Exploring the performance and explainability of fine-tuned BERT models for neuroradiology protocol assignment

Table 2 A comparison of imaging protocol F1 scores

Protocol Name	BERT	RoBERTa	ClinicalBert	BioBERT	DNN	XGBoost	RF	KNN
MR BRAIN DEMYELINATING	0.92	0.92	0.95	0.94	0.91	0.92	0.90	0.75
MR BRAIN MASS/METS/INFECT	0.85	0.85	0.86	0.87	0.77	0.71	0.66	0.59
MR BRAIN MOYA-MOYA DIAMOX	0.96	0.96	0.96	0.98	0.96	0.98	0.97	0.90
MR NASOPHARYNX OROPHARYNX	0.89	0.94	0.93	0.97	0.92	0.93	0.91	0.75
MR ORBIT SINUS FACE	0.85	0.84	0.89	0.88	0.83	0.81	0.75	0.68
MR BRAIN SEIZURE	0.95	0.95	0.96	0.96	0.77	0.78	0.68	0.66
MR SELLA	0.96	0.96	0.97	0.97	0.94	0.94	0.89	0.74
MR SKULL BASE	0.82	0.82	0.89	0.96	0.79	0.74	0.64	0.61
MR STROKE	0.84	0.84	0.88	0.88	0.83	0.79	0.73	0.72
MR VASCULAR MALFORMATION	0.87	0.84	0.89	0.88	0.84	0.83	0.75	0.65
Weighted Average	0.89	0.89	0.91	0.92	0.85	0.84	0.77	0.70

ISSN: 1472-6947