Fig 2

(Left) Original pre-trained BERT that is trained to perform ‘next sentence prediction (NSP)’ and ‘masked-language modeling (MLM)’. Special classification [CLS] and separator [SEP] tokens are inserted into the input to facilitate learning. (Right) BERT is fine-tuned for this classification task using labeled data from physician entries. The output is a class label corresponding to the assigned protocol