BioClinical-ModernBERT-base

Model ID: google-bert/bert-base-uncased Model name: bert-base-uncased Author: Google‑BERT Pipeline tag: fill‑mask bert-base-uncased is the original BERT‑Base architecture released by Google Research in 2018.

Model ID: FacebookAI/xlm‑roberta‑base Model Name: xlm‑roberta‑base Author: FacebookAI Downloads: 21,932,797 License: unknown Tags: transformers, pytorch, tf, jax, onnx, safetensors, xlm‑roberta, fill‑mask, exbert, multilingual

It learns bidirectional contextual representations by randomly masking 15 % of tokens in a sentence and forcing the network to predict those tokens. The model is case‑sensitive, meaning it distinguishes “english” from “English”.

FacebookAI/roberta‑base is a 125‑million‑parameter transformer encoder released by Facebook AI. It is a pre‑trained English language model that learns to predict masked tokens (the Masked Language Modeling – MLM – objective).