ModernBERT, like BERT, is an encoder-only model. Encoder-only models have the characteristic of outputting a 'list of numbers ... By passing the encoded data to a decoder-only model, ...