“Text encoders have remained largely unchanged and have not scaled as rapidly as decoders since the introduction of the BERT architecture.”