“The t5x and seqio libraries have been used to train models with hundreds of billions of parameters on datasets with multiple terabytes of training data.”