“Low-rank adaptation (LoRA) enables multi-tenant serving, where a single inference server can keep many adapters in memory and sample from them simultaneously in a batched way.”