“Low-rank adaptation (LoRA) can be trained on a hardware layout only slightly larger than what is used for sampling due to its lower memory usage compared to full fine-tuning.”