Fine-tuning remains a cornerstone technique for adapting general-purpose pre-trained large language models (LLMs) models (also called foundation models) to serve more specialized, high-value downstream tasks, even as zero- and few-shot methods gain traction.