LoRA

Also: low-rank adaptation

Freezing the original weights and training a small pair of low-rank matrices whose product is added to each one. A few million trainable parameters can move behaviour as much as a full fine-tune, and the result is a file of tens of megabytes.