← Library
Fundamentals of LoRA and low-rank fine-tuning
A Nebius deep dive into how LoRA updates a low-rank decomposition of weight matrices (W' = BA) to match full fine-tuning at a fraction of the cost, plus newer variants like PiSSA and DoRA.tokenfactory
The full write-up lives on the original source — use the link above to read it.