Fernando Velasco
Blog - peft
    LoRA vs Full Fine-Tuning: A Beautiful Illusion of Equivalence

    LoRA vs Full Fine-Tuning: A Beautiful Illusion of Equivalence

    A critical look at how LoRA fine-tuning actually differs from full fine-tuning — and the 'intruder dimensions' that formalize how LoRA silently forgets part of the pre-training.

    llms fine-tuning peft
© 2026 Fernando Velasco Lozano
Built with Astro · Astrofy template · source
FV
Fernando Velasco
Senior Applied Data Scientist & AI Tech Lead
  • Home
  • Projects
  • Writing
  • CV
  • Contact