Walking through the full LoRA fine-tuning code — loading TinyLlama, configuring LoRA, training on the Alpaca dataset, and testing the result.
8 min read
• #ai#fine-tuning#llm
A collection of 2 posts about lora.
Walking through the full LoRA fine-tuning code — loading TinyLlama, configuring LoRA, training on the Alpaca dataset, and testing the result.
How LoRA works, how quantization reduces memory, and how QLoRA combines both for efficient fine-tuning.