Walking through the full LoRA fine-tuning code — loading TinyLlama, configuring LoRA, training on the Alpaca dataset, and testing the result.
8 min read
• #ai#fine-tuning#llm
Topic: #fine-tuning
A collection of 3 posts about fine-tuning.
How LoRA works, how quantization reduces memory, and how QLoRA combines both for efficient fine-tuning.
8 min read
• #ai#fine-tuning#llm
The fundamentals of fine-tuning a large language model — from data preparation and hyperparameters to the training loop and evaluation.
6 min read
• #ai#fine-tuning#llm