I'm a developer and I want to fine-tune small LLMs for my own use case

Basic — Understand the Architecture

Language Modeling from First Principlesbeginner

Build a predictive-text engine from scratch — the next-word suggestions behind a phone keyboard

8 sections · Google, Apple, Microsoft

Build GPT from Scratchadvanced

Build a decoder-only GPT language model from scratch in PyTorch and generate text with it

10 sections · OpenAI, Google DeepMind, Anthropic

Advanced — Fine-Tune for a Domain

LoRA from Scratch — Parameter-Efficient Fine-Tuningadvanced

Build a LoRA adapter from scratch — freeze a pretrained weight and learn a low-rank update in its place

9 sections · Hugging Face, Microsoft, Databricks

Legal-Clause GPT — Fine-Tune GPT-2 on Contractsintermediate

Fine-tune GPT-2 on real legal contract clauses so it tags a clause with its type

9 sections · Harvey, Casetext, LexisNexis