Legal-Clause GPT — Fine-Tune GPT-2 on Contracts

What you'll be able to do

✓Fine-tune GPT-2 on real legal contract clauses so it tags a clause with its type
✓Load and explore the LEDGAR legal-clause dataset from the Hugging Face Hub
✓Reframe a classification task as causal generation using special <Label> tokens
✓Extend a pretrained tokenizer with new tokens and resize the model's embeddings to match
✓Train with the Hugging Face Trainer, then save and reload your fine-tuned model
✓Generate the clause type for an unseen clause and measure how often it is right

Build the clause-tagging engine behind contract-review tools — hand it "This agreement shall be governed by the laws of Delaware" and it answers <Governing Laws>, the way Harvey and Casetext read contracts at scale.

⌁ Domain fine-tuning is how legal-AI products are built — Harvey, Casetext (CoCounsel), LexisNexis, and Thomson Reuters adapt general LLMs to contracts, case law, and clauses.

Start this internship

Create an account to unlock the 9 sections, the workbench, and AskThili.

Begin