All drills

Build a Two-Tower Retrieval Engine

What you'll be able to do

Build the candidate-generation layer that sits under every large recommender — the stage that turns a catalog of millions into a shortlist of hundreds, fast enough to run on every request.

YouTube, Netflix, Spotify, and Pinterest all run two-tower retrieval in front of their rankers; it is also the architecture behind modern semantic search and RAG retrieval.
Start this internship
Create an account to unlock the 11 sections, the workbench, and AskThili.
Begin

Sections

1. Build a Two-Tower Retrieval Engine
🔒 locked
2. The Retrieval Problem
🔒 locked
3. Two Towers
🔒 locked
4. In-Batch Negatives
🔒 locked
5. The Popularity Trap
🔒 locked
6. Evaluating Retrieval
🔒 locked
7. Indexing the Towers
🔒 locked
8. Recall vs Latency
🔒 locked
9. Cold Start
🔒 locked
10. Retrieval → Ranking
🔒 locked
11. Ship It
🔒 locked

Dig deeper

📄Deep Neural Networks for YouTube Recommendations (Covington, Adams & Sargin, 2016, RecSys)
paper
📄Sampling-Bias-Corrected Neural Modeling for Large Corpus Item Recommendations (Yi et al., 2019, RecSys)
paper
📄Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs (Malkov & Yashunin, 2016)
paper
📄Billion-scale similarity search with GPUs (Johnson, Douze & Jégou, 2017)
paper
🔗thili-ai/thilitower — the reference implementation you build in this course
code