CHAPTER 00 · Start Here: Foundational Modelling, Explained Simply · 3 / 4
Chapter map
- The Transformer: the engine inside every modern model
- Scaling Laws and Chinchilla: how big should a model be?
- Alignment: turning a text predictor into a helpful assistant (RLHF and DPO)
- LoRA: fine-tuning giant models on a budget
- Mixtral and Mixture of Experts: more brain, same speed
- Judging models: how do we measure quality?
- Glossary: every key term, explained from zero