One idea to hold in your head

Almost everything in this folder is a variation on a single trick: predict the next word. A language model is trained by hiding the next word in billions of sentences and asking the model to guess it. That is it. Everything else, the architecture, the scaling, the alignment, is about making that one trick work better and behave the way we want. Keep that anchor in mind and the rest will click into place.

Ready? Start with Chapter 1: The Transformer.