05See for yourself how it works
The whole toy model in one animation, from "I speak Esperanto" to the next word, step by step.
Everything described in this article, in one place, with the numbers of our toy model. Press Play, or step through at your own pace, and watch "I speak Esperanto" become tokens, IDs and vectors, then watch "anto" gather context through attention, get corrected by the classic network, and produce a prediction. Every number on screen is one you can find, and check, in chapters 1 to 3, and replay in the companion spreadsheet.