An animated walkthrough of everything above, step by step.
Everything described in this article, in one place, with the numbers of our toy model. Press Play, or step through at your own pace, and watch "I speak Esperanto" become tokens, IDs and vectors, then watch "anto" gather context through attention, get corrected by the classic network, and produce a prediction. Every number on screen is one you can find, and check, in chapters 02 and 05.