a book, drawn by Nib

How machines learn

What a language model actually does with your words, from tokens up to transformers: drawn, and runnable in the page.

  1. Why can’t AI count the r’s in “strawberry”?

    See exactly what GPT-2, GPT-4 and GPT-4o receive when you ask about “strawberry”, then train your own tokenizer on Alice in Wonderland and watch letters fuse into tokens.