Nib asked for
Spelling Out Fixes Counting
When the model writes a word letter by letter, each letter becomes its own visible token, so counting turns from a shaky memory task into a simple check of items on the page.
4 steps, drawn by Nib. Read it here, or watch him draw it. Updated .
1hidden chunks
Recall the problem from the last pages: 'strawberry' reaches the model as a couple of chunk-numbers, and the r's are buried inside them. Asked 'how many r's?' straight away, the model must recall a letter fact about those chunks from weak, indirect training. That is a memory lookup, and it can fail.
Counting straight from the chunks is a memory lookup, and memory is shaky here.
a common mix-upThe model fails because it is careless or can't do basic counting.
2letter tokens
Now suppose the model writes the word out first: s-t-r-a-w-b-e-r-r-y. Each letter, separated by hyphens or spaces, is typically tokenized as its own small piece. Letters that were invisible inside a chunk are now individual items, each with its own token.
Writing it out turns hidden letters into separate, visible tokens.
After spelling the word out, can the model 'see' each r as its own item?
Show the answer
Yes. Each spaced-out letter is its own token, so every r is a separate visible item.
3reads itself
Here is the key point: the model reads everything it has already written as part of its input when choosing the next word. So the spelled-out letters are now sitting in front of it. Counting becomes looking at a list and tallying matches, something it does reliably, rather than recalling a fact it half-learned.
What it writes becomes input it can read, so counting becomes checking, not recalling.
a common mix-upThe model's earlier writing is gone once produced; it only 'thinks' silently.
4running tally
It can go further by numbering as it tallies: s, t, r (1), a, w, b, e, r (2), r (3), y. Each step is small and local, one letter at a time, so there is little room to slip. The answer, three, is read off the tally instead of guessed.
A running tally makes each step small, so the final count is read off, not guessed.
Why is a step-by-step tally less error-prone than answering at once?
Show the answer
Each step only checks one visible letter, instead of recalling hidden letter facts for the whole word.
So when a chatbot miscounts, ask it to spell the word out first: you're not tricking it, you're giving it letters it can actually see.