Tokenisation
Also called: tokenization
In one sentence
The process of cutting text into tokens before a model reads it.
In more depth
Because the model manipulates tokens rather than characters, character-level tasks — counting letters, reversing a word, some rhyming — work against its representation and fail in ways that look strange next to its other abilities.