Token
A token is a chunk of text, usually a word or part of a word, and it is the unit AI search actually reads and counts.
In a little more detail
Roughly speaking a hundred tokens is about seventy-five English words. It matters mainly because everything AI search charges for, remembers or truncates is measured in tokens rather than pages.
Related terms
- Context window: A context window is the maximum amount of text AI search can hold in mind at once, counted in tokens.
- LLM: An LLM, or large language model, is the program underneath AI search: software trained on an enormous amount of text that predicts what words should come next.
See it on your own site
The scan reads your site the way AI search does and reports where you stand on this and sixteen other checks.