Token

A token is the basic unit of text — and increasingly of other modalities — that a language model processes. Tokens are typically subword units produced by a tokenizer: common words may be a single token, while less common words, technical terms, or words with unusual morphology may be split into multiple tokens. Token counts determine context window utilization, inference compute cost, and API billing across LLM providers.

← Back to Glossary