Skip to content
ITG Now
Follow

Home › AI glossary › Tokens per second

What does tokens per second mean?

Short answer

Tokens per second is how fast an AI writes its answer, counted in small pieces of text called tokens.

  • Category Benchmarks
  • Also called tokens/s, tok/s
  • Updated 20 Oct 2026
Share

Tokens per second, explained simply

A token is a small chunk of text, like part of a word. Tokens per second counts how many the AI produces each second.

A higher number means the answer streams out faster. Lower is slower.

This matters when you wait for long answers, like a big piece of code or a long summary.

Speed depends on the model, the computer running it, and how busy it is. A faster model isn't always a better one.

On ITG Now, the AI models page shows output speed in tokens per second, next to quality scores.

TokenLatencyInferenceGPUBenchmarkLocal AI

Where you'll see it on ITG Now

Questions people ask about Tokens per second

Is a higher tokens per second number better?

Yes for speed. It means the text appears faster, but it says nothing about quality.

How many words is a token?

A token is often a bit less than one word. Short words may be one token, and long words may be several.

Does my computer change tokens per second?

Yes, if you run a model locally. A stronger graphics chip and more memory usually help.

Sources

Last updated

Share

Browse all 200 AI terms