Skip to content
ITG Now
Follow

Home › AI glossary › Compute

What does compute mean in AI?

Short answer

Compute is the computing power used to train and run AI, mostly made up of chips, time and electricity.

  • Category Hardware
  • Updated 20 Oct 2026
Share

Compute, explained simply

In AI, compute means how much computer work is available. More chips running for longer means more compute.

Training a big model takes a huge amount of it. Running the model for millions of users takes a lot more.

That is why compute is often called a limit on AI. Companies compete for chips and data center space.

On ITG Now, our daily AI news stories often mention compute when companies talk about training big models.

GPUAI chipData centerTrainingInferenceFLOPs

Where you'll see it on ITG Now

Questions people ask about Compute

Why is compute so important for AI?

Better models usually need more training work. Compute decides how large a model a company can build and serve.

Is compute the same as a chip?

No. Chips supply compute, along with power and time. Compute is the total amount of work you can do.

Do I need a lot of compute to use AI?

No. Online AI tools use the company's compute. You only need your own if you run big models at home.

Sources

Last updated

Share

Browse all 200 AI terms