Skip to content
ITG Now
Follow

Home › AI glossary › HBM

What is HBM?

Short answer

HBM is a very fast type of memory stacked in layers and placed right next to an AI chip.

  • Category Hardware
  • Also called high-bandwidth memory
  • Updated 20 Oct 2026
Share

HBM, explained simply

HBM stands for high-bandwidth memory. Bandwidth means how much data can move in a second.

The memory chips are stacked like pancakes and sit beside the processor. That short path lets data move very fast.

AI chips need this because models are huge. The chip must read a lot of data constantly, and slow memory would hold it back.

On ITG Now, our daily AI news stories sometimes mention HBM when talking about shortages or chip supply.

GPUAI chipVRAMRAMSemiconductorData center

Questions people ask about HBM

HBM vs normal RAM: what is the difference?

Normal RAM sits farther from the chip and moves less data at a time. HBM is stacked and placed close, so it moves far more.

Do I need HBM in my computer?

No. It is used in expensive AI chips in data centers. Home computers use other kinds of memory.

Why does HBM matter for AI?

Large models need data delivered quickly. Fast memory keeps the AI chip from sitting idle.

Sources

Last updated

Share

Browse all 200 AI terms