Home › AI glossary › HBM
What is HBM?
HBM is a very fast type of memory stacked in layers and placed right next to an AI chip.
- Category Hardware
- Also called high-bandwidth memory
- Updated 20 Oct 2026
HBM, explained simply
HBM stands for high-bandwidth memory. Bandwidth means how much data can move in a second.
The memory chips are stacked like pancakes and sit beside the processor. That short path lets data move very fast.
AI chips need this because models are huge. The chip must read a lot of data constantly, and slow memory would hold it back.
On ITG Now, our daily AI news stories sometimes mention HBM when talking about shortages or chip supply.
Related terms
GPUAI chipVRAMRAMSemiconductorData center
Questions people ask about HBM
HBM vs normal RAM: what is the difference?
Normal RAM sits farther from the chip and moves less data at a time. HBM is stacked and placed close, so it moves far more.
Do I need HBM in my computer?
No. It is used in expensive AI chips in data centers. Home computers use other kinds of memory.
Why does HBM matter for AI?
Large models need data delivered quickly. Fast memory keeps the AI chip from sitting idle.