Glossary · Term

HBM

Also known as: high bandwidth memory

HBM is a high-speed memory attached to an AI chip. It is the flagship product of SK Hynix and Samsung Electronics and is a key component of the AI semiconductor boom.

HBM, which stands for high bandwidth memory, is an ultra-high-speed memory that dramatically widens the path through which data travels by stacking memory chips vertically like an apartment. No matter how fast the GPU calculates, if it does not receive data on time, it is idle, and HBM acts as a pipe that supplies that data at ultra-high speed.

AI learning and inference requires constant movement of enormous data, which creates a bottleneck with general memory, so HBM is essential next to NVIDIA's AI accelerator. As demand exploded along with the AI semiconductor boom, it became a market where SK Hynix, Samsung Electronics, and Micron competed. In particular, SK Hynix took the lead and became the new flagship product of the Korean semiconductor industry.

Unlike general memory, it is characterized by being close to customer customization and the process difficulty being so high that not just anyone can make it. HBM supply capacity and yield are often mentioned as variables that determine the performance and stock price of semiconductor companies.

✅ Why it matters

⚠️ Limits and debates

← View all glossary entries