Density. These memories could store much more data than a core memory system in the same volume. Of course, you could write to core memory, too, but that’s not always a requirement.

High Bandwidth Memory (HBM) is the commonly used type of DRAM for data center GPUs like NVIDIA's H200 and AMD's MI325X. High Bandwidth Flash (HBF) is a stack of flash chips with an HBM interface.

As noted in a recent blog post, the current HBM4 doubles channel count per stack with a 2Kbit interface, speed bins up to 6.4Gbps, and options supporting 16-high through-silicon via (TSV) stacks.

By using the 1β process node, Micron says that its second-generation HBM3 stack delivers 2.5x more performance for the same amount of power as an HBM2 stack with 50 percent faster data-transfer ...