SK Hynix shows off its 24GB HBM3 6.4 Gbps memory at OCP Summit

Published: Nov 11th 2021, 16:40 GMT   Comments

SK hynix HBM3 memory shown at OCP Summit 2021

ServeTheHome spotted next-generation high-bandwidth-memory out in the wild.

SK Hynix HBM3, Source: SK Hynix

SK Hynix only recently confirmed they have developed 24GB HBM3 memory with up to 819 GB/s bandwidth per stack. The next-gen memory for high-performance computing products such as GPUs and possibly CPUs will require even more capacity and higher bandwidth, which is where HBM3 comes in.

JEDEC, which is a body responsible for HBM3, has not yet published the final specifications of the new standard. Hynix has updated the specs from initial 5.2 Gbps to 6.4 Gbps, but it is unclear which specs are closer to whatever the company plans to mass-produce for next-gen accelerators.

SK Hynix HBM3, Source: ServerTheHome

The module that was already shown features 12 stacks each attached to a 1024-bit interface. While controller bus width has not changed since HBM2, a higher number of stacks in addition to higher frequency increases the bandwidth per stack from 461 GB/s to 819 GB/s. A comparison chart has been put together by AnandTech:

SK Hynix HBM Memory Comparison
Max Capacity
24 GB
16 GB
8 GB
Max Bandwidth Per Pin
6.4 Gb/s
3.6 Gb/s
2.0 Gb/s
Number of DRAM ICs per Stack
Effective Bus Width
1.2 V
1.2 V
Bandwidth per Stack
819.2 GB/s
460.8 GB/s
256 GB/s

High Bandwidth Memory comparison, Source: Anandtech

AMD Instinct MI250X accelerator, which was announced just this Monday, offers 8 HBM2e stacks clocked at 3.2 Gbps. Each features 16GB of capacity, thus the whole device offers 128 GB. Meanwhile, TSMC had already revealed its plans for CoWoS-S (Chip-on-Wafer-on-Substrate) packaging technology featuring up to 12 HBM stacks. The first products featuring this technology are now expected in 2023.

By the time such products launch, the HBM3 should be widely available, so theoretically a product featuring twelve 12Hi HBM3 stacks from SK Hynix would offer 288 GB of capacity and up to 9.8 TB/s of maximum bandwidth.

AMD Instinct MI250X & TSMC CoWoS-S Gen4-6, Source: AMD/TSMC

Source: ServerTheHome via Andreas Schilling

The following video is timestamped
[ServeTheHome] WILD Cloud Hardware at OCP Summit 2021 (36,595 views)

Comment Policy
  1. Comments must be written in English and should not exceed 1000 characters.
  2. Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  3. Comments and usernames containing language or concepts that could be deemed offensive will be deleted.
  4. Comments complaining about the post subject or its source will be removed.
  5. A failure to comply with these rules will result in a warning and, in extreme cases, a ban. In addition, please note that comments that attack or harass an individual directly will result in a ban without warning.
  6. VideoCardz has never been sponsored by AMD, Intel, or NVIDIA. Users claiming otherwise will be banned.
  7. VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  8. If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy