NVIDIA preparing more H100 Hopper cards with 94GB and 64GB memory options

Published: Jun 26th 2023, 09:55 GMT   Comments

Please note that this post is tagged as a rumor.

NVIDIA H100 with 64GB and 94GB memory

NVIDIA is reportedly adding more options based on the Hopper architecture.

According to the recent update to the PCI Device ID list, NVIDIA might add more variants of the H100 Hopper data-center accelerator. One of the contributors to the public PCI ID list claims that SXM5 based models are in the works featuring 94GB and 64GB of memory. The fact that these cards would utilize the SXM5 form factor would suggest we are looking at HBM memory, possibly of HBM3 design.

Nevertheless, the 94GB memory configuration is a bit unusual, and it is unclear how are HBM stacks configured exactly. However, this is not the first H100 card to launch with 94GB of memory, as there is a H100 NVL (for Large Language Models) with the same memory configuration. NVIDIA did not explain how 94GB memory is achieved, but it is likely due to HBM production and yields reasons. It may be more convenient to disable layers in the stack than the whole stack.

NVIDIA H100 94/64GB options, Source: PCI-ID list

Additionally, a 64GB model is considered, which could be achieved with four out of six stacks featuring 16GB of capacity. What this essentially means that NVIDIA might soon have four memory options for its H100 GPU series and that’s probably not the full list.

It is worth keeping in mind that the H100 was also spotted with an even higher memory capacity of 120GB. Thus far, there was no official confirmation or even a driver PCI ID leak that would confirm such a variant though.

VideoCardz.com NVIDIA Hopper Data-Center Series
PCI Device IDSKUInterface
2313H100 CNX 80GBPCIe Gen5 x16
2321 H100 NVL 94GBSXM5
2322H800 (China)PCIe Gen5 x16
2324H800 (China)SXM5
2330H100 80GB
2331H100PCIe Gen5 x16
2336H100 80/96GBSXM5
2337H100 64GBSXM5
2339H100 94GBSXM5
233AH800L 94GB (China)SXM5
233dH100 96GBSXM5
????H100 120GBPCIe Gen5 x16

Source: PCI ID list

Comment Policy
  1. Comments must be written in English and should not exceed 1000 characters.
  2. Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  3. Comments and usernames containing language or concepts that could be deemed offensive will be deleted.
  4. Comments complaining about the post subject or its source will be removed.
  5. A failure to comply with these rules will result in a warning and, in extreme cases, a ban. In addition, please note that comments that attack or harass an individual directly will result in a ban without warning.
  6. VideoCardz has never been sponsored by AMD, Intel, or NVIDIA. Users claiming otherwise will be banned.
  7. VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  8. If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy