NVIDIA Hopper H100 data-center GPU spotted with 120GB HBM2e memory

Published: Sep 26th 2022, 07:40 GMT   Comments

NVIDIA working on H100 with 120GB

A mysterious PCIe-based graphics card called G100 120GB has been spotted running alongside RTX 3090 Ti and RTX 4090 ES. 

Powered by GH100 processor, the 120GB variant is just as fast as the SXM variant, the report from s-ss claims. A screenshot published by the website shows a supposed H100 processor with 120GB of HBM2e memory, however unlike the existing 80GB model, this variant has increased bandwidth to 3 TB/s.

Such bandwidth is only available with the SXM variant (NVIDIA proprietary mezzanine connector) which is unlocked for higher power, but this model also uses HBM3. Worth noting, to support 120GB of capacity, each of the five working stacks would have to be 24GB.

Furthermore, the H100 120GB PCIe reportedly has the same GPU specs as the SXM variant, which in this case means 16896 CUDA Cores and 528 Tensors.

Alleged NVIDIA H100 120GB PCIe, Source: S-SS

What is interesting about this leak is that the sample of H100 120GB PCIe was listed in a Windows Device Manager alongside ‘RTX ADLCE Engineering Sample’. The ADLCE obviously stands for Ada Lovelace, and it is a preproduction unit with TDP limited to 350W (final specs are 450W). As a result, the single-precision compute performance is said to be limited to 60 TFLOPs (retail unit has 82 TFLOPS).

NVIDIA Data-Center GPUs Specifications
VideoCardz.comNVIDIA H100 SXMNVIDIA H100 120GB PCIeNVIDIA H100 80GB PCIe
Die Size814 mm²814 mm²814 mm²
Fabrication NodeTSMC 4N TSMC 4N TSMC 4N
GPU Clusters132132114
CUDA Cores168961689614592
L2 Cache50MB50MB50MB
Tensor Cores528528456
Memory Bus5120-bit5120-bit5120-bit
Memory Size80 GB HBM3120GB HBM2e80GB HBM2e
InterfaceSXM5PCIe Gen5PCIe Gen5
Launch Year202220222022

Source: s-ss via MegaSizeGPU

Comment Policy
  1. Comments must be written in English.
  2. Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  3. Comments and usernames containing language or concepts that could be deemed offensive will be deleted.
  4. Comments complaining about the post subject or its source will be removed.
  5. A failure to comply with these rules will result in a warning and, in extreme cases, a ban. In addition, please note that comments that attack or harass an individual directly will result in a ban without warning.
  6. VideoCardz has never been sponsored by AMD, Intel, or NVIDIA. Users claiming otherwise will be banned.
  7. VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  8. If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy