NVIDIA H100 SXM with 4nm Hopper GPU and 80GB HBM3 memory has been pictured up close

Published: 5th May 2022, 16:16 GMT   Comments

NVIDIA H100 pictured up close

More than a month after GTC 2022 (conference), ServeTheHome is finally allowed to publish the photos of the NVIDIA’s  latest data-center GPU. 

NVIDIA H100 is an upcoming accelerator featuring 4 nm GPU made in Hopper architecture. Thus far we have only seen renders of this solution, but thanks to ServeTheHome we now get to see the new design of the SXM form factor in real photos. They confirm that the device has a board model called “PG520”:

NVIDIA H100 SXM 80GB GPU, Source: Patrick Kennedy/ServeTheHome

The H100 is using TSMC CoWoS packing technology with a 814 mm² large GH100 GPU die and six memory modules around. This variant features 16896 CUDA cores and ship with 80 GB of HBM3 memory. The SXM mezzanine connectors layout has changed compared to A100. Instead of two long connectors on each side of the GPU, one is now shorter.

This Hopper solution consumes up to 700W of power, which is 250W to 300W more than previous SXM data-center GPUs based on Ampere and Volta architectures.

NVIDIA H100 SXM 80GB GPU, Source: Patrick Kennedy/ServeTheHome

The H100 has recently appeared in Japan for pre-order at 33,000 USD. The only difference was that the card on sale was the PCIe Gen5 based model, whereas the card above is the SXM variant with more CUDA cores, more memory and higher power.

NVIDIA Data-Center GPUs Specifications
VideoCardz.comNVIDIA H100NVIDIA A100NVIDIA Tesla V100NVIDIA Tesla P100
Picture
GPUGH100GA100GV100GP100
Transistors80B54.2B21.1B15.3B
Die Size814 mm²828 mm²815 mm²610 mm²
ArchitectureHopperAmpereVoltaPascal
Fabrication NodeTSMC N4TSMC N712nm FFN16nm FinFET+
GPU Clusters132/114*1088056
CUDA Cores16896/14592*691251203584
L2 Cache50MB40MB6MB4MB
Tensor Cores528/456*432320
Memory Bus5120-bit5120-bit4096-bit4096-bit
Memory Size80 GB HBM3/HBM2e*40/80GB HBM2e16/32 HBM216GB HBM2
TDP700W/350W*250W/300W/400W250W/300W/450W250W/300W
InterfaceSXM5/*PCIe Gen5SXM4/PCIe Gen4SXM2/PCIe Gen3SXM/PCIe Gen3
Launch Year2022202020172016

Source: ServeTheHome




Comment Policy
  • Comments must be written in English.
  • Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  • Comments and usernames containing language or concepts that could be deemed offensive will be deleted. Note this may include abusive, threatening, pornographic, offensive, misleading, or libelous language.
  • Comments complaining about the article subject or its source will be removed.
  • A failure to comply with these rules will result in a warning and, in extreme cases, a ban. Please also note that comments that attack or harass an individual directly will result in a ban without warning.
  • VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  • If you would like to appeal for a comment section ban to be removed, please use this page.
  • If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy
Comments