NVIDIA H100 GPU features TSMC N4 process, HBM3 memory, PCIe Gen5, 700W TDP

Published: 22nd Mar 2022, 14:06 GMT   Comments

NVIDIA H100 Specs

Some details on NVIDIA’s next-gen AI accelerator have leaked just an hour ahead of the announcement. 

Contrary to the rumors that NVIDIA H100 based on Hopper architecture will be using TSMC N5, NVIDIA today announced that its latest accelerator will be using a custom TSMC N4 process technology. The rumors were also wrong about the transistors count. This monolithic GPU is build with 80 billion transistors. The chip features up to 16896 FP32 CUDA cores for the SXM variant and 14592 cores for the PCIe based model.

NVIDIA H100 Specifications, Source: NVIDIA

NVIDIA H100 has HBM3 memory with 3 TB/s of bandwidth, this is 1.5x more than A100. This next-gen accelerator features 80GB of High-Bandwidth-Memory. The technology will depend on the variant though, the SXM model has HBM3 rated at 3TB/s whereas the PCIe based H100 GPU has HBM2e rated at 2TB/s.

In terms of performance, NVIDIA is claiming 3X higher compute power in FP64, TF32, FP16 and 6x higher in FP8 than A100.

The accelerator will be using PCIE Gen5 or SXM form factor. The latter will have a TDP of 700W, exactly 300W more than A100.

NVIDIA Grace SuperChips Specifications, Source: VideoCardz

NVIDIA is also launching two ARM-based Grace CPU platforms today. One features Grace CPU combined with Hopper GPU featuring 600GB of memory, whereas the other features two Grace CPUs with a total of 144 cores. It will be equipped with LPDDR5X memory. Both Grace SuperChips will be available in the first half of 2023.

RUMORED NVIDIA Data-Center GPUs Specifications
VideoCardz.comNVIDIA H100NVIDIA A100NVIDIA Tesla V100NVIDIA Tesla P100
Picture
GPUGH100GA100GV100GP100
Transistors80B54.2B21.1B15.3B
Die Size814 mm²828 mm²815 mm²610 mm²
ArchitectureHopperAmpereVoltaPascal
Fabrication NodeTSMC N4TSMC N712nm FFN16nm FinFET+
GPU Clusters132/114*1088056
CUDA Cores16896/14592*691251203584
L2 Cache50MB40MB6MB4MB
Tensor Cores528/456*432320
Memory Bus5120-bit5120-bit4096-bit4096-bit
Memory Size80 GB HBM3/HBM2e*40/80GB HBM2e16/32 HBM216GB HBM2
TDP700W/350W*250W/300W/400W250W/300W/450W250W/300W
InterfaceSXM5/*PCIe Gen5SXM4/PCIe Gen4SXM2/PCIe Gen3SXM/PCIe Gen3
Launch Year2022202020172016



Comment Policy
  • Comments must be written in English.
  • Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  • Comments and usernames containing language or concepts that could be deemed offensive will be deleted. Note this may include abusive, threatening, pornographic, offensive, misleading, or libelous language.
  • Comments complaining about the article subject or its source will be removed.
  • A failure to comply with these rules will result in a warning and, in extreme cases, a ban. Please also note that comments that attack or harass an individual directly will result in a ban without warning.
  • VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  • If you would like to appeal for a comment section ban to be removed, please use this page.
  • If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy
Comments