NVIDIA Hopper GPU to rumored to feature 140 billion transistors

Published: Feb 7th 2022, 12:16 GMT   Comments

Please note that this post is tagged as a rumor.

NVIDIA Hopper with 2.6x the transistors of GA100?

According to a rumor from Chiphell forums, NVIDIA’s next-gen data center GPU called Hopper might feature as many as 140 billion transistors. 

NVIDIA A100 (Ampere), Source: NVIDIA

Chiphell user Zhangzhonghao did not actually mention GH100 or any other GPU by its name, however, the context clearly refers to NVIDIA’s upcoming 5nm GPU codename Hopper. It is said that more than 140 billion transistors might be used by this AI processor.

The most recent rumors put Hopper GPUs among the largest processors ever made. It was said that might even feature a 900 mm² die, but many enthusiasts are rightly skeptical of this claim because the current EUV photomask (reticle) limit is 858 mm².

Furthermore, it is said that Hopper architecture might actually span into multiple designs, one of them (GH100) being a monolithic chip while rumored GH102 might actually be a multi-chip-module design. One should mention here is that there were also rumors about another Ampere data-center chip called GA101 (supposedly of half of the size of GA100), but this GPU was never released.

The Hopper architecture is set to compete against already-announced AMD Aldebaran GPU and Intel’s upcoming Ponte Vecchio. This might be the first time all three companies will at the same time have powerful accelerators with HBM2e memory and Multi-Chip-Module design.

NVIDIA has never acknowledged its Hopper architecture release plans, but the word on the street is that they might announce this architecture at GTC 2022 in March.

High Performance Computing GPUs
VideoCardz.comNVIDIA GH100NVIDIA GA100AMD AldebaranIntel Ponte Vecchio
Picture[ not available ]
ArchitectureNVIDIA HopperNVIDIA AmpereAMD CDNA2Intel Xe-HPC
Fabrication NodeTSMC N5TSMC N7TSMC N6Intel 7 (base)
TSMC N7 (Xe-Link)
TSMC N5 (compute tile)
Full Transistor Count>140B54.2B58.2Bover 100B
Base Tile(2x?) ~900 mm²~826 mm²2x ~790 mm²2x 640 mm²
MemoryTBCup to 80GB, 5x HBM2eup to 128GB, 8x HBM2eup to 128GB, 8x HBM2e
GPU Cores(2x?) ~134 SMs108 SMs2x 110 Compute Units128 Xe Cores
L2/L3 CacheTBC40MB2x 8MB2x 204 MB
Form FactorSXM? (~1000W)SXM4 (400W)
PCIe Gen4 (300W)
PCIe Gen5
Announcement DateQ2 2022?Q4 2020Q4 20212022

Source: Chiphell via @9550pro, Wccftech

Comment Policy
  1. Comments must be written in English and should not exceed 1000 characters.
  2. Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  3. Comments and usernames containing language or concepts that could be deemed offensive will be deleted.
  4. Comments complaining about the post subject or its source will be removed.
  5. A failure to comply with these rules will result in a warning and, in extreme cases, a ban. In addition, please note that comments that attack or harass an individual directly will result in a ban without warning.
  6. VideoCardz has never been sponsored by AMD, Intel, or NVIDIA. Users claiming otherwise will be banned.
  7. VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  8. If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy