NVIDIA DGX-A100 with eight “Ampere” Tesla A100 detailed

Published: May 14th 2020, 08:01 GMT   Comments

NVIDIA Ampere GA100 GPU to feature 54 billion transistors.

NVIDIA Tesla A100

This is the world’s largest GPU and NVIDIA’s first manufactured in the 7nm fabrication process. NVIDIA GA100 features 54 billion transistors, which more than twice of what Volta GV100 had to offer (21B).

NVIDIA claims that the GPU will be 20x more powerful than Volta GPU in AI-training (single-precision operations) and AI interference (8-bit integer operations). In terms of high-performance computing (double precision operations) NVIDIA says that the GPU will be 2.5 faster.

“With this new precision, A100 offers 20 times more compute for single-precision AI, and because developers can continue to use the inputs as single-precision and get outputs back as single-precision, they do not need to do anything differently. They benefit from this acceleration automatically out of the box,”

  • NVIDIA Kharya, director of product management for accelerated computing at Nvidia

NVIDIA Ampere features third-generation Tensor cores called TF32 designed for AI. New Tensor Cores now support FP64 numbers, which is a key upgrade for HPC applications. It means that the GPU will have much higher double-precision performance.


The DGX A100 system features eight Tesla A100 accelerations, offering up to 5 petaflops of performance. In NVIDIA’s own numbers, each of the Teslas offers 20x more peak performance than Volta-based DGX systems.

While the former generation was designed only with AI-operations in mind, DGX A100 is also scale-up applications (data analytics) and scale-out applications (inference).

NVIDIA is happy to demonstrate that a single rack of DGX1 system replaced 25 data center racks with CPUs, but only requiring 1/20 of the power and 1/10 of the investment.

NVIDIA also confirmed that the DGX A100 systems are already in operation in the US Department of Energy (Aragone National laboratory), where they are used to fight Covid-19.

Each of the DGX-A100 systems will cost 200,000 USD. The systems are already shipping.

Source: EETimes (removed)


Comment Policy
  1. Comments must be written in English and should not exceed 1000 characters.
  2. Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  3. Comments and usernames containing language or concepts that could be deemed offensive will be deleted.
  4. Comments complaining about the post subject or its source will be removed.
  5. A failure to comply with these rules will result in a warning and, in extreme cases, a ban. In addition, please note that comments that attack or harass an individual directly will result in a ban without warning.
  6. VideoCardz has never been sponsored by AMD, Intel, or NVIDIA. Users claiming otherwise will be banned.
  7. VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  8. If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy