NVIDIA introduces A2 Tensor Core GPU with GA107 GPU and 16GB GDDR6 memory

Published: Nov 9th 2021, 16:02 GMT   Comments

NVIDIA A2 is a low-power accelerator for AI

Today NVIDIA launches its entry-level edge interference accelerator.

NVIDIA continues to add more SKUs to its Data Center Ampere lineup. The series which we used to call “Tesla” are now using a much simpler naming, albeit a lot more confusing. The A2 Tensor Core is the entry-level accelerator featuring 8nm Ampere GA107 GPU with 1280 CUDA Cores, half of what the processor offers in a full-fat version.

The A2 has a lot in common with the A16, which is based on four GA107 GPUs. Both accelerators have 16GB GDDR6 memory across the 128-bit interface, except for each GPU. That said the A16 offers 64GB of memory, but also consumes a lot more power: 250W. The A2 on the other hand is a very power-efficient solution with TBP at 60W maximum, but the GPU can be set to 40W as well. Thus it does not require external power.

With a base clock of 1440 MHz and a boost clock of 1770 MHz, the GPU offers up to 4.5 TFLOPS of single-precision compute power. This is actually even less than NVIDIA GeForce RTX 3050 Ti mobile at 7.1 TFLOPs, but the gaming GPU has 2048 CUDA cores.

NVIDIA A2 Tensor Core Specifications, Source: NVIDIA

The accelerator is being compared to entry-level Turing T4 which was the slowest accelerator from the previous generation. According to NVIDIA will be 20 to 30% faster than T4 in intelligent edge use cases. It is also to offer 60% better price to performance and 10% better power efficiency compared to the T4.

NVIDIA A2 Tensor Core
Peak FP324.5 TF
TF32 Tensor Core9 TF | 18 TF¹
BFLOAT16 Tensor Core18 TF | 36 TF¹
Peak FP16 Tensor Core18 TF | 36 TF¹
Peak INT8 Tensor Core36 TOPS | 72 TOPS¹
Peak INT4 Tensor Core72 TOPS | 144 TOPS¹
RT Cores10
Media engines1 video encoder
2 video decoders (includes AV1 decode)
GPU memory16GB GDDR6
GPU memory bandwidth200GB/s
InterconnectPCIe Gen4 x8
Form factor1-slot, low-profile PCIe
Max thermal design power (TDP)40–60W (configurable)
Virtual GPU (vGPU) software support²NVIDIA Virtual PC (vPC), NVIDIA Virtual Applications (vApps), NVIDIA RTX Virtual Workstation (vWS), NVIDIA AI Enterprise, NVIDIA Virtual Compute Server (vCS)

The A2 is a headless accelerator that cannot be used for gaming unless it is used through a virtual machine environment. It is optimized for AI inference workloads. It is meant to be a cost-effective and highly compatible server GPU thanks to its single-slot and passive design. NVIDIA does not publicly reveal pricing for its server GPU such as the A2, but the company did confirm it is now available to OEM partners.

NVIDIA Ampere Data Center GPUs
VideoCardz.comGPUCUDA / TensorMemoryFP32 ComputeTDP
NVIDIA A100GA100-884/8836912 / 43240/80GB HBM2e 5120b 1.94 TB/s19.5 TFLOPS400W/250W
NVIDIA A40GA102-89510752 / 67248GB G6 384b 696 GB/s37.4 TFLOPS300W
NVIDIA A30GA100-8903584 / 22424GB HBM2e 3072b 933 GB/s10.3 TFLOPS165W
NVIDIA A164x GA107-???5120 / 1604x 16GB G6 128b 200 GB/s18 TFLOPS250W
NVIDIA A2GA107-???1280 / 4016GB G6 128b 200GB/s4.5 TFLOPS40-60W

Source: NVIDIA via AnandTech

Comment Policy
  1. Comments must be written in English and should not exceed 1000 characters.
  2. Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  3. Comments and usernames containing language or concepts that could be deemed offensive will be deleted.
  4. Comments complaining about the post subject or its source will be removed.
  5. A failure to comply with these rules will result in a warning and, in extreme cases, a ban. In addition, please note that comments that attack or harass an individual directly will result in a ban without warning.
  6. VideoCardz has never been sponsored by AMD, Intel, or NVIDIA. Users claiming otherwise will be banned.
  7. VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  8. If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy