NVIDIA introduces A2 Tensor Core GPU with GA107 GPU and 16GB GDDR6 memory

Published: 9th Nov 2021, 16:02 GMT   Comments

NVIDIA A2 is a low-power accelerator for AI

Today NVIDIA launches its entry-level edge interference accelerator.

NVIDIA continues to add more SKUs to its Data Center Ampere lineup. The series which we used to call “Tesla” are now using a much simpler naming, albeit a lot more confusing. The A2 Tensor Core is the entry-level accelerator featuring 8nm Ampere GA107 GPU with 1280 CUDA Cores, half of what the processor offers in a full-fat version.

The A2 has a lot in common with the A16, which is based on four GA107 GPUs. Both accelerators have 16GB GDDR6 memory across the 128-bit interface, except for each GPU. That said the A16 offers 64GB of memory, but also consumes a lot more power: 250W. The A2 on the other hand is a very power-efficient solution with TBP at 60W maximum, but the GPU can be set to 40W as well. Thus it does not require external power.

With a base clock of 1440 MHz and a boost clock of 1770 MHz, the GPU offers up to 4.5 TFLOPS of single-precision compute power. This is actually even less than NVIDIA GeForce RTX 3050 Ti mobile at 7.1 TFLOPs, but the gaming GPU has 2048 CUDA cores.

NVIDIA A2 Tensor Core Specifications, Source: NVIDIA

The accelerator is being compared to entry-level Turing T4 which was the slowest accelerator from the previous generation. According to NVIDIA will be 20 to 30% faster than T4 in intelligent edge use cases. It is also to offer 60% better price to performance and 10% better power efficiency compared to the T4.

NVIDIA A2 Tensor Core
VideoCardzPerformance
Peak FP324.5 TF
TF32 Tensor Core9 TF | 18 TF¹
BFLOAT16 Tensor Core18 TF | 36 TF¹
Peak FP16 Tensor Core18 TF | 36 TF¹
Peak INT8 Tensor Core36 TOPS | 72 TOPS¹
Peak INT4 Tensor Core72 TOPS | 144 TOPS¹
RT Cores10
Media engines1 video encoder
2 video decoders (includes AV1 decode)
GPU memory16GB GDDR6
GPU memory bandwidth200GB/s
InterconnectPCIe Gen4 x8
Form factor1-slot, low-profile PCIe
Max thermal design power (TDP)40–60W (configurable)
Virtual GPU (vGPU) software support²NVIDIA Virtual PC (vPC), NVIDIA Virtual Applications (vApps), NVIDIA RTX Virtual Workstation (vWS), NVIDIA AI Enterprise, NVIDIA Virtual Compute Server (vCS)

The A2 is a headless accelerator that cannot be used for gaming unless it is used through a virtual machine environment. It is optimized for AI inference workloads. It is meant to be a cost-effective and highly compatible server GPU thanks to its single-slot and passive design. NVIDIA does not publicly reveal pricing for its server GPU such as the A2, but the company did confirm it is now available to OEM partners.

NVIDIA Ampere Data Center GPUs
VideoCardz.comGPUCUDA / TensorMemoryFP32 ComputeTDP
NVIDIA A100GA100-884/8836912 / 43240/80GB HBM2e 5120b 1.94 TB/s19.5 TFLOPS400W/250W
NVIDIA A40GA102-89510752 / 67248GB G6 384b 696 GB/s37.4 TFLOPS300W
NVIDIA A30GA100-8903584 / 22424GB HBM2e 3072b 933 GB/s10.3 TFLOPS165W
NVIDIA A164x GA107-???5120 / 1604x 16GB G6 128b 200 GB/s18 TFLOPS250W
NVIDIA A2GA107-???1280 / 4016GB G6 128b 200GB/s4.5 TFLOPS40-60W

Source: NVIDIA via AnandTech




Comment Policy
  • Comments must be written in English.
  • Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic.
  • Comments and usernames containing language or concepts that could be deemed offensive will be deleted. Note this may include abusive, threatening, pornographic, offensive, misleading, or libelous language.
  • Comments complaining about the article subject or its source will be removed.
  • A failure to comply with these rules will result in a warning and, in extreme cases, a ban.
  • Please note that comments that attack or harass an individual directly will be deleted and such comments will result in a ban.
  • VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  • If you would like to appeal for a comment section ban to be removed, please use this page.
  • If you have any questions about the commenting policy, please let us know through the Contact Page.
  • NEW: Due to the recent increased amount of spam all links will require moderator approval. 
Hide Comment Policy
Comments