NVIDIA Tesla A100 features 6912 CUDA Cores
The card features 7nm Ampere GA100 GPU with 6912 CUDA cores and 432 Tensor cores. This GPU has a die size of 826mm2 and 54-billion transistors. The GPU is divided into 108 Streaming Multiprocessors. The GPU in Tesla A100 is clearly not the full chip.
The card features third-generation NVLINK with bi-directional bandwidth of 4.8 TB/s with the server and 600 GB/s in GPU to GPU interconnection.
Tesla A100 features 40GB of HBM2 memory across 5120 memory bus.