Skip to content
NVNEXUS
GPU Comparison

NVIDIA A2 vs NVIDIA H100 NVL

How the NVIDIA A2 and NVIDIA H100 NVL compare across memory, compute, power and form factor, with the stronger figure highlighted on each row.

Specification NVIDIA A2 AMPERE NVIDIA A2 View Product NVIDIA H100 NVL HOPPER NVIDIA H100 NVL View Product
Pricing
Price $39,600.00
Overview
Architecture Ampere Hopper
Memory
Memory 16 GB GDDR6 with ECC 94 GB HBM3
Memory Bandwidth 200 GB/s 3.9 TB/s
Compute
CUDA Cores 1,280
Tensor Cores 40
RT Cores 10
FP32 4.5 TFLOPS 60 TFLOPS
FP64 Tensor 30 TFLOPS / 60 TFLOPS
TF32 Tensor 9 TFLOPS (18 TFLOPS with sparsity) 835 TFLOPS (with sparsity)
FP16/BF16 Tensor 1,671 TFLOPS (with sparsity)
FP8 Tensor 3,341 TFLOPS (with sparsity)
INT8 Tensor 3,341 TOPS
Platform
Interface PCIe Gen4 x8
NVLink NVLink bridges, PCIe Gen5
TDP 40–60W (configurable) 350–400W (configurable)
Form Factor Low-profile, single-slot, passive Dual PCIe dual-slot air cooled
Not sure which fits?

Talk it through with a specialist

Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.

Talk to an Expert

More Comparisons