NVIDIA A2 vs NVIDIA H100 NVL
How the NVIDIA A2 and NVIDIA H100 NVL compare across memory, compute, power and form factor, with the stronger figure highlighted on each row.
| Specification |  AMPERE NVIDIA A2 View Product → |  HOPPER NVIDIA H100 NVL View Product → |
|---|---|---|
| Pricing | ||
| Price | – | €28,380.00 |
| Overview | ||
| Architecture | Ampere | Hopper |
| Memory | ||
| Memory | 16 GB GDDR6 with ECC | 94 GB HBM3 |
| Memory Bandwidth | 200 GB/s | 3.9 TB/s |
| Compute | ||
| CUDA Cores | 1,280 | – |
| Tensor Cores | 40 | – |
| RT Cores / Ray Accelerators | 10 | – |
| FP32 | 4.5 TFLOPS | 60 TFLOPS |
| FP64 Tensor | – | 30 TFLOPS / 60 TFLOPS |
| TF32 Tensor | 9 TFLOPS (18 TFLOPS with sparsity) | 835 TFLOPS (with sparsity) |
| FP16/BF16 Tensor | – | 1,671 TFLOPS (with sparsity) |
| FP8 Tensor | – | 3,341 TFLOPS (with sparsity) |
| INT8 Tensor | – | 3,341 TOPS |
| Platform | ||
| Interface | PCIe Gen4 x8 | – |
| NVLink / Infinity Fabric | – | NVLink bridges, PCIe Gen5 |
| TDP | 40–60W (configurable) | 350–400W (configurable) |
| Form Factor | Low-profile, single-slot, passive | Dual PCIe dual-slot air cooled |
Not sure which fits?
Talk to an Expert → Talk it through with a specialist
Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.
More Comparisons
- NVIDIA A2 vs NVIDIA A10 →
- NVIDIA A2 vs NVIDIA A100 80GB →
- NVIDIA A2 vs NVIDIA A16 →
- NVIDIA A2 vs NVIDIA B200 →
- NVIDIA A2 vs AMD Instinct MI210 →
- NVIDIA A2 vs AMD Instinct MI300X →
- NVIDIA H100 NVL vs NVIDIA H100 SXM →
- NVIDIA H100 NVL vs NVIDIA H200 NVL →
- NVIDIA H100 NVL vs NVIDIA H200 SXM →
- NVIDIA H100 NVL vs NVIDIA A10 →