NVIDIA H100 SXM vs NVIDIA L40
How the NVIDIA H100 SXM and NVIDIA L40 compare across memory, compute, power and form factor, with the stronger figure highlighted on each row.
| Specification |  HOPPER NVIDIA H100 SXM View Product → |  ADA LOVELACE NVIDIA L40 View Product → |
|---|---|---|
| Pricing | ||
| Price | – | €7,740.00 |
| Overview | ||
| Architecture | Hopper | Ada Lovelace (4nm) |
| Memory | ||
| Memory | 80 GB HBM3 | 48 GB GDDR6 with ECC |
| Memory Bandwidth | 3.35 TB/s | 864 GB/s |
| Memory Interface | – | 384-bit |
| Compute | ||
| CUDA Cores | – | 18,176 |
| Tensor Cores | – | 568 |
| RT Cores / Ray Accelerators | – | 142 |
| FP32 | 67 TFLOPS | – |
| FP64 Tensor | 67 TFLOPS | – |
| TF32 Tensor | 989 TFLOPS | – |
| FP16/BF16 Tensor | 1,979 TFLOPS | – |
| FP8 Tensor | 3,958 TFLOPS | – |
| INT8 Tensor | 3,958 TOPS | – |
| Platform | ||
| Interface | Gen5 128 GB/s | PCIe Gen4 x16 |
| NVLink / Infinity Fabric | 900 GB/s (4th Gen) | – |
| TDP | Up to 700W (configurable) | 300W |
| Form Factor | SXM | 4.4" H × 10.5" L, dual slot, passive |
| Display Outputs | – | 4× DisplayPort 1.4a |
| Multi-Instance GPU (MIG) | Up to 7 instances (10GB each) | – |
Not sure which fits?
Talk to an Expert → Talk it through with a specialist
Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.
More Comparisons
- NVIDIA H100 SXM vs NVIDIA H100 NVL →
- NVIDIA H100 SXM vs NVIDIA H200 NVL →
- NVIDIA H100 SXM vs NVIDIA H200 SXM →
- NVIDIA H100 SXM vs NVIDIA A10 →
- NVIDIA H100 SXM vs AMD Instinct MI300X →
- NVIDIA H100 SXM vs AMD Instinct MI210 →
- NVIDIA L40 vs NVIDIA L4 →
- NVIDIA L40 vs NVIDIA L40S →
- NVIDIA L40 vs NVIDIA RTX 2000 Ada Generation →
- NVIDIA L40 vs NVIDIA RTX 4000 Ada Generation →