Skip to content
NVNEXUS
GPU Comparison

NVIDIA H200 SXM vs NVIDIA RTX 4000 Ada Generation

How the NVIDIA H200 SXM and NVIDIA RTX 4000 Ada Generation compare across memory, compute, power and form factor, with the stronger figure highlighted on each row.

Specification NVIDIA H200 SXM HOPPER NVIDIA H200 SXM View Product NVIDIA RTX 4000 Ada Generation ADA LOVELACE NVIDIA RTX 4000 Ada Generation View Product
Pricing
Price $1,736.40
Overview
Architecture Hopper Ada Lovelace
Memory
Memory 141 GB HBM3e 20 GB GDDR6 with ECC
Memory Bandwidth 4.8 TB/s 360 GB/s
Memory Interface 160-bit
Compute
CUDA Cores 6,144
Tensor Cores 192 (4th Gen)
RT Cores 48 (3rd Gen)
FP32 67 TFLOPS 26.7 TFLOPS
FP16/BF16 Tensor 1,979 TFLOPS
FP8 Tensor 3,958 TFLOPS
INT8 Tensor 3,958 TOPS
Tensor / AI Performance 327.6 TFLOPS (FP8 Sparse)
RT Performance 61.8 TFLOPS
Platform
Interface Gen5 128 GB/s PCIe 4.0 x16
NVLink 900 GB/s (4th Gen)
TDP Up to 700W (configurable) 130W
Form Factor SXM 4.4" H x 9.5" L, Single Slot
Display Outputs 4x DisplayPort 1.4a
Multi-Instance GPU (MIG) Up to 7 instances
Not sure which fits?

Talk it through with a specialist

Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.

Talk to an Expert

More Comparisons