Skip to content
NVNEXUS
info@nvnexus.com
Talk to an Expert →
GPU Comparison

AMD Instinct MI325X vs NVIDIA H200 SXM

How the AMD Instinct MI325X and NVIDIA H200 SXM compare across memory, compute, power and form factor, with the stronger figure highlighted on each row. Vendor-specific figures (CUDA vs stream processors, Tensor vs matrix cores) are listed on their own rows.

Specification CDNA 3 AMD Instinct MI325X NVIDIA alternative: NVIDIA H200 SXM → NVIDIA H200 SXM HOPPER NVIDIA H200 SXM View Product →
Pricing
Price Not sold by NVNexus –
Overview
Architecture AMD CDNA 3 Hopper
Memory
Memory 256 GB HBM3E 141 GB HBM3e
Memory Bandwidth 6 TB/s 4.8 TB/s
Memory Interface 8192-bit –
Compute
Stream Processors (AMD) 19,456 (304 CUs) –
Matrix Cores / AI Accelerators (AMD) 1,216 –
FP32 163.4 TFLOPS (matrix) 67 TFLOPS
FP64 Tensor 163.4 TFLOPS (matrix) –
TF32 Tensor 653.7 TFLOPS / 1,307 (sparse) –
FP16/BF16 Tensor 1,307 TFLOPS / 2,615 (sparse) 1,979 TFLOPS
FP8 Tensor 2,615 TFLOPS / 5,230 (sparse) 3,958 TFLOPS
INT8 Tensor 2,615 TOPS / 5,230 (sparse) 3,958 TOPS
Platform
Interface PCIe Gen5 x16 Gen5 128 GB/s
NVLink / Infinity Fabric Infinity Fabric, 896 GB/s aggregate 900 GB/s (4th Gen)
TDP 1000W Up to 700W (configurable)
Form Factor OAM module (8-GPU platform) SXM
Multi-Instance GPU (MIG) – Up to 7 instances
Cooling Passive (chassis airflow) –
Transistors 153 billion –
Not sure which fits?

Talk it through with a specialist

Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.

Talk to an Expert →

More Comparisons