Skip to content
NVNEXUS
info@nvnexus.com
Talk to an Expert →
GPU Comparison

AMD Instinct MI350X vs NVIDIA H200 NVL

How the AMD Instinct MI350X and NVIDIA H200 NVL compare across memory, compute, power and form factor, with the stronger figure highlighted on each row. Vendor-specific figures (CUDA vs stream processors, Tensor vs matrix cores) are listed on their own rows.

Specification CDNA 4 AMD Instinct MI350X NVIDIA alternative: NVIDIA B200 → NVIDIA H200 NVL HOPPER NVIDIA H200 NVL View Product →
Pricing
Price Not sold by NVNexus $41,400.00
Overview
Architecture AMD CDNA 4 Hopper
Memory
Memory 288 GB HBM3E 141 GB HBM3e
Memory Bandwidth 8 TB/s 4.8 TB/s
Memory Interface 8192-bit –
Compute
Stream Processors (AMD) 16,384 (256 CUs) –
Matrix Cores / AI Accelerators (AMD) 1,024 –
FP32 144.2 TFLOPS 67 TFLOPS
FP64 Tensor 72.1 TFLOPS 34 TFLOPS / 67 TFLOPS
FP16/BF16 Tensor 2.3 PFLOPS / 4.6 (sparse) TFLOPS –
FP8 Tensor 4.6 PFLOPS / 9.2 (sparse) TFLOPS 3,958 TFLOPS (with sparsity)
FP4 Tensor 9.2 PFLOPS TFLOPS –
Platform
Interface PCIe Gen5 x16 –
NVLink / Infinity Fabric Infinity Fabric, 1,075 GB/s aggregate NVIDIA NVLink (900 GB/s), PCIe Gen5 (128 GB/s)
TDP 1000W Up to 600W (configurable)
Form Factor OAM module (8-GPU platform) PCIe dual-slot air cooled
Multi-Instance GPU (MIG) – Up to 7 MIGs @ 18 GB each
Decoders – 7 NVDEC, 7 JPEG
Cooling Air cooled –
Transistors 185 billion –
Not sure which fits?

Talk it through with a specialist

Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.

Talk to an Expert →

More Comparisons