Skip to content
NVNEXUS
info@nvnexus.com
Talk to an Expert →
GPU Comparison

AMD Instinct MI355X vs NVIDIA H100 NVL

How the AMD Instinct MI355X and NVIDIA H100 NVL compare across memory, compute, power and form factor, with the stronger figure highlighted on each row. Vendor-specific figures (CUDA vs stream processors, Tensor vs matrix cores) are listed on their own rows.

Specification CDNA 4 AMD Instinct MI355X NVIDIA alternative: NVIDIA B200 → NVIDIA H100 NVL HOPPER NVIDIA H100 NVL View Product →
Pricing
Price Not sold by NVNexus $39,600.00
Overview
Architecture AMD CDNA 4 Hopper
Memory
Memory 288 GB HBM3E 94 GB HBM3
Memory Bandwidth 8 TB/s 3.9 TB/s
Memory Interface 8192-bit –
Compute
Stream Processors (AMD) 16,384 (256 CUs) –
Matrix Cores / AI Accelerators (AMD) 1,024 –
FP32 157.3 TFLOPS 60 TFLOPS
FP64 Tensor 78.6 TFLOPS 30 TFLOPS / 60 TFLOPS
TF32 Tensor – 835 TFLOPS (with sparsity)
FP16/BF16 Tensor 2.5 PFLOPS / 5 (sparse) TFLOPS 1,671 TFLOPS (with sparsity)
FP8 Tensor 5 PFLOPS / 10.1 (sparse) TFLOPS 3,341 TFLOPS (with sparsity)
FP4 Tensor 10.1 PFLOPS TFLOPS –
INT8 Tensor – 3,341 TOPS
Platform
Interface PCIe Gen5 x16 –
NVLink / Infinity Fabric Infinity Fabric, 1,075 GB/s aggregate NVLink bridges, PCIe Gen5
TDP 1400W 350–400W (configurable)
Form Factor OAM module (8-GPU platform) Dual PCIe dual-slot air cooled
Cooling Liquid cooled –
Transistors 185 billion –
Not sure which fits?

Talk it through with a specialist

Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.

Talk to an Expert →

More Comparisons