Skip to content
NVNEXUS
GPU Comparison

AMD Instinct MI325X vs NVIDIA L4

How the AMD Instinct MI325X and NVIDIA L4 compare across memory, compute, power and form factor, with the stronger figure highlighted on each row. Vendor-specific figures (CUDA vs stream processors, Tensor vs matrix cores) are listed on their own rows.

Specification CDNA 3 AMD Instinct MI325X NVIDIA alternative: NVIDIA H200 SXM NVIDIA L4 ADA LOVELACE NVIDIA L4 View Product
Pricing
Price Not sold by NVNexus $3,958.80
Overview
Architecture AMD CDNA 3 Ada Lovelace
Memory
Memory 256 GB HBM3E 24 GB GDDR6
Memory Bandwidth 6 TB/s 300 GB/s
Memory Interface 8192-bit
Compute
Stream Processors (AMD) 19,456 (304 CUs)
Matrix Cores / AI Accelerators (AMD) 1,216
FP32 163.4 TFLOPS (matrix) 30.3 TFLOPS
FP64 Tensor 163.4 TFLOPS (matrix)
TF32 Tensor 653.7 TFLOPS / 1,307 (sparse) 120 TFLOPS (Sparse)
FP16/BF16 Tensor 1,307 TFLOPS / 2,615 (sparse) 242 TFLOPS (Sparse)
FP8 Tensor 2,615 TFLOPS / 5,230 (sparse) 485 TFLOPS (Sparse)
INT8 Tensor 2,615 TOPS / 5,230 (sparse) 485 TOPS (Sparse)
Platform
Interface PCIe Gen5 x16 PCIe Gen4 x16
NVLink / Infinity Fabric Infinity Fabric, 896 GB/s aggregate
TDP 1000W 72W
Form Factor OAM module (8-GPU platform) Single-slot, low-profile, passive cooling
Cooling Passive (chassis airflow)
Transistors 153 billion
Not sure which fits?

Talk it through with a specialist

Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.

Talk to an Expert

More Comparisons