AMD Instinct MI325X vs NVIDIA L4
How the AMD Instinct MI325X and NVIDIA L4 compare across memory, compute, power and form factor, with the stronger figure highlighted on each row. Vendor-specific figures (CUDA vs stream processors, Tensor vs matrix cores) are listed on their own rows.
| Specification | CDNA 3 AMD Instinct MI325X NVIDIA alternative: NVIDIA H200 SXM → | ADA LOVELACE NVIDIA L4 View Product → |
|---|---|---|
| Pricing | ||
| Price | Not sold by NVNexus | $3,958.80 |
| Overview | ||
| Architecture | AMD CDNA 3 | Ada Lovelace |
| Memory | ||
| Memory | 256 GB HBM3E | 24 GB GDDR6 |
| Memory Bandwidth | 6 TB/s | 300 GB/s |
| Memory Interface | 8192-bit | – |
| Compute | ||
| Stream Processors (AMD) | 19,456 (304 CUs) | – |
| Matrix Cores / AI Accelerators (AMD) | 1,216 | – |
| FP32 | 163.4 TFLOPS (matrix) | 30.3 TFLOPS |
| FP64 Tensor | 163.4 TFLOPS (matrix) | – |
| TF32 Tensor | 653.7 TFLOPS / 1,307 (sparse) | 120 TFLOPS (Sparse) |
| FP16/BF16 Tensor | 1,307 TFLOPS / 2,615 (sparse) | 242 TFLOPS (Sparse) |
| FP8 Tensor | 2,615 TFLOPS / 5,230 (sparse) | 485 TFLOPS (Sparse) |
| INT8 Tensor | 2,615 TOPS / 5,230 (sparse) | 485 TOPS (Sparse) |
| Platform | ||
| Interface | PCIe Gen5 x16 | PCIe Gen4 x16 |
| NVLink / Infinity Fabric | Infinity Fabric, 896 GB/s aggregate | – |
| TDP | 1000W | 72W |
| Form Factor | OAM module (8-GPU platform) | Single-slot, low-profile, passive cooling |
| Cooling | Passive (chassis airflow) | – |
| Transistors | 153 billion | – |
Not sure which fits?
Talk to an Expert → Talk it through with a specialist
Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.
More Comparisons
- AMD Instinct MI325X vs AMD Instinct MI300X →
- AMD Instinct MI325X vs AMD Instinct MI210 →
- AMD Instinct MI325X vs AMD Instinct MI350X →
- AMD Instinct MI325X vs AMD Instinct MI355X →
- AMD Instinct MI325X vs NVIDIA H200 SXM →
- AMD Instinct MI325X vs NVIDIA A10 →
- NVIDIA L4 vs NVIDIA L40 →
- NVIDIA L4 vs NVIDIA L40S →
- NVIDIA L4 vs NVIDIA RTX 2000 Ada Generation →
- NVIDIA L4 vs NVIDIA RTX 4000 Ada Generation →