AMD Instinct MI350X vs NVIDIA L40S
How the AMD Instinct MI350X and NVIDIA L40S compare across memory, compute, power and form factor, with the stronger figure highlighted on each row. Vendor-specific figures (CUDA vs stream processors, Tensor vs matrix cores) are listed on their own rows.
| Specification | CDNA 4 AMD Instinct MI350X NVIDIA alternative: NVIDIA B200 → |  ADA LOVELACE NVIDIA L40S View Product → |
|---|---|---|
| Pricing | ||
| Price | Not sold by NVNexus | $11,160.00 |
| Overview | ||
| Architecture | AMD CDNA 4 | Ada Lovelace |
| Memory | ||
| Memory | 288 GB HBM3E | 48 GB GDDR6 with ECC |
| Memory Bandwidth | 8 TB/s | – |
| Memory Interface | 8192-bit | – |
| Compute | ||
| Stream Processors (AMD) | 16,384 (256 CUs) | – |
| Matrix Cores / AI Accelerators (AMD) | 1,024 | – |
| FP32 | 144.2 TFLOPS | 91.6 TFLOPS |
| FP64 Tensor | 72.1 TFLOPS | – |
| TF32 Tensor | – | 366 TFLOPS (Sparse) |
| FP16/BF16 Tensor | 2.3 PFLOPS / 4.6 (sparse) TFLOPS | 733 TFLOPS (Sparse) |
| FP8 Tensor | 4.6 PFLOPS / 9.2 (sparse) TFLOPS | 1,466 TFLOPS (Sparse) |
| FP4 Tensor | 9.2 PFLOPS TFLOPS | – |
| RT Performance | – | 212 TFLOPS |
| Platform | ||
| Interface | PCIe Gen5 x16 | PCIe Gen4 |
| NVLink / Infinity Fabric | Infinity Fabric, 1,075 GB/s aggregate | – |
| TDP | 1000W | 350W |
| Form Factor | OAM module (8-GPU platform) | PCIe dual-slot |
| Cooling | Air cooled | – |
| Transistors | 185 billion | – |
Not sure which fits?
Talk to an Expert → Talk it through with a specialist
Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.
More Comparisons
- AMD Instinct MI350X vs AMD Instinct MI355X →
- AMD Instinct MI350X vs AMD Instinct MI210 →
- AMD Instinct MI350X vs AMD Instinct MI300X →
- AMD Instinct MI350X vs AMD Instinct MI325X →
- AMD Instinct MI350X vs NVIDIA B200 →
- AMD Instinct MI350X vs NVIDIA A10 →
- NVIDIA L40S vs NVIDIA L4 →
- NVIDIA L40S vs NVIDIA L40 →
- NVIDIA L40S vs NVIDIA RTX 2000 Ada Generation →
- NVIDIA L40S vs NVIDIA RTX 4000 Ada Generation →