NVIDIA A16 vs AMD Instinct MI350X
How the NVIDIA A16 and AMD Instinct MI350X compare across memory, compute, power and form factor, with the stronger figure highlighted on each row. Vendor-specific figures (CUDA vs stream processors, Tensor vs matrix cores) are listed on their own rows.
| Specification |  AMPERE NVIDIA A16 View Product → | CDNA 4 AMD Instinct MI350X NVIDIA alternative: NVIDIA B200 → |
|---|---|---|
| Pricing | ||
| Price | – | Not sold by NVNexus |
| Overview | ||
| Architecture | Ampere | AMD CDNA 4 |
| Memory | ||
| Memory | 64 GB GDDR6 ECC (4× 16 GB) | 288 GB HBM3E |
| Memory Bandwidth | 4× 232 GB/s | 8 TB/s |
| Memory Interface | – | 8192-bit |
| Compute | ||
| CUDA Cores | 5,120 (4× 1,280) | – |
| Stream Processors (AMD) | – | 16,384 (256 CUs) |
| Tensor Cores | 160 (4× 40) | – |
| Matrix Cores / AI Accelerators (AMD) | – | 1,024 |
| RT Cores / Ray Accelerators | 40 (4× 10) | – |
| FP32 | – | 144.2 TFLOPS |
| FP64 Tensor | – | 72.1 TFLOPS |
| FP16/BF16 Tensor | – | 2.3 PFLOPS / 4.6 (sparse) TFLOPS |
| FP8 Tensor | – | 4.6 PFLOPS / 9.2 (sparse) TFLOPS |
| FP4 Tensor | – | 9.2 PFLOPS TFLOPS |
| Platform | ||
| Interface | PCIe Gen4 x16 | PCIe Gen5 x16 |
| NVLink / Infinity Fabric | – | Infinity Fabric, 1,075 GB/s aggregate |
| TDP | 250W | 1000W |
| Form Factor | Dual-slot, full-height, passive | OAM module (8-GPU platform) |
| GPUs per Board | 4 | – |
| Cooling | – | Air cooled |
| Transistors | – | 185 billion |
Not sure which fits?
Talk to an Expert → Talk it through with a specialist
Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.
More Comparisons
- NVIDIA A16 vs NVIDIA A10 →
- NVIDIA A16 vs NVIDIA A100 80GB →
- NVIDIA A16 vs NVIDIA A2 →
- NVIDIA A16 vs NVIDIA B200 →
- NVIDIA A16 vs AMD Instinct MI210 →
- NVIDIA A16 vs AMD Instinct MI300X →
- AMD Instinct MI350X vs AMD Instinct MI355X →
- AMD Instinct MI350X vs AMD Instinct MI210 →
- AMD Instinct MI350X vs AMD Instinct MI300X →
- AMD Instinct MI350X vs AMD Instinct MI325X →