Skip to content
NVNEXUS
GPU Comparison

NVIDIA A16 vs AMD Instinct MI355X

How the NVIDIA A16 and AMD Instinct MI355X compare across memory, compute, power and form factor, with the stronger figure highlighted on each row. Vendor-specific figures (CUDA vs stream processors, Tensor vs matrix cores) are listed on their own rows.

Specification NVIDIA A16 AMPERE NVIDIA A16 View Product CDNA 4 AMD Instinct MI355X NVIDIA alternative: NVIDIA B200
Pricing
Price Not sold by NVNexus
Overview
Architecture Ampere AMD CDNA 4
Memory
Memory 64 GB GDDR6 ECC (4× 16 GB) 288 GB HBM3E
Memory Bandwidth 4× 232 GB/s 8 TB/s
Memory Interface 8192-bit
Compute
CUDA Cores 5,120 (4× 1,280)
Stream Processors (AMD) 16,384 (256 CUs)
Tensor Cores 160 (4× 40)
Matrix Cores / AI Accelerators (AMD) 1,024
RT Cores / Ray Accelerators 40 (4× 10)
FP32 157.3 TFLOPS
FP64 Tensor 78.6 TFLOPS
FP16/BF16 Tensor 2.5 PFLOPS / 5 (sparse) TFLOPS
FP8 Tensor 5 PFLOPS / 10.1 (sparse) TFLOPS
FP4 Tensor 10.1 PFLOPS TFLOPS
Platform
Interface PCIe Gen4 x16 PCIe Gen5 x16
NVLink / Infinity Fabric Infinity Fabric, 1,075 GB/s aggregate
TDP 250W 1400W
Form Factor Dual-slot, full-height, passive OAM module (8-GPU platform)
GPUs per Board 4
Cooling Liquid cooled
Transistors 185 billion
Not sure which fits?

Talk it through with a specialist

Tell us your workload and we will recommend the right GPU, configuration, and sourcing options.

Talk to an Expert

More Comparisons