NVIDIA A16 PCIe vs AMD Radeon Instinct MI300A

GPU · Specs Compare

Products
GPU NVIDIA A16 PCIe NVIDIA · 2021-04
GPU AMD Radeon Instinct MI300A AMD · 2023-12
Graphics Card
Release Date
Apr 2021
Dec 2023
Generation
Tesla
Radeon Instinct
Type
Desktop
Desktop
Bus Interface
PCIe 4.0 x8
PCIe 5.0 x16
Clock Speeds
Base Clock
885 MHz
1000 MHz
Boost Clock
1695 MHz
2100 MHz
Memory Clock
1812 MHz
2525 MHz
Memory
Memory Size
16GB
192GB
Memory Type
GDDR6
HBM3
Memory Bus
128bit
8192bit
Bandwidth
231.9GB/s
10.3TB/s
Render Config
SM Count
10
—
Shading Units
1280
19456
TMUs
40
1216
ROPs
32
0
Tensor Cores
40
1216
RT Cores
10
—
L1 Cache
128 KB (per SM)
16 KB (per CU)
L2 Cache
2 MB
16 MB
Compute Units
—
304
L3 Cache
—
256 MB
Theoretical Performance
Pixel Rate
54.24 GPixel/s
0 MPixel/s
Texture Rate
67.80 GTexel/s
2554 GTexel/s
FP16 (half)
4.339 TFLOPS
653.7 TFLOPS
FP32 (float)
4.339 TFLOPS
81.72 TFLOPS
FP64 (double)
135.6 GFLOPS
81.72 TFLOPS
Graphics Processor
GPU Name
GA107
Aqua Vanjaram
Architecture
Ampere
CDNA 3.0
Foundry
Samsung
TSMC
Process Size
8 nm
5 nm
Transistors
Unknown
153 billion
Die Size
Unknown
1017 mm²
Board Design
TDP
250W
750W
Suggested PSU
600 W
1150 W
Outputs
No outputs
No outputs
Power Connectors
8-pin EPS
None
Graphics Features
DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
8.6
—
Shader Model
6.6
N/A
Benchmark
Blender
510
—
▲ Specs Compare Data sourced from official specifications and benchmark tests.