NVIDIA H100 SXM5 vs NVIDIA GeForce RTX 2080 Ti

GPU · Specs Compare

Products
GPU NVIDIA H100 SXM5 NVIDIA · 2022-03
GPU NVIDIA GeForce RTX 2080 Ti NVIDIA · 2018-09
Graphics Card
Release Date
Mar 2022
Sep 2018
Generation
Tesla Hopper
GeForce 20
Type
AI GPU
Desktop
Bus Interface
PCIe 5.0 x16
PCIe 3.0 x16
Clock Speeds
Base Clock
1590 MHz
1350 MHz
Boost Clock
1980 MHz
1545 MHz
Memory Clock
1313 MHz
1750 MHz
Memory
Memory Size
80GB
11GB
Memory Type
HBM3
GDDR6
Memory Bus
5120bit
352bit
Bandwidth
3350GB/s
616.0GB/s
Render Config
SM Count
132
68
Shading Units
16896
4352
TMUs
528
272
ROPs
24
88
Tensor Cores
528
544
L1 Cache
256 KB (per SM)
64 KB (per SM)
L2 Cache
50 MB
0 MB
RT Cores
—
68
Theoretical Performance
Pixel Rate
47.52 GPixel/s
136.0 GPixel/s
Texture Rate
1045 GTexel/s
420.2 GTexel/s
FP16 (half)
267.6 TFLOPS
26.90 TFLOPS
FP32 (float)
66.91 TFLOPS
13.45 TFLOPS
FP64 (double)
33.45 TFLOPS
420.2 GFLOPS
Graphics Processor
GPU Name
GH100
TU102
Architecture
Hopper
Turing
Foundry
TSMC
TSMC
Process Size
4 nm
12 nm
Transistors
80 billion
18.6 billion
Die Size
814 mm²
754 mm²
GPU Variant
—
TU102-300A-K1-A1
Board Design
TDP
700W
250W
Suggested PSU
1100 W
600 W
Outputs
No outputs
1x HDMI 2.03x DisplayPort 1.4a1x USB Type-C
Power Connectors
8-pin EPS
2x 8-pin
Graphics Features
DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
3.0
Vulkan
N/A
1.4
CUDA
9.0
7.5
Shader Model
N/A
6.8
▲ Specs Compare Data sourced from official specifications and benchmark tests.