NVIDIA H200 vs NVIDIA GB200
NVIDIA GB200 comes out ahead of NVIDIA H200 on 6 of the 8 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.
The verdict
NVIDIA GB200 takes it, 6–2 on rounds.
On the published figures, NVIDIA GB200 takes 6 of 8 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.
Choose NVIDIA H200 if…
- • You want NVIDIA H200's edge on how much power it draws and how it handles scientific fp64 math
Choose NVIDIA GB200 if…
- • You want NVIDIA GB200's edge on how much memory it has and how fast its memory is
Round by round
- Round 1How much memory it hasNVIDIA GB200 wins
NVIDIA GB200 wins this round on what the company itself publishes.
- Round 2How fast its memory isNVIDIA GB200 wins
NVIDIA GB200 wins this round on what the company itself publishes.
- Round 3How fast it runs FP8 AI mathNVIDIA GB200 winsNVIDIA H2005/10
3,958 TFLOPS
fp8 tensor core, with sparsity
- 3,958 TFLOPS, against 10 PFLOPS
Source: nvidia.com ↗
NVIDIA GB200 wins this round on what the company itself publishes.
- Round 4How fast it runs FP16 AI mathNVIDIA GB200 winsNVIDIA H2005/10
1,979 TFLOPS
fp16 tensor core, with sparsity
- 1,979 TFLOPS, against 5 PFLOPS
Source: nvidia.com ↗
NVIDIA GB200 wins this round on what the company itself publishes.
- Round 5How much power it drawsNVIDIA H200 wins
NVIDIA H200 wins this round on what the company itself publishes.
- Round 6How fast chips talk to each otherNVIDIA GB200 winsNVIDIA H2005/10
900 GB/s NVLink
nvlink gpu-to-gpu
- 900 GB/s NVLink, against 1.8 TB/s NVLink
Source: nvidia.com ↗
NVIDIA GB200 wins this round on what the company itself publishes.
- Round 7How it handles scientific FP64 mathNVIDIA H200 winsNVIDIA GB2005/10
40 TFLOPS
fp64/fp64 tensor core
- 40 TFLOPS, against 67 TFLOPS
Source: dam-cdn.nvd.orangelogic.com ↗
NVIDIA H200 wins this round on what the company itself publishes.
- Round 8How new it isNVIDIA GB200 wins
NVIDIA GB200 wins this round on what the company itself publishes.
Side by side
- 141 GB HBM3e, against 186 GB HBM3E
- 4.8 TB/s, against 8 TB/s
- 3,958 TFLOPS, against 10 PFLOPS
- 1,979 TFLOPS, against 5 PFLOPS
- 1,200 W, against 700 W
- 40 TFLOPS, against 67 TFLOPS
- 186 GB HBM3E, against 288 GB HBM3E
- 40 TFLOPS, against 78.6 TFLOPs