NVIDIA A100 vs NVIDIA B200
NVIDIA B200 comes out ahead of NVIDIA A100 on 7 of the 8 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.
The verdict
NVIDIA B200 takes it, 7–1 on rounds.
On the published figures, NVIDIA B200 takes 7 of 8 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.
Choose NVIDIA A100 if…
- • You want NVIDIA A100's edge on how much power it draws
Choose NVIDIA B200 if…
- • You want NVIDIA B200's edge on how much memory it has and how fast its memory is
Round by round
- Round 1How much memory it hasNVIDIA B200 wins
NVIDIA B200 wins this round on what the company itself publishes.
- Round 2How fast its memory isNVIDIA B200 wins
NVIDIA B200 wins this round on what the company itself publishes.
- Round 3How fast it runs FP16 AI mathNVIDIA B200 winsNVIDIA A1005/10
624 TFLOPS
fp16 tensor core, with sparsity
- 624 TFLOPS, against 4.5 PFLOPS
Source: nvidia.com ↗
NVIDIA B200 wins this round on what the company itself publishes.
- Round 4How much power it drawsNVIDIA A100 wins
NVIDIA A100 wins this round on what the company itself publishes.
- Round 5How fast chips talk to each otherNVIDIA B200 winsNVIDIA A1005/10
600 GB/s NVLink
nvlink gpu-to-gpu
- 600 GB/s NVLink, against 1.8 TB/s NVLink
Source: nvidia.com ↗
NVIDIA B200 wins this round on what the company itself publishes.
- Round 6How it handles scientific FP64 mathNVIDIA B200 wins
NVIDIA B200 wins this round on what the company itself publishes.
- Round 7Which memory generation it usesNVIDIA B200 wins
NVIDIA B200 wins this round on what the company itself publishes.
- Round 8How new it isNVIDIA B200 wins
NVIDIA B200 wins this round on what the company itself publishes.
