NVIDIA A100 vs NVIDIA H100
NVIDIA H100 comes out ahead of NVIDIA A100 on 6 of the 7 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.
The verdict
NVIDIA H100 takes it, 6–1 on rounds.
On the published figures, NVIDIA H100 takes 6 of 7 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.
Choose NVIDIA A100 if…
- • You want NVIDIA A100's edge on how much power it draws
Choose NVIDIA H100 if…
- • You want NVIDIA H100's edge on how fast its memory is and how fast it runs fp16 ai math
Round by round
- Round 1How fast its memory isNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 2How fast it runs FP16 AI mathNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 3How much power it drawsNVIDIA A100 wins
NVIDIA A100 wins this round on what the company itself publishes.
- Round 4How fast chips talk to each otherNVIDIA H100 winsNVIDIA A1005/10
600 GB/s NVLink
nvlink gpu-to-gpu
- 600 GB/s NVLink, against 900 GB/s NVLink
Source: nvidia.com ↗
NVIDIA H100 wins this round on what the company itself publishes.
- Round 5How it handles scientific FP64 mathNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 6Which memory generation it usesNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 7How new it isNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
Side by side
- 80 GB HBM2e, against 128 GB HBM2E
- 2,039 GB/s, against 3.7 TB/s
- 312 TFLOPS, against 1,678 TFLOPS
- 2020, against September 24, 2024
- 80 GB HBM3, against 288 GB HBM3E
- 3.35 TB/s, against 8 TB/s
- 1,979 TFLOPS, against 5 PFLOPs
- 989 TFLOPS, against 2.5 PFLOPs