NVIDIA H100 vs NVIDIA L40S
NVIDIA H100 comes out ahead of NVIDIA L40S on 5 of the 7 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.
The verdict
NVIDIA H100 takes it, 5–2 on rounds.
On the published figures, NVIDIA H100 takes 5 of 7 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.
Choose NVIDIA H100 if…
- • You want NVIDIA H100's edge on how much memory it has and how fast its memory is
Choose NVIDIA L40S if…
- • You want NVIDIA L40S's edge on how much power it draws and how new it is
Round by round
- Round 1How much memory it hasNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 2How fast its memory isNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 3How fast it runs FP8 AI mathNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 4How fast it runs FP16 AI mathNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 5How much power it drawsNVIDIA L40S wins
NVIDIA L40S wins this round on what the company itself publishes.
- Round 6Which memory generation it usesNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 7How new it isNVIDIA L40S wins
NVIDIA L40S wins this round on what the company itself publishes.
Side by side
- 80 GB HBM3, against 288 GB HBM3E
- 3.35 TB/s, against 8 TB/s
- 1,979 TFLOPS, against 5 PFLOPs
- 989 TFLOPS, against 2.5 PFLOPs
- 350 W, against 72 W
- 48 GB GDDR6, against 80 GB HBM3
- 864 GB/s, against 3.35 TB/s
- 733 TFLOPS, against 1,979 TFLOPS