NVIDIA A100 vs NVIDIA L40S
NVIDIA A100 and NVIDIA L40S are level on what each maker publishes. The one that matters for you may be one the leader loses.
The verdict
It's a dead heat.
Neither pulls ahead on the published figures, so the decision is in the details this comparison cannot see. Check the current figures on both pages.
Choose NVIDIA A100 if…
- • You want NVIDIA A100's edge on how much memory it has and how fast its memory is
Choose NVIDIA L40S if…
- • You want NVIDIA L40S's edge on how fast it runs fp16 ai math and how much power it draws
Round by round
- Round 1How much memory it hasNVIDIA A100 wins
NVIDIA A100 wins this round on what the company itself publishes.
- Round 2How fast its memory isNVIDIA A100 wins
NVIDIA A100 wins this round on what the company itself publishes.
- Round 3How fast it runs FP16 AI mathNVIDIA L40S wins
NVIDIA L40S wins this round on what the company itself publishes.
- Round 4How much power it drawsNVIDIA L40S wins
NVIDIA L40S wins this round on what the company itself publishes.
- Round 5Which memory generation it usesNVIDIA A100 wins
NVIDIA A100 wins this round on what the company itself publishes.
- Round 6How new it isNVIDIA L40S wins
NVIDIA L40S wins this round on what the company itself publishes.
Side by side
Overall score
6.0
6.5
Price
See price
See price
How fast its memory is
6.1
6.0
How much memory it has
6.3
6.0
How much power it draws
6.9
7.0
How fast it runs FP16 AI math
5.8
7.0
How new it is
5.4
8.0
Head-to-head findings
How fast its memory is
2,039 GB/s
864 GB/s
How much memory it has
80 GB HBM2e
48 GB GDDR6
How much power it draws
400 W
350 W
How fast it runs FP16 AI math
312 TFLOPS
733 TFLOPS
How new it is
2020
2023
Which memory generation it uses
HBM2e
GDDR6
How fast it runs FP8 AI math
—
1,466 TFLOPS
How it handles scientific FP64 math
19.5 TFLOPS
—
Record
Head-to-head record
2–5–1
1–1–1
Head-to-heads won
29 %
50 %
Rounds won
31 %
47 %
Pros
Cons
- 80 GB HBM2e, against 128 GB HBM2E
- 2,039 GB/s, against 3.7 TB/s
- 312 TFLOPS, against 1,678 TFLOPS
- 2020, against September 24, 2024
- 350 W, against 72 W
- 48 GB GDDR6, against 80 GB HBM3
- 864 GB/s, against 3.35 TB/s
- 733 TFLOPS, against 1,979 TFLOPS