NVIDIA L4 vs NVIDIA L40S
NVIDIA L40S comes out ahead of NVIDIA L4 on 4 of the 6 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.
The verdict
NVIDIA L40S takes it, 4–1 on rounds.
On the published figures, NVIDIA L40S takes 4 of 6 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.
Choose NVIDIA L4 if…
- • You want NVIDIA L4's edge on how much power it draws
Choose NVIDIA L40S if…
- • You want NVIDIA L40S's edge on how much memory it has and how fast its memory is
Round by round
- Round 1How much memory it hasNVIDIA L40S wins
NVIDIA L40S wins this round on what the company itself publishes.
- Round 2How fast its memory isNVIDIA L40S wins
NVIDIA L40S wins this round on what the company itself publishes.
- Round 3How fast it runs FP8 AI mathNVIDIA L40S winsNVIDIA L45/10
485 TFLOPS
fp8 tensor core, with sparsity
- 485 TFLOPS, against 1,466 TFLOPS
Source: nvidia.com ↗
NVIDIA L40S wins this round on what the company itself publishes.
- Round 4How fast it runs FP16 AI mathNVIDIA L40S winsNVIDIA L45/10
242 TFLOPS
fp16 tensor core, with sparsity
- 242 TFLOPS, against 733 TFLOPS
Source: nvidia.com ↗
NVIDIA L40S wins this round on what the company itself publishes.
- Round 5How much power it drawsNVIDIA L4 wins
NVIDIA L4 wins this round on what the company itself publishes.
- Round 6Which memory generation it usesTie
Nothing to separate them here.
Side by side
- 24 GB GDDR6, against 80 GB HBM2e
- 300 GB/s, against 2,039 GB/s
- 242 TFLOPS, against 624 TFLOPS
- GDDR6, against HBM2e
- 350 W, against 72 W
- 48 GB GDDR6, against 80 GB HBM3
- 864 GB/s, against 3.35 TB/s
- 733 TFLOPS, against 1,979 TFLOPS