Jake Tech Lab

NVIDIA V100 vs NVIDIA A100

NVIDIA A100 comes out ahead of NVIDIA V100 on 5 of the 6 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.

NVIDIA V100
NVIDIA V100
5.5
Weak
1 of 6 rounds
vs
NVIDIA A100Winner
NVIDIA A100
6.0
Fair
5 of 6 rounds

The verdict

NVIDIA A100 takes it, 5–1 on rounds.

On the published figures, NVIDIA A100 takes 5 of 6 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.

Choose NVIDIA V100 if…

  • • You want NVIDIA V100's edge on how much power it draws

Choose NVIDIA A100 if…

  • • You want NVIDIA A100's edge on how much memory it has and how fast its memory is

Round by round

  1. Round 1How much memory it hasNVIDIA A100 wins
    NVIDIA V1005/10

    32 GB HBM2

    gpu memory

    • 32 GB HBM2, against 80 GB HBM2e

    Source: nvidia.com ↗

    NVIDIA A1008/10

    80 GB HBM2e

    gpu memory

    Source: nvidia.com ↗

    NVIDIA A100 wins this round on what the company itself publishes.

  2. Round 2How fast its memory isNVIDIA A100 wins
    NVIDIA V1005/10

    900 GB/s

    memory bandwidth

    • 900 GB/s, against 2,039 GB/s

    Source: nvidia.com ↗

    NVIDIA A1008/10

    2,039 GB/s

    memory bandwidth

    Source: nvidia.com ↗

    NVIDIA A100 wins this round on what the company itself publishes.

  3. Round 3How fast it runs FP16 AI mathNVIDIA A100 wins
    NVIDIA V1005/10

    125 TFLOPS

    deep learning (tensor, mixed precision)

    • 125 TFLOPS, against 312 TFLOPS

    Source: nvidia.com ↗

    NVIDIA A1008/10

    312 TFLOPS

    fp16 tensor core

    Source: nvidia.com ↗

    NVIDIA A100 wins this round on what the company itself publishes.

  4. Round 4How much power it drawsNVIDIA V100 wins
    NVIDIA V1008/10

    300 W

    max consumption

    Source: nvidia.com ↗

    NVIDIA A1005/10

    400 W

    max tdp (sxm)

    • 400 W, against 300 W

    Source: nvidia.com ↗

    NVIDIA V100 wins this round on what the company itself publishes.

  5. Round 5How fast chips talk to each otherNVIDIA A100 wins
    NVIDIA V1005/10

    300 GB/s NVLink

    nvlink bi-directional

    • 300 GB/s NVLink, against 600 GB/s NVLink

    Source: nvidia.com ↗

    NVIDIA A1008/10

    600 GB/s NVLink

    nvlink gpu-to-gpu

    Source: nvidia.com ↗

    NVIDIA A100 wins this round on what the company itself publishes.

  6. Round 6How new it isNVIDIA A100 wins
    NVIDIA V1005/10

    2017

    year announced

    • 2017, against 2020

    Source: nvidianews.nvidia.com ↗

    NVIDIA A1008/10

    2020

    year announced

    Source: nvidianews.nvidia.com ↗

    NVIDIA A100 wins this round on what the company itself publishes.

NVIDIA V100NVIDIA V100
NVIDIA A100NVIDIA A100

Side by side

Overall score
5.5
6.0
Best
Price
See price
See price
How fast its memory is
5.0
6.1
How much memory it has
5.0
6.3
How much power it draws
8.0
6.9
How fast it runs FP16 AI math
5.0
5.8
How new it is
5.0
5.4
Head-to-head findings
How fast its memory is
900 GB/s
2,039 GB/s
How much memory it has
32 GB HBM2
80 GB HBM2e
How much power it draws
300 W
400 W
How fast it runs FP16 AI math
125 TFLOPS
312 TFLOPS
How new it is
2017
2020
Which memory generation it uses
—
HBM2e
How fast it runs FP8 AI math
—
—
How it handles scientific FP64 math
—
19.5 TFLOPS
Record
Head-to-head record
0–1
2–5–1
Head-to-heads won
0 %
29 %
Rounds won
17 %
31 %
Pros
      Cons
      • 32 GB HBM2, against 80 GB HBM2e
      • 900 GB/s, against 2,039 GB/s
      • 125 TFLOPS, against 312 TFLOPS
      • 300 GB/s NVLink, against 600 GB/s NVLink
      • 80 GB HBM2e, against 128 GB HBM2E
      • 2,039 GB/s, against 3.7 TB/s
      • 312 TFLOPS, against 1,678 TFLOPS
      • 2020, against September 24, 2024
      Add a third option to this comparison →

      More AI accelerators match-ups