Jake Tech Lab

NVIDIA A100 vs NVIDIA B200

NVIDIA B200 comes out ahead of NVIDIA A100 on 7 of the 8 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.

NVIDIA A100
NVIDIA A100
6.0
Fair
1 of 8 rounds
vs
NVIDIA B200Winner
NVIDIA B200
6.7
Fair
7 of 8 rounds

The verdict

NVIDIA B200 takes it, 7–1 on rounds.

On the published figures, NVIDIA B200 takes 7 of 8 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.

Choose NVIDIA A100 if…

  • • You want NVIDIA A100's edge on how much power it draws

Choose NVIDIA B200 if…

  • • You want NVIDIA B200's edge on how much memory it has and how fast its memory is

Round by round

  1. Round 1How much memory it hasNVIDIA B200 wins
    NVIDIA A1005/10

    80 GB HBM2e

    gpu memory

    • 80 GB HBM2e, against 180 GB HBM3E

    Source: nvidia.com ↗

    NVIDIA B2008/10

    180 GB HBM3E

    gpu memory

    Source: dam-cdn.nvd.orangelogic.com ↗

    NVIDIA B200 wins this round on what the company itself publishes.

  2. Round 2How fast its memory isNVIDIA B200 wins
    NVIDIA A1005/10

    2,039 GB/s

    memory bandwidth

    • 2,039 GB/s, against 7.7 TB/s

    Source: nvidia.com ↗

    NVIDIA B2008/10

    7.7 TB/s

    memory bandwidth

    Source: dam-cdn.nvd.orangelogic.com ↗

    NVIDIA B200 wins this round on what the company itself publishes.

  3. Round 3How fast it runs FP16 AI mathNVIDIA B200 wins
    NVIDIA A1005/10

    624 TFLOPS

    fp16 tensor core, with sparsity

    • 624 TFLOPS, against 4.5 PFLOPS

    Source: nvidia.com ↗

    NVIDIA B2008/10

    4.5 PFLOPS

    fp16/bf16 tensor core, with sparsity

    Source: dam-cdn.nvd.orangelogic.com ↗

    NVIDIA B200 wins this round on what the company itself publishes.

  4. Round 4How much power it drawsNVIDIA A100 wins
    NVIDIA A1008/10

    400 W

    max tdp (sxm)

    Source: nvidia.com ↗

    NVIDIA B2005/10

    1,000 W

    max tdp

    • 1,000 W, against 400 W

    Source: dam-cdn.nvd.orangelogic.com ↗

    NVIDIA A100 wins this round on what the company itself publishes.

  5. Round 5How fast chips talk to each otherNVIDIA B200 wins
    NVIDIA A1005/10

    600 GB/s NVLink

    nvlink gpu-to-gpu

    • 600 GB/s NVLink, against 1.8 TB/s NVLink

    Source: nvidia.com ↗

    NVIDIA B2008/10

    1.8 TB/s NVLink

    nvlink gpu-to-gpu

    Source: nvidia.com ↗

    NVIDIA B200 wins this round on what the company itself publishes.

  6. Round 6How it handles scientific FP64 mathNVIDIA B200 wins
    NVIDIA A1005/10

    19.5 TFLOPS

    fp64 tensor core

    • 19.5 TFLOPS, against 37 TFLOPS

    Source: nvidia.com ↗

    NVIDIA B2008/10

    37 TFLOPS

    fp64/fp64 tensor core

    Source: dam-cdn.nvd.orangelogic.com ↗

    NVIDIA B200 wins this round on what the company itself publishes.

  7. Round 7Which memory generation it usesNVIDIA B200 wins
    NVIDIA A1005/10

    HBM2e

    memory type

    • HBM2e, against HBM3E

    Source: nvidia.com ↗

    NVIDIA B2008/10

    HBM3E

    memory type

    Source: dam-cdn.nvd.orangelogic.com ↗

    NVIDIA B200 wins this round on what the company itself publishes.

  8. Round 8How new it isNVIDIA B200 wins
    NVIDIA A1005/10

    2020

    year announced

    • 2020, against 2024

    Source: nvidianews.nvidia.com ↗

    NVIDIA B2008/10

    2024

    year announced

    Source: nvidianews.nvidia.com ↗

    NVIDIA B200 wins this round on what the company itself publishes.

NVIDIA A100NVIDIA A100
NVIDIA B200NVIDIA B200

Side by side

Overall score
6.0
6.7
Best
Price
See price
See price
How fast its memory is
6.1
6.8
How much memory it has
6.3
6.5
How much power it draws
6.9
6.5
How fast it runs FP16 AI math
5.8
7.3
How new it is
5.4
6.5
Head-to-head findings
How fast its memory is
2,039 GB/s
7.7 TB/s
How much memory it has
80 GB HBM2e
180 GB HBM3E
How much power it draws
400 W
1,000 W
How fast it runs FP16 AI math
312 TFLOPS
4.5 PFLOPS
How new it is
2020
2024
Which memory generation it uses
HBM2e
HBM3E
How fast it runs FP8 AI math
—
9 PFLOPS
How it handles scientific FP64 math
19.5 TFLOPS
37 TFLOPS
Record
Head-to-head record
2–5–1
3–2–1
Head-to-heads won
29 %
60 %
Rounds won
31 %
53 %
Pros
      Cons
      • 80 GB HBM2e, against 128 GB HBM2E
      • 2,039 GB/s, against 3.7 TB/s
      • 312 TFLOPS, against 1,678 TFLOPS
      • 2020, against September 24, 2024
      • 180 GB HBM3E, against 288 GB HBM3E
      • 7.7 TB/s, against 8 TB/s
      • 37 TFLOPS, against 78.6 TFLOPs
      • 2024, against 6/12/2025
      Add a third option to this comparison →

      More AI accelerators match-ups