Jake Tech Lab

NVIDIA A100 vs AMD MI300X

AMD MI300X comes out ahead of NVIDIA A100 on 6 of the 7 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.

NVIDIA A100
NVIDIA A100
6.0
Fair
1 of 7 rounds
vs
AMD MI300XWinner
AMD MI300X
6.8
Fair
6 of 7 rounds

The verdict

AMD MI300X takes it, 6–1 on rounds.

On the published figures, AMD MI300X takes 6 of 7 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.

Choose NVIDIA A100 if…

  • • You want NVIDIA A100's edge on how much power it draws

Choose AMD MI300X if…

  • • You want AMD MI300X's edge on how much memory it has and how fast its memory is

Round by round

  1. Round 1How much memory it hasAMD MI300X wins
    NVIDIA A1005/10

    80 GB HBM2e

    gpu memory

    • 80 GB HBM2e, against 192 GB HBM3

    Source: nvidia.com ↗

    AMD MI300X8/10

    192 GB HBM3

    dedicated memory size

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

  2. Round 2How fast its memory isAMD MI300X wins
    NVIDIA A1005/10

    2,039 GB/s

    memory bandwidth

    • 2,039 GB/s, against 5.3 TB/s

    Source: nvidia.com ↗

    AMD MI300X8/10

    5.3 TB/s

    peak memory bandwidth

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

  3. Round 3How fast it runs FP16 AI mathAMD MI300X wins
    NVIDIA A1005/10

    312 TFLOPS

    fp16 tensor core

    • 312 TFLOPS, against 1.3 PFLOPs

    Source: nvidia.com ↗

    AMD MI300X8/10

    1.3 PFLOPs

    peak fp16 performance

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

  4. Round 4How much power it drawsNVIDIA A100 wins
    NVIDIA A1008/10

    400 W

    max tdp (sxm)

    Source: nvidia.com ↗

    AMD MI300X5/10

    750W

    typical board power (peak)

    • 750W, against 400 W

    Source: amd.com ↗

    NVIDIA A100 wins this round on what the company itself publishes.

  5. Round 5How it handles scientific FP64 mathAMD MI300X wins
    NVIDIA A1005/10

    19.5 TFLOPS

    fp64 tensor core

    • 19.5 TFLOPS, against 163.4 TFLOPs

    Source: nvidia.com ↗

    AMD MI300X8/10

    163.4 TFLOPs

    peak fp64 matrix

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

  6. Round 6Which memory generation it usesAMD MI300X wins
    NVIDIA A1005/10

    HBM2e

    memory type

    • HBM2e, against HBM3

    Source: nvidia.com ↗

    AMD MI300X8/10

    HBM3

    dedicated memory type

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

  7. Round 7How new it isAMD MI300X wins
    NVIDIA A1005/10

    2020

    year announced

    • 2020, against 12/06/2023

    Source: nvidianews.nvidia.com ↗

    AMD MI300X8/10

    12/06/2023

    launch date

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

NVIDIA A100NVIDIA A100
AMD MI300XAMD MI300X

Side by side

Overall score
6.0
6.8
Best
Price
See price
See price
How fast its memory is
6.1
7.0
How much memory it has
6.3
7.0
How much power it draws
6.9
6.5
How fast it runs FP16 AI math
5.8
6.5
How new it is
5.4
6.6
Head-to-head findings
How fast its memory is
2,039 GB/s
5.3 TB/s
How much memory it has
80 GB HBM2e
192 GB HBM3
How much power it draws
400 W
750W
How fast it runs FP16 AI math
312 TFLOPS
1.3 PFLOPs
How new it is
2020
12/06/2023
Which memory generation it uses
HBM2e
HBM3
How fast it runs FP8 AI math
—
2.61 PFLOPs
How it handles scientific FP64 math
19.5 TFLOPS
163.4 TFLOPs
Record
Head-to-head record
2–5–1
4–2
Head-to-heads won
29 %
67 %
Rounds won
31 %
56 %
Pros
      Cons
      • 80 GB HBM2e, against 128 GB HBM2E
      • 2,039 GB/s, against 3.7 TB/s
      • 312 TFLOPS, against 1,678 TFLOPS
      • 2020, against September 24, 2024
      • 1.3 PFLOPs, against 1,678 TFLOPS
      • 12/06/2023, against September 24, 2024
      • 192 GB HBM3, against 288 GB HBM3E
      • 5.3 TB/s, against 8 TB/s
      Add a third option to this comparison →

      More AI accelerators match-ups