Jake Tech Lab

NVIDIA H200 vs AMD MI300X

AMD MI300X comes out ahead of NVIDIA H200 on 3 of the 6 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.

NVIDIA H200
NVIDIA H200
6.5
Fair
2 of 6 rounds
vs
AMD MI300XWinner
AMD MI300X
6.8
Fair
3 of 6 rounds

The verdict

AMD MI300X takes it, 3–2 on rounds.

On the published figures, AMD MI300X takes 3 of 6 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.

Choose NVIDIA H200 if…

  • • You want NVIDIA H200's edge on how much power it draws and which memory generation it uses

Choose AMD MI300X if…

  • • You want AMD MI300X's edge on how much memory it has and how fast its memory is

Round by round

  1. Round 1How much memory it hasAMD MI300X wins
    NVIDIA H2005/10

    141 GB HBM3e

    gpu memory

    • 141 GB HBM3e, against 192 GB HBM3

    Source: nvidia.com ↗

    AMD MI300X8/10

    192 GB HBM3

    dedicated memory size

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

  2. Round 2How fast its memory isAMD MI300X wins
    NVIDIA H2005/10

    4.8 TB/s

    memory bandwidth

    • 4.8 TB/s, against 5.3 TB/s

    Source: nvidia.com ↗

    AMD MI300X8/10

    5.3 TB/s

    peak memory bandwidth

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

  3. Round 3How much power it drawsNVIDIA H200 wins
    NVIDIA H2008/10

    700 W

    max tdp

    Source: nvidia.com ↗

    AMD MI300X5/10

    750W

    typical board power (peak)

    • 750W, against 700 W

    Source: amd.com ↗

    NVIDIA H200 wins this round on what the company itself publishes.

  4. Round 4How it handles scientific FP64 mathAMD MI300X wins
    NVIDIA H2005/10

    67 TFLOPS

    fp64 tensor core

    • 67 TFLOPS, against 163.4 TFLOPs

    Source: nvidia.com ↗

    AMD MI300X8/10

    163.4 TFLOPs

    peak fp64 matrix

    Source: amd.com ↗

    AMD MI300X wins this round on what the company itself publishes.

  5. Round 5Which memory generation it usesNVIDIA H200 wins
    NVIDIA H2008/10

    HBM3e

    memory type

    Source: nvidia.com ↗

    AMD MI300X5/10

    HBM3

    dedicated memory type

    • HBM3, against HBM3e

    Source: amd.com ↗

    NVIDIA H200 wins this round on what the company itself publishes.

  6. Round 6How new it isTie
    NVIDIA H2007/10

    2023

    year announced

    Source: nvidianews.nvidia.com ↗

    AMD MI300X7/10

    12/06/2023

    launch date

    Source: amd.com ↗

    Nothing to separate them here.

NVIDIA H200NVIDIA H200
AMD MI300XAMD MI300X

Side by side

Overall score
6.5
6.8
Best
Price
See price
See price
How fast its memory is
6.0
7.0
How much memory it has
6.0
7.0
How much power it draws
7.4
6.5
How fast it runs FP16 AI math
6.3
6.5
How new it is
6.3
6.6
Head-to-head findings
How fast its memory is
4.8 TB/s
5.3 TB/s
How much memory it has
141 GB HBM3e
192 GB HBM3
How much power it draws
700 W
750W
How fast it runs FP16 AI math
1,979 TFLOPS
1.3 PFLOPs
How new it is
2023
12/06/2023
Which memory generation it uses
HBM3e
HBM3
How fast it runs FP8 AI math
3,958 TFLOPS
2.61 PFLOPs
How it handles scientific FP64 math
67 TFLOPS
163.4 TFLOPs
Record
Head-to-head record
2–4
4–2
Head-to-heads won
33 %
67 %
Rounds won
43 %
56 %
Pros
      Cons
      • 141 GB HBM3e, against 186 GB HBM3E
      • 4.8 TB/s, against 8 TB/s
      • 3,958 TFLOPS, against 10 PFLOPS
      • 1,979 TFLOPS, against 5 PFLOPS
      • 1.3 PFLOPs, against 1,678 TFLOPS
      • 12/06/2023, against September 24, 2024
      • 192 GB HBM3, against 288 GB HBM3E
      • 5.3 TB/s, against 8 TB/s
      Add a third option to this comparison →

      More AI accelerators match-ups