Jake Tech Lab

NVIDIA H200 vs AMD MI325X

AMD MI325X comes out ahead of NVIDIA H200 on 4 of the 6 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.

NVIDIA H200
NVIDIA H200
6.5
Fair
1 of 6 rounds
vs
AMD MI325XWinner
AMD MI325X
6.8
Fair
4 of 6 rounds

The verdict

AMD MI325X takes it, 4–1 on rounds.

On the published figures, AMD MI325X takes 4 of 6 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.

Choose NVIDIA H200 if…

  • • You want NVIDIA H200's edge on how much power it draws

Choose AMD MI325X if…

  • • You want AMD MI325X's edge on how much memory it has and how fast its memory is

Round by round

  1. Round 1How much memory it hasAMD MI325X wins
    NVIDIA H2005/10

    141 GB HBM3e

    gpu memory

    • 141 GB HBM3e, against 256 GB HBM3E

    Source: nvidia.com ↗

    AMD MI325X8/10

    256 GB HBM3E

    dedicated memory size

    Source: amd.com ↗

    AMD MI325X wins this round on what the company itself publishes.

  2. Round 2How fast its memory isAMD MI325X wins
    NVIDIA H2005/10

    4.8 TB/s

    memory bandwidth

    • 4.8 TB/s, against 6 TB/s

    Source: nvidia.com ↗

    AMD MI325X8/10

    6 TB/s

    peak memory bandwidth

    Source: amd.com ↗

    AMD MI325X wins this round on what the company itself publishes.

  3. Round 3How much power it drawsNVIDIA H200 wins
    NVIDIA H2008/10

    700 W

    max tdp

    Source: nvidia.com ↗

    AMD MI325X5/10

    1000W

    typical board power (peak)

    • 1000W, against 700 W

    Source: amd.com ↗

    NVIDIA H200 wins this round on what the company itself publishes.

  4. Round 4How it handles scientific FP64 mathAMD MI325X wins
    NVIDIA H2005/10

    67 TFLOPS

    fp64 tensor core

    • 67 TFLOPS, against 163.4 TFLOPs

    Source: nvidia.com ↗

    AMD MI325X8/10

    163.4 TFLOPs

    peak fp64 matrix

    Source: amd.com ↗

    AMD MI325X wins this round on what the company itself publishes.

  5. Round 5How new it isAMD MI325X wins
    NVIDIA H2005/10

    2023

    year announced

    • 2023, against 10/10/2024

    Source: nvidianews.nvidia.com ↗

    AMD MI325X8/10

    10/10/2024

    launch date

    Source: amd.com ↗

    AMD MI325X wins this round on what the company itself publishes.

  6. Round 6Which memory generation it usesTie
    NVIDIA H2007/10

    HBM3e

    memory type

    Source: nvidia.com ↗

    AMD MI325X7/10

    HBM3E

    dedicated memory type

    Source: amd.com ↗

    Nothing to separate them here.

NVIDIA H200NVIDIA H200
AMD MI325XAMD MI325X

Side by side

AMD MI325XBest for how much memory it hasAMD MI325X
Overall score
6.5
6.8
Best
Price
See price
See price
How fast its memory is
6.0
7.3
How much memory it has
6.0
7.3
How much power it draws
7.4
5.8
How fast it runs FP16 AI math
6.3
5.0
How new it is
6.3
7.0
Head-to-head findings
How fast its memory is
4.8 TB/s
6 TB/s
How much memory it has
141 GB HBM3e
256 GB HBM3E
How much power it draws
700 W
1000W
How fast it runs FP16 AI math
1,979 TFLOPS
1.3 PFLOPs
How new it is
2023
10/10/2024
Which memory generation it uses
HBM3e
HBM3E
How fast it runs FP8 AI math
3,958 TFLOPS
2.61 PFLOPs
How it handles scientific FP64 math
67 TFLOPS
163.4 TFLOPs
Record
Head-to-head record
2–4
3–1
Head-to-heads won
33 %
75 %
Rounds won
43 %
54 %
Pros
      Cons
      • 141 GB HBM3e, against 186 GB HBM3E
      • 4.8 TB/s, against 8 TB/s
      • 3,958 TFLOPS, against 10 PFLOPS
      • 1,979 TFLOPS, against 5 PFLOPS
      • 1.3 PFLOPs, against 1,678 TFLOPS
      • 1000W, against 900W
      • 256 GB HBM3E, against 288 GB HBM3E
      • 6 TB/s, against 8 TB/s
      Add a third option to this comparison →

      More AI accelerators match-ups