Jake Tech Lab

AMD MI325X vs Intel Gaudi 3

AMD MI325X comes out ahead of Intel Gaudi 3 on 4 of the 6 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.

AMD MI325XWinner
AMD MI325X
6.8
Fair
4 of 6 rounds
vs
Intel Gaudi 3
Intel Gaudi 3
6.2
Fair
2 of 6 rounds

The verdict

AMD MI325X takes it, 4–2 on rounds.

On the published figures, AMD MI325X takes 4 of 6 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.

Choose AMD MI325X if…

  • • You want AMD MI325X's edge on how much memory it has and how fast its memory is

Choose Intel Gaudi 3 if…

  • • You want Intel Gaudi 3's edge on how fast it runs fp16 ai math and how much power it draws

Round by round

  1. Round 1How much memory it hasAMD MI325X wins
    AMD MI325X8/10

    256 GB HBM3E

    dedicated memory size

    Source: amd.com ↗

    Intel Gaudi 35/10

    128 GB HBM2E

    hbm capacity

    • 128 GB HBM2E, against 256 GB HBM3E

    Source: cdrdv2-public.intel.com ↗

    AMD MI325X wins this round on what the company itself publishes.

  2. Round 2How fast its memory isAMD MI325X wins
    AMD MI325X8/10

    6 TB/s

    peak memory bandwidth

    Source: amd.com ↗

    Intel Gaudi 35/10

    3.7 TB/s

    hbm bandwidth

    • 3.7 TB/s, against 6 TB/s

    Source: cdrdv2-public.intel.com ↗

    AMD MI325X wins this round on what the company itself publishes.

  3. Round 3How fast it runs FP8 AI mathAMD MI325X wins
    AMD MI325X8/10

    2.61 PFLOPs

    peak fp8 performance

    Source: amd.com ↗

    Intel Gaudi 35/10

    1,678 TFLOPS

    fp8 mme (matrix) tflops

    • 1,678 TFLOPS, against 2.61 PFLOPs

    Source: cdrdv2-public.intel.com ↗

    AMD MI325X wins this round on what the company itself publishes.

  4. Round 4How fast it runs FP16 AI mathIntel Gaudi 3 wins
    AMD MI325X5/10

    1.3 PFLOPs

    peak fp16 performance

    • 1.3 PFLOPs, against 1,678 TFLOPS

    Source: amd.com ↗

    Intel Gaudi 38/10

    459 TFLOPS

    FP16 (signed) matrix (MME) peak, Gaudi 3 technical paper Table 5; 1,678 is the BF16/FP8 figure

    • bf16 mme (matrix) tflops

    Source: cdrdv2-public.intel.com ↗

    Intel Gaudi 3 wins this round on what the company itself publishes.

  5. Round 5How much power it drawsIntel Gaudi 3 wins
    AMD MI325X5/10

    1000W

    typical board power (peak)

    • 1000W, against 900W

    Source: amd.com ↗

    Intel Gaudi 38/10

    900W

    tdp

    Source: cdrdv2-public.intel.com ↗

    Intel Gaudi 3 wins this round on what the company itself publishes.

  6. Round 6Which memory generation it usesAMD MI325X wins
    AMD MI325X8/10

    HBM3E

    dedicated memory type

    Source: amd.com ↗

    Intel Gaudi 35/10

    HBM2E

    memory type

    • HBM2E, against HBM3E

    Source: cdrdv2-public.intel.com ↗

    AMD MI325X wins this round on what the company itself publishes.

AMD MI325XAMD MI325X
Intel Gaudi 3Intel Gaudi 3

Side by side

AMD MI325XBest for how much memory it hasAMD MI325X
Overall score
6.8
Best
6.2
Price
See price
See price
How fast its memory is
7.3
6.2
How much memory it has
7.3
6.2
How much power it draws
5.8
5.8
How fast it runs FP16 AI math
5.0
7.4
How new it is
7.0
7.3
Head-to-head findings
How fast its memory is
6 TB/s
3.7 TB/s
How much memory it has
256 GB HBM3E
128 GB HBM2E
How much power it draws
1000W
900W
How fast it runs FP16 AI math
1.3 PFLOPs
459 TFLOPS
How new it is
10/10/2024
September 24, 2024
Which memory generation it uses
HBM3E
HBM2E
How fast it runs FP8 AI math
2.61 PFLOPs
1,678 TFLOPS
How it handles scientific FP64 math
163.4 TFLOPs
—
Record
Head-to-head record
3–1
2–3
Head-to-heads won
75 %
40 %
Rounds won
54 %
38 %
Pros
    • bf16 mme (matrix) tflops
    Cons
    • 1.3 PFLOPs, against 1,678 TFLOPS
    • 1000W, against 900W
    • 256 GB HBM3E, against 288 GB HBM3E
    • 6 TB/s, against 8 TB/s
    • 128 GB HBM2E, against 192 GB HBM
    • 3.7 TB/s, against 7.37 TB/s
    • 1,678 TFLOPS, against 4,614 TFLOPs
    • 1,678 TFLOPS, against 2,307 TFLOPs
    Add a third option to this comparison →

    More AI accelerators match-ups