NVIDIA H100 vs AMD MI355X
AMD MI355X comes out ahead of NVIDIA H100 on 7 of the 8 things that decide this, going by what each maker publishes. The one that matters for you may be one the leader loses.
The verdict
AMD MI355X takes it, 7–1 on rounds.
On the published figures, AMD MI355X takes 7 of 8 rounds. Treat that as a starting point and check the current figures on both pages, because prices and plans move.
Choose NVIDIA H100 if…
- • You want NVIDIA H100's edge on how much power it draws
Choose AMD MI355X if…
- • You want AMD MI355X's edge on how much memory it has and how fast its memory is
Round by round
- Round 1How much memory it hasAMD MI355X wins
AMD MI355X wins this round on what the company itself publishes.
- Round 2How fast its memory isAMD MI355X wins
AMD MI355X wins this round on what the company itself publishes.
- Round 3How fast it runs FP8 AI mathAMD MI355X winsNVIDIA H1005/10
1,979 TFLOPS
fp8 tensor core
- 1,979 TFLOPS, against 5 PFLOPs
Source: dam-cdn.nvd.orangelogic.com ↗
AMD MI355X wins this round on what the company itself publishes.
- Round 4How fast it runs FP16 AI mathAMD MI355X winsNVIDIA H1005/10
989 TFLOPS
fp16 tensor core
- 989 TFLOPS, against 2.5 PFLOPs
Source: dam-cdn.nvd.orangelogic.com ↗
AMD MI355X wins this round on what the company itself publishes.
- Round 5How much power it drawsNVIDIA H100 wins
NVIDIA H100 wins this round on what the company itself publishes.
- Round 6How it handles scientific FP64 mathAMD MI355X wins
AMD MI355X wins this round on what the company itself publishes.
- Round 7Which memory generation it usesAMD MI355X wins
AMD MI355X wins this round on what the company itself publishes.
- Round 8How new it isAMD MI355X wins
AMD MI355X wins this round on what the company itself publishes.
Side by side
- 80 GB HBM3, against 288 GB HBM3E
- 3.35 TB/s, against 8 TB/s
- 1,979 TFLOPS, against 5 PFLOPs
- 989 TFLOPS, against 2.5 PFLOPs
- 1400W, against 700 W
- 1400W, against 750W
- 78.6 TFLOPs, against 163.4 TFLOPs
- 1400W, against 1000W