Jake Tech Lab

Updated October 2026 · 15 compared

The best AI accelerators, ranked.

15 AI accelerators compared across 35 head-to-heads.

Every matchup is scored round by round on what matters most: how fast its memory is, how much memory it has, how much power it draws, how fast it runs fp16 ai math.

  1. 1Google TPU v7 IronwoodGoogle TPU v7 Ironwood7.4
  2. 2AMD MI355XAMD MI355X7.3
  3. 3NVIDIA GB200NVIDIA GB2007.0

At a glance

Top 15 AI accelerators

Ranked by overall score

1Google TPU v7 Ironwood

Pick Google TPU v7 Ironwood if you have a reason to pick Google TPU v7 Ironwood that is not on this list.

How fast its memory is
7.37 TB/s
How much memory it has
192 GB HBM
How fast it runs FP16 AI math
2,307 TFLOPs
How new it is
Apr 09, 2025
  • peak bf16 compute per chip
  • 192 GB HBM, against 288 GB HBM3E
  • 7.37 TB/s, against 8 TB/s
  • 4,614 TFLOPs, against 5 PFLOPs
  • 2,307 TFLOPs, against 2.5 PFLOPs
2AMD MI355X
Best for how fast its memory is

AMD MI355X

Pick AMD MI355X if you want AMD MI355X's edge on how much memory it has and how fast its memory is.

How fast its memory is
8 TB/s
How much memory it has
288 GB HBM3E
How much power it draws
1400W
How fast it runs FP16 AI math
2.5 PFLOPs
    • 1400W, against 700 W
    • 1400W, against 750W
    • 78.6 TFLOPs, against 163.4 TFLOPs
    • 1400W, against 1000W
    3NVIDIA GB200

    Pick NVIDIA GB200 if you want NVIDIA GB200's edge on how much memory it has and how fast its memory is.

    How fast its memory is
    8 TB/s
    How much memory it has
    186 GB HBM3E
    How much power it draws
    1,200 W
    How fast it runs FP16 AI math
    5 PFLOPS
      • 1,200 W, against 700 W
      • 40 TFLOPS, against 67 TFLOPS
      • 186 GB HBM3E, against 288 GB HBM3E
      • 40 TFLOPS, against 78.6 TFLOPs
      4AMD MI300X

      Pick AMD MI300X if you want AMD MI300X's edge on how much memory it has and how fast its memory is.

      How fast its memory is
      5.3 TB/s
      How much memory it has
      192 GB HBM3
      How much power it draws
      750W
      How fast it runs FP16 AI math
      1.3 PFLOPs
        • 1.3 PFLOPs, against 1,678 TFLOPS
        • 12/06/2023, against September 24, 2024
        • 192 GB HBM3, against 288 GB HBM3E
        • 5.3 TB/s, against 8 TB/s
        5AMD MI325X
        Best for how much memory it has

        AMD MI325X

        Pick AMD MI325X if you want AMD MI325X's edge on how much memory it has and how fast its memory is.

        How fast its memory is
        6 TB/s
        How much memory it has
        256 GB HBM3E
        How much power it draws
        1000W
        How fast it runs FP16 AI math
        1.3 PFLOPs
          • 1.3 PFLOPs, against 1,678 TFLOPS
          • 1000W, against 900W
          • 256 GB HBM3E, against 288 GB HBM3E
          • 6 TB/s, against 8 TB/s
          6NVIDIA B200

          Pick NVIDIA B200 if you want NVIDIA B200's edge on how much power it draws.

          How fast its memory is
          7.7 TB/s
          How much memory it has
          180 GB HBM3E
          How much power it draws
          1,000 W
          How fast it runs FP16 AI math
          4.5 PFLOPS
            • 180 GB HBM3E, against 288 GB HBM3E
            • 7.7 TB/s, against 8 TB/s
            • 37 TFLOPS, against 78.6 TFLOPs
            • 2024, against 6/12/2025
            7NVIDIA B300

            Pick NVIDIA B300 if you want NVIDIA B300's edge on how fast it runs fp4 ai math and how much power it draws.

            How fast its memory is
            7.7 TB/s
            How much memory it has
            270 GB HBM3E
            How much power it draws
            1,100 W
            How fast it runs FP16 AI math
            4.5 PFLOPS
              • 270 GB HBM3E, against 288 GB HBM3E
              • 7.7 TB/s, against 8 TB/s
              • 1.2 TFLOPS, against 78.6 TFLOPs
              • 9 PFLOPS, against 10 PFLOPS
              8NVIDIA L40S

              Pick NVIDIA L40S if you want NVIDIA L40S's edge on how much memory it has and how fast its memory is.

              How fast its memory is
              864 GB/s
              How much memory it has
              48 GB GDDR6
              How much power it draws
              350 W
              How fast it runs FP16 AI math
              733 TFLOPS
                • 350 W, against 72 W
                • 48 GB GDDR6, against 80 GB HBM3
                • 864 GB/s, against 3.35 TB/s
                • 733 TFLOPS, against 1,979 TFLOPS
                9NVIDIA H200

                Pick NVIDIA H200 if you want NVIDIA H200's edge on how much power it draws and how it handles scientific fp64 math.

                How fast its memory is
                4.8 TB/s
                How much memory it has
                141 GB HBM3e
                How much power it draws
                700 W
                How fast it runs FP16 AI math
                1,979 TFLOPS
                  • 141 GB HBM3e, against 186 GB HBM3E
                  • 4.8 TB/s, against 8 TB/s
                  • 3,958 TFLOPS, against 10 PFLOPS
                  • 1,979 TFLOPS, against 5 PFLOPS
                  10Intel Gaudi 3

                  Pick Intel Gaudi 3 if you have a reason to pick Intel Gaudi 3 that is not on this list.

                  How fast its memory is
                  3.7 TB/s
                  How much memory it has
                  128 GB HBM2E
                  How much power it draws
                  900W
                  How fast it runs FP16 AI math
                  459 TFLOPS
                  • bf16 mme (matrix) tflops
                  • 128 GB HBM2E, against 192 GB HBM
                  • 3.7 TB/s, against 7.37 TB/s
                  • 1,678 TFLOPS, against 4,614 TFLOPs
                  • 1,678 TFLOPS, against 2,307 TFLOPs
                  11NVIDIA H100

                  Pick NVIDIA H100 if you want NVIDIA H100's edge on how much power it draws.

                  How fast its memory is
                  3.35 TB/s
                  How much memory it has
                  80 GB HBM3
                  How much power it draws
                  700 W
                  How fast it runs FP16 AI math
                  989 TFLOPS
                    • 80 GB HBM3, against 288 GB HBM3E
                    • 3.35 TB/s, against 8 TB/s
                    • 1,979 TFLOPS, against 5 PFLOPs
                    • 989 TFLOPS, against 2.5 PFLOPs
                    12NVIDIA A100

                    Pick NVIDIA A100 if you want NVIDIA A100's edge on how much power it draws.

                    How fast its memory is
                    2,039 GB/s
                    How much memory it has
                    80 GB HBM2e
                    How much power it draws
                    400 W
                    How fast it runs FP16 AI math
                    312 TFLOPS
                      • 80 GB HBM2e, against 128 GB HBM2E
                      • 2,039 GB/s, against 3.7 TB/s
                      • 312 TFLOPS, against 1,678 TFLOPS
                      • 2020, against September 24, 2024
                      13NVIDIA L4
                      Best for how much power it draws

                      NVIDIA L4

                      Pick NVIDIA L4 if you want NVIDIA L4's edge on how much power it draws and how new it is.

                      How fast its memory is
                      300 GB/s
                      How much memory it has
                      24 GB GDDR6
                      How much power it draws
                      72 W
                      How fast it runs FP16 AI math
                      242 TFLOPS
                        • 24 GB GDDR6, against 80 GB HBM2e
                        • 300 GB/s, against 2,039 GB/s
                        • 242 TFLOPS, against 624 TFLOPS
                        • GDDR6, against HBM2e
                        14NVIDIA V100

                        Pick NVIDIA V100 if you want NVIDIA V100's edge on how much power it draws.

                        How fast its memory is
                        900 GB/s
                        How much memory it has
                        32 GB HBM2
                        How much power it draws
                        300 W
                        How fast it runs FP16 AI math
                        125 TFLOPS
                          • 32 GB HBM2, against 80 GB HBM2e
                          • 900 GB/s, against 2,039 GB/s
                          • 125 TFLOPS, against 312 TFLOPS
                          • 300 GB/s NVLink, against 600 GB/s NVLink
                          15Google TPU v6e Trillium

                          Pick Google TPU v6e Trillium if you have a reason to pick Google TPU v6e Trillium that is not on this list.

                          How fast its memory is
                          1638 GBps
                          How much memory it has
                          32 GB HBM
                          How fast it runs FP16 AI math
                          918 TFLOPs
                          How new it is
                          May 15, 2024
                            • 32 GB HBM, against 192 GB HBM
                            • 1638 GBps, against 7.37 TB/s
                            • 918 TFLOPs, against 4,614 TFLOPs
                            • 918 TFLOPs, against 2,307 TFLOPs

                            Compare every spec

                            Sort any column, tick products to go head-to-head · hover the edges or drag to see more

                            best in column · tick up to 4 to compare
                            1Google TPU v7 IronwoodGoogle TPU v7 IronwoodScore 7.47.37 TB/s192 GB HBM—2,307 TFLOPsApr 09, 2025HBM3E4,614 TFLOPs—3–175 %75 %
                            2AMD MI355XAMD MI355XScore 7.38 TB/s288 GB HBM3E1400W2.5 PFLOPs6/12/2025HBM3E5 PFLOPs78.6 TFLOPs7–0100 %69 %
                            3NVIDIA GB200NVIDIA GB200Score 7.08 TB/s186 GB HBM3E1,200 W5 PFLOPS2024HBM3E10 PFLOPS40 TFLOPS3–175 %62 %
                            4AMD MI300XAMD MI300XScore 6.85.3 TB/s192 GB HBM3750W1.3 PFLOPs12/06/2023HBM32.61 PFLOPs163.4 TFLOPs4–267 %56 %
                            5AMD MI325XAMD MI325XScore 6.86 TB/s256 GB HBM3E1000W1.3 PFLOPs10/10/2024HBM3E2.61 PFLOPs163.4 TFLOPs3–175 %54 %
                            6NVIDIA B200NVIDIA B200Score 6.77.7 TB/s180 GB HBM3E1,000 W4.5 PFLOPS2024HBM3E9 PFLOPS37 TFLOPS3–2–160 %53 %
                            7NVIDIA B300NVIDIA B300Score 6.67.7 TB/s270 GB HBM3E1,100 W4.5 PFLOPS2025HBM3E9 PFLOPS1.2 TFLOPS1–2–133 %46 %
                            8NVIDIA L40SNVIDIA L40SScore 6.5864 GB/s48 GB GDDR6350 W733 TFLOPS2023GDDR61,466 TFLOPS—1–1–150 %47 %
                            9NVIDIA H200NVIDIA H200Score 6.54.8 TB/s141 GB HBM3e700 W1,979 TFLOPS2023HBM3e3,958 TFLOPS67 TFLOPS2–433 %43 %
                            10Intel Gaudi 3Intel Gaudi 3Score 6.23.7 TB/s128 GB HBM2E900W459 TFLOPSSeptember 24, 2024HBM2E1,678 TFLOPS—2–340 %38 %
                            11NVIDIA H100NVIDIA H100Score 6.03.35 TB/s80 GB HBM3700 W989 TFLOPS2022HBM31,979 TFLOPS67 TFLOPS2–722 %31 %
                            12NVIDIA A100NVIDIA A100Score 6.02,039 GB/s80 GB HBM2e400 W312 TFLOPS2020HBM2e—19.5 TFLOPS2–5–129 %31 %
                            13NVIDIA L4NVIDIA L4Score 5.9300 GB/s24 GB GDDR672 W242 TFLOPS2023GDDR6485 TFLOPS—0–20 %25 %
                            14NVIDIA V100NVIDIA V100Score 5.5900 GB/s32 GB HBM2300 W125 TFLOPS2017———0–10 %17 %
                            15Google TPU v6e TrilliumGoogle TPU v6e TrilliumScore 5.01638 GBps32 GB HBM—918 TFLOPsMay 15, 2024—918 TFLOPs—0–10 %0 %

                            Popular head-to-heads

                            35 round-by-round comparisons — here are the top-ranked match-ups

                            Build your own comparison →

                            How these are scored: our ranking method. We may earn a commission from links on this page — disclosure.