Intel will intensify competition in the AI chip market led by NVIDIA. At the Intel Vision 2024 event organized by the company, the latest Intel Gaudi 3 was introduced. So what does Gaudi 3 promise to compete with NVIDIA H100?

Intel Gaudi 3 specs

Gaudi 3 is built on TSMC’s 5nm process and has 32 tensor cores. Despite the lack of a big increase in hardware, Intel claimed that Gaudi 3 is better than the Nvidia H100 in large language models. It is even 50 percent better in performance and 40 percent better in efficiency.

The Gaudi 3 chip promises a huge boost in machine learning performance with more than 1.8 trillion floating point operations per second. It also offers a 1.5x increase in memory bandwidth compared to the previous model. This opens the door to 4x more AI computation for BF16.

On the other hand, it needs 900 watts of energy; it draws 50 percent more power compared to the previous model. However, Intel said it will offer higher-power liquid-cooled versions for sale. All models will connect to servers via PCIe Gen 5 x16 interface.

Gaudi 3 is scheduled to ship to supply partners in the third quarter of 2024. Intel stated that Dell Technologies, HPE, Lenovo and Supermicro are among the major partners.

So what do you think about this issue? How do you think Intel Gaudi 3 performance is? You can share your opinions with us in the Comments section below.