[ad_1]
Intel kicked off its Imaginative and prescient 2024 convention with the revealing of the Gaudi 3 AI processing chip. Gaudi 3 is designed to speed up AI workloads at an enterprise stage, and Intel reckons it is sooner than the present business benchmark – Nvidia’s H100 GPU.
Gaudi 3 makes use of the identical structure and underlying rules as Gaudi 2, however it makes use of TSMC’s 5nm course of (in comparison with TSMC’s 7nm in Gaudi 2), making it extra environment friendly.
Gaudi 3 has as much as 128GB of HBM2e with 3.7 TB/s of bandwidth and 900W TDP.
Intel confirmed benchmarks evaluating Gaudi 3 to market chief Nvidia and its dominating H100 GPU, operating completely different giant language fashions like LLAMA2-7B, LLAMA2-13B, and GPT 3-175B. Gaudi 3 is as much as 1.7x sooner.
Intel additionally says that Gaudi 3 is as much as 2.3 occasions extra energy environment friendly than Nvidia’s H100.
Intel has already despatched air-cooled Gaudi 3 fashions for sampling to companions with normal availability to observe in Q3. Liquid-cooled items will are available in This autumn.
[ad_2]
Supply hyperlink
