Microsoft's CTO has said that while NVIDIA GPUs remain the best choice for AI, AMD is also making compelling options & the overall supply is also getting better.
NVIDIA's AI GPU Supply Gets Better As H100 GPUs Remain The Top Choice But AMD Has Compelling Solutions On The Horizon Too, Says Microsoft's CTO
We all know that Team Green's AI chips, particularly the H100s, witnessed an immense rise in demand due to the rapid growth of "genAI" developments this year. NVIDIA started to receive "millions" of orders almost instantaneously, which resulted in an "unbalanced" supply chain, causing order backlogs reaching up to six months. The AI GPUs were started to being categorized as the "holy grail" of the industry, which made acquiring them a headache of its own. However, the situation has improved vastly, with the delivery process being much faster.
Microsoft's CTO Kevin Scott, in an interview with The Verge, claimed that NVIDIA chips are starting to become more "readily" available, and the situation of the supply chain is much more refined.
Demand was far exceeding the supply of GPU capacity that the whole ecosystem could produce.
That is resolving. It’s still tight, but it’s getting better every week, and we’ve got more good news ahead of us than bad on that front, which is great.
Microsoft is well into the race to integrate generative AI into mainstream applications, and their developments made headlines after the company decided to invest heavily into OpenAI's ChatGPT language model. The backbone of LLM training requires high computational performance, and this is where NVIDIA's AI chips come in handy since they offer a better price-to-performance ratio and are well ahead of their competitors.
Talking about competitors, Kevin also said that AMD has some compelling AI solutions coming soon. He also goes on to state that competition is a good thing:
“They’re making increasingly compelling GPU offerings that I think are going to become more and more important to the marketplace in the coming years,"
With NVIDIA striving to maintain a seamless supply, the situation for the AI industry will definitely improve, especially for AI startups that couldn't access the required hardware due to inflated prices. Furthermore, an extensive supply chain will also cater to NVIDIA's goal of shipping 1.5 to 2 million H100s next year.
WccftechContinue reading/original-link]
