Elon Musk’s XAI Ventures into Building a Supercomputer for its AI Bot Grok
The company xAI, owned by billionaire Elon Musk, is reportedly planning to construct its own computer to facilitate the operation of its Artificial Intelligence-powered bot, Grok, according to online sources. Musk revealed this during a recent meeting with investors.
According to Musk, the supercomputer is slated to be operational by autumn of next year. Moreover, he hinted at the possibility of XAI collaborating with Oracle for this project. This matter, however, remains unconfirmed as official representatives from xAI and Oracle have yet to comment.
Details reveal xAI intends to use Nvidia H100 accelerators in its supercomputer, although the exact number isn’t specified. It is known that 20,000 H100 accelerators were used in the training of the language model Grok 2. Musk previously suggested that the training of next-generation algorithms would require a total of 100,000 accelerators.
Nvidia H100 accelerators dominate the chip market for data processing centres employed in the field of AI. However, acquiring a large number of these accelerators can be quite challenging due to high demand. Musk founded xAI last year to compete with Microsoft, OpenAI, and Google in the AI sphere.
This post was last modified on 05/26/2024