The run on training hardware has put chipmakers at the forefront of the general artificial intelligence boom.
OpenAI is reportedly in talks with Broadcom and other chip makers in what appears to be an urgent effort to expand its artificial intelligence operations.
AI models such as OpenAI’s ChatGPT and Meta’s Llama are typically trained using massive clusters of graphical processing units (GPUs) or similar computer chips. The most popular hardware, the H100, belongs to Nvidia.
The H100 can cost anywhere from $15,000 to $30,000, depending on the number purchased and current market conditions. It can take tens of thousands of these AI chips to train a single model, with more necessary for larger, more robust systems.
