Nvidia’s H100, the state-of-the-art GPU designed for AI methods, has been noticed on eBay for over $40,000.
No less than eight of the playing cards have been listed between $39,995 to only beneath $46,000, though some sellers have been providing it for as little as $36,000.
The H100 is the corporate’s successor to the A100, famous for powering well-liked AI fashions reminiscent of ChatGPT, as they comprise a core a part of the cloud computing infrastructure that kinds Microsoft Azure, which is the place the favored AI author is hosted.
Rising prices
The escalation in value as been spurred on by the massive surge in AI curiosity, kickstarted by the breakout success of OpenAI’s ChatGPT. For perspective, the earlier A100 is valued at round $10,000.
As extra firms look to develop their very own superior AI methods, they require the ability provided by the H100 to fulfill their wants. Terabytes of information are required to coach and develop Massive Language Fashions like ChatGPT, and a whole bunch of those GPUs have to work in tandem and run for days and even weeks on finish.
Microsoft has been a key investor in OpenAI, and has spent millions (opens in new tab) on getting sufficient A100s to construct ChatGPT. And Nvidia themselves is providing entry to its personal DGX supercomputer for $37,000 a month, which runs on the A100s.
Because the comply with up, the H100 is the primary chip to particularly designed for the pc structure utilized in superior AI purposes, which it hopes will usher in a brand new period of much more highly effective and succesful AI methods.
Given the mammoth prices concerned in growing AI, its no marvel that Microsoft is eager to see some returns on its sizeable funding, because it has lately been shoehorning the superior know-how into lots of its providers. Coupled with the tumbling income it has seen in its once-flagship Home windows OS sector, the money cannot come rolling in quick sufficient.
- For extra realistically attainable powerhouse efficiency, check out our greatest workstations