Modern AI models require massive computing power, specialized data-center cooling, and high memory capacity. The US government has approved a secret $9 billion request for superchips to help the CIA and NSA keep pace with major AI companies. The GB10 superchips use a 20-core Arm CPU made by MediaTek, paired with an Nvidia GPU based on the Blackwell architecture. The system includes 128GB LPDDR5x memory and 4TB NVMe M.2 SSD storage. The chip delivers about 1 petaflop of FP4 AI performance while drawing about 140 watts, enabling fine-tuning of AI models with roughly 70 billion parameters.
"The latest batch of AI models needs a massive amount of computing power -- not to mention a huge supply of power and specialized cooling that comes as part of cutting-edge, modern-day data centers -- to run, and the silicon to deliver this is Nvidia's Grace Blackwell superchips, named after American mathematician David Blackwell and American computer scientist and Navy pioneer Grace Hopper."
"These superchips, called the GB10, feature a 20-core Arm CPU made by MediaTek, codenamed Grace, with an Nvidia GPU based on the Blackwell architecture. Take this chip and add 128GB LPDDR5x -- it's the demand for memory for AI that's skyrocketed the price of RAM and things like Raspberry Pi boards -- and 4TB of storage in the form of an NVMe M.2 SSD, and you have a chip that offers 1 petaflop of FP4 AI performance for a power draw of only 140 watts."
"This one chip has the power to fine-tune AI models with 70 billion parameters. Just in terms of storage alone, a model like this needs some 140GB of space. Also: AI isn't getting smarter, it's getting more power hungry - and expensive This is why the government has given the thumbs-up to a secret $9 billion request for superchips that will allow the CIA and NSA to keep up with what big AI players like Anthropic and OpenAI are doing."
Read at ZDNET
Unable to calculate read time
Collection
[
|
...
]