Nvidia Blackwell Ahead in AI Inference, AMD is close second on benchmark

Good news! Competition is good, more competition is better!

"In the latest round of machine learning benchmark results from MLCommons, computers built around Nvidia’s new Blackwell GPU architecture outperformed all others. But AMD’s latest spin on its Instinct GPUs, the MI325, proved a match for the Nvidia H200, the product it was meant to counter. The comparable results were mostly on tests of one of the smaller-scale large language models, Llama2 70B (for 70 billion parameters). However, in an effort to keep up with a rapidly changing AI landscape, MLPerf added three new benchmarks to better reflect where machine learning is headed. ..."

Nvidia Blackwell Leads AI Inference, AMD Challenges - IEEE Spectrum "MLPerf benchmarks show AMD’s Instinct GPUs on par with Nvidia’s H200"

AMD’s MI325X AI accelerator made an impact on LLM benchmarks