Tuesday, November 17, 2020

Cerebras' wafer-size chip is 10,000 times faster than a GPU

Wow! Could this be a major breakthrough in chip technology? Wafer scale technology seems to be a very different paradigm in microprocessor technology!

"On a practical level, this means AI neural networks that previously took months to train can now train in minutes on the Cerebras system. ... But Cerebras ... takes that wafer and makes a single, massive chip out of it. Each piece of the chip, dubbed a core, is interconnected in a sophisticated way to other cores. The interconnections are designed to keep all the cores functioning at high speeds so the transistors can work together as one. ... 
The CS-1 beat the Joule Supercomputer [which is No. 82 on a list of the top 500 supercomputers in the world
] at a workload for computational fluid dynamics, which simulates the movement of fluids in places such as a carburetor. The Joule Supercomputer costs tens of millions of dollars to build, with 84,000 CPU cores spread over dozens of racks, and it consumes 450 kilowatts of power. In this demo, the Joule Supercomputer used 16,384 cores, and the Cerebras computer was 200 times faster, ... Cerebras costs several million dollars and uses 20 kilowatts of power. ..."

Cerebras' wafer-size chip is 10,000 times faster than a GPU | VentureBeat



No comments: