Posted: 8/24/2019 Updated: 8/30/2019
Update Of 8/30/2019
The large size of this chip (215 mm on each side) could indicate a major paradigm shift in chip production! In the past, the major trend was to make chips more compact and dense on ever tinier scales.
However, “... Cerebras argues that the world’s semiconductor companies have spent decades developing ever tinier chips that can then be bundled together to create super-powerful processors. But hooking lots of small chips together creates latencies that slow down training of AI models—a huge industry bottleneck. In contrast, an extra giant chip could shift data between processing and memory incredibly fast and turbocharge AI applications” (source; emphasis added)
Original Post
Could this be a game changer we have been waiting on? AI & machine learning have a serious bottleneck (limiting factor) and that is the computing hardware itself. Better and more powerful chips are urgently needed.
This is a giant of a WSE (Wafer Scale Engine) chip measuring 215 mm each side or 46,225 mm2 and featuring 1.2 Trillion transistors and 400,000 AI-optimized cores! “By comparison, the largest Graphics Processing Unit is 815 mm2 and has 21.1 Billion transistors.” (S2) This chip was just released by Cerebras Systems (not exactly one of the familiar names in the chip making industry, but this may change).
Sources (S):
No comments:
Post a Comment