Thursday, March 11, 2021

Intel works with Deci to speed up machine learning on its chips

Intel is playing catch up to Nvidia and Google TPUs! Welcome to more computer hardware competition! The computing requirements for state of the art AI/ML are enormous! Better hardware is needed!

"Intel today announced a strategic business and technology collaboration with Deci to optimize machine learning on the former’s processors ...
Deci achieves
runtime acceleration through a combination of data preprocessing and loading, selecting model architectures and hyperparameters (i.e., the variables that influence a model’s predictions) as well as datasets optimized for inference. It also takes care of steps like deployment, serving, monitoring, and explainability. Deci’s accelerator redesigns models to create new models with several computation routes, all optimized for a given inference device.

Deci’s router component ensures that each data input is directed via the proper route. (Each route is specialized with a prediction task.) As for the company’s accelerator, it works in synergy with other compression techniques like pruning and quantization. The accelerator can even act as a multiplier for complementary acceleration solutions such as AI compilers and specialized hardware, according to the company. ...
Deci was cofounded by Geifman, entrepreneur Jonathan Elial, and Ran El-Yaniv, a computer science professor at Technion in Haifa, Israel."

Intel works with Deci to speed up machine learning on its chips | VentureBeat

No comments: