When superstition trumps common sense! Or is this naive, wishful thinking?
This recent blog post by Anthropic appears to have stirred up quite some public controversy and fears about the future of machine learning and AI!
I would say these public fears are quite overblown! So far humanity has managed other potentially dangerous, catastrophic technologies like nuclear weapons and biological weapons quite well! Why would or should it be different this time?
To halt or slow down AI development as suggested appears to be an extreme and rather unnecessary measure. Plus, such a halt or slowdown could e.g. not be verified worldwide with confidence!
"For most of AI’s history, humans drove every step in its development cycle. But at Anthropic, we are delegating a growing share of AI development to AI systems themselves, which is speeding up our work.
Taken far enough, and given enough compute, that trend points to an AI system capable of fully autonomously designing and developing its own successor. This is called recursive self-improvement. We are not there yet, and recursive self-improvement is not inevitable. But it could come sooner than most institutions are prepared for. ...
We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology. ..."
Action Alert: Opportunity for AI Pause by MIRI Institute (MIRI is a leading, ML & AI research institute in Berkeley, CA)
No comments:
Post a Comment