“Good-bye folks. It’s been nice knowing you.”
Actually, I’m not ready to say goodbye to the human race just yet. Then again, I do suggest we not ignore the warnings.
Writing in the Futurism.com web site, Victor Tangermann writes:
“An existential catastrophe is not just possible, but likely.”
Researchers at Google Deepmind and the University of Oxford have concluded that it’s now “likely” that superintelligent AI will spell the end of humanity — a grim scenario that more and more researchers are starting to predict.
In a recent paper published in the journal AI Magazine, the team — comprised of DeepMind senior scientist Marcus Hutter and Oxford researchers Michael Cohen and Michael Osborne — argues that machines will eventually become incentivized to break the rules their creators set to compete for limited resources or energy.
“Under the conditions we have identified, our conclusion is much stronger than that of any previous publication — an existential catastrophe is not just possible, but likely,” Cohen, Oxford University engineering student and co-author of the paper, tweeted earlier this month.
In their paper, the researchers argue that humanity could face its doom in the form of super-advanced “misaligned agents” that perceives humankind as standing in the way of a reward.
You can read a lot more at: https://futurism.com/the-byte/google-oxford-paper-ai-humankind