While there doesn’t appear to be any immediate threat, there also appears to be no simple solution.
Scientists from ML Alignment Theory Scholars, the University of Toronto, Google DeepMind and the Future of Life Institute have recently published research indicating that fighting to keep artificial intelligence (AI) under human control could become an ongoing struggle.
Dubbed “Quantifying stability of non-power-seeking in artificial agents,” the team’s pre-print research paper investigates the question of whether an AI system that appears safely aligned with human expectations in one domain is likely to remain that way as its environment changes.
Per the paper:
