Abstract In the literature, there is a concern that if AI and robotic systems become super-intelligent, we will lose control over those systems. The loss of control, some worry, may yield bad or even catastrophic outcomes. Some think that we can avoid this problem even in the absence of control, simply by ensuring that the systems are aligned with our human values (what is known as “value alignment”). Here it is argued that value alignment will not succeed without sufficient control.
Björn Lundgren (Wed,) studied this question.