|Image Courtesy: map.norsecorp.com|
Is future with AI a dream or a nightmare for human race:
What will happen once we develop a real AI, in the sense that it can learn and grow itself,whenever there is a change in the situation, it can change itself to better fit. Also, when all the different AIs can collaborate together to achieve certain tasks.What will happen when these super intelligent machines start competing with 7 billion people for resources to achieve a certain goal. Let me present a hypothesis:
Suppose an artificial intelligent system is created with a task to maximize the production of diesel cars, now to produce these cars it will need all the raw materials. Now there are a lot of practical issues like trade barrier and environmental concerns that need to be accounted for. In an ideal scenario, it would want to take control of the entire world to have indefinite resources available to produce these cars and it can turn against humans whose values doesn't align with its values.
Also, with these AI residing on clouds and distributed across various systems around the world, it wouldn't be easy to shut them down. Also, if we are able to build a single kill switch, these machines being super-intelligent would find a way to protect it.
Recognizing these potential threats, many AI researchers have started building machine ethics which teach these AIs about human ethics and values so that the control remains with humans.