I have thought about this a lot, and here is something that relates to it, somehow, I think. This is something I think about every time I hop in the car and go somewhere.
If you take a 200 foot view from above and analyze it, the current system simply should not work. It defies all logic that for the most part, yet it does work. Yes, every day all over the place there are mishaps, crashes, people hurt, people killed. But when you look at the total number of cars and the total miles being driven, for the most part it works. Every day you go out and go somewhere and come back unscathed, it worked.
But how it can possibly work gnaws at me every time I get in the car. Whenever I meet random people that are part of the overall general population, I always find that at least about a third of them, if not more, are marginally sane, if sane at all. After a few minutes of conversation, it becomes apparent that this person is existing in some other plane, where logic is right out the window. They seem completely oblivious and incoherent. Sometimes I wonder how on earth they can even exist in society, and have a means to support themselves, and be able to deal with all the trials of everyday life. Now, when you get in your car, you are surrounded by a random mix of all the people in the population. Some are truly out of it. Some no doubt are on drugs, alcohol, etc. A fair number are talking on their phones are texting. And here you are, especially on the freeway, going 60-80 miles an hour in a two ton projectile, and surrounded by dozens of others, and most of the time, the spacing between the cars is just a few feet, nowhere near enough to allow for a defensive maneuver if something goes wrong. I am amazed that it all goes along without constant crashing all over the place.
Somehow, apparently, peoples' brains get wired to be able to handle all of the inputs and outputs for driving a car at speed on a crowded road, and make the necessary adjustments, and be able to avoid problems most of the time. Its not trivial to do this, from a mechanistic point of view. But it works. For driverless to take over, the AI has to equal the processing power of the human brain. Maybe its doable some day?