Self-Driving Cars and Ecology, or "Where's the Running Board?"

 NYTimes had an article on Tesla in its Sunday magazine. Its emphasis was on the problems in the self-driving software.  

Tesla claims that based on accidents per miles their cars are much safer than those driven by people.  That may well be true, but I'd love to see a test where the drivers and conditions are randomly assigned.

I think one problem is the lack of sound data--apparently each company which is trying to implement such software maintains its own data, presumably for competitive reasons. But even if the data were public, there doesn't seem to be a basis for comparison.  The testing being done uses drivers who aren't at all reflective of the overall population and is done on roads and in conditions which aren't representative of normal driving. 

As it stands the testing being done is also unfair to Tesla and the others.  What do I mean?  The current ecology of drivers, roads, and conditions has evolved over a long history. An experienced driver has expectations based on her experience, and operates on their basis. I imagine it could be modeled as a circle in a Venn diagram. Imagine 60 years from now when almost all cars are self-driving.  That ecology will have "drivers" with somewhat different expectations, cars different than todays--notably quicker to to react, and roads which will have been modified for better self-driving. In our Venn diagram, the circle for the current ecology and the circle for the self-driving ecology will not be identical; they'll overlap in some areas.

Today when we judge self-driving software we're judging it by the current ecology, not the ecology of 60 years from now.  It's like cow-catchers on locomotives or running boards on cars--both were things needed by the early rail and automotive systems, but not by the current ones (though it turns out our trucks and SUV's still need them).  It will take time for the ecology to evolve; for drivers to gain experience with the cars, for the cars and software to improve, for the roads to be modified, for the insurance industry to adapt and the laws to change. It will be evolutionary.