Slashdot Mirror


Inside Google's Self-Driving Car Test Center (medium.com)

An anonymous reader writes: Steven Levy reports on his trip to the facility where Google tests is autonomous vehicles (here's a map). The company apparently has a four-week program to certify people to not-drive these cars, and they gave Levy an abbreviated version of it. "The most valuable tool the test team has for making sure things are running smoothly is the laptop on the co-driver's lap. Using an interface called x_view, the laptop shows the world as the car sees it, a wireframe representation of the area that depicts all the objects around the car: pedestrians, trees, road signs, other cars, motorcycles—basically everything picked up by the car's radar and laser sensors.

X_view also shows how the car is planning to deal with conditions, mainly through a series of grid-like "fences" that depict when the car intends to stop, cautiously yield, or proceed past a hazard. It also displays the car's path. If the co-driver sees a discrepancy between x_view and the real world, that's reason to disengage. ... At the end of the shift, the entire log is sent off to an independent triage team, which runs simulations to see what would have happened had the car continued autonomously. In fact, even though Google's cars have autonomously driven more than 1.3 million miles—routinely logging 10,000 to 15,000 more every week—they have been tested many times more in software, where it's possible to model 3 million miles of driving in a single day."

26 of 43 comments (clear)

  1. spoiler alert! by Gravis+Zero · · Score: 2

    it's not bigger on the inside. :(

    --
    Anons need not reply. Questions end with a question mark.
  2. medium.com by 110010001000 · · Score: 2

    Why doesn't medium.com just buy Slashdot and get it over with?

  3. and what about the prison / jail time when the car by Joe_Dragon · · Score: 1

    and what about the prison / jail time when the car runs though the framers market?

  4. Is it fair? by burtosis · · Score: 1

    Is it fair to say these cars are currently safer than human drivers when a dedicated copilot is nearly always present and double checking on the cars and who then shuts it off for a human to take over at the slightest problem? How many accidents have been prevented?
    For those of you that haven't seen the university of Michigan report

    1. Re:Is it fair? by 110010001000 · · Score: 1

      No, it isn't fair to say that. Googles car depend on extensive pre-mapping of the driving space. That is why the tests are limited to certain areas. If you put that car in the middle of Philadelphia it wouldn't work. Basically autonomous car driving is a con job at this point.

    2. Re:Is it fair? by khasim · · Score: 2

      The problem with that report is that it only covers reported accidents.

      ANY accident that involves an autonomous car gets reported.

      A similar accident between two humans may not be reported.

      And, finally, the report even states that NONE of the accidents were the fault of the autonomous cars. They were ALL the fault of the human drivers. So, yes, the autonomous cars are better drivers than the humans in those instances.

    3. Re:Is it fair? by burtosis · · Score: 2

      Two things.
      1) The first sentence of the report says "after correcting for underreported accidents".
      2) Most of the mileage of autonomous cars is going 25mph on residential streets or on the open, non-congested highway under perfect driving conditions.
      so I'm not sure it's comparing apples to apples. I haven't been able to find a non-pay walled version if anyone has I would like to read it but am not paying.

    4. Re:Is it fair? by burtosis · · Score: 1

      Plus you failed to take into account these cars are piloted by humans who, in all likelihood, prevented accidents from happening which was my original point. For a fair study in safety each time they removed control in an unsafe situation should be counted as a crash. That was never documented and released to the public.

    5. Re:Is it fair? by khasim · · Score: 1

      From the abstract:

      Second, the corresponding 95% confidence intervals overlap. Therefore, we currently cannot rule out, with a reasonable level of confidence, the possibility that the actual rates for self - driving vehicles are lower than for conventional vehicles.

      So they are admitting that their "higher" rate may not be correct. Which is what I said.

      Secondly, yes, it is "apples to apples". Because the human drivers involved in the accidents with the autonomous cars were all driving under the exact same conditions. And NONE of those accidents were the fault of the autonomous cars.

      Otherwise you are stating that the autonomous cars (which have never been at fault) are WORSE drivers under-ideal-conditions than humans (who are almost always at fault) are under all conditions.

      The best you can argue is that the autonomous cars are only as-good-or-better-than-humans under limited conditions. And that they have only been tested under those limited conditions.

    6. Re:Is it fair? by burtosis · · Score: 1

      Nice goalpost moving. You said reported accidents. You barely skimmed before replying. So no your argument is invalid as I'm sure your armchair guesswork is better than peer reviewed papers.

    7. Re:Is it fair? by amRadioHed · · Score: 2

      Who exactly is Google conning? So far, the only ones losing money on self-driving cars are the companies like Google that are researching them.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    8. Re:Is it fair? by khasim · · Score: 1

      Nice goalpost moving.

      Don't use terms you do not understand.

      You claimed that the autonomous cars were WORSE drivers because they had MORE accidents. I said that that 100% of the accidents had to be reported for autonomous cars but not for human accidents. So there is a question whether the comparison is accurate.

      You claimed that the paper said that they had adjusted for that.

      I quoted the summary saying that those researchers admitted that they were NOT sure that the adjustment was correct.

      And then I pointed out what seems to me to be an obvious error in claiming that cars with ZERO "at fault" accidents were worse drivers than humans who had almost all "at fault" accidents.

      Now you can disagree and argue that 0 > 1. But that is on you. I'll stick with 0 1.

    9. Re:Is it fair? by khasim · · Score: 2

      Or let's try this a different way. A mental experiment. Think of both sides as two humans. Autonomous Alice and Bob.

      Alice drives less than Bob. And Alice only drives under perfect conditions in a limited area. Bob drives everywhere in all conditions.

      Bob does not report every accident he has to his insurance company. But Alice does. The insurance company sees that, on average, Alice reports more accidents than Bob. And the insurance company tries to adjust for Bob's under-reporting.

      But every single accident Alice is in involves Bob hitting Alice and being found to be at fault for hitting Alice.

      None of the accidents involve Alice being at fault.

      So, to whom does the insurance company give the best rate to?

    10. Re:Is it fair? by MrL0G1C · · Score: 1

      Indeed, Google is conning itself, they've said their goal is autonomous cars by 2020 but they still haven't actually said how they hope to achieve this, primarily - with or without constant extensive mapping?

      And now they've released the fact that the only reason the cars didn't crash is perhaps because humans took control of the cars whenever they made mistakes.

      --
      Waterfox - a Firefox fork with legacy extension support, security updates and better privacy by default.
  5. Google by ickleberry · · Score: 1

    Self-driving car = Google
    Driverless car = Everyone else

    1. Re:Google by GuB-42 · · Score: 1

      Google cars, the ones that go in actual traffic are self-driving, not driverless. Because there is still a driver in the car in case of emergency.
      Passenger airplanes nowadays are pretty much self-flying, but they are not pilotless.

  6. Re:Million Dollar Payout by ShanghaiBill · · Score: 5, Insightful

    Google will be paying some accident victim millions of dollars in the future. It is inevitable.

    ... which will be covered by their insurance company ... the same insurance companies that are already paying millions to accident victims. The only thing that will change with SDCs, is that they will be paying a lot less.

    SDCs don't need to be perfect. They just need to be better than human drivers. That is not a high bar.

  7. Re:Million Dollar Payout by khasim · · Score: 3, Informative

    I will be surprised if Google's insurance company ever has to pay a claim. The cars will have so much data on the accident that it should be trivial to show that the car was obeying all the laws and that any accident was either impossible to avoid or the fault of someone else.

    Google itself might pay in the case of an accident that was not their fault BUT has a PR issue attached to it.

    But, overall, I think that the insurance companies will love the autonomous cars that they're insuring. It's free money for them.

  8. Redundancy by jklovanc · · Score: 1

    In fact, even though Google's cars have autonomously driven more than 1.3 million miles—routinely logging 10,000 to 15,000 more every week—they have been tested many times more in software, where it's possible to model 3 million miles of driving in a single day."

    That would be three million miles over the same few miles of well understood track and roads. The real world is much more varied than that.

  9. Google cars involved in crashes by smooth+wombat · · Score: 2

    Google revealed that their vehicles had been involved in 341 "disengagements" (when the driver had to take over) between September 2014 and October 2015. Of those "disengagements", 79.8% were due to a failure of the autonomous system.

    Read the details here which outline the results of the report.

    --
    We will bankrupt ourselves in the vain search for absolute security. -- Dwight D. Eisenhower
    1. Re:Google cars involved in crashes by Kjella · · Score: 1

      I wouldn't say it failed. As the article explains it does not mean the sensors failed to detect something, it means the sensors detected a glitch/malfunction/blockage and alerted the driver to take over. Presumably that means the test models lack redundancy and the ability to "vote out" malfunctioning gear, those are things that are relatively trivial to fix since it's purely a technical issue and not about the car's understanding of the surroundings. In fact over the test period they show about a 7x improvement on that to once >5000 miles. It's the other 20% that are interesting, after simulations:

      the company calculated that 13 of these 69 manual disengagements would have resulted in contact of some sort with another road-user or (in two of the 13 cases) with a traffic cone. In 10 of these 13 events Google says its own technology was at fault, and in the remaining three, other drivers were to blame.

      So that's in 424,331 miles of driving, if we don't blame it for the bad driving of others that's one potential accident per 42k miles. Now Google's cars have been hit 12 times in 1,8 millon miles = ~3 times in the same distance. So assuming it didn't have a human driver the score would be roughly:

      Hit by other drivers (non-avoidable): 3
      Hit by other drivers (avoided now by takeover): 3
      Google hit accidents: 8
      Google solo accidents (presumably other drivers have these too): 2

      Is it great? No. It's also not terrible for a product in development, the important part is that these flaws are being found and fixed. There's only so much we can do about the human flaws...

      --
      Live today, because you never know what tomorrow brings
    2. Re:Google cars involved in crashes by MrL0G1C · · Score: 1

      Presumably that means the test models lack redundancy and the ability to "vote out" malfunctioning gear, those are things that are relatively trivial to fix since it's purely a technical issue and not about the car's understanding of the surroundings. In fact over the test period they show about a 7x improvement on that to once >5000 miles. It's the other 20% that are interesting, after simulations:

      That's a rather massive presumption and could be completely wrong for instance the failure could be on behalf of the computer AI in determining what objects are - that is no easy thing to fix. It seems that you presumed an easy fix because you wanted it to be easy to fix.

      The simple fact is that the drivers had to prevent vehicle collisions from occurring 13+ times whilst on a small set of very heavy mapped roads. To be fair though this is new tech and over time the proficiency can be improved over time and I do hope that it will be improved enough to be able to do away with the probably unfeasible level of mapping before Google loses faith and scraps the idea.

      --
      Waterfox - a Firefox fork with legacy extension support, security updates and better privacy by default.
  10. Ob by Hognoxious · · Score: 1

    Why would a car test center need to drive?

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  11. Re:Million Dollar Payout by amRadioHed · · Score: 1

    Again, it's naive to think that the cars driving software will be infallible, but most accidents are caused by the fallibility of human drivers. All Google needs to do to save thousands of lives and millions of dollars is be a little better than people, a goal which should not be hard to reach.

    --
    We hope your rules and wisdom choke you / Now we are one in everlasting peace
  12. Re:Million Dollar Payout by ShanghaiBill · · Score: 1

    Airbus killed 20-30 people

    So software killed a few dozen. Pilot error has killed thousands.

  13. really, really slow and/or dangerous by globaljustin · · Score: 1

    in TFA the car has to be taken off auto-drive because it comes to a construction area and slows down so much it was barely moving

    these things are not going to work in this form, and pushing them into the market will be a disaster

    car AI is much, much improved, and I can see groups of electric semi-trucks following one lead driver on an interstate, but that's about it

    --
    Thank you Dave Raggett