Slashdot Mirror


Former Top Waymo Engineer Altered Code To Go on 'Forbidden Routes', Report Says (arstechnica.com)

In the early days of what ultimately became Waymo, Google's self-driving car division (known at the time as "Project Chauffeur"), there were "more than a dozen accidents, at least three of which were serious," according to a new article in The New Yorker . From a report: The magazine profiled Anthony Levandowski, the former Google engineer who was at the center of the Waymo v. Uber trade secrets lawsuit. According to the article, back in 2011, Levandowski also modified the autonomous software to take the prototype Priuses on "otherwise forbidden routes."

Citing an anonymous source, The New Yorker reports that Levandowski sat behind the wheel as the safety driver, along with Isaac Taylor, a Google executive. But while they were in the car, the Prius "accidentally boxed in another vehicle," a Camry.

As The New Yorker wrote: "A human driver could easily have handled the situation by slowing down and letting the Camry merge into traffic, but Google's software wasn't prepared for this scenario. The cars continued speeding down the freeway side by side. The Camry's driver jerked his car onto the right shoulder. Then, apparently trying to avoid a guard rail, he veered to the left; the Camry pinwheeled across the freeway and into the median. Levandowski, who was acting as the safety driver, swerved hard to avoid colliding with the Camry, causing Taylor to injure his spine so severely that he eventually required multiple surgeries." This was apparently just one of several accidents in Project Chauffeur's early days.

24 of 167 comments (clear)

  1. How Not To Write A Headline by American+AC+in+Paris · · Score: 5, Insightful

    These two yutzes cause a crash on the freeway and they don't even bother to stop and check if the other people are injured?

    They don't even bother reporting the crash to the authorities, they just driiive on back to HQ and hush it up?

    "Former Top Waymo Engineer Altered Code To Go On Forbidden Routes" is not the headline I would have chosen for this story, folks.

    --

    Obliteracy: Words with explosions

    1. Re:How Not To Write A Headline by chispito · · Score: 5, Informative

      If you don' t know something, just make it up? Who said they didn't stop?...Do you have some cite for information that says they did not report this accident, one that you're keeping secret from the law enforcement authorities who would like to know about it?

      I am not blaming you. The summary quotes the horrible Ars writeup, which itself butchers the New Yorker piece. In the New Yorker piece, it explicitly states about the incident

      The Prius regained control and turned a corner on the freeway, leaving the Camry behind. Levandowski and Taylor didn’t know how badly damaged the Camry was. They didn’t go back to check on the other driver or to see if anyone else had been hurt. Neither they nor other Google executives made inquiries with the authorities. The police were not informed that a self-driving algorithm had contributed to the accident.

      The quote from Ars doesn't even make it explicitly clear that the "forbidden route" was involved with the near miss which led to the Camry crashing. It should be noted, however, that the Camry driver was by all accounts at fault in that scenario. It sounds like the Camry thought he could be more aggressive and overtake the Prius, but the Prius (human or robot) has the right of way.

      --
      The Daddy casts sleep on the Baby. The Baby resists!
    2. Re:How Not To Write A Headline by Roger+W+Moore · · Score: 3, Informative

      These two yutzes cause a crash on the freeway and they don't even bother to stop and check if the other people are injured?

      Doesn't that actually depend on who has to give way when merging? In most countries, traffic merging has to give way to that on the main road. If this is true in California while the safer thing to do would have been to slow down and let the Camry in what was preventing the Camry from slowing down and merging in behind i.e. giving way to existing traffic as it merged?

      While the software could have taken steps to avoid this behaviour that it not the same thing as saying that it caused the accident. If you leave your house door open and you get burgled you have not caused your house to be burgled nor have you done anything wrong you just failed to anticipate that your actions would encourage bad behaviour by others.

    3. Re:How Not To Write A Headline by jittles · · Score: 2

      These two yutzes cause a crash on the freeway and they don't even bother to stop and check if the other people are injured?

      They don't even bother reporting the crash to the authorities, they just driiive on back to HQ and hush it up?

      "Former Top Waymo Engineer Altered Code To Go On Forbidden Routes" is not the headline I would have chosen for this story, folks.

      They most definitely did NOT cause an accident. The driver who is merging needs to actually MERGE and not just assume that people are going to let him in. Typically if they have their indicator on, I will adjust my speed to help them merge but it sounds like the driver of the other vehicle did not try to speed up or slow down. That is their problem and not Google's. Too many people just putter on down the on-ramp not even acting like they're getting onto a freeway or interstate. Sure there are areas where drivers ought to give extra consideration to mergers. Connecticut, as an example, has notoriously short on-ramps that make proper merging difficult.

    4. Re:How Not To Write A Headline by msauve · · Score: 4, Insightful

      "These two yutzes cause a crash on the freeway"

      You're not reading the same summary the rest of us are. They didn't cause any accident. It was the Camry which was merging onto the freeway. No doubt one of those assholes who merges - not by looking for a gap in traffic, positioning and adjusting speed - but by simply letting the white line on the outside of the merge lane "push" them into traffic, which they expect to make way for them. The Waymo car didn't do that, nor was it required to. The Camry continued to drive on the shoulder, and the Camry driver caused their own crash.

      --
      "National Security is the chief cause of national insecurity." - Celine's First Law
    5. Re:How Not To Write A Headline by MachineShedFred · · Score: 4, Informative

      In the United States, and specifically in California, the traffic entering the highway yields to traffic already on the highway.

      If there was no collision between the cars, then the Camry was at fault. They should have moderated their speed (read: slow down) and merged behind the Prius instead of trying to outrun it before the auxiliary lane went away. Bad, aggressive driving was responsible for this wreck.

      --
      Slashdot still doesnâ(TM)t support Unicode after it was added to the HTML standard in 1997.
    6. Re: How Not To Write A Headline by mrchew1982 · · Score: 5, Informative

      You're so fucking wrong that it's not funny. Before you kill somebody here is the relevant line from the CA DMV handbook: "Freeway traffic has the right-of-way." From: https://www.dmv.ca.gov/portal/... Every state that I have lived in has been the same, some going so far as to post "YIELD" signs on the on-ramp.

    7. Re:How Not To Write A Headline by commodore64_love · · Score: 2

      California needs to add "Yield" signs to the end of its ramps. Growing-up in the northeast I saw those signs everywhere, but in California? Almost never. Californians have no clue they are supposed to yield. They don't know the basic rules of the road.

      - Another thing common in other states is "Left Lane Passing Only" but those signs don't seem to exist in Cali, so people just hang out in the left lane, even when not passing.

      - And one more complaint: Where are the minimum speed signs? Many states have posted "40/70" or "45/75" for their minimum/maximum speeds. Not California where I was pulled-over by a Cop for doing 50.... too slow. Who knew that was illegal? It isn't posted (and it isn't illegal in any of the other 49 states).

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    8. Re:How Not To Write A Headline by commodore64_love · · Score: 2

      > By the sounds of it: the self-driving car was apparently very inconsiderate and didn't let a Camry merge on - a very bad move

      In my home state slowing down to allow a car to Merge will get you a ticket (very rare but I've seen it happen). THEIR LANE is the one that has the "Yield" sign so it is their job to do so, not the cars already in the main flow of traffic

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    9. Re: How Not To Write A Headline by MobyDisk · · Score: 4, Informative

      Here in the US, the "zipper principle" applies when two lanes are merging into one, but not when a car is merging onto the highway. Are you sure that, in Denmark, the zipper principle applies when merging onto a highway? That doesn't seem to apply since there should be many many car lengths of space between each car merging onto the highway, and there should not be a long line of cars require such a merge.

    10. Re:How Not To Write A Headline by sphealey · · Score: 2

      - - - - - Well; they didn't exactly cause a crash on the freeway --- they clearly contributed to creating the setting by which events occured. By the sounds of it: the self-driving car was apparently very inconsiderate and didn't let a Camry merge on - a very bad move the safety driver should've intervened on, which resulted in a scenario arising the Camry driver had a duty to anticipate and respond to in a safe manner but was apparently unprepared for: causing an accident, and the Camry would have been 100% at fault if it collided with another vehicle on the freeway.

      If you are merging, and the other vehicles on the other side of the merge are being rude and creating no opening:
      you still have to ensure you are driving at such speed that you can safely stop shorter than the end of your merge lane and wait for a clearing in traffic, and stop if required. - - - - -

      100% agree with the quote and your entire post. That said, five days a week I enter the motorway at an entrance where there are 4 lanes of traffic moving at 90 kph in the left lane and 15 kph in the right lane, joined by two merging lanes generally with traffic at 14 kph in the _left_ lane and 45 kph in the right, with an exit-only lane and another similar merge 3 km ahead. If everyone operated exactly according to the letter of the law we would bring the whole 5 km stretch to a crashing stop every day. People experienced in the region obey the norms and conventions of the metro area and that stretch of highway; those who are not observe and adapt in realtime. If 'autonomous' vehicles can't do this they the only way they could be used is if 100% of the vehicles on the road converted overnight - and even then I'm not sure how they would deal with my daily merge.

    11. Re:How Not To Write A Headline by MDMurphy · · Score: 4, Informative

      while the safer thing to do would have been to slow down and let the Camry in what was preventing the Camry from slowing down and merging in behind i.e. giving way to existing traffic as it merged?

      I've been screwed by the people who think slowing down to "let merging traffic in" is safer. I enter an onramp and adjust my speed to slip behind the person in the lane. What do they do? Slow down as well, hanging out in my blind spot as I run out of onramp. If you're on the road maintain your speed, don't speed up to cut someone off but don't slow down either. Then the person who's merging knows where you are and how fast you're going. If I see a slow vehicle merging onto the road and it seems we might be trying to share the same space I'll change lanes to the left, leaving them the lane to merge into. I do not alter my speed except to avoid an accident with an idiot who doesn't know how to enter a freeway.

    12. Re:How Not To Write A Headline by religionofpeas · · Score: 2

      People cannot always move over to the left lane if there's no gap there, or if that lane is moving much faster. The cannot always keep their speed either, because there may not be a gap big enough on the lane you're trying to merge in. When they slow down, the gap in front of them gets bigger, and you can safely slip in there.

  2. Why not just add by bobstreo · · Score: 2

    some flashing lights and rotating blades to the front, and some Roman chariot-like scythes to the wheels. Would probably eliminate most pedestrian issues, one way or the other. /s

  3. California Road Law by Anonymous Coward · · Score: 2, Informative

    Freeway traffic always has the right of way. It is the duty of the person merging onto the freeway to adjust their speed accordingly. This includes speeding up to prevent cutting people off.

    https://www.dmv.ca.gov/portal/dmv/detail/pubs/hdbk/merg_pass

  4. Re:What else is Google/Waymo/whoever hiding? by klingens · · Score: 4, Interesting

    I might sound callous to you but this has always been the case.
    Explorers who sought India, how many expeditions died? How many of them found what they actually sought? How many flight pioneers died so now we can travel to a beach resort two times a year? How many people died so far in rockets? How many people died before we thought "Hey, seatbelts would be a swell idea!". Airbags too but seatbelts would have been a possible tech from 1900 onwards while an airbag is much harder to build.

    New and possibly dangerous technology will always kill a number of people before it is made safe enough for the average user and commoditized. Driverless cars are even at the very beginning, so there will be many more deaths and injuries in the future I'd think before driverless cars will be common day usage.

  5. Re:Looking for more Native American DNA by MachineShedFred · · Score: 2, Informative

    Wildly off topic, but I guess I wonder why anyone gives a single shit about if she has native American blood somewhere in her ancestry or not. Does that all of a sudden make her policy stances more acceptable? Less?

    The things that voters choose to care about...

    --
    Slashdot still doesnâ(TM)t support Unicode after it was added to the HTML standard in 1997.
  6. Re:Who Does the time for HIT and RUN (crime) by jittles · · Score: 4, Insightful

    Seriously, why are there not criminal charges pending? Perhaps they stopped and reported it. But had they done that, why did the PR at Waymo not cite the police report? Conversely, a police report would have been created for the victim in the case of a hit and run -- where is the investigation into the Camry? Shoddy journalism. Fairly one sided view of the incident

    If they were not involved in the accident they are not obligated to stop or report anything. Unless I misread the article, they were not in an accident. AN idiot who does not know how to merge was in a single car accident, unless I am mistaken.

  7. Re:Who Does the time for HIT and RUN (crime) by commodore64_love · · Score: 4, Insightful

    WHAT hit and run? There was NO hit (the Google car was never impacted). It reminds me of when I was cruising down the interstate, and the guy behind me was distracted (probably on his phone)...... he came up behind me very rapidly, suddenly saw my car with mere feet to spare, and turned hard to avoid me (eventually hitting the guard rail).

    I thought "Should I stop?" and then remembered I'm in a flyover state where they own guns & quick to anger. So I kept going thinking "I didn't do anything wrong. I was in my lane, driving 65, never deviating from my course

    "I can't help if the idiot CRASHED HIMSELF without any intervention by me." Same with the google car, which did not cause the Camry to crash.... the Camry driver crashed himself with reckless, uncontrolled swerving.

    --
    "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
  8. Re:What else is Google/Waymo/whoever hiding? by Kulahan · · Score: 2

    Nah, we need autonomous driving.

    There are a huge number of benefits once we finally cross the threshold of 100% autonomous drivers. There will be a day, far in the future, when a car crashes and causes a traffic jam and it makes national headlines. You'll see posts on reddit's successor about how kids these days don't understand the past horrors of having to be awake for a 35 minute commute to work BOTH WAYS. You can train people as much as you want - you'll never reach that level if you don't just get their hands off the wheel altogether.

    There are way more benefits, but you get the idea.

    People are too easily distracted to ever be trusted with a 4000 pound block of metal and flammable liquids capable of going over 100 mph easily.

  9. Yeah, right! by WoodstockJeff · · Score: 2

    > As The New Yorker wrote: "A human driver could easily have handled the situation by slowing down and letting the Camry merge into traffic ..."

    Rather funny to read anything that involves a "New Yorker" suggesting that human driver would exercise courtesy, let alone courtesy that wasn't required by law....

  10. Re:Who Does the time for HIT and RUN (crime) by sphealey · · Score: 2

    - - - - - - WHAT hit and run? There was NO hit (the Google car was never impacted). - - - - -

    Unless a video still exists we will never know exactly what happened, and as discussed above a driver that causes an accident by violating the norms and conventions of a maneuver and/or region can always fall back to the letter of the law to claim they weren't at fault.

    With that said, your statement raises a bit of concern for the future in that if autonomous vehicles are good at anything it will be dancing around a potential point of impact, thus saving themselves from collision at the price of forcing other vehicles into unrecoverable situations. Unless these vehicles explicitly implement the Three Laws the result of putting 5% of them into the driving population may not be the accident reduction nirvana their proponents claim - a bit of unintended consequence may well intervene.

  11. Human Driver Response by CNTOAGN · · Score: 2

    "A human driver could easily..." Bullshit. Human drivers are the worst. A drunk monkey could do better than most humans who are distracted by their pretty phones.

  12. Re:Was this a case of bad Waymo code... by ledow · · Score: 2

    I am not defending anyone here but this is part of the problem.

    When drivers drive "exactly as they should've done", alongside humans who don't, then it ends in such accidents.

    As my dad always said, you can always argue about who's to blame, or who has right-of-way, but it's easiest to just not have the accident in the first place.

    And let me highlight - the problem with automated cars is not that they "can't break the rules" like humans do. I'd much prefer we kept to the same rules than they learned to expect us to break them because that's just madness. The problem is that there are two totally incompatible ways of driving on the same road, and one of them is unable to change it's programming.

    That means it has to be just as rude as us, or it will literally follow the rule of the road and "cause" accidents (the cause is really the other guy being a dick, but you know what public perception will be).

    Self-driving cars need to be on their own road. And at that point, you might as well just build personal trains.