Slashdot Mirror


How Autonomous Cars' Safety Features Clash With Normal Driving

An anonymous reader writes: Google's autonomous cars have a very good safety record so far — the accidents they've been involved in weren't the software's fault. But that doesn't mean the cars are blending seamlessly into traffic. A NY Times article explains how doing the safest thing sometimes means doing something entirely unexpected to real, human drivers — which itself can lead to dangerous situations. "One Google car, in a test in 2009, couldn't get through a four-way stop because its sensors kept waiting for other (human) drivers to stop completely and let it go. The human drivers kept inching forward, looking for the advantage — paralyzing Google's robot." There are also situations in which the software's behavior may be so incomprehensible to human passengers that they end up turning it off. "In one maneuver, it swerved sharply in a residential neighborhood to avoid a car that was poorly parked, so much so that the Google sensors couldn't tell if it might pull into traffic."

25 of 451 comments (clear)

  1. Poor example by fred911 · · Score: 5, Insightful

    "One Google car, in a test in 2009,..."

    One would think that in 6 years some improvements would have been made. Do we have a more current example?

    --
    09 F9 11 02 9D 74 E3 5B - D8 41 56 C5 63 56 88 C0 45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    1. Re:Poor example by wstrucke · · Score: 4, Interesting

      "One Google car, in a test in 2009,..."

      One would think that in 6 years some improvements would have been made. Do we have a more current example?

      It mentions further down in the article that that particular example has already been corrected.

      ... For instance, at four-way stops, the program lets the car inch forward, as the rest of us might, asserting its turn while looking for signs that it is being allowed to go.

    2. Re:Poor example by Braedley · · Score: 5, Interesting

      As it turns out, we do. A Google Self Driving Car and a cyclist on a fixed gear bike met at a 4-way stop. The cyclist was doing a track stand (staying upright on the peddles, sometimes peddling backwards and forwards a small ammount) instead of balancing on a foot. This caused the Google car to think the cyclist was going to enter the intersection after the car had started moving, causing it to stop and "wait" for the cyclist, which by this point had "stopped", which the car took to mean that he (the cyclist) was waiting for the car to go (which was actually the case), and so the car would start moving again until the cyclist started his next forward motion to balance himself.

    3. Re:Poor example by PolygamousRanchKid+ · · Score: 5, Insightful

      it will be always be a challenge to have these control systems anticipate what human drivers intend to do.

      This is complicated by the fact that some human drivers do not even know themselves, what they intend to do. So how should a computer control system be able to anticipate what a human driver intends to do, when the human drivers don't even know themselves?

      I really don't think it is that many . . . maybe only 1% of all human drivers. However, one clueless driver can confuse and tie up 99 drivers who know where they want to go, and can communicate it to other drivers.

      It's like being on a escalator at the airport or train station. Two folks don't know where they are going. So they stop dead in their tracks at the end of the escalator, blocking the path for all the other folks on the escalator. An accordion affect ensues, with all the folks on the escalator getting squished together. The two people doing the blocking, are totally oblivious to this fact. Their field of vision ends at their own noses. They are entirely engulfed in themselves, and can't even conceive that there are other living beings around them.

      This is what happens on the road, as well. The driver of the car parked halfway into the street, is just not capable of thinking, that other drivers might be confused by this. Is the car really parked? Or is the driver trying to park? Or maybe trying to drive away . . . ? At any rate, some drivers need to be taught that it is terribly important to anticipate how others might interpret their actions.

      --
      Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
    4. Re:Poor example by AmiMoJo · · Score: 4, Informative

      The NYT hates new car tech, especially EVs and robots. I seems to be in the pocket of some big vested interests (oil presumably, maybe other auto manufacturers who are falling behind). Remember the infamous Tesla Model S review by that Broder guy, where he did everything in his power to make it fail, exceeding the speed limit and slow-cooking himself with the heater etc.

      This is just another hit-piece against autonomous cars. It might even be out to trash Tesla again, since they are introducing autopilot.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    5. Re:Poor example by jbengt · · Score: 4, Interesting

      It's like being on a escalator at the airport or train station. Two folks don't know where they are going. So they stop dead in their tracks at the end of the escalator, blocking the path for all the other folks on the escalator.

      That is a well known problem in architectural design. Give a clear path for people to exit and clear escalators and the like, and place directional signs where people have space to stop to read them. There's an art to finding a way to entice people away from stairs and escalators after they exit them.

    6. Re:Poor example by McWilde · · Score: 4, Insightful

      Take your idiotic talent to the track. In traffic, you put your foot down at the intersection. This causes you no delay at all, since you can start creating forward movement with the other foot still on the pedal.

      --
      Maybe
    7. Re:Poor example by Boronx · · Score: 4, Funny

      It's not a traffic circle without a million dollar island complete with shrubbery.

  2. In other news by Anonymous Coward · · Score: 5, Insightful

    Millions of people on the road today deserve to have their license taken from them because they can't follow simple rules like signaling, not parking halfway out into the street and leaving enough room to brake in case the car in front of you brakes.

    1. Re:In other news by Lumpy · · Score: 4, Insightful

      Or speeding in residential areas. Those people are the scum of the earth.

      --
      Do not look at laser with remaining good eye.
    2. Re:In other news by Mr+D+from+63 · · Score: 4

      Left lane laggards are even lower.

    3. Re:In other news by Anonymous Coward · · Score: 5, Informative

      Not your job to prevent others from speeding. In fact in most cases the law is written forcing you to yield the left lane to the speeder as they are traveling faster then you.

      It is more dangerous for you to go slowly in the left lane and force the speeders to pass you on the right, then it is for you to just get the hell over.

  3. culture dependent by Chrisq · · Score: 4, Interesting

    “They have to learn to be aggressive in the right amount, and the right amount depends on the culture.”

    Very true, When holidaying in Texas I quickly found out that stopping for a red light that had just turned would upset drivers behind me. The lights had a much longer amber time, so a whole lot of people who would have had to brake for the lights in the UK would go through

    1. Re:culture dependent by Pentium100 · · Score: 4, Interesting

      Depends on the location. In my country, a yellow light means you can legally drive out of an intersection (for example, if you are turning left), but not into it, unless you need to brake suddenly, in which case you can go.

      Now, "brake suddenly" is a subjective thing. If I see the light some distance away and do not need to slam on the brakes to stop, then I stop. It may cause an inattentive driver to hit me from behind (happened recently when I stopped to allow a pedestrian to cross as required by law).

      However, it is also the law to leave a safe distance between you and the car in front so you can stop without hitting it if the car in front of you suddenly stops. If you hit another car from behing, you will almost always be found guilty (pretty much the only hope for you is for the other driver to be drunk - drunk drivers are always guilty for an accident even if they did not cause it - this is done to discourage people from driving drunk).

    2. Re:culture dependent by Malc · · Score: 4, Informative

      Amber means stop you can do so safely:
      https://www.gov.uk/government/...

      It does not mean try to squeeze through because you think you have time. I know people who've had tickets for running the amber, despite being across the line before it went red.

    3. Re:culture dependent by jabuzz · · Score: 4, Informative

      The other get out for hitting a driver in front is if said driver pulled into your safe braking distance.

      So if some idiot pulls out of a junction without looking and you go into the back of them as a result it is not your fault. Another one would be someone overtaking pulling in and then slamming the brakes on (the last one is often done as part of an insurance fraud).

      There are a whole bunch of others as well, though they can be hard to prove if you don't have a dashboard camera.

    4. Re: culture dependent by fisted · · Score: 4, Funny

      I'm color blind, you insensitive clod. It's called fucking the middle grey.

  4. Programmed behaviour is programmed behaviour. by ledow · · Score: 5, Interesting

    If the programming makes it jerk the steering away from a stationary hazard rather than, say, detect it earlier and slow down as it approaches, then it's not suitably programmed for coexistence with unexpected stationary hazards (Not even anything to do with human presence! What if that was a cardboard box and it swerved heavily in case that box "pulled out"?).

    If it can't make it's way through a junction where the drivers are following the rules, that's bad programming. If it can't make it's way through a junction where other drivers don't come to a complete halt for it, it's not fit to be on the road with other drivers.

    If you want a car to co-exist on the road, it has to be treated as a learner driver. If a learner driver swerved at a non-hazard, they would fail. If a learner driver refused to make progress at a junction because the masses didn't open up before it, they would fail. So should an automated car.

    Unless - and this is important - you are saying that automated cars should only operate on automated roads where such hazards should never be possible and they are deliberately NOT programmed to take account of such things. Which, in itself, is expensive (separate roads with separate rules with no human drivers), stupid (that's otherwise known as a "train line", and because they can't do anything about it it will hurt more when it does happen), and dangerous (because what happens if a cardboard box blows over the automated road? etc.).

    Program to take account of these things, or don't plan on driving on the road. The safety record is exemplary but equally there are only a handful of them and the eyes of the world are on them, and there are still humans behind the wheel, and even by miles travelled each one is probably dwarved by a single long-distance driver over the course of a year - and it's not hard to find a long-distance driver who's not had an accident for years.

    If you're going to be on the roads, then you need to be able to take account of all these things, the same as any learner driver. Sure, you didn't hurt anyone by swerving or not pulling out, but equally - in the wording of my first driving test failure - you have "failed to make adequate progress" while driving.

    A car sitting on a driveway would have an even better safety record but, in real life, it's still bog-useless compared to a human. Similarly for any automated vehicle that just stops at a junction because it can't pull out, or swerves out of the way of a non-hazard (and potentially weighs up collision with non-hazard vs collision with small child and gets it wrong).

    1. Re:Programmed behaviour is programmed behaviour. by Cassini2 · · Score: 5, Interesting

      If it can't make it's way through a junction where the drivers are following the rules, that's bad programming. If it can't make it's way through a junction where other drivers don't come to a complete halt for it, it's not fit to be on the road with other drivers.

      The problem is that people don't follow rules. We follow approximations of the rules. For instance, my driver's handbook described the correct way to deal with yielding at a four-way stop as "yield to the person on the right." For a computer, that's an obvious deadlock situation, or worse - an obvious mistake. If four cars are parked at a four way stop, and each car yields to the car on the right, then (a) a situation could occur where no one goes anywhere, and (b) if the individual cars only pay attention to the person on the right, then they could hit an on-coming car turning left, or the car on the left turning left. People process the "yield to the person on the right" rule into something much more complex.

      People use a number of complex behaviours at four-way stops. Firstly, the wave of the hand, or the nod of the head to indicate that you yield to the other driver is an important signal. Secondly, in my jurisdiction, 90% of the four way stops are done on a first-come first-served basis. Lastly, and this is the bit I don't understand, often people yield to the person on the left. The actual system of navigating a four-way stop is much more complex than what an initial computer implementation might be.

    2. Re:Programmed behaviour is programmed behaviour. by Xyrus · · Score: 4, Insightful

      Computers follow rules. Humans (a.k.a every other asshole on the road) do not.

      This is a no win situation. If you program a car to drive safely and follow rules, then it won't be safe on roads because of all the assholes who don't. If you program the car to behave more like an asshole ( a human driver), then it won't be safe since there's a good chance it will make the wrong call. If you program the car to just account for assholes but still drive safely, then it will basically choke in situations like a four way stop in southern California where every other asshole will just muscle or roll their way through the stop.

      The long pole in the tent isn't developing an AI capable of driving. It's developing an AI that can deal with assholes.

      --
      ~X~
    3. Re:Programmed behaviour is programmed behaviour. by edtice1559 · · Score: 4, Interesting

      You can't program the self-driving car to break the rules as it opens up all kinds of moral and (more importantly, or at least more expensively) legal liability issues. You have a human driver for that situation until the proportion of self-driving cars increases enough to change traffic characteristics.

  5. Re:Actually, it IS the software's fault by bickerdyke · · Score: 5, Insightful

    The article summary isn't very good. If the software is programmed in a way that causes a car to behave in a way that's dangerous, it IS the software's fault.

    That's trivial but true.

    It becomes interesting when the software has the car behaving in a way that is SAFE, but unexpected.

    --
    bickerdyke
  6. Re:Not normal driving. by gstoddart · · Score: 4, Informative

    Which is always going to be the problem ... because as long as there are human drivers on the road, there will always be cases in which the computer utterly fails.

    And any technology future which is predicated on suddenly replacing all drivers with autonomous cars is complete crap and will never actually happen. Because nobody is going to pay for it.

    It's the corner cases which will always cause these things to go wrong. And, I'm sorry, but the driver with his right turn signal on who swoops across two lanes and turns left ... or the ones who think they can use the oncoming lane because there's something in their lane ... or who randomly brake because they can see a cat a half mile away ... or cyclists who do crazy and random shit ... or any number of crazy things you can see on a daily basis ... all of these things will create situations in which the autonomous car utterly fails to do the right thing.

    As much as people think it will mostly work most of the time, if these things require the driver to constantly monitor it or have to swoop in when the system decides it doesn't know what to do, then the utility of the autonomous car pretty much vanishes.

    I just don't see this technology ever becoming widespread or used in the real world, other than by companies trying to prove how awesome it is. Because it's just going to have too many cases which simply don't work, and the occupants will have to be ready to take the controls.

    In which case you might as we be driving and actively engaged in the process instead of zoned out and not paying attention. Because the human reaction time is greatly diminished when you're reading the newspaper and suddenly have to take evasive reaction.

    --
    Lost at C:>. Found at C.
  7. Re:Best solution: by Anonymous Coward · · Score: 5, Insightful

    No surprise this is up modded insightful. I'm betting many slashdotters are horrible technologists who assume the world needs to bend to technology. Simply put, that's not the case. If these cars can't handle driving around humans they are not ready for consumption. The fact that they can't properly work with and adapt with humans on the road means that these cars are unsafe. They may be "safe" from the definition of the laws, but they are not safe if they are causing or instigating traffic accidents. It seems it's blind luck that these cars haven't been the clear cut cause of an accident yet.

  8. Re:Best solution: by TWX · · Score: 4, Insightful

    More to the point, autonomous cars are currently not the cheaper technology. Any bill that would attempt to force conventional vehicles off of the road would be stillborn, there are far too many automotive enthusiasts that have already made inroads in the other direction (ie, looser emissions testing rules on cars with collectors' insurance) that it literally can not happen. There would also be pushback from those that simply cannot afford new cars and advocacy groups for them; one can buy running cars for less than $1000 on the used market, it will take a decade for there to even be a chance for a used autonomous vehicle to be that cheap, if not even longer.

    There have been lots of discussions on attempting to change driver behavior. Those are also nonstarters. People are not going to change how they drive until conditions in the field force them to do so. Hell, we still have idiots driving below the speed limit in the left lane on busy freeways where they're actually posing a safety hazard and where the law actually states that one can be cited for failing to yield and being passed on the right. Most people probably don't even know the rules for what's defined as stopping (ie, remaining still for two seconds where I live) and have no interest in bothering to learn, and the police don't seem inclined to enforce either, so this simply won't change.

    The cars are going to have to learn how to adapt to these conditions.

    --
    Do not look into laser with remaining eye.