Comment by cjsplat
3 days ago
I was driving across the east side of SF and hit a patch of lights that were out.
The Waymo's were just going really slow through the intersection. It seemed that the "light is out means 4-way stop" dynamic caused them to go into ultra-timid mode. And of course the human drivers did the typical slow and roll, with decent interleaving.
The result was that each Waymo took about 4x as long to get through the intersections. I saw one Waymo get bluffed out of its driving slot by cross traffic for perhaps 8 slots.
This was coupled with the fact that the Waymos seemed to all be following the same route. I saw a line of about a dozen trying to turn left, which is the trickiest thing to navigate.
And of course I saw one driver get pissed off and drive around a Waymo that was advancing slowly, with the predictable result that the Waymo stopped and lost three more slots through the intersection.
On normal days, Waymos are much better at the 4-way stops than they used to be a few years back, by which I mean they are no longer dangerously timid. The Zoox (Amazon) cars are more like the Waymos used to be.
I expect there will be some software tweaks that will improve this situation, both routing around self-induced congestion and reading and crossing streets with dead lights.
Note that I didn't see any actually dead Waymos as others have reported here. I believe this is an extreme failsafe mode, and perhaps related to just too much weirdness for the software to handle.
It would be interesting to see the internal post mortem.
Its either people complain that they go slow and are too careful, or they will video and complain about every small traffic infringement that they make. Humans never driver 100% within the law and no one really cares. The second a single one of those things steps out of line and its an uproar. they have to drive ultra conservatively. How long have people been complaining about that one cat.
>either people complain that they go slow and are too careful, or they will video and complain about every small traffic infringement that they make.
Is there a name for this (and related) effects? Obviously, in a group of several hundred thousand people, there will always be at least a few people that complain about something for the exact opposite reasons. That's not a signal of usefulness. I feel we need a name for the some-rando-has-an-opinion-that-gets-picked-up-and-amplified-by-"the algorithm" phenomena. And the more fringe/out-there, the more passionate that particular person is likely to be about this issue, when "most" people feel "eh" about the whole thing.
The answer to everything in life is always "somewhere in the middle".
We could call it GuinansEyebrows' law, but it's definitely far from new.
the fact that there's practically no visible regulatory response to autonomous/remote-controlled vehicles that violate traffic laws or put people/pets/property at risk is a big part of why i'm personally not okay with these vehicles being allowed to use public rights-of-way.
when a waymo can get a traffic ticket (commensurate with google's ability to pay, a la the new income-based speeding ticket pilot programs in LA and SF), and when corporate officers down to engineers bear responsibility for failures, i think a lot more people will stop seeing these encroachments onto our commons as a nuisance.
story time: i've literally had one of those god awful food delivery robots run straight into me on a sidewalk. once, one of them stopped in my way and would not move, so i physically moved it myself and it followed me to my apartment. i'm about to start cow-tipping them (gently, because i don't want a lawsuit alleging property damage, even though they're practically just abandoned tech scrap without a human operator nearby to take responsibility).
Failed pretty badly but no reported injuries or even accidents so not that badly.
And if you’re Waymo, it’s a short-term reputation hit but great experience to learn from and improve.
Triggering some sort of extreme safety mode is considered failing now?
Anything other than "normalish" tends to be a failure in driving. I.e. stopping and throwing your hazards on when you're in the intersection isn't success just because there were even worse options to have picked. It's nice they were able to pull the fleet back and get the cars out of the roads during the problem though.
I think this was a failure. The gold standard should be that the if every human driver was replaced with an AI how well could the system function. This makes it look like things would be catastrophic. Thus, showing how humans continue to be much more versatile and capable than AI.
I suppose if you lower the standards for what you hope AI can accomplish it wouldn't be considered a failure.
2 replies →
I'd say yes. The goal of a self-driving car is to emulate humans. If the car is panicking and reverting to "extreme safety mode" in situations where a normal human is going to be fine, then that's a failure.
>Failed pretty badly but no reported injuries or even accidents so not that badly.
Just because no integer lives were wasted doesn't mean we can't sum the man hours and get a number greater than 1
Using that math it would be better if they were faster even if they killed somebody.
That's a repulsive argument... Just because some argument is logically sound doesn't mean it's rational or reasonable.
Also, when attempting that math, make sure you account for the buffer that everyone already builds into their life. No sense in double counting the extra 10m I'm angry in traffic, instead of angry sitting at home because I'm doom scrolling some media feed with that extra 10m I saved because the robotaxi was faster.
3 replies →
[flagged]
/Programmers/ can.
>to learn from and improve.
Okay, let's see if they actually do it this time.
Waymo has been quite good about responsibly learning and improving imo. I do hope and think they’ll learn from this.
7 replies →
>It would be interesting to see the internal post mortem.
What post mortem? The whole fleet reverted to it's "baseline" of acting like a hysterical teenager on day 1 of driver's ed. Obviously there's serious collateral damage to overall system performance when you just create thousands of those people out of thin air but that's "other people's problem" as far as waymo is concerned.
I’m curious what’s the regulation in this scenario? In Canada I think light off means 4-way stop signs so everyone obeys that, or at least most of everyone. What’s the situation in SF?
Yes, that is the same law in California, but so many people drift through stop signs that the guidance is close to meaningless.
In addition, there are 4-way stop signs all over SF and tourists regularly comment on how they work here.
The law is clear - yield to the right, but that is a pretty slow system in congested roads.
The local custom in SF is that someone is usually obviously first, rightmost, or just most aggressive, and opposing pairs of cars go simultaneously, while being wary about left turns.
Of course pedestrians have right of way in California, so someone in a crosswalk gives implied right of way to the road parallel to the person's crosswalk.
The result is 2x or better throughput, and lots of confused tourists.
So ... with the lights out on a Saturday before Xmas, there was a mess of SF local driving protocol, irritated shoppers, people coming to SF for Xmas parties, and just normal Saturday car and foot traffic.
I thought Waymo did pretty well, but as I said, I didn't see any ones that were dead in the middle of the street..
Is this not how four way stops work everywhere? I live in Kansas and have previously lived in Chicago, and I feel like both places follow this custom. Only thing that’s different is the laws are followed slightly more rigorously in low traffic areas, but the customary rules are definitely still in play.
3 replies →
Your local custom seems to describe 4 way intersections everywhere.
1 reply →
>The local custom in SF is that someone is usually obviously first, rightmost, or just most aggressive, and opposing pairs of cars go simultaneously, while being wary about left turns.
This is how it works in most of north america.
Those confused tourists are just making up excuses for being poor drivers.
Yes, I feel the same way about driving in NYC thanks for asking.
I thought the US had a “FIFO” rule for 4 way stop signs? I had to drive through Nevada and Arizona last year so read up on the rules.
Keeping track of which cars entered at what time was kind of stressful and I’m pretty sure I didn’t do a good job of it.
1 reply →
Thanks, I get the situation is pretty chaos...
Legally in the United States a completely dead traffic signal becomes an all way stop.
Thanks you!
SF drivers mostly don’t stop at stop signs. Many do not stop at red lights either.
> And of course I saw one driver get pissed off and drive around a Waymo that was advancing slowly, with the predictable result that the Waymo stopped and lost three more slots through the intersection.
Why are you saying they got pissed off? Going around another vehicle that is blocking the road sounds like basic driving to me.
Obviously things will continue to improve, so this is a point in time criticism.
One of the biggest issues with current state of tech I see is, where these cars usually are. They're in cities, and most often in very dense ones, and ones in the south. These are effectively perfect conditions.
From my perspective, I wonder how these cars will behave with ice on the road, with snow, or a typical Montreal Wednesday of "It's a blizzard, you can't see 10 feet, there is snow on the road and ice, it's slippery, all the lines and street markings are obscured completely, oh and the power is out and there are no traffic lights."
Some of this can be resolved by snow tires, or even studded tires which are legal in Quebec. It should be noted that Quebec plows the roads less, and uses less dirt and salt on the road, and also enforces a law that snow tires are on cars in the winter. Of course studded tires give insane grip on ice, but have reduced grip on rain.
And it can 10C and rain, then freeze, then be a blizzard, then move to -40C, all in a few days.
But anyhow, my point is if a Waymo is slow with a missing traffic light, how will it act with a missing traffic light, and 10ft visual range of reflective snow in the air, no ability to see lines on the street, and so on. Humans are great at peering and seeing mostly obscured indications of an intersection, but this is still challenging for a car with a top priority of safety.
Here's another example. The cameras in my car are constantly obscured by slush, dirt, and such on the windshield and all over the car. All the roads are coated with dirt to help with slipping on ice. I often have my car absurdly complaining that cameras are covered, and there's no assist this and that, just because the entire car is coated in dirt.
How will a Waymo operate with all sensors covered in dirt?
There are probably solutions. But it feels like it will be a long while before such cars treat a normal day in winter, as usual.
It should be noted that I've simply discussed downtown Montreal. What of a rural area? And by rural, I mean houses 1 km apart, also with a blizzard, all lines obscured on the road, and meanwhile Canadians just intuitively know where and how to drive it. We just slow down a bit (from 120km/hr to maybe 70km/hr) and just drive on our merry way. If we try to stop, distances are greatly extended, and of course in some places without care you'll just slide into the ditch.
Of course that's just a Wednesday, and you can read the 'signs of the road', and sort of tell where to slow down more. Where to take more care.
Sometimes, you'll see a bunch of cars in the ditch, and think 'Ah, must be particularly slippery here', and slow down a bit more.
It’s entirely possible we only ever get them in major cities where feasible, and that seems ok.
No way, it would be such a humongous quality of life improvement for humanity. I don't think we will just give up on it. Car interiors could be reworked once all the controls were gone, throughput on freeways/roads could be optimized, all the parking lots could be closed.
I'm starting to realize that this is most likely what will happen. They'll be available in select major cities, for certain areas, under certain weather conditions.
It would help in many respects. I'll 100% agree that a solution doesn't need to be absolute, that edge cases don't mean a failure.
I'm also curious about this. They're coming to Minneapolis next year, so apparently they're confident in their ability to figure out cold / unpredictable weather (in urban conditions at least).
LIDAR can't be compared to radarless cars (yes, to Teslas) The car might have a better understanding in low visibility conditions than a person (blizzard)
Wouldn’t LIDAR be completely ineffective in a blizzard?
1 reply →
I got stuck behind a Zoox in SF trying to cross the street from an alley. There was an endless stream of stop & go traffic and the Zoox refused to push itself into traffic, despite other cars deliberately giving it space. I wasn't sure if honking at it would help or hurt the situation.
I'm not sure if it even knows it's being honked at.
There was definitely a second there where they were aggressive enough to run red lights, probably because they kept getting rear-ended by people that were expecting them to run the red light.