{"id":44261536,"user":"jerrygoyal","time":1749754182,"time_ago":"3 days ago","type":"comment","content":"

GCP is also down https://news.ycombinator.com/item?id=44260810","comments":[{"id":44262366,"user":"tete","time":1749757668,"time_ago":"3 days ago","type":"comment","content":"

When being down scales. :D","comments":[],"comments_count":0,"level":0,"url":"item?id=44262366"},{"id":44261642,"user":"ipsum2","time":1749754593,"time_ago":"3 days ago","type":"comment","content":"

Odd coincidence. Wonder if Cloudflare uses GCP?","comments":[{"id":44261705,"user":"ikiris","time":1749754843,"time_ago":"3 days ago","type":"comment","content":"

It's likely their auth infra based on what the Google outage is","comments":[{"id":44261787,"user":"devmor","time":1749755142,"time_ago":"3 days ago","type":"comment","content":"

What do you mean by this? The Google outage is a widespread outage of most GCP services.","comments":[{"id":44261827,"user":"pageandrew","time":1749755292,"time_ago":"3 days ago","type":"comment","content":"

Google is claiming the root cause is with some of their central IAM services, which would have a cascading effect to the rest of their services.","comments":[{"id":44261883,"user":"devmor","time":1749755513,"time_ago":"3 days ago","type":"comment","content":"

Where did you see this information? Was it on a social media channel? I do see the IAM services in the list of affected services in the incident report.","comments":[{"id":44261901,"user":"tom1337","time":1749755592,"time_ago":"3 days ago","type":"comment","content":"

check https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1S...

> Multiple GCP products are experiencing impact due to Identity and Access Management Service Issue","comments":[],"comments_count":0,"level":5,"url":"item?id=44261901"},{"id":44262861,"user":"ikiris","time":1749760302,"time_ago":"3 days ago","type":"comment","content":"

Scroll up. Its literally in this HN comment section highly upvoted.","comments":[{"id":44266268,"user":"devmor","time":1749797404,"time_ago":"2 days ago","type":"comment","content":"

It was not when I posted the reply that you are replying to 2 hours after I posted it.","comments":[],"comments_count":0,"level":6,"url":"item?id=44266268"}],"comments_count":1,"level":5,"url":"item?id=44262861"}],"comments_count":3,"level":4,"url":"item?id=44261883"}],"comments_count":4,"level":3,"url":"item?id=44261827"},{"id":44262878,"user":"ikiris","time":1749760397,"time_ago":"3 days ago","type":"comment","content":"

The comment was self explanatory, and no, it wasn't a widespread GCP outage. Most everything was up except for GCS and firebase, and later on identity stuff started causing cascading issues but not when this was posted.","comments":[{"id":44263220,"user":"zerd","time":1749762513,"time_ago":"3 days ago","type":"comment","content":"

> it wasn't a widespread GCP outage.

If this wasn't widespread, what is?

Incident affecting API Gateway, Agent Assist, AlloyDB for PostgreSQL, Apigee, Apigee Edge Private Cloud, Apigee Edge Public Cloud, Apigee Hybrid, Cloud Data Fusion, Cloud Firestore, Cloud Logging, Cloud Memorystore, Cloud Monitoring, Cloud Run, Cloud Security Command Center, Cloud Shell, Cloud Spanner, Cloud Workstations, Contact Center AI Platform, Contact Center Insights, Data Catalog, Database Migration Service, Dataform, Dataplex, Dataproc Metastore, Datastream, Dialogflow CX, Dialogflow ES, Google App Engine, Google BigQuery, Google Cloud Bigtable, Google Cloud Composer, Google Cloud Console, Google Cloud DNS, Google Cloud Dataflow, Google Cloud Dataproc, Google Cloud Pub/Sub, Google Cloud SQL, Google Cloud Storage, Google Compute Engine, Identity Platform, Identity and Access Management, Looker Studio, Managed Service for Apache Kafka, Memorystore for Memcached, Memorystore for Redis, Memorystore for Redis Cluster, Persistent Disk, Personalized Service Health, Pub/Sub Lite, Speech-to-Text, Text-to-Speech, Vertex AI Search","comments":[{"id":44264527,"user":"ikiris","time":1749773359,"time_ago":"3 days ago","type":"comment","content":"

Our entire infra in GCP stayed up just fine, we just couldn't manage anything. IDK what to tell you. Many of the things you list here were not down at all.","comments":[{"id":44265015,"user":"mirashii","time":1749779182,"time_ago":"3 days ago","type":"comment","content":"

That it wasn’t down for you does not mean it wasn’t down for others or even almost everyone. Certainly, Google wouldn’t have listed the services as having an outage if nobody was impacted. You can’t extrapolate from “works for me” to “it must have been working for everyone”.","comments":[{"id":44265728,"user":"ikiris","time":1749789413,"time_ago":"2 days ago","type":"comment","content":"

Dude, I literally was an SRE there. I'm well aware of how this stuff works.

If some of those things listed had actual widespread outages, it would have been much much worse.","comments":[{"id":44267063,"user":"solardev","time":1749807342,"time_ago":"2 days ago","type":"comment","content":"

I don't understand your argument? Wasn't GCP's own status page calling them outages? Some of our upstream providers (who use GCP) were definitely affected and down.

As a former SRE there, is "widespread outage" a specific, special kind of classification that's not obvious to the public just by looking at the status page...? Or what do you mean?","comments":[],"comments_count":0,"level":8,"url":"item?id=44267063"}],"comments_count":1,"level":7,"url":"item?id=44265728"}],"comments_count":2,"level":6,"url":"item?id=44265015"},{"id":44265038,"user":"iimblack","time":1749779379,"time_ago":"3 days ago","type":"comment","content":"

So weird to argue when google themselves listed these as having an outage.","comments":[],"comments_count":0,"level":6,"url":"item?id=44265038"}],"comments_count":4,"level":5,"url":"item?id=44264527"}],"comments_count":5,"level":4,"url":"item?id=44263220"}],"comments_count":6,"level":3,"url":"item?id=44262878"}],"comments_count":12,"level":2,"url":"item?id=44261787"},{"id":44264070,"user":"artursapek","time":1749768866,"time_ago":"3 days ago","type":"comment","content":"

Their KV store was definitely down.","comments":[],"comments_count":0,"level":2,"url":"item?id=44264070"}],"comments_count":14,"level":1,"url":"item?id=44261705"}],"comments_count":15,"level":0,"url":"item?id=44261642"}],"comments_count":17,"url":"item?id=44261536"}

Comment by jerrygoyal