Comment by JohnMakin
1 hour ago
At this point we’re playing semantic nittery. us-east-1 is their control plane. critical services that only run in us-east-1 were impacted badly. this has a cascading effect to services that run in other regions that rely on those services - even if those services themselves aren’t technically out, it’s a cascading effect. the whole fucking internet went down that day.
my original claim was that their control plane runs in us-east-1. this is a fact.
> my original claim was that their control plane runs in us-east-1. this is a fact.
The claim I'm testing is whether the impact spread to AWS services in other regions.
> At this point we’re playing semantic nittery.
It's not "semantic nittery." It's important as an engineer to be precise about the impact of incidents and how systems are architected, as opposed to making broadly sweeping (and false) claims that "[an entire] control plane runs in us-east-1" and "the whole fucking internet went down that day."
As someone who worked for AWS, I have insider knowledge that what you said is not true as a blanket statement. They generally take great care to isolate both control and data planes regionally, with rare exceptions where service data has to be globally consistent. Moreover, they have always recommended not to rely on control planes to respond to incidents: https://docs.aws.amazon.com/wellarchitected/latest/framework...