Google Cloud Platform load-balanced Web sites outage.

It appears quite a few sites that use GCP load balancers are all returning a 404 right now. Two examples include spotify.com and homedepot.com. I have checked from many separate locations. -- Hunter Fuller (they) Router Jockey VBH M-1A +1 256 824 5331 Office of Information Technology The University of Alabama in Huntsville Network Engineering

Looks like they have something up now: Incident affecting Google Cloud Networking Global: Experiencing Issue with Cloud networking Incident began at *2021-11-16 10:10* (all times are *US/Pacific*). DATETIMEDESCRIPTION 16 Nov 2021 10:10 PST Summary: Global: Experiencing Issue with Cloud networking Description: We are experiencing an issue with Cloud Networking beginning at Tuesday, 2021-11-16 09:53 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2021-11-16 10:40 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers may encounter 404 errors when accessing web pages. Workaround: None at this time. On Tue, Nov 16, 2021 at 1:12 PM Hunter Fuller via Outages < outages@outages.org> wrote:
It appears quite a few sites that use GCP load balancers are all returning a 404 right now.
Two examples include spotify.com and homedepot.com.
I have checked from many separate locations.
-- Hunter Fuller (they) Router Jockey VBH M-1A +1 256 824 5331
Office of Information Technology The University of Alabama in Huntsville Network Engineering _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Things are recovering now, and Google have posted to their status page about it. https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh -- Hunter Fuller (they) Router Jockey VBH M-1A +1 256 824 5331 Office of Information Technology The University of Alabama in Huntsville Network Engineering On Tue, Nov 16, 2021 at 11:58 AM Hunter Fuller <hf0002+nanog@uah.edu> wrote:
It appears quite a few sites that use GCP load balancers are all returning a 404 right now.
Two examples include spotify.com and homedepot.com.
I have checked from many separate locations.
-- Hunter Fuller (they) Router Jockey VBH M-1A +1 256 824 5331
Office of Information Technology The University of Alabama in Huntsville Network Engineering

Yes Google just confirmed Summary: Global: Experiencing Issue with Cloud networking Description: We are experiencing an issue with Cloud Networking beginning at Tuesday, 2021-11-16 09:53 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2021-11-16 10:40 US/Pacific with current details. Monal Valia ISN (800) 976-1303 Main (469) 914-3406 Direct (972) 897-4270 Mobile ________________________________ From: Outages <outages-bounces@outages.org> on behalf of Hunter Fuller via Outages <outages@outages.org> Sent: Tuesday, November 16, 2021 11:58:38 AM To: outages <outages@outages.org> Subject: [outages] Google Cloud Platform load-balanced Web sites outage. It appears quite a few sites that use GCP load balancers are all returning a 404 right now. Two examples include spotify.com and homedepot.com. I have checked from many separate locations. -- Hunter Fuller (they) Router Jockey VBH M-1A +1 256 824 5331 Office of Information Technology The University of Alabama in Huntsville Network Engineering _______________________________________________ Outages mailing list Outages@outages.org https://urldefense.com/v3/__https://puck.nether.net/mailman/listinfo/outages...

https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh On Tue, Nov 16, 2021, 1:12 PM Hunter Fuller via Outages <outages@outages.org> wrote:
It appears quite a few sites that use GCP load balancers are all returning a 404 right now.
Two examples include spotify.com and homedepot.com.
I have checked from many separate locations.
-- Hunter Fuller (they) Router Jockey VBH M-1A +1 256 824 5331
Office of Information Technology The University of Alabama in Huntsville Network Engineering _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

On Tue, 16 Nov 2021, at 12:58, Hunter Fuller via Outages wrote:
It appears quite a few sites that use GCP load balancers are all returning a 404 right now.
Two examples include spotify.com and homedepot.com.
I have checked from many separate locations.
-- Hunter Fuller (they) Router Jockey VBH M-1A +1 256 824 5331
Office of Information Technology The University of Alabama in Huntsville Network Engineering
Google Cloud status dashboard has a incident for this: https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh latest update: "Summary: Global: Experiencing Issue with Cloud networking Description: We believe the issue with Cloud Networking is partially resolved. Customers will be unable to apply changes to their load balancers until the issue is fully resolved. We do not have an ETA for full resolution at this point. We will provide an update by Tuesday, 2021-11-16 11:28 US/Pacific with current details. Diagnosis: Customers may encounter 404 errors when accessing web pages. Workaround: None at this time." -- Sadiq Saif https://sadiqsaif.com
participants (5)
-
Hunter Fuller
-
Jon Sands
-
Monal Valia
-
Robert Webb
-
Sadiq Saif