October 2022 - Outages - Outages Lists

Apparently Equifax is down for consumers and businesses.
by Chapman, Brad (NBCUniversal) 13 Jul '26

13 Jul '26

I was ordering fiber optic internet from Frontier Communications—my doctor said I should consume more fiber—but their system said my credit check failed and was demanding an equipment deposit. I pushed back. They ran it three times. Then they got word in a group chat that Equifax’s consumer and business portals are down, so they can’t process any credit checks. Woe be unto you if you work in finance or support a business that depends on this service. I hope they didn’t have another breach. Maybe they will need a tiny excavator to dig them out of this mess like that freighter stuck in the Suez canal<https://www.reddit.com/r/CatastrophicFailure/comments/mcw8og/new_pictures_f…> for the last two days... Cheers, Brad

8 7

VZ Contact
by Dovid Bender 31 Oct '22

31 Oct '22

Hi, Anyone have a contact at VZ? It seems that any IP in the NYC area that is behind ae203-0.NYCMNY-VFTTP-387.verizon-gni.net is having about 50% packet loss. I did traces from around the world including VZ Europe (AS702) and we see it everywhere. TIA. Dovid

2 2

Microsoft Hotmail Email Delivery Failures via IPv6
by Peter Beckman 27 Oct '22

27 Oct '22

We have been using IPv6 for years, but hotmail has been IPv4. Checking our email logs, we have been successfully delivering email via IPv4 to Hotmail without issue since May 29, 2022 (as far back as our email logs go at the moment). At Oct 24 21:06:13 UTC, the MX record started returning IPv6 addresses: hotmail.com. 3256 IN MX 2 hotmail-com.olc.protection.outlook.com. hotmail-com.olc.protection.outlook.com has address 104.47.1.33 hotmail-com.olc.protection.outlook.com has address 104.47.2.33 hotmail-com.olc.protection.outlook.com has IPv6 address 2a01:111:f400:7e8a::33 hotmail-com.olc.protection.outlook.com has IPv6 address 2a01:111:f400:7e89::33 So that's cool. Except that 54 minutes later, Hotmail blocked ALL of our email traffic. Deferred: 451 4.7.500 Server busy. Please try again later from [2a01:111:e400:7e0d::51]. (AS750) [HE1EUR04FT020.eop-eur04.prod.protection.outlook.com] Pretty sure that the 9 (nine) emails we went via IPv6 at 5pm EDT did not all get reported as SPAM. To aggravate the situation further, Hotmail's Sender Tools are all still IPv4-only. I cannot check or add or monitor an IPv6 address or range, and their Support Tool also only allows IPv4 addresses. I'm not an enterprise customer of Microsoft, but this is pretty crappy. I'm now looking for ways to connect to Microsoft via IPv4 only while still using IPv6 for other email systems. Anyone else run into issues like this? Beckman --------------------------------------------------------------------------- Peter Beckman Internet Guy beckman(a)angryox.com https://www.angryox.com/ ---------------------------------------------------------------------------

2 2

Re: [outages] Azure: Storage account outage in us-east
by Steve McClendon 27 Oct '22

27 Oct '22

Is it really necessary to have a 25 line email signature with every method of contact possible, for a one line response to a mailing list. Best sjm ------------------------------ *From:* Outages <outages-bounces(a)outages.org> on behalf of Michael B. Williams via Outages <outages(a)outages.org> *Sent:* Thursday, October 27, 2022 3:31 PM *To:* Dj Padzensky *Cc:* outages(a)outages.org *Subject:* Re: [outages] Azure: Storage account outage in us-east Thank you for this! ------------------------------ *Michael B. Williams * Glexia - An IT Company Book a Meeting With Me <https://calendly.com/glexia-michael-williams> USA Direct: +1 978 477 6797 <http://voice.google.com/calls?a=nc,%2B19784776797> USA Toll Free: +1 800 675 0297 <http://voice.google.com/calls?a=nc,%2B18006750297>x101 AUS Direct: +61 3 8594 2265 AUS Toll Free: +61 1800 931 724 <http://voice.google.com/calls?a=nc,%2B611800931724>x101 Fax: +1.815-301-5570 Michael.Williams(a)glexia.com Michael.Williams(a)secure.glexia.com (High-Security Correspondence) https://www.glexia.com/ Legal Notice: The information in this electronic mail message is the sender's confidential business and may be legally privileged. It is intended solely for the addressee(s). Access to this internet electronic mail message by anyone else is unauthorized. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it is prohibited and may be unlawful. On Wed, Oct 26, 2022 at 4:37 PM Dj Padzensky via Outages < outages(a)outages.org> wrote: > > Here’s the latest from Microsoft: > > The product team has determined that underlying storage resources within a > scale unit in the region experienced an issue and became unavailable. As > the resources began to recover, an increase in traffic was directed to > these resources (from retries and concurrent ongoing requests) and has > resulted in additional storage request latency. This could impact > additional resources that rely on storage resources in this region. > > Currently, we are investigating steps to fully recover the resources in > the scale unit to help mitigate impact. Additionally, we are investigating > additional balancing of traffic by shifting resources to other scale units, > and are continuing to monitor service health and have observed > improvements. The next update will be provided in 60 minutes or as events > warrant. > > > —Dj > > > On Oct 26, 2022, at 11:36 AM, Dj Padzensky via Outages < > outages(a)outages.org> wrote: > > > Just got off the phone with Microsoft. They’re seeing widespread outages > on storage accounts in us-east. The incident started at 0400Z. As of > right now, they’re still investigating. No ETR. > > —Dj_______________________________________________ > Outages mailing list > Outages(a)outages.org > https://puck.nether.net/mailman/listinfo/outages > > > _______________________________________________ > Outages mailing list > Outages(a)outages.org > https://puck.nether.net/mailman/listinfo/outages >

1 0

Azure: Storage account outage in us-east
by Dj Padzensky 27 Oct '22

27 Oct '22

Just got off the phone with Microsoft. They’re seeing widespread outages on storage accounts in us-east. The incident started at 0400Z. As of right now, they’re still investigating. No ETR. —Dj

2 2

WhatsApp down globally ish
by George Herbert 25 Oct '22

25 Oct '22

Apparently the WhatsApp app connections are down everywhere, though it’s not as easy to track as website outages. Downdetector has it. Meta scrambling response and PR. -george Sent from my iPhone

3 2

paypal.com certificate revoked?
by Chuck Anderson 14 Oct '22

14 Oct '22

Firefox says: Secure Connection Failed An error occurred during a connection to paypal.com. Peer’s Certificate has been revoked. Error code: SEC_ERROR_REVOKED_CERTIFICATE OCSP checker says: https://www.certificatetools.com/ocsp-checker Domain Name(s) paypal.com, paypal-workplace.com, xoom-experience.com, buyindiaonline.com, paypal-experience.com, xoom.com, venmo-experience.com, sandbox.paypal.com, paypal.me, cash2india.com OCSP URI http://ocsp.digicert.com Next Update Oct 21 18:12:02 2022 GMT This Update Oct 14 18:57:02 2022 GMT Cert Status revoked Produced At Oct 14 19:13:05 2022 GMT Response Type Basic OCSP Response OCSP Response Status successful (0x0) OpenSSL Command openssl ocsp -sha1 -issuer ca.crt -cert cert.crt -header host=ocsp.digicert.com -url http://ocsp.digicert.com -text -CAfile ca.crt -no_nonce

4 4

New Relic, Sales Force, poss. Us-west AWS?
by DL 07 Oct '22

07 Oct '22

I'm seeing complaints of New Relic problems (https://status.newrelic.com/) salesforce issues (https://status.salesforce.com/) and a friend has some software down in US-West AWS but they aren't reporting anything yet. Outages list has been quiet - so I figured I'd see if others are seeing anything particularly odd today?

3 2

ups.com from Washington / Oregon?
by Aaron de Bruyn 03 Oct '22

03 Oct '22

Anyone else having trouble accessing ups.com <http://ups.com> from Washington / Oregon states? I tested from 30 locations (mostly Comcast and Charter, but a few small local ISPs) throughout Washington and Oregon. -A

10 9