June 2017 - Outages - Outages Lists

Level 3 outage in Texas
by Richard Cook 30 Jun '17

30 Jun '17

06/30/2017 19:51:00 GMT - Field Service have arrived at the first testing location and will begin taking initial light level readings to further isolate the suspected fiber damage in cooperation with the Transport NOC. 06/30/2017 19:35:05 GMT - The Transport NOC has responded to a suspected fiber cut in Dallas, TX that is impacting unprotected services, and are working to dispatch Field Services at this time, but an estimated time of arrival is not available. Please be advised that updates for this event will be relayed at a minimum of hourly unless otherwise noted. The information conveyed hereafter is associated to live troubleshooting effort and as the discovery process evolves through to service resolution, ticket closure, or post incident review, details may evolve. -- *Richard Cook* IT Manager | rateGenius, Inc. *p:* 512-302-6358 | *e: rcook(a)rategenius.com <rcook(a)rategenius.com>* <http://www.rategenius.com/> *Mail:* 9300 United Dr. Ste 3-180 Austin, Tx 78758 _________________________________________________________ The information in this email may be confidential and/or privileged. This email may be reviewed only by the intended recipient named above. Any review, use or disclosure of the information contained in this email, or any attachments by anyone other than the intended recipient, is prohibited. If you have received this email in error, please immediately notify the sender and permanently delete this email from your system. *P* *Please consider the environment and only print this email if absolutely necessary.* *P* -- The information in this email may be confidential and/or privileged. This email may be reviewed only by the intended recipient named above. Any review, use or disclosure of the information contained in this email, or any attachments by anyone other than the intended recipient, is prohibited. If you have received this email in error, please immediately notify the sender and permanently delete this email from your system.

1 0

MicroCenter.com
by Mike Phipps 26 Jun '17

26 Jun '17

The www.microcenter.com website is blocking all incoming traffic. The message that is shown suggests that their SonicWALL network appliance blocked the connection due to the country of origin being unknown. This has been verified at downforeveryoneorjustme.com, and it's been doing it for about 10 minutes now. Just FYI. I would imagine that they'll fix this quickly.

5 4

Re: [outages] Verizon wholesale sip incoming down
by jd 20 Jun '17

20 Jun '17

I also have not had any complaints Sent from my BlackBerry - the most secure mobile device From: outages(a)outages.org Sent: June 20, 2017 6:41 PM To: anakaoka(a)trinet-hi.com Reply-to: Eric.Lester(a)acadiahealthcare.com Cc: outages(a)outages.org; Tech(a)trinet-hi.com Subject: Re: [outages] Verizon wholesale sip incoming down I don’t have reports of inbound issues yet but they just may not be testing inbound. From: Aryn Nakaoka 808.356.2901 [mailto:anakaoka@trinet-hi.com] Sent: Tuesday, June 20, 2017 8:33 PM To: Eric Lester <Eric.Lester(a)acadiahealthcare.com> Cc: TN Tech Support <Tech(a)trinet-hi.com>; outages(a)outages.org Subject: Re: [outages] Verizon wholesale sip incoming down This is affecting inbound and Verizon won't reroute. That's a bigger problem. Outbound we already routed off Verizon. On Jun 21, 2017 10:25 AM, "Eric Lester" <Eric.Lester(a)acadiahealthcare.com<mailto:Eric.Lester@acadiahealthcare.com>> wrote: I have 3 sites in California reporting no outbound ld or tfn. All reported in the past couple hours, Verizon ipia circuits. Sent from my Verizon, Samsung Galaxy smartphone -------- Original message -------- From: "Aryn Nakaoka 808.356.2901<tel:(808)%20356-2901> via Outages" <outages(a)outages.org<mailto:outages@outages.org>> Date: 6/20/17 6:39 PM (GMT-06:00) To: outages(a)outages.org<mailto:outages@outages.org>, TN Tech Support <Tech(a)trinet-hi.com<mailto:Tech@trinet-hi.com>> Subject: Re: [outages] Verizon wholesale sip incoming down http://downdetector.com/status/verizon<https://urldefense.proofpoint.com/v2/url?u=http-3A__downdetector.com_status…> On Jun 21, 2017 8:36 AM, "Aryn Nakaoka 808.356.2901<tel:(808)%20356-2901>" <anakaoka(a)trinet-hi.com<mailto:anakaoka@trinet-hi.com>> wrote: All we know is that Verizon has a nose down in Sacramento and it's causing failed incoming calls... Been 2 working days now.

1 0

Verizon wholesale sip incoming down
by Aryn Nakaoka 808.356.2901 20 Jun '17

20 Jun '17

All we know is that Verizon has a nose down in Sacramento and it's causing failed incoming calls... Been 2 working days now.

2 6

Skype down globally
by Jay Ashworth 20 Jun '17

20 Jun '17

Nothing at all, huh? :-) Microsoft acknowledging global outage; no ETR at present. More Later<tm>. - jra -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

3 2

Wilmington Outage
by Robert Otto 19 Jun '17

19 Jun '17

Can confirm that there are issues, our location is completely down and we are unable to ping their gateway. Robert Otto | Sunbelt Rentals, Inc. IT Network Engineer Making It Happen For Our Customers! 2341 Deerfield Drive | Fort Mill, SC 29715   T: 803.578.9441 | Robert.otto(a)sunbeltrentals.com -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of outages-request(a)outages.org Sent: Monday, June 19, 2017 3:20 PM To: outages(a)outages.org Subject: Outages Digest, Vol 109, Issue 33 This message was sent from a sender outside of Sunbelt Rentals. Send Outages mailing list submissions to outages(a)outages.org To subscribe or unsubscribe via the World Wide Web, visit https://puck.nether.net/mailman/listinfo/outages or, via email, send a message with subject or body 'help' to outages-request(a)outages.org You can reach the person managing the list at outages-owner(a)outages.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Outages digest..." Today's Topics: 1. I'm getting end-user outage reports from Wilmington, NC (Steven J. Vaughan-Nichols) 2. Re: Abnormal Google Public DNS Routing (P E) 3. Re: I'm getting end-user outage reports from Wilmington, NC (Paul Nazario) 4. Re: Abnormal Google Public DNS Routing (Paul M - outages) 5. Re: Abnormal Google Public DNS Routing (Karl Katzke) ---------------------------------------------------------------------- Message: 1 Date: Mon, 19 Jun 2017 12:56:25 -0400 From: "Steven J. Vaughan-Nichols" <sjvn(a)vna1.com> To: outages(a)outages.org Subject: [outages] I'm getting end-user outage reports from Wilmington, NC Message-ID: <1497891385.20245.3.camel(a)vna1.com> Content-Type: text/plain; charset="utf-8" They're telling me that they're unable to connect reliability?via Charter Spectrum cable or Verizion Wireless. Anyone seeing anything? Steven -- Steven J. Vaughan-Nichols CBS/ZDNet, Contributing Editor: http://goo.gl/FkYasd ComputerWorld, Columnist: http://goo.gl/c02Km0 QOTD: "I write when I'm inspired, and I see to it that I'm inspired? at nine o'clock every morning."--Peter de Vries -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://puck.nether.net/pipermail/outages/attachments/20170619/69a060aa/att…> ------------------------------ Message: 2 Date: Mon, 19 Jun 2017 11:14:43 -0600 From: P E <list-outages(a)dragon.net> To: "Aryn Nakaoka 808.356.2901" <anakaoka(a)trinet-hi.com>, "Aryn Nakaoka 808.356.2901 via Outages" <outages(a)outages.org> Subject: Re: [outages] Abnormal Google Public DNS Routing Message-ID: <20170619171443.ACFE969FA08(a)fafnir.remote.dragon.net> outages> $150 / month for KYIH basically...?? outages> [[https://www.thousandeyes.com/pricing]] Please keep commercials and marketing off this list. Have also reported this to the list moderators. ------------------------------ Message: 3 Date: Mon, 19 Jun 2017 17:17:07 +0000 From: Paul Nazario <paul.nazario(a)wisc.edu> To: "sjvn(a)vna1.com" <sjvn(a)vna1.com> Cc: "outages(a)outages.org" <outages(a)outages.org> Subject: Re: [outages] I'm getting end-user outage reports from Wilmington, NC Message-ID: <EC7B9853-DCD7-4915-B7D0-2698F7AD1323(a)wisc.edu> Content-Type: text/plain; charset="us-ascii" Looks like problems around Wilmington and other nearby areas. Click the link and zoom into NC. http://downdetector.com/status/spectrum/map/ On Jun 19, 2017, at 11:56 AM, Steven J. Vaughan-Nichols via Outages <outages(a)outages.org<mailto:outages@outages.org>> wrote: They're telling me that they're unable to connect reliability via Charter Spectrum cable or Verizion Wireless. Anyone seeing anything? Steven -- Steven J. Vaughan-Nichols CBS/ZDNet, Contributing Editor: http://goo.gl/FkYasd ComputerWorld, Columnist: http://goo.gl/c02Km0 QOTD: "I write when I'm inspired, and I see to it that I'm inspired at nine o'clock every morning."--Peter de Vries _______________________________________________ Outages mailing list Outages(a)outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://puck.nether.net/pipermail/outages/attachments/20170619/231bf816/att…> ------------------------------ Message: 4 Date: Mon, 19 Jun 2017 18:57:28 +0100 From: Paul M - outages <paul+outages(a)mansfield.co.uk> To: outages(a)outages.org Subject: Re: [outages] Abnormal Google Public DNS Routing Message-ID: <CAGwpYofZ87ThXnHtweBAKJPjMmdrR4ARR+afXeAo3Fco+SNFKA(a)mail.gmail.com> Content-Type: text/plain; charset="UTF-8" It's worth setting your on-site monitoring system to measure and record DNS lookup times to Google's resolvers. I also record the time to do "wget -p www.google.com". This gives me some insight into whether there's upstream problems. ------------------------------ Message: 5 Date: Mon, 19 Jun 2017 19:19:29 +0000 From: Karl Katzke <Karl.Katzke(a)kasasa.com> To: Tanner Ryan <canadatechguy(a)gmail.com>, "outages(a)outages.org" <outages(a)outages.org> Subject: Re: [outages] Abnormal Google Public DNS Routing Message-ID: <44BEA3CF-E8C3-4BEB-B4E1-DA1A6A9CAF23(a)kasasa.com> Content-Type: text/plain; charset="utf-8" Not Google, but Dyn?s DNS services have not been propagating zone updates at all for the past 36+ hours. It?s getting kind of annoying. -K From: Outages <outages-bounces(a)outages.org> on behalf of Tanner Ryan via Outages <outages(a)outages.org> Reply-To: Tanner Ryan <canadatechguy(a)gmail.com> Date: Sunday, June 18, 2017 at 8:46 PM To: "outages(a)outages.org" <outages(a)outages.org> Subject: [outages] Abnormal Google Public DNS Routing Hello, Has anyone experienced any issues with Google Public DNS in the past 5 days or so? My connection to the public resolver usually enters Google at the Toronto Internet Exchange (TORIX), and terminates at Google's caching node in Toronto. For the past few days, the connection is still entering in at TORIX, but is routing much further into Google's network to terminate. Before DNS resolutions were getting resolved in Toronto, but now are getting passed to the Council Bluffs (Iowa) data center. This not only causes DNS resolution times to increase, but I am also noticing some resolution timeouts every once in a while. I also know that there has been a lot of issues with Google Public DNS in Brazil for the past few days. I've seen this abnormal routing start around the same time that the issues in Brazil started. Is anyone else also seeing this abnormal routing or experiencing these issues? ~Tanner ________________________________ This message and any attached files contain confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or without error as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required please request a hard-copy version. -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://puck.nether.net/pipermail/outages/attachments/20170619/6767ee38/att…> ------------------------------ Subject: Digest Footer _______________________________________________ Outages mailing list Outages(a)outages.org https://puck.nether.net/mailman/listinfo/outages ------------------------------ End of Outages Digest, Vol 109, Issue 33 ****************************************

1 0

Abnormal Google Public DNS Routing
by Tanner Ryan 19 Jun '17

19 Jun '17

Hello, Has anyone experienced any issues with Google Public DNS in the past 5 days or so? My connection to the public resolver usually enters Google at the Toronto Internet Exchange (TORIX), and terminates at Google's caching node in Toronto. For the past few days, the connection is still entering in at TORIX, but is routing much further into Google's network to terminate. Before DNS resolutions were getting resolved in Toronto, but now are getting passed to the Council Bluffs (Iowa) data center. This not only causes DNS resolution times to increase, but I am also noticing some resolution timeouts every once in a while. I also know that there has been a lot of issues with Google Public DNS in Brazil for the past few days. I've seen this abnormal routing start around the same time that the issues in Brazil started. Is anyone else also seeing this abnormal routing or experiencing these issues? ~Tanner

6 6

I'm getting end-user outage reports from Wilmington, NC
by Steven J. Vaughan-Nichols 19 Jun '17

19 Jun '17

They're telling me that they're unable to connect reliability via Charter Spectrum cable or Verizion Wireless. Anyone seeing anything? Steven -- Steven J. Vaughan-Nichols CBS/ZDNet, Contributing Editor: http://goo.gl/FkYasd ComputerWorld, Columnist: http://goo.gl/c02Km0 QOTD: "I write when I'm inspired, and I see to it that I'm inspired at nine o'clock every morning."--Peter de Vries

2 1

[MODERATOR] YouTube outage
by Jay Ashworth 16 Jun '17

16 Jun '17

I think everybody's on top of the spread of this outage now. Please move further discussion to the... -discussions list. :-) Cheers, - jra -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

1 0

Re: [outages] youtube down?
by Stephen Richards 16 Jun '17

16 Jun '17

Yes it is down in upstate ny Rochester, we are on XO/verizon Sent from my, Samsung Galaxy smartphone -------- Original message -------- From: Tim Priestnall via Outages <outages(a)outages.org> Date: 6/16/17 9:45 AM (GMT-05:00) To: outages(a)outages.org Subject: Re: [outages] youtube down? This is almost like Slack Day all over again. :| Can’t we just keep an eye on downdetector’s page / heatmap? http://downdetector.com/status/youtube From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Nick Allgood via Outages Sent: Friday, June 16, 2017 2:42 PM To: outages(a)outages.org Subject: Re: [outages] youtube down? It’s down over here in Baltimore, DC, and Northern VA. On Jun 16, 2017, at 9:38 AM, Sam Kirsch via Outages <outages(a)outages.org<mailto:outages@outages.org>> wrote: Came up an went back out in Upstate NY Sam Kirsch Network Administrator TeamWorld, Inc. 498 Conklin Avenue, Binghamton, NY 13903 T (607) 352-1431 | F (607) 770-1153 skirsch(a)teamworld.com<mailto:skirsch@teamworld.com> | www.teamworld.com<http://www.teamworld.com/> From: David Rubin via Outages [mailto:outages@outages.org] Sent: Friday, June 16, 2017 9:34 AM To: outages(a)outages.org<mailto:outages@outages.org> Subject: Re: [outages] youtube down? Up in NYC again. On Fri, Jun 16, 2017 at 9:24 AM, Colangelo, Dom via Outages <outages(a)outages.org<mailto:outages@outages.org>> wrote: Up in Boston now. Dominick Colangelo * Systems Administrator * Technology Services * Wentworth Institute of Technology * 550 Huntington Ave, Boston MA 02115 * 617-989-4523<tel:(617)%20989-4523> * email/im colangelod(a)wit.edu<mailto:colangelod@wit.edu> * wit.edu/dts<http://www.wit.edu/dts> * Follow us on Twitter @ DTSatWIT<http://twitter.com/DTSatWIT> From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Derek J. Nicholls via Outages Sent: Friday, June 16, 2017 9:20 AM To: Outages(a)outages.org<mailto:Outages@outages.org> Subject: Re: [outages] youtube down? Getting same out of MN via TWTelecom/Level3 through Chicago. Derek From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kyle Farmer via Outages Sent: Friday, June 16, 2017 8:06 AM To: Outages(a)outages.org<mailto:Outages@outages.org> Subject: [outages] youtube down? Getting reports that youtube is offline. 500 Internal Server Error Sorry, something went wrong. A team of highly trained monkeys has been dispatched to deal with this situation. If you see them, send them this information as text (screenshots frighten them): APCGX7pT6rHl2pXoLP8sOBfmqxqQgE5m3DnBew6_kj5o9FDPRvUpZSJW Vv6JFXU2Jsdgoe-JTo9CyWVT6fcF9EXa6R1r5cqdh7mcG1WzMd_nUXVv y8fIRxao9_IUSUEwrPZrdjacO9wkg0SbJ2LXPaElUPZcNJgJ5gCvrT2J 23Bt7NnS0aM0QYKR618KB_DGc_4mPSw66zNVMKNUYx-zuC_PoDnIAICC Tt9RWd9yrembPVj1iYefeyOGhzT9Q598Cvjkcdgw66JsSn3jx__DZSTD NVB6AamsAeTHxPnZaJdnmmnSWIVgi-YbDEmHN7V3w0xH9CbORAmQbi5n jQTkmfAqtIMkagKVNim-os86Gs0ltWNQnlMFKSTyEdx_bpML4CkfrNb3 8zVd4TxHFA5Aa9wxOhMbWsTbbEE-PKx_9sLaf3TzPdlU7gVwmDnmG00N MM5mSUj5mGgeA9X8iGdwCf9a9_84w7qfYxoY48wEPhRaM_23kLKUQ3gQ 6BnOMBRoqF_tO9WnfVfQfWHs4mrGMoqv9mdeN7coyTcEBGCZJGH3d2fx f18mCsRp_hnq2xipnBlv101lHbxLaextIzS55Hkp-31MFiX2F7Zn_p3b 5HjKI0LAOfZYX6Rgd38htHBCLalFoFlsZt6zPZzd2Zpqrcd4eRxc6f_3 pob3GjwaEpnB7L8ICWdMwsML0uq6Jby7ZjHDzK0Ep1vVYatz-Hcb7AsY -IzSbNI9M_1kczZ7Spc8I9RNv6mUgVe8vCGGmhqwcs3yn52p_oOAoetA TmB6pfv1CtuSZ4Z4-2zeU3SHLjwFAPVsCh0WyTSq0xATQKOGFnCxl2j6 kyXIW6SGe85a_BccylW9Y9xBfOSPMEFCD_80i1UAvAtByR41vqlha2Yk wPQXfYD4jWhvlm-Rj6dTK7G9CWu_QF6idloCLaUfT--r2HEiB-1M3pUe EoPGaBeQiu-wtBQlKqnQdraI0FdQTalf6FBYrNztSvilTd8zJk5I_Gxe 7oueLQCXpgnfDembxsftDQJrKbS1txRCZaQo0-xYqVZUj_QyDLAiu-rC umpzMv4j7NxQD7IMZ7EDthWhHS7kXzKncykoRGyByi4jIRlOvoX97h1p 9o1u3JEq3hyzhd_3HSlSRVPucLtjIa3rYY-NWl1P42wtQtnZS_DJ6vVu oRJmUccZM8owaKfFAeHUlybHRI1_lHH5gpbfIjARHk0SIQhundM01hY4 2qRk6Kgafh1b2YAfC9dHKr2dlQF0vGU0DZ0rGhBMdrcDt7j78gh8nTkC HBzaFHUG1wVUFl6lDrijQOxf0PmP3Q6VCJ1mit18boCCFYDrorUj2UNl djvrnAhBiUenQEhDlT95i0nVokew_yqRL5jp6Tzj1YFsytlbEGKAnS3l ksBjwo1wph43WIOxKB9Fl5JucbxnJ6DPomrxzMV5_ztdwahJ_0XtArgB iGTo0hhLpROyihzux-VZakwz9H7gGMHsZToGrJXfClScKgHXD9qA1gBD VfNyLLPBb7J-dEWD-CqYxWxeQmv-7nxOPW31BkIY5fy_8kyOHBDz0QfC SUOqOmSvnKu9HQG8PqnLRwlQK2oyKSXhDmd53TD0kZ6QsIdWapz2buWG XukEb84YXTN2XWaMvBYlIeUDsY5QtKUnwM1hxEaHUcra0sZRwI2wDdti Ohlx1lrclkFswWQKFjJGkV0gBtm7o7Q7IOlkrQdzIMu_rwzC5UOqC12t kiqJhhHWCAM7afG6p1Onuq_pU5xdxFZcJuJB1FnT7bfZkjCnehqNURig kmXRbe2BWKWwql7xqacV_-rV3hd4son2QvWVrQwx9x0M_EAplf9-ZYfu ntvQ8wNe12oi Anyone else seeing this on their side? THIS MESSAGE IS ONLY INTENDED FOR THE USE OF THE INTENDED RECIPIENT(S) AND MAY CONTAIN INFORMATION THAT IS PRIVILEGED, PROPRIETARY AND/OR CONFIDENTIAL. If you are not the intended recipient, you are hereby notified that any review, re-transmission, dissemination, distribution, copying, conversion to hard copy or other use of this communication is strictly prohibited. If you are not the intended recipient and have received this message in error, please notify me by return e-mail and delete this message from your system. TempWorks Software, Inc. _______________________________________________ Outages mailing list Outages(a)outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- David Rubin Cubex Group 223 Wall Street - PMB #267 Huntington, NY 11743 646.221.3283 If you have a support-related issue, please email to support(a)cubexgroup.com<mailto:support@cubexgroup.com>. _______________________________________________ Outages mailing list Outages(a)outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

4 4