November 2016 - Outages - Outages Lists

Comcast residential in south SF Bay Area
by Grant Ridder 30 Nov '16

30 Nov '16

Comcast appears to be experiencing an outage in the south SF Bay Area. Not sure how wide spread it is but confirmed on the automated customer service line Grant Sent from my iPhone

4 4

VoIP Innovations Down due to Level3 Outage?
by Sam Kirsch 28 Nov '16

28 Nov '16

We received word that our connections to VoIP Innovations are down due to a Level3 outage. I'm wondering if folks are seeing evidence of that elsewhere? -- Samuel Kirsch, Network Support Plexicomm - Internet Solutions | www.plexicomm.net Office: 1.866.759.4678 x109 | Fax: 1.866.852.4688 Emergency Support: 1.866.759.9713 | samuel(a)plexicomm.net

4 3

Cogent Outage in Philadelphia
by Eric Tykwinski 25 Nov '16

25 Nov '16

Just forwarding to the list if anyone is experiencing issues. http://status.cogentco.com/ <http://status.cogentco.com/> Welcome to the Cogent Communications status page. Customers in Philadelphia may be experiencing a loss of service at this time, Noc is investigating no ETA. Welcome to the Cogent Communications status page. Due to a bldg fire at 1735 Market St in the Philadelphia, Cogent Communications provided service have been affected. No ETR at this present time. The master case is HD6722977. Sincerely, Eric Tykwinski TrueNet, Inc. P: 610-429-8300

3 2

Tokyo Undersea Cable Fault
by frnkblk＠iname.com 23 Nov '16

23 Nov '16

FYI: https://status.linode.com/incidents/8hr00gyqtnjk "Users in China may experience increased congestion and latency for our Tokyo 1 and 2 data centers as there is a fault in the undersea cable that is the shortest route between Hong Kong, China, and Japan. The operators of the cable line are already working on repairs. Nov 23, 2016 - 15:48 UTC"

1 0

NYC level3 fiber cut 2016-11-21, at 75 Broad
by Eric Kuhnke 23 Nov '16

23 Nov '16

This may be having follow on effects still as traffic has been re-routed. RFO from Level3: Level-3 Mgmt Update: The Level 3 contractor was performing demolition work in the basement of 75 Broad related to abandoned equipment due to Hurricane Sandy. The equipment was not carrying live traffic. The contractor cut all fiber cables in the space even though it was expressly indicated they were not to be cut. Conduits feeding the 3rd and 5th floors were cut as well as the conduit through the foundation of the building to the street manhole. The restoration plan includes the installation of two new entrance cables from the street manhole to the inside of the building. One will feed the 3rd floor and one will feed the 5th floor. Level 3 is working to obtain street closure permits. New York City is currently in a street closure moratorium and the permits are not guaranteed. Level 3 has indicated they will start the manhole work at 8PM Eastern even if the permits have not been granted. Multiple splice crews will be present both inside and outside the building to expedite the repair. A firm MTR will be established once the replacement cables are in place.

1 0

NTT to Level3 routing issue in NYC?
by Ca By 23 Nov '16

23 Nov '16

http://www.us.ntt.net/support/looking-glass/ *Query Results:* *Router: *New York, NY - US *Command:* ping 4.2.2.2 Sending 5, 100-byte ICMP Echos to 4.2.2.2, timeout is 2 seconds: ..... Success rate is 0 percent (0/5) But it seems to work fine from Ashburn *Query Results:* *Router: *Ashburn, VA - US *Command:* ping 4.2.2.2 Sending 5, 100-byte ICMP Echos to 4.2.2.2, timeout is 2 seconds: !!!!! Success rate is 100 percent (5/5), round-trip min/avg/max = 1/1/1 ms

7 13

Level 3 outages texas
by Anthony Armstrong 22 Nov '16

22 Nov '16

Appears to be level3 related issue through Texas Anyone else confirm? Best Regards, Anthony Armstrong Sent via mobile

2 1

Level 3 fiber cut ATL.
by Luke Guillory 22 Nov '16

22 Nov '16

After 24 hours of being down we finally got the following. Anyone else having issues, this is between Atlanta and College Park, GA it seems. *** CASCADED EXTERNAL NOTES 22-Nov-2016 14:30:06 GMT From CASE: 11829710 - Event Earlier, Field Services investigated and located the fiber cut, caused by a local gas company performing work in the area. A 432-count fiber cable was damaged by the work. The cable is marked as belonging to the last mile provider. The last mile provider dispatched their field technician, who is now onsite evaluating the damage. Luke Guillory Network Operations Manager [cid:image0b2fc0.JPG@25fdd7be.4b93a06d] <http://www.rtconline.com> Tel: 985.536.1212 Fax: 985.536.0300 Email: lguillory(a)reservetele.com Web: www.rtconline.com Reserve Telecommunications 100 RTC Dr Reserve, LA 70084 Disclaimer: The information transmitted, including attachments, is intended only for the person(s) or entity to which it is addressed and may contain confidential and/or privileged material which should not disseminate, distribute or be copied. Please notify Luke Guillory immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. Luke Guillory therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission.

3 3

Re: [outages] Outages Digest, Vol 102, Issue 37
by Ekblade, Amy 17 Nov '16

17 Nov '16

Comcast is down in Connecticut as well. It started around 7am EST -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of outages-request(a)outages.org Sent: Thursday, November 17, 2016 10:49 AM To: outages(a)outages.org Subject: Outages Digest, Vol 102, Issue 37 Send Outages mailing list submissions to outages(a)outages.org To subscribe or unsubscribe via the World Wide Web, visit https://puck.nether.net/mailman/listinfo/outages or, via email, send a message with subject or body 'help' to outages-request(a)outages.org You can reach the person managing the list at outages-owner(a)outages.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Outages digest..." Today's Topics: 1. Comcast Outages (Matthew Carse) 2. Re: Comcast Outages (Andrey Khomyakov) 3. Re: Comcast Outages (John Neiberger) 4. Re: Comcast Outages (Matthew Carse) 5. Re: Comcast Outages (Jeremy Chadwick) 6. Incapsula hosted sites (Steven Surdock) ---------------------------------------------------------------------- Message: 1 Date: Wed, 16 Nov 2016 09:42:45 -0800 From: Matthew Carse <mcarse(a)gmail.com> To: outages(a)outages.org Subject: [outages] Comcast Outages Message-ID: <CAPLuo_spw29zQ92Fkudoc6Cz5arU-BTL5cEu8-jM12QBtS5OXA(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" Anyone else seeing Comcast down in California? We are seeing all our Comcast connections offline. Matt

1 0

Incapsula hosted sites
by Steven Surdock 17 Nov '16

17 Nov '16

Greetings, anyone else experiencing issues with Incapsula hosted sites routing through Chicago? Our customers have reported issues with the following site: www.dotloop.com www.menards.com www.foremoststar.com It appears we have an asymmetric routing issue that is confusing Incapsula. Disabling all sessions with Incapula, including MLPE seems to have allowed us to work around the issue. Incapsula support has not been very supportive. Steven Surdock CTS Telecom ssurdock[at]ctstelecom.com

3 2