Comcast outages in Denver metro area

Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure. Thanks. Chris

There does appear to be some sort of Comcast outage. I have a remote system out there that also went down in the last hour. Dave On Tue, Oct 11, 2016 at 3:26 AM Chris Stone via Outages <outages@outages.org> wrote:
Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure.
Thanks.
Chris
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Thanks - I did see one client come back up, but then immediately went back down again. Chris On 10/11/2016 01:31 AM, Dave Pascoe wrote:
There does appear to be some sort of Comcast outage. I have a remote system out there that also went down in the last hour.
Dave
On Tue, Oct 11, 2016 at 3:26 AM Chris Stone via Outages <outages@outages.org <mailto:outages@outages.org>> wrote:
Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure.
Thanks.
Chris
_______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

There is a Backbone device that is/was mis-behaving in Denver that is causing some traffic issues. We're in the process of getting corrected..... -Steve On Tue, Oct 11, 2016 at 3:31 AM, Dave Pascoe via Outages < outages@outages.org> wrote:
There does appear to be some sort of Comcast outage. I have a remote system out there that also went down in the last hour.
Dave
On Tue, Oct 11, 2016 at 3:26 AM Chris Stone via Outages < outages@outages.org> wrote:
Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure.
Thanks.
Chris
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- -Steve

We saw IPv6-related timeouts (ICMPv6 and HTTPv6) to postmaster.comcast.net (multiple hosts), xfinity.comast.net, www.comcast.net <http://www.comcast.net> , mydeviceinfo.comcast.net, www.comcast6.net <http://www.comcast6.net> between ~2:35 and to 5:49 am (U.S. Central). Frank From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Steve Meuse via Outages Sent: Tuesday, October 11, 2016 7:49 AM To: Dave Pascoe <davekm3t@gmail.com> Cc: outages@outages.org Subject: Re: [outages] Comcast outages in Denver metro area There is a Backbone device that is/was mis-behaving in Denver that is causing some traffic issues. We're in the process of getting corrected..... -Steve On Tue, Oct 11, 2016 at 3:31 AM, Dave Pascoe via Outages <outages@outages.org <mailto:outages@outages.org> > wrote: There does appear to be some sort of Comcast outage. I have a remote system out there that also went down in the last hour. Dave On Tue, Oct 11, 2016 at 3:26 AM Chris Stone via Outages <outages@outages.org <mailto:outages@outages.org> > wrote: Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure. Thanks. Chris _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- -Steve

We are seeing Comcast IP cable modem reachability issues across the entire US right now from AT&T. Traffic appears to be dying between Level3 and Comcast from our AT&T based sensors. Regards, James -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Chris Stone via Outages Sent: Tuesday, October 11, 2016 0:26 To: outages@outages.org Subject: [outages] Comcast outages in Denver metro area Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure. Thanks. Chris

FWIW...seems like Comcast traffic going west from Comcast in the New England area is dying at 350 E Cermak in Chicago. This is also affecting ISPs that get transit from Comcast out here, at least for Comcast destinations west of Chicago. Can't tell if it is limited to only certain Comcast markets out west...but it is definitely affecting Comcast transit in the Bay Area AFAICT. On Tue, Oct 11, 2016 at 4:13 AM, James Laszko via Outages < outages@outages.org> wrote:
We are seeing Comcast IP cable modem reachability issues across the entire US right now from AT&T. Traffic appears to be dying between Level3 and Comcast from our AT&T based sensors.
Regards,
James
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Chris Stone via Outages Sent: Tuesday, October 11, 2016 0:26 To: outages@outages.org Subject: [outages] Comcast outages in Denver metro area
Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure.
Thanks.
Chris
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

I'm seeing Comcast cable modem issues from my house here in Denver. Details from my account portal indicate an ETR of 7AM Denver time Sent from my iPhone On Oct 11, 2016, at 3:01 AM, Dave Pascoe via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: FWIW...seems like Comcast traffic going west from Comcast in the New England area is dying at 350 E Cermak in Chicago. This is also affecting ISPs that get transit from Comcast out here, at least for Comcast destinations west of Chicago. Can't tell if it is limited to only certain Comcast markets out west...but it is definitely affecting Comcast transit in the Bay Area AFAICT. On Tue, Oct 11, 2016 at 4:13 AM, James Laszko via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We are seeing Comcast IP cable modem reachability issues across the entire US right now from AT&T. Traffic appears to be dying between Level3 and Comcast from our AT&T based sensors. Regards, James -----Original Message----- From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Chris Stone via Outages Sent: Tuesday, October 11, 2016 0:26 To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Comcast outages in Denver metro area Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure. Thanks. Chris _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more visit the Mimecast website.

Issue in question was extremely widespread -- a large portion of the US east coast (from Maine to Florida), as well as Colorado, Washington, Texas, and California; I can confirm the latter. Issue lasted from 00:56 to 04:08 PDT (UTC-0700), according to my periodic mtrs between Mountain View (Silicon Valley) and Seattle. Sadly, my return-path traceroutes (SEA->MV) weren't working during the outage due to a configuration mistake on my part, so I don't have a full picture of what happened. For general end-user complaints, the #comcastoutage hashtag on Twitter has quite a lot. There is strong speculation this was Level 3 botching something -- which, if true, makes 2 major outages in 7 days. -- | Jeremy Chadwick jdc@koitsu.org | | UNIX Systems Administrator http://jdc.koitsu.org/ | | Making life hard for others since 1977. PGP 4BD6C0CB | On Tue, Oct 11, 2016 at 01:25:55AM -0600, Chris Stone via Outages wrote:
Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure.
Thanks.
Chris
begin:vcard fn:Chris Stone n:Stone;Chris org:AxisInternet, Inc. adr:Suite 1110;;910 16th St.;Denver;Colorado;80202;USA email;internet:cstone@axint.net title:VP/CTO tel;work:303.592.2947 x302 tel;fax:303.893.2947 tel;home:303.838.2386 tel;cell:303.570.6947 x-mozilla-html:FALSE url:www.axint.net version:2.1 end:vcard
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

We have noticed an issue with a single Comcast connection in Michigan (in the SW corner of Michigan) that has been intermittently up/down since Friday. Same story as the rest (goes through Level 3 around Chicago with issues before coming into Michigan). -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jeremy Chadwick via Outages Sent: Tuesday, October 11, 2016 7:34 To: outages@outages.org Subject: Re: [outages] Comcast outages in Denver metro area Issue in question was extremely widespread -- a large portion of the US east coast (from Maine to Florida), as well as Colorado, Washington, Texas, and California; I can confirm the latter. Issue lasted from 00:56 to 04:08 PDT (UTC-0700), according to my periodic mtrs between Mountain View (Silicon Valley) and Seattle. Sadly, my return-path traceroutes (SEA->MV) weren't working during the outage due to a configuration mistake on my part, so I don't have a full picture of what happened. For general end-user complaints, the #comcastoutage hashtag on Twitter has quite a lot. There is strong speculation this was Level 3 botching something -- which, if true, makes 2 major outages in 7 days. -- | Jeremy Chadwick jdc@koitsu.org | | UNIX Systems Administrator http://jdc.koitsu.org/ | | Making life hard for others since 1977. PGP 4BD6C0CB | On Tue, Oct 11, 2016 at 01:25:55AM -0600, Chris Stone via Outages wrote:
Anyone aware of any Comcast outages in the Denver area? Have a number of VoIP clients that are on Comcast circuits around the Denver metro area that are all down right now. I monitor their gateways in Nagios too and they are all 100% down at present. Trying to access them via Cogent and Level3 with the same results - 100% failure.
Thanks.
Chris
begin:vcard fn:Chris Stone n:Stone;Chris org:AxisInternet, Inc. adr:Suite 1110;;910 16th St.;Denver;Colorado;80202;USA email;internet:cstone@axint.net title:VP/CTO tel;work:303.592.2947 x302 tel;fax:303.893.2947 tel;home:303.838.2386 tel;cell:303.570.6947 x-mozilla-html:FALSE url:www.axint.net version:2.1 end:vcard
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages Disclaimer: This email and its attachments may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Kent Record Management Inc. If you are not the intended recipient of this email and its attachments, you must take no action based upon them, nor must you copy or show them to anyone. Please contact the sender if you believe you have received this email in error.
participants (8)
-
B.J. Ash
-
Chris Stone
-
Dave Pascoe
-
frnkblk@iname.com
-
James Laszko
-
Jeremy Chadwick
-
Randall (Randy) Raitz
-
Steve Meuse