I'm seeing more than 50% of our connections with charter offline and almost 100% in the eastern half of the US. Have been hold waiting for a rep for over 40 minutes thus far. This is both Fiber and Cable connections. Anyone else seeing this or have any details? I know some of the areas could be storm related but they all dropped at the same time and in areas on both sides of the storm
On Dec 6, 2013 4:30 AM, "Mitch Patterson" <mitpatterson@gmail.com> wrote:
I'm seeing more than 50% of our connections with charter offline and almost 100% in the eastern half of the US. Have been hold waiting for a rep for over 40 minutes thus far. This is both Fiber and Cable connections.
Anyone else seeing this or have any details? I know some of the areas could be storm related but they all dropped at the same time and in areas on both sides of the storm
Yes. Atlanta metro area, no storms or bad weather. Same outage occurred 7 days ago (Black Friday AM). SYNC Timing Synchronization failure - Failed to acquire QAM/QPSK symbol timing;;CM-MAC=xx:xx:xx:xx:xx;CMTS-MAC=00:00:00:00:00 Note the CMTS MAC...imo thats indicative of a plant failure. -Jim P.
Doesn't seem like a plant issue... We are seeing this across the country all at the same time. On Fri, Dec 6, 2013 at 5:12 AM, Jim Popovitch <jimpop@gmail.com> wrote:
On Dec 6, 2013 4:30 AM, "Mitch Patterson" <mitpatterson@gmail.com> wrote:
I'm seeing more than 50% of our connections with charter offline and almost 100% in the eastern half of the US. Have been hold waiting for a rep for over 40 minutes thus far. This is both Fiber and Cable connections.
Anyone else seeing this or have any details? I know some of the areas could be storm related but they all dropped at the same time and in areas on both sides of the storm
Yes. Atlanta metro area, no storms or bad weather. Same outage occurred 7 days ago (Black Friday AM).
SYNC Timing Synchronization failure - Failed to acquire QAM/QPSK symbol timing;;CM-MAC=xx:xx:xx:xx:xx;CMTS-MAC=00:00:00:00:00
Note the CMTS MAC...imo thats indicative of a plant failure.
-Jim P.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
On Dec 6, 2013 5:19 AM, "Mitch Patterson" <mitpatterson@gmail.com> wrote:
Doesn't seem like a plant issue... We are seeing this across the country
all at the same time. No doubt. I just expect to see a CMTS MAC if there is signal in the plant. Could be a multi-regional CMTS patch fu*kup. -Jim P.
I believe my employer uses Charter fiber in Medford Oregon and seems OK currently. Sent from my iPhone 5S.
On Dec 6, 2013, at 2:26 AM, Jim Popovitch <jimpop@gmail.com> wrote:
On Dec 6, 2013 5:19 AM, "Mitch Patterson" <mitpatterson@gmail.com> wrote:
Doesn't seem like a plant issue... We are seeing this across the country all at the same time.
No doubt. I just expect to see a CMTS MAC if there is signal in the plant. Could be a multi-regional CMTS patch fu*kup.
-Jim P.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
On Fri, Dec 6, 2013 at 5:50 AM, aUser <auser@mind.net> wrote:
I believe my employer uses Charter fiber in Medford Oregon and seems OK currently.
Charter is coming back up in the Atlanta area. 7:15am here, probably just took someone waking up and kicking something. :-) -Jim P.
Yep, seeing most coming up On Dec 6, 2013 7:27 AM, "Jim Popovitch" <jimpop@gmail.com> wrote:
On Fri, Dec 6, 2013 at 5:50 AM, aUser <auser@mind.net> wrote:
I believe my employer uses Charter fiber in Medford Oregon and seems OK currently.
Charter is coming back up in the Atlanta area. 7:15am here, probably just took someone waking up and kicking something. :-)
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
We went down hard for a while on our Charter connections (St. Louis area). Some things are coming back but I believe there are still a lot of issues. -Ross On Fri, Dec 6, 2013 at 6:28 AM, Mitch Patterson <mitpatterson@gmail.com>wrote:
Yep, seeing most coming up On Dec 6, 2013 7:27 AM, "Jim Popovitch" <jimpop@gmail.com> wrote:
On Fri, Dec 6, 2013 at 5:50 AM, aUser <auser@mind.net> wrote:
I believe my employer uses Charter fiber in Medford Oregon and seems OK currently.
Charter is coming back up in the Atlanta area. 7:15am here, probably just took someone waking up and kicking something. :-)
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
We lost our charter bgp sessions in Verona WI at 7:14 am. Sent from my phone; disregard quality of message. -----Original Message----- From: Ross Hosman [ross@ruse.is] Received: Friday, 06 Dec 2013, 7:16 To: Mitch Patterson [mitpatterson@gmail.com] CC: Outages@outages.org [Outages@outages.org] Subject: Re: [outages] Charter Outage?? We went down hard for a while on our Charter connections (St. Louis area). Some things are coming back but I believe there are still a lot of issues. -Ross On Fri, Dec 6, 2013 at 6:28 AM, Mitch Patterson <mitpatterson@gmail.com<mailto:mitpatterson@gmail.com>> wrote: Yep, seeing most coming up On Dec 6, 2013 7:27 AM, "Jim Popovitch" <jimpop@gmail.com<mailto:jimpop@gmail.com>> wrote: On Fri, Dec 6, 2013 at 5:50 AM, aUser <auser@mind.net<mailto:auser@mind.net>> wrote:
I believe my employer uses Charter fiber in Medford Oregon and seems OK currently.
Charter is coming back up in the Atlanta area. 7:15am here, probably just took someone waking up and kicking something. :-) -Jim P. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
We're in Verona WI and we received a boatload of helpdesk tickets from our tech services staff members about connectivity problems getting to our customer sites, but zero tickets about any voice problems (Charter is our first-choice outgoing for long distance, which we do a ton of). I'm thinking that we would've seen tickets about voice problems too if there were any. As soon as we shutdown our Charter BGP sessions, connectivity to our customer sites was restored. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ross Hosman Sent: Friday, December 06, 2013 7:13 AM To: Mitch Patterson Cc: Outages@outages.org Subject: Re: [outages] Charter Outage?? We went down hard for a while on our Charter connections (St. Louis area). Some things are coming back but I believe there are still a lot of issues. -Ross On Fri, Dec 6, 2013 at 6:28 AM, Mitch Patterson <mitpatterson@gmail.com<mailto:mitpatterson@gmail.com>> wrote: Yep, seeing most coming up On Dec 6, 2013 7:27 AM, "Jim Popovitch" <jimpop@gmail.com<mailto:jimpop@gmail.com>> wrote: On Fri, Dec 6, 2013 at 5:50 AM, aUser <auser@mind.net<mailto:auser@mind.net>> wrote:
I believe my employer uses Charter fiber in Medford Oregon and seems OK currently.
Charter is coming back up in the Atlanta area. 7:15am here, probably just took someone waking up and kicking something. :-) -Jim P. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
In Appleton, WI we saw voice outages but our point to point ethernets stayed stable. None of our p2p's extend out of the NE Wisconsin area, however. On Fri, 6 Dec 2013, Jeremy Charles wrote:
Date: Fri, 6 Dec 2013 14:31:24 +0000 From: Jeremy Charles <JCharles@epic.com> To: Ross Hosman <ross@ruse.is>, Mitch Patterson <mitpatterson@gmail.com> Cc: "Outages@outages.org" <Outages@outages.org> Subject: Re: [outages] Charter Outage??
We?re in Verona WI and we received a boatload of helpdesk tickets from our tech services staff members about connectivity problems getting to our customer sites, but zero tickets about any voice problems (Charter is our first-choice outgoing for long distance, which we do a ton of). I?m thinking that we would?ve seen tickets about voice problems too if there were any.
As soon as we shutdown our Charter BGP sessions, connectivity to our customer sites was restored.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ross Hosman Sent: Friday, December 06, 2013 7:13 AM To: Mitch Patterson Cc: Outages@outages.org Subject: Re: [outages] Charter Outage??
We went down hard for a while on our Charter connections (St. Louis area). Some things are coming back but I believe there are still a lot of issues.
-Ross
On Fri, Dec 6, 2013 at 6:28 AM, Mitch Patterson <mitpatterson@gmail.com> wrote:
Yep, seeing most coming up
On Dec 6, 2013 7:27 AM, "Jim Popovitch" <jimpop@gmail.com> wrote:
On Fri, Dec 6, 2013 at 5:50 AM, aUser <auser@mind.net> wrote:
I believe my employer uses Charter fiber in Medford Oregon and seems OK currently.
Charter is coming back up in the Atlanta area. 7:15am here, probably just took someone waking up and kicking something. :-)
-Jim P. _______________________________________________ Outages mailing
Not sure if this helps or hinders the issue(s) presented: One of our Charter connections (DOCSIS) never lost IP transit between Cleveland, TN and Atlanta, Ga. Circuit (VC) Originates on Charter IP Transit/Transport and arrives via IP-Transit (non-private-peering) in Atlanta. Happy to provide more information, if it's of use to someone while investigating what appears to be a national outage/issue. On Fri, Dec 6, 2013 at 9:43 AM, Paul Thompson < outages@majordomo.thedacare.org> wrote:
In Appleton, WI we saw voice outages but our point to point ethernets stayed stable. None of our p2p's extend out of the NE Wisconsin area, however.
On Fri, 6 Dec 2013, Jeremy Charles wrote:
Date: Fri, 6 Dec 2013 14:31:24 +0000 From: Jeremy Charles <
JCharles@epic.com> To: Ross Hosman <ross@ruse.is>, Mitch Patterson < mitpatterson@gmail.com> Cc: "Outages@outages.org" <Outages@outages.org> Subject: Re: [outages] Charter Outage??
We?re in Verona WI and we received a boatload of helpdesk tickets from our tech services staff members about connectivity problems getting to our customer sites, but zero tickets about any voice problems (Charter is our first-choice outgoing for long distance, which we do a ton of). I?m thinking that we would?ve seen tickets about voice problems too if there were any.
As soon as we shutdown our Charter BGP sessions, connectivity to our customer sites was restored.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ross Hosman Sent: Friday, December 06, 2013 7:13 AM To: Mitch Patterson Cc: Outages@outages.org Subject: Re: [outages] Charter Outage??
We went down hard for a while on our Charter connections (St. Louis area). Some things are coming back but I believe there are still a lot of issues.
-Ross
On Fri, Dec 6, 2013 at 6:28 AM, Mitch Patterson <mitpatterson@gmail.com> wrote:
Yep, seeing most coming up
On Dec 6, 2013 7:27 AM, "Jim Popovitch" <jimpop@gmail.com> wrote:
On Fri, Dec 6, 2013 at 5:50 AM, aUser <auser@mind.net> wrote:
I believe my employer uses Charter fiber in Medford Oregon and seems > OK currently.
Charter is coming back up in the Atlanta area. 7:15am here, probably just took someone waking up and kicking something. :-)
-Jim P. _______________________________________________ Outages mailing
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (7)
-
aUser -
Jeremy Charles -
Jim Popovitch -
Kraig Beahn -
Mitch Patterson -
Paul Thompson -
Ross Hosman