All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
Confirmed, we're seeing issues at multiple sites in northern NJ and NYC. Outbound seems to work most of the time, incoming standard DIDs and 8xx service seems impacted. On Tue, Oct 4, 2016 at 10:27 AM, Kevin Miller via Outages < outages@outages.org> wrote:
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Same in Vermont. Seeing outage on both VoIP delivered over PRI and traditional PRI (formally off local Telcove/ABS 5ESS Switch) Good thing we have FairPoint as backup’s -- Michael T. Voity Network Engineer University of Vermont From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jayson Navitsky via Outages Sent: Tuesday, October 04, 2016 10:30 To: Kevin Miller <kmiller@vantage.com> Cc: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Confirmed, we're seeing issues at multiple sites in northern NJ and NYC. Outbound seems to work most of the time, incoming standard DIDs and 8xx service seems impacted. On Tue, Oct 4, 2016 at 10:27 AM, Kevin Miller via Outages <outages@outages.org <mailto:outages@outages.org> > wrote: All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well. Nicholas Sideras Director of Technical Operations Holland Bulb Farms From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues? All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
Seeing them in Houston On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else. On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages <outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
We are seeing outbound issues on both LD and local call types. Denver area Level3 pris Sent from my iPhone On Oct 4, 2016, at 8:37 AM, Kevin Kastelic via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else. On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Seeing them in Houston On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more visit the Mimecast website.
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Kastelic via Outages Sent: Tuesday, October 04, 2016 9:37 AM To: Will Wylie Cc: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else. On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Seeing them in Houston On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
Seeing inbound issues also in Columbia, KY. Sent from my Verizon, Samsung Galaxy smartphone -------- Original message -------- From: Nicholas Sideras via Outages <outages@outages.org> Date: 10/4/16 10:44 AM (GMT-05:00) To: Kevin Kastelic <kevink@sharppackaging.com> Cc: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Kastelic via Outages Sent: Tuesday, October 04, 2016 9:37 AM To: Will Wylie Cc: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else. On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Seeing them in Houston On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We have the same thing here in Brookfield, WI "MKE"
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
seeing issues all over NY, NJ Toll Free. Shripal Daphtary | Managing Director shripal.daphtary@pressone.net D: 718.360.1222 C: 973.432.1440 F: 718.360.1222 On Tue, Oct 4, 2016 at 10:46 AM, Rob Hall via Outages <outages@outages.org> wrote:
Seeing inbound issues also in Columbia, KY.
Sent from my Verizon, Samsung Galaxy smartphone
-------- Original message -------- From: Nicholas Sideras via Outages <outages@outages.org> Date: 10/4/16 10:44 AM (GMT-05:00) To: Kevin Kastelic <kevink@sharppackaging.com> Cc: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues?
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Inbound in PA from NYC same issue.
On Oct 4, 2016, at 10:43, Nicholas Sideras via Outages <outages@outages.org> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Kastelic via Outages Sent: Tuesday, October 04, 2016 9:37 AM To: Will Wylie Cc: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages <outages@outages.org> wrote: Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org> wrote: We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine. On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages < outages@outages.org> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Sean Beverly Senior Infrastructure Engineer 312.895.5362 Dir 312.427.3246 Fax
Wow. Did Level3 get hit with an EMP? On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages < outages@outages.org> wrote:
Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine.
On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages < outages@outages.org> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Sean Beverly Senior Infrastructure Engineer
312.895.5362 Dir 312.427.3246 Fax
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Level3 Outage ID: 11571692. Not that you can get a hold of anyone at Level3 to discuss it.. On Tue, Oct 4, 2016 at 10:53 AM, Dan Wood via Outages <outages@outages.org> wrote:
Wow. Did Level3 get hit with an EMP?
On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages < outages@outages.org> wrote:
Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine.
On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages < outages@outages.org> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Sean Beverly Senior Infrastructure Engineer
312.895.5362 Dir 312.427.3246 Fax
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- David Wessell President, Ringfree Communications, Inc p: 828-575-0030 x101 a: 475 S Church St Hendersonville, NC 28792 s: www.ringfree.com e: david@ringfree.com
looks pretty widespread http://downdetector.com/status/level3/map/ On Tue, Oct 4, 2016 at 10:55 AM, David Wessell via Outages < outages@outages.org> wrote:
Level3 Outage ID: 11571692. Not that you can get a hold of anyone at Level3 to discuss it..
On Tue, Oct 4, 2016 at 10:53 AM, Dan Wood via Outages <outages@outages.org
wrote:
Wow. Did Level3 get hit with an EMP?
On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages < outages@outages.org> wrote:
Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine.
On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages < outages@outages.org> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Sean Beverly Senior Infrastructure Engineer
312.895.5362 Dir 312.427.3246 Fax
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
David Wessell President, Ringfree Communications, Inc p: 828-575-0030 x101 a: 475 S Church St Hendersonville, NC 28792 s: www.ringfree.com e: david@ringfree.com
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Confirmed in PHL, NYC, MIA, and TPA. On Tuesday, October 4, 2016, David Wessell via Outages <outages@outages.org> wrote:
Level3 Outage ID: 11571692. Not that you can get a hold of anyone at Level3 to discuss it..
On Tue, Oct 4, 2016 at 10:53 AM, Dan Wood via Outages <outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
Wow. Did Level3 get hit with an EMP?
On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages < outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>
wrote:
Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine.
On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages < outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org <javascript:_e(%7B%7D,'cvml','outages-bounces@outages.org');>] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');> *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org <javascript:_e(%7B%7D,'cvml','outages-bounces@outages.org');>] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');> Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages
-- Sean Beverly Senior Infrastructure Engineer
312.895.5362 Dir 312.427.3246 Fax
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages
--
David Wessell President, Ringfree Communications, Inc p: 828-575-0030 x101 a: 475 S Church St Hendersonville, NC 28792 s: www.ringfree.com e: david@ringfree.com <javascript:_e(%7B%7D,'cvml','david@ringfree.com');>
-- Sean Hayes Network Engineer Engage Communications 529 Southard St. Key West, FL 33040 Office: (305)320-0007
Is this effecting more than voice do we know?
On Oct 4, 2016, at 10:58 AM, Sean Hayes via Outages <outages@outages.org> wrote:
Confirmed in PHL, NYC, MIA, and TPA.
On Tuesday, October 4, 2016, David Wessell via Outages <outages@outages.org <mailto:outages@outages.org>> wrote: Level3 Outage ID: 11571692. Not that you can get a hold of anyone at Level3 to discuss it..
On Tue, Oct 4, 2016 at 10:53 AM, Dan Wood via Outages <outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote: Wow. Did Level3 get hit with an EMP?
On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages <outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote: Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine.
On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages <outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote: The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
From: Outages [mailto:outages-bounces@outages.org <javascript:_e(%7B%7D,'cvml','outages-bounces@outages.org');>] On Behalf Of Kevin Kastelic via Outages Sent: Tuesday, October 04, 2016 9:37 AM To: Will Wylie Cc: outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');> Subject: Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages <outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org <javascript:_e(%7B%7D,'cvml','outages-bounces@outages.org');>] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org <javascript:_e(%7B%7D,'cvml','outages@outages.org');> Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
-- Sean Beverly Senior Infrastructure Engineer
312.895.5362 <> Dir 312.427.3246 <> Fax
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
--
David Wessell President, Ringfree Communications, Inc p: 828-575-0030 x101 a: 475 S Church St Hendersonville, NC 28792 s: www.ringfree.com <http://www.ringfree.com/> e: david@ringfree.com <javascript:_e(%7B%7D,'cvml','david@ringfree.com');>
-- Sean Hayes Network Engineer Engage Communications 529 Southard St. Key West, FL 33040 Office: (305)320-0007 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
We have L3 for MPLS and a few other data circuits throughout TX and AZ and see no problems there…..yet….. Thanks, Jeff Hershberger | Telecom Manager BCNE, ACMA 2323 Ross Avenue, Suite 600 | Dallas, TX | 75201 V: (214) 953-5748 | F: (214) 661-6665 | jhershberger@jw.com<mailto:jhershberger@jw.com> [cid:CF52621A-DBF7-42CC-8289-0DAD97F4F825@jwllp.com] On Oct 4, 2016, at 10:01 AM, Paul Stewart via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Is this effecting more than voice do we know? On Oct 4, 2016, at 10:58 AM, Sean Hayes via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Confirmed in PHL, NYC, MIA, and TPA. On Tuesday, October 4, 2016, David Wessell via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Level3 Outage ID: 11571692. Not that you can get a hold of anyone at Level3 to discuss it.. On Tue, Oct 4, 2016 at 10:53 AM, Dan Wood via Outages <outages@outages.org<javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote: Wow. Did Level3 get hit with an EMP? On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages <outages@outages.org<javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote: Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine. On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages <outages@outages.org<javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote: The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message. From: Outages [mailto:outages-bounces@outages.org<javascript:_e(%7B%7D,'cvml','outages-bounces@outages.org');>] On Behalf Of Kevin Kastelic via Outages Sent: Tuesday, October 04, 2016 9:37 AM To: Will Wylie Cc: outages@outages.org<javascript:_e(%7B%7D,'cvml','outages@outages.org');> Subject: Re: [outages] Level3 VoIP Issues? We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else. On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages <outages@outages.org<javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote: Seeing them in Houston On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org<javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote: We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org<javascript:_e(%7B%7D,'cvml','outages@outages.org');>> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org<javascript:_e(%7B%7D,'cvml','outages-bounces@outages.org');>] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org<javascript:_e(%7B%7D,'cvml','outages@outages.org');> Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN _______________________________________________ Outages mailing list Outages@outages.org<javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages -- Sean Beverly Senior Infrastructure Engineer 312.895.5362 Dir 312.427.3246 Fax _______________________________________________ Outages mailing list Outages@outages.org<javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<javascript:_e(%7B%7D,'cvml','Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages -- [https://newoldstamp.com/editor/profilePictures/profile-0842283c892d783bb54be...] David Wessell President, Ringfree Communications, Inc p: 828-575-0030 x101 a: 475 S Church St Hendersonville, NC 28792 s: www.ringfree.com<http://www.ringfree.com/> e: david@ringfree.com<javascript:_e(%7B%7D,'cvml','david@ringfree.com');> -- Sean Hayes Network Engineer Engage Communications 529 Southard St. Key West, FL 33040 Office: (305)320-0007 _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
Our internet is through Level3 as well here in Sussex, WI, and it appears to be working fine. Just voice for us. On Tue, Oct 4, 2016 at 10:01 AM, Paul Stewart via Outages < outages@outages.org> wrote:
Is this effecting more than voice do we know?
On Oct 4, 2016, at 10:58 AM, Sean Hayes via Outages <outages@outages.org> wrote:
Confirmed in PHL, NYC, MIA, and TPA.
On Tuesday, October 4, 2016, David Wessell via Outages < outages@outages.org> wrote:
Level3 Outage ID: 11571692. Not that you can get a hold of anyone at Level3 to discuss it..
On Tue, Oct 4, 2016 at 10:53 AM, Dan Wood via Outages < outages@outages.org> wrote:
Wow. Did Level3 get hit with an EMP?
On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages < outages@outages.org> wrote:
Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine.
On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages < outages@outages.org> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Sean Beverly Senior Infrastructure Engineer
312.895.5362 Dir 312.427.3246 Fax
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
David Wessell President, Ringfree Communications, Inc p: 828-575-0030 x101 a: 475 S Church St Hendersonville, NC 28792 s: www.ringfree.com e: david@ringfree.com
-- Sean Hayes Network Engineer Engage Communications 529 Southard St. Key West, FL 33040 Office: (305)320-0007 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Internet Circuits are up for me with no issues in NYC.....yet... On Tue, Oct 4, 2016 at 11:01 AM, Paul Stewart via Outages < outages@outages.org> wrote:
Is this effecting more than voice do we know?
On Oct 4, 2016, at 10:58 AM, Sean Hayes via Outages <outages@outages.org> wrote:
Confirmed in PHL, NYC, MIA, and TPA.
On Tuesday, October 4, 2016, David Wessell via Outages < outages@outages.org> wrote:
Level3 Outage ID: 11571692. Not that you can get a hold of anyone at Level3 to discuss it..
On Tue, Oct 4, 2016 at 10:53 AM, Dan Wood via Outages < outages@outages.org> wrote:
Wow. Did Level3 get hit with an EMP?
On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages < outages@outages.org> wrote:
Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine.
On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages < outages@outages.org> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Sean Beverly Senior Infrastructure Engineer
312.895.5362 Dir 312.427.3246 Fax
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
David Wessell President, Ringfree Communications, Inc p: 828-575-0030 x101 a: 475 S Church St Hendersonville, NC 28792 s: www.ringfree.com e: david@ringfree.com
-- Sean Hayes Network Engineer Engage Communications 529 Southard St. Key West, FL 33040 Office: (305)320-0007 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Because bugging them in the middle of an outage will get it resolved quicker? :P I will never understand people that are well aware a major outage is happening as evidenced by a 20+ email thread on a major outage list who insist on pestering the very people who are working to get this resolved or level1 reps who literally don't have any control over the situation and limited knowledge to begin with. On Tue, Oct 4, 2016 at 8:55 AM, David Wessell via Outages < outages@outages.org> wrote:
Level3 Outage ID: 11571692. Not that you can get a hold of anyone at Level3 to discuss it..
On Tue, Oct 4, 2016 at 10:53 AM, Dan Wood via Outages <outages@outages.org
wrote:
Wow. Did Level3 get hit with an EMP?
On Tue, Oct 4, 2016 at 10:49 AM, Sean Beverly via Outages < outages@outages.org> wrote:
Inbound calls to DID's on Level 3 in Chicago and NYC are failing for us. Outbound on our trunks seems to be working fine.
On Tue, Oct 4, 2016 at 9:43 AM, Nicholas Sideras via Outages < outages@outages.org> wrote:
The support line just hung up on me while on hold, and calling back gets an "all circuits are busy" message. Calling our sales rep's local MKE office number does the same, but our inbound still appears to be working. Outbound local and long distance still gets an intercept message.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Kevin Kastelic via Outages *Sent:* Tuesday, October 04, 2016 9:37 AM *To:* Will Wylie *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We are also seeing it in Sussex, WI on Level3. Local calling seems to work, but nothing else.
On Tue, Oct 4, 2016 at 9:34 AM, Will Wylie via Outages < outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Sean Beverly Senior Infrastructure Engineer
312.895.5362 Dir 312.427.3246 Fax
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
David Wessell President, Ringfree Communications, Inc p: 828-575-0030 x101 a: 475 S Church St Hendersonville, NC 28792 s: www.ringfree.com e: david@ringfree.com
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Seeing the same thing here. No inbound to Louisiana, Mississippi Level 3 did's. Sent from my iPhone
On Oct 4, 2016, at 9:34 AM, Will Wylie via Outages <outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org> wrote: We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Also experiencing inbound / outbound issues with Level 3 in Midtown NYC. -Mike From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jeremie Chism via Outages Sent: Tuesday, October 04, 2016 10:38 AM To: Will Wylie <willjwylie@gmail.com> Cc: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Seeing the same thing here. No inbound to Louisiana, Mississippi Level 3 did's. Sent from my iPhone On Oct 4, 2016, at 9:34 AM, Will Wylie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Seeing them in Houston On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages ________________________________ Spam<https://antispam.roaringpenguin.com/canit/b.php?i=01RPqDg3l&m=e4f45f01fb73&t=20161004&c=s> Phish/Fraud<https://antispam.roaringpenguin.com/canit/b.php?i=01RPqDg3l&m=e4f45f01fb73&t=20161004&c=p> Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=01RPqDg3l&m=e4f45f01fb73&t=20161004&c=n> Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=01RPqDg3l&m=e4f45f01fb73&t=20161004&c=f>
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem. Seeing issues with other providers like Bandwidth.com and Vitelity as well. --------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2cf&elqCampaignId=> On Tue, Oct 4, 2016 at 10:40 AM, Mike Castoro via Outages < outages@outages.org> wrote:
Also experiencing inbound / outbound issues with Level 3 in Midtown NYC.
-Mike
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Jeremie Chism via Outages *Sent:* Tuesday, October 04, 2016 10:38 AM *To:* Will Wylie <willjwylie@gmail.com> *Cc:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
Seeing the same thing here. No inbound to Louisiana, Mississippi Level 3 did's.
Sent from my iPhone
On Oct 4, 2016, at 9:34 AM, Will Wylie via Outages <outages@outages.org> wrote:
Seeing them in Houston
On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages < outages@outages.org> wrote:
We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages < outages@outages.org> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason Hellenthal JJH48-ARIN
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
------------------------------
Spam <https://antispam.roaringpenguin.com/canit/b.php?i=01RPqDg3l&m=e4f45f01fb73&t=20161004&c=s> Phish/Fraud <https://antispam.roaringpenguin.com/canit/b.php?i=01RPqDg3l&m=e4f45f01fb73&t=20161004&c=p> Not spam <https://antispam.roaringpenguin.com/canit/b.php?i=01RPqDg3l&m=e4f45f01fb73&t=20161004&c=n> Forget previous vote <https://antispam.roaringpenguin.com/canit/b.php?i=01RPqDg3l&m=e4f45f01fb73&t=20161004&c=f>
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Hey Aubrey -- Did you see origination or termination issues with Bandwidth and Vitelity? Or both? Beckman On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2cf&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ---------------------------------------------------------------------------
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2cf&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ --------------------------------------------------------------------------- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com
Bandwidth also has its own CLEC operation, and we didn't see any impact to origination services through them since the majority of our DIDs are on their own network. No impact to termination through them that I'm aware of, though it could be that we had some traffic going out through other carriers. On Tue, Oct 4, 2016 at 12:08 PM, Michael Cargile via Outages < outages@outages.org> wrote:
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well.
On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25e af566bc2cf&elqCampaignId=>
------------------------------------------------------------ --------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ------------------------------------------------------------ --------------- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Bandwidth has their own CLEC operations, and also uses Level 3 in regions where they do not have their own network. We received outage notifications from Bandwidth directly during this incident.
Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut" -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS
FWIW, we're still seeing an outage via Charter's voice service. Local calling seems to be unaffected, but all inbound/outbound long distance is out. We're seeing this behavior in every location in which we have Charter's service, ranging across East TN and into Northern GA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mike Castoro via Outages Sent: Tuesday, October 04, 2016 1:36 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut" -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Also confirmed with Comcast and Cox voice service in VA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 4, 2016 2:08 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? FWIW, we're still seeing an outage via Charter's voice service. Local calling seems to be unaffected, but all inbound/outbound long distance is out. We're seeing this behavior in every location in which we have Charter's service, ranging across East TN and into Northern GA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mike Castoro via Outages Sent: Tuesday, October 04, 2016 1:36 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut" -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Call flow appears to be normal as of 4:00PM Eastern across Charter, Comcast and Cox. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 4, 2016 2:17 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Also confirmed with Comcast and Cox voice service in VA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 4, 2016 2:08 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? FWIW, we're still seeing an outage via Charter's voice service. Local calling seems to be unaffected, but all inbound/outbound long distance is out. We're seeing this behavior in every location in which we have Charter's service, ranging across East TN and into Northern GA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mike Castoro via Outages Sent: Tuesday, October 04, 2016 1:36 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut" -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
This is what we received from our partner, "The Level 3 VOICE department has made a few configuration changes on core network equipment, to provide a work around, and restore customer services. Currently, Level 3 has a ticket open with one of their vendors and the work around will stay in place until a root cause analysis is complete." Frank -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 04, 2016 3:35 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Call flow appears to be normal as of 4:00PM Eastern across Charter, Comcast and Cox. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 4, 2016 2:17 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Also confirmed with Comcast and Cox voice service in VA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 4, 2016 2:08 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? FWIW, we're still seeing an outage via Charter's voice service. Local calling seems to be unaffected, but all inbound/outbound long distance is out. We're seeing this behavior in every location in which we have Charter's service, ranging across East TN and into Northern GA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mike Castoro via Outages Sent: Tuesday, October 04, 2016 1:36 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut" -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
---------------------------------------------------------------------------
Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t =20161004&c=s Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t =20161004&c=p Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t =20161004&c=n Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t =20161004&c=f ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
There was a maintenance scheduled for a cut over that we had been notified of but I'm having trouble confirming if it's related. It seems like a maintenance or maintenance prep work gone bad. I got that email at 1:00am central. GCR # 11424826<tel:11424826> Summary Level 3 will implement scheduled maintenance as part of a large scale global project to migrate traffic from our Voice platform to our IP platform. This work is taking place to migrate traffic off equipment that has reached end of life support and move it to a more stable environment. This GCR is one of several maintenances taking place across various locations. We will be performing this migration to increase network capacity, reliability, and stability. During this time you may experience up to three minutes of fast busies. Updates 04:11 GMT<x-apple-data-detectors://1> - This maintenance is now in progress. Harris Kleyman Data Center Engineer ---- Atomic Data(r) // Safe. Simple. Smart.(tm) 250 Marquette Ave, Suite 225 Minneapolis, MN 55401 Main // 612.466.2000 Direct // 612.466.2031 It's official. We're SOC 3 Certified, again!<http://www.atomicdata.com/articles/atomic-data%C2%AE-keeps-client%E2%80%99s-data-protected-soc-3%C2%AE-certified-security-and-controls> On Oct 4, 2016, at 4:55 PM, Frank Bulk via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: This is what we received from our partner, "The Level 3 VOICE department has made a few configuration changes on core network equipment, to provide a work around, and restore customer services. Currently, Level 3 has a ticket open with one of their vendors and the work around will stay in place until a root cause analysis is complete." Frank -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 04, 2016 3:35 PM To: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Call flow appears to be normal as of 4:00PM Eastern across Charter, Comcast and Cox. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 4, 2016 2:17 PM To: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Also confirmed with Comcast and Cox voice service in VA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Rob Hall via Outages Sent: Tuesday, October 4, 2016 2:08 PM To: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? FWIW, we're still seeing an outage via Charter's voice service. Local calling seems to be unaffected, but all inbound/outbound long distance is out. We're seeing this behavior in every location in which we have Charter's service, ranging across East TN and into Northern GA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mike Castoro via Outages Sent: Tuesday, October 04, 2016 1:36 PM To: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut" -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com<mailto:beckman@angryox.com>> Cc: Aubrey Wells via Outages <outages@outages.org<mailto:outages@outages.org>> Subject: Re: [outages] Level3 VoIP Issues? Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote: Hey Aubrey -- Did you see origination or termination issues with Bandwidth and Vitelity? Or both? Beckman On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote: Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem. Seeing issues with other providers like Bandwidth.com<http://Bandwidth.com> and Vitelity as well. --------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=> --------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com<mailto:beckman@angryox.com> http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com<http://www.vicidial.com> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t =20161004&c=s Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t =20161004&c=p Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t =20161004&c=n Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t =20161004&c=f ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
Here is my last update from Level 3: Outage Start: October 4 , 2016 14:06 GMT Outage Stop: October 4 , 2016 15:31 GMT Root Cause: Calls were not present in Level 3 voice switches, impacting voice services in multiple markets of the United States. Fix Action: Configuration adjustments were implemented to allow calls to reach the switches and complete appropriately. Reason for Outage (RFO) Summary: The Voice NOC investigated reports of voice service impact throughout multiple markets in the United States. The equipment vendor was engaged for assistance with investigations. No inbound or outbound calls were present in voice switches. The Voice NOC was able to implement configuration changes that were successful in allowing calls to reach the switches and process accurately. The Voice NOC will continue to fully evaluate the incident and appropriate actions will take place to ensure incidents of this nature do not recur in the future. Services are currently restored and stable. Corrective Actions: We know how important these services are to our customers. As an organization, we are putting processes in place to prevent issues like this from recurring in the future. This service impact has concluded; however, there may be additional analysis and discovery that occurs as the incident is reviewed by NOC management. Any available updates will be relayed upon event ticket closure. If additional issues are experienced, please contact the Level 3 Technical Service Center at 1-877-4LEVEL3.
Man, I hope that sentence is backwards, because I don't even want to know how much light you have to pump down fiber to cause a fire when you cut it. On Tue, Oct 4, 2016 at 12:35 PM, Mike Castoro via Outages < outages@outages.org> wrote:
Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut"
-Mike
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues?
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well.
On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
------------------------------------------------------------
Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------
Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b. php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=s Fraud/Phish: https://antispam.roaringpenguin.com/canit/b. php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=p Not spam: https://antispam.roaringpenguin.com/canit/b. php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=n Forget vote: https://antispam.roaringpenguin.com/canit/b. php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=f ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- -Ryan McGinnis Platte Valley Communications 308-237-9512
Has anyone received anything about the outage that includes details on the fire? So far, below is what I’ve received: Outage Start: October 4, 2016 14:06 GMT Outage Stop: October 4, 2016 15:31 GMT Root Cause: Calls were not present in Level 3 voice switches, impacting voice services in multiple markets of the United States. Fix Action: Configuration adjustments were implemented to allow calls to reach the switches and complete appropriately. Reason for Outage (RFO) Summary: The Voice NOC investigated reports of voice service impact throughout multiple markets in the United States. The equipment vendor was engaged for assistance with investigations. No inbound or outbound calls were present in voice switches. The Voice NOC was able to implement configuration changes that were successful in allowing calls to reach the switches and process accurately. The Voice NOC will continue to fully evaluate the incident and appropriate actions will take place to ensure incidents of this nature do not recur in the future. Services are currently restored and stable. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ryan McGinnis via Outages Sent: Tuesday, October 4, 2016 1:44 PM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Man, I hope that sentence is backwards, because I don't even want to know how much light you have to pump down fiber to cause a fire when you cut it. On Tue, Oct 4, 2016 at 12:35 PM, Mike Castoro via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut" -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com<mailto:beckman@angryox.com>> Cc: Aubrey Wells via Outages <outages@outages.org<mailto:outages@outages.org>> Subject: Re: [outages] Level3 VoIP Issues? Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850<tel:888.305.3850> Support: 877.344.4861<tel:877.344.4861> or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com<mailto:beckman@angryox.com> http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com<http://www.vicidial.com> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- -Ryan McGinnis Platte Valley Communications 308-237-9512 Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more visit the Mimecast website.
No I haven't gotten anything except for that. This smells a lot like human error until the story of the fire gets tossed in. Harris Kleyman Data Center Engineer ---- Atomic Data® // Safe. Simple. Smart.™ 250 Marquette Ave, Suite 225 Minneapolis, MN 55401 Main // 612.466.2000 Direct // 612.466.2031 It's official. We're SOC 3 Certified, again!<http://www.atomicdata.com/articles/atomic-data%C2%AE-keeps-client%E2%80%99s-data-protected-soc-3%C2%AE-certified-security-and-controls> On Oct 4, 2016, at 4:25 PM, Randall (Randy) Raitz via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Has anyone received anything about the outage that includes details on the fire? So far, below is what I’ve received: Outage Start: October 4, 2016 14:06 GMT Outage Stop: October 4, 2016 15:31 GMT Root Cause: Calls were not present in Level 3 voice switches, impacting voice services in multiple markets of the United States. Fix Action: Configuration adjustments were implemented to allow calls to reach the switches and complete appropriately. Reason for Outage (RFO) Summary: The Voice NOC investigated reports of voice service impact throughout multiple markets in the United States. The equipment vendor was engaged for assistance with investigations. No inbound or outbound calls were present in voice switches. The Voice NOC was able to implement configuration changes that were successful in allowing calls to reach the switches and process accurately. The Voice NOC will continue to fully evaluate the incident and appropriate actions will take place to ensure incidents of this nature do not recur in the future. Services are currently restored and stable. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ryan McGinnis via Outages Sent: Tuesday, October 4, 2016 1:44 PM To: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? Man, I hope that sentence is backwards, because I don't even want to know how much light you have to pump down fiber to cause a fire when you cut it. On Tue, Oct 4, 2016 at 12:35 PM, Mike Castoro via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut" -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com<mailto:beckman@angryox.com>> Cc: Aubrey Wells via Outages <outages@outages.org<mailto:outages@outages.org>> Subject: Re: [outages] Level3 VoIP Issues? Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well. On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com<http://Bandwidth.com> and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850<tel:888.305.3850> Support: 877.344.4861<tel:877.344.4861> or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com<mailto:beckman@angryox.com> http://www.angryox.com/ ---------------------------------------------------------------------- ----- _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com<http://www.vicidial.com> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Fraud/Phish<https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=sFraud/Phish>: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- -Ryan McGinnis Platte Valley Communications 308-237-9512 Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been automatically archived. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
I have a feeling that "fire from a fiber cut" email was a bit of snark (playing on the usual evasive answers you get about many outages) and not meant to be taken seriously. But who knows? My cynicism filter might be set a little high this afternoon. On Tue, Oct 4, 2016 at 2:24 PM, Randall (Randy) Raitz via Outages <outages@outages.org> wrote:
Has anyone received anything about the outage that includes details on the fire? So far, below is what I’ve received:
Outage Start: October 4, 2016 14:06 GMT Outage Stop: October 4, 2016 15:31 GMT Root Cause: Calls were not present in Level 3 voice switches, impacting voice services in multiple markets of the United States. Fix Action: Configuration adjustments were implemented to allow calls to reach the switches and complete appropriately. Reason for Outage (RFO) Summary: The Voice NOC investigated reports of voice service impact throughout multiple markets in the United States. The equipment vendor was engaged for assistance with investigations. No inbound or outbound calls were present in voice switches. The Voice NOC was able to implement configuration changes that were successful in allowing calls to reach the switches and process accurately. The Voice NOC will continue to fully evaluate the incident and appropriate actions will take place to ensure incidents of this nature do not recur in the future. Services are currently restored and stable.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ryan McGinnis via Outages Sent: Tuesday, October 4, 2016 1:44 PM To: outages@outages.org
Subject: Re: [outages] Level3 VoIP Issues?
Man, I hope that sentence is backwards, because I don't even want to know how much light you have to pump down fiber to cause a fire when you cut it.
On Tue, Oct 4, 2016 at 12:35 PM, Mike Castoro via Outages <outages@outages.org> wrote:
Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut"
-Mike
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues?
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well.
On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ----------------------------------------------------------------------
----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------
Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
-Ryan McGinnis
Platte Valley Communications
308-237-9512
Disclaimer
The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.
This email has been scanned for viruses and malware, and may have been automatically archived.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Yes, when I see a claim that a major outage was caused by a: "fire at a large switching center caused by a major fiber cut" I tend to assume that the claim was a joke. -Rusty On Tue, Oct 4, 2016 at 5:40 PM, Jeff Shultz via Outages <outages@outages.org> wrote:
I have a feeling that "fire from a fiber cut" email was a bit of snark (playing on the usual evasive answers you get about many outages) and not meant to be taken seriously.
But who knows? My cynicism filter might be set a little high this afternoon.
On Tue, Oct 4, 2016 at 2:24 PM, Randall (Randy) Raitz via Outages <outages@outages.org> wrote:
Has anyone received anything about the outage that includes details on the fire? So far, below is what I’ve received:
Outage Start: October 4, 2016 14:06 GMT Outage Stop: October 4, 2016 15:31 GMT Root Cause: Calls were not present in Level 3 voice switches, impacting voice services in multiple markets of the United States. Fix Action: Configuration adjustments were implemented to allow calls to reach the switches and complete appropriately. Reason for Outage (RFO) Summary: The Voice NOC investigated reports of voice service impact throughout multiple markets in the United States. The equipment vendor was engaged for assistance with investigations. No inbound or outbound calls were present in voice switches. The Voice NOC was able to implement configuration changes that were successful in allowing calls to reach the switches and process accurately. The Voice NOC will continue to fully evaluate the incident and appropriate actions will take place to ensure incidents of this nature do not recur in the future. Services are currently restored and stable.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ryan McGinnis via Outages Sent: Tuesday, October 4, 2016 1:44 PM To: outages@outages.org
Subject: Re: [outages] Level3 VoIP Issues?
Man, I hope that sentence is backwards, because I don't even want to know how much light you have to pump down fiber to cause a fire when you cut it.
On Tue, Oct 4, 2016 at 12:35 PM, Mike Castoro via Outages <outages@outages.org> wrote:
Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut"
-Mike
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues?
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well.
On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ----------------------------------------------------------------------
----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------
Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
-Ryan McGinnis
Platte Valley Communications
308-237-9512
Disclaimer
The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.
This email has been scanned for viruses and malware, and may have been automatically archived.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
No snark intended. Just relaying the story as I heard it. I also questioned the fire/fiber cut order. -Mike -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jeff Shultz via Outages Sent: Tuesday, October 04, 2016 5:41 PM To: Randall (Randy) Raitz <randy.raitz@readytalk.com>; outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? I have a feeling that "fire from a fiber cut" email was a bit of snark (playing on the usual evasive answers you get about many outages) and not meant to be taken seriously. But who knows? My cynicism filter might be set a little high this afternoon. On Tue, Oct 4, 2016 at 2:24 PM, Randall (Randy) Raitz via Outages <outages@outages.org> wrote:
Has anyone received anything about the outage that includes details on the fire? So far, below is what I’ve received:
Outage Start: October 4, 2016 14:06 GMT Outage Stop: October 4, 2016 15:31 GMT Root Cause: Calls were not present in Level 3 voice switches, impacting voice services in multiple markets of the United States. Fix Action: Configuration adjustments were implemented to allow calls to reach the switches and complete appropriately. Reason for Outage (RFO) Summary: The Voice NOC investigated reports of voice service impact throughout multiple markets in the United States. The equipment vendor was engaged for assistance with investigations. No inbound or outbound calls were present in voice switches. The Voice NOC was able to implement configuration changes that were successful in allowing calls to reach the switches and process accurately. The Voice NOC will continue to fully evaluate the incident and appropriate actions will take place to ensure incidents of this nature do not recur in the future. Services are currently restored and stable.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ryan McGinnis via Outages Sent: Tuesday, October 4, 2016 1:44 PM To: outages@outages.org
Subject: Re: [outages] Level3 VoIP Issues?
Man, I hope that sentence is backwards, because I don't even want to know how much light you have to pump down fiber to cause a fire when you cut it.
On Tue, Oct 4, 2016 at 12:35 PM, Mike Castoro via Outages <outages@outages.org> wrote:
Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut"
-Mike
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues?
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well.
On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2 c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ --------------------------------------------------------------------- -
----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
-Ryan McGinnis
Platte Valley Communications
308-237-9512
Disclaimer
The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.
This email has been scanned for viruses and malware, and may have been automatically archived.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages -- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------ Teach CanIt if this mail (ID 01RPxFHga) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPxFHga&m=a0e5f28f98eb&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPxFHga&m=a0e5f28f98eb&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPxFHga&m=a0e5f28f98eb&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPxFHga&m=a0e5f28f98eb&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS
My apologies :). -R On Tue, Oct 4, 2016 at 5:47 PM, Mike Castoro via Outages <outages@outages.org> wrote:
No snark intended. Just relaying the story as I heard it. I also questioned the fire/fiber cut order.
-Mike
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jeff Shultz via Outages Sent: Tuesday, October 04, 2016 5:41 PM To: Randall (Randy) Raitz <randy.raitz@readytalk.com>; outages@outages.org Subject: Re: [outages] Level3 VoIP Issues?
I have a feeling that "fire from a fiber cut" email was a bit of snark (playing on the usual evasive answers you get about many outages) and not meant to be taken seriously.
But who knows? My cynicism filter might be set a little high this afternoon.
On Tue, Oct 4, 2016 at 2:24 PM, Randall (Randy) Raitz via Outages <outages@outages.org> wrote:
Has anyone received anything about the outage that includes details on the fire? So far, below is what I’ve received:
Outage Start: October 4, 2016 14:06 GMT Outage Stop: October 4, 2016 15:31 GMT Root Cause: Calls were not present in Level 3 voice switches, impacting voice services in multiple markets of the United States. Fix Action: Configuration adjustments were implemented to allow calls to reach the switches and complete appropriately. Reason for Outage (RFO) Summary: The Voice NOC investigated reports of voice service impact throughout multiple markets in the United States. The equipment vendor was engaged for assistance with investigations. No inbound or outbound calls were present in voice switches. The Voice NOC was able to implement configuration changes that were successful in allowing calls to reach the switches and process accurately. The Voice NOC will continue to fully evaluate the incident and appropriate actions will take place to ensure incidents of this nature do not recur in the future. Services are currently restored and stable.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Ryan McGinnis via Outages Sent: Tuesday, October 4, 2016 1:44 PM To: outages@outages.org
Subject: Re: [outages] Level3 VoIP Issues?
Man, I hope that sentence is backwards, because I don't even want to know how much light you have to pump down fiber to cause a fire when you cut it.
On Tue, Oct 4, 2016 at 12:35 PM, Mike Castoro via Outages <outages@outages.org> wrote:
Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut"
-Mike
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues?
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well.
On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2 c f&elqCampaignId=>
--------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ --------------------------------------------------------------------- -
----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
-Ryan McGinnis
Platte Valley Communications
308-237-9512
Disclaimer
The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.
This email has been scanned for viruses and malware, and may have been automatically archived.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------
Teach CanIt if this mail (ID 01RPxFHga) is spam: Spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPxFHga&m=a0e5f28f98eb&t... Fraud/Phish: https://antispam.roaringpenguin.com/canit/b.php?i=01RPxFHga&m=a0e5f28f98eb&t... Not spam: https://antispam.roaringpenguin.com/canit/b.php?i=01RPxFHga&m=a0e5f28f98eb&t... Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=01RPxFHga&m=a0e5f28f98eb&t... ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
http://www.networkworld.com/article/3127062/lan-wan/level-3-acknowledges-net... *Thanks!!* * Jeff Wolf* * | Network Systems Administrator | Technical Services * *jeff.wolf@alliedbuilding.com* <jeff.wolf@alliedbuilding.com> * | Ph: 701-476-4452 **Allied Building Products* <http://www.alliedbuilding.com>* |100 20th St N| Fargo, ND 58107* On Tue, Oct 4, 2016 at 4:24 PM, Randall (Randy) Raitz via Outages < outages@outages.org> wrote:
Has anyone received anything about the outage that includes details on the fire? So far, below is what I’ve received:
Outage Start: October 4, 2016 14:06 GMT Outage Stop: October 4, 2016 15:31 GMT Root Cause: Calls were not present in Level 3 voice switches, impacting voice services in multiple markets of the United States. Fix Action: Configuration adjustments were implemented to allow calls to reach the switches and complete appropriately. Reason for Outage (RFO) Summary: The Voice NOC investigated reports of voice service impact throughout multiple markets in the United States. The equipment vendor was engaged for assistance with investigations. No inbound or outbound calls were present in voice switches. The Voice NOC was able to implement configuration changes that were successful in allowing calls to reach the switches and process accurately. The Voice NOC will continue to fully evaluate the incident and appropriate actions will take place to ensure incidents of this nature do not recur in the future. Services are currently restored and stable.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Ryan McGinnis via Outages *Sent:* Tuesday, October 4, 2016 1:44 PM *To:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
Man, I hope that sentence is backwards, because I don't even want to know how much light you have to pump down fiber to cause a fire when you cut it.
On Tue, Oct 4, 2016 at 12:35 PM, Mike Castoro via Outages < outages@outages.org> wrote:
Unofficially, I'm hearing that the Level 3 voice outage was caused by a "fire at a large switching center caused by a major fiber cut"
-Mike
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Michael Cargile via Outages Sent: Tuesday, October 04, 2016 12:09 PM To: Peter Beckman <beckman@angryox.com> Cc: Aubrey Wells via Outages <outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues?
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well.
On 2016-10-04 11:57, Peter Beckman via Outages wrote:
Hey Aubrey --
Did you see origination or termination issues with Bandwidth and Vitelity? Or both?
Beckman
On Tue, 4 Oct 2016, Aubrey Wells via Outages wrote:
Atlanta Ga, our trunks terminate in McLean VA and NYC. Same problem.
Seeing issues with other providers like Bandwidth.com and Vitelity as well.
--------------------- Aubrey Wells Manager, Network Engineering Digium Cloud Services Main: 888.305.3850 Support: 877.344.4861 or http://www.digium.com/en/support <http://www.digium.com/en/support?elq=65516445a5964d3597e25eaf566bc2c f&elqCampaignId=>
------------------------------------------------------------
Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ----------------------------------------------------------------------
----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Michael Cargile Director of Consulting Vicidial Group www.vicidial.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- BEGIN-ANTISPAM-VOTING-LINKS ------------------------------------------------------
Teach CanIt if this mail (ID 01RPs9KqN) is spam: Spam: https://antispam.roaringpenguin.com/canit/b. php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=s Fraud/Phish <https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=sFraud/Phish>: https://antispam.roaringpenguin.com/canit/b.php?i=01RPs9KqN&m= fab7ef2658be&t=20161004&c=p Not spam: https://antispam.roaringpenguin.com/canit/b. php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=n Forget vote: https://antispam.roaringpenguin.com/canit/b. php?i=01RPs9KqN&m=fab7ef2658be&t=20161004&c=f ------------------------------------------------------ END-ANTISPAM-VOTING-LINKS
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
-Ryan McGinnis
Platte Valley Communications
308-237-9512
*Disclaimer*
The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.
This email has been scanned for viruses and malware, and may have been automatically archived.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- This e-mail and any files transmitted with it are intended only for the person or entity to which it is addressed and may contain confidential material and/or material protected by law. Any retransmission or use of this information may be a violation of that law. If you received this in error, please contact the sender and delete the material from any computer.
On 10/04/2016 12:08 PM, Michael Cargile via Outages wrote:
Both Bandwidth and Vitelity are just VoIP resellers. They use larger carriers like Level3 for their termination and origination. As such Level3's outage is effecting their services as well.
Bandwidth started out as a Level3 resale play, but that information is almost a decade out of date. -- Alex Balashov | Principal | Evariste Systems LLC Tel: +1-706-510-6800 (direct) / +1-800-250-5920 (toll-free) Web: http://www.evaristesys.com/, http://www.csrpswitch.com/
Los Angeles area affected as well. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jeremie Chism via Outages Sent: Tuesday, October 04, 2016 9:38 AM To: Will Wylie <willjwylie@gmail.com> Cc: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Seeing the same thing here. No inbound to Louisiana, Mississippi Level 3 did's. Sent from my iPhone On Oct 4, 2016, at 9:34 AM, Will Wylie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Seeing them in Houston On Tue, Oct 4, 2016 at 9:32 AM, Jason Hellenthal via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We have the same thing here in Brookfield, WI “MKE”
On Oct 4, 2016, at 09:30, Nicholas Sideras via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
We can't make outgoing calls with Level3 from MKE, but incoming is fine as far as we can tell. This is on what was formerly a TWTC connection. I've been waiting about 10 minutes on hold with support as well.
Nicholas Sideras Director of Technical Operations Holland Bulb Farms
From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Kevin Miller via Outages Sent: Tuesday, October 04, 2016 9:27 AM To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Level3 VoIP Issues?
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=01%7C01%7CYsokhan%40cannondesign.com%7C211588fd9c9a45930e2508d3ec6438c3%7C2a62832947c24e25a873a847f2961371%7C1&sdata=PGoNYjmrdp5CJOcKl7nFHDVA9WZ92j3Yqa7wn5JEsNI%3D&reserved=0>
-- Jason Hellenthal JJH48-ARIN _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=01%7C01%7CYsokhan%40cannondesign.com%7C211588fd9c9a45930e2508d3ec6438c3%7C2a62832947c24e25a873a847f2961371%7C1&sdata=PGoNYjmrdp5CJOcKl7nFHDVA9WZ92j3Yqa7wn5JEsNI%3D&reserved=0> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=01%7C01%7CYsokhan%40cannondesign.com%7C211588fd9c9a45930e2508d3ec6438c3%7C2a62832947c24e25a873a847f2961371%7C1&sdata=PGoNYjmrdp5CJOcKl7nFHDVA9WZ92j3Yqa7wn5JEsNI%3D&reserved=0>
Outbound dialing is failing for the majority of our trunks in AZ. On Tue, Oct 4, 2016 at 7:27 AM, Kevin Miller via Outages < outages@outages.org> wrote:
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
We are seeing it intermittently in all of our offices throughout the major Texas cities as well. Thanks, Jeff Hershberger | Telecom Manager BCNE, ACMA 2323 Ross Avenue, Suite 600 | Dallas, TX | 75201 V: (214) 953-5748 | F: (214) 661-6665 | jhershberger@jw.com<mailto:jhershberger@jw.com> [cid:CF52621A-DBF7-42CC-8289-0DAD97F4F825@jwllp.com] On Oct 4, 2016, at 9:52 AM, Jon Shay via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Outbound dialing is failing for the majority of our trunks in AZ. On Tue, Oct 4, 2016 at 7:27 AM, Kevin Miller via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
Not that we likely need more confirmation at this point, but I'm seeing it on Cleveland-area DIDs. Definitely some kind of SHTF situation at Level3. On Tue, Oct 4, 2016 at 10:28 AM Kevin Miller via Outages < outages@outages.org> wrote:
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
We're seeing issues with SIP/PRI in ROC inbound. Also seeing throughout NE and upstate NY. On Tue, Oct 4, 2016 at 10:27 AM, Kevin Miller via Outages < outages@outages.org> wrote:
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- *Nathan J. Lichtenstein * *Rochester Institute of Technology* Networking and Systems Administration, BS *Cisco Certified Entry Network Technician* Verification No. 421913973673ASCH
SIP / PRI inbound-outbound issues in Central California as well. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Nathan J. Lichtenstein via Outages Sent: Tuesday, October 04, 2016 8:08 AM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? We're seeing issues with SIP/PRI in ROC inbound. Also seeing throughout NE and upstate NY. On Tue, Oct 4, 2016 at 10:27 AM, Kevin Miller via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- Nathan J. Lichtenstein Rochester Institute of Technology Networking and Systems Administration, BS Cisco Certified Entry Network Technician Verification No. 421913973673ASCH
Does anyone have a link that would show the status via l3 website etc? Dennis Burgess – Network Solution Engineer – Consultant MikroTik Certified Trainer/Consultant<http://www.linktechs.net/productcart/pc/viewcontent.asp?idpage=5> – MTCNA, MTCRE, MTCWE, MTCTCE, MTCINE For Wireless Hardware/Routers visit www.linktechs.net<http://www.linktechs.net/> Radio Frequiency Coverages: www.towercoverage.com<http://www.towercoverage.com/> Office: 314-735-0270 E-Mail: dmburgess@linktechs.net<mailto:dmburgess@linktechs.net> From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Musser KD (Kevin) at Aera via Outages Sent: Tuesday, October 4, 2016 10:19 AM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? SIP / PRI inbound-outbound issues in Central California as well. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Nathan J. Lichtenstein via Outages Sent: Tuesday, October 04, 2016 8:08 AM To: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Level3 VoIP Issues? We're seeing issues with SIP/PRI in ROC inbound. Also seeing throughout NE and upstate NY. On Tue, Oct 4, 2016 at 10:27 AM, Kevin Miller via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- Nathan J. Lichtenstein Rochester Institute of Technology Networking and Systems Administration, BS Cisco Certified Entry Network Technician Verification No. 421913973673ASCH
Posted in an earlier email. http://downdetector.com/status/level3/map/ From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Dennis Burgess via Outages Sent: Tuesday, October 04, 2016 11:21 AM To: outages@outages.org Subject: Re: [outages] Level3 VoIP Issues? Does anyone have a link that would show the status via l3 website etc?
Does anyone have any information on the scope of the outage or a L3 master ticket to reference....it seems nationwide...anyone know what happened yet? On Tue, Oct 4, 2016 at 11:19 AM, Musser KD (Kevin) at Aera via Outages < outages@outages.org> wrote:
SIP / PRI inbound-outbound issues in Central California as well.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Nathan J. Lichtenstein via Outages *Sent:* Tuesday, October 04, 2016 8:08 AM *To:* outages@outages.org *Subject:* Re: [outages] Level3 VoIP Issues?
We're seeing issues with SIP/PRI in ROC inbound. Also seeing throughout NE and upstate NY.
On Tue, Oct 4, 2016 at 10:27 AM, Kevin Miller via Outages < outages@outages.org> wrote:
All of our Level3 DIDs in PHL and JFK do not seem to working inbound. Outgoing seems to be fine. Waiting for someone to pick up at Level3. Anyone else seeing issues?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
*Nathan J. Lichtenstein * *Rochester Institute of Technology* Networking and Systems Administration, BS
*Cisco Certified Entry Network Technician*
Verification No. 421913973673ASCH
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (40)
-
Alex Balashov -
Aubrey Wells -
Calvin Ellison -
chris -
Dan Wood -
David Wessell -
Dennis Burgess -
Frank Bulk -
Harris Kleyman -
Hershberger, Jeff -
Jason Hellenthal -
Jayson Navitsky -
jchism2＠gmail.com -
Jeff Shultz -
Jeff Wolf -
Jon Shay -
Kevin Kastelic -
Kevin Miller -
Lucky 225 -
Mark Harrison -
Matt Hoppes -
Michael Cargile -
Michael Voity -
Mike Castoro -
Musser KD (Kevin) at Aera -
Nathan J. Lichtenstein -
Nicholas Sideras -
Paul Stewart -
Peter Beckman -
Randall (Randy) Raitz -
Rob Hall -
Robert Johnson -
Rusty Dekema -
Ryan McGinnis -
Sean Beverly -
Sean Harlow -
Sean Hayes -
Shripal Daphtary -
Sokhan, Yuriy -
Will Wylie