
Just came back up…..let our port out process begain… From: Jeff Waddell [mailto:jeff@waddellsolutions.com] Sent: Friday, May 06, 2016 11:09 AM To: Jordan Morris <jmorris@crosswindvoip.com> Cc: Outages@outages.org Subject: Re: [outages] VoIP Innovations Down Just came back up for me Jeff Waddell Engineer | Waddell Solutions Group Office: 859.818.0000 x3002 www.waddellsolutions.com<http://www.waddellsolutions.com> jeff@waddellsolutions.com<mailto:jeff@waddellsolutions.com> On Fri, May 6, 2016 at 1:43 PM, Jordan Morris via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Two of their four servers are down for us but we're still getting traffic on the other two. -----Original Message----- From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Alex Leach via Outages Sent: Friday, May 06, 2016 10:39 AM To: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] VoIP Innovations Down Yes, seeing them down too. On 5/6/2016 12:33 PM, Plexicomm via Outages wrote:
Anyone else see VoIP Innovations go down, AGAIN!!
_______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

It’s not 100% like always.. keeps going up and down. They recommend adding the 209.x.x.x address for disaster recovery but its not working either. Kurt Duncan *From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Jordan Morris via Outages *Sent:* Friday, May 6, 2016 11:14 AM *To:* Outages@outages.org *Subject:* Re: [outages] VoIP Innovations Down *Just came back up…..let our port out process begain…* *From:* Jeff Waddell [mailto:jeff@waddellsolutions.com <jeff@waddellsolutions.com>] *Sent:* Friday, May 06, 2016 11:09 AM *To:* Jordan Morris <jmorris@crosswindvoip.com> *Cc:* Outages@outages.org *Subject:* Re: [outages] VoIP Innovations Down Just came back up for me *Jeff Waddell* *Engineer | Waddell Solutions Group* Office: 859.818.0000 x3002 *www.waddellsolutions.com* <http://www.waddellsolutions.com> *jeff@waddellsolutions.com* <jeff@waddellsolutions.com> On Fri, May 6, 2016 at 1:43 PM, Jordan Morris via Outages < outages@outages.org> wrote: Two of their four servers are down for us but we're still getting traffic on the other two. -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Alex Leach via Outages Sent: Friday, May 06, 2016 10:39 AM To: outages@outages.org Subject: Re: [outages] VoIP Innovations Down Yes, seeing them down too. On 5/6/2016 12:33 PM, Plexicomm via Outages wrote:
Anyone else see VoIP Innovations go down, AGAIN!!
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Same experience here, including the DR site not being of any use. It responds with a "100 Trying" and then 20 seconds later a "504 Server Timeout". Between this and the issue I posted about the other day (which they confirmed was a bug in their system that caused parts of it to think certain endpoints were actually at the IP "1.1.1.1") I'm getting pretty fed up with them this week. On Fri, May 6, 2016 at 2:18 PM Kurt Duncan via Outages <outages@outages.org> wrote:
It’s not 100% like always.. keeps going up and down. They recommend adding the 209.x.x.x address for disaster recovery but its not working either.
Kurt Duncan
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Jordan Morris via Outages *Sent:* Friday, May 6, 2016 11:14 AM *To:* Outages@outages.org
*Subject:* Re: [outages] VoIP Innovations Down
*Just came back up…..let our port out process begain…*
*From:* Jeff Waddell [mailto:jeff@waddellsolutions.com <jeff@waddellsolutions.com>] *Sent:* Friday, May 06, 2016 11:09 AM *To:* Jordan Morris <jmorris@crosswindvoip.com> *Cc:* Outages@outages.org *Subject:* Re: [outages] VoIP Innovations Down
Just came back up for me
*Jeff Waddell*
*Engineer | Waddell Solutions Group*
Office: 859.818.0000 x3002
*www.waddellsolutions.com* <http://www.waddellsolutions.com>
*jeff@waddellsolutions.com* <jeff@waddellsolutions.com>
On Fri, May 6, 2016 at 1:43 PM, Jordan Morris via Outages < outages@outages.org> wrote:
Two of their four servers are down for us but we're still getting traffic on the other two.
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Alex Leach via Outages Sent: Friday, May 06, 2016 10:39 AM To: outages@outages.org Subject: Re: [outages] VoIP Innovations Down
Yes, seeing them down too.
On 5/6/2016 12:33 PM, Plexicomm via Outages wrote:
Anyone else see VoIP Innovations go down, AGAIN!!
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Our monitoring showed their two main hosts as unreachable. Fortunately all but two of our numbers have been ported away. Final two go on Monday. On Fri, May 6, 2016 at 2:40 PM, Sean Harlow via Outages <outages@outages.org
wrote:
Same experience here, including the DR site not being of any use. It responds with a "100 Trying" and then 20 seconds later a "504 Server Timeout".
Between this and the issue I posted about the other day (which they confirmed was a bug in their system that caused parts of it to think certain endpoints were actually at the IP "1.1.1.1") I'm getting pretty fed up with them this week.
On Fri, May 6, 2016 at 2:18 PM Kurt Duncan via Outages < outages@outages.org> wrote:
It’s not 100% like always.. keeps going up and down. They recommend adding the 209.x.x.x address for disaster recovery but its not working either.
Kurt Duncan
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Jordan Morris via Outages *Sent:* Friday, May 6, 2016 11:14 AM *To:* Outages@outages.org
*Subject:* Re: [outages] VoIP Innovations Down
*Just came back up…..let our port out process begain…*
*From:* Jeff Waddell [mailto:jeff@waddellsolutions.com <jeff@waddellsolutions.com>] *Sent:* Friday, May 06, 2016 11:09 AM *To:* Jordan Morris <jmorris@crosswindvoip.com> *Cc:* Outages@outages.org *Subject:* Re: [outages] VoIP Innovations Down
Just came back up for me
*Jeff Waddell*
*Engineer | Waddell Solutions Group*
Office: 859.818.0000 x3002
*www.waddellsolutions.com* <http://www.waddellsolutions.com>
*jeff@waddellsolutions.com* <jeff@waddellsolutions.com>
On Fri, May 6, 2016 at 1:43 PM, Jordan Morris via Outages < outages@outages.org> wrote:
Two of their four servers are down for us but we're still getting traffic on the other two.
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Alex Leach via Outages Sent: Friday, May 06, 2016 10:39 AM To: outages@outages.org Subject: Re: [outages] VoIP Innovations Down
Yes, seeing them down too.
On 5/6/2016 12:33 PM, Plexicomm via Outages wrote:
Anyone else see VoIP Innovations go down, AGAIN!!
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

* *TicketID : */135554/ * *Opened : */5/6/2016 2:38:00 PM/ * *Created by : */RandyS/ * *Original Issue : * o This ticket is to acknowledge a service disruption that occurred at approximately 1:30 PM on 5/6.Our engineers and network teams are currently looking into the matter to determine the cause and restore service as quickly as possible. At this point in time we simply do not have any details we can share with you but will provide them as soon as we have them. This event affected both inbound and outbound calling. At this time calls are processing at normal levels although we have had some reports o! f additio nal failures. We will update you with information as soon as we have it. On 05/06/2016 12:17 PM, Kurt Duncan via Outages wrote:
It’s not 100% like always.. keeps going up and down. They recommend adding the 209.x.x.x address for disaster recovery but its not working either.Â
Â
Â
Kurt Duncan
Â
*From:*Outages [mailto:outages-bounces@outages.org <mailto:outages-bounces@outages.org>] *On Behalf Of *Jordan Morris via Outages *Sent:* Friday, May 6, 2016 11:14 AM *To:* Outages@outages.org <mailto:Outages@outages.org> *Subject:* Re: [outages] VoIP Innovations Down
Â
Â
*Just came back up…..let our port out process begain…*
Â
*From:*Jeff Waddell [mailto:jeff@waddellsolutions.com] *Sent:* Friday, May 06, 2016 11:09 AM *To:* Jordan Morris <jmorris@crosswindvoip.com <mailto:jmorris@crosswindvoip.com>> *Cc:* Outages@outages.org <mailto:Outages@outages.org> *Subject:* Re: [outages] VoIP Innovations Down
Â
Just came back up for me
Â
*Â *
*Jeff Waddell*
*Engineer | Waddell Solutions Group*
Office: 859.818.0000 x3002
*www.waddellsolutions.com* <http://www.waddellsolutions.com>
*jeff@waddellsolutions.com* <mailto:jeff@waddellsolutions.com>
Â
On Fri, May 6, 2016 at 1:43 PM, Jordan Morris via Outages <outages@outages.org <mailto:outages@outages.org>> wrote:
Two of their four servers are down for us but we're still getting traffic on the other two.
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org <mailto:outages-bounces@outages.org>] On Behalf Of Alex Leach via Outages Sent: Friday, May 06, 2016 10:39 AM To: outages@outages.org <mailto:outages@outages.org> Subject: Re: [outages] VoIP Innovations Down
Yes, seeing them down too.
On 5/6/2016 12:33 PM, Plexicomm via Outages wrote: > Anyone else see VoIP Innovations go down, AGAIN!! > > > _______________________________________________ > Outages mailing list > Outages@outages.org <mailto:Outages@outages.org> > https://puck.nether.net/mailman/listinfo/outages >
_______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
Â
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (5)
-
Chris Stone
-
Jordan Morris
-
Kurt Duncan
-
Robert Johnson
-
Sean Harlow