We're seeing widespread issues getting SMS messages back and forth between various North American carriers. Informal testing between at&t and Verizon is failing, and we're seeing high fail rates delivering SMS in a number of contexts. One indication of problems from an SMS service: http://status.twilio.com/services/outgoing-sms Anyone else see anything or know what's up? -Steve
Some evidence: I'm on Sprint (in Seattle), ported through Google Voice, and GV is not seeing them, so my friends aren't either! However I did receive some this morning from a friend on AT&T. On Mon, Jul 8, 2013 at 11:00 AM, Steve Dispensa <Steve.Dispensa@microsoft.com> wrote:
We’re seeing widespread issues getting SMS messages back and forth between various North American carriers. Informal testing between at&t and Verizon is failing, and we’re seeing high fail rates delivering SMS in a number of contexts.
One indication of problems from an SMS service: http://status.twilio.com/services/outgoing-sms
Anyone else see anything or know what’s up?
-Steve
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Chris Sheats yawnbox@gmail.com
Our NOC is also noting extended SMS delivery times for both ingress and egress, confirmed in recent testing as of a few moments ago (VZW<->ATT & ATT<>VZW). We are still in the process of testing other carriers now. Initial observations point to an issue at Syniverse, however we are still in the process of confirming such. If interested - we can keep you posted off-list as updates seem to be coming in every few minutes. Kindly, Kraig Beahn L2Networks Corp. On Mon, Jul 8, 2013 at 2:00 PM, Steve Dispensa <Steve.Dispensa@microsoft.com
wrote:
We’re seeing widespread issues getting SMS messages back and forth between various North American carriers. Informal testing between at&t and Verizon is failing, and we’re seeing high fail rates delivering SMS in a number of contexts.****
** **
One indication of problems from an SMS service: http://status.twilio.com/services/outgoing-sms****
** **
Anyone else see anything or know what’s up? ****
** **
-Steve****
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
This seems to be PRIMARILY between ATT and VZW. I have been able to duplicate the symptoms between those carriers in several different BTA's on both coasts. There seems to be some minor Sprint involvement but the bulk is ATT-> VZW and VZW-> ATT ATT-> ATT and VZW -> VZW seems unaffected NOTE: My systems (approximately 300 nationwide) are all MO/MT based using cellular modems Aaron D. Osgood Streamline Solutions L.L.C P.O. Box 6115 Falmouth, ME 04105 TEL: 207-781-5561 MOBILE: 207-831-5829 ICQ: 206889374 GVoice: 207.518.8455 GTalk: aaron.osgood AOsgood@Streamline-Solutions.net http://www.streamline-solutions.net <http://www.streamline-solutions.net/> Introducing Efficiency to Business since 1986. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Kraig Beahn Sent: Monday, July 08, 2013 2:18 PM To: Steve Dispensa Cc: outages@outages.org Subject: Re: [outages] SMS issues Our NOC is also noting extended SMS delivery times for both ingress and egress, confirmed in recent testing as of a few moments ago (VZW<->ATT & ATT<>VZW). We are still in the process of testing other carriers now. Initial observations point to an issue at Syniverse, however we are still in the process of confirming such. If interested - we can keep you posted off-list as updates seem to be coming in every few minutes. Kindly, Kraig Beahn L2Networks Corp. On Mon, Jul 8, 2013 at 2:00 PM, Steve Dispensa <Steve.Dispensa@microsoft.com> wrote: We're seeing widespread issues getting SMS messages back and forth between various North American carriers. Informal testing between at&t and Verizon is failing, and we're seeing high fail rates delivering SMS in a number of contexts. One indication of problems from an SMS service: http://status.twilio.com/services/outgoing-sms Anyone else see anything or know what's up? -Steve _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Is everyone that is having issues in one region? or spread across the country? I am on sprint and don't appear to be having issues. -Grant On Mon, Jul 8, 2013 at 11:17 AM, Kraig Beahn <kraig@l2net.com> wrote:
Our NOC is also noting extended SMS delivery times for both ingress and egress, confirmed in recent testing as of a few moments ago (VZW<->ATT & ATT<>VZW).
We are still in the process of testing other carriers now.
Initial observations point to an issue at Syniverse, however we are still in the process of confirming such.
If interested - we can keep you posted off-list as updates seem to be coming in every few minutes.
Kindly,
Kraig Beahn L2Networks Corp.
On Mon, Jul 8, 2013 at 2:00 PM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
We’re seeing widespread issues getting SMS messages back and forth between various North American carriers. Informal testing between at&t and Verizon is failing, and we’re seeing high fail rates delivering SMS in a number of contexts.****
** **
One indication of problems from an SMS service: http://status.twilio.com/services/outgoing-sms****
** **
Anyone else see anything or know what’s up? ****
** **
-Steve****
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
It was widespread in North America; it has since resolved for me, but we noticed about an hour of impact (4-5 minute delays or worse) when crossing carriers. From: Grant Ridder [mailto:shortdudey123@gmail.com] Sent: Monday, July 8, 2013 11:34 To: Kraig Beahn Cc: Steve Dispensa; outages@outages.org Subject: Re: [outages] SMS issues Is everyone that is having issues in one region? or spread across the country? I am on sprint and don't appear to be having issues. -Grant On Mon, Jul 8, 2013 at 11:17 AM, Kraig Beahn <kraig@l2net.com<mailto:kraig@l2net.com>> wrote: Our NOC is also noting extended SMS delivery times for both ingress and egress, confirmed in recent testing as of a few moments ago (VZW<->ATT & ATT<>VZW). We are still in the process of testing other carriers now. Initial observations point to an issue at Syniverse, however we are still in the process of confirming such. If interested - we can keep you posted off-list as updates seem to be coming in every few minutes. Kindly, Kraig Beahn L2Networks Corp. On Mon, Jul 8, 2013 at 2:00 PM, Steve Dispensa <Steve.Dispensa@microsoft.com<mailto:Steve.Dispensa@microsoft.com>> wrote: We're seeing widespread issues getting SMS messages back and forth between various North American carriers. Informal testing between at&t and Verizon is failing, and we're seeing high fail rates delivering SMS in a number of contexts. One indication of problems from an SMS service: http://status.twilio.com/services/outgoing-sms Anyone else see anything or know what's up? -Steve _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
----- Original Message -----
From: "Kraig Beahn" <kraig@l2net.com>
If interested - we can keep you posted off-list as updates seem to be coming in every few minutes.
I'm ruling this on topic; if you can give us a roll up every half hour or so as you know new stuff that'd be great. Cheers, -- jr '</moderator>' a -- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://baylink.pitas.com 2000 Land Rover DII St Petersburg FL USA #natog +1 727 647 1274
Confirmed issue with Syniverse in Dallas and Chicago having a 'binding' issue. On Mon, Jul 8, 2013 at 12:38 PM, Jay Ashworth <jra@baylink.com> wrote:
----- Original Message -----
From: "Kraig Beahn" <kraig@l2net.com>
If interested - we can keep you posted off-list as updates seem to be coming in every few minutes.
I'm ruling this on topic; if you can give us a roll up every half hour or so as you know new stuff that'd be great.
Cheers, -- jr '</moderator>' a -- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://baylink.pitas.com 2000 Land Rover DII St Petersburg FL USA #natog +1 727 647 1274 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- The information contained in this message is privileged and confidential and protected from disclosure under Title 18 USC 2150-2521. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you.
"binding" refers to the SMPP binds (TCP connections) that connect the aggregator (Syniverse) to the customer (AT&T/T-Mobile/Verizon/Sprint or other large aggregators such as Iris or SAP/Sybase). These TCP connections are the ones that transfer all the messages. Usually there are hundreds per large carrier. On Mon, Jul 8, 2013 at 12:00 PM, Jered Morgan <lucky225@gmail.com> wrote:
Confirmed issue with Syniverse in Dallas and Chicago having a 'binding' issue.
On Mon, Jul 8, 2013 at 12:38 PM, Jay Ashworth <jra@baylink.com> wrote:
----- Original Message -----
From: "Kraig Beahn" <kraig@l2net.com>
If interested - we can keep you posted off-list as updates seem to be coming in every few minutes.
I'm ruling this on topic; if you can give us a roll up every half hour or so as you know new stuff that'd be great.
Cheers, -- jr '</moderator>' a -- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://baylink.pitas.com 2000 Land Rover DII St Petersburg FL USA #natog +1 727 647 1274 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- The information contained in this message is privileged and confidential and protected from disclosure under Title 18 USC 2150-2521. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you. <https://puck.nether.net/mailman/listinfo/outages>
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
On Jul 9, 2013, at 3:49 AM, Jared Geiger wrote:
These TCP connections are the ones that transfer all the messages. Usually there are hundreds per large carrier.
Does this traffic run across the public Internet (either raw or VPNned), or is it WAN traffic? ----------------------------------------------------------------------- Roland Dobbins <rdobbins@arbor.net> // <http://www.arbornetworks.com> Luck is the residue of opportunity and design. -- John Milton
Without getting into too much detail or violating any existing NDA's currently in place - we can say that all traffic is either encrypted via (VPN/IPSEC/Public Internet) or for heavier users they can opt for unencrypted private line ethernet transport, at the expense of the customer. While a little older, here's a couple of documents that may help describe the overall "connectivity model" Syniverse and other SMS participants currently use: http://cdn.l2net.com/dox/syniverse/CRX_PT_Syniverse_L2NC.pdf http://cdn.l2net.com/dox/syniverse/Syniverse_Connectivity_Models_L2N_Public.... Kindly, Kraig Beahn L2Networks Corp. On Mon, Jul 8, 2013 at 6:02 PM, Dobbins, Roland <rdobbins@arbor.net> wrote:
On Jul 9, 2013, at 3:49 AM, Jared Geiger wrote:
These TCP connections are the ones that transfer all the messages. Usually there are hundreds per large carrier.
Does this traffic run across the public Internet (either raw or VPNned), or is it WAN traffic?
----------------------------------------------------------------------- Roland Dobbins <rdobbins@arbor.net> // <http://www.arbornetworks.com>
Luck is the residue of opportunity and design.
-- John Milton
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
I've been doing unrelated testing of SMS between AT&T and T-Mobile today without any issues. On Mon, Jul 8, 2013 at 11:00 AM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
We’re seeing widespread issues getting SMS messages back and forth between various North American carriers. Informal testing between at&t and Verizon is failing, and we’re seeing high fail rates delivering SMS in a number of contexts.****
** **
One indication of problems from an SMS service: http://status.twilio.com/services/outgoing-sms****
** **
Anyone else see anything or know what’s up? ****
** **
-Steve****
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Carlos Alvarez TelEvolve 602-889-3003
participants (10)
-
Aaron D. Osgood -
Carlos Alvarez -
Chris Sheats -
Dobbins, Roland -
Grant Ridder -
Jared Geiger -
Jay Ashworth -
Jered Morgan -
Kraig Beahn -
Steve Dispensa