
Hello, Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning. Cal

It looks from my graphs that indeed there is a lack of traffic towards BT. May or may not be related to the power outage at Equinix LD8/Telecity HEX 8/9. Unconfirmed there is an issue however. Regards, Marty Strong -------------------------------------- CloudFlare - AS13335 Network Engineer marty@cloudflare.com +44 7584 906 055 smartflare (Skype) https://www.peeringdb.com/asn/13335
On 20 Jul 2016, at 09:25, Cal Leeming via Outages <outages@outages.org> wrote:
Hello,
Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning.
Cal
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Seems that a bunch of BT core routers are down; http://www.ukinternetreport.co.uk core1-gig2-0.edinburgh.ukcore.bt.net core2-te-0-15-0-6.ilford.ukcore.bt.net etc etc Graphs for each show an outage started approx 2 hours ago. IPX seems unaffected, at least with equipment in TeleHouse metro (according to a colleague). Cal On 20 July 2016 at 09:29:12, Marty Strong (marty@cloudflare.com) wrote: It looks from my graphs that indeed there is a lack of traffic towards BT. May or may not be related to the power outage at Equinix LD8/Telecity HEX 8/9. Unconfirmed there is an issue however. Regards, Marty Strong -------------------------------------- CloudFlare - AS13335 Network Engineer marty@cloudflare.com +44 7584 906 055 smartflare (Skype) https://www.peeringdb.com/asn/13335
On 20 Jul 2016, at 09:25, Cal Leeming via Outages <outages@outages.org> wrote:
Hello,
Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning.
Cal
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Also seems that LINX peering for BT is down too; http://www.ukinternetreport.co.uk/?p=d&id=215 Cal On 20 July 2016 at 09:35:36, Cal Leeming (cal@iops.io) wrote: Seems that a bunch of BT core routers are down; http://www.ukinternetreport.co.uk core1-gig2-0.edinburgh.ukcore.bt.net core2-te-0-15-0-6.ilford.ukcore.bt.net etc etc Graphs for each show an outage started approx 2 hours ago. IPX seems unaffected, at least with equipment in TeleHouse metro (according to a colleague). Cal On 20 July 2016 at 09:29:12, Marty Strong (marty@cloudflare.com) wrote: It looks from my graphs that indeed there is a lack of traffic towards BT. May or may not be related to the power outage at Equinix LD8/Telecity HEX 8/9. Unconfirmed there is an issue however. Regards, Marty Strong -------------------------------------- CloudFlare - AS13335 Network Engineer marty@cloudflare.com +44 7584 906 055 smartflare (Skype) https://www.peeringdb.com/asn/13335
On 20 Jul 2016, at 09:25, Cal Leeming via Outages <outages@outages.org> wrote:
Hello,
Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning.
Cal
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

"BT confirmed it was experiencing issues, which it has attributed to a power failure at one of its internet peering partners' sites in London." http://www.express.co.uk/life-style/science-technology/691282/BT-Broadband-D own-Not-Working-UK-Cant-Get-Online-Outages Frank -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Marty Strong via Outages Sent: Wednesday, July 20, 2016 3:29 AM To: Cal Leeming <cal@iops.io> Cc: Nathan J. Lichtenstein via Outages <outages@outages.org> Subject: Re: [outages] BT Internet UK wide outage? It looks from my graphs that indeed there is a lack of traffic towards BT. May or may not be related to the power outage at Equinix LD8/Telecity HEX 8/9. Unconfirmed there is an issue however. Regards, Marty Strong -------------------------------------- CloudFlare - AS13335 Network Engineer marty@cloudflare.com +44 7584 906 055 smartflare (Skype) https://www.peeringdb.com/asn/13335
On 20 Jul 2016, at 09:25, Cal Leeming via Outages <outages@outages.org> wrote:
Hello,
Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning.
Cal
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Probably related to the power outage at Telecity/Equinix Harbour Exchange. They are still being pretty vague about exactly what happened. "Dear Equinix Customer, Further to the notification below, please be advised that Equinix have identified the root cause of today’s fault and a mitigation plan is in place. The system is stable and a customer incident report will be issued within 24 hours. If you have any further queries, please contact us via email at uk.customerservice@telecity.com. We apologise for any inconvenience caused." On Wed, Jul 20, 2016 at 10:12 AM, Frank Bulk via Outages < outages@outages.org> wrote:
"BT confirmed it was experiencing issues, which it has attributed to a power failure at one of its internet peering partners' sites in London."
http://www.express.co.uk/life-style/science-technology/691282/BT-Broadband-D own-Not-Working-UK-Cant-Get-Online-Outages
Frank
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Marty Strong via Outages Sent: Wednesday, July 20, 2016 3:29 AM To: Cal Leeming <cal@iops.io> Cc: Nathan J. Lichtenstein via Outages <outages@outages.org> Subject: Re: [outages] BT Internet UK wide outage?
It looks from my graphs that indeed there is a lack of traffic towards BT. May or may not be related to the power outage at Equinix LD8/Telecity HEX 8/9.
Unconfirmed there is an issue however.
Regards, Marty Strong -------------------------------------- CloudFlare - AS13335 Network Engineer marty@cloudflare.com +44 7584 906 055 smartflare (Skype)
https://www.peeringdb.com/asn/13335
On 20 Jul 2016, at 09:25, Cal Leeming via Outages <outages@outages.org> wrote:
Hello,
Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning.
Cal
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Saw an alert from Onyx this morning about it.
Details: We are currently seeing routing issues to BT internet hosted locations and 3rd parties who receive service from BT internet or related services. Onyx engineers will continue to monitor the major service outage on the BT network but at this time only external/routed connections to the BT networks are affected, customers with Onyx circuits (provided over BT copper) are not affected by this outage.
-----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJXjzqFAAoJEK8oEetIZDH4dDUH/27gSo+Z4JwmdOa4UWCT4bQ7 jIPyOcnMwDjg95GY55nYG+RfWqK9tPDEP1m9JfLgqIGEcUqCY42mcswAfRJsej0M iKETmBZVuUi3ERrtL5+X7ecR2+wrWbdip813pZvruDSOyDTPIDGusTZoohAoqYCx aEttuhWzxY3xwMBnRnQ6Cw07Dn0yXBFVOAd+k1w999sWUl1W6559VtQCFUs4YJ/8 Iu87JSuPcSszaTIRQ8geKLwVax076NzuHFblSVr6hhhoJ5vtdl7wLfkVJBHu2flm reQQJAUHnWhkVUidn7BIa+RPQ9k0Fdt9QZcLGmm69MUy4HI65fLnuGKL/KSTbsQ= =Fwbe -----END PGP SIGNATURE-----

Saw an alert from Onyx this morning about it. Details: We are currently seeing routing issues to BT internet hosted locations and 3rd parties who receive service from BT internet or related services. Onyx engineers will continue to monitor the major service outage on the BT network but at this time only external/routed connections to the BT networks are affected, customers with Onyx circuits (provided over BT copper) are not affected by this outage.
:s/Onyx/Pulsant/g - we have new owners.. :) We (Onyx/Pulsant) saw a number of monitors drop. We have currently manually dropped our session to BT over LINX Juniper which has helped visibility from our monitoring platforms to end customers. Extreme still seems to be down. We continue to see major issues within customers using BT as an Internet provider, the various graphs being sent round currently show this well. Chris Russell Senior Networks Engineer Onyx/Pulsant Email confidentiality notice This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender. Any offers or quotation of service are subject to formal specification. Errors and omissions excepted. Please note that any views or opinions presented in this email are solely those of the author and do not necessarily represent those of Pulsant Limited or any companies within the wider group. Finally, the recipient should check this email and any attachments for the presence of viruses. Pulsant Limited accept no liability for any damage caused by any virus transmitted by this email. Onyx Group Limited and all associated companies are operating as part of Pulsant Limited.

More here: http://www.ibtimes.co.uk/bt-working-internet-outage-fix-broadband-service-de... Frank From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Cal Leeming via Outages Sent: Wednesday, July 20, 2016 3:25 AM To: Nathan J. Lichtenstein via Outages <outages@outages.org> Subject: [outages] BT Internet UK wide outage? Hello, Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning. Cal

Looks like things are slowly returning to normal, BT LINX and several core routers are showing 0% packet loss now. There’s still some impact on the network, it will be interesting to see what BT say was the root cause Cal On 20 July 2016 at 13:23:48, frnkblk@iname.com (frnkblk@iname.com) wrote: More here: http://www.ibtimes.co.uk/bt-working-internet-outage-fix-broadband-service-de... Frank From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Cal Leeming via Outages Sent: Wednesday, July 20, 2016 3:25 AM To: Nathan J. Lichtenstein via Outages <outages@outages.org> Subject: [outages] BT Internet UK wide outage? Hello, Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning. Cal
participants (7)
-
Cal Leeming
-
Chris Russell
-
Dan Spataro
-
Daniel Hadfield
-
Frank Bulk
-
frnkblk@iname.com
-
Marty Strong