Hi all, I figure some folks here use Pingdom as part of their monitoring solution. Just an FYI that they're having troubles right now: Issues with Pingdom services and/or the Internet <https://status.pingdom.com/incidents/0n95zvcxb19m>Subscribe <https://status.pingdom.com/#subscribe-modal-0n95zvcxb19m> Investigating - Our operations team have discovered that something is wrong on the internet. We suspect a major ISP or similiar, this affects all our services, to unknown degrees so far, we will continue to investigate and update here. (from https://status.pingdom.com) We saw this manifest as a couple of our checks immediately firing for phantom problems, but if you're relying on them today you probably want to have a backup too. --Mason
Telia (AS1299) had a complete outage between the United States and Europe for ~20 minutes at 14:45 UTC. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mason via Outages Sent: Tuesday, 2 May 2017 11:15 AM To: outages@outages.org Subject: [outages] Pingdom alerting issues Hi all, I figure some folks here use Pingdom as part of their monitoring solution. Just an FYI that they're having troubles right now: Issues with Pingdom services and/or the Internet<https://status.pingdom.com/incidents/0n95zvcxb19m>Subscribe<https://status.pingdom.com/#subscribe-modal-0n95zvcxb19m> Investigating - Our operations team have discovered that something is wrong on the internet. We suspect a major ISP or similiar, this affects all our services, to unknown degrees so far, we will continue to investigate and update here. (from https://status.pingdom.com) We saw this manifest as a couple of our checks immediately firing for phantom problems, but if you're relying on them today you probably want to have a backup too. --Mason
Got this from them, derp.
Dear Customer,
We regret to inform you that we experienced connectivity issues within our network between US and Europe between 14:47 and 14:55 UTC. The issue was caused by a human mistake while configuring backbone links.
As soon as the issue was identified the configuration was corrected and the transatlantic traffic is now running as expected. Further details will be provided on an official Reason for Outage report.
We sincerely regret any inconvenience this issue may have caused to your services.
Please note that if your service is a protected service, you should not experience any issues as your service is running on a protected path.
Regards, Marty Strong -------------------------------------- Cloudflare - AS13335 Network Engineer marty@cloudflare.com +44 7584 906 055 smartflare (Skype) https://www.peeringdb.com/asn/13335
On 2 May 2017, at 16:33, Nikolas Geyer via Outages <outages@outages.org> wrote:
Telia (AS1299) had a complete outage between the United States and Europe for ~20 minutes at 14:45 UTC.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mason via Outages Sent: Tuesday, 2 May 2017 11:15 AM To: outages@outages.org Subject: [outages] Pingdom alerting issues
Hi all,
I figure some folks here use Pingdom as part of their monitoring solution. Just an FYI that they're having troubles right now:
Issues with Pingdom services and/or the InternetSubscribe Investigating - Our operations team have discovered that something is wrong on the internet. We suspect a major ISP or similiar, this affects all our services, to unknown degrees so far, we will continue to investigate and update here.
(from https://status.pingdom.com)
We saw this manifest as a couple of our checks immediately firing for phantom problems, but if you're relying on them today you probably want to have a backup too.
--Mason _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
This now seems to have also affected the Pingdom control panel (my.pingdom.com); CloudFlare seems to be unable to talk to the backend servers and is serving up a cached page. CloudFlare is reporting broader issues related to a single transit provider (https://www.cloudflarestatus.com/incidents/51q3xhq8w7t8). On 5/2/2017 11:15 AM, Mason via Outages wrote:
Hi all,
I figure some folks here use Pingdom as part of their monitoring solution. Just an FYI that they're having troubles right now:
Issues with Pingdom services and/or the Internet <https://status.pingdom.com/incidents/0n95zvcxb19m>Subscribe <https://status.pingdom.com/#subscribe-modal-0n95zvcxb19m> Investigating - Our operations team have discovered that something is wrong on the internet. We suspect a major ISP or similiar, this affects all our services, to unknown degrees so far, we will continue to investigate and update here.
(from https://status.pingdom.com)
We saw this manifest as a couple of our checks immediately firing for phantom problems, but if you're relying on them today you probably want to have a backup too.
--Mason
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Anyone know if this is still an issue? I just had Pingdom dump on 20 of my nodes, all down, 15 seconds later all up. -----Original Message----- From: Mason via Outages <outages@outages.org> Reply-to: Mason <masond@gmail.com> To: outages@outages.org <outages@outages.org> Subject: [outages] Pingdom alerting issues Date: Tue, 2 May 2017 15:15:09 +0000 Hi all, I figure some folks here use Pingdom as part of their monitoring solution. Just an FYI that they're having troubles right now: Issues with Pingdom services and/or the InternetSubscribe Investigating - Our operations team have discovered that something is wrong on the internet. We suspect a major ISP or similiar, this affects all our services, to unknown degrees so far, we will continue to investigate and update here. (from https://status.pingdom.com) We saw this manifest as a couple of our checks immediately firing for phantom problems, but if you're relying on them today you probably want to have a backup too. --Mason _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages -- Ben Hart | Systems Administrator Montana Interactive (dba MT.gov) Office: (406) 449-3468 x223 Cell: (406) 431-5927 www.egovmt.com CONFIDENTIALITY NOTICE: This email and any attachments are confidential. If you are not the intended recipient, you do not have permission to disclose, copy, distribute, or open any attachments. If you have received this email in error, please notify us immediately by returning it to the sender and delete this copy from your system.
May 2, 2017 8:34 PM, "Hart, Benjamin via Outages" <outages@outages.org> wrote:
Anyone know if this is still an issue?
I just had Pingdom dump on 20 of my nodes, all down, 15 seconds later all up.
This is because they had a backlog of alerts in the queue.. afaik it is resolved. -- Nathan
participants (6)
-
Hart, Benjamin -
Marty Strong -
Mason -
Nathan Higgins -
Nikolas Geyer -
Peter Kristolaitis