Hello, Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me.
I had to summarize for an internal resource in the last few minutes, figure I would share: -- Of our three datacenters, this is what we saw: Parsippany 1 (OCT) - The worst we saw here was several sub-second power hits. UPS's held without problem, and we did not transfer to generator at all yet. Parsippany 2 (WBR) - Transferred to generator at about 7:55 PM EST as a precautionary measure due to ongoing utility power hits. However, shortly after transfer, utility voltage went to 0 on all phases; around 10p power returned, but abnormally high (seeing about 550 volts on 480 volt bus). We remain on generator with at least 60 hours of fuel left on site. Cedar Knolls 1 (MMU) - Briefly transferred to generator around 7:10, then back to utility. We then force transferred to generator around 8pm and stayed until this morning. Returned to utility and all systems are normal. Fuel trucks are stationed at our facilities as of noon yesterday, and remain. Across all centers, consumption would be - in worst case - around 250 gallons per hour. We have 6,880 on site in generator tanks (27 hours), and additional 12,500 gallons (50 hours) on site available for transfer as needed, for a total of run time of 77 hours. However, we are only consuming fuel at one site right now (WBR, rate of 43 gal/hr). We have accommodated several customers by allowing them to use our conference rooms and some offices, mainly because they lost power at their buildings, lost access to their buildings, or generators ran out of fuel. There has been no service interruption of any sort to any of our datacenter customers, as of this writing. We lost one span of fiber optics between MMU and 165 Halsey, Newark (NWR), network healed in less than 1 second. It was imperceptible. That was early though, yesterday afternoon. We have sales people onsite who are actively taking sales calls, and there is a measurable amount of customers moving equipment into our facilities as I write this. Many are moving equipment from offices with no power and no ETR in sight. We have electricians onsite to help accommodate. The facilities department has been manning all locations around the clock. All sites remain accessible by road. There was never a situation where you could not over the last 24 hours. We have no equipment in 111 8th, so I cannot offer any telemetry there. However, our gear in 60 Hudson St (Tel-X 9th floor) is still online. We saw no interruption at 165 Halsey, except for some very brief utility hits. UPS's held. We are seeing hundreds, if not thousands, of DSL / T1 / T3 / Ethernet customers down - presumably mostly power loss on the CPE. We lost our connection to Covad, presumably they have gear in a building which lost power. We have seen substantial interruption to the cellular networks; in many cases, ATT Wireless (who NAC uses) is unable to complete a call. In certain areas, there is no signal at all. Where I live, in 07874 (Byram), many roads are impassable and most everyone does not have power. Trees are down everywhere. I heard that a Byram squad car had a tree land on it while responding to a call. Schools are closed, Halloween has been "rescheduled" according to our governor. My cable is down, cable modem is down, POTS service is out - yet I still have xDSL (loop by Verizon, IP by NAC) and I run on that successfully. I am unable to get any ATT cell service at my house (usually at least three bars). I am on generator at my house, consuming about 2 gal/hour (propane), with a little over 500 gallons left. That is all I have. This is the road leading to the Byram Police Dept - I took this earlier this morning: https://sphotos-a.xx.fbcdn.net/hphotos-prn1/12696_4311181250657_900557870_n.... This is typically what Northern NJ looks like: https://sphotos-a.xx.fbcdn.net/hphotos-ash3/548544_4311185050752_1011136048_... From: outages-bounces@outages.org [mailto:outages-bounces@outages.org] On Behalf Of Alex Rubenstein Sent: Tuesday, October 30, 2012 10:07 AM To: outages@outages.org Subject: [outages] NYC Outages Hello, Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me.
Ouch, and RE: Covad/Megapath lines, in NY they have been lighting up our email with outage reports, they all end up with a status of: Description: We are currently experiencing a service interruption due to equipment failure at the NYCMNYBS central office in New York, NY. UPDATE: Due to hurricane storm Sandy, the city is under full state of emergency as roads and bridges are closed. Services will remain down during duration of storm as no dispatches can be made. NOC will send further update whenever there is change in condition. On Tue, Oct 30, 2012 at 11:56 AM, Alex Rubenstein <alex@corp.nac.net> wrote:
I had to summarize for an internal resource in the last few minutes, figure I would share:
--
Of our three datacenters, this is what we saw:
Parsippany 1 (OCT) – The worst we saw here was several sub-second power hits. UPS’s held without problem, and we did not transfer to generator at all yet.
Parsippany 2 (WBR) – Transferred to generator at about 7:55 PM EST as a precautionary measure due to ongoing utility power hits. However, shortly after transfer, utility voltage went to 0 on all phases; around 10p power returned, but abnormally high (seeing about 550 volts on 480 volt bus). We remain on generator with at least 60 hours of fuel left on site.
Cedar Knolls 1 (MMU) – Briefly transferred to generator around 7:10, then back to utility. We then force transferred to generator around 8pm and stayed until this morning. Returned to utility and all systems are normal.
Fuel trucks are stationed at our facilities as of noon yesterday, and remain. Across all centers, consumption would be - in worst case - around 250 gallons per hour. We have 6,880 on site in generator tanks (27 hours), and additional 12,500 gallons (50 hours) on site available for transfer as needed, for a total of run time of 77 hours. However, we are only consuming fuel at one site right now (WBR, rate of 43 gal/hr).
We have accommodated several customers by allowing them to use our conference rooms and some offices, mainly because they lost power at their buildings, lost access to their buildings, or generators ran out of fuel.
There has been no service interruption of any sort to any of our datacenter customers, as of this writing.
We lost one span of fiber optics between MMU and 165 Halsey, Newark (NWR), network healed in less than 1 second. It was imperceptible. That was early though, yesterday afternoon.
We have sales people onsite who are actively taking sales calls, and there is a measurable amount of customers moving equipment into our facilities as I write this. Many are moving equipment from offices with no power and no ETR in sight. We have electricians onsite to help accommodate.
The facilities department has been manning all locations around the clock.
All sites remain accessible by road. There was never a situation where you could not over the last 24 hours.
We have no equipment in 111 8th, so I cannot offer any telemetry there. However, our gear in 60 Hudson St (Tel-X 9th floor) is still online.
We saw no interruption at 165 Halsey, except for some very brief utility hits. UPS’s held.
We are seeing hundreds, if not thousands, of DSL / T1 / T3 / Ethernet customers down – presumably mostly power loss on the CPE. We lost our connection to Covad, presumably they have gear in a building which lost power.
We have seen substantial interruption to the cellular networks; in many cases, ATT Wireless (who NAC uses) is unable to complete a call. In certain areas, there is no signal at all.
Where I live, in 07874 (Byram), many roads are impassable and most everyone does not have power. Trees are down everywhere. I heard that a Byram squad car had a tree land on it while responding to a call. Schools are closed, Halloween has been “rescheduled” according to our governor. My cable is down, cable modem is down, POTS service is out – yet I still have xDSL (loop by Verizon, IP by NAC) and I run on that successfully. I am unable to get any ATT cell service at my house (usually at least three bars). I am on generator at my house, consuming about 2 gal/hour (propane), with a little over 500 gallons left.
That is all I have.
This is the road leading to the Byram Police Dept – I took this earlier this morning:
https://sphotos-a.xx.fbcdn.net/hphotos-prn1/12696_4311181250657_900557870_n....
This is typically what Northern NJ looks like:
https://sphotos-a.xx.fbcdn.net/hphotos-ash3/548544_4311185050752_1011136048_...
From: outages-bounces@outages.org [mailto:outages-bounces@outages.org] On Behalf Of Alex Rubenstein Sent: Tuesday, October 30, 2012 10:07 AM To: outages@outages.org Subject: [outages] NYC Outages
Hello,
Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers. Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement... Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while. -- Martin Hepworth, CISSP Oxford, UK On 30 October 2012 14:06, Alex Rubenstein <alex@corp.nac.net> wrote:
Hello,****
** **
Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me.****
** **
** **
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Internap reporting via http://pastebin.com/9Fr2eW6U "The flooding has submerged and destroyed the site's diesel pumps and is preventing fuel from being pumped to the generators on the mezzanine level. The available fuel reserves on the mezzanine level are estimated to support customer loads for approximately 5-7 hours. Once this fuel supply has been exhausted the generator will no longer be able to sustain operation and critical customer power loads will be lost. The building itself is being evacuated and no remote hands support will be available to assist in any equipment shutdown." 75 Broad Street in Manhattan, where both Internap and Peer1 Hosting are shutting down operations. peer1 status page: http://forums.peer1.com/viewtopic.php?f=37&t=7532&p=9463%23p9463 regards, /virendra On 10/30/2012 09:59 AM, Martin Hepworth wrote:
Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers. Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement...
Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/ iF4EAREIAAYFAlCQDJkACgkQ3HuimOHfh+GQWQD/ZJ5sn9LQ5IYpgLbJkr+2rstn AhDfGHEAyfVYkRnFnQYA/0FpP/9DPOU0iWk3v2dt//hzCTMLzwTGe0G9H24YBhR7 =KrMb -----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hi, On 10/30/2012 09:59 AM, Martin Hepworth wrote:
Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers.
Unless I 'm off, US AC-2 landing station is in Bellport, New York, while another is in Tuckerton, NJ. From I gather both areas have heavy storm damage since they were on the north side of Sandy's land fall. They are reporting a storm surge at 13 feet above flood stage in NYC. Can you run a traceroute, would be interested in seeing the path its traversing. Just curious. regards, /virendra
Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement...
Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while.
-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/ iF4EAREIAAYFAlCQEsIACgkQ3HuimOHfh+EcRAD/ZQ0jHTZ9mkStVDPd+Ux9JXYG EOsj0TeaVe/g3Ii32L4A/0t23mJvXesBGC4GnZ4b39r+bYlyZdW8JyfM/0HUK7Xa =8HTz -----END PGP SIGNATURE-----
I know some people were offering help for people effected by the storm in NYC and just saw the below in my Twitter feed. ≠===========≠ Need someone adept at Cisco servers to assist @HumanityRoad in NYC. https://mobile.twitter.com/GWOBorg/status/263338521559969792 ≠===========≠ On 30 Oct 2012 17:57, "virendra rode" <virendra.rode@outages.org> wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
Hi,
On 10/30/2012 09:59 AM, Martin Hepworth wrote:
Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers.
Unless I 'm off, US AC-2 landing station is in Bellport, New York, while another is in Tuckerton, NJ. From I gather both areas have heavy storm damage since they were on the north side of Sandy's land fall. They are reporting a storm surge at 13 feet above flood stage in NYC.
Can you run a traceroute, would be interested in seeing the path its traversing. Just curious.
regards, /virendra
Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement...
Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while.
-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/
iF4EAREIAAYFAlCQEsIACgkQ3HuimOHfh+EcRAD/ZQ0jHTZ9mkStVDPd+Ux9JXYG EOsj0TeaVe/g3Ii32L4A/0t23mJvXesBGC4GnZ4b39r+bYlyZdW8JyfM/0HUK7Xa =8HTz -----END PGP SIGNATURE----- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Who is reporting AC-2 down? Is that from the UK side? Can't find anything on it from Level 3 http://blog.level3.com/level-3-network/official-level-3-statement-hurricane-... Carl Brooks From: Martin Hepworth <maxsec@gmail.com<mailto:maxsec@gmail.com>> Date: Tue, 30 Oct 2012 11:59:10 -0500 Cc: "outages@outages.org<mailto:outages@outages.org>" <outages@outages.org<mailto:outages@outages.org>> Subject: Re: [outages] NYC Outages Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers. Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement... Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while. -- Martin Hepworth, CISSP Oxford, UK On 30 October 2012 14:06, Alex Rubenstein <alex@corp.nac.net<mailto:alex@corp.nac.net>> wrote: Hello, Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
The backhaul in Long Island went down (29th, 22.40 UTC) but has been repaired (31st, 02.40 UTC) .. this was only one backhaul path so not everyone was affected. On 30 October 2012 18:47, Carl Brooks <carl.brooks@tier1research.com> wrote:
Who is reporting AC-2 down? Is that from the UK side? Can't find anything on it from Level 3
http://blog.level3.com/level-3-network/official-level-3-statement-hurricane-... /
Carl Brooks
From: Martin Hepworth <maxsec@gmail.com> Date: Tue, 30 Oct 2012 11:59:10 -0500 Cc: "outages@outages.org" <outages@outages.org> Subject: Re: [outages] NYC Outages
Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers. Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement...
Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while.
-- Martin Hepworth, CISSP Oxford, UK
On 30 October 2012 14:06, Alex Rubenstein <alex@corp.nac.net> wrote:
Hello,****
** **
Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me.** **
** **
** **
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Director / Founder IX Reach Ltd E: steve.wilcox@ixreach.com M: +44 7966 048633 Tempus Court, Bellfield Road, High Wycombe, HP13 5HA, UK.
Anyone have any info about the olm.net host? we have stuff down there, they are reporting power issues at the data center but are on generators but we can't reach anything of theirs. On Wed, Oct 31, 2012 at 12:50 PM, Stephen Wilcox <steve.wilcox@ixreach.com>wrote:
The backhaul in Long Island went down (29th, 22.40 UTC) but has been repaired (31st, 02.40 UTC) .. this was only one backhaul path so not everyone was affected.
On 30 October 2012 18:47, Carl Brooks <carl.brooks@tier1research.com>wrote:
Who is reporting AC-2 down? Is that from the UK side? Can't find anything on it from Level 3
http://blog.level3.com/level-3-network/official-level-3-statement-hurricane-... /
Carl Brooks
From: Martin Hepworth <maxsec@gmail.com> Date: Tue, 30 Oct 2012 11:59:10 -0500 Cc: "outages@outages.org" <outages@outages.org> Subject: Re: [outages] NYC Outages
Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers. Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement...
Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while.
-- Martin Hepworth, CISSP Oxford, UK
On 30 October 2012 14:06, Alex Rubenstein <alex@corp.nac.net> wrote:
Hello,****
** **
Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me.* ***
** **
** **
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Director / Founder IX Reach Ltd E: steve.wilcox@ixreach.com M: +44 7966 048633 Tempus Court, Bellfield Road, High Wycombe, HP13 5HA, UK.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Where do they host? On 31 October 2012 17:03, Mitch <mitpatterson@gmail.com> wrote:
Anyone have any info about the olm.net host? we have stuff down there, they are reporting power issues at the data center but are on generators but we can't reach anything of theirs.
On Wed, Oct 31, 2012 at 12:50 PM, Stephen Wilcox <steve.wilcox@ixreach.com
wrote:
The backhaul in Long Island went down (29th, 22.40 UTC) but has been repaired (31st, 02.40 UTC) .. this was only one backhaul path so not everyone was affected.
On 30 October 2012 18:47, Carl Brooks <carl.brooks@tier1research.com>wrote:
Who is reporting AC-2 down? Is that from the UK side? Can't find anything on it from Level 3
http://blog.level3.com/level-3-network/official-level-3-statement-hurricane-... /
Carl Brooks
From: Martin Hepworth <maxsec@gmail.com> Date: Tue, 30 Oct 2012 11:59:10 -0500 Cc: "outages@outages.org" <outages@outages.org> Subject: Re: [outages] NYC Outages
Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers. Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement...
Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while.
-- Martin Hepworth, CISSP Oxford, UK
On 30 October 2012 14:06, Alex Rubenstein <alex@corp.nac.net> wrote:
Hello,****
** **
Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me. ****
** **
** **
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Director / Founder IX Reach Ltd E: steve.wilcox@ixreach.com M: +44 7966 048633 Tempus Court, Bellfield Road, High Wycombe, HP13 5HA, UK.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Director / Founder IX Reach Ltd E: steve.wilcox@ixreach.com M: +44 7966 048633 Tempus Court, Bellfield Road, High Wycombe, HP13 5HA, UK.
*Trumbull CT* On Wed, Oct 31, 2012 at 1:05 PM, Stephen Wilcox <steve.wilcox@ixreach.com>wrote:
Where do they host?
On 31 October 2012 17:03, Mitch <mitpatterson@gmail.com> wrote:
Anyone have any info about the olm.net host? we have stuff down there, they are reporting power issues at the data center but are on generators but we can't reach anything of theirs.
On Wed, Oct 31, 2012 at 12:50 PM, Stephen Wilcox < steve.wilcox@ixreach.com> wrote:
The backhaul in Long Island went down (29th, 22.40 UTC) but has been repaired (31st, 02.40 UTC) .. this was only one backhaul path so not everyone was affected.
On 30 October 2012 18:47, Carl Brooks <carl.brooks@tier1research.com>wrote:
Who is reporting AC-2 down? Is that from the UK side? Can't find anything on it from Level 3
http://blog.level3.com/level-3-network/official-level-3-statement-hurricane-... /
Carl Brooks
From: Martin Hepworth <maxsec@gmail.com> Date: Tue, 30 Oct 2012 11:59:10 -0500 Cc: "outages@outages.org" <outages@outages.org> Subject: Re: [outages] NYC Outages
Also reports AC2 transatlantic cable down and loss of connectivity to NY based servers. Along with reports on Ausnog about all the fun with the large DCs in Manhattan going to gennie power, diesel pumps being flooded and failing 'cos the tanks are in the basement...
Will be a massive clearup not just for the IT folks, Subways and road tunnels flooded so getting about will be challenging for a while.
-- Martin Hepworth, CISSP Oxford, UK
On 30 October 2012 14:06, Alex Rubenstein <alex@corp.nac.net> wrote:
Hello,****
** **
Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me. ****
** **
** **
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Director / Founder IX Reach Ltd E: steve.wilcox@ixreach.com M: +44 7966 048633 Tempus Court, Bellfield Road, High Wycombe, HP13 5HA, UK.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Director / Founder IX Reach Ltd E: steve.wilcox@ixreach.com M: +44 7966 048633 Tempus Court, Bellfield Road, High Wycombe, HP13 5HA, UK.
Nothing from here in Denver, CO - can't resolve their domain - on fastdns.net which dies: ; <<>> DiG 9.9.2-RedHat-9.9.2-2.fc17 <<>> any olm.net +trace ;; global options: +cmd . 257216 IN NS l.root-servers.net. . 257216 IN NS d.root-servers.net. . 257216 IN NS h.root-servers.net. . 257216 IN NS m.root-servers.net. . 257216 IN NS k.root-servers.net. . 257216 IN NS i.root-servers.net. . 257216 IN NS e.root-servers.net. . 257216 IN NS a.root-servers.net. . 257216 IN NS f.root-servers.net. . 257216 IN NS b.root-servers.net. . 257216 IN NS j.root-servers.net. . 257216 IN NS g.root-servers.net. . 257216 IN NS c.root-servers.net. ;; Received 857 bytes from 127.0.0.1#53(127.0.0.1) in 6 ms net. 172800 IN NS a.gtld-servers.net. net. 172800 IN NS b.gtld-servers.net. net. 172800 IN NS c.gtld-servers.net. net. 172800 IN NS d.gtld-servers.net. net. 172800 IN NS e.gtld-servers.net. net. 172800 IN NS f.gtld-servers.net. net. 172800 IN NS g.gtld-servers.net. net. 172800 IN NS h.gtld-servers.net. net. 172800 IN NS i.gtld-servers.net. net. 172800 IN NS j.gtld-servers.net. net. 172800 IN NS k.gtld-servers.net. net. 172800 IN NS l.gtld-servers.net. net. 172800 IN NS m.gtld-servers.net. ;; Received 731 bytes from 128.63.2.53#53(128.63.2.53) in 106 ms olm.net. 172800 IN NS ns1.fastdns.net. olm.net. 172800 IN NS ns2.fastdns.net. dig: couldn't get address for 'ns1.fastdns.net': no more On 10/31/2012 11:08 AM, Mitch wrote:
*Trumbull CT*
On Wed, Oct 31, 2012 at 1:05 PM, Stephen Wilcox <steve.wilcox@ixreach.com <mailto:steve.wilcox@ixreach.com>> wrote:
Where do they host?
On 31 October 2012 17:03, Mitch <mitpatterson@gmail.com <mailto:mitpatterson@gmail.com>> wrote:
Anyone have any info about the olm.net <http://olm.net> host? we have stuff down there, they are reporting power issues at the data center but are on generators but we can't reach anything of theirs.
They have confirmed they are having issues, they have posted to olmnews.comthey are reporting they are on generators but they have not said why the network is down, my guess is outside resources, wasn't sure anyone else had other news. On Wed, Oct 31, 2012 at 1:18 PM, Chris Stone <cstone@axint.net> wrote:
Nothing from here in Denver, CO - can't resolve their domain - on fastdns.net which dies:
; <<>> DiG 9.9.2-RedHat-9.9.2-2.fc17 <<>> any olm.net +trace ;; global options: +cmd . 257216 IN NS l.root-servers.net. . 257216 IN NS d.root-servers.net. . 257216 IN NS h.root-servers.net. . 257216 IN NS m.root-servers.net. . 257216 IN NS k.root-servers.net. . 257216 IN NS i.root-servers.net. . 257216 IN NS e.root-servers.net. . 257216 IN NS a.root-servers.net. . 257216 IN NS f.root-servers.net. . 257216 IN NS b.root-servers.net. . 257216 IN NS j.root-servers.net. . 257216 IN NS g.root-servers.net. . 257216 IN NS c.root-servers.net. ;; Received 857 bytes from 127.0.0.1#53(127.0.0.1) in 6 ms
net. 172800 IN NS a.gtld-servers.net. net. 172800 IN NS b.gtld-servers.net. net. 172800 IN NS c.gtld-servers.net. net. 172800 IN NS d.gtld-servers.net. net. 172800 IN NS e.gtld-servers.net. net. 172800 IN NS f.gtld-servers.net. net. 172800 IN NS g.gtld-servers.net. net. 172800 IN NS h.gtld-servers.net. net. 172800 IN NS i.gtld-servers.net. net. 172800 IN NS j.gtld-servers.net. net. 172800 IN NS k.gtld-servers.net. net. 172800 IN NS l.gtld-servers.net. net. 172800 IN NS m.gtld-servers.net. ;; Received 731 bytes from 128.63.2.53#53(128.63.2.53) in 106 ms
olm.net. 172800 IN NS ns1.fastdns.net. olm.net. 172800 IN NS ns2.fastdns.net. dig: couldn't get address for 'ns1.fastdns.net': no more
On 10/31/2012 11:08 AM, Mitch wrote:
*Trumbull CT*
On Wed, Oct 31, 2012 at 1:05 PM, Stephen Wilcox <steve.wilcox@ixreach.com>wrote:
Where do they host?
On 31 October 2012 17:03, Mitch <mitpatterson@gmail.com> wrote:
Anyone have any info about the olm.net host? we have stuff down there, they are reporting power issues at the data center but are on generators but we can't reach anything of theirs.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Also from Peer1 tech forum they are physically carrying diesel jerry cans from ground floor to the day tanks to keep the gennies going. Thats 17 floors up steps - if anyone needs a workout and their gym is shut pop down to them ! Martin On Wednesday, 31 October 2012, Mitch wrote:
They have confirmed they are having issues, they have posted to olmnews.com they are reporting they are on generators but they have not said why the network is down, my guess is outside resources, wasn't sure anyone else had other news.
On Wed, Oct 31, 2012 at 1:18 PM, Chris Stone <cstone@axint.net<javascript:_e({}, 'cvml', 'cstone@axint.net');>
wrote:
Nothing from here in Denver, CO - can't resolve their domain - on fastdns.net which dies:
; <<>> DiG 9.9.2-RedHat-9.9.2-2.fc17 <<>> any olm.net +trace ;; global options: +cmd . 257216 IN NS l.root-servers.net. . 257216 IN NS d.root-servers.net. . 257216 IN NS h.root-servers.net. . 257216 IN NS m.root-servers.net. . 257216 IN NS k.root-servers.net. . 257216 IN NS i.root-servers.net. . 257216 IN NS e.root-servers.net. . 257216 IN NS a.root-servers.net. . 257216 IN NS f.root-servers.net. . 257216 IN NS b.root-servers.net. . 257216 IN NS j.root-servers.net. . 257216 IN NS g.root-servers.net. . 257216 IN NS c.root-servers.net. ;; Received 857 bytes from 127.0.0.1#53(127.0.0.1) in 6 ms
net. 172800 IN NS a.gtld-servers.net. net. 172800 IN NS b.gtld-servers.net. net. 172800 IN NS c.gtld-servers.net. net. 172800 IN NS d.gtld-servers.net. net. 172800 IN NS e.gtld-servers.net. net. 172800 IN NS f.gtld-servers.net. net. 172800 IN NS g.gtld-servers.net. net. 172800 IN NS h.gtld-servers.net. net. 172800 IN NS i.gtld-servers.net. net. 172800 IN NS j.gtld-servers.net. net. 172800 IN NS k.gtld-servers.net. net. 172800 IN NS l.gtld-servers.net. net. 172800 IN NS m.gtld-servers.net. ;; Received 731 bytes from 128.63.2.53#53(128.63.2.53) in 106 ms
olm.net. 172800 IN NS ns1.fastdns.net. olm.net. 172800 IN NS ns2.fastdns.net. dig: couldn't get address for 'ns1.fastdns.net': no more
On 10/31/2012 11:08 AM, Mitch wrote:
*Trumbull CT*
On Wed, Oct 31, 2012 at 1:05 PM, Stephen Wilcox <steve.wilcox@ixreach.com
_______________________________________________ Outages mailing list Outages@outages.org <javascript:_e({}, 'cvml', 'Outages@outages.org');> https://puck.nether.net/mailman/listinfo/outages
-- -- Martin Hepworth, CISSP Oxford, UK
If your interested info from Internap IRT NYC datacenters NYM008 111 8th avenue /76 9th avenue on generator power with approx 103 hours also fuel truck expected to replenish NYMTEXT1 75 Broadstreet is completely down not ETR for obvious reasons Tks On Tue, Oct 30, 2012 at 7:06 AM, Alex Rubenstein <alex@corp.nac.net> wrote:
Hello,****
** **
Nothing to report outage-wise. However, if there is anything NAC can do to help anyone affected by the hurricane, please feel free to email me.****
** **
** **
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (9)
-
Alex Rubenstein -
Bacon Zombie -
Carl Brooks -
Chris Stone -
Martin Hepworth -
Mitch -
Stephen Wilcox -
Tony -
virendra rode