
FB is down from Fiji: the connection to the server was reset Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys

I'm seeing page timeouts and slow load times from the San Francisco area as well. On Fri, Apr 23, 2010 at 3:06 PM, Franck Martin <franck@avonsys.com> wrote:
FB is down from Fiji: the connection to the server was reset
Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Working fine from Atlanta. -Jim P. On Fri, Apr 23, 2010 at 18:13, Paul McMillan <paul@mcmillan.ws> wrote:
I'm seeing page timeouts and slow load times from the San Francisco area as well.
On Fri, Apr 23, 2010 at 3:06 PM, Franck Martin <franck@avonsys.com> wrote:
FB is down from Fiji: the connection to the server was reset
Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Drama. http://gigaom.com/2010/04/23/facebook-sees-major-outage-takes-out-partner-si... On Fri, Apr 23, 2010 at 6:17 PM, Jim Popovitch <jimpop@gmail.com> wrote:
Working fine from Atlanta.
-Jim P.
On Fri, Apr 23, 2010 at 18:13, Paul McMillan <paul@mcmillan.ws> wrote:
I'm seeing page timeouts and slow load times from the San Francisco area as well.
On Fri, Apr 23, 2010 at 3:06 PM, Franck Martin <franck@avonsys.com> wrote:
FB is down from Fiji: the connection to the server was reset
Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Fine in KY. News feed, chat, and profile updates all snappy. Disruption resolved? Jason On Fri, Apr 23, 2010 at 6:35 PM, Nathan Milford <nathan@outbrain.com> wrote:
Drama.
http://gigaom.com/2010/04/23/facebook-sees-major-outage-takes-out-partner-si...
On Fri, Apr 23, 2010 at 6:17 PM, Jim Popovitch <jimpop@gmail.com> wrote:
Working fine from Atlanta.
-Jim P.
On Fri, Apr 23, 2010 at 18:13, Paul McMillan <paul@mcmillan.ws> wrote:
I'm seeing page timeouts and slow load times from the San Francisco area as well.
On Fri, Apr 23, 2010 at 3:06 PM, Franck Martin <franck@avonsys.com> wrote:
FB is down from Fiji: the connection to the server was reset
Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jason L. Sparks 502.303.1925 - v 502.896.9295 - f jlsparks@gmail.com

Southeast is fine, I always get taken to Arkansas. -----Original Message----- From: Franck Martin <franck@avonsys.com> Date: Sat, 24 Apr 2010 10:06:48 To: <outages@outages.org> Subject: [outages] FB down? _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Same here but I see HTTP connections now. I got timeouts a few mins ago. Zaid On 4/23/10 3:06 PM, "Franck Martin" <franck@avonsys.com> wrote:
FB is down from Fiji: the connection to the server was reset
Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Who cares? </editorial> Sydney, Australia was down. Cleveland, OH and San Francisco, CA are both functioning. On Sat, Apr 24, 2010 at 10:06:48AM +1200, Franck Martin wrote:
FB is down from Fiji: the connection to the server was reset
Franck Martin [1]http://www.avonsys.com/ [2]http://www.facebook.com/Avonsys twitter: [3]FranckMartin [4]Avonsys
References
Visible links 1. http://www.avonsys.com/ 2. http://www.facebook.com/Avonsys 3. http://twitter.com/FranckMartin 4. http://twitter.com/avonsys
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Correct me if I'm wrong but aren't RST's sent by the TCP stack in the webserver? If you are recieving them it would imply that the network connection is fine, but you were sent to a server that is having issues. WIth the amount of traffic they recieve I would assume they use some sort of load balancing method. Try clearing your DNS cache and closing your browser and trying again. [outages] FB down? Franck Martin to: outages 04/23/10 06:12 PM Sent by: <outages-bounces@outages.org> FB is down from Fiji: the connection to the server was reset Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

On Fri, Apr 23, 2010 at 07:08:14PM -0400, Keegan.Holley@sungard.com wrote:
Correct me if I'm wrong but aren't RST's sent by the TCP stack in the webserver? If you are recieving them it would imply that the network connection is fine, but you were sent to a server that is having issues. WIth the amount of traffic they recieve I would assume they use some sort of load balancing method. Try clearing your DNS cache and closing your browser and trying again.
RSTs are sent by the OS (not the "webserver"; there is no TCP stack inside a webserver) when the underlying userland application calls close(2) on the descriptor (socket), the process exits, or otherwise aborts/crashes in some way thus freeing the descriptor that handles the network I/O. Facebook's predominantly using Linux[1] which is why I describe the above model. Given Facebook's complexity, who knows what the problem was. Load balancer or layer 7 filter/re-writer (think F5) issues? Back-end server problems? Software misconfiguration? Doing burn-outs in an AMC Pacer by sticking with PHP[2]? Some developer deciding to just roll something out in the middle of the day (as is quite common with social networking sites these days)? We'll probably never know. If I had a nickel for every time I've seen FB's environment behave erratically (easy to confirm with curl), close sockets abruptly, time out during HTTP transactions, I'd own a series of small islands by now. [1]: http://www.infoq.com/presentations/Facebook-Software-Stack [2]: http://developers.facebook.com/blog/post/358 -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |
[outages] FB down?
Franck Martin to: outages 04/23/10 06:12 PM
Sent by: <outages-bounces@outages.org>
FB is down from Fiji: the connection to the server was reset
Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

By webserver I meant the box not the daemon running on it. I wasn't trying to give everyone a lesson on TCP, I was just implying that the original post about the problem being based on a location were probably false. I'm still curious if it was the entire site or just a few of the servers in a load-balanced pool Re: [outages] FB down? Jeremy Chadwick to: outages 04/23/10 07:48 PM Sent by: <outages-bounces@outages.org> On Fri, Apr 23, 2010 at 07:08:14PM -0400, Keegan.Holley@sungard.com wrote:
Correct me if I'm wrong but aren't RST's sent by the TCP stack in the webserver? If you are recieving them it would imply that the network connection is fine, but you were sent to a server that is having issues.
WIth the amount of traffic they recieve I would assume they use some sort of load balancing method. Try clearing your DNS cache and closing your browser and trying again.
RSTs are sent by the OS (not the "webserver"; there is no TCP stack inside a webserver) when the underlying userland application calls close(2) on the descriptor (socket), the process exits, or otherwise aborts/crashes in some way thus freeing the descriptor that handles the network I/O. Facebook's predominantly using Linux[1] which is why I describe the above model. Given Facebook's complexity, who knows what the problem was. Load balancer or layer 7 filter/re-writer (think F5) issues? Back-end server problems? Software misconfiguration? Doing burn-outs in an AMC Pacer by sticking with PHP[2]? Some developer deciding to just roll something out in the middle of the day (as is quite common with social networking sites these days)? We'll probably never know. If I had a nickel for every time I've seen FB's environment behave erratically (easy to confirm with curl), close sockets abruptly, time out during HTTP transactions, I'd own a series of small islands by now. [1]: http://www.infoq.com/presentations/Facebook-Software-Stack [2]: http://developers.facebook.com/blog/post/358 -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |
[outages] FB down?
Franck Martin to: outages 04/23/10 06:12 PM
Sent by: <outages-bounces@outages.org>
FB is down from Fiji: the connection to the server was reset
Franck Martin http://www.avonsys.com/ http://www.facebook.com/Avonsys twitter: FranckMartin Avonsys
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (10)
-
Franck Martin
-
Jason L. Sparks
-
Jeremy Chadwick
-
Jim Popovitch
-
jon
-
Keegan.Holley@sungard.com
-
Nathan Milford
-
Paul McMillan
-
Ravi Pina
-
Zaid Ali