View Full Version : So I found out what was crashing the server so often


Andrew_Pakula
08-27-2008, 10:33 AM
It was the Yahoo Slurp Spider.

After painfully trying to figure out why the server had become so unstable the past month and a half I finally figured out the root cause was the Yahoo Slurp spider bots that were excessively hitting the server constantly. They came more then double the amount the Google bots came and in bursts compared to Google which spreads them out more evenly. Putting a limit on the Yahoo bot seems to have fixed the problem almost immediately.

http://www.timothysykes.com/wp-content/uploads/2008/03/yahoo.jpg

Caine Walker
08-27-2008, 10:34 AM
sweetness.

duovamp
08-27-2008, 10:42 AM
Praise Zeus.

Andrew_Pakula
08-27-2008, 10:53 AM
Heres the stats graphic of yahoo bot

JokeyLoki
08-27-2008, 10:58 AM
WTF

tcm
08-27-2008, 11:01 AM
shit that's nasty

???
08-27-2008, 11:10 AM
its like aids or sum shit.

JokeyLoki
08-27-2008, 11:19 AM
its like aids or sum shit.

http://www.crazymonkeygames.com/Pandemic-2.html

gpub
08-27-2008, 11:21 AM
Good work, Pakula!

wHATcOLOR
08-27-2008, 12:50 PM
in light of this information, i propose that we all take another shot at performing The Robot and uploading videos of our attempts to youtube

hnibos
08-27-2008, 01:04 PM
hey whatcolor you have a mac dont you? what program do you use to record video?

Mo
08-27-2008, 01:15 PM
Let's sue Yahoo!
I mean I paid for access to this forum.

duovamp
08-27-2008, 01:19 PM
I feel like I don't even want to know how much bandwidth I'm eating up...

waltermcphilp
08-27-2008, 01:22 PM
IM GUNNA GO TO YOUR HOUSE AND EAT ALL YOUR BANDWIDTH!

CHOMP CHOMP GULP!


http://www.thefamilygroove.com/EatUp.jpg

wHATcOLOR
08-27-2008, 01:30 PM
hey whatcolor you have a mac dont you? what program do you use to record video?

the hd died at least a month ago. i dont remember exactly waht i used, whatever came with the computer by default

hnibos
08-27-2008, 01:33 PM
aww shucks, thats what happened to me too.

waltermcphilp
08-27-2008, 01:34 PM
im not sure about macs but on my PC i use Debut. its free and works well. i use the screen capture mode to record whatever is on my monitor so im not entirely sure how well it records with a cam.
http://www.nchsoftware.com/capture/index.html

topleybird
08-27-2008, 02:15 PM
"Yahoo Slurp Spider" might be the most terrifying combination of three words I have ever heard.

Mo
08-27-2008, 02:22 PM
im not sure about macs but on my PC i use Debut. its free and works well. i use the screen capture mode to record whatever is on my monitor so im not entirely sure how well it records with a cam.
http://www.nchsoftware.com/capture/index.html

Well, I do hope the servers are running on some kind of UNIX-based OS.

Rider
08-27-2008, 02:23 PM
"Yahoo Slurp Spider" might be the most terrifying combination of three words I have ever heard.

Microsoft has a security project that uses Microsoft spider monkey bots.