Jump to content

Archived

This topic is now archived and is closed to further replies.

Dangerousdave26

Aggressive MSN Search Bots

Recommended Posts

Tom

 

I thought I might share this tidbit Ickie came up with over at the Outhouse.

 

http://www.sim-outhouse.com/sohforums/showthread.php?79790-Aggressive-MSN-Search-Bots

 

I noticed AVSIM was down the other day and it looks like the site is loading slow (for me).

 

I am thinking you might be having the same issue with the MSN Search Bots almost acting like a DDoS Attack.

 

http://social.microsoft.com/Forums/en-US/d4743e76-d7e7-49d2-84a5-3fd119dd6438/msn-bot-crashes-my-site-like-a-dos-attack

 

http://social.microsoft.com/Forums/en-US/41092b13-7fd6-4c65-a43d-fe81add8e964/msn-search-bot-trying-to-attack-my-site

 

http://social.microsoft.com/Forums/en-US/41092b13-7fd6-4c65-a43d-fe81add8e964/msn-search-bot-trying-to-attack-my-site

 

Ickie has a fix for the issue posted in our thread above.

 

Even if you are not suffering from the above issues with MSN search bots you may want to apply the fix to your server.

 

Dave

 


There are 10 kinds of people; those who understand binary, and those who don't.

Share this post


Link to post
Share on other sites

Dave, thank you for sharing this information with us. I'll make sure Tom gets this if he hasn't already.


Sincerely,

Chase 

 

My 2017 Build: Liquid Cooled i7 7700K CPU idle @ 4.2GHz | MSI GTX 1080 Gaming X 8G | 16GB's DDR4 4000 RAM | ASUS 27" 144hz Gaming Monitor | MSI Z270 M7 Motherboard  | Windows 10 | Samsung 960 EVO M.2 500GB SSD

Share this post


Link to post
Share on other sites

 

 


Even if you are not suffering from the above issues with MSN search bots you may want to apply the fix to your server.

 

Thank you Dave. There are a number of those that we have taken care of. However, he might get better results by putting those in an .htaccess file rather than the robots.txt file. The .htaccess file block access by the denied IP to ALL areas / directories under the .htaccess root directory rather than the robot.txt file which "bad" robots don't pay any attention to anyway. MSN at this time could be considered a "bad" robot and there are many others that just blow by the instructions in the robot file.

Share this post


Link to post
Share on other sites

Originally we tried the Robot.txt file but they just ignored it.

 

We ended just blocking them at the server level in the Firewall.

 

 


There are 10 kinds of people; those who understand binary, and those who don't.

Share this post


Link to post
Share on other sites

Originally we tried the Robot.txt file but they just ignored it. We ended just blocking them at the server level in the Firewall.

 

That will do the job.

Share this post


Link to post
Share on other sites

  • Tom Allensworth,
    Founder of AVSIM Online


  • Flight Simulation's Premier Resource!

    AVSIM is a free service to the flight simulation community. AVSIM is staffed completely by volunteers and all funds donated to AVSIM go directly back to supporting the community. Your donation here helps to pay our bandwidth costs, emergency funding, and other general costs that crop up from time to time. Thank you for your support!

    Click here for more information and to see all donations year to date.
  • Donation Goals

    AVSIM's 2020 Fundraising Goal

    Donate to our annual general fundraising goal. This donation keeps our doors open and providing you service 24 x 7 x 365. Your donation here helps to pay our bandwidth costs, emergency funding, and other general costs that crop up from time to time. We reset this goal every new year for the following year's goal.


    18%
    $4,720.00 of $25,000.00 Donate Now
×
×
  • Create New...