Script Pulse

Trade Pulse => Trade Pulse Support => Topic started by: Ric on January 06, 2010, 01:17:10 PM

Title: Cuill - Twiceler - Bad Bot
Post by: Ric on January 06, 2010, 01:17:10 PM

Cuill - has a retarded robot that has been hammering my sites, skewing my stats and ignoring robots.txt

Shows up in noref_in as User Agent "Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html)"

If others have this problem... below is the entry to block it using htaccess

Code: [Select]

ReWriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Mozilla/5(.*)Twiceler
RewriteRule ^.*$ - [F]