Re: Search Bot
>Doesn't Apache::Throttle, configured in apache to kick as a fixuphandler
> Shawn wrote:
>>Hi, I have been trying to figure out a way to limit the massive amount
>>of bandwidth that search bots (Googlebot/2.1) consume daily from my
>>website. My problem is that I am running Apache::ASP and about 90% of
only for Googlebot, address the problem?
I seem to recall a thread where people were using it to throttle clients
based on a "bad client" IP list that was updated on a cron script.
Reporting bugs: http://perl.apache.org/bugs/
Mail list info: http://perl.apache.org/maillist/modperl.html
List etiquette: http://perl.apache.org/maillist/email-etiquette.html