Serendipity Forums

For several days, my webserver got hit by a bad bots.. ( spammer ? )
They crawl my site just like a robot, but have nothing on their identification, just range of dots.. some said this is an e-mail harvesting robots..

12.44.172.92 - - [14/Nov/2005:03:25:34 +0700] "GET /feeds/categories/5-Daily.rss HTTP/1.0" 200 21758 "-" "Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 )"

Then I found a solution on this page : How to build a Bot Trap and keep bad bots away from a web site

so first, I install "external PHP application" plugin, include the php file,
and make the page link ( e.g : /trap/index.html )

second, create an invisible link on sidebar with HTML Nugget plugin which
pointing to /trap/index.html

third, add corresponding directory to robots.txt's Disallow option.
( User-Agent: * Disallow : /trap* )


Now the problem is, all mighties ..

I have to include the file blacklist.php.. where should I include it ?
- Tried in index.php, but somehow it fsckup the captcha plugin images..
- tried in index.tpl in default template, I got the "Headers already sent.." stuffs..



It would be nice to have this as additional spam protection..

Just my 2 cents ..

You can put that PHP code inside a "config.inc.php" file of your template -- that executes the PHP code just before any template is printed, so it should be okay.

Regards,
Garvin

Awesome ..

Thx Mr. Hicking !

Anybody interested to make this as a plugin ?

The problem is that this trap also blocks any search spider robots, like Google or MSNSearch...

Regards,
Garvin

RobA,

ah - I missed that point totally, sorry

Sadly these actions are a bit interconnected to many parts, so I don't really know how to create a plugin for that...

Regards,
Garvin

I've checked the bot listed there..
it's actually a "wild bots" faking their ID as googlebot / msnbot

Shoot !

I tried putting it as an invisible link on my sidebar, but I guess invisible
pixel is much more effective, ay ?

Would you create a plugin out of it ?
I knew you've created quite some cool plugins for s9y ...

RobA wrote:So I implemented this after reading it....

I got my first (and only so far) hit of someone following the invisible pixel link into the disallowed directory:

Code: Select all

A bad robot hit /***/ 2005-11-14 (Mon) 22:16:30
address is 198.6.95.95, agent is Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)

hehehe.

----
CryingWolf