.htaccess and robots.txt

Lothar · Post by **Lothar** » Mon Sep 17, 2007 9:33 pm

Are there any suggestions for these files? There are a lot of entries for both. However, I would like some template files.

Lothar Geyer

chickens · Post by **chickens** » Mon Sep 17, 2007 10:18 pm

I would suggest keeping the .htaccess the default format as it should be the correct settings for most people. There are places where you may have to change it, but you will know when that happens.

For the robots.txt file I personally just grabbed the one from wikipedia and edited it to suit my needs. I got rid of most of the site specific info and its mainly just blocking bad bots.

http://en.wikipedia.org/robots.txt
my robots.txt http://zacgarrett.com/robots.txt