This post is off topic!  It’s about the right to turn off Bots.
This is more of a plea for help and a Rant from an upset, abused person!
I’m probably one week away from shutting down my blog and moving it somewhere else. Another server and domain perhaps? Why you ask and why Am I discussing it here?  

Name ………………………………………………Hits ……….Bandwidth ………Date
Inktomi Slurp …………………………………..1315 ……….47.10 MB …….23 Oct 06
MSNBot …………………………………………….815 ……….30.45 MB …… 27 Oct 06
WISENutbot ………………………………………438 ……….16.67 MB …… 27 Oct 06
Unknown robot (identified by ’spider’) …. 364 …………2.97 MB …….24 Oct 06
Unknown robot (identified by ‘crawl’) …….345 ……….13.27 MB ……26 Oct 06
LinkWalker …………………………………………209 …………2.78 MB ……02 Oct 06
AskJeeves ………………………………………….147 …………5.02 MB ……27 Oct 06

Trying to get a handle on this through server control files like .htaccess or Robot.txt and at what level they should reside and how long they take to listen is like performing magic.

While I’m mastering this, users are often kept out, I lose posts, and basically when something is not working right, because of speed or comments, people just go away. In my mind it is a form of censorship as it is to many other users. Sure I’m flattered to have references to my blog sought out by the different engines.  but…

A. I never asked for it
B. for some people it a Bandwidth problem.
C. It slows the system to a crawl.
D. It deters users from re-visiting.

Just to name a few.
So can we get all the brainiacs together and put up a formula for people who spend the $125 U.S. + to have access to their own server, register a domain.
What is the proper syntax, which files should be modified, where should they reside. Are there other tricks out there that deter the bots, can you turn them all off or just some? Can you let them crawl in certain places and not others?

Why don’t they schedule them by time zone and hit at 3.am when there maybe less traffic?

I consider myself above average when it comes to this stuff, but I’ve slowly been fighting this for over a year.  First off of PhPbb2 boards.  This seems to have worked, now I have to apply the same medicine here.   How’s that line go?   Fuck the Fucking Fuckers!