DaveC Asked: 2010-08-10 10:06:37 +0800 CST Which bots and spiders should I block in robots.txt? 14 In order to: Increase security of my website Reduce bandwidth requirements Prevent email address harvesting performance security robots.txt