# Disallow known pagesuckers
User-agent: psbotDisallow: /User-agent: WebStripper/2.62Disallow: /User-agent: WebStripperDisallow: /User-agent: MSIECrawlerDisallow: /User-agent: XupiterToolbarDisallow: /User-agent: TeleportPro/1.29Disallow: /User-agent: TeleportPro/1.29.1718Disallow: /User-agent: WebCopierDisallow: /User-agent: WebCopier v2.8Disallow: /User-agent: WebCopier v2.6Disallow: /User-agent: WebZipDisallow: /User-agent: WebZip/4.0Disallow: /User-agent: WebZIP/4.22 (http://www.spidersoft.com)Disallow: /User-agent: WebCopy/Disallow: /User-agent: WebFetcher/0.8, Disallow: /User-agent: Wget/1.4.0 Disallow: /User-agent: Wget/1.6Disallow: /User-agent: WebBandit/3.50Disallow: /# Let all other spiders crawl the site except some pages and the forumUser-agent: *Disallow: /print.phpDisallow: /subs/Disallow: /forum/Disallow: /apps/Disallow: /default/Disallow: /files/Disallow: /911.phpDisallow: /911bass.phpDisallow: /badtab.phpDisallow: /comments.phpDisallow: /sendmail.phpDisallow: /tellafriend.phpDisallow: /viewtab.phpDisallow: /bandtabs.php