User-agent: * Disallow: /bot-trap/ Disallow: /questions.html/ Disallow: /ap_info_form.html/ Disallow: /cgi-bin/ Disallow: /aporders/ Disallow: /misc/ Disallow: /pass/ Disallow: /test/ Disallow: /stats/ Disallow: /java/ Disallow: /message.html/ Disallow: /log_test.html/ Disallow: /popunder.html/ Disallow: /pwtest.html/ Disallow: /index2a.html/ Disallow: /webmaster.html/ Disallow: /code.html/ Disallow: /count.html/ Disallow: /Bookmark.htm/ Disallow: /*/print/ Disallow: /print/ Disallow: /send_form/ Disallow: /problem.html/ User-agent: WebZIP Disallow: / User-agent: TurnitinBot Disallow: / #Will disallow all urls on your site User-agent: internetserviceteam.com Disallow: / User-agent: WebTrends Disallow: / User-agent: Yahoo-NewsCrawler Disallow: User-Agent: msnbot Crawl-Delay: 1 User-Agent: Slurp Crawl-Delay: 1