User-agent: * Disallow: /cgi-bin/ User-agent: * Disallow: /index2.php User-agent: Yeti Disallow: / User-agent: jetbot Disallow: / User-agent: Baiduspider Disallow: / User-agent: RFCrawler-Mobile Disallow: / User-agent: NaverBot Disallow: / User-agent: BecomeJPBot Disallow: / User-agent: Twiceler Disallow: / User-agent: Yahoo! Slurp/3.0 Disallow: /