# Robots.txt file for website # Allow google spiders User-agent: Googlebot Disallow: /cms/ User-agent: Googlebot-Image Disallow: /images/ Disallow: /uploads/ Disallow: /cms/ # Allow Inktomi spiders and Yahoo User-agent: Slurp Disallow: /cms/ # Allow MSN spiders and Yahoo User-agent: MsnBot Disallow: /cms/ # Allow Inktomi spiders and Yahoo User-agent: YahooSeeker Disallow: /cms/ # allow WiseNut/ Looksmart spiders User-agent: Zyborg Disallow: /cms/ # Allow Fast / AllTheWeb spiders User-agent: fast Disallow: /cms/ # Allow OpenFind spiders User-agent: Openbot Disallow: /cms/ # Allow Alta Vista spiders User-agent: Scooter Disallow: /cms/ # Disallow EmailSiphon spiders User-agent: EmailSiphon Disallow:/ # Disallow EmailWolf spiders User-agent: EmailWolf Disallow:/ # Disallow ExtractorPro spiders User-agent: ExtractorPro Disallow:/ # Disallow CherryPicker spiders User-agent: CherryPicker Disallow:/ # Disallow NICErsPRO spiders User-agent: NICErsPRO Disallow:/ # Disallow Teleport spiders User-agent: Teleport Disallow:/ # Disallow EmailCollector spiders User-agent: EmailCollector Disallow:/ # Disallow TurnitinBot spiders User-agent: TurnitinBot Disallow:/ # Disallow NPBot spiders User-agent: NPBot Disallow:/ # Disallow Omni-Explorer spiders User-agent: OmniExplorer_Bot Disallow:/