# This file is used by automatic WWW Robots, Web Crawlers, # and other automated web mapper programs. # It defines which areas are not to be explored. # # See http://www.robotstxt.org/wc/norobots.html # for more information. # # Robots.txt # bye User-Agent: Baiduspider User-Agent: baiduspider User-Agent: BecomeBot User-Agent: BecomeJPBot User-Agent: CazoodleBot User-Agent: Gaisbot User-Agent: girafa User-agent: IRLbot User-agent: LC-Crawler User-Agent: nabot User-Agent: NPBot User-Agent: Openbot User-Agent: panscient.com User-Agent: psbot User-Agent: Twiceler User-Agent: WebAlta User-Agent: Yeti User-Agent: YodaoBot User-Agent: ZyBorg Disallow: /