# robots.txt file to restrict spiders from accessing the site. Most spiders will use this file for permission to site index # fot the spiders that do not adhere to this standard, a rule has been written in ISAPI to also disallow Spiders that are # known in the list. #all spiders where name is entered into http user-agent are not allowed to crawl through site. User-agent: * Disallow: /