# robots.txt for http://connorlanguage.com 181102 MJH User-agent: * Disallow: /admin/ # nothing under /admin/ should be spidered Disallow: /azienda/ Disallow: /Forms/ Disallow: /images/ Disallow: /teachers/ # Disallow: /active.asp # active content here, no point spidering it