User-agent: * Disallow: /cgi-bin/ Disallow: /old_files/ Disallow: /cwl_dev/ Disallow: /include/ Disallow: /js/ Disallow: /admin/ Disallow: /fmfm-email/ Disallow: /fmfm-files/ Disallow: /notes/ # Rover is a bad dog User-agent: Roverbot Disallow: / # MOMspider, AccessAbility's pet spider, can check our links. User-agent: MOMspider Disallow: /