$ mackers.com robots file User-agent: * Disallow: /ErrorDocument/ Disallow: /cgi-bin/ Disallow: /private/ Disallow: /admin/ Disallow: /mc/ Disallow: /temp/ Disallow: /virtual_domains/ Disallow: /hosted_sites/ Disallow: /main/music/ Disallow: /main/music.php Disallow: /photos/ Disallow: /main/cv.pdf Disallow: /sc/ Disallow: /portfolio/ Disallow: /tmp/ Disallow: /clients/ Disallow: /adm/ Disallow: /portfolio/