User-agent: * Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /mods/ Disallow: /public_files/ Disallow: /images/