User-agent: * Disallow: /logs/ Disallow: /images/ Disallow: /html_code/ Disallow: /db_import/ Disallow: web.config