User-agent: * Disallow: /login.asp Disallow: /intranet.asp Disallow: /login.htm Disallow: /mdb-database Disallow: /myasg Allow: /. Allow: /