User-agent: * Disallow: /404.asp Disallow: /blog*.asp Disallow: /register.asp Disallow: /wg.asp Disallow: /search.asp /sitemap.asp