User-agent: * Allow: / Disallow: /cgi-bin/ Disallow: /wp-* Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$