User-agent: * Allow: /$ Disallow: /cgi-bin Disallow: /*.php Disallow: /*.html