User-agent: * Disallow: /cgi-bin/ Disallow: /Library/ Disallow: /scgi-bin/ Disallow: .htaccess Disallow: stuff.html Disallow: test.html