User-agent: * Disallow: /cgi-bin/ Disallow: /Library/ Disallow: /flash/ Disallow: /pdfs/ Disallow: /css/ Disallow: /templates/ # Use for LIVE server - will allow all search engines to index, but exclude CGI directory