User-agent: * #direct to all spiders
Disallow: /cgi/
Disallow: /js/
Disallow: /stylesheet/