User-agent: * Disallow: /Blog/ Disallow: /blog/ Disallow: /Test/ Disallow: /images/ Disallow: /img/ Disallow: /css/ Disallow: /cgi-bin/ Disallow: /rw_common/ Disallow: /files/ Sitemap: http://www.cameronwilsonmusic.com/sitemap.xml User-agent: Googlebot # disallow all files ending with these extensions Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.txt$