#Robots.txt www.davidcarralon.com/robots.txt User-agent: * Disallow: # Don't allow spambot to crawl any pages User-agent: spambot Disallow: / # Disallow access to CLIENTS User-agent: * Disallow: /CLIENTS sitemap:www.davidcarralon.com/sitemap.xml