# For domain: http://www.webmasters-central.com/ # All robots will spider the domain User-agent: * Disallow:/cgi-bin/ Disallow:/wp-* Disallow:/article-blog/wp-* Disallow:/rss/ Disallow:/lists/