A Deeper Look At Robots.txt

This article from SearchEngineLand by Stephan Spencer* discusses the details and importance of including a Robots.txt file in your website for SEO best practices, as each time a search engine spider or “bot” comes to your site, it will look for this file.

The InterCon Group includes a robots.txt file in each and every site we optimize, adhering to  SEO best practices, and as the content and site change, we update the Sitemap and the Robots.txt file as needed.


No comments yet

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: