Robots.txt and Robots Metatags

by Eric Enge Want to control those pesky bots? There are techniques available to help you control what they crawl, and what they index. This article will discuss the basics and point you at some resources for more information. Robots.txt Overview The most basic technique is the "robots.txt" file. This file allows you to tell … [Read more...]

Metatags and SEO

by Eric Enge The role of metatags is misunderstood by some members of the webmaster community. I still have people who are not in the business come up to me and talk about SEO as if it's all about picking keywords metatags. I try not to cringe when I get into these discussions. I once had an idea for an article about this. The … [Read more...]

Implementing Custom Meta Descriptions in WordPress

Recently, we did a post about Google's snippets stating that out site will soon be the most read site in the SEO World. Not many people can claim that Google says that about their site. As I pointed out in the discussion, this results from the way that Google builds it's snippets. Google first looks to find text on your page that … [Read more...]

NoODP, NoYahoo

Barry Schwartz reports that Yahoo is on the verge of adding support for the NoODP metatag. This emerged from an interview with Yahoo's Tim Mayer. This is a good step forward, as Yahoo does use the descriptions for sites found in the Open Directory Project on some occasions, and sometimes these descriptions are not that … [Read more...]

The NoIndex Metatag Debate

Matt Cutts has just put out a posting on how search engines handle the "noindex" metatag. He makes some interesting observations about the results as follows: Google doesn’t show the page in any way Ask doesn’t show the page in any way MSN shows a url reference and Cached link, but no snippet. Clicking the cached link doesn’t … [Read more...]

Robots.txt and Robots Metatags

Telling a search engine to not index a page sounds relatively easy. According to the specs, all you need to do is implement the NOINDEX parameter in your Robots Metatag. Sounds like you're all set. But you might not be. Why? It turns out that if you have also used your Robots.txt file to tell Google to not crawl the pages you … [Read more...]