Why is Search So Complex?

(UPDATE 31 July 2014: We’re resharing this today as one of our “Throwback Thursday” posts on social media because the content here is still very valid and helpful. Please note that although the concepts in the infographic remain accurate, some of the numbers quoted are undoubtedly much larger now.)

Why Is Search SO Complex?

Building a search engine is a very complex task. I often find myself trying to justify to people why it is that search engines can’t understand their site. They seem fixated on believing that a search engine should understand it if a human can understand it. The short answer is that with an infinite amount of time the search engine could, but the scale of the Internet makes it oh so VERY hard.

The infographic below tries to give you some sense of the scale of the problem. Please note that a few numbers are hard to truly pin down, but I pulled them from the best sources I could. For example, Matt Cutts mentioned to me at Pubcon 2012 that Google knew of more than 100 Trillion web pages, and I bet that has grown a lot since then, or the average web page size.

Regardless, the message is the same either way. The web is a really complex place!

Search Engine Complexity Infographic

See the Search Complexity Infographic at Full size

Share This Infographic:

Comments

  1. says

    The sheer numbers alone are astounding, and give you a great idea as to why things are so complex. Then when you factor in that computer language and SEO tactics etc. are changing on a daily basis, it makes it even easier to see that the fog it’s going to clear anytime soon. Search is complex and that isn’t going to change, if anything it will rapidly get more and more complicated as things continue to advance.

Leave a Reply

Your email address will not be published. Required fields are marked *

*