Videos in Blended Search

This post is a follow-up to last weeks post on Images in Blended Search. Today, however, we will focus on videos in blended search. As with last week’s analysis, we will look at 10 different search terms to see how each of the four largest search engines behave in response to those queries. Here is the raw data:

Yahoo tom brady video shows 2 of them, as 1st and 3rd result, both from YouTube
Google tom brady video one video in position 1, from YouTube
Microsoft tom brady video 3 videos from video search, right up top, 1-3 from video search
Ask tom brady video 3 videos from Blinkx, profile on left
Yahoo scooby doo videos 5th and 6th, YouTube
Google scooby doo videos 1 on position 6, YouTube
Microsoft scooby doo videos 3 videos from video search, right up top, 1-3 from video search
Ask scooby doo videos 3 videos up top, movies and profile on left
Yahoo nosferatu images up top: halloween-mask.com, movieforum.com, flickr, video in position 9, YouTube – the whole movie
Google nosferatu one, in position 3, from Google Video – the whole movie
Microsoft nosferatu no videos
Ask nosferatu no inline videos, images, music guide, encyclopedia, and 2 videos on right
Yahoo I have a dream 4th and 9th, both from YouTube
Google i have a dream position 1, a book, Google Book Search, position 5 and 6, Google Video and YouTube
Microsoft i have a dream no videos
Ask i have a dream no inline videos, images, encyclopedia, 2 videos, and news on right
Yahoo one small step for man 1 result, position 8, YouTube
Google one small step for man no videos
Microsoft one small step for man no videos
Ask one small step for man no inline videos, nothing over on right
Yahoo alaska videos no videos
Google alaska videos no videos
Microsoft alaska videos 3 videos from video search, right up top, 1, 2, 13 from video search
Ask alaska videos 3 videos up top, nothing on right rail
Yahoo nascar videos positions 8, 9, both from YouTube
Google nascar videos position 7, YouTube
Microsoft nascar videos 3 videos from video search, right up top, 2, 3, 4 from video search
Ask nascar videos 3 videos up top, nothing on right rail
Yahoo parachute videos 2, 3, 6, YouTube * 2, metacafe
Google parachute videos position 5, 8, killsometime.com, kewego.com
Microsoft parachute videos 3 videos up top
Ask parachute videos 3 videos up top, nothing on right rail
Yahoo rolling stones videos 3 results from Yahoo Music, also links to Yahoo Music page for the Stones videos, Note: comes up in a window over the search results (which are greyed out)
Google rolling stones videos no videos
Microsoft rolling stones videos 3 videos from video search, right up top, 3, 4, 5 from video search
Ask rolling stones videos 3 videos up top, 1st plays over search results, second jumps to rolling stone.com, music guide on right
Yahoo britney spears videos 3 results from Yahoo Music, also links to Yahoo Music page for the Spears videos, Note: comes up in a window over the search results (which are greyed out)
Google britney spears videos 5, YouTube, goes to the page, and then runs video (does not show inline or semi-inline)
Microsoft britney spears videos 3 videos from video search, right up top, 3, 4, 6 from video search
Ask britney spears videos 3 videos up top, profile on right rail

Here is a summary of the key things I found in looking at the above data:

  1. Google and Yahoo truly blend their results into the web search results. In other words, one or more of the 10 blue links now is in fact now a video instead of a web site. This is probably because Google and Yahoo attempt to way the relevance of the video results in comparison with those of the web results.
  2. Microsoft and Ask do not blend in the video results when you include the word “videos” in the search phrase. Instead, the videos are shown up above the search results. Evidently, Microsoft and Ask assume that when the query includes the word videos, that the most relevant thing to do is to show these results up top.
  3. Microsoft and Ask do not show videos when presented with popular phrases that don’t include the word “videos”. Examples include “I have a dream”, “One small step for man”, “nosferatu”, etc. (in the case of I have a dream, Ask showed 2 videos over on the right rail).
  4. Google and Yahoo do fail to show videos some of the time, even when the user’s query includes thw word “videos”. For example “alaska videos” (Google and Yahoo) and “rolling stones videos” (Google).

The data illustrates what an early state we are at with videos being blended into web search. There really is no reason not to show one or more videos to the user when the user includes the word “videos” in their query. Their intent has been made clear. On the other hand, if someone types in “one small step for man” or “I have a dream”, it would seem appropriate that one of the choices include a video.

Bottom line, none of the engines have this perfectly scoped out just yet, and there is lots of room for improvement. Nonetheless, the general notion of integrating video into web search results is definitely happening, and it’s a great step forward.

Images In Blended Search

This post is going to take a look at how far the top 4 search engines have gone with integrating images into their blended search results. I’ve put it together as part of my background research for my presentation at SMX West on the panel on images and blended search.

What I did was take 10 different search terms and tried them out. One of the search terms ended with the word “pics”, four ended with “pictures” and five ended with the word “images”. So let’s start by looking at the raw data:

Search Engine Search Phrase Results Source Comments
Yahoo! white mountain pics 3 images up top Flickr  
Google white mountain pics 0 images N/A  
Microsoft white mountain pics 0 images N/A  
Ask white mountain pics 3 images up top Ask image search videos and news on right, image results same as white mountains pictures, do not match the image search results for white mountain pics
Yahoo! white mountains pictures 3 images up top Flickr pictures are from California, the Alps, and upstate NY
Google white mountains pictures 0 images N/A  
Microsoft white mountains pictures 5 images up top Live Image search  
Ask white mountains pictures 3 images up top Ask image search encyclopedia, videos and news on right
Yahoo! acne pictures 3 images up top Flickr (2), Medlist.com  
Google acne pictures 0 images N/A  
Microsoft acne pictures 5 images up top Live Image search  
Ask acne pictures 3 images up top Ask image search encyclopedia, videos and news on right
Yahoo! acne vulgaris pictures 3 images up top acne.republica.pl, scf-online.com, cosmetic.medicine.jp  
Google acne vulgaris pictures 3 images up top history.amedd.army.mil, library.med.utah.edu, aafp.org  
Microsoft acne vulgaris pictures 5 images up top Live Image Search  
Ask acne vulgaris pictures 3 images up top Ask image search encyclopedia, videos and news on right
Yahoo! psoriasis pictures 3 images up top dogflu.ca, dermnetnz.org, dermatology.co.uk  
Google psoriasis pictures 0 images N/A  
Microsoft psoriasis pictures 4 images up top Live Image Search  
Ask psoriasis pictures 3 images up top Ask image search encyclopedia, videos and news on right
Yahoo! Moon images 3 images up top smm.org (2), us.movies1.yimg.com  
Google moon images 3 images up top hoax-slayer.com. carpecrustulum.wordpress.com, nssdc.gsfc.nasa.gov  
Microsoft moon images 5 images up top Live Image Search 3 are of cartoon (anime) character Sailor Moon
Ask moon images 3 images up top Ask image search videos and news on right, First item is a picture of a moon snail
Yahoo! stanford images 3 images up top d.yimg.com (2), us.movies1.yimg.com  
Google stanford images 2 images up top star.stanford.edu, serc.carleton.edu  
Microsoft stanford images 4 images up top Live Image Search  
Ask stanford images 3 images up Ask image search videos on right
Yahoo! mit images 3 images up top Flickr (2), cs.virginia.edu  
Google mit images 3 images up top images.google.com  
Microsoft mit images 4 images up top Live Image Search  
Ask mit images 3 images up top Ask image search videos on right
Yahoo! forest images 3 images up top ucmp.berkeley.edu 2 are basically half size for some reason
Google forest images 3 images up top mass.gov (2), hickerphoto.com  
Microsoft forest images 4 images up top Live Image Search  
Ask forest images 3 images up top Ask Image Search videos and news on right
Yahoo! trees images 3 images up top Flickr  
Google trees images no image results N/A  
Microsoft trees images 5 images up top Live Image Search  
Ask trees images 3 images up top Ask Image Search videos and news on right

Let’s try to summarize this. Here are my observations about the above data:

  1. Yahoo and Ask picked up on the phrase “white mountain pics” and rendered images for that search. Google and Microsoft did not.
  2. Microsoft did offer inline image results up above the web search results in all 9 cases other than the “pics” case.
  3. Google provided image results only 50% of the time, in spite of the leading words “images” and “pictures”.
  4. Yahoo and Google provide a substantial portion of their results directly from third party web sites, as opposed to their image search properties.
  5. Microsoft and Ask provided 100% of their results from their respective image search engines.
  6. There were only two anomalies across all 40 searches performed:
    • Ask provided the same results for “white mountain pics” as it did for “white mountains pictures”. Interestingly enough, even though they provide all their results from their image search engine, “white mountain pics” and “white mountains pictures” do NOT provide the same results in their image search.
    • Microsoft shows two pictures of an Anime character, Sailor Moon, in response to “moon images”. I’d think that they would only call up Sailor Moon images if someone actually typed in “sailor moon images”.

Another interesting aspect of all this is that if you dig in a bit deeper and repeat these searches on the image search engines, you find that the results integrated into web search are NOT, generally speaking, the first 3 results that come up for the exact same search within image search.

For example, if you look at the “acne vulgaris pictures” results from Microsoft, the five images presented in the web search results are the 1st, 5th, 7th, 9th, and 10th results if you search on the exact same phrase in image search.

Overall the result quality was high. When someone provides such a leading indicator of what they want (i.e. “images” or “pictures” is part of the search query) most vendors picked up on that cue (C’mon Google!) and presented reasonable results.