How Bing Is Rethinking The Way We Search: Part 1 w/ Stefan Weitz

photo of Stefan Weitz

Key Points from Interview with Stefan Weitz

In this interview Stefan outlines the key areas where Bing sees itself diverging from Google. The discussion provides a clear and direct look at the way Bing plans to build its market share over time. There are three major components to Bing’s strategy:

  1. Become a personal assistant for the searcher, one that knows enough about you to highly customize the search experience (see the discussion about Mission Impossible below)
  2. Move away from a search box and make it totally transparent (for more on this read the discussion of the Xbox Kinect below)
  3. Focus on partnerships instead of acquisitions, allowing Bing to leverage the creativity and accumulated data of others

Stefan also sees great algorithmic search as “table stakes”, but that the real value add in the future is come through additional layers built on top of the raw algorithmic piece. These layers will handle the personalization, the embedding in different platforms, managing partnerships, etc.

This summary covers the basics. Please read the full interview transcript to get the full impact of the discussion.

Full Interview Transcript

Eric Enge: During our last interview we talked Google being very algorithm-focused, and how Bing was going to take a different path. I suspect that this divergence is beginning to grow. Is that right?

There is this shift in how we view the web and what it can do and the way Google does …

Stefan Weitz: Yes. Let me take you a step back, and cover some new stuff we haven’t talked about before. This bifurcation you referred to is happening. There is this shift in how we view the web and what it can do and the way Google does, and neither of them by the way are bad and they both are necessary, but there is a difference. They have done great work focusing on index size, index freshness, speed optimizations, and user experience models. They offer a great keyword search experience, and that’s good. On our side we obviously have to do an amazing job with that core index, with retrieval of URLs based on two and a half keywords per query.

… in many cases we actually outperform Google for algorithmic search and in almost all cases we are at least as good or better.

All that stuff is table stakes, and we’ve always known that. With a couple of our more recent algorithmic updates, in many cases we actually outperform Google for algorithmic search and in almost all cases we are at least as good or better. But, there is this new thing, this notion that the web itself has changed and continues to change at an accelerating pace.

Bare Search PagesSearch really is predicated on the structure of the web, and as it changes, search needs to change with it. Over time search looks less and less like a search box on a web site. It looks much more like a service, almost like a platform that spans across any input modality from a gesture on your Xbox, to voice on your phone, to touch on a tablet device, to even implicit queries that you don’t even know necessarily are happening on your behalf.

Of course, the service has to be personally useful. We want to create something that takes into account who you are, who you know, what you do, all those types of things, and then focuses on delivering experiences that help turn those ideas of things you want to actions. To do this well, we have to do an amazing job of brokering resources from all across the web to enable new levels of functionality.

Continue Reading…

News Revenue Optimization Podcast with Dennis Mortensen

photo of Dennis Mortensen

Full Podcast Transcript

Continue Reading…

Cool New Quality Score Metrics from AdCenter

photo of Ping Jen

Briefing with Ping Jen

Ping Jen and I connected for a call last week and reviewed some of the current developments with Microsoft adCenter. Today’s post will review the main items we talked about and what they mean for adCenter advertisers.

New Quality Score Data Provided

1. Historic Quality Score History: adCenter now allows you to monitor the Quality Score of a keyword over time. One reason this is important is that the most common question that the adCenter team gets is: “What does it mean if we see our Quality Score drop on keywords when we have not made any changes recently in that campaign?”

Great question! What it means is that your competition has been doing optimization work that is causing their click through rate to go up. As a result, your Quality Score is dropping because your CTR no longer compares as well to theirs as it did before.

Historical Quality Score (HQS) allows you to see the trends on a keyword by keyword basis over time. This can provide some great insights into marketplace dynamics. It can also help you understand what keywords the marketplace sees as the most important.

To see HQS you need to request a report. You will need to request a keyword report in daily mode as this is the only:

Creating a Historical Quality Score Report

Continue Reading…

How Google Does Personalization with Jack Menzel

photo of Jack Menzel

Key Points

One of the hot areas in search is personalization. Google recognizes that personalization is a way to offer people better search results. How this works has a big impact on SEO, and I had the opportunity arise to speak with Jack Menzel and jumped at it. Here are some of the key points from the discussion:

  1. People confuse context with personalization, and these are different things. Context includes factors such as language, location, and time of year.
  2. (Jack:) “A lot of people assume personalization is amazingly pervasive”. In fact only small changes are made to a results page based on personalization. Google recognizes for diverse query results.
  3. Past query history is used for personalization. If you search for “rome”, and then “hotels”, some of the results will be for hotels in Rome.
  4. Past click through history is a factor. If you show a clear preference for one site by clicking on it in the results, then it may be moved up in the results for you.
  5. The recommendations of friends are used in personalization.
  6. Google will look at your friend’s profile to see what networks they have included there, and then see what they recommend on those sites.
  7. (Jack): “When people are signed out, their search results are personalized based on past search information linked to their browser for up to 180 days using an anonymous cookie”.
  8. Appending &pws=0 to the end of a URL does work, but it only removes personalization, it does not remove context (language, location, time of year).
  9. There are ways to turn off all personalized results. Google’s position is that user’s own their data. However, context will still be taken into account.

Interview Transcript

Eric Enge: Sometimes people confuse the notion of context with personalization, right?

If I respond to your query in your language that is really about context, not personalization.

Jack Menzel: That’s right. Sometimes results that are really a result of context get misinterpreted by people as personalization. If I respond to your query in your language that is really about context, not personalization. Personalization is more about recognizing that I like Dominion the card game and you really like Dominion the power company, and someone else really likes a videogame called Dominion. Imagine you turned off personalization, and suddenly Google was responding to all of your queries in the wrong language, you would be like “oh come on”.

Eric Enge: Another example would be that you are in the US and Halloween is in the near future.

Jack Menzel: Correct, right before thanksgiving there are a lot of searches about turkeys, and it often means people want turkey recipes.

Eric Enge: What are some of the other kinds of things that fit into the definition of context?

Jack Menzel: Let’s use a conversation based example. If we are both in Mountain View and I am talking to you about catching a bus, I don’t have to remind you that I am talking about bus in Mountain View, as opposed to one in Austin, Texas.

We take into account geography, language, and seasonality to a certain extent.

We take into account geography, language, and seasonality to a certain extent. The context of the previous queries is kind of on the borderline of what is personal and what isn’t.

Eric Enge: For example, if a person’s previous query was “Rome”, and then they search on “hotel”, there is going to be a tendency to show hotels in Rome.

Search results 3 to 5 for “hotels” when the prior search was for “rome”

Continue Reading…

Search Algorithms with Google Director of Research Peter Norvig

photo of Peter Norvig

Introduction

As you will see in the transcript below, this discussion focused on the use of artificial intelligence algorithms in search. Peter outlines for us the approach used by Google on a number of interesting search problems, and how they view search problems in general. This is fascinating reading for those of you who want to get a deeper understanding of how search is evolving and the technological approaches that are driving it. The types of things that are detailed in this interview include:

  1. The basic approach used to build Google Translate
  2. The process Google uses to test and implement algorithm updates
  3. How voice driven search works
  4. The methodology being used for image recognition
  5. How Google views speed in search
  6. How Google views the goals of search overall

Some of the particularly interesting tidbits include:

  1. Teaching automated translation systems vocabularly and grammar rules is not a viable approach. There are too many exceptions, and language changes and evolved rapidly. Google Translate uses a data driven approach of finding millions of real world translations on the web and learning from them.
  2. Chrome will auto translate foreign language websites for you on the fly (if you want it to).
  3. Google tests tens of thousands of algorithm changes per year, and make one to two actual changes every day
  4. Test is layered, starting with a panel of users comparing current and proposed results, perhaps a spin through the usability lab at Google, and finally with a live test with a small subset of actual Google users.
  5. Google Voice Search relies on 230 billion real world search queries to learn all the different ways that people articulate given words. So people no longer need to train their speech recognition for their own voice, as Google has enough real world examples to make that step unecessary.
  6. Google Image search allows you to drag and drop images onto the search box, and it will try to figure out what it is for you. I show a screen shot of an example of this for you below. I LOVE that feature!
  7. Google is obsessed with speed. As Peter says “you want the answer before you’re done thinking of the question”. Expressed from a productivity perspective, if you don’t have the answer that soon your flow of thought will be interrupted.

Interview Transcript

Eric Enge: Can you outline at a layman’s level the basic approach that was used to allow Google engineers a translation system that handles 58 languages?

Peter Norvig: Sure — Google Translate uses a data-driven, machine learning approach to do automatic translation between languages. We learn from human examples of translation.

Google Translate

Continue Reading…

Starting Up with Google Product Search, with Google’s Mayuresh Saoji

photo of Mayuresh Saoji

Key Points

Google product search offers a rich array of opportunities for publishers to place their products in front of shoppers (there is a bulleted list of the opportunities right at the start of the interview). Mayuresh does a great job of spelling out the way to get started with Google Commerce in this interview. If you sell physical products this interview can act as a guide on how to get started and how to prioritize your efforts from an optimization perspective. Here are the key points:

  1. You must sell physical products online to participate.
  2. One opportunity is to place Google Commerce Search on your site. This provides visitors a way to search your product catalog using Google’s search technology. It is a paid product.
  3. The first step is to create a Merchant Center account.
  4. The second step is to verify that you are the owner of the website.
  5. The next step is to provide a data feed of all your products.
  6. Implement a test feed before going live, as this will allow you to find and remove errors upfront.
  7. The most important optimization step is good quality data. This is worth a lot of effort, as Google will lose faith in feeds that show errors.
  8. Make absolutely sure that the pricing data is accurate.
  9. Plan on having a ISBN code, UPC code, or EAN code (Europe) for all your products.
  10. Have images for all of your products. (Mayuresh): “it’s to your benfit to send uys good images for every product”.
  11. Update your feed (Mayruesh): “at least as often as your website is updated”.
  12. The Content API is useful for large feeds where it may be desirable to make partial updates (e.g. change only the price for 200 products). However, you need programming expertise to use it.
  13. (Mayuresh): “Product reviews are important, and they provide a good signal to users about products”.

Interview transcript

Eric Enge: What are the benefits of participating in product search?

Mayuresh Saoji: Any merchant that sells physical products online is a good candidate for participating in Google product search. Participating in product search provides you with a forum for sending structured data on your products to Google. It allows merchants to show more rich data in many formats:

  • On Google.com
  • Google Shopping
  • Google Product Search
  • Product Ads and Product Extensions
  • Google Shopper in Mobile Search

If they are Google Commerce Search customers, which is a paid product, then that same data is leveraged to power the search and discovery experience on their e-commerce website or mobile application.

The end goal is to drive a lot of qualified traffic to publishers, and that’s the best reason for doing this.

Eric Enge: Basically, it is like a Custom Search Engine, but for products?

Google Commerce Search (GCS) is an e-commerce search solution designed specifically with online and multi-channel retailers in mind.

Mayuresh Saoji: It has some general similarities, but Google Commerce Search (GCS) is an e-commerce search solution designed specifically with online and multi-channel retailers in mind. GCS has several advanced features besides product recommendations to help retailers improve their conversion rates.

Eric Enge: Great, what’s the best way for someone to get started?

Mayuresh Saoji: First you create a Merchant Center account. This is where you tell us about your business, your store, and provide us with your URL. The second step is to verify that you are the owner of your website. This is still part of the signup flow, and once that’s done then now you have a valid Merchant Center account. That’s one part of the story.

The other part of the story is to start submitting your data to us. Google has published a product feed specification, and you need to adhere to that specification, and then you can submit data in one of a number of formats to us. You can submit it as a tab delimited (TSV) file, a flat file, XML file, or via the Content API. Many of our larger retailers use the Content API, and that allows them to easily submit hundreds of thousands of items (and much more), and also makes it easy to make very quick changes to specific attributes of those items.

Google Commerce TSV file

Continue Reading…