Category Archives: Search Survey

Question #3, Part 5 – Phrase Matching and Blog Searching

What can search engines could do better?

One person responded:

    * …I’ll do a search and get results with just one of the key words in it…e.g. if I did a search on Tamil Tigers, I would probably get results with just the word Tigers, which I’m not at all interested in.

    Comments: partial phrase matching is indeed an issue with search engines. Quoting searches can help with this, but can also overly limit the result set. Proximity can be a problem, as in pages that mention Tamil and Tigers, but they don’t mention them connected as a phrase (probably unlikely for this example, but you get the point). Phrase matching is really the key to relevancy. For most one-word queries it’s either easy enough to assume what the user is searching for (eBay), or ambiguous enough (jaguar) that a breadth of results is appropriate. But with a multi-term query you get into the world of concept matching, as in when a web site defines an entity as Navy Blue Shirt, but the searcher searches for Dark Blue Shirt.

    But maybe the bigger challenge is the challenge of “small mentions”. These days, with a two-word query like Tamil Tigers I think most results will match on both terms. However, what about pages that make only a passing reference to the term?

Another respondent wrote:

    * Update blog searches quicker.

    Comments: most blog search engines are near real-time right now, though I guess “near” is not real-time. I notice a lag sometimes between when I publish a posting on the Search Lounge and when it gets pushed to my RSS feeds.

Question #3, Part 3 – Official Sites and Language Settings

What can search engines could do better?

**Official Sites**

The respondent wrote:

    *Always list the official site first. (So if I do a search for Nabisco I want listed first, not several articles about Nabisco).

    Comments: A few years ago search engines weren’t very good at always getting the official page in the first position, but now they generally are. But what if users click more often on the non-official page because the official page isn’t the best source?

**Language Settings**

The respondent wrote:

    * Ask me for the languages I am able to comprehend since links that are mostly written in Czech, Chinese or Icelandic do not really help me.

    Comments: most engines do let users set this preference, but it’s definitely not foolproof. Results in other languages still show up often enough to be noticeable.

Question #3, Part 2 – Tips and How-Tos

What can search engines could do better?

A few people wrote they want search engines to explain more about how they work. Although I understand this sentiment, do people really want that?. What I’m thinking they want is to get better results; and if they’re not getting good results they think maybe they’re doing something wrong, but they don’t know what. So rather than search engines going into the minute details of ranking algorithms and so forth, when users don’t get good search results the engines should step in and offer ways to improve their search.

But I think this issue addresses a serious topic. Namely, search engines are really complex systems, but people want to be able to enter a couple of words in the search box and get exactly what they want. How do search engines balance on the tight line between sharing information on how search works, while not overwhelming people with too much info?

Here are some of the responses on this topic:

    *Offer more tips on searching.
    *…providing me with a better understanding of how they [search engines] use the inputs to conduct a search would help. This info is no doubt already available, but I’m usually in convenience mode when doing searches and unless this info is up front, I usually won’t take the time to go searching for it.
    * What I wish there was more (maybe there already is and i don’t know how to find it) is a “how to…” search engine. In my case, for arts and crafts, but it could be for anything else.
    *Provide more intuitive search refinements than boolean language, such as dropdown menus and check boxes with refinements explained in common English.

Question #3, Part 1 – Providing Answers on Search Results Page

What can search engines could do better?

I got 12 real responses to this question, which is more than I expected since it’s a tough question.
I’m going to break out the answers into separate, small posts, starting with…

    *Add direct reference data. e.g. “when is labor day?” pulls up result: “September 5, 2005″ .

    I love it when the SERP answers my question and I don’t have to click through to the page! Like the way Brainboost does it. Engines are experimenting more and more with this concept, like Instant Search.

Question #2, Part 2 – Using Another Engine

When you do a search and are not satisfied with the results, what’s your next step?

8 out of 21 respondents said they try their searches on another engine when they don’t find what they want. But only 2 said that’s the only thing they do. Most people said they reformulate their query first, and then as a last resort go to another engine.

Here’s some examples:

    *Alter the wording then use a different engine.
    *Put different or varying words in search field (I rarely use a different search engine).
    * Fine-tuning the query. I usually don’t go to another search engine until I’ve exhausted a number of possible key search words.

One respondent explained how, after unsuccessfully issuing a search on a search engine, they go directly to expert sites and look around for links to the sought-after information.

Another person said if he doesn’t find what he wants using a search engine that he’ll use a professional database (imagine that!).

It’s good that people reformulate their queries. But I’m curious to know what strategies people use other than quoting the search terms, or if they just keep hacking away hoping to find the magic keyword combination.

As to the people who don’t use other engines, or only use them as a last resort, that’s troubling. If I go to a video store and they don’t have a DVD I’m looking for, I don’t stop my search and assume it doesn’t exist. I’ll go to another store to find it. Or a book in a bookstore, or a shirt in a clothing store, etc. The same holds true for search engines.

Post Navigation