Daily Archives: September 16, 2005

I’m not going to get all scientific about the demographics, but here’s a brief overview:

- None of the respondents have ever worked in the search industry.
- Most respondents are in their early to mid 30s.
- All respondents were college educated.
- 47% of the respondents have advanced degrees.
- 59% of the respondents live in the San Francisco Bay Area.

Oh, and I sent the survey to about 30 people, and received 18 responses to my 3 survey questions.

UPDATE: I now have 20 responses.

Question #1: When you need to conduct a search, what are the most important factors for you in determining which search engine to use?

Relevancy was not really that big of a stated factor in the responses to this question. Only one respondent specifically used the word relevancy, and it was only one of the factors. Here’s their answer: “Accessibility, ease of use, and relevancy.”

Although this other response doesn’t specifically use the word relevancy, the unspoken meaning is relevancy:
“It is important that the results really reflect the issues I am looking for and do not come up with all kinds of results that just mention the key words as a side matter…”

One other response was specific in terms of the type of information being sought: “If I am searching for a particular item, like a product web site, movie trailer, or phone number, I value conveninece and accuracy.”

I think the main issue here is that perceived relevance is what’s important to a lot of users. They don’t spend much time or thought exploring various search engines beyond what they already know, and so the answers to this question were generally vague. There just really are not many factors that go into most people’s decision making process on this topc. Most people don’t decide to use a particular engine for a particular type of query. They just stick with the engine they know.

Question #1: When you need to conduct a search, what are the most important factors for you in determining which search engine to use?

I purposely didn’t ask for the names of search engines that people use, yet I found out the following:

6 people only use Google.
6 different people use Yahoo and/or Google.
2 people sometimes use Dogpile.
6 people did not mention a particular engine.

A lot of people didn’t really have a reason for why they use Google, for example:
“I have no technical criteria - I use google for one-stop shopping. Brand familiarity and nothing more.”
“I go to Google. I do not consider factors.”
“Uh, no real determinants, as I always use Google.”
“Honestly, I only use Google, and not for any particular factor, except that I simply don’t have time to compare
different search engines, so I go with the default.”

One of the Dogpile users gave this insightful response:
“…If, however, I’m not looking for a specific item, and instead am trying to conduct research, I often won’t know what it is I’m looking for until I’ve found it. For these types of searches I value search engines like dogpile.com that often provide less focused searches, but that often turn up some overlooked gems.”

One respondent, who did not mention any engine names, put this very telling line: “Whatever is on my screen.”

I decided it would be interesting to ask my friends who don’t work in the search engine industry for their opinions about search, so I sent out the following email:

I’m putting together a qualitative and non-scientific survey. If you have a few minutes I’d appreciate your input. I plan to write up the findings for the Search Lounge. All references to comments will be anonymous.

(Note that I have purposefully left the questions open-ended to allow for personal interpretation.)

1. When you need to conduct a search, what are the most important factors for you in determining which search engine to use?

2. If you do a search and are not satisfied with the results, what’s your next step?

3. What can search engines could do better?

UPDATE: To read the results of the survey, check out the The Search Survey category.