RSS

Can ChaCha's Humans Compete with Google's Algorithms?

By: Chris DannenMon Jun 16, 2008 at 11:40 AM
Scott A. Jones

Scott A. Jones
Scott A. Jones talks about the human-guided search engine, competition from other sites, and how ChaCha embraces a Wikipedia-esque structure.

Related Content


In 2006, Scott A. Jones co-founded ChaCha.com, a search engine that uses human guides to answer queries. Now they're expanding to the mobile space, allowing users to call or text their nuanced questions in plain English, and receive succinct answers in minutes. But with the amount of data on the Web growing exponentially, are human beings really the best tools for trolling it all? FastCompany.com sat down with Jones, also the co-founder of Gracenote and a voicemail pioneer, to talk about the future of mobile search, the irreplaceable nature of human intelligence, and why he doesn't fear Google.

The amount of data online is growing, but more and more people are trying to access it on small-screen mobile devices. How will that alter the way search is performed?

Well, in order for search to be effective on phones, we're going to have to dig through more data, but the results will also need to get more and more specific. Other companies like Google, Yahoo, and Ask are struggling to do that -- to come up with deep, rich, succinct content from their searches. They're having problems, because it's not like algorithmic searches are always going to give you a relevant result as the first, second, or third thing on the page.

What's so bad about having the user do her own filtering?

I think that in many situations, having human mediation is key. Especially when the mediation is from people who know something about whatever you're asking - sports, entertainment, medicine - because they can sort through search results at their desktop, and get you back succinct answers very quickly at moments when you need them most. Those are what I call the "peak demand" moments. Right now, when you need something on the run, you don't want to mess with your smart phone's browser. So what do you do? You call or text your friends, so they can point you in the right direction. That behavior is already there, so it's my gut feeling that because of the way technology is trending, humans need to be in this loop for a while.

So Cha-Cha is actually better suited for mobile phones than for computers?

We knew that it would be better for phones from the beginning, but we knew we had to build out our backend first. Twenty years ago I was working on voicemail technology, and I had science fiction ideas about the future of phones: that, for example, there would be a small phone in my ear that could access The Library of Congress - this was before the Internet -- and also have access to practical information, like the best restaurant in town, and even which waitress to ask for while there. That's the idea behind ChaCha.

What about searching outside of the "peak demand" moment? Why do we still need human mediation in those searches?

Before giving a speech at the National Academy of Sciences a few years ago, I was on Google, Yahoo and Wikipedia, searching for information on what new technology was coming out, trying to prepare what I would say. I called my friends at Sequoia, my CTO, my other friends, and they'd always give me answers that sent me back to the Web. That was the "aha!" moment: What if I could do that across all topics? That would be a hugely powerful thing. I was still thinking of this in terms of mobile phones, but we started at the desktop version first to figure out the taxonomy of managing our guides. In fact, most of our 25 patents are about managing the human army of guides, not about spiders or indexing.

Do you really have thousands of people out there waiting to respond to my search query?

We've had 40,000 guides -- maybe 50,000 -- come through our system, and they come from all walks of life. Some are college students, some are work-at-home moms, retired librarians, people who like Jeopardy, people who like working on Wikipedia. Some people do it for the money, others do it to help the online community, and some do it to learn more about a topic they're interested in. To become a guide, there are some basic requirements, and they have to take a test online. They login online to take the tests, which take a few hours, and within a day they can be online and active.

You've announced that soon these guides will be able to accept not only SMS queries, but voice queries as well. In a world where most voice-activated systems are mediocre at best, is voice-powered search really viable?

June 2008

Sign in or register to comment.
or

Recent Comments | 5 Total

June 16, 2008 at 4:52pm by Matt Lee

I love the idea of human-powered search, and see it as the only current way to ensure the finding of trustable information online – both for business and personal use. It’s fairly easy for SEO firms to game algorithms, and while it’s a worst case scenario, sometimes marketing pushes corporate agendas over reliable information. Shocking, I know.
A recent IWR article discusses what Tim Berners-Lee sees as the discrediting of online information (http://www.iwr.co.uk/information-world-review/news/2217786/misinformatio...). Human-powered search might alleviate this, but is it scalable? With 65 billion questions being answered with online information per year (http://interconnectionsreport.org/reports/ConclusionsSummaryFinalB.pdf) that’s a lot of retired librarians to employ…

June 18, 2008 at 9:22pm by Shashank Tripathi

The mobile aspect works only in the US?

July 17, 2008 at 1:31am by Lynne M.

I jut signed up to be a guide today. I passed the three of four tests so far, and waiting for the fourth one to work so I can take it. So far, I'm semi-impressed from the guide aspect. There's a lot of stress on doing good it seems, and I guess that I can understand that with it being a paid position. However, I am unimpressed with the server issues, the fact that if you experience a server issue while attempting to take a test to become a full fledge Guide, well .. you're S.O.L. because they refuse to allow you retake of the test. Today I was going to attempt my Simulated test to get in the sore, and as fate would have it, I was disconnected repeatedly any time I tried to use the guide end of the service. I wasn't alone in this. Other Guides were having the same issues, but worse were the guides-in-training who were taking the simulated test and got booted out in the middle of it. That counts against them. Poor system in my opinion, but I'm willing to stick it out and see how they improve.

August 1, 2008 at 12:28pm by April Pruitt

I have been a guide for a little over a month. There's no way that the human guides can keep up with Google because we are "limited" on our sources, here is an excerpt from my last "quality control email": "Additionally, avoid websites such as Wikipedia, Yahoo Answers, forums and other websites that include user contribution as their base of information. Google should only be used to provide answers on maps/directions, weather, movie listings, and conversions or calculations."
We are also instructed to endure offensive requests and answer questions we are uncomfortable with. The example that ChaCha uses in their training information is "How do I kill a baby?" They consider this to be offensive but not abusive. I have asked ChaCha about the legalities of answering these questions but they have not answered. I also get a lot of questions on how to do illegal drugs, I have no way of knowing who is on the other end of the line but I am expected to answer. We are also expected to find information about people such as "Where does Jane Doe live?" I have no idea if the person they are looking for is a minor or someone's child yet we are expected to answer. (I don't by the way) I think that ChaCha is opening itself for a big lawsuit, its just a ticking time bomb.