RSS

Can ChaCha's Humans Compete with Google's Algorithms?

By: Chris DannenMon Jun 16, 2008 at 11:40 AM
Scott A. Jones

Scott A. Jones
Scott A. Jones talks about the human-guided search engine, competition from other sites, and how ChaCha embraces a Wikipedia-esque structure.

Related Content


There are actually multiple layers of problems you'd have to solve to make voice-powered search work: the first is speech recognition. Even the most advanced speech recognition software in the world requires correction of every fourth or fifth word. Sure, you can do some special tricks, give the system a limited vocabulary -- but if you try to do a generalized search it just doesn't work. The second layer of problems involves natural language recognition. Even if your system can understand the words you're saying, it won't necessarily get the syntax; now the question becomes, "What's actually being said?" The final piece of the problem is the algorithmic issue: We need to get to a place where we're coming up with half a page of results instead of two million. The algorithmic problem is far from being solved, and the big guys don't really know how to do it any better than they're doing it now.

Of course, the easiest way to solve problems one and two is to take them out of the equation completely -- and we do that by using people. We have a bunch of different types of guides; if you call in to ChaCha, you get sent to a transcriber, who transcribes what you've asked and sends it to an ambassador guide. That ambassador triages that query, checks if the question has been asked before, and if it hasn't, sends it off to a specialist, generalist, or expert. The ambassador tees up the question that way, as if it's a game of volleyball -- pitching this query around, and trying to get the best answer for you. And it all happens in a couple of minutes.

So the ambassador can access a database of previously asked questions? Do you hope that eventually the top questions will fill your database and make your guides' responses faster?

As the databases of questions grow, those databases will definitely assist our guides with finding answers more rapidly. On the backside, we have a mechanism that enables expert guides to go through various answers to one question and decide which are best -- those "best" answers will appear higher in their results. That's actually better than simple crowd wisdom because the best answer is picked by an expert.

Sounds like you must like the idea behind Mahalo, then?

There are lots of ways to apply people to search, and Mahalo is going for the short tail of queries - the most common ones. That's a good direction, if Google lets them get there. Who knows, maybe Mahalo is a place that we ought to be sending people to with some of our reference links. Maybe there's a partnership brewing. I view most of the other guys as potential partners.

Does that mean you don't fear Google?

They do some things really well. Take Google Mobile: It's good for simple questions like sports and weather; even if it can't give you much depth in its answers, it's very fast. I actually think there's an opportunity to partner with, or be on the shoulders of, the other big search engines. The founders of Google fundamentally believe in using algorithms over people, so we don't really compete with them ideologically.

How will ChaCha draw revenue? Can you do targeted advertising via SMS and not annoy your users?

I don't know that our users would see targeted SMS advertising as benign, and right now I'm experimenting with different payloads for delivering ads. I'm not happy with them yet. There are several places to put that extra ad message - in a separate text message, at the end of your answer, or on the page you access with the reference link you get at the end of your text. We will choose the method that is least offensive.

Our best idea for a solution is to send out ads so targeted and local that they'll be viewed as a positive part of the search result. To do that, we intend to leverage our human knowledge at choosing ads as well.

June 2008

Sign in or register to comment.
or

Recent Comments | 5 Total

June 16, 2008 at 4:52pm by Matt Lee

I love the idea of human-powered search, and see it as the only current way to ensure the finding of trustable information online – both for business and personal use. It’s fairly easy for SEO firms to game algorithms, and while it’s a worst case scenario, sometimes marketing pushes corporate agendas over reliable information. Shocking, I know.
A recent IWR article discusses what Tim Berners-Lee sees as the discrediting of online information (http://www.iwr.co.uk/information-world-review/news/2217786/misinformatio...). Human-powered search might alleviate this, but is it scalable? With 65 billion questions being answered with online information per year (http://interconnectionsreport.org/reports/ConclusionsSummaryFinalB.pdf) that’s a lot of retired librarians to employ…

June 18, 2008 at 9:22pm by Shashank Tripathi

The mobile aspect works only in the US?

July 17, 2008 at 1:31am by Lynne M.

I jut signed up to be a guide today. I passed the three of four tests so far, and waiting for the fourth one to work so I can take it. So far, I'm semi-impressed from the guide aspect. There's a lot of stress on doing good it seems, and I guess that I can understand that with it being a paid position. However, I am unimpressed with the server issues, the fact that if you experience a server issue while attempting to take a test to become a full fledge Guide, well .. you're S.O.L. because they refuse to allow you retake of the test. Today I was going to attempt my Simulated test to get in the sore, and as fate would have it, I was disconnected repeatedly any time I tried to use the guide end of the service. I wasn't alone in this. Other Guides were having the same issues, but worse were the guides-in-training who were taking the simulated test and got booted out in the middle of it. That counts against them. Poor system in my opinion, but I'm willing to stick it out and see how they improve.

August 1, 2008 at 12:28pm by April Pruitt

I have been a guide for a little over a month. There's no way that the human guides can keep up with Google because we are "limited" on our sources, here is an excerpt from my last "quality control email": "Additionally, avoid websites such as Wikipedia, Yahoo Answers, forums and other websites that include user contribution as their base of information. Google should only be used to provide answers on maps/directions, weather, movie listings, and conversions or calculations."
We are also instructed to endure offensive requests and answer questions we are uncomfortable with. The example that ChaCha uses in their training information is "How do I kill a baby?" They consider this to be offensive but not abusive. I have asked ChaCha about the legalities of answering these questions but they have not answered. I also get a lot of questions on how to do illegal drugs, I have no way of knowing who is on the other end of the line but I am expected to answer. We are also expected to find information about people such as "Where does Jane Doe live?" I have no idea if the person they are looking for is a minor or someone's child yet we are expected to answer. (I don't by the way) I think that ChaCha is opening itself for a big lawsuit, its just a ticking time bomb.