Slashdot Mirror
Putting Google to the Test
Big Nothing writes "Google has built its reputation on being the fastest and most accurate way to find information. But is the internet really the quickest way to access facts - and get them right? The Guardian puts Google to the test against more old-fashioned methods."
To win radio trivia call in contests a few years ago. Using Google to answer trivia just like in Ghost World.
Great comparison but they don't take into account how long it takes to get to the library, phone charges, etc. For me, 15 minutes on Google is faster than 30 seconds at the library.
Instead of comparing them against each other, its more important to use both internet based as well as "old fashioned" resources together. Its important to realize that hard backed enyyclopedias are better than google and wikipedia for some things, and not for others. The younger generation needs to learn how to recognize what source to use, instead of automatically going to google. The internet should not replace old fashioned resources but merely embrace them.
the byproduct of years of oppression by the white man
That none of the questions included something likey what is the maximum sustainable speed in Mb/s of the alcatel 8100 series router
Thats the stuff where Google with kick everyones trash, not complete list of authorships
He didn't count the time it took for him to leave his office and drive to the library. So add another 20 minutes to all of the library times.
This article assumes that the person looking for information already knows other means of finding information. I didn't know about the Who's Who book and even if I did, I might not have one handy. I think these results are a little less than accurate for most people. Also, the author directly phones some people. What if I don't know exactly who to phone? I think Google will win in that case.
... is YES. Books on, say, Napoleon, you can find in a library. But ever tried to find, say, ten pages, or even a paragraph, about Napoleon? Especially in a 1200+ page book, or several? Ever tried looking something up in a card catalog? Or finding one sentence in a huge book? The answer to the question in the article is a definite YES.
The comparison dosent seem to be so much as google / other means - its more of an Online V/s Offline means to search for specific stuff.
I think its wrong to brand Google as the only means to look for information online.
Secondly, the issues that the reviewer raises are also adhoc - they cant be used to generalise the entire deal / spectrum of infomation that people need / want / desire.
Try looking for a code sample that shows you how the GTK# can be used from Mono to display a Multi level Outline filelist. What are the options that you have for this in the Non - Online world ?
The guy already knew who to ask / who to talk to - what if you dont know that - what then ? how do you go about finding the best non-online resource to speak with / enquire from ? My guess is that you are going to be heading right back online.
What about the fact that the online resources / google are avilable to you when you want it - how you want it and where you want it. Ever looked up what a word from the bible meant in the middle of sunday mass at the local church using a Wap phone over gprs at wml.google.com ? Me neither....
I bet those who he/she called, immediatly fired up google to find the answer ;)
After reading the article, I feel there is a slight bias in favour of the libraries when looking at the questions. Of course a library has a master index of books of one author. Or - to find out about some very specific question about an event you immediately know what kind of journals to look in.
The only question really geared for search engines was the Thatcher quote (as that would be a full text search).
Would this be the time to create a true categorisation of questions to be used in comparisons? (Note - not the ACTUAL questions, so that search engines could optimise for them, but only specify the general direction of questions).
I admit, it would be pretty hard to do, but I guess it could be worth the effort...
Had you even bothered to read the article (Duh, this is slashdot, what am I thinking).
You'd notice this was the whole test.
We asked various "pub quiz" type questions and then comapres the speed of response of various methods of finding the answers, such as telephone, library and of course google.
Then again I wouldn't have needed to write this post if you'd bothered to read the article.
The article report compare between Google, Phone and Library.
I think this is a biase comparison.
In the phone and library search, it is assumed upon a narrowed subject or particular topic. Where the searcher knows where to look for the _authorative_ answer, for example the title of the particular book to get the answer.
Overall, I think the winner is pretty inconclusive, but it still does shows that Google is a really good search engine - where you can actually find a reasonable result.
Hey, that's my password you are typing
The methods all have their uses. I don't use google find old classical music scores, but I don't use the library to find recent news stories, software, and such. There's a use for all these things, and it's important to preserve it all.
:-)
There's nothing that beats human interaction and direct knowledge in many cases, but people are not there all the time. If I had them right at me, I wouldn't need google. Google (and the library) is a compilation of what a bunch of people once knew, worked on, built further on, et cetera. Now, since it's impossible to reach these people, we wrote books. Books that we can read, to learn what people found out. That has it's value. Now, we can find the book, read about it, even read it, using google, or we could find other information rapidly that the library won't have for a long time - at least not before the next day's newspaper.
After all, the library might even have their search engine against a GoogleServer in the back room
Final point: Cherish all sources of knowledge, and use them appropriately. That will give you the best results.
This could be because no-where in the top page source does Google ever have the word 'engine'.
I'm a researcher with Google Answers and it's never a must that we use Google to answer questions that come in. Actually, for one-off's and questions which I know can be answered with a phone call or two, I won't even bother with the internet. Of course, then again, there was that one time I called over a hundred different restaurants to see who was serving on Christmas Day. Hah.
-Christopher Wu
http://www.christopherwu.net/
Question 3: Who is the vice chairman of the all-party parliamentary group on back care?
Google - 6min 27sec (3rd)
Quote: "Unfortunately, "back" is rather a common word, and is turning up in all sorts of irrelevant documents..."
Entering "back care" in quotation marks got me the answer in 25 seconds, much less than either of the "offline" sources. If they're going to have an accurate test, at least make sure the person performing it knows how to use a search engine.
Or maybe I'm wrong; maybe most people don't have these basic searching skills, in which case the test is accurate after all?
-- If no truths are spoken then no lies can hide --
I would think it would take 5 mins just to find the phone number to the library, get some one to answer the phone and then explain the question, PLUS have them search for answer. This also would all depend on the library you call. Google is google no matter where you live, but not every library is staffed when the same people.
I've often said that I'd have to quit programming if Google ever disappeared. I lean on it for information in the same way that excessively using a calulator will lead you to punching in 1 + 1. In fact, I'm so good at it that people sometimes think I'm a genius problem solver, when really it's just a matter of creative googling on an error message.
The meek shall inherit the earth, in 3 by 6 plots. - Lazerus Long
it's interesting that your 'library searches' seemed to take only a minute or two to perform. You didn't bother counting the time it took to actually go to the library and find the relevant book, then?
I'm a Google Researcher. Generally most Researchers use the Internet or their own knowledge as their primary resource when answering questions. This is because most questions have a low fee and can be given answers which are merely pointers to further resources. Researchers are also encouraged to give the methods they used in their answer, to help the person who asked the question.
However, there have been quite a number of extraordinary cases where people have been so interested in answering the question that they've made phone calls, chased people, and dug out answers to incredibly complex questions. In one case, a Researcher managed to track down someone's obscure pre-20th C. German heritage.
Do remember that Google Answers is primarily for people who don't have excellent research skills of their own. While easy to use, finding certain things with Google (and other engines) requires skill, time, intelligence, and abstract thinking faculties that many people lack. Also bear in mind that most Google Researchers don't do it for the money. You will inevitably get a far higher quality (and longer) answer than you could possibly expect for the money. This is why tips are given to Researchers so often on the system.
I found the answer to the question 3 in about 30 seconds, well under the 6m 27s quoted by their researcher. It's clear from their comments about irrelevant pages that they hadn't enclosed 'back' in quotes to form "back pain", as '"back care" parliamentary group' puts the result on the third link (from google.co.uk). Also, it doesn't seem very fair to compare a researcher who doesn't think to use quotes round that expression with a librarian who knows to look "on page 242 of the excellent Vacher's Quarterly", a publication with which I (and most of the public, I would imagine) have no familiarity whatsoever.
Google knows nothing, except where words are placed.
But really, that test does not consider the fact that it takes a while to go to the library and that you actually need to get out of your house. Plus, library isn't available at night, neither is most people you can try to call.
Google sure wins any convenience test.
Qui ne va pas à la chasse n'a pas de gibier
PHP Queb
They have done in the past for legal reasons. They do not do so for editorial reasons. For instance:
(From google.com/explanation).
No, that is just one possibility. A far likelier reason would be that you don't know the Google ranking algorithm and so haven't taken into account important details.
So you're telling me that the first library test which took 20 seconds, involved looking in a card index, fetching the book and looking it up? Or did he have the relevant book in front of him already? - That strikes me a bit as cheating, otherwise I'd say it would take longer than 20 seconds just getting the book and opening it.
My <1000 UID is with a hot chick
Google has some other advantages that phoning and the Library don't have:
1. Google is pretty much 'always on'. I can do a Google search any time of day where as I can't use the phone or the library at 3 am.
2. The ability to Find a keyword. Usually when I use a google search I use the google cache. This highlights the terms I am looking for so I can find them easily on the page. This is an inherent advantage of the computer over people or your eyes - scanning through text looking for what you really want.
humble and proud of it.
How about a meaningful comparison of electronic data retrieval services?
Compare Google to Lexis-Nexis.
Lexis-Nexis has boolean logic driven search (not natural language), and lacks "PageRank", but it includes all sorts of major periodicals not offered and certainly not archived on the web.
Lexis-Nexis would win hands down in all sorts of categories of questions.
It's an object lesson in the impact of intellectual property laws on access to information in our societies.
Ricochet was around $70 amonth, but at 20-60 bucks a week it more than paid for itself. Best thing, there were no rules that said you couldn't access the internet. People were amazed at my trivia knowledge.
Question 3: Who is the vice chairman of the all-party parliamentary group on back care?
A google search for:
"vice chairman" all-party parliamentary group "back care"
resulted in *exactly one* hit, a pdf document listing all parliamentary groups. A click on View As HTML, a find on "back care" and Voila, the answer took about 30 seconds to get.
An experienced googler can find things faster than they did. This particular case was just a matter of knowing the difference between words and phrases and putting quotes in the right place. But there are many other tricks (such as negation and using 'site:') that their google searches could have benefited from.
bp
Who cares if you don't know where to look for a piece of information? The reference librarian does. In larger libraries, there are usually librarians who specialize in particular fields of research. My university's library, for instance, has at least one research librarian assigned to each college or school within the university-- all degreed, and many dual-degreed in library science and their respective specialty fields. And they don't care in the least who is asking them for help-- it's not like the CS librarian will only talk to CS students.
Google is convenient, and fast for most searches, but there's a lot of information that just isn't available to it. Libraries buy access to that information, both in print and in databases, and they hire people to help you find the stuff you need.
The most important library skill, and the one that is most often overlooked, is recognizing the reference desk and asking for help.