Slashdot Mirror


Google Scholar: Not Ready for Prime Time?

reptilicus writes "The Thomson Gale publishing group has put together a comprehensive review of Google Scholar, and they find it highly lacking compared with similar offerings from Highwire Press, Scopus, and The Web of Science. Will Google's overhyped offerings drive these superior services out of the market?"

49 of 231 comments (clear)

  1. overhyped? by brickballs · · Score: 2, Insightful

    overhyped

    overhyped? I dont recall ever hearing of it. of course I havn't heard of the others either..

    --
    "What does slashdotting mean?"
    "You've never heard of slashdot?"
    "I know it makes websites not work."
  2. beta by MankyD · · Score: 4, Funny

    But it's still in Beta! Google would never release a service without taking it out of Beta first, of course.

    --
    -dave
    http://millionnumbers.com/ - own the number of your dreams
    1. Re:beta by DrEldarion · · Score: 4, Insightful

      I'm under the impression that everything they release will be in perpetual beta in order to be able to dodge any issues using that as an excuse.

  3. C'mon, people... by gg3po · · Score: 2, Insightful

    ...isn't this still in alpha or beta stage? Give'em a break, already.

    --
    ---
    1. Re:C'mon, people... by Vobbo · · Score: 3, Informative

      Out of beta:

      Search
      Image Search
      Alerts
      Answers
      Directory
      Mobile

      Still in beta:

      Suggest
      Groups
      News
      Froogle
      Local
      Print
      Sc holar

      Catalogs

  4. Oh baby, YES! by Anonymous Coward · · Score: 2, Funny

    I can't get enough google articles. Give me more!

  5. OMG! by Anonymous Coward · · Score: 5, Funny

    An article critical of google! I think my transmission link from my brain to slashdot groupthink just fused.

  6. The answer is: No. by Shadow+Wrought · · Score: 4, Funny
    Will Google's overhyped offerings drive these superior services out of the market?

    Brought to you by Minimalist Posting Enterprises, Inc. All rights reserved.

    --
    If brevity is the soul of wit, then how does one explain Twitter?
  7. Just remember. by Neck_of_the_Woods · · Score: 4, Insightful

    Microsoft loved to put out something that was just good enough, but free to kill off everything else.

    --
    Neck_of_the_Woods
    #/usr/local/surf/glassy/overhead
  8. Google's advantage? by mister_llah · · Score: 5, Insightful

    At least for now...

    IT'S FREE!

    [looking at the other options, they are NOT free]

    ===

    I'd say in that regard, Google is way ahead...

    --
    MoM++ - A Classic Expanded - [Master of Magic 1.5]
    http://mompp.sourceforge.net/
    1. Re:Google's advantage? by Otter · · Score: 4, Informative
      HighWire is free, although the articles it links to may not be. (This is an advantage over Google, not a disadvantage.)

      The others are expensive curated services, and are hardly playing in the same league as the free services.

    2. Re:Google's advantage? by joeybagadonuts · · Score: 2, Funny

      The same can be said for Internet Explorer, 1995-present. Free, and no installation required! Or is Microsoft evaluated differently?

    3. Re:Google's advantage? by f97tosc · · Score: 2, Informative

      Most universities have web of science (which indeed is a better product). This means that most users (=scientists) have access to it anyway. Tor

    4. Re:Google's advantage? by Strontium-90 · · Score: 2, Interesting

      And, having used both Google Scholar and Web of Science, I can say that they're roughly equal in terms of quality. WoS is definitely not a great program. I've had situations where I was able to provide an author's exact name, the name of the journal, and a relatively narrow time period, and it was unable to find an article that I *knew* my school has access to. Of all of the various tools that I've used, none of them are really where they ought to be, and most of them are much more expensive than they should be, given the quality of the product.

  9. Utterly shocking by Otterley · · Score: 5, Insightful

    What? A company whose mission is to provide content and research services to academia gives a poor review to one of its up-and-coming competitors' offerings? Say it isn't so!

    1. Re:Utterly shocking by ScytheBlade1 · · Score: 4, Insightful

      While you have a definite point, I believe that there may be a tad bit more to it than you make it out to be.

      "whose mission is to provide content and research services to academia"

      Also from that same page:
      "with 2004 revenues from continuing operations of $8.10 billion"


      You think...that's it's possible...that this company is doing it RIGHT? That it's possible that they know what they're talking about?

      I'm not claiming to know the answer. I don't use either service, but after reading your post, the obvious jumped out...

      Of course they're an apparent competitor. I just have this feeling, though, that they may actually know what they're doing. It's possible that you're right, it's possible that you're wrong, it's just that I don't see evidence as to either for a post like yours to hit +5 Insightful (which it is) without some counter-balance to it.

      If their entire goal is to provide a similar service, and they've made $8.10 billion....something tells me that they're doing something right, which may actually give base to their claims.

    2. Re:Utterly shocking by anonicon · · Score: 2, Insightful

      Your point is made on the conflict of interest. But, if you read the review linked from the front page, it makes several key points about why Google's Scholar service is pretty poor. No structured XML/other output, no listed, covered research publications, no index- or directory-browsing options, no fuzzy logic operants for branch-defining a research institute's name wildcards, and much more.

      Yes, it's free, but given the time and productivity constraints that the professionals who will be using this are under, this is the classic case of being free only if your time is worth nothing. For casual or non-professional related searches, that's fine; for this field, it's a timehole.

      Of course, YMMV.

    3. Re:Utterly shocking by CheshireCatCO · · Score: 2, Insightful

      Microsoft (to trot out the obvious and tired example) makes a killing in the software market, but I don't trust their opinions of Linux.

      And you can't read that much about knowledge into how much money a company makes. Profit is as much an art of marketing and keeping costs down as it is making a quality product. If quality equated with profit directly, we'd all be using Apple or IBM machines and no one would have Windows. (And McDonalds would be out of business long since and no one would know who "Britney Spears" is.)

    4. Re:Utterly shocking by Anonymous Coward · · Score: 2, Insightful

      hmm...along this reasoning, it may be that Windows is really telling the truth on it's linux myths pages. Afterall, they earn billions on Windows, so they must be be the best authority on judging OS.

      Right?

      Bullshit.

      I've used Highwire, scholar and a couple of other (closed) systems to find relevant papers. The conclusion? I prefer google scholar.

      The reason? Most of the stuff I find is easily accessible. It really annoys me when I (or my University) has no access to more then the abstracts journal X. In fact, usually I can find other relevant papers via scholar which I can access without subscription (or which we've subscribed to). Slightly OT: It's my believe that you will get more citations if you publish in the more open journals, so I always prefer that.

      Second reason: google is fast and clean. You would not believe the horrible interfaces or some of the others. javascripts, java or even proprietary programs needed to access the databases. As for Highwire, it should be called Slowwire....

      Of course, if scholar don't work I still try some of the others. But it is something I definately check and need nowadays.

      A (very recent) PhD.

    5. Re:Utterly shocking by Gkeeper80 · · Score: 2, Interesting

      It's not that the Gale group is a competitor, they're just not the target group for Google Scholar. They're and industry group. Scoopus and WoS are expensive products which are sold to libraries...and guess who makes the purchasing decissions in those places? Librarians!

      The librarians (and other experienced researchers, to be fair) expect the advanced searching functionality that these services provide. They're willing to pay for it and hope that their students will use it.

      Google Scholar is aimed much lower, it's probably most useful to students who've never taken the time to learn proper searching techniques in a database system. They expect everything to work like google, one search box and you get your answers.

      Despite that fact that librarians buy these services so that students will have better resources most students will never learn how to use them.

      The article is right, the expensive services have much more advanced features for advanced users, but most users of those systems will never use a Serial Source list or Thesaurus or Author list. They'll never miss it

    6. Re:Utterly shocking by hanssprudel · · Score: 2, Interesting

      Slightly OT: It's my believe that you will get more citations if you publish in the more open journals, so I always prefer that.

      It is not just your belief, it is well established:

      http://citeseer.ist.psu.edu/online-nature01/

      I think that as academia continues to pull its collective head out of its ass, and realizes that it does not need to pay for a multi-billion dollar publishing industry that gives nothing back (authors write for free, reviewers review for free, editors edit for free, yet my institution spends more than $200k per year on journal subscriptions), services like Google Scholar which revolve around open Internet publishing will become more and more important.

  10. JESUS CHRIST OF COURSE by hoborocks · · Score: 5, Informative

    CLICK the links on the side, the "related links". You'll see that "The Web of Science" and "Scopus" are PART of thomson gale.

    Can we really be that surprised they said that google isn't that good?!

    --
    AccountKiller
  11. Note: HighWire appears to be free too :) by mister_llah · · Score: 2, Informative

    ... oops :)

    --
    MoM++ - A Classic Expanded - [Master of Magic 1.5]
    http://mompp.sourceforge.net/
  12. I DEMAND MORE ::CUE::CAT STORIES! by Thud457 · · Score: 2, Funny
    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

  13. Of course they trash their competition by Anonymous Coward · · Score: 5, Informative

    As the article mentions, there are only two other multidisciplinary academic databases, web of science and scopus. Both are expensive. Google is free. I have access to (and use) web of science, and google blows it out of the water in terms of speed and user interface. Its database is generally pretty good too.

    Not bad for free.

  14. It's one thing to have all the information by winkydink · · Score: 2, Insightful

    It's entirely another to organize it in a way that is meaningful to those attempting to access it.

    The beta argument doesn't wash with me. Virtually everything Google is doing today is beta. It's a cutesy way to hide behind any mistakes in a production service, because you can always say, "whoops! well, remember, it's only beta!"

    --

    "I'd rather be a lightning rod than a seismometer." -Ken Kesey

    1. Re:It's one thing to have all the information by Mac+Degger · · Score: 4, Interesting

      You're right. They should have scholar.google.com locked up in a testlab, accessible only to google employees. until they iron out ALL the bugs. That's far better than to let all acedemia use it right now for the benefit they could recieve using it.

      As should be obvious, I think you're nuts. I've used google scholar for projects at uni for a while now, and it has been quite usefull. It could be better (direct display of homonyms...you never know what jargon scientists will use for the same bloody phenomenon), but it's usefull in it's current state. I'm far happier being able to use it now. If they want to call it beta, fine for them.

      --
      -- Waht? Tehr's a preveiw buottn?
  15. Spreading the goodness too thin by RealProgrammer · · Score: 3, Insightful

    Google is guilty of a bit of overconfidence, maybe, in expanding into areas they know little about, but I think Google Scholar is why there is a Google.

    Google's founders were academics. Their focus is on creating ways to find information. Finding academic information ought to be their pet project.

    The kicker is that if someone else does it better, Google will just buy them.

    --
    sigs, as if you care.
    1. Re:Spreading the goodness too thin by Peter_Pork · · Score: 2

      No, the kicker is that Google engineers read Slashdot, and they really care to improve their services. Wait and see. Either they drop Google Schole (which I doubt) and it will surpass everybody else.

  16. Astronomy by v@mp · · Score: 5, Insightful

    I am a researcher in Astronomy and I have found that Google Schalor is very lacking in my field. They have bigger competition in Astronomy than in most fields because all of the journal articles in Astronomy going back a century have been scanned, cross referenced and are available from the NASA/Harvard Database.

    They have a long way to go to compete with that.

    --
    Censorship rests on the child's delusion that "If I shut my eyes so I can't see it, it isn't there".
  17. Repository != Search Service by Peter_Pork · · Score: 4, Insightful

    Google Scholar is not an attempt to replicate repositories like citeseer and the like. It is a specialized search service! If I search for a paper using Scholar, I get links from many different repositories, and from the web site of the authors. That's what this is all about. Furthermore, as a researcher, I always use plain Google or Google Scholar to locate papers, and I do have access to every other service. Google is just better at it than any other service. Do you know why? Because it gets the job done without any brain damage search language, without broken links and it searches the whole web, not just your random journal list. Can Google Scholar improve? Sure, but the article is pretty biased against a free (as in beer) service.

    Also, there are other great free indexes out there that are not even mentioned in the article, like DBLP.

  18. What's the big deal? by Wee · · Score: 2, Insightful
    So the free (and relatively new) offering isn't as good as the pay services. So what? Most researchers have probably been using the pay services already (unless they only started doing their work 6 months ago, and even then their department likely has access to the subscription stuff), so now they can use the free Google service to supplement that. How can more information be bad?

    That business about "otherwise very intelligent people have succumbed to stupidity by using Google Scholar to the exclusion of the other, much better services" sounds like the author has a personal or financial stake in WoS or Scopus. Or just a chip on his shoulder, axe to grind, whatever. Either way, the reviewer comes off sounding like an pompous asshole.

    If you use Google Scholar and get what you need, then at least you didn't pay anything for the privilege. If they were charging money and it sucked, yeah, I could see someone whining about it. But for free?

    -B

    --

    Ash and Hickory, straight-grained and true, make excellent bludgeons, dandy for the cudgeling of vegetarians.

  19. This review is just stupid... by quadshop · · Score: 2, Insightful

    Two reasons: a) The services to which they are comparing Google Scholar are extremely expensive. It is like comparing free TV to a movie you pay see in the theater, and getting all bent out of shape because TV has commercials and isn't in widescreen. Well, duh. b) The reviewer is obviously biased. This is not a review, it is marketing for the other services that are "superior" to Google Scholar. You can see this kind of stuff on pretty much any product site. But that other crap isn't on the front page of /. being touted as a "review".

  20. TFA misses the point by jeremymiles · · Score: 5, Insightful
    I use Google Scholar and Web of Science on a pretty regular basis - I'm not familiar with Scopus, so I can't comment on that. TFA doesn't mention Pubmed either, which is free.

    It seems to me TFA has have missed the point of Google Scholar. Web of science does abstract, keyword and title searches. And it's very good at them. Google Scholar does full text searches. If I want to know if there has been a study on the effects of ibuprofen on slugs (or whatever), I go to WoS. However, sometimes you want something in the details, which isn't mentioned in the abstract or title. I sometimes want papers that have used a particular statistical technique - I'm not (very) interested in the substantive content, I just want a nice example. WoS - no use at all. Google Scholar - excellent.

    When you get your results, WOS gives you the abstract. Google Scholar points you to the full text source - often you have to pay for it, but you have it there.

    People who get obsessive about systematically reviewing the literature and making sure that they have accessed everything on the subject are never going to use Google Scholar. People who want to know more about a subject are better off with Google Scholar.

    On citation searches, WoS wins hands down (IMHO).

    --
    GENERATION 26: The first time you see this, copy it into your sig on any forum and add 1 to the generation.
  21. Google Scholar is fine... by GileadGreene · · Score: 3, Interesting
    Google Scholar is fine for what it sets out to be: Google that restricts its searches to academic content.

    Is it a replacement for, e.g. Citeseer? No. But then it isn't intended to be.

    What Google Scholar provides is a useful metasearch across existing archives (like Citeseer, the IEEE, the ACM, and so on). It can be handy for finding odd connections between topics covered in different archives. It can also be handy for trawling through those archives using a different search algorithm than the defaults provided by the archive itself. I can't see Google Scholar ever replacing Citeseer - I see it continuing to complement Citeseer.

  22. Anything else? by QMO · · Score: 4, Interesting

    Has Google driven anyone out of the market?

    (I really don't know)

    If yes, did they actually have a truly better product/service?

    --
    Exam 4/C again. Maybe I'll do better this time.
  23. Ummmm... by Seoulstriker · · Score: 2, Insightful

    Or maybe it really is in beta?

    --
    I am defenseless. Use your button. Mod me down with all of your hatred.
  24. Search styles by Kontinuum · · Score: 3, Informative

    I do research in medical image analysis, and I regularly use both Google Scholar and PubMed. I think that there's a big stylistic difference about how different people approach these searches. Going to college and grad school in the mid to late 90's into the 2000s, I grew up (academically, at least) with the idea that I should be able to just type a few words into a search bar and a bunch of related stuff would come up, without having to think too much about where in the document it was located and whether it was a keyword or whether I was searching for the institution or publisher or whatever.

    Older scientists grew up searching those big bound hardback science citation indices, where you had to think very hard about keywords and publishers and such. Even the abstract was more critical then, because you couldn't just grab articles willy nilly onto your desktop and then sort them out later.

    I think of it like the difference between my parents and myself when searching for stuff on the web ... my parents like to go to Yahoo and descend down the well organized categories until they get what they want, whereas I just type a bunch of phrases into Google. I'm not saying one way is better than the other ... it's just a different style.

    That being said, Google Scholar does need a bit more polishing, but I still use it a lot. However, until you can grab citation info into Endnote or Bibtex, it don't see it replacing anything soon.

    1. Re:Search styles by william.gunn · · Score: 2, Interesting
      "That being said, Google Scholar does need a bit more polishing, but I still use it a lot. However, until you can grab citation info into Endnote or Bibtex, it don't see it replacing anything soon."

      Have you heard of Connotea? You can grab bibliographical info from Pubmed, HubMed, and many other indices directly into your Connotea list, and output in .RIS, so you can import into RefMan or whatever. The eventual goal is to move totally away from Thompson ISI and their crufty old products, but until someone comes out with a Journal Style formatting package, we're stuck with RefMan's heinous old interface, at least for now.

      So if you click through any search result, you can grab the citation info, and then pass that on to EndNote or whatever, but hopefully we'll soon not even need to do that. Give Connotea a try, you may find it more useful for at least making the list.

      What I'd like to see is better cooperation with dx.doi.org and more OpenURL support, but I guess that is mostly up to the libraries. I'm going to try to talk my school into registering their resolver with Google, so it knows which library I get my access from, and hopefully Open Access continues to spread.

      Since it's really all about the interface, now we need good forward and backward citation navigation. Tree based approaches, like the one they use at Hubmed, is nice, but the implementation is still a little rough. I would think Google, with their AJAX skillz, could do something much nicer, ala Google Maps.

  25. Thompson-Gale... by MattGWU · · Score: 2, Informative

    Any relationship to Thompson-West, who do massive databases of things like Westlaw? Why yes, there IS a relationship. That's why they think it's 'overhyped'...they are probably in a decent position to put together their own competing service.

    --
    "These people look deep within my soul and assign me a number based on the order in which I joined" --Homer re:
  26. Doing actual research! Re:Google's advantage? by Anonymous Coward · · Score: 2, Insightful

    Google advantage is not only that its free, but it finds PDF's on the net! When doing research, true research, not just padding citations on my paper, I can't afford $5 or $10 for every paper that looks like it *might* be interesting. The walled-off, high-priced services are nasty and unusable if you really need to blast into new territory with research. Sounds to me like there's a sour grapes syndrome here, as authors and publishers alike discover that if their articles aren't free, aren't on the web, then they don't get read and they don't get cited.

  27. Internet changes things, right? by solomonrex · · Score: 2, Interesting

    Google's stuff might as well be publicly available betas, it's the cheapest and most realistic form of testing, and it allows them to ramp up server demand.

    Most consumers like me never heard of 'beta' until Google started up. So I assume their meaning is just as good as yours, because popular usage trumps tradition and logic (which is why a generation of students will spell googol google!).

    Why restrict beta tests to 'expert-only' invitations? Since people CAN use this service productively, I'm glad they allow access in 'beta' form. And now they've elicited a free list of bugs and features that should be added - and from their supposed competition, no less.

    Finally, Google is an advertising company, not a shrink-wrap software company. No doubt they open up public betas because it draws eyeballs, and that just doesn't work for Gale's licensing-based sales model.

    Personally, I don't think Academic journals need publishers anymore. Every prof puts their papers online, and universities certainly have enough free resources to offer html articles and links to sources. It's kind of embarrassing that scholars still use regular journals. Just keep them online, and when someone wants it, they'll print it out- a waste of paper, but students just make a zillion copies, anyway.

    Here's what kills me: one of the major expenses of a college library are the journal subscriptions (whose prices are rising due to consolidation), and they serve professors, who are the ones who write the journals to begin with!

    1. Re:Internet changes things, right? by AvitarX · · Score: 2, Interesting

      Peer Review

      The interent is great for sharing information, but someone needs to pay to have stuff reviewed, and that is why they still have an industry, it's not what they publish, it's what they don't. Even if they get rid of the printed matierial the same companies will be charging for the articles to pay for the review.

      Of course they publish fake articles too, so maybe the review isn't so important. Also the review may be volenteer in which case it is only bandwidth.

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
  28. wrong question by jilles · · Score: 4, Informative

    The question is not whether google is good enough but wether the commercial offerings are good enough.

    As others point out google scholar is free. Generally commercial solutions aren't and work on subscription basis.

    Furthermore google scholar works by basically more or less the same strategies as regular google. Put some search terms in the box and relevant search results will surface. This is a different strategy than the traditional solutions which index many different kinds of metadata and allow for elaborate searches based on that metadata. Both strategies have their place but eventually price and convenience will determine who dominates the market. If simple queries are your thing, google scholar is the preferred search engine. If you are a fussy librarian, you probably need something more sophisticated.

    I'm a researcher who is not associated with a research institute and thus has no access to academic search engines, online subscriptions, etc. I do have access to google scholar. If your article shows up there with a download link for the pdf I can read it. Otherwise I have to make an effort to read your article. The way scientific publications work has changed over the past few years. Journal publications give you status, google gives you exposure. Many researchers end up reading my articles after doing a google query, not after consulting a table of contents of some journal. Google is convenient that's why it works so well.

    I have a number of different use cases that are typical for me:
    - get some useful references on a topic
    - look up the correct reference for something you have read
    - find stuff written someone you've read other stuff from
    - find out who is citing you

    All these things google scholar does well. If you are a researcher it is in your interest to make sure google returns relevant search results if people look for your work stuff that is related to your work. Putting your articles on a website is all you need to do.

    --

    Jilles
  29. Its the interface, stupid by paanta · · Score: 2, Insightful

    I've used most of the big academic search engines, and there's one area where google just blows everyone else away: the interface. No one else can hold a candle to the 'type some shit and get what you want back' google scholar search. Yeah, sure, it may be an 'incomplete' database, but what is there is VERY easy to find in my experience. When they've got more stuff indexed, this thing is going to rock. It's already the first place I turn when I need to pull up a citation, and I rarely have to go to one of the 'better' search engines.

  30. Googlix? by Sprotch · · Score: 2, Insightful

    As as lawyer having to rely on Lexis on Westlaw (expensive internet legal databases), I find their "search" engine a real pain. I can't imagine how it could be worse. If google would start a competitive database, they could win the whole market in a flash.

  31. Actually it is not a review by Thomson Gale... by Matt1313 · · Score: 2, Informative

    ...it is a review by Peter Jasco, who is an independent reviewer.

    http://www2.hawaii.edu/~jacso/

    We just provide him the space to post his reviews.
    As we do for several others...

    http://www.galegroup.com/free_resources/reference/ index.htm

    "Visit gale.com regularly to check out the latest reviews on reference resources by these prominent experts:"

  32. From a chemist's point of view by Atraxen · · Score: 2, Informative

    In the end, it all depends how you use it and what you want it to be. Scifinder Scholar (no relation to the Google service, despite the lawsuit) and Beilstein are probably the two most-used indexes used in chemistry. I'll use Web of Science once in a while, as well. They are all very good at what they do (some annoying twitches of each aside), which is why my University is shelling out lot of money for them. The problem with site-licensed databases is they need an on-campus IP address, which sucks when I'm working in a coffee shop. Google Scholar is nice because I can find citations fairly reliably - I still have to use the web-based VPN to be 'on-campus' to then get the article, but it works.

    --
    Be careful of your thoughts; they could become words at any minute...
  33. Re:Yes and yes. by StringBlade · · Score: 2, Insightful
    Which search engines were those?

    Last I checked, all the same search engines I used to use still exist: Altavista, Lycos, WebCrawler, Hotbot, Yahoo, AskJeeves. If you're talking about some obscure engine that doesn't exist anymore I hardly blame Google for that since they never made it out of obscurity.

    Granted, Google is my (and most people's) primary search engine because it is most accurate most often and is very fast with lots of nice tools (site:, cache:, etc.).

    --
    ...and that's the way the cookie crumbles.