Slashdot Mirror


Google Releases an API for Their Database

Ben Wills writes "Yahoo! announced that Google Released an API last Thursday. "The service, launched Thursday, is called Google Web APIs, for application programming interfaces. The tools let noncommercial software developers "query more than 2 billion Web documents directly from their own computer programs," according to Google's Web site. For now, the service is free." Google just keeps pushing the limits."

54 of 202 comments (clear)

  1. for those who don't like Yahoo... by WebMasterJoe · · Score: 3, Informative

    I try not to give Yahoo any more hits after they messed up their privacy poolicy, so here's the same exact story on CNET: http://news.com.com/2100-1023-882252.html.

    --
    I really hate signatures, but go to my website.
    1. Re:for those who don't like Yahoo... by markhb · · Score: 3, Funny

      I try not to give Yahoo any more hits after they messed up their privacy poolicy, so here's the same exact story on Slashdot:
      http://slashdot.org/article.pl?sid=02/04/12/112821 0&mode=nested.

      --
      Save Maine's economy: write stuff down. All comments are exclusively my own, not my employer.
    2. Re:for those who don't like Yahoo... by mobiGeek · · Score: 3, Funny

      I try not to give Slashdot any more hits after they keep posting dupes, so here's the story as posted on Yahoo! http://story.news.yahoo.com/news?tmpl=story&ncid=7 0&e=3&cid=70&u=/cn/20020415/tc_cn/google_tests_sea rch_tools_for_developers.

      --

      ...Beware the IDEs of Microsoft...

  2. No support for image or usenet queries... by casio282 · · Score: 4, Insightful
    Sadly, though, there is no support in the API for queries on their image or usenet "groups" indices, according to the API FAQ:
    2. Can Google APIs be used to access Google Groups? Image search? Directory search?

    No. The Google Web APIs service can only be used to search Google's main index of 2 billion web pages.

    I'll have to keep on parsin'... Maybe some day.
    --

    :wq
  3. For the sake of the revolution of the world! by Agelmar · · Score: 4, Funny

    The world can now be revolutionized! We can get Google searches on Microsoft.com! The pigeons will come out of their cages and peck the buttons on the Microsoft servers, thus shutting down the evil megacorporation! Hail Google for saving the world! The pigeons will save us all, hail the open API!

  4. useful for sorting by oever · · Score: 3, Funny

    Now we can sort strings in order of google hits!

    Wow, very nice for word completion

    --
    DNA is the ultimate spaghetti code.
  5. Slashdot Releases an API for Their Database by ajakk · · Score: 5, Funny

    PsPrEditor writes: "Yahoo announced that Slashdot Released an API last Monday. "The service, launched Monday, is called SlashPI. It will allow users to remove duplicate stories that have been plaguing /. for the past year. ""

    1. Re:Slashdot Releases an API for Their Database by jeffehobbs · · Score: 5, Funny

      In other news, PsPrEditor writes: "Yahoo announced that Slashdot Released an API last Monday. "The service, launched Monday, is called SlashPI. It will allow users to remove duplicate stories that have been plaguing /. for the past year. ""

  6. Recursion by Yoda2 · · Score: 2, Funny

    Can it be used to query for Slashdot stories on the Google API?

  7. Google saving bandwidth? by shaldannon · · Score: 4, Insightful

    Why do I get the feeling that Google is doing this to save bandwidth? How many people do you thing scrape Google for results? How much load are they going to save if people use the API rather than searching and scraping? That's what I thought...

    --


    What is your Slash Rating?
    1. Re:Google saving bandwidth? by jlanng · · Score: 3, Interesting

      Probably not a great deal. Remember that when you're 'scraping' from HTML, you don't have to load images, css resources etc

    2. Re:Google saving bandwidth? by mattdm · · Score: 2

      Well, I set up a Black & White * Sucks-Rules-O-Meter getting its results from Google -- just one query a day. After about a month, they noticed it and banned my IP from doing that search.

      Since that's probably pretty effective in most cases, I'd guess they're not really saving bandwidth with this API, especially since it'll encourage *more* people to do scripted searches (and since the html page is pretty small anyway).

      I think they're doing it to appear cool to computer geeks. Works for me....

      * the game

    3. Re:Google saving bandwidth? by babbage · · Score: 5, Insightful
      Well, exactly. This is really where things should be going. Think about it. If a user can express exactly what they want from an online resource in a terse but complete way, then both the user and the resource provider come out ahead. Neither side wants to deal with the extra overhead of serving whole pages of HTML formatting when [a] you just want the hits on a given search query and [b] Google doesn't want to pay the extra bandwidth charges.

      Allowing power users to target requests more efficiently is a boost to both sides here -- even if Google doesn't charge a nominal fee for this, the bandwidth savings could still put them ahead of where they would have been under a more traditional HTTP/HTML transaction. You phrase your comment in a very cynical way, but really this seems like a great thing to me. One of the biggest burdens in getting info from the web is having to manually scrape it out of a web browser (or muck around with say LWP and HTML parsers). With an API like this, we can see more applications such as Watson, that aggregate the data & cut through all the web crap that makes finding information tedious. This is where everything is going with SOAP, .NET, MONO, XML-RPC, and so on, and I for one am glad to see a great company like Google leading the way.

    4. Re:Google saving bandwidth? by rob_from_ca · · Score: 2

      Don't think they'll be saving much bandwidth. Those XML/SOAP requests passing back and forth aren't exactly lightweight, probably about the same as the HTML for a page. And the logo of course is cached everywhere. :-)

  8. Google more open to "google bombing" now? by cetan · · Score: 5, Interesting

    An interesting article on K5

    http://www.kuro5hin.org/story/2002/4/15/72154/5065

    talks about how now Google bombing is even more effective with this release.

    --
    In Soviet Russia...michael would be rotting in Siberia!
  9. Google is Great by smagruder · · Score: 2

    It's amazing to see the advances in what appears (to the non-programmer) to be a set of simple technologies coming out of little ol' Google. They're putting all the other search engines to shame, esp. including Yahoo!. Even Yahoo! is stealing ideas from Google, such as the really cool Zeitgeist.

    --
    Steve Magruder, Metro Foodist
    1. Re:Google is Great by Hydrogenoid · · Score: 2, Interesting

      Err... Since Yahoo! uses the google engine, it is not that surprising that some features are in common...

    2. Re:Google is Great by smagruder · · Score: 2

      It's understood that Yahoo! is using Google as a *secondary* search engine. Yahoo! continues to display items from their directory before showing the Google results. Thus, Yahoo! is not only stealing the zeitgeist, but also search results. :)

      --
      Steve Magruder, Metro Foodist
    3. Re:Google is Great by jCaT · · Score: 2

      interesting!! notice in the image searches, they limit it to "anime" image searches and holiday ones. Why? Because probably 80% of the people using the image search are using to try to find porn!

      It would be interesting to actually see those stats, though.

  10. Dont forget.. by josh+crawley · · Score: 3, Funny

    Dont forget that Google released their API for their database...

  11. What web services were meant to be? by SirSlud · · Score: 5, Insightful

    Am I one of the only people that contend that THIS is what the whole 'web services' thing is all about?

    I think this is ultra cool. Imagine, if you made an application that had skins or used plugins, or whatever. You could have an in-app browser, powered by google, to search for new add-ons to applications, etc.

    Actually, the possibilities are quite cool.

    --
    "Old man yells at systemd"
    1. Re:What web services were meant to be? by bricriu · · Score: 2

      Or an in-browser app that automatically Google-linked everything in a page? Like M$'s proposed auto-linking, but populist. True hypertext.

      --

      AHHHHHHH! I'm burning with goodness again!
      - Reakk, Sluggy Freelance

    2. Re:What web services were meant to be? by SirSlud · · Score: 3, Interesting

      yeah, and the beauty is, it 'breaks' the control that corperations are attempting to leverage on their consumer base through their partnerships.

      For instance, if FedEX has an API I can hook into, I am not forced to use some partner of theirs [AB Inc, for the purposes of this example] because AB Inc has special permission or some manual corperate-driven method for providing their services integrated with FedEx. Now I can hook right into FedEx myself and not be forced to follow the 'carrot' of seamless integration based on their partnership strategies that force me into 'buyins' I dont really want to participate in.

      --
      "Old man yells at systemd"
    3. Re:What web services were meant to be? by Anonymous Coward · · Score: 3, Funny
    4. Re:What web services were meant to be? by anthony_dipierro · · Score: 2

      Am I one of the only people that contend that THIS is what the whole 'web services' thing is all about?

      Nope, Google is just one of the few companies that actually has the guts to try it.

  12. Re:That sounds really familiar... by dthable · · Score: 2

    But they need to keep the volume up to justify the subscription model. When it doubt, start looking for crap in the trash can.

  13. credit card trolling is even faster now. by JDizzy · · Score: 2

    I wonder how hard it would be to trawl the cache for the good stuff?

    --
    It isn't a lie if you belive it.
  14. Well.... by qurob · · Score: 2

    Any real hacker already has perl/cgi/whatever code to do this for him :)

  15. Heh, Google faster than Microsoft. Perfect timing. by Baki · · Score: 5, Informative
    Microsoft, claiming everyone should use .NET to be able to use web services (WSDL) just announced their first web service (mappoint) but google beats them. Plus, google shows you don't need .NET but can just as well use Java to make use of XML web services. MSFT must be quite pissed because of this, google stealing the web services show for now.

    Apart from that I think it is a pity that noone comes up with a Corba-over-HTTP standard. As an API, Corba IDL is nicer and more compact than WSDL, and all tool support is already there. WSDL offers no advantages over Corba. The only difference is the use of XML instead of (easy) IDL, and using HTTP as transport mechanism. Corba is transport mechanism independant; current implementations mostly use IIOP, but one could just as well implement Corba using HTTP as transport. Hell, you could even use some XML-over-HTTP as transport, to satisfy all XML freaks that think any machine-to-machine data nowadays should be human readable.

    The only justification for XML web services is that MSFT hates Corba (because of their Not Invented Here syndrome they invented COM+ to compete, also helping vendor lock in) thus they had to come up with something else; switching to Corba would mean they loose their face.

  16. Didn't by xcomputer_man · · Score: 2

    Already see this on Friday? It was released thursday, so it possibly couldn't be a different story...

    Google releases Web APIs

  17. Sounds familiar by Jaeger · · Score: 5, Informative

    I'm glad the army of highly-trained rodents that processes Slashdot submissions was able to catch these reduntant stories. We've seen this a few times before:

    The first story even included a link to the API page on Google's site.

  18. I shoulda waited ... by jc42 · · Score: 2

    Damn! I wrote my own about two months ago.

    Maybe I'll grab theirs and see if it gives me any ideas.

    --
    Those who do study history are doomed to stand helplessly by while everyone else repeats it.
  19. Look here for the xml-rpc interface by codepunk · · Score: 5, Interesting

    Google xml-rpc interface

    I personally refuse to support and or recommend anyone using SOAP web services due to the patent fiasco. I asked on the xml-rpc list if anyone knew of a xml-rpc gateway and Dave Winer immediately jumped to the challange and put up a public gateway.

    Thanx Dave

    --


    Got Code?
    1. Re:Look here for the xml-rpc interface by sheldon · · Score: 2

      What patent fiasco?

      Or is this more FUD like that ZDNet article?

  20. How to solve this by aozilla · · Score: 2

    The database obviously has a list of "related links". Both the original "article" and this dup have the same link, to http://www.google.com/apis/. Why not just list all the other "articles" which contain that same "related link" in the last 2 weeks or so when the "editor" (and I use that term very loosely) submits the "article" (which I also use very loosely).

    --
    ok then your [sic] infringing on my copyright! Could you as [sic] me next time before STEALING my comments for your own?
  21. What about slashdot? by aozilla · · Score: 2

    How long until slashdot offers this service? (No, I don't mean just the headlines, I mean the whole site).

    --
    ok then your [sic] infringing on my copyright! Could you as [sic] me next time before STEALING my comments for your own?
  22. Re:Heh, Google faster than Microsoft. Perfect timi by mnot · · Score: 2, Interesting

    That's not what Web Services are about.

    Although current applications (and some implementations) focus on RPC-over-HTTP-using-XML (and "section 5" encoding), most of the big WS vendors believe the real meat of WS is in literal-encoded documents in long-lived message exchanges.

    This buys you a lot; instead of needing to have objects at both ends, you send messages that are described by a schema; the implementations are relatively independent. WS are more flexible, more loosely coupled, and more dynamic.

    In this manner, WS is closer to message queuing solutions (e.g., MQSeries, MSMQ, Tibco, etc.) than it is to Corba.

    The intermediary model in SOAP hasn't been exploited much yet, but should prove interesting.

    Another interesting feature of SOAP is the extensibility that Modules bring you; this should allow a number of common behaviours (like reliable delivery) to be standardized.

    Finally, SOAP isn't just over HTTP; again, many vendors believe that HTTP is too limiting and tempermental to be useful for the more interesting applications.

  23. Darn by Kallahar · · Score: 2

    I was about to submit this story:

    Slashdot is reporting that Google is opening their API. Slashdot's Hemos was unable to be reached for a reply, but Slashdot's CmdrTaco decided to post the story anyway.

    :)

  24. Good Thing? I agree by shaldannon · · Score: 3, Insightful

    I just believe they're doing it for a reason that makes business sense to them rather than out of the "this is a really great technical idea" motivation. (Hence the cynical tone) I agree that it would be good if there were some sort of standard API available (like RSS does) that allowed you to do this sort of thing for all sites. Then again...(cynicism=on) Microsoft would just find another way to corrupt the standard.

    --


    What is your Slash Rating?
  25. Re:A great move by Google by Zico · · Score: 2

    How do you figure Google has some strong Open Source relationship? Have they given out their source code so that people could create their own Googles? Serious question, maybe they have and I just didn't know about it.


    And how would an API such as this "easily muscle out any sniff of a competition from other search engine wannabes"? I don't think too many other guys are going to be rushing out to implement this, seeing as every time someone uses the API, they're not seeing the ads. People stop seeing the ads, advertisers stop giving Google money. Google stops getting money, Google go bye bye. Google's already unsure how they can make money from this as it is, I wouldn't expect everyone else to make the blind jump along with them.

  26. Heh, you're completely wrong. by Zico · · Score: 2

    Microsoft has offered TerraServer access as a web service for over a year now. You can still see the current incarnation at TerraService.net. As I said, it's been around for over a year now, because I still see cached articles about it from last April. Nice try, though. ;)

  27. Yeah actually I could by shaldannon · · Score: 2

    But I was taking the controversial (around here) approach that a business was trying to make money versus the (conventional, around here) approach that they were doing new things for technology's sake. I suppose I could get really wild and suggest that they were doing this to get people hooked and then would set the hook by making it a subscription service, but that's pure speculation.

    --


    What is your Slash Rating?
  28. Re:Google Stock Exchange by tps12 · · Score: 2

    That's a cool idea. And that's a great page! I was surprised to see that Mac users search on Google four times as much as do Linux users. I guess I have a warped perception of the number of Linux users...

    --

    Karma: Good (despite my invention of the Karma: sig)
  29. Re:Heh, Google faster than Microsoft. Perfect timi by sheldon · · Score: 2

    Why would Microsoft be pissed?

    It's simple... Take VS.Net and build a client application to utilize the google.com web service.

    Now do the same with Java.

    It only takes 10 minutes or so to build the entire client UI in VS.Net. How long will it take the Java developer? *That* is what Microsoft is selling...

  30. Re:Heh, Google faster than Microsoft. Perfect timi by hgh · · Score: 3, Informative

    google shows you don't need .NET but can just as well use Java to make use of XML web services

    Of course anybody who has any background knowledge of web services knows that pretty much any language with text manipulation can be used to create web services. The point of .NET is not that it is the only way of creating web services but rather it makes creating them a lot easier; WSDL, DISCO, SOAP, etc. are abstracted away to make the developing web services easier. Yon don't need to know the bare protocol to start coding (of course it always helps).

    WSDL offers no advantages over Corba. The only difference is the use of XML...

    The use of XML is an advantage. XML is easy to use, and is an open standard. Although binary specs are slightly more efficient in transfer time and space requirements, this is becoming more and more negligible. More important is a developer's time. It is a lot easier to use and debug and text-based spec like XML than a binary spec.

    The only justification for XML web services is that MSFT hates Corba

    Maybe before you spout worthless anti-msft drivel you should research the origins of Web Services. Check out this article by Tim Berners-Lee for a quick intro.

    hgh
  31. Not really free by flossie · · Score: 2
    This is incredibly cool, however:
    And you may not use the search results provided by the Google Web APIs service with an existing product or service that competes with products or services offered by Google.
    It is certainly reasonable for google to prevent other large search engines from crippling them by using the Google API to obtain all the best links, but this is rather vague.What exactly constitutes competition? Other search engines? Other commercial sites competing for viewers? Other sites that display adverts?

    While I'm sure that Google's interpretation will be very reasonable, I don't really like the license text.

  32. Re:Heh, Google faster than Microsoft. Perfect timi by CaptainSuperBoy · · Score: 2, Insightful

    How long will it take the Java developer?

    About five minutes, using the Java classes that Google included with their API. RTFM, man.

  33. Well, at least the soap protocol... by SuperKendall · · Score: 2

    The nice thing is that it's more a push of pure Soap than .Net. You could use Java, Perl, Ruby, or really anything against the Soap interface (as long as you have a soap library to wrap up the calls, or are willing to create a wrapper).

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  34. GoogleThrashing by webmaven · · Score: 2

    As this is an example of a feedback loop, rather than the sort of coordinated manipulation that a GoogleBomb is, I felt it deserved it's own term, so I decided to call it GoogleThrashing since this could at least potentially cause the Google Pagerank algorithm to thrash, depending on the extent and type of feedback involved.

    Besides, it sounds cool :-)

    I posted a short description of GoogleThrashing to my weblog and also posted it to the Google API discussion group.

    --
    The real Webmaven is user ID 27463. I don't rate an imposter, because my ID is such a lame-ass high number.
  35. Re:Heh, Google faster than Microsoft. Perfect timi by Baki · · Score: 2
    XML is easy to use, and is an open standard
    Huh, why is XML more open then specifying how Corba data is to be marshalled? It is all neatly described, just read the IIOP spec (available on www.omg.com). Why easier to use? Because XML is human readable? I don't see the fundamental difference. No developer (except those that implement an ORB) need to debug the transport mechanism. And, should you wish to do so and still think that XML somehow is "easier", then feel free to implement Corba on top of XML, i.e. use XML to transfer Corba requests/data. In fact, I'm pretty sure that Corba implementors shall quickly offer "Corba over SOAP" (just like they were quick to implement a Corba-COM bridge).
  36. Re:Heh, Google faster than Microsoft. Perfect timi by Electrum · · Score: 2

    He's talking about building the UI, which is incredibly easy in VB, using the GUI builder. The API is easy to use with either language.

  37. Re:Heh, Google faster than Microsoft. Perfect timi by CaptainSuperBoy · · Score: 2

    Not really.. All Google's API does is generate the right XML for you, which you could do yourself with a third party XML library or an hour's hacking. They are using completely off-the-shelf components - SAX to do the XML, and Apache's SOAP library for Java.

  38. Re:Heh, Google faster than Microsoft. Perfect timi by CaptainSuperBoy · · Score: 2

    Yeah but if you use J#.Net.... :)

  39. Be careful of bait and switch by 3seas · · Score: 2

    Web Service are intended to be used to charge people for using.

    I'm sure your local drug dealing will give out some free samples to hook the kids.....

    Think about it....There have been some recent article regarding MS and IBM "patenting"
    the internet via web services....