Slashdot Mirror


Are Googlers Too Smart For Their Own Good?

theodp writes "If you're a mere mortal, don't be surprised if your first reaction to Google Storage for Developers is 'WTF?!' Offering the kind of 'user-friendly' API one might expect from a bunch of computer science Ph.D.s, Google Storage even manages to overcomplicate the simple act of copying files. Which raises the question: Are Googlers with 'world-class programming skills' capable of producing straightforward, simple-to-use programming interfaces for ordinary humans?"

38 of 307 comments (clear)

  1. Hint: "For Developers" Means "For Developers" by eldavojohn · · Score: 5, Insightful
    As a developer who deals daily with RESTful interfaces at his job, I found this to be rather intuitive. It may be complicated but would you be so kind as to elaborate on what is unnecessarily complicated about this interface? You might think "Oh, you're just moving data around" but add on top of that security like SSL support, scalability, namespaces and the ability to store very large hundred GB objects then ... Yeah, the end result is going to be a bit more than PUT <Data>Object</Data>. It's well documented as far as I can tell. I haven't used it so I don't know if this documentation is worthless but it looks comprehensive at first glance.

    So, theodp, if you were a developer you would look at this and see a set of interfaces to web services done in a RESTful manner. You would say, "Oh, my users want to use Google storage but they need more of a drag and drop interface." Then you would spend a couple weeks using Ruby on Rails and Scriptaculous to make virtual folders or buckets or whatever your application calls them and using the elegance of RoR with the UI of Scriptaculous so the user can move their photos or data from your server to the cloud or vice versa. You could really use anything you want to interact with it but I would bet these two GPL compatible tools would result in the most rapid of web application development.

    So three sentences with links to Google besmirching them for being smart will get you on the frontpage of Slashdot these days? Really the substance of the 'story' here is essentially "WTF?! So complicated it must Suck!"

    Offering the kind of 'user-friendly' API ...

    Here's a final hint: API stands for Application Programming Interface is not supposed to be user-friendly. It's supposed to be developer-friendly. I hope I don't sound like a Google fanboy but this is a nontrivial task and I would defend the API they have produced. The documentation is far more than you would get from a CS PhD. You want me to take notice of your mindless drivel, theodp? Get off your ass, code an interface for this API and then point out how the API and documentation is lacking in a step by step post. That would be helpful and deserve a place in Slashdot's programming section. What you have here is not.

    --
    My work here is dung.
    1. Re:Hint: "For Developers" Means "For Developers" by Anonymous Coward · · Score: 5, Insightful

      I agree.

      Slashdot is so non-technical these days it's a complete fucking joke. Ignorance just spews on anything even remotely related to software development. Please drop "news from nerds" from the slogan. Replace with "lip service for sycophants".

    2. Re:Hint: "For Developers" Means "For Developers" by mondoterrifico · · Score: 5, Funny

      Coding is hard! Let's go shopping!

    3. Re:Hint: "For Developers" Means "For Developers" by sribe · · Score: 4, Funny

      I hope I don't sound like a Google fanboy but this is a nontrivial task and I would defend the API they have produced.

      Heck, I had the exact same reaction to this article, and I haven't even looked at the API! My reaction was based solely on the wording theodp's atrocious post.

    4. Re:Hint: "For Developers" Means "For Developers" by Cylix · · Score: 3, Insightful

      Seems like a adver-troll by proposing such a silly argument.

      It's a straight forward documented restful api. No biggie, written a few myself and it is always a bonus to get some decent usage examples.

      I'm not sure you would be classified as a google fanboy for pointing out the obvious.

      Looking over the API and the simpler nature of the subject I doubt it would take a few weeks. If you have some code lingering around to manage similar API's you can sling together an app over a weekend.

      --
      "You should always go to other people's funerals; otherwise, they won't come to yours." -- Yogi Berra
    5. Re:Hint: "For Developers" Means "For Developers" by toxonix · · Score: 3, Funny

      but wait! I'm submitting an article to /. about how hard google is! I want to go to the apple store! apple store!

    6. Re:Hint: "For Developers" Means "For Developers" by mcgrew · · Score: 5, Interesting

      It isn't slashdot that has become non-nerdy, it's that being a nerd has become "cool", very unlike it was when slashdot started. These days, anybody who knows that you make your computer stop by clicking "start" thinks (s)he's a nerd, even if they couldn't copy a file without a GUI, let alone have ever heard of Linux or BSD or any other non-Microsoft OS (which these days actually have GUIs).

      In the old days, a submission like this most likely wouldn't have been posted, but now we have the firehose, where every nerd wannabe can vote a story up. There are still very good, technical stories here (there was one a couple of days ago about mathematics) -- you just have to ignore the ones like this one voted up by the wannabes. That said, I haven't looked at Google's APIs.

      God, I never thought I'd see the day when we would be considered cool! Just laugh smugly and enjoy being cool instead of being a wannabe.

      That said, sometimes I say stupid things here (probably a lot this week, I've had the flu and it's affected my mental faculties).

    7. Re:Hint: "For Developers" Means "For Developers" by fusiongyro · · Score: 4, Informative

      Granted, this story is grandstanding. But still, this is what you have to do to copy from the article:

      • "Create source and destination URIs."
      • "Create new destination URI with the source object name as the destination object name." (clone_replace_name)
      • "Create a new destination key object."
      • "Retrieve the source key and create a source key object."
      • "Create a temporary file to hold our copy operation."
      • "Copy the file."

      That seems like a lot of steps, and a couple of them seem very strange to me, namely the clone_replace_name.

      I agree that complex tasks require complex APIs. I just don't see why this is such a complex task. We're not using SSL, namespaces or storing a gigantic file here, and I don't see any reason why those features should make the process that much harder. If you want to store large data in the cloud, why should it be so much harder than storing data on a regular filesystem? You don't have "namespaces" on the filesystem, just folders and they just work. SSL "just works." Large files are not intrinsically different from small files. There aren't any ACLs in this example. Where's the complexity? Shouldn't simple things be simple?

      The answer is because the cloud is ultimately about marketing and selling expensive crap to enterprises that don't need it, so a burdensome API is just another way of making things that should be cheap more expensive. Expensive developers up on their marketing will get to charge 5x as much because it will take them 5x as much work to do simple things. "Everyone wins."

    8. Re:Hint: "For Developers" Means "For Developers" by Lunix+Nutcase · · Score: 4, Funny

      Perhaps the OP would enjoy a line of work that involves shovels and dirt.

      Yeah, but shovels are too complicated an unintuitive. I mean it would probably take theodp hours to figure out which end he is supposed to hold and which end goes into the dirt.

    9. Re:Hint: "For Developers" Means "For Developers" by Yvan256 · · Score: 4, Funny

      To the shopmobile!

    10. Re:Hint: "For Developers" Means "For Developers" by masmullin · · Score: 4, Funny

      What? Shopping is way more difficult than coding!

    11. Re:Hint: "For Developers" Means "For Developers" by RobDude · · Score: 3, Insightful

      Which is why, to this day, it's so much easier to get a GUI up and running in other OS's other than Windows.

      While most other OS's will 'just work' getting Windows to display the GUI can be an involved and frustrating task requiring the modification of .conf files or running command line based configuration tools.

  2. If everyone was supposed to understand it... by Low+Ranked+Craig · · Score: 5, Insightful

    They wouldn't call it code.

    --
    I still cannot find the droids I am looking for...
    1. Re:If everyone was supposed to understand it... by Sockatume · · Score: 4, Funny

      The da Vinci Code begs to differ.

      --
      No kidding!!! What do you say at this point?
    2. Re:If everyone was supposed to understand it... by Anonymous Coward · · Score: 5, Funny

      The da Vinci Code begs to differ.

      I still don't understand why anyone would want to read it. Does that count?

  3. It's just not for regular users by kikito · · Score: 5, Insightful

    In other news: the space shuttle UI is too complicated for regular car drivers! duh.

  4. Yes by Dunbal · · Score: 4, Funny

    Whatever happened to simple interfaces, like:

    "Would you like to play Global Thermonuclear War? [YES|NO]"

    --
    Seven puppies were harmed during the making of this post.
  5. Re:Huh? by Anonymous Coward · · Score: 5, Funny

    We didn't have a Google story for over two hours, so we had to post what was available.

  6. APIs are not written for end-users. by Delusion_ · · Score: 3, Insightful

    This isn't to discredit the idea of ease of use or good design - god knows Google graphs requires way more hoops than it should (compare, say, Visifire).

    I think it's easy to look at the developer's guide and just flee in terror, but honestly if that's your reaction, Google storage API is probably not the droid you're looking for. If you need simple file sharing that a typical user can appreciate without having to read a manual, Dropbox may be more appropriate; Google Storage API is written with developers in mind.. I'm a big fan of some of Google's APIs, Dropbox, and Google Docs for sure.

  7. Re:Simple Interface from Google? by Low+Ranked+Craig · · Score: 4, Insightful

    UI != API. A proper API doesn't need to be simple, it needs to work properly and consistently. Not to get too subtle, but a complex API for something like this is perfectly fine as long as it is not overly complicated, if you get what I mean.

    --
    I still cannot find the droids I am looking for...
  8. Meanwhile, slashdot editors too dumb for own good by jaymz2k4 · · Score: 5, Insightful

    I was expecting something really crazy and complex but what I saw was well documented and made sense. Seriously, how on earth is this front page news on slashdot?? I wont repeat the many well made statements that "API's arent for users" above. I'm just surprised this has made it to the front page as a developers link. I sure hope I don't work with the sub. at any point if he thinks this is an example of people being "too smart for their own good". /saddened

    --
    jaymz
  9. It isn't their design by igb · · Score: 4, Insightful

    As the documents point out, it's the same API used for Amazon EC3 and others. They're implementing someone else's protocol.

    1. Re:It isn't their design by SashaMan · · Score: 4, Insightful

      Mod parent up. This is from the docs:

      Interoperability
      Google Storage is interoperable with a large number of cloud storage tools and libraries that work with services such as Amazon Simple Storage Service (Amazon S3) and Eucalyptus Systems, Inc.

      Basiacally, google is essentially building on what has become an industry standard for cloud storage.

      This article submission is either from an idiot or a troll.

  10. Are you one of those types by Anonymous Coward · · Score: 5, Funny

    who flood developer-boards with questions that typically look like

    " Sir Sir please help sir I have project due sir I need full workking code by tomorrow sir" ??

    If so, you would expect everything to be point and click, I guess.

  11. Ob. Quote by gzipped_tar · · Score: 5, Insightful

    There's been an awful lot of discussion about what is or isn't simple, and people have gotten a pretty sophisticated notion of simplicity, but I'm not sure it has helped.
                                                -- Ward Cunningham

    --
    Colorless green Cthulhu waits dreaming furiously.
  12. Explaining American Football to Chinese by Spacecase · · Score: 3, Interesting

    Things become much more complicated then first impression when you try to really explain something. For example I went to a football game with a group of Chinese grad students and they asked me how a team can score points. I thought to myself this is easy, and began to explain the rules.

    1. Touchdowns are worth 7 points... err they are worth 6 points technically
    2. After a touchdown the scoring team can decide to kick the ball through the uprights for 1 point
    Or
    3. The scoring team can decide to run another regular play and if they enter the end-zone again on that 1 play they get 2 points.
    4. Fields goals are 3 points and are scored when the team on offense can kick the ball through the uprights.
    5. The defense can score points if they can tackle an offensive player in the end-zone while they are holding the football. The defensive team then gets 2 points and gets the ball kicked to them on the following play instead of the normal system where the scoring team kicks the ball to the other team.
    6. If the defense can steal the ball and run into the end-zone they are facing then it is a touchdown and rule 2 and 3 apply.

    By the end of this discussion they were more confused then when we started. So when you say how hard can it be to explain how to store a file questions like.

    1. How to delete?
    2. How to rename?
    3. How to create folders or other organizational structures?
    4. How to move items between organizational structures?
    5. How to copy an item already in storage?
    6. How to download multiple files?
    7. Can security be set or changed?
    8. Oh yeah and how to I upload a file in the first place?

    The more precision you apply to a discussion the more complicated they tend to get. Just like a touchdown is 7 points is easier to understand, upload a file is easy too.

  13. Re:Rule of the 5 Year Old and 7 Year Old by sammy+baby · · Score: 4, Insightful

    anything that is user facing should be able to be explained to a common 5 year old (hint if you have enough developers available then you should have access to at least one).

    As the parent to your post noted: we are talking about an API here. Precisely none of it is user facing.

  14. Re:API is not a UI by wurp · · Score: 4, Funny

    Do you think anyone who would conflate API with UI will know what conflate means?

  15. Re:uh? Maybe I'm missing something..... by vrai · · Score: 3, Informative

    But maybe I'm missing something here.....

    Yes you are. This is not a "storage system to be used as a filesystem" it's an implementation of the Amazon S3 interface that provides remote, redundant key/value storage (where the value in this case is a bucket of bytes). There's nothing to stop you implementing a file system on top of it; but the API provided by Google is at a lower level than that. Which is a good thing as a standard file system is not necessarily the best way to use this kind of storage.

  16. Article Tag by codepunk · · Score: 4, Insightful

    The tag on the article "submittertoostupid" pretty much says it all here folks.

    --


    Got Code?
    1. Re:Article Tag by SharpFang · · Score: 3, Interesting

      It's not about being too difficult. It's about being way too overcomplicated.

      Let's look at the code.

              config = boto.config

      okay here. We need config.

              bucket_name = "dogs"

      remote dir. So they made a half-assed directories system. Can't be nested, data can't be outside them. Piss-poor but let's say "okay" here.

              name = "poodle.jpg"
              dir_name = "pets"

      so far so good.

            src_uri = boto.storage_uri(bucket_name + "/" + name, "gs")
            dst_uri = boto.storage_uri(dir_name, "file")

      seems logical if slightly redundant. So we need some objects instead of plaintext names...

              dst_key_name = dst_uri.object_name + os.sep + src_uri.object_name ...wtf... oh, we are trying to create a local filename... that's some convoluted way to do it.

            new_dst_uri = dst_uri.clone_replace_name(dst_key_name)

      err... so our local disk file needs to be placed at... "pets/dogs/poodle.jpg". Now that's some way to get there!

            dst_key = new_dst_uri.new_key()

      oh, that was just the NAME of the new key... so we need the actual "key"... again, what for?

            src_key = src_uri.get_key()

      again, if we have the URI object, why do we need some "key" object? Isn't the dedicated URI object good enough?

            tmp = tempfile.TemporaryFile()
            src_key.get_file(tmp)
            tmp.seek(0) ...can't we read directly from a file instead of creating temporary one? So the "uri" of a file is not good enough, the "key" of a file is not good enough, we need a "tempfile" object extra?

            dst_key.set_contents_from_file(tmp)

      I recommend a reading about a hammer factory factory factory. This one doesn't overdo factories, just abstraction layers. I can spot four: filename (string), URI, key, file handle within the key. WHO needs that???

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
  17. Nice low-level API. Missing high-level API. by Millennium · · Score: 4, Insightful

    This looks like a nice low-level API for doing really interesting and complicated things. Unfortunately, they neglected to include a high-level API to deal with what will be by far the most common use cases. Sure, it's not so difficult to implement an upload_file(filepointer, uri) function with this, but given the huge proportion of developers using this library that are going to need exactly this sort of function, do we really need all of them reinventing the wheel?

    Powerful and complex functionality is good, but the most common use cases got that way for a reason. Specifically accounting for them, even if only through a set of basic frontend functions, brings major productivity boosts to the programmers that use your library. It is a thing worth doing, and it sounds like the Google folks neglected to do that in this case.

    1. Re:Nice low-level API. Missing high-level API. by panic!_at_the_ring0 · · Score: 3, Insightful

      Uploading a file is simply performing a PUT on an object URI:
      http://code.google.com/apis/storage/docs/reference-methods.html#putobject

      Content goes in the HTTP request body.

      This is not rocket science. If you can't wrap your head around REST, wait for someone to come up with a RPC-style API.

  18. Re:Rule of the 5 Year Old and 7 Year Old by The+Flymaster · · Score: 3, Insightful

    ALL of it is user facing. That's the very point of an API. The user is the developer.

    This is a very, very important concept. As I said in my other post, this is a good API, a usable API. But so many APIs aren't usable. API usability should ALWAYS be considered when releasing a public library/service.

  19. Or in other words: by Hurricane78 · · Score: 3, Funny

    Are you just simply way too “dumb”* for the 21st-fuckin-century?

    I know I’m (sadly) a minority here. And I know that I will probably get modded to into oblivion. But except from the stupid overengineering... come on!
    How about for a change actually learning something, when it is useful for you?

    * I’m not even really saying that people are too dumb. It’s just that most people grew up in a culture, where it made more sense, to complain and feel entitled, to getting spoon-fed, than to understand it themselves. Where intelligent people get hate, and dumb people get special treatment (e.g. it not being allowed to point out that fact about their mental performance).
    So naturally, they choose the more efficient way.

    But the thing is, that we all are very much capable of grasping those complex concepts that we always say we were too dumb for. It’s just an excuse. And the more it is used, the more mental growth we miss. So after some time, we really have a hard time using our brains. Just like with a muscle. Just like we all are born with the ability to some day run for hours, every day, in the heat.

    So, no, they are not too smart. We’re just used to being lazy as hell.

    --
    Any sufficiently advanced intelligence is indistinguishable from stupidity.
  20. If anything, it's too simple by Animats · · Score: 3, Informative

    After reading through the API, if anything, it's too simple. You can't copy a bucket without reading it from Google's servers and writing it back, which is far slower than a copy carried out within their high-speed network. The "list" capability isn't well documented. The security model is about as dumb as the UNIX/Linux one; it doesn't have capabilities or anything like that. Bucket transactions are themselves atomic, but there are no user-specified atomic transactions. You can't, for example, rename "current" to "old" and "new" to "current" as an atomic transaction. (That's a normal operation in SQL, and a useful one when you've constructed a new copy of a mostly-static table and want to make it live.) Nor do buckets have version management. There's no way to read replication status; although bucket data is supposedly replicated, when does this happen? Right after uploading a bucket, or some time later?

  21. Oh, delicious irony. by FiloEleven · · Score: 3, Insightful

    theodp in this post quotes from a book entitled "The Dumbing-Down of Programming."

    Not content with infantilizing the end user, the purveyors of point-and-click seem determined to infantilize the programmer as well.

    Judging by this story submission, it turns out he's for it.

  22. Re:That API looks fine to me by DragonWriter · · Score: 3, Informative

    The only nonintuitive thing is the name "bucket", which might be better called "zone" or "filesystem".

    It might be better to call it "bucket", if one of your biggest target audiences was, say, developers already using and familiar with Amazon S3, a popular existing service in the same space that calls the same thing a "bucket" rather than a "zone" or "filesystem".