Slashdot Mirror


Ex-Google Engineer Blasts Google's Technology

lee1 writes "Dhanji R. Prasanna, an engineer who recently resigned from Google, describes Google's famous back-end infrastructure as a collection of obsolete technologies, designed 10 years ago for building search engines and crawlers. He blasts MapReduce and its closed-source friends as 'ancient, creaking dinosaurs', compared with outside open source projects like MessagePack, JSON, and Hadoop. He also criticizes Google's coding culture, which has become unfriendly to hacker types due to the company's enormous size." I suspect that most people would be happy to have company infrastructure problems as pressing as Google's, though.

38 of 158 comments (clear)

  1. There is nothing easier... by Anonymous Coward · · Score: 2

    Than finding fault in what people choose to do.

  2. Former Employee Has Chip on Shoulder... by Nethemas+the+Great · · Score: 4, Funny

    news at eleven.

    --
    Two of my imaginary friends reproduced once ... with negative results.
    1. Re:Former Employee Has Chip on Shoulder... by OverlordQ · · Score: 4, Interesting

      Not just former employee:

      As a member of the Google Wave team, Prasanna helped build the search and indexing pipelines for the ill-fated effort to reinvent communication on the web

      Probably angsty nobody liked his baby.

      --
      Your hair look like poop, Bob! - Wanker.
    2. Re:Former Employee Has Chip on Shoulder... by Anonymous Coward · · Score: 2, Interesting

      I read his posting as well as those of his friends who've also recently quit, and one of them had a better critique that seemed to explain why Wave turned out as the jumbled mess that it was. From the post:

      If you pitch an idea or a project to Larry and Sergey, their feedback is quite easy to anticipate. They'll tell you you have to solve the problem in a more generic way. ... Come up with something that solves everything!
      ...
      Wave is a case in point. Wave started with some fairly easy to understand ideas about online collaboration and communication. But in order to make it more general and universal, more ideas were added until the entire thing could only be explained in a 90 minute mind blowing demo that left people speechless but a little later wondering what the hell this was for.

      To me, that perfectly explains why Wave turned out the way that it did. Rather than building a simple tool and adjusting it based off of how people used it, they tried to come up with the single solution that solved every problem. They ended up producing something that solved many interesting technical challenges but did very little to solve anyone's real-world problems.

      It could be that this is specific to Wave and the fact that all this disgruntled feeling is coming from one group may not be an indication of any larger problem at Google. On the other hand, if this attitude is as pervasive as it's claimed, I can see it being incredibly frustrating to work there as an engineer. Imagine having a good idea, then having management talk you into turning into some grandiose and monolithic monstrosity that then gets panned as being overly complex and difficult to understand when all you wanted to do in the first place is make a smaller tool that would have been ideally suited to a more limited task and would have been well received and appreciated by those that used it. I know I'd be bitter if I'd wasted years of my life pursuing someone else's mutated version of my own idea.

    3. Re:Former Employee Has Chip on Shoulder... by dudpixel · · Score: 3, Informative

      Wave was misguided. It had really cool tech and it did have potential...

      but where they failed was they couldn't even tell people HOW to use or even WHY they'd want to.

      I thought of things I could use it for, but when telling others about how it worked, not only could I not explain it well (who could?), no one really saw the point of it.

      FAIL is an understatement.

      --
      This seemed like a reasonable sig at the time.
    4. Re:Former Employee Has Chip on Shoulder... by MrAngryForNoReason · · Score: 4, Insightful

      I think this is the lesson we can all learn from Facebook. To succeed a technology doesn't have to be particularly well built or ambitious in solving problems. It just has to be easy enough to use that everyone can understand it and use it without too many problems. Facebook has so many users because it can be summed up in very simple terms, 'it's for sharing photos with your friends', 'it lets you see what people are doing'.

      Google Wave may have been a technological marvel and a solution to all kinds of problems but when it launched no-one knew what it was for, so nobody bothered using it.

    5. Re:Former Employee Has Chip on Shoulder... by Kamiza+Ikioi · · Score: 2

      Probably angsty nobody liked his baby.

      I heard 5 people liked it. That's more than anyone can say for MySpace today.

      --
      I8-D
    6. Re:Former Employee Has Chip on Shoulder... by ColdWetDog · · Score: 2

      Right, because no one ever bought Lotus Notes.

      Not voluntarily, anyway.

      --
      Faster! Faster! Faster would be better!
  3. Re:MapReduce vs Hadoop by MightyMartian · · Score: 4, Funny

    I'm sure he's pushing his own brand new technology, Sour Grapes

    --
    The world's burning. Moped Jesus spotted on I50. Details at 11.
  4. I wonder by ModernGeek · · Score: 4, Interesting

    Does an obsession with following a certain set of methodologies always benefit the bottom line?

    --
    Sig: I stole this sig.
    1. Re:I wonder by Kjella · · Score: 4, Insightful

      Ideally you'd pick the best solution for the problem every time. The problem is then that you end up with very many solutions, and you need ideal people who understand all of them.

      Methodology is a way of narrowing down the variables, here we do it this way and that's what you need to learn too. That way developers become more flexible and components more reusable.

      Then you go too far and try banging the square peg in the round hole. Obsession is not good. Total lack of methodology is not good. As usual the answer is somewhere in between, that kind of fuzzy answer nobody really likes.

      --
      Live today, because you never know what tomorrow brings
  5. Re:Hadoop? by sockman · · Score: 2

    The original paper from google was "MapReduce" of which Hadoop is an open source implementation of the concepts described in the paper.

    http://labs.google.com/papers/mapreduce.html

  6. Haha by unity100 · · Score: 3, Interesting

    the guy got so accustomed to good that his standards seem to have perpetually got raised. he thinks google's state is 'bad'. lucky him.

    1. Re:Haha by shutdown+-p+now · · Score: 3, Insightful

      My thoughts exactly. He sounds like someone in academia land - the same guys who think that most industry players are dinosaurs for not using Haskell and similar bleeding edge stuff.

      In truth, all big players have to be reasonably conservative in the adoption of technology, because otherwise the risks become unmanageable. For example, Google standardized on Java, C++ (or rather a fairly conservative subset thereof), and Python - all mature, established platforms. On the other hand, Google does actively participate in development of those; not sure about C++, actually, but they definitely have a strong presence in Java development process, and Python - well, Guido is a Google employee. And then there is experimental stuff, such as Go, being slowly adopted.

      Few companies can boast being that far ahead from the bulk (think of all the companies still on Java 1.4 for in-house development, for example). If he's not content with this arrangement, then he shouldn't work for a company of that size in the first place. Find some startup where they can implement crazy ideas just like that, just to see if it works or not (and possibly fail if it doesn't, but on that size, who cares?).

  7. Academia v. industry by antifoidulus · · Score: 5, Insightful

    This guy seems to have never lost his academic mindset, it's not at all surprising, or bad really, that Google is keeping around old technology. Guess what, they have this thing called operations where they pretty much have to be up 24x7 so that they can serve customer requests. They cannot just start dumping infrastructure that:
    a) work and
    b) they have invested significant amounts of money in
    just because some new technology came around. If everybody in industry did that, it would be absolute chaos and nobody would be able to get anything done. This is just as true in computers as it is with steel mills.

    Now compare this with academia, where they have no real customer base to speak of. They can constantly push the boundaries, try new technologies, change their infrastructure etc. That seems to be where this guys mindset remains.

    Note that I'm not bashing academia as being out of touch with "reality" or anything like that, the entire POINT of academia is to push these boundaries, industry exists to take these advances, combine them with their own, and then deploy them in an operationally efficient manner.

    1. Re:Academia v. industry by back@slash · · Score: 4, Insightful

      Was going to post something similar. I've observed that at some point most developers go from "must always use the latest and greatest" mindset out of college to "if it ain't broke don't fix it" mindset that comes with a few gray hairs. Just like any company Google would need to justify the cost of upgrading to newer technologies against any new capabilities the technologies would enable to either save costs or drive new revenue. If that cost can't be justified they could be running on existing technology for a long time (of course ensuring that you can hire people that know enough about these technologies is another story..)

      --
      This comment was generated by a Squadron of Ultra Ninjas
    2. Re:Academia v. industry by stabiesoft · · Score: 2

      Agree completely, I think he should work at facebook. I hear they roll stuff out all the time for users to test for them. Skype seems to be following that model as well. I am quite satisfied that google operates as they do as I rely on them being there and working for search and so far they have never gone offline. I'm glad he left.

    3. Re:Academia v. industry by kangsterizer · · Score: 4, Insightful

      Does it matter?
      The point is, Google was once pushing technology. And now, they are not, at least, in these very fields.

      None of your I-like-Google post goes against what the guy says. In fact, you're supporting his claims.

      Neither are bad things - but I can understand an engineer who wants to use the latest tech or invent new innovative tech instead of using 10 year old stuff.

    4. Re:Academia v. industry by wrook · · Score: 2

      I've observed that at some point most developers go from "must always use the latest and greatest" mindset out of college to "if it ain't broke don't fix it" mindset that comes with a few gray hairs.

      Yeah. You get to a point where you realise that eating different food doesn't necessarily result in making your shit any more appealing. One thing about using the bleeding edge is that it pretty much guarantees that you don't know how to use it properly. You don't have any experience to tell you what is appropriate and what isn't. You don't even have a lot of examples to show you how to avoid issues and how to write code the way everyone else does (because everyone else *doesn't* yet). The industry is littered with new projects that suck just as hard as the things they were supposed to replace.

  8. Seriously? by fyzikapan · · Score: 5, Insightful

    10 year old tech? My last job was using a bunch of stuff originally built in the 1970s! This guy needs to get a grip on reality. You don't throw out something that works, even if it's a bit kludgey sometimes, simply because there's some fancy new thing.

    1. Re:Seriously? by Anonymous Coward · · Score: 2, Interesting

      Don't tell him how old NASA's space shuttles are?

  9. Re:MapReduce vs Hadoop by sortius_nod · · Score: 2

    While I know google doesn't require apologists, I always have a little chuckle when I read articles like this. So what if it's 10 year old tech, it seems to be working well for them. Sour grapes and a healthy serving of plug-my-own-products.

  10. Translation by crow_t_robot · · Score: 4, Funny

    Heaven SUCKS! The noise of all the angel's wings flapping is making it difficult to truly enjoy my harem of supermodels, swimming pool filled with wine and diamond roller skates! I'M OUTTA HERE, SUCKERS.

    1. Re:Translation by maxwell+demon · · Score: 3, Insightful

      Seriously, I read "resigned from Google" and had to take a few minutes to get my mind around that concept. Especially if he was a coder. They treat coders like demi-gods.

      Well, maybe that's the problem: He didn't want to be treated as mere demigod. :-)

      --
      The Tao of math: The numbers you can count are not the real numbers.
  11. Actual Link by batrick · · Score: 3, Informative
  12. Don't dismiss Dhanji's street cred as a developer by MurrayTodd · · Score: 4, Interesting

    His book on Dependency Injection is one of the few recent computer books I had to go through carefully, and with notepad and highlighter in hand. His work on Google Guice is really notable. This ain't just some Microsoft-bound disgruntled guy.

    But it's not necessarily surprising. I'm not very familiar with it, but Google's Wave was one of those allegedly killer technologies that just didn't get the corporate support it needed to reach its potential as a disruptive technology. Still, there's a possible tone of sour grapes here. Hard to know.

    I'll just say this: I would love to have the privilege to work with someone of his caliber.

    --
    Murray Todd Williams
  13. Obsolete is the new stable? by phoebe · · Score: 2

    I think many other companies would be happy to have remotely 'ancient, creaking dinosaur' technology. I ponder to think what the authors opinion of infrastructure technology in the rest of the world that would be lucky to be only 15-20 years old.

    Citing MessagePack is certainly surprising as that particular technology is significantly worse than Google Protocol Buffers, the website is littered with bad test procedures and many errors. Google's serialization doesn't have the speed of say TIBCO's QForms or the compactness of Reuters RForms but it is pretty clear from their documentation that flexibility and easy management were preferred goals over utmost highest performing technology.

  14. Re:MapReduce vs Hadoop by beelsebob · · Score: 2, Insightful

    To be honest, it sounds like a guy who thought that he knew best, and wanted to just mash bad code out... Google told him to write good code or fuck off... he chose the latter.

  15. So what? by rickb928 · · Score: 2

    All my ex'es blast me too. And for good reason. According to them.

    The moved on to another loser of their own making. How's that workin for ya, honey? Gotten through his six months worth stupid stories yet? Ask him how he likes your hyena-like laugh. Later, babe. See if your latest will move you into your new trailer. Love your new hair.

    ps - Hackers struggle in almost every corporation. Something about breaking stuff and not valuing availability over innovation. So do I want a hacker mentality ruling at my bank? Depends. Keep them away from the transaction system and the website, so I can get in and get my money, ok? The ops guys hose it up enough already.

    --
    deleting the extra space after periods so i can stay relevant, yeah.
  16. The dude needs to grow up by alexmin · · Score: 2

    He will see the point in using those "obsolete" (read stable) technologies in 10 years: the goal of business is to make money, not make work by constantly upgrading.

  17. Re:MapReduce vs Hadoop by MightyMartian · · Score: 3, Insightful

    The fat is that Google's products, by and large, work. If the whole damned thing is floating on top of Pentium IV's with 2gb of RAM, or whatever, does it matter? It's a moronic position, and clearly one formulated as an excuse to show how superior what he's doing is. What a prick.

    --
    The world's burning. Moped Jesus spotted on I50. Details at 11.
  18. All grown up by CaroKann · · Score: 2

    Sounds like to me that Google's all grown up now.

  19. Is it working, though? by t2t10 · · Score: 2, Insightful

    Google has had a number of failures, and they do seem to have a hard time pushing out obvious updates and improvements to many of their products. Think about what it says if a company with 26000 employees can't keep a services like Wave going and instead suffers the embarrassment of killing it off three months out of beta.

    The reason you still see so much tech coming out of Google is because they have hired a large chunk of the best coders in the world. Google has so many good employees and so few core products that it can be argued that they are actually not working very efficiently.

  20. Re:MapReduce vs Hadoop by cshark · · Score: 2

    I thought the real insight in the article came from the piece about the coding culture. Staking out territory and maintaining complete control of the design and implementation of systems. If that's the case, is it any wonder the systems are obsolete? The way I see it, this article is really less about how antiquated Google's systems are, and more about how pig headed the culture can be. Made sense to my feeble warped mind anyway.

    --

    This signature has Super Cow Powers

  21. Re:MapReduce vs Hadoop by MightyMartian · · Score: 2, Insightful

    The big lead isn't the equipment. It's the AdSense algorithms. This guy is blowing smoke out his ass.

    --
    The world's burning. Moped Jesus spotted on I50. Details at 11.
  22. Re:MapReduce vs Hadoop by im_thatoneguy · · Score: 2

    It matters because successful organizations often don't feel the need to continue innovating. "After all Google Is print money, why change?" And small little problems start cropping up. This feature becomes difficult to maintain. This product starts to lag behind the competition a little bit. But all of it can be ignored since they're still so successful.

    Eventually some little whipper snapper comes along and eats their lunch (usually founded by 'sour grapes' ex-$organization members).

    It becomes particularly problematic when a single organization starts to establish fiefdoms. Microsoft being the obvious case study. You can't add XYZ to ABC because it'll compete with UVW. It's good to have competition but you don't want to stifle disruptive technology since your competition won't be so accommodating in disrupting your existing product line.

    Maybe what you have is working. But someone out there is cooking up something that's not just working... it's better. If you're in the lead you have to start competing with yourself.

  23. Re:MapReduce vs Hadoop by DigiShaman · · Score: 3, Interesting

    Renegades. They're the non-team player types that shoot from the hip (without drawing), and fly by the seat of their pants. They're the most dangerous and reckless type of employees you can have. Oh, and the concept of a contingency plan? It doesn't even cross their mind. If you ask, you will get the typical "what ever, please..."

    If you have a renegade for a boss, leave your company, like yesterday. Trust me on this.

    --
    Life is not for the lazy.
  24. Re:MapReduce vs Hadoop by Idbar · · Score: 3, Insightful

    And the only thing that comes to my mind is: If Google manage to get its revenue and performance from ancient technology, I don't even want to imagine what they can do if they... well, upgrade.