Slashdot Mirror


Google Data Liberation Group Seeks To Unlock Data

Several sources are reporting that The Data Liberation Front, a new engineering group within Google, is trying make it easier for users to move their data in and out of Google products. They have already "liberated" about half of Google's offerings (including Blogger and Gmail) and have plans to liberate Google Sites and Google Docs in the near future. "In a blog post this morning, Data Liberation engineering manager Brian Fitzpatrick, uses a good analogy to explain why the company sees this is an important step: 'Imagine you want to move out of your apartment. When you ask your landlord about the terms of your previous lease, he says that you are free to leave at any time; however, you cannot take all of your things with you - not your photos, your keepsakes, or your clothing. If you're like most people, a restriction like this may cause you to rethink moving altogether. Not only is this a bad situation for you as the tenant, but it's also detrimental to the housing industry as a whole, which no longer has incentive to build better apartments at all. Although this may seem like a strange analogy, this pretty accurately describes the situation my team, Google's Data Liberation Front, is working hard to combat from an engineering perspective.'"

47 of 167 comments (clear)

  1. So... by Drunken+Buddhist · · Score: 4, Funny

    So the idea is that making it easier to leave google makes you more likely to stay with google?

    I need to try this on my girlfriend!

    --
    -1, Disagree is not a valid option. Troll, Flamebait and Offtopic are not a substitute.
    1. Re:So... by Bragador · · Score: 5, Insightful

      You should. If you are not jealous and trust her, she'll feel more "free" in the relationship and stay with you. On the other hand, if you keep watching her and always remind her that she's yours, she'll get away.

    2. Re:So... by Yvan256 · · Score: 4, Insightful

      Doesn't the saying goes something like "The harder you squeeze, the more will slip through your fingers..."?

      So yes, in theory is will make people more likely to stay with Google. No fear of being locked means you don't look for a way out, which is a problem for Microsoft right now.

    3. Re:So... by Philip+K+Dickhead · · Score: 5, Funny

      This is Slashdot. The appropriate version of this plattitude goes:"The more you tighten your grip, Tarkin, the more star systems will slip through your fingers".

      At the suggestive notion of Princess Leia, and the salacious interpretation of "Slip through your fingers", many of the regular posters will now compulsively grasp their crotch, as the OggTheora of "Slave Leia's Supplication" is summoned from Portable VNC on the USB key, once again...

      --
      "Speaking the Truth in times of universal deceit is a revolutionary act." -- George Orwell
    4. Re:So... by m.ducharme · · Score: 4, Funny

      Must....not....fap....

      --
      Rule of Slashdot #0: You and people like you are not representative of the larger population. - A.C.
    5. Re:So... by rolfwind · · Score: 2, Insightful

      So the idea is that making it easier to leave google makes you more likely to stay with google?

      This is an excellent idea on google's part. It's like that old IT truism whereby the more necessary a programmer becomes, the sooner you should get rid of him.

      It could help small businesses and organizations decide to go with google, if they have guarantee of local backups as well. Nothing is more annoying than being able to put data in, but not getting it out in any timely, consistent fashion - which is the failure of many web-based solutions. Especially as Google is aiming to have all the productivity tools on the web - email, web, documents, etc.

    6. Re:So... by DragonWriter · · Score: 2, Informative

      So the idea is that making it easier to leave google makes you more likely to stay with google?

      No, the idea is that making it easier to leave particular Google services makes it more likely that people will use those services in the first place, not that it makes them more likely to stay with them once they start using them.

    7. Re:So... by danieltdp · · Score: 3, Insightful

      On the other hand (no pun intended), if you completely open your hands, the butterfly will simply fly away.

      As always, the solution lies in the middle: you should neither squeeze nor open your hands, but simply hold it gently :-P

      Coming back to the topic. Being possible do leave will make more people willing to get-in in the first place

      --
      -- dnl
    8. Re:So... by l3prador · · Score: 2, Insightful

      This is a good strategy if and only you are confident that you are the best option available. In Google's case, this is probably true, but I can't speak for the GP's case. (Although the fact that confidence is attractive to most women might help in this case.)

    9. Re:So... by jdgeorge · · Score: 3, Funny

      Hmmm.... my mind goes back to a girl I left long years ago, who told me, "I, for one, welcome my new, liberating overlord."

      Gah! Meme conflict... or... hey....

    10. Re:So... by bitt3n · · Score: 2, Funny

      You should. If you are not jealous and trust her, she'll feel more "free" in the relationship and stay with you. On the other hand, if you keep watching her and always remind her that she's yours, she'll get away.

      this is one of those situations where either solution will work, just don't use half measures. It's either "complete freedom" or "manacled in a half-mile deep concrete bunker somewhere in a remote region of desert in New Mexico." Mutual respect and devotion, or such abject desolation as sucks out the will to live, leaving a mere husk of a living thing groveling at one's feet for death. Every relationship is different, and romance is always about surprises, so don't hesitate to go with your instincts.

    11. Re:So... by HamburglerJones · · Score: 2, Insightful

      I've met plenty of women who love the jealousy and control.

      I call those chicks "women I don't want to date."

  2. Do No Evil? by Anonymous Coward · · Score: 4, Funny

    This is an even-numbered, "Do No Evil" week.

    Watch out next week though.

  3. The Anti-AOL by chill · · Score: 5, Interesting

    This is one of THE major complaints about AOL. Easy to get data in, impossible to get out.

    Just last month I was asked to assist someone to get all their contacts (1,500 or so) out of AOL's mail system. There is no export feature, nor any third-party tool to do it. AOL's official answer is to print it out for a backup.

    I called AOL's support, and after several rounds of phone-tree hell, got a tech who told me flat out "We don't do that. Good luck!"

    I ended up writing a script that parsed the XML-like output of their "print" function. Print to screen, save to file, parse with Perl. It hoses up the contact lists, which are included and just end up creating duplicates. They don't output as lists at all.

    Still, it was marginally better than hiring someone to retype it all by hand.

    --
    Learning HOW to think is more important than learning WHAT to think.
    1. Re:The Anti-AOL by imunfair · · Score: 4, Funny

      AOL is actually free now, but back when they charged it was more of a feature than a problem that they wanted to retain customers. As long as you were willing to call them every month or two you could obtain completely free service. Sign up for a trial and when it was about to expire just call and say you wanted to cancel - they would usually help you find an excuse to extend your trial by a month or two more. Once the extension was nearly up - call again. As far as I could tell you could do that forever - I tried it for about a year.

      Story bonus: They also had little surveys you could fill out for discounts off your subscription fee ... but if you were on a trial account they would actually mail you a check for the amount you 'earned'. It was only a few dollars but I found it amusing to get paid to have an AOL account.

    2. Re:The Anti-AOL by Jay+L · · Score: 2, Interesting

      I left AOL in 2001, but my roommate wrote the original Personal Filing Cabinet, and I can confirm that there's no known official way of exporting any of it, or at least there wasn't last I checked. There are some third-party tools that do a so-so job of the mail itself, but they are very picky about which AOL client version you have, and I don't know if they export the address book itself... and it looks like they've all been abandoned anyway (there was ForMorph, PFCViewer, and FvonGordon's PFC Converter).

      And yes, it's cool to see Google doing this of their own (apparent) volition. It's tempting, when you're the 800-pound gorilla, to view your user base as a captive audience, and to make it as difficult as possible to switch away (we used to call that "flypaper"). But in the long term, it encourages competition, which fosters innovation, which benefits everyone.

  4. Interesting atitude, "Anti-lockin"... by nweaver · · Score: 5, Interesting

    This is both the big advantage (for providers) and disadvantage (for customers) with SaaS-type "cloud" services: data lock-in. Its interesting that Google believes that they can compete enough on quality that lock-in is no longer an advantage to them because it scares away more potential customers than it traps.

    --
    Test your net with Netalyzr
    1. Re:Interesting atitude, "Anti-lockin"... by QuantumRiff · · Score: 5, Insightful

      They have a HUGE upside to helping people move their data out of Exchange servers (emails, contacts, appointments, etc) into the paid Google Apps service.. Last time I looked, their tools for doing just this were coming along nicely. That was one of the biggest complaints, getting the email and archives out. This same thing was a big pain, when MS wanted people to migrate from Groupwise and Lotus Notes to Exchange. MS made a nice little importer, but they didn't make their data easy to Export.

      That can lead to very tempting sales pitches, give us 6 months, (or a year, or whatever) and if you don't like our service, we'll help you go right back to what you had before.

      --

      What are we going to do tonight Brain?
    2. Re:Interesting atitude, "Anti-lockin"... by ducomputergeek · · Score: 2, Interesting

      That's why we give our customers 5 methods of export: PDF, Word, Excel, CSV, and XML. Every order, customer, report, and product can be exported for back up or to take elsewhere. The only thing they can't get to is credit card details. And we won't release those for obvious reasons. So that might be a headache if they switched to another service, but...

      --
      "The problem with socialism is eventually you run out of other people's money" - Thatcher.
    3. Re:Interesting atitude, "Anti-lockin"... by CodeBuster · · Score: 3, Insightful

      Its interesting that Google believes that they can compete enough on quality that lock-in is no longer an advantage to them because it scares away more potential customers than it traps.

      With the rise of strong or at least credible competition from many open source products and a greater user awareness (although still not universal) of the perils of lock-in, the use of lock-in as a strategy by proprietary software vendors is becoming progressively less valuable. In fact, a tipping point may already have been reached whereby, as you stated, the number or users entrapped is not outweighed by the number of users scared away by the trap. This is a good thing for both consumers and the marketplace because it removes or lessens the impact of a classic barrier to entry in the software business. Google is wise to recognize and exploit this against other large competitors, such as Microsoft and Autodesk (which is infamous for their proprietary file format lock-in on their AutoCAD products), that have historically favored lock-in or at least done little or nothing to facilitate interoperability.

  5. The Life of Google by Anonymous Coward · · Score: 5, Funny

    Guy 1: Are you with the Data Liberation Front?
    Guy 2: No, we're with the Liberation Front for Data!
    Guy 1: Oh, well at least you aren't with the Front for Data Liberation!

    1. Re:The Life of Google by Anonymous Coward · · Score: 3, Funny

      SPLITTERS!

      so, aside from free search, email, blogging, maps, docs, apps - what has Google ever done for us?

  6. MapMaker vs. openstreetmap by stvn · · Score: 4, Interesting

    I'm very curious how they are going to liberate the user added data in Google Maps/Mapmaker. Right now the 'community' adds raw data like streets & locations but 'only' get back PNGs with colors representing streets and locations. Granted this is enough for most people. But Openstreetmap has been doing similar work and allows users access to the raw data, resulting in totally different uses than just simple PNG-maps. It would be awesome to tap into the raw mapmaker data and combine it with raw openstreetmap data for for instance routing, vector based maps for mobiles (smaller!) etc

    1. Re:MapMaker vs. openstreetmap by Richard+Fairhurst · · Score: 3, Informative

      But there's not a lot point exporting the data if you don't have the rights to use it.
      That's what the top-ranked Data Liberation suggestion is talking about - great that we can get the data out; but now allow us to use it elsewhere without fear of being sued for breach of copyrighted.

    2. Re:MapMaker vs. openstreetmap by stvn · · Score: 2, Interesting

      I'm very curious how they are going to liberate the user added data in Google Maps/Mapmaker.

      I'm not sure if this covers the "user added data" you are concerned about, but -- from the Data Liberation Front page linked in TFA -- the main mechanism for getting your data (either "My Maps" or "Saved Locations") out of Google Maps is via KML export.

      There are some caveats on this KML export, for instance you're not allowed to bulk export data: "Also, you may not use Google Maps in a manner which gives you or any other person access to mass downloads or bulk feeds of numerical latitude and longitude coordinates."
      This is a vague limitation; can I get all my tens of bicycle paths back and what about the tens or hundreds friends of me did etc.
      I do understand that entering 'public' data (where roads are) is different from private data (gmail). So the DLF is doing a good job on the latter, but I'm curious about the former: user contributed public data. I can see the result of an added road by user X, so why can I not access the raw data?
      There is an interesting discussion going on on Ed Parsons (google) blog http://www.edparsons.com/2009/09/liberating-your-my-maps-data/

  7. Re:Bad analogy by Yvan256 · · Score: 3, Funny

    No way dude, they wouldn't do something evil like that. I really take my stuff and they keep the low-quality copy!

  8. OMG by sonicmerlin · · Score: 3, Funny

    I am SO sick of Google. They are giving every corporation a bad name by being so unevil.

  9. hippies by ArhcAngel · · Score: 4, Funny

    Damn capitalist hippies!

    It's getting where an evil mega-corp can't make a bazillion bucks anymore.

    --
    "A person is smart. People are dumb, panicky dangerous animals and you know it." - K
  10. Useful email backup tool by imunfair · · Score: 3, Interesting

    I've been looking for a good way to get a bunch of old email out of my yahoo account for a while without paying for a premium account... this actually looks like a good option! Judging from the screenshots I can import my email into gmail and then grab it via POP/IMAP.. now off to try it :)

  11. Re:interesting analogy by andymadigan · · Score: 2, Interesting

    Even for a minority member of the market it is to their advantage. Advertising that it is easier to move (and scaring consumers that other vendors/landlords "lock you in") gets you customers. This either means you end up with more customers, or you force everyone in the industry to add the ability to move. If they choose the latter, then you can compete on features and be able to easily pull customers from other vendors.

    --
    The right to protest the State is more sacred than the State.
  12. Mistaken analogy by Anonymous Coward · · Score: 2, Insightful

    Doesn't he mean, "You wouldn't choose to enter into that lease in the first place."

    I.e. people won't use Google products until they can avoid lock-in.

  13. Re:Bad analogy by jfengel · · Score: 5, Insightful

    The analogy, as with most analogies, is useful for precisely the things it was designed to be useful for, and is misleading when extended.

    There is a legitimate fear of Google's tools that you can't apply any other tools to your data. These guys are trying to fix that problem.

    There is another legitimate fear that you can't delete your data for certain and ever. That's Somebody Else's Problem, and also not covered by the analogy.

    Analogies can be useful to explain things, but they're rarely valid for actually proving things. They're useful for proofs only when the analogy is so precise that it's no easier to understand or manipulate than the original thing.

  14. my favorite essay on who has your data by NewToNix · · Score: 2, Interesting
    One of the best essay's about where you keep your data I've ever read:

    http://linuxmafia.com/faq/Essays/winolj.html/

    Rick Moen . . .

    INOLJ-OOW2.0C (Is Not On LiveJournal Or Other Web 2.0 Cults)

    It's worth the read.

  15. Most important use case missing by mwvdlee · · Score: 3, Informative

    So you can get your data out when you want to move to different sites/applications.
    What about getting your data out if Google decides to stop the site/app, decides to stop the "Liberation Group", decides to delete your data from it's systems or somehow has to stop business.
    This "Liberation Group" thing simply ensures you can get your data only when you least need to.

    --
    Slashdot social media options: AIM, ICQ, Yahoo, Jabber and Mobile Text. Why no MySpace?
    1. Re:Most important use case missing by DragonWriter · · Score: 3, Insightful

      What about getting your data out if Google decides to stop the site/app, decides to stop the "Liberation Group", decides to delete your data from it's systems or somehow has to stop business.

      If Google gives you the tools to export your data on demand (which is what most of this amounts to, on the export side), then you can decide how frequently you want to archive it to protect against that kind of eventuality, just as you would with local storage. Yes, you run some risk of catastrophic, no-warning failure/cancelation of Google as a whole or the particular service, but you do that with most forms of storage under your own control as well, and, in either case, you can backup your data to mitigate the risk.

      This "Liberation Group" thing simply ensures you can get your data only when you least need to.

      That seems to require accepting a particularly odd definition of "when you least need to".

  16. Re:Bad analogy by 0xdeadbeef · · Score: 2, Funny

    Dude, did you know the government puts fluoride in the drinking water? It's true!

  17. Re:interesting analogy by volsung · · Score: 4, Insightful

    I think often people confuse "altruism" with "long term self-interest," and that may be the issue Google is considering here. In the short term, you can make it hard for tenants to move out, and maybe gain a little bit of rent that you would not have otherwise gotten. However, people talk and, in the long term, behavior like that can lose you potential customers. You will be forced to drop your rent in order to keep your units full.

    (This relates to the best description of "business ethics" I've heard: Ethical business requires that you balance the needs of and try to act in the best interest of your owners, employees and customers. Otherwise, in the long run, you will find yourself without capital, labor, or revenue. Thus, business ethics is about long term self-interest, not some kind of abstract altruism. Sometimes the "long run" takes a really long time, encouraging people to risk unethical behavior, of course.)

    Making it easier to leave Google applications helps grow your potential customer base in the future (such as those who are wary of lock in), at the risk of losing current customers who are unhappy with your service. That is a motivation well-rooted in self-interest, as long as you think your product is better than everyone else's.

  18. Re:interesting analogy by Red+Flayer · · Score: 2

    The obvious problem is that no particular landlord is interested in "the housing industry as a whole": they're interested in their own corner of it. And so it's not clear why the landlord would want to do something to make it easier for tenants to move out, just because the end result is good for "the industry as a whole", unless they're altruists.

    Landlords would want to make it easier for tenants to move out because then it's easier to get tenants to move in. You'd get more people interested in being tenants, if they knew they wouldn't have to leave all their stuff behind when they left. This increased demand for rental spaces means that existing capacity is more likely to be filled, and new capacity built as demand makes it profitable.

    But it's a little much to expect people to follow a clumsy tenant/landlord analogy when a perfectly good car analogy can be made.

    This is like you rent a truck for a big shopping trip, but when you return the truck you also have to hand over all the stuff you bought. The Google Data Liberation Group is working to ensure that you get to keep all the stuff you bought on your excursion, and you'll even be able to put it in the back of a competitor's truck if you decide to rent another one.

    Except Google has old-tymey magickal replicator technology, and they kept a copy of all your stuff, and detailed records of how and where you bought it, so that they can make sure that you're bombarded with ads for products and services related to what you bought.

    --
    "Trolls they were, but filled with the evil will of their master: a fell race..." -- J.R.R. Tolkien on Olog-hai
  19. Re:interesting analogy by Trepidity · · Score: 2, Interesting

    It raises risks, though: not only do you have to think your product is better than everyone else's, but that it'll stay that way indefinitely. I think a lot of companies aren't that confident that, sometime in the future, someone else won't come along with a better---maybe even much better---product. Then they're suddenly out of business, unless they've made it harder for people to quickly switch. If they did make it hard to switch, though, they'll have residual business for years after being obsoleted, from locked-in "legacy" customers.

    Depending on how you value risks, it might not be irrational to accept slower growth (scare off customers due to lock-in) in return for diminished chance of rapid, large-scale customer desertion (they can't easily leave, due to lock-in).

  20. Re:interesting analogy by sukotto · · Score: 2, Insightful

    It reduces the competitive moat yes. BUT it also give people more incentive to try your product. "Hey, if it doesn't work out you're not locked in. so why not START with us and if you're ever unhappy then you can move on.". The best next step for them is to make it really easy to get your data into their product line from their competitors. Like that guy upthread who was trying to extract 1.5k contact cards from AOL, for example.

    This is good press for them on multiple levels.

    --
    Come play free flash games on Kongregate!
  21. Re:Bad analogy by c0d3g33k · · Score: 5, Insightful

    No. The reason it's a bad analogy is because it misses the key and only crucial point: the fundamental disconnect between "your things" and "cannot take" when the latter is arbitrarily imposed on you by a party that has no legitimate claim on the former. The landlord has no claim on "your things" unless you have breached contract somehow, like not paying rent. Otherwise taking "your things" with you when moving out is an activity not to be questioned at all. A better analogy might be that the mere act of moving in resulted in the landlord claiming "your things" were now "his things" without any justification supported by law or common cultural practice. The Google Data Liberation Group is (belatedly, IMHO) expending energy to rectify a situation that should never have existed in the first place. A laudable effort, to be sure, but one that should not have been necessary.

  22. Obligatory car analogy by noidentity · · Score: 2, Insightful

    Imagine you've been driving your car for years, and have accumulated lots of map notes, music, and playlists in your car's navigation and music systems. When you decide you want to buy a new car from a different manufacturer, you're free to do so, but you can't simply transfer all your settings to the new vehicle, even though it has similar systems. The only way to move it all over is to manually re-enter/recopy each item, which would take many hours.

  23. Re:If Microsoft did this... by LordLimecat · · Score: 4, Insightful

    Are you unaware of their export-to-CSV capabilities..?

  24. Names by dazjorz · · Score: 3, Funny

    Google More Obvious Name Group Seeks To Make Names More Obvious

  25. It's a *perferct* analogy by mangu · · Score: 3, Insightful

    With Google The Evil (tm), you have no guarantee that they haven't stashed a "backup" somewhere in their dark recesses. You don't really take your stuff, you just make a copy.

    No, you take out your stuff, they may keep a copy.

    The leased apartment is a perfect analogy in this respect. No one can be sure that the landlord didn't use his master key when you were away and took pictures of all your stuff. Maybe he has his own apartment decorated exactly like yours.

    But why should he? Unless you are a world-famous interior decorator, what reason would anyone have to copy your layout? Likewise, what incentive does Google have to keep copies of your data? They may keep information about you, for statistics, just like a marketing researcher may look into your trash can to see what products you buy, but that's not such a big deal.

    I think people are too nervous about the assumed value of their on-line data. Think of how much data about you was public long before home computers existed. Your phone number and address are written in a book that's given for free to everyone who has a telephone. You carry a plate with a unique id code on the outside of your car. Every cheque you use to pay something has your signature and bank account number. All these items can and *have* been used by fraudsters in the past. Why should we get more nervous just because the data is in a digital format?

  26. Exporting the data is only half the battle. by queazocotal · · Score: 5, Interesting

    The highest rated suggestion - over a thousand votes - on the data liberation site is about Google Maps.

    Specifically - the rather loose definition of what we can and can't do with the data.

    http://moderator.appspot.com/#15/e=43649&t=4364a

    You can extract a kml from a my-maps thing you've drawn on top of googles satellite imagery easily.

    But what can you do with this?

    Google have made vague and unclear statements that 'bulk' use is not allowed - without saying what this is.

    Yahoos terms and conditions allow uses like this, and much of OpenStreetMap has been helped by this for example - people able to trace streets, streams, and ...

    But the license for data derived from maps is still unclear - can I for example take a list of 3000 river crossings from google, crowdsource how easy they are to get across with a 4x4 or a donkey, and then publish this list?

    And if I sell the list, or publish a book of maps using this data combined with openstreetmap data?

  27. Re:Google Pervasiveness Front by lwsimon · · Score: 2, Insightful

    While this is a valid concern, you can take it too far. As a private citizen, it doesn't really bother me that Google crawls my email and my contacts' email and uses keywords to target ads. As a business, it would be more concerning, but even then only for certain types of data.

    At the end of the day, they provide a service and need to be paid. They get paid through targeted ads - so if you don't want to see targeted ads, you're not "paying" Google, and why should they do things for you then?

    It would be "evil" if they weren't up front about it or denied it - but data mining is Google's primary business, and they aren't hiding it. I've yet to see any instance of them declaring data sacred and then parsing it for their own purposes, either.

    In short, I see no evidence that Google is "evil" - merely that they aren't doing things the way that a lot of F/OSS folks would prefer. They aren't making their money off support though, so that's expected.

    --
    Learn about Photography Basics.