Slashdot Mirror


Ask Slashdot: Building a Personal FOSS Cloud?

An anonymous reader writes "Cloud-based personal data management is pretty cool... if you don't mind entrusting the entirety of your personal data to a gigantic corporation. Apart from the risks of their doing unseemly things with your data, also the security of your data is entirely in their unreliable hands. So, is it possible to build my own personal data repository, where for example, I can store my contacts and calendars to sync to multiple devices? This could be hosted on any third party hosting service assuming also that all of my data was encrypted at the data level. So even if the host wanted to look at my data, all they'd see is 1s and 0s. What are the options for the tinfoil hat wearing FOSS folks that want to participate in the cloud age?"

44 of 189 comments (clear)

  1. Thanks for sharing by Anonymous Coward · · Score: 5, Insightful

    So even if the host wanted to look at my data, all they'd see is 1s and 0s.

    That was the dumbest thing I read all day.

    1. Re:Thanks for sharing by masternerdguy · · Score: 5, Funny

      Yeah, that's like saying that if I open a book all I'll see are characters.

      --
      To offset political mods, replace Flamebait with Insightful.
    2. Re:Thanks for sharing by datavirtue · · Score: 2

      No kidding.....I cam in to post, "Who's writing this shit?" Anonymous Reader my ass. This is garbage. The whole post is garbage.

      --
      I object to power without constructive purpose. --Spock
    3. Re:Thanks for sharing by jxander · · Score: 3, Funny

      Unsure if troll, or honest effort to top the dumbest thing heard all day.

      --
      This signature is false.
    4. Re:Thanks for sharing by martin-boundary · · Score: 2

      Yeah, that's like saying that if I open a book all I'll see are characters.

      Pfft! When I open a book I see blonde, brunette, redhead....

  2. Found it when googling for dropbox alternatives by BagOBones · · Score: 4, Informative

    http://owncloud.org/

    - Calendar
    - Contacts
    - dropbox like storage

    --
    EA David Gardner -"... but the consumers have proven that actually what they want is fun."
    1. Re:Found it when googling for dropbox alternatives by SomePgmr · · Score: 4, Interesting

      Or use any of the usual storage services that provide a client to maintain a sync'd mount point, and just secure the contents. Jungledisk will do this for you for Amazon or Rackspace backed storage. Google Drive, Dropbox, etc. can be used with your own encryption mechanism.

      For bonus redundancy, sync the local cache to an external USB drive so you don't get caught with your pants down if one of those services botches your remote store.

    2. Re:Found it when googling for dropbox alternatives by sortadan · · Score: 2

      It looks like this could work well with a Synology configured for disk redundancy, plus a home router with VPN (dd-wrt or tomato).

    3. Re:Found it when googling for dropbox alternatives by Bob9113 · · Score: 2, Informative

      http://owncloud.org/

      It's pretty cool, but right on the first page it pulls code from googleapis.com. Hit the front page and you send a request with the referrer URL to one of the biggest stalkers. Maybe it's still good, maybe it's not hard to redirect that js link to your own machine, but it just seems like they've missed the fundamental point of not giving your data away.

    4. Re:Found it when googling for dropbox alternatives by jcreus · · Score: 3, Insightful

      It's open source! You either: a) send them a bug report, or b) download it, and change the code to whatever you want.

    5. Re:Found it when googling for dropbox alternatives by Anonymous Coward · · Score: 5, Informative

      The actual ownCloud application that you setup on your server doesn't have a reference to googleapis. I just checked on my installation.

      For those wondering, the project website links to the jQuery library hosted on Google's server so they don't have to host it themselves.

    6. Re:Found it when googling for dropbox alternatives by Architect_sasyr · · Score: 2

      If you found out your local department store was sending your home address through to the local marketing agency you'd be pitching an absolute fit. This is the same. I'm just browsing to a web page, that shouldn't mean that [google/jquery/insertother] should know about it, even if their code is being used on that web page. Just because it's a digital way of gathering the information, doesn't mean it is any less of an intrusion.


      And the sysadmin in me feels that constantly polling off to get the latest version of adsense/jquery.js/googleapi is just a waste of bandwidth and resources. Just because you have a 100MB link and 64GB of RAM doesn't mean browsing to a web page or running a program should use it all.

      --
      Me failed English...
      FreeBSD over Linux. If my comments seem odd, this may explain...
    7. Re:Found it when googling for dropbox alternatives by datajack · · Score: 2

      That's on their site. The one where you download the software from. The point of his question was how to store data on your own site.

      Download and install owncloud, and there's no sign of googleapis.

    8. Re:Found it when googling for dropbox alternatives by icebraining · · Score: 4, Informative

      For those wondering, the project website links to the jQuery library hosted on Google's server so they don't have to host it themselves.

      And more importantly, so that we don't have to be constantly re-download the same file, since we probably already have Google's copy cached.

    9. Re:Found it when googling for dropbox alternatives by Anonymous Coward · · Score: 2, Insightful

      A solution to this problem is to use a proxy that removes the Referrer header.

      Personally, I use a proxy that removes all headers except 'Host', unless a site absolutely needs it. For a few sites I need to enable 'Cookie' for example.

      In addition, you could configure the proxy to only get files from googleapis once and cache it in the proxy.

      Posting anonymously since I was never here.

  3. cloud vs server by O('_')O_Bush · · Score: 4, Interesting

    At what point does this involve a cloud? Renting a server(providing ftp, for example) is easy, and doesn't require anything from the "cloud age".

    Also, building a server or buying one secondhand is cheap, if you want to DIY.

    --
    while(1) attack(People.Sandy);
    1. Re:cloud vs server by ganjadude · · Score: 4, Interesting

      I was wondering the same, when I first read the headline I had visions of friends setting up partitions on each others hard drives and do cloud storage between mom,dad,sister,brother,grandparents,friends

      redundancy for family photos for instance on all family computers for instance. obviously private storage as well. the odds of all computers going down at once in multiple locations is highly unlikely. p

      --
      have you seen my sig? there are many others like it but none that are the same
    2. Re:cloud vs server by marcello_dl · · Score: 2

      You might want to try tahoe-lafs if you want to share stuff with a fair number of people without giving them default access to the content.

      --
      ---- MISSING MISCELLANEOUS DATA SEGMENT --- [sigdash] trolololol
    3. Re:cloud vs server by AuMatar · · Score: 5, Informative

      Servers are web 1.0. Cloud is web 3.0. Much buzzier and hipper.

      --
      I still have more fans than freaks. WTF is wrong with you people?
    4. Re:cloud vs server by SuricouRaven · · Score: 2

      Abstraction and provisioning. With the cloud, you don't need to worry about where the server really is physically and can alter the configuration at very short notice (It'll be a virtual machine). The 'cloud' term comes from the network diagram use of a cloud to represent internet connectivity: The server is out there on the internet, somewhere, and you don't need to care where. The cloud service operator handles that. So they can juggle workloads around for peak efficiency and thus minimum cost, or let you easily add another virtual processor and a few gig more ram if you suddenly find business booming. But in technology terms, it's really just virtualisation and some fancy management software. The cloud is a business innovation, not technological.

  4. For Christ's Sake, Just Get A Big USB Drive by Anonymous Coward · · Score: 5, Funny

    You can write "The Cloud" on it with a Sharpie if you absolutely must.

    1. Re:For Christ's Sake, Just Get A Big USB Drive by petsounds · · Score: 4, Funny

      The difference is, if there's a fire in the house, your cloud will go up in smoke.

      Thank you, thank you, I'll be here all week.

    2. Re:For Christ's Sake, Just Get A Big USB Drive by Jesus_C_of_Nazareth · · Score: 2

      This solution doesn't seem to be buzzword compliant. The cloud isn't about writing stuff with a pen. Cloud is.. er, it's kind of like, well you know, Internet things. Give me money.

      --
      JC
  5. We're working on it by wurp · · Score: 5, Informative

    https://github.com/wurp/Friendly-Backup

    It works now, with some bugs. The first targeted usecase is distributed backup.

    However, it can store arbitrary read-only content-addressed data as well as signed labels that point point to a particular piece of CBA data to emulate mutable data.

    I have a whole slew of plans beyond backup for it, but backup seemed like the thing everyone needs and would most like to have for free on a federated data store.

  6. I don't get it. by Nyder · · Score: 5, Insightful

    OMFG, the cloud. I got to have or do the cloud. Magic Ponies in the cloud!!!!

    Seriously, wtf do you really need the cloud for? Is it going to magically sync all your different data together so you can access it all the time?

    No, seriously, do you think it's going to sync all your data so you can use it and access it anywhere?

    No, it's not. Sure, you can access you data anywhere, but duder, we've been doing that for a couple of decades now, way to join the late train.
    Unfortunately, the various corporations don't want to agree to standards, so having docs/apps/whatever working with everything isn't in the "rape as much money as we can" business plan. so nothing is going to change.

    Now let's look at the Megaupload thingy. That was cloud storage, file lockers. It's not around now, is it? That is what happens to clouds, the winds blow them away. The wind? Oh ya, in this case, that's the good old USA Government, working for their Pimps, the Music/Movie Industry. You think that can't happen to any "cloud" servers? Think again. OMG, Terrorist used that server, Child porn was on that server, boom! You're data, which has nothing to do with those 2 things, is gone also. Hope you make a backup. Oh, wait, the cloud was magically supposed to back it up for you?

    Cloud has been around for awhile, but we called it what it was, the internet.

     

    --
    Be seeing you...
    1. Re:I don't get it. by The+Mighty+Buzzard · · Score: 5, Insightful

      Oh give the guy a break. This is exactly the situation the "the cloud" buzzword was created for: people who are scared of the phrase "file server". There is absolutely nothing new about "the cloud" in any way but it's a nice fluffy word that people are comfortable with and it's acceptable to not have any idea what it actually is. I'd change the hostname of my home server to thecloud just for wiseassery's sake if it wouldn't hose my Trek shipname naming scheme.

      --
      Violence is like duct tape. If it doesn't solve the problem, you didn't use enough.
  7. SSH not good enough for you? by siddesu · · Score: 3, Insightful

    What's in the cloud that is better?

    1. Re:SSH not good enough for you? by thegarbz · · Score: 2

      A pretty n00b friendly web interface.

  8. Freedombox by Qubit · · Score: 4, Informative

    slashdot ate my last comment, so just check out the link

    --

    coding is life /* the rest is */
    1. Re:Freedombox by Anonymous Coward · · Score: 2, Informative

      For more context: http://archive.org/details/EbenMoglen-FreedomInTheCloud2010

    2. Re:Freedombox by ICantFindADecentNick · · Score: 2

      Don't know why it's modded "Informative". The link posted has a lot about vision, and freedom but nothing about what functions the freedom box is meant to provide.

  9. don't trust others... by swell · · Score: 3, Informative

    the safest storage is your own high speed server quality RAID 7 write-only drive

    --
    ...omphaloskepsis often...
    1. Re:don't trust others... by SpaghettiPattern · · Score: 4, Funny

      the safest storage is your own high speed server quality RAID 7 write-only drive

      There's a readily available device for this that emulates a RAID 7 write-only drive but with better performance. It's called /dev/null.

      --

      I hadn't the slightest objection to his spending his time planning massacres for the bourgeoisie... (P.G. Wodehouse)
    2. Re:don't trust others... by hawkinspeter · · Score: 3, Funny

      Yes, but does it do dedup?

      --
      You're a temporary arrangement of matter sliding towards oblivion in a cold, uncaring universe
  10. I have the above, and it's not a cloud by thegarbz · · Score: 4, Interesting

    You want the above? That's easy. Access to email from anywhere, access to my contacts and my calendar, how about access to all my files? Yep got that. Though it doesn't have a fancy name like "cloud". If I were into marketing I'd call it a cloud, but right now I'll stick to calling it an "internet facing linux machine"

    Yeah it's not as exciting, but it does everything the so called cloud has done and it has done it for many years before this mythical cloud has existed. My phone sees the same set of files and emails as my home desktop PC, and there's a web interface to access all the above too.

    Seriously just google "Linux Groupware" and maybe "Linux Web Fileserver" and you'll have everything that the cloud has.

  11. SparkleShare by SpzToid · · Score: 4, Informative

    Try the free open-source SparkleShare software and roll your your own cloud 100%. That would trump any cloud provider option if this is your concern, since all the disks and PCs are under your ownership and control.

    SparkleShare is essentially a DropBox clone in terms of a GUI, which extends to recovering older versions with a right-click. It looks like DropBox, and it works like DropBox too. But it is just a scripted GIT environment. In fact if you already have a GIT Repo hosted on a server (or service) somewhere, SparkleShare is easily configured to wrk with it. Here's how you start from scratch, assuming you already have PGP keys shared with the server:

    At the server, create a new, empty GIT repository:
    git init --bare NEWREPOSITORY.git
    At the workstation:

    Normally, you might use something like the following commands to work with GIT. (these are not necessary if you use SparkleShare)

    git clone ssh://user@example.com:port/home/user/NEWREPOSITORY.git
    cd NEWREPOSITORY.git
    git clone ssh://user@example.com:port/home/user/NEWREPOSITORY.git
    The SparkleShare config:

    Add Hosted Project...

    Address:

    ssh://user@example.com:port

    Remote Path: /home/user/NEWREPOSITORY.git

    This document explains how to add a layer of encryption, (which also works to secure services like DropBox btw: https://github.com/hbons/SparkleShare/wiki/Encrypting-your-files-before-transfer

    --
    You can't be ahead of the curve, if you're stuck in a loop.
    1. Re:SparkleShare by devent · · Score: 2

      Git is not designed to handle big binary data. Since Git is creating SHA hashs for each file, with a file 500MB and more it will take more time, also it will use up all the RAM to calculate the hash. In addition the size of the repository will skyrocket if you put revisions of big binary files, since you can't easily delete old files in a git repository.

      Git is good for text documents and source code. But since even the Odt documents are binary blobs (the xml data is compressed with zip), you can't use git efficient with open document text files or other documents like Excel, Spreadsheets, etc.

      So either you are using a modified git version, or you just ignore the issues? Do SparkleShare delete old revisions of a file?

      But I'm using Git for all my documents, too. Git is secure (the hash is almost a perfect proof that the files were not modified) and fast. With the bonus that I can delete/modify all my documents with the save guard of revision history.

      --
      http://www.mueller-public.de - My site http://www.anr-institute.com/ - Advanced Natural Research Institute
  12. Real Cloud by PiSkyHi · · Score: 3, Informative

    I did misread this. When I think cloud computing, I am coming for a CS point of view, which is that cloud computing is the terms used to describe the efforts to make scalability of software as a service ubiquitous. Basically, the cloud is not a bunch of servers, it is the infrastructure that provides scalable services to an application layer like the web. Amazon pretty much built the best cloud and others are following their lead. So, I have been looking at OpenStack
    If anyone actually thinks this question is in any way relevant, please let me know if there are other resources.

  13. My experience: possibly eGroupWare or SOGo? by Anonymous Coward · · Score: 2, Interesting

    *snort* 27 posts so far and no one seems to really have addressed the poster's real question. (Instead, all I've read is basic suggestions like a file share, VNC/SSH, or OpenStack; all of which seem to ignore the main point: "is it possible to build my own personal data repository, where for example, I can store my contacts and calendars to sync to multiple devices?")

    I've been looking for something like this for a while now, actually. From my research, I think the best way to solve this problem is to set up your own 'groupware' server on a hosted VM somewhere. You can custom-configure the VM to make sure that it stores your server-side data in an encrypted filesystem within the VM itself. [To make it that much harder for anyone from your hosting company to spy on you, naturally... ;-) ]

    Then, you can use the open-source sync clients from the "Funambol" project to synchronize the contacts and calendar data on the phone with the data on the groupware server. The issue I've had is that I *also* want a non-shitty *Web* interface for calendar management... and so far, *that* has been hard to find. (I can't bring my personal smartphone into work, so I need something to be able to manage my calendar over the Internet and sync those appointments back to my phone).

    So what server to use? Well, I set up an eGroupWare server a few years ago (before all this shit was called "cloud" everything :-P) and it seemed to have most of the features I wanted as far as calendar management goes. [I even locked everything down, moving the back-end database to an encrypted filesystem that wasn't auto-mounted...] Unfortunately, the default web interface kinda sucked. And the good Funambol 'web' client is only available on their own 3rd-party calendar hosting servers, which I wouldn't use because I wouldn't get to control my own data. (Again, the project only ships with a crappy text-based one out of the box :-P) So I stopped using that solution. Consequently, I never actually got all the way to the point of trying out the PalmOS(which I was using at the time)/Android/iOS Funambol clients to see how well they worked to synchronize contacts and calendar data.

    Recently, I've been looking at SOGo, another open-source groupware server which apparently has a fancy Ajax-based web UI... and should also work with the Funambol open-source sync clients for all the major mobile OS devices. I haven't set it up yet, though.

    Incidentally, I'd be *very* interested to hear from anyone else who's attempted to set up similar solutions about your problems and successes. Has anyone else actually tried this?

    1. Re:My experience: possibly eGroupWare or SOGo? by jbolden · · Score: 3, Informative

      I tried something like this last year using Linuxy solutions. For a midsized setup (30k users in groups ranging from about 30-500). For personal though I'm not sure it doesn't make more sense to just treat calendar and disk storage as two totally distinct problems and thus simplify the solution. Pick any of a dozen different internet calendar / scheduling services and do storage by itself.

      But if you want to know the lay of the land as far as groupware:

      1) I didn't go with Zimbra because at the time they were focused heavily on the rack server space and their longer term direction scared me. The cost per user was high for the commercial version and I did want commercial version features.

      2) Scalix was really good 4-5 years ago. But is essentially now unmaintained. If you can live with broken compatibility and FireFox 3 for less than 10 users it is free. It has a very advanced calendar and an easy to use but powerful administration system. Really nice but I'd have a hard time going with a product that is now essentially dead.

      3) OX (http://www.open-xchange.com/home.html) has what you are looking for. But understand that for whatever reason the app is not written MVC gui code is completely intermixed with functionality. It is effectively not much more changeable than a closed source program. They were working on this and by 2014 or so that likely will be fixed.

      There were some others I experimented with if this is the sort of information you are looking for.

  14. Re:Africa by Anonymous Coward · · Score: 2, Insightful

    Yea, those poverty-stricken, starving kids in Africa should keep their aircraft carriers, long-range bomber aircraft and unmanned drone fleets in their own fucking country!

  15. Re:Africa by GameboyRMH · · Score: 2

    I think he was talking about their population/resource imbalance.

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
  16. Personal Cloud Can't Exist, By Definition by jon3k · · Score: 3, Insightful
    "Personal Cloud" is a misnomer, at best.

    Using the wikipedia definition:

    "Cloud computing is the delivery of computing and storage capacity [1] as a service [2] to a community of end-recipients.".

    The whole point of a cloud is to abstract a massive underlying infrastructure to deliver some type of computing service (PaaS, IaaS, SaaS, etc ad naseum) to a large group of users and to be able to scale that infrastructure seamlessly. A "personal cloud" is an oxymoron.

  17. git-annex assistant by gottabeme · · Score: 3, Informative

    This is what we are all waiting for, and it's already been funded! Just a matter of time until Joey finishes it: http://www.kickstarter.com/projects/joeyh/git-annex-assistant-like-dropbox-but-with-your-own

    --
    "Those who consume the bulk of goods are those who make them. We must never forget this secret of our prosperity."