Using P2P for Legitimate Applications?
scum-o asks: "Where I work, we move a lot of large weather data around and there's always a question of whether someone's already found the data that I need to use (many projects use the same data, but it needs to get refreshed several times a day). My brilliant idea was to use a P2P-like network to search for already-existing data and use that in my app (and if none found, go to the original source). My company has a fast network and I'd much rather have my app suck the data from someone else in my company who's already grabbed the data as opposed to pounding on the public ftp server (which is slow and horribly abused each day). Has anyone found any way to use the P2P-network for legitimate reasons other than just file swapping/sharing and stuff? Also, how would I go about this, can I just grab a gnutella API and start searching?"
...and stop reinventing the wheel.
It won't be a solution, because after a while people will get used to having the network and being able to find the documents on other people's machines, and they will ask for text searching, version control, and so on. Not sure what Microsoft wants for the Sharepoint and what are the Linux alternatives, but it seems to be worth it in your case.
What's wrong with the simple solution of just putting a proxy server in to cache the data from the original site?
Isn't that what it was designed for in the first place? Peer to peer file sharing in a trusted enviornment?
"All I want is a warm bed and a kind word and unlimited power." - Ashleigh Brilliant
File sharing is "illegitimate" because of the files, not the sharing.
:)
If you're a small garage band trying to advertize yourself, there's nothing wrong with throwing mp3s of your performances on kazaa. Anything else that you created yourself is legitimate, too. Same with uncopyrighted works (like the complete works of Shakespeare, for example).
The only real problem with file sharing is that nobody wants that stuff, they all want the copyrighted stuff
Oh, and I downloaded Mandrake, RedHat, and Knoppix ISOs from BitTorrent. Those were totally legit uses.
Bittorrent is fucking ill-suited for that kind of work. It would require constant re-seeding, as people tend to close download windows when they finish.
So if I'm not mistaken then that's a sort of Steam application, but not only for VALVe/Sierra games. That's quite good. If you guys manage to get a thing like that going, I'm sure it's going to be popular. It's like, All Seeing Eye with intergrated chat,resource downloads and everything. Nice idea, care to share the URL?
Just hang a squid proxy off your router with a huge cache... problem solved.
Then go get a drink, for not having to re-invent the wheel, or cost your company much ( if any ) money.
---- Booth was a patriot ----
when I reread the article, I guessed that you might be asking about saving load on the public FTP server on a larger scale. I.e. providing an option for all other users of the same service an opportunity to help reduce the load. In this case, the best bet is to talk to the service provider and use whatever they are willing to use!
Ask the public FTP provider to put up Torrent files, or equivalent, right on the FTP site, or in a README. Alternatively, if they aren't interested or are too busy to set it up themselves, ask them to put a description and link to a webpage that YOU control in a readme file. Something along the lines of, "Our servers are busy. A good samaritan maintains an alternate download method at this URL. You may get faster results from there." Perhaps toss in some MD5 hashes so that people can verify data if they so desire, and then hope for the best. With any luck, your company wins, other groups win, and the provider wins.
Pretty much any P2P network would work, but you would probably have more support from IT groups for BitTorrent than eMule/eDonkey or Gnucleus.