Slashdot Mirror


Packet Juggling - Floating Data Storage

Filthmaster writes "I just saw an interesting paper that has been posted to bugtraq, full-disclosure and vulnwatch. It deals with the principles of stealthily using network infrastructure as either short-term or long-term storage. Not sure if I'm ready to implement it, but it makes interesting food for thought." There's also a mirror up.

107 of 148 comments (clear)

  1. It works fine .. by maharg · · Score: 1

    .. as long as the power stays up..

    --

    $ strings FTP.EXE | grep Copyright
    @(#) Copyright (c) 1983 The Regents of the University of California.
    1. Re:It works fine .. by oldwarrior · · Score: 1

      there could well be redundancies built at both ends and geographical algorithms to reduce the locality of reference of redundant nodes to lessen the impact of wide scale power outages.

      --
      If it were done when 'tis done, then t'were well it were done quickly... MacBeth
    2. Re:It works fine .. by SEWilco · · Score: 1

      .. because I always mount a spare network.

  2. Bandwidth? by shish · · Score: 3, Insightful

    Won't everyone pinging their gigabytes of data back and forth totally screw the net, a la slammer?

    --
    I mod down anyone who says "I will be modded down for this", regardless of the rest of their comment
    1. Re:Bandwidth? by OMG · · Score: 1

      So better send you data to the moon and resend what is reflected ;-)

    2. Re:Bandwidth? by Zocalo · · Score: 5, Funny
      Ah, but in this context that could be a good thing since a slower Internet = more latency = longer TTL on your data. Take the ping for example; if it takes twice as long for your ping to echo back with your data, then you only need to retransmit back to storage at half the rate.

      I wasn't trying DoS the Internet your honour... I was trying to improve data retention times! ;)

      --
      UNIX? They're not even circumcised! Savages!
    3. Re:Bandwidth? by MacroRex · · Score: 1

      It depends on the medium. Pinging data over the bongo drums wouldn't screw over the 'net, though anyone can probably think of some other adverse effects.

      However, the speed of sound (or, rather, the lack of it compared to an electric signal) makes it an interesting option. Yes, storing data in TCP/IP packets represented in sound waves sounds cool.

    4. Re:Bandwidth? by Oculus+Habent · · Score: 2, Insightful

      I thought the "100-foot well" bit at the end of the article was a unique twist. 6 kilobits of data in 100 feet at 20KHz stored as sound...

      --
      That what was all this school was for... to teach us how to solve our own problems. -- janeowit
    5. Re:Bandwidth? by thrill12 · · Score: 1

      That's not completely true. A ping only *seems* to take so long because it hops across a lot of routers. The TTL router is decreased anyway during the transit.

      In essence, what a DoS or 'slower internet' would do is just congest the network so much that a ping will probably not reach the next hop, but just get dropped because the ('slow') router has too much data to process.

      --
      Slashdot: stuff for news, nerds that matter, matter for news, stuff that nerd
    6. Re:Bandwidth? by illumin8 · · Score: 1

      Yes, and there is an even bigger problem with trusting ICMP: It's a UDP protocol, so there are no guarantees that your data will ever get to the other host, much less get back to you.

      Have you ever tried doing a traceroute and then pinging every hop along the way? Usually once I get about 5 or 6 hops out I start getting about 2-3% packet loss on pings.

      Also, another problem is that many backbone providers may decide to drop UDP traffic (especially ICMP since it's only supposed to be there for troubleshooting) if their links get overloaded. UDP is simply best effort, and if push comes to shove, the TCP traffic is more important.

      --
      "When the president does it, that means it's not illegal." - Richard M. Nixon
  3. Re:howso? by Lord+Bitman · · Score: 1

    would it no longer meet its qualification of being "volitile memory" if the power went down?

    --
    -- 'The' Lord and Master Bitman On High, Master Of All
  4. If this were quick enough by Amiga+Lover · · Score: 5, Interesting

    If it were quick enough and timed well enough, could network bounced packets be enough for some really quick swapped out swap space? gig ethernet gets around 1ms to my next machine, and thats 10 times quicker than my hard drive (10ms access time) so if I could store swap in that space, would that work?

    I was thinking of tunneling ssh over sms before this, but that sounds just silly now.

    1. Re:If this were quick enough by Lost+Race · · Score: 1
      You'd be using your network buffers as swap space. That's not a very efficient use of memory. If you have some LAN server with extra memory that you want to use as swap space for the other hosts, you're probably better off using a Network Block Device instead.

      BTW, your Gbps ethernet probably has round-trip latency closer to 0.1 ms.

  5. Not quite stealthy by jubalj · · Score: 3, Funny

    Why use your own network when you can..

    6seryoeyEe O.ot..>u&6eOyeUWrong loader, giving up...f1Afaef1UDf efPAMSfIr f=PAMSu e }eoACfuuEu1E1OeIr*uu uuAUfayyfAafafayyfaI1UIeS1AOA6Ee PAQuo1AOA6YoIrutEe A1AuoEe O1A AuIr!AOEe A

  6. Redundancy by Solokron · · Score: 1

    This would be very interesting with RAID 5.

    --
    30% off web hosting. Coupon code "SLASHDOT".
  7. it's alive! by geoff+lane · · Score: 4, Funny

    First you give it comms, then unlimited CPU and now distributed memory.

    Can Skynet be far behind...

    1. Re:it's alive! by muffen · · Score: 1

      Can Skynet be far behind...

      I play UT on skynet all the time. Finally I understand why I never win! :)

  8. Re:howso? by maharg · · Score: 1

    point taken, Lord Bitman. However, the world 'reliable' is given greater prominence by the author:
    The following paper explores the possibilities of using certain properties of the Internet or any other large network to create a reliable, volatile distributed data storage of a large capacity.

    --

    $ strings FTP.EXE | grep Copyright
    @(#) Copyright (c) 1983 The Regents of the University of California.
  9. Great excuse! :) by CoolVibe · · Score: 3, Funny
    Q: Why the hell are you flooding the shit out of my network?
    A: Oh, I'm just storing data temporarily.

    Seriously, the idea is interesting, but I doubt that many network operators will like the extra network load. It would be interesting to build a SAN in this manner, just for academic's sake ;-)

    Oh, and the example with Microsoft's exchange servers made me chuckle. Finally a reliable storage "medium" from Microsoft! Go figure :)

    1. Re:Great excuse! :) by the_argent · · Score: 1
      It would be interesting to build a SAN in this manner, just for academic's sake ;-)
      Is that in a "Oh shit here comes the RIAA, hide the porn and MP3's" academic sake?
    2. Re:Great excuse! :) by CoolVibe · · Score: 1

      Interesting. Using the connection latency of a connection to the RIAA webserver to store your favorite Britney Spears (bleagh) mp3s. Sure, man. But strictly academicly, right? :)

    3. Re:Great excuse! :) by Anonymous Coward · · Score: 1, Interesting

      Think we could get them to sue themselves for illegally storing and distributing copyrighted material? Or would my mp3s now be legit (afterall the RIAA sent them to me)?

    4. Re:Great excuse! :) by irc.goatse.cx+troll · · Score: 2, Funny

      When the RIAA page was hacked (I say this as if it only happened once..) the new Linkin Park cd ended up on their webserver publicly. I believe this was a few days before it hit shelfs, to. End result: just pisses people off.

      You can pull DeCSS from disneys nameservers if you want, doesn't really mean anything.

      --
      Pain lasts, kid. Its how you know you're alive. Sometimes I think this growing up thing is just pain management-TheMaxx
  10. Already there by Rogerborg · · Score: 3, Informative

    When our network fileserver fills up (as it does twice a week or so), I start emailing things to myself through the corporate mail server. When the mail server fills up, I start adding to my intranet HTTP pages. When all else fails, I start sending (encrypted) data back to myself via my ISPs external mail servers.

    It would of course be far better for the company if they just sprang for some new drives in the fileserver, but engineer and bandwidth costs don't appear as capital expenses, so they are viewed as being effectively "free". Sigh.

    --
    If you were blocking sigs, you wouldn't have to read this.
    1. Re:Already there by tgrigsby · · Score: 1

      Say it with me: ZIP Drive. Up to a gig of space on a single removable disk. A few bucks a shot and reusable.

      Or try a CD/DVD burner for stuff that you need long term and don't want to keep on the hard drive.

      But what you're talking about is just dumb. "I start emailing things to myself through the corporate mail server. When the mail server fills up, I start adding to my intranet HTTP pages. When all else fails..." When the mail server fills up? Intranet page storage until all else fails? D00d, you're part of the problem for everyone on your network. What you're doing is *not* a solution. You don't have to say it for it be obvious: you haven't explained what you're doing to anyone in your company that has the ability to fire you.

      On the other hand, taking your "practices" as an example, one can quickly see why bouncing packets around a network as a means of short term storage is just dumb.

      --
      *** *** You're just jealous 'cause the voices talk to me... ***
  11. Provisioned storage within the Internet by FastDownload · · Score: 5, Informative

    While the authors try to use existing protocols to simulate temporary storage in the Internet, we are working on a scalable, shared storage resource that is open to the community.

    We currently have over 20 TB of storage around the world available in the public Logistical Networking Testbed and other groups have another 10-20 TB provisioned in private use testbeds.

    In additon to storage, we are also working on providing simple computational services at the storage nodes (work on the data in place while it is stored rather than moving it to computation centers).

    For more info, visit the LoCI Lab at http://loci.cs.utk.edu.

    --
    Download Linux ISOs in 5 minutes using LoRS Tools available at http://loci.cs.utk.edu
  12. Reminds us of the old days... by ControlFreal · · Score: 5, Interesting

    ... in which complete computer memories worked like this: those were called mercury delay line memories, in which pressure waves in mercury lines basically held information.

    The UNIVAC I had such an 18-channel memory. More information can be found here, here, and here.

    These channels could hold a whopping kilobit!

    --
    Support a Europe-related section on Slashdot!
    1. Re:Reminds us of the old days... by kilraid · · Score: 2, Interesting

      In future, we might be using light in fibre loops instead of sound waves in mercury delay lines, to act as computer memory. I googled for light loop memory --- look what turned up:

      Fiber loop makes quantum memory

    2. Re:Reminds us of the old days... by zero_offset · · Score: 1
      It appears they are aware of this. In the Legal Notice section at the end of the paper, they have some weird stuff (copied below) which didn't make any sense until I read the links you provided. It still doesn't make a LOT of sense, but it does appear they're jokingly making an obtuse reference to delay-line memory.

      A do-it-yourself kit (long wire, speaker + microphone, shovel and a driver disk) will provide an affordable, portable and reusable way for extending storage memory on portable systems.

      It is estiamted that, after digging a 100 ft well, it is possible to achieve over six kilobits of extra RAM storage at 20 kHz.

      --

      Slashdot quality declines as the number of hot grits posts decreases. - Provolt's Law, Apr-09-2005

    3. Re:Reminds us of the old days... by hey · · Score: 1

      We did this with X.25 packets in the 1980's.

    4. Re:Reminds us of the old days... by Colin+Douglas+Howell · · Score: 1
      Read the notes at the end of that document.

      The main memory held 1000 words, but that was composed of 100 mercury channels. (The whole memory system had 126 channels, but some of the channels were not part of main memory.) Each channel was a single acoustic path through a mercury tank, with 18 channels per tank. A main memory channel stored 10 words, with each word composed of 12 characters (11 digits plus sign), each of which was 6 bits plus a parity bit. That comes out to 840 bits.

      The note estimates 1000 total bits per channel based on the clock rate and the maximum access time, but I think he got his numbers a little wrong. (He used a clock rate of 2.5 MHz, but it should be 2.25 MHz, which gives an answer of 900 bits.)

    5. Re:Reminds us of the old days... by Colin+Douglas+Howell · · Score: 1

      They also used systems based on signal delays through wire and through quartz. (The wire system is also described on the Wikipedia page.)

  13. You don't need the Internet to do this by melonman · · Score: 5, Funny

    Just burn a CD a day and post it to a non-existant address on the other side of the world. That way you can probably keep a terabyte of data int he air without taking any space in your office, and, unlike TCP/IP, you may be able to reuse the wrappers.

    --
    Virtually serving coffee
    1. Re:You don't need the Internet to do this by teeker · · Score: 1

      yeah but the latency time is what kills ya...make sure you've got swap turned off...

      --
      teeker
  14. I had this idea too by turgid · · Score: 1
    I had this idea too once, and I told my collegues, who thought I was a nut-case as a result.

    Someone once said that if you have a truly good idea you don't need to worry about anyone stealing it : you'll have to try very hard to get anyone to listen at all.

  15. Main problem with this is... by zen+parse · · Score: 5, Informative

    Not everyone can benefit, because of side effects of it's parasitic nature.

    The amount of storage this system gives in the text would be total available for ALL users of the system. More users, less avaiable storage.

    Parasites can do better when there little competition from other parasites, but if the system get's infested, the host it lives of may die. Or someone may develop a cure.

    Either way, after a certain threshold, the more popular any system using this gets, the less useful it would be.

    Just some random thoughts I had when I was talking about a similar idea with someone.

  16. aaah... pAcket by bastardsquadmuzz · · Score: 2, Funny

    Did anyone else read this as Pocket Juggling?

    --
    --Muzz
  17. Re:howso? by Oculus+Habent · · Score: 1

    The use of mail servers (Class B) more adequately meets the term "reliable", but is still dependent on power being available at critical times.

    These situations seem to be for those cases where security of data far outweighs the ability to retain it. Check you mail queue. Maybe you have NSA encrypted documents right now :)

    --
    That what was all this school was for... to teach us how to solve our own problems. -- janeowit
  18. Sounds like BOFH? by flappinbooger · · Score: 1

    Wasn't there an old (pre theregister.co.uk) BOFH article where the Bastard tricked his boss into proposing the use of the network as a storage medium?

    --
    Flappinbooger isn't my real name
    1. Re:Sounds like BOFH? by iantri · · Score: 1

      Yes.. I was just about to comment on that. Here it is: The BOFH wins an award from his peer group ... (halfway down the page)

  19. What was that scifi story by xyote · · Score: 1
    were they discovered a way to create extra space (from another dimension presumeably)? At first they used it to create extra closet space (everybody needs that right) but then people used it to create extra living space and extra apartments. And so extra space got tacked on to extra space and pretty soon almost everybody was living in borrowed space.


    And then power failed on one of the first units.

    1. Re:What was that scifi story by Richard_at_work · · Score: 1

      Any idea of the author or title of this one? Sounds interesting, worth a read!

    2. Re:What was that scifi story by caseydk · · Score: 1


      Wasn't Jane born in this space "between the endpoints" on the philotic (sp?) threads?

      It seems like you could bounce around data relatively easily... it would be another issue on determining and monitoring which data was where when the time came to actually use it...

    3. Re:What was that scifi story by Amiga+Lover · · Score: 1

      Oh that sounds amazingly cool as a story. Do you have any other clues as to the author, characters, terminology that could be googleable about it?

    4. Re:What was that scifi story by Creepy+Crawler · · Score: 1

      It's the Ender's Game series of books by Orson Scott Card.

      --
    5. Re:What was that scifi story by Jetson · · Score: 1

      It sounds like something you would see on the Twilight Zone. Is there a plot archive online? (My favorite was the morality play where people were given a box with a button on it, and if they pressed the button they would get $1,000,000 but someone they didn't know would die....)

    6. Re:What was that scifi story by Amiga+Lover · · Score: 1

      I know I'd consider for a moment, then press the button. and again. repeatedly, quickly, stabbing for all it's worth.

    7. Re:What was that scifi story by FreeForm+Response · · Score: 1
  20. Re:Of course by melonman · · Score: 2, Funny

    You could make a shorter loop by posting the letters to yourself, and increase the packet size (DVD). But these are the kind of trivial implementational issues that are always thrown up by late-adopters in the face of a paradigm shift. If your office gets hit by lightning, chances are that your 40GB HD is a gonner, whereas in my system all your data will still be safe, providing the fire brigade let you put up a provisional post box.

    --
    Virtually serving coffee
  21. I once wrote a sci-fi story ... by torpor · · Score: 1

    ... based around the premise of an 'industry' of 'dataspace', where data is converted into radio waves, and 'flung' out into space to be 'stored', retreived on the other end, and bounced back again, repeatedly, over millions and millions of miles, as a way of getting 'cheap' storage for stuff that you want to have around only on a periodic basis.

    I guess I should've made it a 'whitepaper' instead. I got a B, though, that was nice!

    --
    ; -- the corruption of government starts with its secrets. a truly free people keep no secrets. --
  22. Re:howso? by maharg · · Score: 1

    You've obviously never used Exchange then ?

    --

    $ strings FTP.EXE | grep Copyright
    @(#) Copyright (c) 1983 The Regents of the University of California.
  23. Delay Line Memories by Gnissem · · Score: 3, Interesting

    There's never anything new...in electronics lab in college in the 60's I built a delay line memory, which was nothing more than a very large coil of wire and some rather simple circuity that would shove bit's into one end and 'catch' them out the other side and recirculate them. You used timing to specify the addresss and could read or update as the bit came by. Another variation that was commercially used on this used a column of mercury and cycling sound waves...see http://ed-thelen.org/comp-hist/mak-UNIVAC-I-delay- line.doc

  24. Einstein reference by |>>? · · Score: 3, Funny
    Did anyone else get the Einstein reference:
    Article: would it work without oranges?
    which to my mind refers to:
    Einstein: The wireless telegraph is not difficult to understand. The ordinary telegraph is like a very long cat. You pull the tail in New York, and it meows in Los Angeles. The wireless is the same, only without the cat.
    It could just be my mind - just fell down in the bath and hit my head falling over the edge...
    --
    |>>? ..EBCDIC for Onno..
    1. Re:Einstein reference by pmz · · Score: 1

      You pull the tail in New York, and it meows in Los Angeles.

      Hmmm, I find that LA just bites back. Einstein is a stooge (just joking, folks).

  25. This isn't new by harikiri · · Score: 1

    I recall seeing this mentioned in a hacker "e-zine" article many moons ago. Perhaps someone could dig it up?

    --
    Man watching 6 MSCE's around a sun box, looks alot like the opening scene's of 2001:space odyssey...
  26. BOFH by i.r.id10t · · Score: 2, Insightful

    Didn't the BOFH convince the Boss that you could store data on the network cables, causing him to order quite a few spools of the stuff?

    --
    Don't blame me, I voted for Kodos
  27. Complexity, Risk Management, Cost by MadFarmAnimalz · · Score: 2, Insightful

    Whilte it's good to see people exercising their minds like this, it's also good to keep in mind that some things should not be regarded as more than just exercises.

    With this particular scheme, the inherent complexity (needing interfaces to all of these common network protocols) and the risks (there must be a billion ways to lose data this way) basically mean that storage according to this scheme would be really high.

    Disproportionate storage costs per unit data automatically means no real-world application outside of brain exercising.

    --
    Blearf. Blearf, I say.
  28. The BOFH was there already by red_dragon · · Score: 4, Informative

    It was 1997 when Simon the BOFH wrote about such a contraption, which won him the IT Idiot Award for Least Intelligent Supervisor.

    ... This year I've decided to sell the boss on using the network as a storage medium. I casually drop a couple of remarks until the boss decides to channel his massive intelligence away from tying his shoelaces and onto the matter at hand.

    "It's simplicity itself!" I cry "We've got these Gigabit Ethernet switches all around the place that we just aren't using! Instead of letting them go to waste we could be sending data continuously around them until it's needed which would actually cut down on the amount of physical disk storage we would need! And just think of the time we would save with read and write latency when the data's already on the net!"
    ...

    --
    In Soviet Russia, Jesus asks: "What Would You Do?"
    1. Re:The BOFH was there already by bobbozzo · · Score: 1

      And this idea was presented last year at DefCon 0A
      see here
      PPT here
      RealVideo here

      --
      Nothing to see here; Move along.
  29. Juggling Apples by immel · · Score: 1

    "Most of us, the authors of this paper, have attempted to juggle with three or more apples" Try juggling three iMacs (they're fragile ballistic objects, right?) and let's see how your arms feel!

    --

    10 Bits= $.25
    100 Bits= $.50
    110 Bits= $.75
    1000 Bits= 1 byte
  30. This is not new by eris_crow · · Score: 4, Interesting

    When I was in college back in the Good Old Days (tm) of the Internet, I had a friend who sometimes stored files "in transit", so to speak, by emailing them to himself with explicit routing in the To address. He would send the message on a long circuit of several machines around the country and he had a script to automatically reforward them once they got back if he didn't save them within a certain period of time. Back in the day you could do this by setting the To address to something like "@hostone.com,@hosttwo.com,me@myhost.com" (see RFC 821 sec 3.6) and since the network and the machines on it were much slower in those days, if you added enough hosts then you could introduce a significant delay and have lots of files stored in transit (actually, on the various mail servers) even though your own disk quota was nearly used.

    Explicit routing is long gone, but it is an interesting early manifestation of the same principle: the network is my hard drive.

  31. One word: Usenet by vidarh · · Score: 1

    Let Google and thousands of news servers archive all your data for you.

    1. Re:One word: Usenet by LinuxHam · · Score: 1

      If anyone does it, the guys at LUFS will write a driver for exactly that. "Remember, everything is a file, and if it isn't, it should be!"

      I can see a driver that posts to encrypted anonymous groups optionally via anonymous remailers and then checks google for updates. Post 2 messages per chunk: a pointer to each chunk's subject line, and each chunk. The data in the pointer-posts should be enough to formulate a directory structure. (Hey, I might be onto something here...) Now, for the UI. Something that can generate posts and reconstruct files. Perhaps an ftp-like interface? Or just a CLI that can be backgrounded for the reconstruction phase.

      It seems like that would give you much better access to vast data storage without having to staple together slow, medium, and fast-access data. If they do write drivers for all those methods, I vote for this to be the first one they tackle :)

      --
      Intelligent Life on Earth
  32. Satellites ! by wtarreau · · Score: 4, Interesting

    I remember that when I was at the University, I explained to someone that with satellites at 37000 km from us, information took a quarter of a second to go there and back to earth. So if you use a 500 Mbps link, you can store 15 MBytes of data in the distance between, on an absolutely zero cost medium, during 0.25 second. And if you were confident enough in the reliability, you could even put a bouncer on earth, which goal would only be to resend the stream to the satellite and keep it looping. You would have 15 Mbytes of free storage with an average access time of 125ms (250ms max). Although absolutely useless, that would be as fun as TCP/IP over pigeon routing :-)

    Willy
    I will never put a sig.

    1. Re:Satellites ! by sql*kitten · · Score: 1

      And if you were confident enough in the reliability, you could even put a bouncer on earth, which goal would only be to resend the stream to the satellite and keep it looping.

      I remember Scotty did this in an episode of Star Trek, he bounced back and forth as a transporter beam for 70-odd years until Georgy La Forge came along rematerialized him.

    2. Re:Satellites ! by VendettaMF · · Score: 1

      Thats GeorDy, and I'm afraid he used the local buffers, while keeping the beam itself disabled, forcing the buffers to refresh every [trail away into technobabble here]...
      ---

      It's nerdy, just a differant kind of nerdy...

      --
      kartune85 : Incapable of reason, observation or learning. A kind of dim, drab, flightless parrot.
    3. Re:Satellites ! by jafuser · · Score: 1

      on an absolutely zero cost medium

      This seems a little problematic, since the actual costs are in maintaining a signal strong enough to overcome a minimum signal-noise ratio for the data to remain intact.

      So as storage capacity (distance) increases, it would seem that cost would increase, because the power needed to keep that signal alive would need to increase...

      --
      Please consider making an automatic monthly recurring donation to the EFF
    4. Re:Satellites ! by bobv-pillars-net · · Score: 1
      So if you use a 500 Mbps link, you can store 15 MBytes of data in the distance between, on an absolutely zero cost medium,

      I realize this is supposed to be funny (even though it is modded as "interesting"), but...

      Would somebody please explain to me how I can get a 500 Mbps link at absolutely zero cost?

      --
      The Web is like Usenet, but
      the elephants are untrained.
  33. We already have slashdot for that! by Bastiaan · · Score: 1

    Much simpler: just post all your stuff on Slashdot. With all the random garbage surrounding it noone will notice anyway.

    <storage>095257baf2ba839ec8605869dd3ddbd1</stora ge>

  34. Speaking of ideas by sokk · · Score: 1

    what about loop-connecting an optical cable -- tech it a little and use that as storage? :).

    When we're speaking of ideas -- have anyone developed a torrent-style mp3-radio? That would make it cheaper and easier to set up a mp3-radio? Or how about streaming video? -- that would've been cool :)

    1. Re:Speaking of ideas by Anonymous Coward · · Score: 1

      That would be cool, but the problem with this is the strength of bit torrent is that users can share different parts of the file they are downloading. Since real-time streaming mp3-radio or video would be sequential in nature, everyone would be downloading the same thing, thus diminishing its value.

    2. Re:Speaking of ideas by sokk · · Score: 1

      Thanks for a good answer

    3. Re:Speaking of ideas by kasperd · · Score: 1

      everyone would be downloading the same thing, thus diminishing its value.

      Just means it cannot work like bit torrent. There are other ways to distribute data. What you need to do is utilize the fact, that everybody wants the same data at the same time. Build a tree structure of clients each repeating everything they receive to two or three other clients, possibly with some redundancy, such that leaves repeat to different locations in the tree. The tricky part will be to dynamically compute a least cost tree.

      --

      Do you care about the security of your wireless mouse?
    4. Re:Speaking of ideas by des09 · · Score: 1
      I have been pondering this for a few weeks, and really like this idea, it would almost eliminate the bandwidth cost of doing live streaming broadcasts. I started thinking of a torrent based solution, but the torrent concept doesn't place priority on any piece of the file arriving before any other, with a broadcast stream you want the chunks arriving in sequence, or close to it. I think it would have to be designed from ground up.

      Another big issue would be matching appropriate clients and peers based on their relative point in the stream, eg. a new client that connects to a peer that is almost finished with the stream poses issues, the peer would have to have almost the whole broadcast cached, and the liklihood of the peer going silent is pretty high, also, the broadcast is no longer live, but delayed considerably.

      What about low-bandwidth nodes on the tree? if bandwidth is not enough to receive and rebroacast the stream to at least one client, the node is effectively a leech.

      --
      .sigless since 2003
    5. Re:Speaking of ideas by kasperd · · Score: 1

      a new client that connects to a peer that is almost finished with the stream
      What I had in mind was live broadcast like on the radio. When you turn it on, you don't get it from the start of the programme, you get what is broadcast right now.

      the broadcast is no longer live, but delayed considerably.
      There will be a delay, but keeping it below 10 seconds shouldn't be a problem. Such a delay would be unacceptable for telephone over the internet, but it is surely acceptable for internet radio.

      What about low-bandwidth nodes on the tree?
      That is obviously a potential problem. Keeping the high bandwith nodes near the root and the low bandwith nodes near the leaves would somehow help. I don't know much about lossy compressions, but if the compression can be designed such, that conversion to lower bit rates can easilly be performed, we will more or less have solved the problem.

      --

      Do you care about the security of your wireless mouse?
    6. Re:Speaking of ideas by des09 · · Score: 1

      The issue of how "live" the system is is a big one... My mental image was a stream that comes from the source, and is cached at each node. A new node connnects at any time and receives from the beginning of the stream. This is obviously different to your idea. I have had a few experiences with bit torrent where the download starts out very healthy, but after a while the number of peers drops off dramatically... keeping the broadcast more synchronous makes this less likely to happen.

      I like the idea of variable compression rates fo higher and lower bandwidth nodes, now it is not just distributing the bandwidth cost, but also the computational cost of recompression. Of course this creates a whole new element to the cost tree.

      I still like the torrent concept, with trackers co-ordinating the peers, but it is going to be challenging to prevent dropouts cascading down the tree when nodes go dark. Is the client involved in computing the best source nodes to connect to? This is a more distributed model, but the clients need a more complete map of the tree, which consumes bandwidth. Perhaps this information also flows from node to node...

      I am a Java developer by day, I am considering using a signed applet for the node software, one issue is that even a signed applet cannot listen on a priveledged port in *nix unless it has root access... which isn't going to happen, I need to look at bit torrent again to see exactly how it gets past these firewall issues.

      --
      .sigless since 2003
  35. the heck? by Frac · · Score: 4, Insightful

    How does using a scarce resource (bandwidth) to create an abundant resource (disk space) make any economic sense?

    Headline: How to turn gold into copper! News at 11.

    1. Re:the heck? by Kaa · · Score: 1

      How does using a scarce resource (bandwidth) to create an abundant resource (disk space) make any economic sense?

      Economics have nothing to do with it. At all.

      First and foremost, this is a cool hack. Second, it's an interesting way to hide information and/or make its recovery quite difficult, as well as to achieve some degree of plausible deniability.

      --

      Kaa
      Kaa's Law: In any sufficiently large group of people most are idiots.
    2. Re:the heck? by jafuser · · Score: 1
      --
      Please consider making an automatic monthly recurring donation to the EFF
    3. Re:the heck? by bninja_penguin · · Score: 1

      How does using a scarce resource (bandwidth) to create an abundant resource (disk space) make any economic sense?

      Well, in a strict economic sense, how does using a scarce resource(diamonds) to create an abundant resource(money) make any econimic sense?

      Ask the broker who sold Kobe Bryant the $4,000,000 diamond ring for Mrs. Bryant. The broker probably never spent more than $10,000 to get the ring to him, and probably less.
      And yes, in terms of abundancy, money is a much larger pile than diamonds.

      --
      For those who describe their systems as 'boxen', do you order multiple 'boxen' of corn flakes also?
  36. I could buy a 80GB harddisk by kasperd · · Score: 2, Insightful

    Or I could upgrade my internet connection to get the same amount of storage in other locations. In about three months the extra required capacity on the internet connection would have cost me as much as the harddisk. If I buy the harddisk now, in three months I will still have storage without having to keep paying. Besides, the harddisk is going to be more efficient and probably also more reliable.

    --

    Do you care about the security of your wireless mouse?
  37. Huh? Let it fail FFS by Moderation+abuser · · Score: 1

    I mean, really. If they've filled the disks then they need more space, why on earth are you fucking about in this bizarre way?

    --
    Government of the people, by corporate executives, for corporate profits.
    1. Re:Huh? Let it fail FFS by Rogerborg · · Score: 1

      >If they've filled the disks then they need more space, why on earth are you fucking about in this bizarre way?

      Because the truly bizarre part is that it becomes my fault if I can't get work done because we've run out of space. Welcome to the corporate world.

      --
      If you were blocking sigs, you wouldn't have to read this.
    2. Re:Huh? Let it fail FFS by smitty45 · · Score: 1

      If keeping disk space monitored is part of your job, then it *is* your fault, isn't it ?

    3. Re:Huh? Let it fail FFS by Rogerborg · · Score: 2, Informative

      No, but I use the network fileserver and one of the lunix boxen to perform builds. If it runs out of space, I can't build. My short term solution is to clear up space by sending myself enough of my own data to make room on the main fileserver.

      I never said that it made sense, just that I'm doing it.

      Of course, it would make more sense for the users with GB of data to get rid of some of it, or for the admin to implement quotas. But those users tend not to be the ones with customer deliberables, and, hey, it turns out that the sysadmin gets paid the same regardless of whether we can work or not. So in practice, it's the people with actual deliverables that have to sort out the problems.

      The best solution of all would be for one of us to complain to management. That would be great, because whoever did it would be surplussed in short order, and the rest of us could have their disk space!

      --
      If you were blocking sigs, you wouldn't have to read this.
  38. VeriSign is already doing it's part to stop this: by media_Assassin · · Score: 1
    From the article: Examples rely on sending a message that is known to result in partial or full echo of the original request, and include:

    DNS lookup responses and cache data. It is possible to store some information in a lookup request and have it bounced back with a NXDomain reply ...


    Not any longer!! (unless you're running the bind patch ...)
  39. Paedo rings by essreenim · · Score: 1

    This is all fine,...

    but yet again, it raises the simple question that

    egotistical people never ask???

    What are the consequences of this?

    Imagine an internet paedophile ring using these

    techniques to TCP or SMTP packets into world

    (loaded with all the condemning data, but...

    no evidence to see who did it, OR, even if the

    data itself exists.. How will people know it)

    I think this is bad science,...

    but interesting nonetheless and truthfully

    something I have already delved in myself.. :/

  40. I know I sound like a broken record... by TrebleJunkie · · Score: 3, Interesting

    ...but I just love bringing up the fact that I'd thought up something similar, like, 4 years ago now, and every time my memory's jogged about it here on Slashdot, I like to post about it. Instead of hijacking existing services, however, I did create a new one, where a basically packets were flung from one machine to another (or many) around and around again -- each machine held on to a number of packets, but didn't keep them for too long. All traffic was encrypted, and no machine knew 1) where a packet started and 2) where a packet ended up, it just kept flinging packets around.

    The main goal of the service was to create a nice, neat, encrypted, secure messaging system where neither the origin or destination of a particular message could be detected, such that even if a message was intercepted and decoded, you still didn't know where it came from or where it was going. (This was envisioned about 2 days after the early reports of Carnivore.)

    One of the nice side effects, however, is that you could use the service to basically store a message "on-the-wire" damn near indefinately, broken apart into tiny packets, distributed more or less randomly to every other participating host, with those hosts having absolutely no clue what it was, who put it there, or who's going to retrieve it.

    The bandwidth usage was, in two words, potentially catastrophic. It could really hork a network. I mean, really, REALLY hork a network.

    It was kinda cool. God only knows where that paper is today, though -- I removed it from the web about 2 years back when the Justice Department was considering considering such papers, ideas, services, devices as potential aids to terrorism, and fining/imprisoning the bright young minds who come up with such stuff. So, until either our government stops playing the "T" card, our citizens calm down, and/or we eradicate the likes of Hammas, Islamic Jihad, the IRA, the ELF, and many other like groups, I doubt I'll ever make it available again. *shrug*

    --

    Ed R.Zahurak

    You know, oblivion keeps looking better every day.

    1. Re:I know I sound like a broken record... by Kashif+Shaikh · · Score: 1

      and/or we eradicate the likes of Hammas, Islamic Jihad, the IRA, the ELF, and many other like groups

      Yeah we muslims are the source of all your problems.Why don't you just take a bomb and drop it down in middle east, saying you're trying to catch osama or saddam's WMDs?

      btw, did you fucking americans find the chemical weapons cache in Iraq? Or are you "fuck 'n bomb them first, then let our spin doctors answer questions later".

      asshole

    2. Re:I know I sound like a broken record... by TrebleJunkie · · Score: 1

      Gee. I didn't know that the IRA and the ELF were muslim sects. *ahem*

      Uh, excuse me, did I say that _all_ muslims are the source of the all our problems?

      No.

      Terrorist organizations (BIG Distinction) are the source of a lot of (real and percieved) hysteria, however. Terrorism is now used as the (real/percieved/viable) excuse for a lot of (near-)unconstitutional limitations of rights and liberty here in the U.S. and abroad, and that's going to continue until these various terrorist groups are eliminated, and, sadly, probably even then, for a considerable time.

      --

      Ed R.Zahurak

      You know, oblivion keeps looking better every day.

  41. Great! by sharkey · · Score: 1

    Floating Data Storage. Now they'll HAVE to approve my request for a jacuzzi in the server room!

    --

    --
    "Outlook not so good." That magic 8-ball knows everything! I'll ask about Exchange Server next.
  42. archive.org cache here by johu · · Score: 1
    1. Re:archive.org cache here by TrebleJunkie · · Score: 1

      Damn, this internet thing is scary. :)

      --

      Ed R.Zahurak

      You know, oblivion keeps looking better every day.

  43. Oh! The irony! by Inspector · · Score: 2, Insightful
    Filthmaster writes "I just saw an interesting paper that has been posted to bugtraq, full-disclosure and vulnwatch. It deals with the principles of stealthily using network infrastructure as either short-term or long-term storage. Not sure if I'm ready to implement it, but it makes interesting food for thought."

    There's also a mirror up.

    Sneaky bastards!

    --
    Michael Gentili
    - He's just some guy, you know?
  44. kaboom by Roadkills-R-Us · · Score: 1

    End of the Internet predicted, and all that.

    I vote we use the papers' authors as practice bombs.

  45. This is new? by jimfrost · · Score: 2, Insightful
    This is just a rehashing of an april fool's joke that went around on USENET some 15+ years ago. They were talking about using the UUCP transmission delay for archiving. I spent a few minutes trying to track down the original on deja.com, unsuccessfully, but trust me ... I remember it.

    It's also interesting that way back in the dawn of computing equipment they did use propagation delay as a way of doing storage. Mercury delay lines in particular. Not only that, the people that used them noticed that the tubes made noise and found ways to play tunes by saving the appropriate data. Google "mercury delay lines" and you'll find a few notes about the technology.

    --
    jim frost
    jimf@frostbytes.com
  46. Parasite by handy_vandal · · Score: 1

    Not everyone can benefit, because of side effects of it's parasitic nature

    "If I come back as an animal in my next lifetime, I hope it's some type of parasite, because this is the part where I take it EASY!"
    - Jack Handey

    --
    -kgj
  47. Yet another Star Trek idea finally shows up. by Gldm · · Score: 1

    Scotty uses this in the TNG episode "Relics" to keep himself alive by being stuck in a transporter doing diagnostic loops for a good number of years (Hey at least it was better than the plothole for Kirk's TNG appearance in Generations!). I always find it amusing when I see sci-fi stuff start showing up in the real world.

    --

    Introducing the new Occam Fusion! Now with sqrt(-1) fewer blades!

  48. Similar tricks for around quotas in college by ron_ivi · · Score: 1

    I remember all sorts of tricks like that in college. Back in the day when many mail servers with UUCP would only call each other every few hours, one could store lots of data in them. Especially if your network's quota system let you exceed your quota for short periods of time. The best were slow mailers where you could use long bang-paths like somewherefar!somewherelsefar!sun!sono!mayer to explicitly target slow/big servers. We were inspired by an article in the 80s proposing similar with mirrors on the moon.

  49. Old News by webhat · · Score: 1

    This is absolutely true. You can actually use all the buffer/cache of all the routers, switches and computers allocate you in the way of the package to store data.
    About 4 years ago I did a test transfering approx 50 Mb of data, as an icmp payload, taking a long route (satelite/trans-atlantic route etc).
    My main problem with it, even with the cache, translation and bouncing delay, was that I was getting the first packets back by the time I was sending packet #. (My PoC wasn't very efficient.)

    I still think it's a cool idea though, just have to make sure that you use Reed-Solomon (or such) so you can reconstruct any dropped packets.

    --
    'I am become Shiva, destroyer of worlds'
  50. Class A by 0x12d3 · · Score: 1

    I don't imagine that a Class A (tcp/ip) parasitic computing model would be particularly ideal for sensitive data as the script/prog/implementation would be stored in RAM on the Host running the exploit. If the ram on this box were compromised, it would prove trivial to re-piece together the data via the individual hosts.

  51. No it isn't, you're just the messenger by Moderation+abuser · · Score: 1

    I'm a sysadmin in a very large corporation and when we run out of space, I tell management. In fact, I tell them in advance, regularly, that's what capacity planning is all about.

    If they decide not to do anything, like let me buy more disk or a bigger file server, I leave the space full and suggest files which might be trimmed or people who are using more space than might be reasonable.

    It's their problem, they are the ones with the purse strings and it's their production which is being halted by their stupidity.

    --
    Government of the people, by corporate executives, for corporate profits.
    1. Re:No it isn't, you're just the messenger by Rogerborg · · Score: 1

      >No it isn't, you're just the messenger

      Hey, do you work in one of those places where cowardly, incompetent spiteful management really don't shoot the messenger? Wow, what's that like?

      By the way, it sounds like I'm complaining, but I'm not really. It turns out that I get paid the same no matter what I do, so it all works out in the end.

      --
      If you were blocking sigs, you wouldn't have to read this.
  52. What about.... by DotDotSlasher · · Score: 1

    What about those /tmp directories -- who needs those? We can store data there.
    Even disks that are full let you create empty files -- uuencode and store data in empty files as long filenames.
    Who uses all that memory these days? Store data in memory, keep a few redundant copies for silly "rebooting" incidents.
    Virtual memory is another place ripe for picking. What about screen memory -- no one uses the whole desktop
    Couldn't you send data to the speakers, and grab the data back from the microphone?

  53. Re:implimentation by Lord+Bitman · · Score: 1

    I dont know, this sounds like something that, with enough forthough, could work very well.
    Of course, that would only work if nobody actually knew about it. The fool published the idea, now no one can do it!

    --
    -- 'The' Lord and Master Bitman On High, Master Of All
  54. Re:What was that scifi story - SPOILER by Amiga+Lover · · Score: 1

    I'll be rich till the end of my days! bonus. *presses the button a few more dozen times*

  55. Storing data in the ether by sglines · · Score: 1

    I went to a lecture by J. W. Forester once where he said that one of the ideas that came up before the invention of core memory was to use long microwave loops as a storage medium. Sounds like bad ideas never fade away.