Slashdot Mirror
Evolving Swarms with Swarmstreaming
Orasis writes "Applications like Bittorrent have broadly validated swarming technology in the real-world. Now, the inventor of swarming has released a new technology called swarmstreaming that allows smooth progressive playback of content, skipping ahead, and random access without downloading the entire file. It's an HTTP proxy, so browsers, podcasting, and RSS apps should be able to use it transparently. "
In other news, the inventor of swarming was attacked by killer bees.
Unknown host pong.
Since when did you want to pause pr0n?
You must be doing it wrong... you are masturbating at the same time right?
...since it's Slashdotted after one comment. :(
Google Cache
Find out about the Lexus Rx400h Hybrid!
Now, the inventor of swarming has released a new technology
Uh, so the killer bees are inventing technology now, and nobody is alarmed? I, for one, welcome our new technology-wielding killer bee overlords.
Think about what this means for pr0n!
Is it just me, or isn't that the default implication for any new video streaming technology?
Oh wait... You must be new here.
Does anyone have a Torrent link to download it?
This is another way of starting a sig with this and ending it with that.
If so... go back to the drawing board Justin...
So wait... you can pause bees in mid-air? Or are there bees in the pr0n that we're pausing? Either way this sounds dangerous.
Swarmstreaming: Swarming Downloads Evolved .swarm files. This is probably our most exciting advancement since the original invention of swarming.
r mstreaming
I'm proud to finally unveil swarmstreaming our third generation of swarming algorithms that are designed for the fastest downloads of web content and multimedia without any special server software or silly
The technology improves swarming by ensuring that the bytes that the user wants next are scheduled to be received next. So if they're playing back a video file, the bytes from the front of the file will be received first. If the user (or application) skips forward to the middle of the file, the bytes at the middle of the file will be prioritized. Thus, unlike first generation swarming systems like Swarmcast or Bittorrent, you don't have to wait for the entire file to download to do something useful with it!.
Under the covers it is almost unimaginably more complicated than this because it also provides Self-Healing Downloads, implements a full-blown, scalable, Web Proxy Cache, and actively works to ensure that the video playback never studders or buffers by constantly monitoring and adapting to changing network conditions. For a raw feature dump, check out the SwarmStream SDK Feature Matrix
Nowadays, because of its immense popularity, most people have only heard of swarming because of Bittorrent. I have no animosity towards Bittorrent because it has done more than any application to prove the value of swarming to the general public. But if people are impressed by Bittorrent, they're going to be absolutely blow away by swarmstreaming and how far we've taken swarming since its humble beginnings five years ago.
The best source of information right now on swarmstreaming is Onion Networks SwarmStream SDK, so check it out and let me know what you think.
He links to http://onionnetworks.com/technology/swarming/#swa
December 13, 2004
.swarm files. This is probably our most exciting advancement since the original invention of swarming.
Swarmstreaming: Swarming Downloads Evolved
I'm proud to finally unveil swarmstreaming our third generation of swarming algorithms that are designed for the fastest downloads of web content and multimedia without any special server software or silly
The technology improves swarming by ensuring that the bytes that the user wants next are scheduled to be received next. So if they're playing back a video file, the bytes from the front of the file will be received first. If the user (or application) skips forward to the middle of the file, the bytes at the middle of the file will be prioritized. Thus, unlike first generation swarming systems like Swarmcast or Bittorrent, you don't have to wait for the entire file to download to do something useful with it!.
Under the covers it is almost unimaginably more complicated than this because it also provides Self-Healing Downloads, implements a full-blown, scalable, Web Proxy Cache, and actively works to ensure that the video playback never studders or buffers by constantly monitoring and adapting to changing network conditions. For a raw feature dump, check out the SwarmStream SDK Feature Matrix
Nowadays, because of its immense popularity, most people have only heard of swarming because of Bittorrent. I have no animosity towards Bittorrent because it has done more than any application to prove the value of swarming to the general public. But if people are impressed by Bittorrent, they're going to be absolutely blow away by swarmstreaming and how far we've taken swarming since its humble beginnings five years ago.
The best source of information right now on swarmstreaming is Onion Networks SwarmStream SDK, so check it out and let me know what you think.
"Skipping ahead" Will skip to a part of the clip that you may not have. This=lag
The technology to eliminate lag already exists and has been implemented. I have used it myself.
What's more, usually you cannot download one second of movie in one second of time, unless you have a crazy tricked out connection.
What nonsense. Have you ever downloaded a trailer from here? If the trailer starts to play immediately when you start downloading (i.e. the gray progress bar proceeds faster than the location marker), then you are downloading 1 second of movie in a time faster than 1 second. I can assure you that millions of people have a connection fast enough to do this.
This means that if you skip to a part you haven't seen yet, you will have to wait even longer for buffering.
Again, not necessarily. Buffering is when the streaming software requires that you download x amount of content ahead of the time you actually view it to account for inconsistencies in the stream or packet loss. If those can be eliminated, and connections made fast enough, there is no empirical reason why buffering must continue to be utilized.
Whenever I hear swarm in an IT context, I can't help but think about Crichton's Prey.
SwarmStream Development Suite Features
* Object code for the entire suite of SwarmStream(TM) APIs, including WebRAID(TM), DirectCache(TM), Throttling, and THEX.
* Visualization tools to perform live inspections and demonstrations of what SwarmStream is doing during your application run time.
* One full license for WAN Transport(TM) Server (normally $2950), an HTTP server specifically designed provide advanced SwarmStream features such as self-healing downloads and automatic mirror discovery.
* One full day of developer training
* 20 hours of ongoing support
* One year of free upgrades for all of the above software.
* Unlimited right to use and implement SwarmStream technology for testing, prototyping, demonstrations, or creation of reference designs or applications. Production deployment requires an additional Deployment License.
* One-time fee: $25,000
Anyone care that Orasis (the story author) = Justin Chapweske?
http://www.advogato.org/person/orasis/
-c
That is incorrect. Instant On has to do with streaming, not progressive downloading. The two are different.
Progressive downloading is where you download something like http://www.whatever.com/movie.mov in a web browser and it starts to play as soon as part of it is downloaded. You can then skip to wherever you want once you have downloaded that part (because at that point all you are doing is scrubbing through a movie file stored on your local machine.)
Streaming is where you load something like rtsp://stream.whatever.com/something.mov into a video player and it streams it to you. At no time during that process is anything stored on your local mahcine aside from what you are currently viewing and whatever the client has buffered ahead of that. Instant On instructs the server to skip the stream to another section.
When you download something via BitTorrent, it's downloaded in random order, as pieces become available. While this works, it means you've got a huge file on your hard disk, but it's completely useless because random pieces are utter garbage bytes. For example, unlike with a straight download, you can't start watching a video file that's still being saved to disk.
The only thing swarmstreaming changes is that it tries to download data in order, so you can use it more quickly, like any other conventional stream-oriented protocol (which is basically anything that uses TCP, along with various streaming media protocols). Now, the innovation is putting together streaming media with the power of swarming--imagine being able to feed a live TV feed from a single stream from the "seed". This is basically what multicast promised, but due to infrastructure problems, has yet to deliver.
Now, the devil is in the details. You're going to have problems with a distributed application that tries to deliver the same data to all nodes in the network at once, since you don't get all those nice properties of randomized distribution of different pieces. Some lossiness would definitely be desirable, meaning you don't really want to use it like a Web proxy. Furthermore, it's physically impossible to deliver data around the planet without many tens or hundreds of milliseconds of latency, so it's not good for interactive applications.
It might be a big win for TV-on-the-Web, though. Imagine if just anyone with a couple hundred kbps could serve a worldwide audience... all those Internet radio stations that are begging for donations to pay bandwidth costs could slash their total bandwidth needs, while upgrading service as well.
I'm not sure if this particular product is going to do the trick (swarmstreaming isn't a new idea, after all, and lots of people have been working on it), but anything that gets people thinking about it should help in the long run.
24 hour PST - 13:37.