Slashdot Mirror


Low Cost Webcast Optimizations?

ChunKing asks: "I work for a small community broadcasting organization, and we operate a limited streaming media facility for a number of not-for-profit webcasters. It has always been an issue to optimize our streaming media infrastructure to most benefit our users. We operate a small cluster of servers from a data center with good connectivity and a highly-rated ISP, who will occasionally allow us to burst to unlimited bandwidth. For big webcasts, we will load balance the stream over a number of servers using round robin DNS. However, we still get problems with stream buffering and network drop-outs, particularly with streaming video. We cannot afford a network of edge delivery servers like Akamai, so in what ways can we further optimize our streaming media capacity to better produce smooth webcasts?"

108 comments

  1. Torrent by MyNymWasTaken · · Score: 3, Interesting

    (This probably won't be helpful to your present problem, unless something along this line of thought already exists.)

    I wonder how well a method such as bittorrent adapted to streaming data would do - i.e. decentralized streaming.

    The first few viewers receive the stream directly from the source, while acting as mirrors for subsequent viewers. It would dramatically cut down on the server load & overhead for the broadcasters.

    1. Re:Torrent by jimmyhat3939 · · Score: 3, Informative

      There was a system that came out to do this. There are numerous problems, including differential lag times between servers and firewalls. Most importantly, unlike torrents, you need to stream media in a linear fashion. The great thing about BitTorrent is you can get, say, piece 53 from one guy and piece 173 from another guy at the same time. Here, you'd have a mad rush for pieces 1 and 2 right from the outset. Also, I suspect it's much harder to get people to 'seed' stuff in the media world. I believe there's still some sort of system based on shoutcast that does this, though, if you want to look it up.

      --
      Free Conference Call -- No Spam, High Quality
    2. Re:Torrent by humphrm · · Score: 2, Insightful
      That is a great idea, really it is. The challenge it presents is, everyone has to "buy in" to the idea of being mirrors for the stream. That's fairly straitforward in bittorrent, everyone's there for the same purpose... but webcast viewers are not there to share, they are there to watch. I suspect some people (I'm not saying they aren't selfish people) would have a problem with sharing their own bandwidth, if they knew that's what it entailed. Especially casual webcast users.

      But, again, a really, really great idea to produce a torrent-like video streaming system.

      --
      -- "In order to have power, I must be taken seriously." -Mojo Jojo
    3. Re:Torrent by mindtriggerz · · Score: 2, Informative

      Xiph is working on a system like the one you describe.
      You can find their informal wiki page at http://wiki.xiph.org/IceShare

    4. Re:Torrent by fsterman · · Score: 2, Informative

      Kinda like this?

      --
      Is there anything better than clicking through Microsoft ads on Slashdot?
    5. Re:Torrent by LabRat · · Score: 2, Informative

      Cool link..though from what I see it only works with pre-recorded stuff and wouldn't be useful for live webcasting as is the intention of the OP. After all, it's tough to get pieces of a broadcast from other clients when it hasn't been created yet :p Unless, of course, one is willing to have clients cache segments of the broadcast...and distribute that to other clients (with a noticeable latency to those further "downstream"). Going that way seems kinda kludgy to me. Something along the lines of skype would be better suited...where it builds a multi-cast-like tree of nodes and supernodes that could be used to distribute live content while providing a much greater scaling factor over the 1:1 that OP currently is getting (though not as good as a bit torrent type architecture would yield), and is suitable for distributing live content where everyone has similar latency, rather than "tiers" of latency. Just an idea...

    6. Re:Torrent by WoTG · · Score: 1

      I vaguely recall using something with "Chain" in the name... this was years ago for a local radio station. Chaincast, maybe? Anyway, IIRC, the problem (to me) was that it required a special client install. On the plus side, I think it was smart enough to server other clients on the same LAN. So, if 50 people happen to like the same stream, there's only one feed through the broadband connection.

    7. Re:Torrent by trozman · · Score: 2, Informative

      What you're describing sounds like PeerCast. http://www.peercast.org/ I've tried it with some radio stations.. connectivity rate seems to suffer, but otherwise, there aren't any issues with quality (but I only used for radio, not video)

    8. Re:Torrent by DeafByBeheading · · Score: 1

      There would be noticeable latency to those downstream, but they would also receive more robust streams, no? Since they would have multiple points to access the stream (whereas the direct streamers must access the one set of servers), it would be more resilient to network problems in one of the connections. I'd gladly watch a "live" webcast delayed by two minutes if it means it's more stable.

      --
      Telltale Games: Bone, Sam and Max
    9. Re:Torrent by LabRat · · Score: 1

      I don't see how one method would be any more or less inherently robust than the other. Each is relying on the bandwidth of intermediate nodes, and by definition each is exposed to the same risks. By the time you add in the caching mechanism that would be needed for a bit torrent type application, you've added more things in the chain to go wrong by increasing the overall complexity. After all, each client would be required to cache the broadcast in exactly the same way, with exactly the same time intervals with exactly the same time references in order to break up the file into indexible pieces ala bit torrent. So, on that front I don't think either method has an advantage in "robustness"....if anything the skype method probably more robust due to its simplicity. In addition, the bit torrent approach necessarily introduces some finite programmatic latency based on tiers of connectivity (assuming you could solve the cache concurrency problem), but the skype approach does not.

      And for a webcast where interactive elements are included (like many of Cisco's...where questions are entered via web, and then answered by the host on video), any kind of purpose-built latency on the order of minutes is unacceptable IMHO.

    10. Re:Torrent by nacturation · · Score: 1

      That is a great idea, really it is. The challenge it presents is, everyone has to "buy in" to the idea of being mirrors for the stream.

      Seems to have worked well for Skype.

      --
      Want to improve your Karma? Instead of "Post Anonymously", try the "Post Humously" option.
    11. Re:Torrent by aminorex · · Score: 1

      Actually, in P2P swarming, you're not sharing your bandwidth, which implies a loss of bandwidth otherwise available to you; rather, if the software is correctly designed, you're exploiting otherwise unused bandwidth.

      --
      -I like my women like I like my tea: green-
    12. Re:Torrent by BigLonn · · Score: 1

      Hmm on sourceforge they have a roup investigating that idea as we speak, I forget the name, but they are moving ahead with the concept, albeit in a slow pace.

  2. Unlimited Bandwidth by lax-goalie · · Score: 4, Informative

    "who will occasionally allow us to burst to unlimited bandwidth"

    Well, unless your provider has "unlimited bandwidth" themselves, you're basing your webcast on a lie. Pretty much no one has unlimited bandwidth; even a couple hundred broadband streams can saturate an OC-3 connection.

    What you need to do is plan your webcasts a little better and ask a bunch of questions: What's the real bandwidth your ISP can provide (with redundancy)? What's the buffer size that your client apps are using? (Settable in some clients, like Flash.) Does your ISP (who promised you unlimited bandwidth) even know what the hell they're doing?

    Without going to a dedicated CDN like Akamai, it's still pretty easy to design a distributed service network with colocated servers scattered across the country. You might want to consider finding someone who knows this kind of thing and paying them a few bucks to fix your problems...

    1. Re:Unlimited Bandwidth by Anonymous Coward · · Score: 4, Funny

      I actually do have unlimited bandwidth. That's because I'm connected to the Google DarkNet. Unfortunately, at present it's just me, a bunch of empty GoogleCubes and Marissa Mayer on here. So we just send porn back and forth really fast and gossip about who Larry's dating this week.

    2. Re:Unlimited Bandwidth by HotNeedleOfInquiry · · Score: 1

      Not very original. I'd at least setup cross-network swap partitions or paging files on each other's machines.

      --
      "Eve of Destruction", it's not just for old hippies anymore...
    3. Re:Unlimited Bandwidth by EggyToast · · Score: 3, Interesting
      Would it be possible to simply have their server limit the amount of connections to ensure that everyone who has a connection keeps a solid stream going? It seems like that would be a more immediate option that would allow them to scale up bandwidth according to their budget.

      After all, even if they scale up with colocation and distributing their webcast to other servers, if they can handle [x] users but only get [x/2], with a burst of x+2 once every 6 months, it seems like they should focus more on what they can do to reasonably control dropouts among users who are already connected, vs the rare scaleup to accomodate a large number of users for a short period of time.


      Of course, it might also prove out that by having more solid streams, they'll have more users, and will inherently get more users, which would lead to an escalation of costs. Might be screwed either way.

    4. Re:Unlimited Bandwidth by fsterman · · Score: 1

      Marginally more original. I'd at least facilitate cutting-edge paradigms to visualize tracking users and facilitate clicks-and-mortar deliverables deployment to leading-edge consumers

      -jk
      --
      Is there anything better than clicking through Microsoft ads on Slashdot?
    5. Re:Unlimited Bandwidth by Anonymous Coward · · Score: 0

      One thing everyone seems to be overlooking is very simple..

      HARDWARE ENCODING..

      Look into it. I would be willing to bet your bottleneck in this is in your hardware, and not your connectivity.

    6. Re:Unlimited Bandwidth by tverbeek · · Score: 1

      I suspect "unlimited bandwidth" means "bandwidth which is not limited arbitrarily". i.e. They get as much of the pipe as they can use.

      --
      http://alternatives.rzero.com/
    7. Re:Unlimited Bandwidth by burne · · Score: 1

      "unlimited bandwidth" can mean either no limit to the bandwidth itself, or no limits applied to your consumption of the available bandwidth. Take my current hoster. I'm on a 100Mbit/s ethernet link, and thus could burst up to around 95Mbit/s. On the other hand: If I expect heavy traffic I could arrange for GE or 10GE links to my hoster. Which in turn has a 2x10GE trunk to the nearest exchange, so 18Gbit/s should be possible. As long as I keep that under 12-24 hours I won't even have to pay for bandwidth, only traffic consumed. It pays to have a cluefull, friendly hoster with nice gear and links and a taste for fine brandy.

      That's close to 'unlimited' for my uses. I'd be thrilled with 72.000 viewers for a webcast. That's ten times over my current peak.

    8. Re:Unlimited Bandwidth by heinousjay · · Score: 2, Funny

      Corporate twin powers, activate! Shape of: e-strategy! Form of: synergistic marketing iniitiatives!

      --
      Slashdot - where whining about luck is the new way to make the world you want.
    9. Re:Unlimited Bandwidth by Anonymous Coward · · Score: 0

      HI,

      Just to clarify the "unlimited bandwidth".

      The server's feed is via 100Mb Ethernet and the rate-limiting on the Juniper router that feeds the servers is lifted on request allowing the full 100Mb/s to be used and we run well below 30Mb/s.

      The ISP has mostly GigE feeds for transit and peering in the UK.

      Kind regards,

      Mark

  3. Bittorrent by Anonymous Coward · · Score: 0

    Bittorrent, of course.

  4. Forget webcasts... by MicroPat · · Score: 2, Interesting

    ... at least for the most part. Encourage your viewers to download instead of stream, if at all possible.

  5. streaming is so 1997 by sPaKr · · Score: 4, Informative

    Streaming? Are you for real, that is so 1997. Just more old media companies trying to push their way of doing things on the net. Give up on streaming. Produce several quailty versions of the same file support a few differnt codecs mp4, xvid, wmv... and setup torrents for each file. Then use your limited bandwidth to deliver the torrent files, run the tracker and with the remaining bandwidth seed the torrents with a good bittorrent client. Why suffer quailty and bandwidth requirements just so the show can be 'live'? I suspect you arn't even showing live events so why streaming? Stop thinking like a TV broadcaster and start thinking like an internet distributer.

    1. Re:streaming is so 1997 by dasnov · · Score: 5, Informative

      It all depends on who the target is. If this is targeted to the average person, I doubt they would know what a torrent is, or want to spend the extra 5 seconds to figure out how to download the file. Plus more and more people are behind firewalls and routers, and I don't think the average person would open (or know how to open) the correct ports to seed. So if this site is for the average computer illiterate person I doubt using a torrent as a solution would be much more benefitial.

      People like the simplicity of just clicking a link and the video poping up and streaming in media player, no download overhead eather.

    2. Re:streaming is so 1997 by aykroyd · · Score: 5, Informative

      A broadcast organization, like the poster is working for, is most likely in a live environment and can't just Bittorrent to success. There are Peer to Peer streaming tools out there including Abacast and Red Swoosh who I work with on a daily basis that provide sound results for their customers.

      Unfortunately, though, a CDN-style infrastructure is still the optimal way to go. There are generally resellers of the CDN technologies that can give you reduced rates on the same service. I know our particular model allows for easy scalability with tools that allow you to control your bandwidth usage. </pitch type="shameless">

    3. Re:streaming is so 1997 by Gulthek · · Score: 2, Interesting

      Most of the time, what you're describing isn't streaming, but downloading. Windows media and quicktime both "stream" downloaded content for the user.

      Torrenting is the new downloading, if people want to get the latest and greatest on the net then they'll just have to learn how it works. I'm sure that it will just eventually be configured automatically as well though.

    4. Re:streaming is so 1997 by aliens · · Score: 2, Informative

      We use ninesystems, not sure if you work for them or just use them as well. But they have always been top notch and quite a bit cheaper than Akamai.

      Keep up the good work!

      --
      -- taking over the world, we are.
    5. Re:streaming is so 1997 by himynameisJake · · Score: 1, Interesting

      I think you should examine the situation a little more closely.

      For instance, if you produce a video that uses a song from Britney Spears (not that anyone would ever do that, but play along), the licenses required to allow people to physically download copies of that song to their hard drives are different and usually vastly more expensive than releasing the video as a live stream or as part of an on-demand system. The primary question of this article was maintaining fiscal responsibility, not opening the door to a finanical raping by the RIAA/MPAA.

      Torrents are also nowhere near easy enough to use for the everyday consumer. It's nice to think so because, after all, everyone on Slashdot is a computer genius, but when you're trying to reach the broadest market possible, things like torrents and other forms of P2P are not viable options. Internet streaming is still, and will continue to be for some time, the best option for delivering content media to consumers at home.

    6. Re:streaming is so 1997 by macklin01 · · Score: 1

      Plus more and more people are behind firewalls and routers

      That's a very good point. Along those lines, many are behind routers/firewalls that actively block P2P and torrent traffic as a matter of policy. (e.g., at universities, businesses, etc.) So, depending upon the target audience, relying solely upon bittorrent could cut out a major group. -- Paul

      --
      OpenSource.MathCancer.org: open source comp bio
    7. Re:streaming is so 1997 by sPaKr · · Score: 1

      If you cant get around those lame blocking attempts you dont deserve the content you want. Just setup a remote socks proxy that runs on port 443. No one blocks web traffic and with SSL they cant do traffic analysis.

    8. Re:streaming is so 1997 by sPaKr · · Score: 1

      So embed the bittorent client into a web page and write it in java or activeX. Blizzard was able to figure out how to use bittorrent for their WoW client updates and those go to MMOG players.

    9. Re:streaming is so 1997 by Anonymous Coward · · Score: 0

      Besides limiting upload bandwidth my ISP also enforces a monthly limit which for upload comes to 1Gb/month and it's something that's standard practice with every ISP here. There is simply no way I would ever consider trading a limited commodity like upstream for content only available through a torrent.

      If you want to provide content online you'll just have to find someway to deliver it to end-users that doesn't involve being cheap and making money by letting your users pay for the bulk of the bandwidth costs, even if they're doing so in an indirect fashion.

      It's easy enough to split off a paid service for faster access to content for those who want it.

    10. Re:streaming is so 1997 by baadger · · Score: 1

      Yes because everyone who attends university, for example, has an external box connected to a line with equivalent bandwidth to said university, that they don't need to pay for, and have sufficient access to setup such a proxy...no wait, thats rare.

      Another really good port btw is 1863, the MSN Messenger service uses this port, it's above the 1024 service level (so easily setup for use by IRC daemons on shell accounts for example), allowed through most firewalls, and, like 443, it's already SSL so won't raise any suspicion.

    11. Re:streaming is so 1997 by HalAtWork · · Score: 1
      If this is targeted to the average person, I doubt they would know what a torrent is, or want to spend the extra 5 seconds to figure out how to download the file

      How can you say this when the average person will download a special media player just to play a certain site's files (name your DRM), or download special applications just to have certain mouse cursors (CometCursor), or download special applications to get a weather icon on their taskbar, etc etc. These are all targetted at the average user. Also, web browsers are building in support for Bittorrent.

      Bittorrent clients are really not difficult to use and appear no different than a web browser's download window. This just sounds like B.S. from web sites that want to keep a stranglehold on content because they cannot get repeat visits any other way.

    12. Re:streaming is so 1997 by Quinthar · · Score: 1

      Red Swoosh also integrates seamlessly with web environments (unlike, say, Bittorrent which spawns a separate application), and offers a JavaScript API for creating iTune's like download managers -- all within a simple webpage.

    13. Re:streaming is so 1997 by Breakfast+Pants · · Score: 2, Informative

      If you write it in java you can only make outgoing connections to the domain from which you downloaded the applet... not very useful for bittorrent eh?

      --

      --

      WHO ATE MY BREAKFAST PANTS?
    14. Re:streaming is so 1997 by stonecypher · · Score: 1

      if people want to get the latest and greatest

      87% IE, 12% Mozilla after four years. Lesson learned: people don't want the latest and greatest.

      --
      StoneCypher is Full of BS
    15. Re:streaming is so 1997 by sPaKr · · Score: 1

      What about signed applets? ya.. you can do much more. Really we only need one signed bittorent applet that takes the torrent file as an arg and then everyone can just reuse that applet passing their own torrent file. Jebus I need to do everything.

    16. Re:streaming is so 1997 by aminorex · · Score: 1

      That is, of course, simply wrong. Java applets can connect to anything, using TCP, UDP, or TLS.
      You must be thinking of Javascript's XMLHttpRequest object.

      --
      -I like my women like I like my tea: green-
    17. Re:streaming is so 1997 by Anonymous Coward · · Score: 0

      You (and others) seem to not realize that there *are* benefits to LIVE webcasting - taking questions from viewers, slide shows (ppt), polling questions, etc. Not that there aren't benefits/ways of doing this for downloads, but suggesting bittorrent for a live webcast isn't going to work if these other features are desired.

  6. Do they *have* to stream? by OverlordQ · · Score: 3, Interesting

    Is it vitally important that they have to stream the data? You cannot just distribute downloads and Coral Cache em? Cut my bandwidth for files from 120GB/mo to ~15GB/mo

    --
    Your hair look like poop, Bob! - Wanker.
    1. Re:Do they *have* to stream? by J.+Random+Luser · · Score: 1

      Can you think how else to do live webcasting? Sure somebody mentioned multicasting, and I can see the ISP's eyes rolling from here. But Torrents, Podcasts, and all the other fancy schemes folks are rambling about here, just won't work for live material.

    2. Re:Do they *have* to stream? by Anonymous Coward · · Score: 1, Informative

      heh, I love the people who think Coral Cache is this big giant unlimited source of bandwidth.. its slow, latent, and unusuable for this application

    3. Re:Do they *have* to stream? by OverlordQ · · Score: 1

      I agree it's slow, and it's not an unlimited source of bandwidth, I'm just saying I use it on a daily basis, and I know of lots of other people who do who use it for distributing media.

      --
      Your hair look like poop, Bob! - Wanker.
  7. Get everyone to use multicasting by Anonymous Coward · · Score: 0

    Oh, you wanted realistic suggestions.

  8. Not more bandwidth but.. by mancontr · · Score: 1

    You don't say what compression you're using. Changing to a better codec (xvid?),resizing, or changing the bitrate, maybe you can improve the streaming

  9. One word. by lw54 · · Score: 2, Informative

    Multicast.

    1. Re:One word. by TubeSteak · · Score: 1
      --
      [Fuck Beta]
      o0t!
    2. Re:One word. by osbjmg · · Score: 1

      I was about to make that comment, kudos. More bandwidth is just brute force, multicast can git 'er done.

    3. Re:One word. by LabRat · · Score: 2, Informative

      Great idea in theory...not so good across the internet when you are trying to reach people who might be connected to any arbitrary Tier-1 provider. MBONE really isn't a solution, either, as it requires a lot of coordination in order to make use of it, and is more of a development tool than production-quality. The OP has a very interesting problem, for sure. I think a skype-like P2P architecture would probably be the best solution rather than multicast...where you effectively create a multi-cast-like network through establishment of application-level tree structures with nodes and supernodes. It's not quite the infinitely-scalable architecture that going with a bit torrent type system would yield...but it would be simpler for a latency-sensitive and order-of-arrival-senstive payload such as video...and still yield huge increases of "effective" bandwidth in the overall broadcast system. All that, and no special network voodoo needs to be arranged with the ISP like a multicast/MBONE application would require.

  10. bottleneck? by adrianmonk · · Score: 4, Informative

    You mention a lot of factors, but you haven't said what area you're having the most problem with. Have you at least managed to identify what the actual bottleneck is? It could be bandwidth at your servers, or between your ISP and some peer (through which most of your traffic is going), or it could be CPU load on your servers, or it could be disk I/O limits on your servers, or it could be lack of memory on your servers (causing them to thrash), or it could be uneven load balancing to DNS-based load balancing being somewhat random, or it could be that you've reached the maximum capacity (in terms of hosts per response record in DNS) with DNS load balancing and you need to add another layer of load balancing.

    The first step is going to be to check into all those areas and identify where the failure is currently happening. Once you know that, the solution will be more obvious. You might just need to add striping for your disks (to increase throughput by brute force) or RAM (to be able to cache all active streams) if the problem is that your disks can't keep up. But, if your ISP's connection to a major peer isn't sufficient, then you will need to do something much more involved (and will probably include gathering data during an actual event where the streaming can't keep up in order to prove that the ISP is the problem).

  11. Akamai and other Content Delivery Networks by dirtyhippie · · Score: 4, Informative

    Stay away from CDNs if you're looking for performance (if it's pricing you're after, that's a seperate issue) - they are likely dealing with all the same issues that you are. Except that when something goes wrong, there's nothing you can do except shrug and say "it's the CDN's fault". My organization went to a CDN to save on ridiculous colo bills, and we heard all the claims about performance with skepticism, but we were shocked to find that despite all the "second generation edge servers" our CDN has, thruput actually went DOWN significantly when we switched to them. We didn't much care since it was saving us a lot of money and was usually unnoticeable or at least bareable...

    But to return to your original question - since you're dealing with not-for-profits, clearly the answer is a live streaming P2P "edge network". Let me know when you release that code :)

    If you don't have the development resources for that, the best solution is probably to scale down your investment in your current colo and pop a few servers in a different geographic locale, a kind of DIY edge network. With 3 or 4 colos (say, Europe, US-East, US-West), and smart determination of which host to route to using Geo::IP or the like, you could probably save a lot of traffic and latency.

  12. One more word.. Re:One word. by Anonymous Coward · · Score: 0
  13. Outsource it to Google video by iamelgringo000 · · Score: 5, Interesting

    Upload video to Google video or YouTube.

    Use their bandwidth to stream your video.

    Use their API to embed the video on your website.

    You lose control over the distribution of the content, but you save a lot of money in the process. The other option is Bit torrent.

    Also, have you looked into DigitalBicycle? They are working on a PeerCasting system for Using Bit Torrent, RSS, and web community software

    1. Re:Outsource it to Google video by ciroknight · · Score: 1

      Ugh are you kidding me? The video quality of both YouTube and Google's Video looks.. downright disgusting.

      Just got with torrents.

      --
      "Victory means exit strategy, and it's important for the President to explain to us what the exit strategy is." G.W.Bush
  14. Use decent modern compression for streams by springbox · · Score: 2, Interesting
    For audio, use aacPlus (probably not free) or Ogg Vorbis (free!) Mainstream players support these (like Winamp.) Don't push junk like Realplayer. Vorbis alone will save a lot, and even super low bit rates will end up sounding decent compared to other compression technologies (I'm looking at you, MP3.) You can also set up a free streamcast server and use vorbis with it.

    For video? I'd recommend XviD, and not just because I use it almost exclusively, but it creates a compliant MPEG-4 video stream (compresses nicely), which will hopefully be streamable by any player that supports MPEG-4 video.

    1. Re:Use decent modern compression for streams by mcbridematt · · Score: 2, Interesting

      Why use plain old MPEG-4 when you can go one up to H264?

      The difference IS noticeable the lower down the bitrate you go.

      So what, you'll need more resources to encode the video but its worth it.

    2. Re:Use decent modern compression for streams by fsiefken · · Score: 1

      aacPlus and Ogg Vorbis aren't supported on a lot of players (the majority?) so you have to inform users to download and install a specific program. So don't be harsh on MP3, it is supported by almost every device (except for people still using sub 386 machines) and it takes less power to decode on portable devices. Concerning the performance at low bitrates: lame -V9 --abr 8 -mm -a --lowpass 5 --athtype 2 -X3 sounds better to my ears then the Ogg (latest Aotuv) or aacPlus equivalent.

    3. Re:Use decent modern compression for streams by fsiefken · · Score: 1

      With a complex codec as H.264 you'll also need more resources on the decoding end. If you go above 320x240 resolution users who don't have h.264 hardware support can't keep up, that means sub Ghz processors and (currently) all mobile devices.

  15. Pod....pod...pod...cast by Anonymous Coward · · Score: 0

    Might as well join the other 100M people. Forget about streaming...old school.

  16. so many bad answers.. by Anonymous Coward · · Score: 2, Insightful

    Akamai is a premium priced streaming provider, there are many others, most of whom will do what you need at a much lower cost. We are currently streaming live streams (live television channels) with akamai, vitalstream, limelight, and others. We are pulling the seed streams from the middle east and south asia and broadcasting to thousands of users over a very wide geographic area. We have load tested to the 10s of thousands of users and none of the CDNS have even broken a sweat. I know of several sites that are streaming 24/7 channels that have literally hundreds of thousands of simultaenous viewers and viewerships ranking in the millions per month. (unique).

    Do yourself a favor, call vitalstream or limelight they have starter streaming packs which you probably cannot even begin to use up and they run in the hundreds of dollars a month if I remember right.

    To everyone that said xvid or any other format. xvid is a file format. he wants LIVE streams.
    to everyone that said streaming is dead.. get a grip, iptv is the next television revolution..
    http://www.cabledatacomnews.com/feb06/feb06-3.html

    1. Re:so many bad answers.. by threedognit3 · · Score: 0

      iptv....oh yes...packets in the millions..all subject to network problems. Fiber optic cable....friendly....extremely fast...you'll be downloading in seconds what I can download in nonoseconds. Skype nut that you are.

  17. Clean, Secure Bandwidth by J.+Random+Luser · · Score: 1

    We operate a small cluster of servers from a data centre with good connectivity and a highly-rated ISP, who will occasionally allow us to burst to unlimited bandwidth.

    How small is that cluster? and what value is unlimited and burst? You don't say which brand of streaming you're running. It wouldn't be meaningful for me to extrapolate from my single QuickTime X-Serve experience, but I have saturated a 100mb/s link between my site and a test site with multiple streams, and no sign of stress on the box. The last test clients to connect got the worst service, and there was no noticeable dropoff in quality for those already connected. Our ISP could have given us a 1G link, but they were afraid we'd find a problem with the link before our box choked.

    If you're doing live webcasting then disk access is not an issue, providing you've got a truckload of ram in each box. Bandwidth at client end is often overlooked. How many clients are simultaneously connected thru a single concentrator point? NAT at client end can be a killer. And if the problem is caused by excessive demand from outside your intended catchment (small community broadcasting organization) then the solution may be difficult for a non-profit. You don't need a network like Akamai. You might get away with one independent dedicated unicast link to a small reflector server cluster somewhere geographically well away from your local target.

    There's another problem which has only recently appeared. Your qos flag settings will be now be fighting with VOIP, and whether/how the intervening routers respect them. I have seen a medium sized corporate installation put its voice traffic onto the data fiber backbone, and "private" jabber videoconferencing suffered in consequence.

  18. bitrate by Lehk228 · · Score: 1

    if you have fine control of encoding try cutting your framerate in half, as long as your sound quality is good even very bad video isn't distracting

    --
    Snowden and Manning are heroes.
    1. Re:bitrate by pestie · · Score: 1

      I generally find the exact opposite to be true. I suppose, though, that it depends on whether the source material's interest is primarily visual or audio. For news programs and the like, the audio is probably much more important than the video. For pr0n, the audio track can be missing and 8 out of 10 viewers won't even notice. Heh...

      In any case, for video watched on a TV vs. a computer monitor, I find that even 320x240 is very watchable (roughly equivalent to VHS videotape, I think) if the frame rate remains at 30 fps. Even 512x384 looks horrible to my eye if the frame rate is 15 fps.

  19. What's the Problem Precisely by Inhibit · · Score: 1

    First you need to figure out your problem, as some others have pointed out. Until you actually get it nailed down, asking other people's kinda pointless.

    It's probably that your bandwith is being maxed out... but you'll want to hire someone that knows what they're doing. That'd be the place I'd start, were I in your shoes.

    --
    You're reading Slashdot. Of course you like Linux and pc hardware
  20. Ourmedia.org by digitalfilmmaker · · Score: 3, Informative

    http://ourmedia.org/ is setup for just such occassions. My video podcasts to a 100,000 people in the last month without complaint. CC friendly. And free.

  21. Investigate Ultravox by kriston · · Score: 4, Interesting

    This problem has been solved already. It's called Ultravox. It's a protocol that is format-agnostic and is used to efficiently multicast a broadcast within the data center up to the point it leaves your network. America Online and Cisco designed and implemented the protocol both in software and in the firmware of specialized Cisco routers and it is used for AOL Radio and for Winamp radio It's very interesting. All your viewers need is Winamp to hear or view your program.

    http://ultravox.aol.com/

    --

    Kriston

  22. What's your input like? by J.+Random+Luser · · Score: 1
    I just reread the summary: we operate a limited streaming media facility for a number of not-for-profit webcasters

    More items for your checklist -
    1. Supplier bandwidth, for live material;
    2. Material optimised for streaming? whether live or files for on-demand.
  23. You are correct by jd · · Score: 2, Informative
    And I'd almost given up hope that others realized the technology was useful! :)


    Seriously, because ISPs generally do not support multicast (even though their hardware does, it's just disabled, it requires 5 seconds to turn on, and is likely native downstream of them anyway), it is better to do this the way NASA Select did with their TV broadcasts in the days of CU-SeeMe. (Great program, died an ugly death, and is now a zombie in the hands of a corporation.)


    What NASA did was to multicast for anyone who could get multicast to receive, but ALSO to reflectors that supported unicast connections. Users without multicast could then hook up to the nearest reflector and get the broadcast with only marginal extra latency.


    Because multicast reduces the number of streams (to one), you have the benefit of being able to boost the quality of the transmission. Typical webcasts are maybe 320x200 at 5 seconds a frame. If you're lucky. A typical MBone transmission is very close to NTSC resolution at 15 frames per second, because the users have that much extra bandwidth to play with. That kind of a dramatic improvement in quality draws attention, which means that if this is a payed service (multicasting supports those), you're likely to improve not only the output but the revenue as well.


    Because this is a broadcast-only system, the flavour of multicasting most likely to be of interest is SSM (Source-Specific Multicasting) where only designated endpoints (in this case the webcast transmitter) can send, all others receive.


    Remember, multicasting is your friend.

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    1. Re:You are correct by TallMatthew · · Score: 2, Informative
      Remember, multicasting is your friend.

      Multicast is one of those technologies which was designed quite well and makes perfect sense in theory, but is seldom useful.

      If this guy is broadcasting to one person in Topeka, one in Taipei and one in Tennessee, does he need multicast? He doesn't. Should every router on the Internet participate in the creation of PIM trees or allow the inclusion of hundreds of thousands of /32 routes under the 224 prefix? They shouldn't. So is multicast useful for streaming audio and video across the Internet, you know, multi-casting? It isn't.

      Multicast ... bah. Yeah, I said it.

    2. Re:You are correct by marx2002 · · Score: 0

      isnt it possible to use "multicast" in a closed network ? for e.g. settup a few servers around the globe , use multicast enabled routers and let people use a tunnel to connect to it ? cheers

  24. It's not the servers... by bgib2610 · · Score: 2, Informative

    Check the load on the servers... that's not your problem. Check your bandwidth pipe. That is your bottle neck. Now just because you might have a 20 MB pipe doesn't mean you have 20 MB to the Internet. Bandwidth providers are famous for overselling pipes... that's how they make money! What you need to look into is getting a second ISP that feeds from a different data center than the one you have now. Now another option is to co-locate to a center that has multiple ISP feeds and place a publishing server at that location. Therefore you only use the bandwidth at your current site to send the feed to the co-location. They will most likely have three to four ISP feeds to the Internet and the cost is a lot less than adding more bandwidth and edge network services. With you being a non-profit you've got to have some leeway to get a better pricing deal.

  25. Savvis beats Akamai on Price and Service by Anonymous Coward · · Score: 0

    Go ask them to give you a quote, Akamai is crazy what they charge, Savvis
    has a great contect delivery system (on par or close to Akamai).

      http://savvis.net/

  26. try darwin streaming server by Anonymous Coward · · Score: 0

    linux, darwin, and windows versions are available , free to download...Look into .

  27. Low Upstream by Crouty · · Score: 1
    I don't know about other parts of the world, but in Germany the vast majority of broadband users are connected via ADSL, most of them with an upstream of 128 kBit/s, from which a significant part is used for TCP ACKs from the downstream.

    I do not see sufficient bandwidth for distributed streaming in the near future here.

    --
    On se Internetz nobody noes your German.
    1. Re:Low Upstream by queazocotal · · Score: 1
      That's the problem of course, you're limited at best to the bandwidth of the average upstream, minus a bit. TCP acks are not a problem - you roll your own protocol.

      You're probably going to want to do forward error correction, dedicationg 5% or so of the stream to error correction, rather than wasting the bandwidth the other way with acks.

      OTOH, in some cases, such as radio, 128K is just fine, and is a lot better than 44K that some stations webcast in noe.

  28. Sounds like bandwidth by Malduin · · Score: 5, Informative

    It sounds like your problem is bandwidth. Either on the client-side, coming off your net to your ISP, or routing problems elsewhere on the Internet. The hard part is tracking down where the bottleneck is. Try to have multiple end-user test points. The company I work for has employees on a couple of different local ISPs and servers at various colo facilities. Try logging in to each machine and testing the stream. If it's across the board, you can safely bet it's your "unlimited" pipe to your ISP or a problem at your ISP. If it's a problem with a fraction of the clients, try doing traceroutes and see how the packets hop across the Internet and look for any similarities to see where the hang-ups can be. It's also possible that some clients just aren't getting the bandwidth they think they should be getting. Try everything you can to optimize your streaming application of choice. Reduce the number of FPS if you can. If it's only a talking head or something with little movement, try spacing out the keyframes more. Unless you're broadcasting a music video or movie, try using mono instead of stereo for audio. If it's a speech, you probably don't need CD-quality sound. Dropping the sound to 32, 24, or even 16kbps for a WMA/MP3/RA stream will still sound decent for something that doesn't have a lot of variation in sound.

    Also, if it is possible, try to expirament around with variable bit-rate streams for video and/or audio. That can come in handy if your target audience spreads from AOL dial-up in the middle of nowhere to your urban 8 Mbps+ broadband connections.

    In streaming, the big three big things that you have to worry about are the encoder's connectivity (to push the stream to the distribution point), the encoder's power (to make sure it can really compress all that video without overheating or dropping frames), and the distribution point's connectivity. Distribution servers don't use much bandwidth as all they do is simply regurgitate the data back out to clients without having to do any processing other than logging.

    I've been doing streaming for about 5-6 years now. I've done everything from web cam streaming to large convention streaming that put out 300+ Mbps of connectivity. By no means am I an expert (I've done streaming--it's not what I do), but everything above is my experience with it. Most of all, just stick with what you know and are comfortable with. Your client base will determine most things. Personally (even being a BSD guy), my preferred streaming setup is using Windows Media Encoder at the source, Windows Media Server 2003 at the distribution point, and Windows Media Player (or anything else that can play Windows Media v9) at the end-user. In my experience, it has been rock-solid and can be deployed quickly. If you're already running Windows 2000/XP/2003, all the software mentioned above is provided free-of-charge.

    Hope this helps.

  29. Think TiVo, not Live TV. by MDMurphy · · Score: 1

    Why, if you're concerned about bandwidth limitations would you encourage all your users to connect at once? Just like TiVo lets viewers watch at their leisure, podcasts let people download when they want to watch, not during some arbitrary time something interesting is happening.

    Set up a video podcast. You may host it all that way, but it's not designed around having everyone sucking bandwidth at the same time. You'll want a delayed download option anyway so those who can't sit in front of the screen when something interesting is happening, so you might as well build around that. If it's a regular occurance letting the users subscribe will let them catch everything, but not necessarily at the same moment.

  30. How about something free? by buck_wild · · Score: 1

    I'm certainly not doing it on as large a scale as you, but I use VLC from videolan.org.

    Not having done anything like it before, it was not TOO difficult for me to set up.

    --
    If all you have is a hammer, everything looks like a nail.
  31. podcasting best bet by asapien · · Score: 1

    Well, unless it needs to absolutely be live, podcasting is a good alternative to streaming since it doesn't present the same problems and the audio quality is better. But if it needs to be live, maybe hook up with live365's service or something similar so you have co-hosted streams.

  32. Wow by MEast · · Score: 1

    I expected more savvy from Slashdotters. A couple different companies offer mature P2P streaming solutions. Ping me offline if you want to know more. Beyond that, the only advice I can offer you is this: It's no longer cost-prohibitive for most to contract the services of a CDN. Don't assume that doing so will cost you far more than a DIY solution.

  33. Scrap the Junky Client by DeathBunnyRanger · · Score: 1

    Stop using real media for your streaming.

    you need to pick a solid client, and the only thing that does a decent job is (irk, windows media) or flash, but flash eats bandwidth for lunch.

    1. Re:Scrap the Junky Client by aminorex · · Score: 1

      If you attempt to force me to use that DRM-laden virus-bus to view your stream, you had might as well stab yourself in the face with a fork, because otherwise I'll have to do it for you.

      --
      -I like my women like I like my tea: green-
  34. Troubleshooting tips by Anonymous Coward · · Score: 0

    Where are the dropouts occurring? Even within the ISP's network. If so, then the problem is easy to solve, since all of the broken things are in your rack/cage. Find a stream that doesn't work, see if other streams from other servers are ok, etc... isolate the problem.

    Maybe it's your switching/networking. Any of your aggregation links filling up? Has the ISP worked with you?

  35. Stream over http by Anonymous Coward · · Score: 0

    Stream over http using an open source solution such as mediaframe.

  36. Start your own "Flickr of Video" by StreetFire.net · · Score: 3, Informative

    First, I can give you unlimited bandwidth on a Dial up line but you're not going to stream video over it, so any ISP that is giving you "unlimited" probably isn't set up to host your video. ;-)

    Second on YouTube and Google
    I agree there is something to be said for "out sourcing" your video to a company like Google Video or YouTube, but if you don't mind I would like to throw my little Start-Up (Vidiac.com) into the ring since we've been doing free video hosting longer than either of those two without all the Web 2.0 Hype. Of course the difference with us is we give you a video hosting portal you can run on your website (Like video.YOURDOMAIN.com), so with us you can start your own "Flickr of Video" either free (ad supported) or pay-per stream. Sorry about the self promotion there.

    Regarding your Dilemma
    Here is my input on the question at hand based on my own experience (I'm streaming just over a million streams a day to 2.5 Million Unique visitors a month). First, as always, start with the needs of the users.

    1.) Are they sophisticated? How would they react to a Torrent? From my experience, if someone has a torrent client installed then they're fine with it, but if they don't you have a large "fear factor" to overcome convincing a user to install a program to watch your video.

    2.) Do they want to click and Watch, (stream), or do they want to download? If you produce content like a video podcast, then I highly recommend giving your users a download option over streaming. If you run a portal-site, like Big-Boys.com that aggregates content then you're better off streaming as you want to be viewed as more than an FTP site.

    3.) How big is your Audience? This is probably the single biggest factor for capacity planning. If they all hit your site at once you need a ton of bandwidth.

    4.) Is this a scheduled broadcast (like a weekly show), or is this content that will be downloaded over time? Scheduled events can cause massive spikes. 10,000 users all at once is harder on a server than a Million users spread out over a month.

    5.) What video quality will your users tolerate? What Software can they use to view it? Windows Media? Quicktime? Flash? Size? Bit Rate? If your users are watching these videos on an iPod they'll accept a lower quality than if they're viewing it on their Plasma HDTV.

    Based on the above you can get a firm handle on your
    1.) Delivery Method (Direct Download, stream, Torrent)
    2.) Video Size (Format, Quality, etc)
    3.) Pipe Size (How much do you need to stream at once)
    3.) Bandwidth Utilization profile (spikes and valley vs. flat)

    Compare the above to your current solution. If your users are buffering, is it because...

    Your upload pipe is saturated? Upgrade to a larger pipe (100Mbps is about the minimum if you have more than 10 people hitting your video at the same time)

    Is your Disk I/O saturated? SATA and IDE are fine for most sites, but if you have 50 viewers requesting 30 different videos you need some strong I/O. we were burning through SATA drives on a weekly basis before switching to a SCSI SAN.

    Does your ISP have proper Network access to get to your end users? Consider pulling in a pipe from an appropriate network. (AT&T strongly peers with Cox cable for instance, MCI has fantastic AOL connectivity).

    Anyhow, I hate to answer a question with more questions, but there are so many ways to deliver video, there is no one silver bullet solution. You just have to do what works for your users and company. From experience though capacity planning for an online video application takes a lot of work, but once you wrap your head around the bandwidth issue, it gets easy. Good Luck!

    -Adam

  37. Look at what Pr0n is doing by xoip · · Score: 3, Interesting

    When ever you're in need of a streaming solution look and see what the Pr0n industry is up to. Awhile back Wired ran an article on an adult site who claim to offer P2P streaming Pr0n...great way to save on bandwidth if it works.

  38. 3 steps to improve streaming by Antique+Geekmeister · · Score: 2, Informative

    First, forget round robin DNS. It simply doesn't work. You cannot rely on the DNS clients to select the round-robin IP addresses in order except under very rare circumstances.

    Second, if it absolutely has to work, you can rent services from Akamai, who have a huge and under-used network for exactly this service. Let them deal with distributing the load from one feed to thousands of servers worldwide: they think it will make them lots of money. They will play more clever DNS games than merely round-robining.

    Third, forget streaming live if you can. Set up a download site for a Bittorrent feed. If lots of people want to see the download, let them distribute the load among themselves.

    Fourth, forget streaming Windows Media. Use Quicktime or Real if you have to stream: they both put much less load on your servers and your server can handle a lot more clients.

  39. Re:Ourmedia.org (OMG) by Anonymous Coward · · Score: 0

    LIVE LIVE LIVE LIVE LIVE... He is talking about LIVE streams. bitorrent, all of these wierd formats people mention (ogg vorbis, xvid, etc) and hosted providers for PROGRESSIVE DOWNLOAD do not count.. Holy c*ap. Why is it that people confuse downloading with streaming. Are you streaming /. to your computer when you load its page? No..

    Progressive download: Storing a file somewhere, linking to that STATIC file through HTTP/FTP/download managers, people download when they want to watch it.

    Web Streaming: LIVE streaming of real-time content like television. If you join the stream late, you miss the show... ITS LIVE

    IPTV: Web streaming of content with unique content (not reflected from television) and in competition with television. IPTV does NOT have to be interactive (another common missconception). Typically when someone is saying IPTV they are talking about more than 1 channel. IPTV is an alternative to cable or satellite.

    Podcasting is progressive downloads

    even driven streaming (live concert) is web streaming. It is a single event, no production outside of that event.

    IPTV is what SBC, Verizon, Microsoft, and all the others are working on and what scares the sh*t out of the cable companies. China telecom has more than 180 channels of IPTV available, korea Telecom has 120, there are numerous companies in north america working on similar systems.

  40. Carnegie Mellon University's P2P Video Streaming by cannuck · · Score: 2, Informative

    Contact the folks at Carnegie Mellon University's "End System Multicast" gang. Its a P2P video streaming sysytem!

    It's at http://esm.cs.cmu.edu/

  41. 'Not for profit' no longer meaningful moniker. by Anonymous Coward · · Score: 0

    Not for profit?
    As if that is supposed to make us give up our secrets.

    And so do your 'not for profit' organizations limit compensation for the officers of the organization?
    Can you provide links to the auditors of your 'not for profit' so that interested parties can determine if your groups are legitimate charities or just money laundering schemes of the trust fund crowd.

    I guess I am on a tear lately trying to increases awareness and oversight of 'not for profit' organizations.

    For example the American Farm Buearu is a 'not for profit'.
    Whose interest do they serve? They clearly are not designed as a charity for the poor, but seem to represent the interests of very large corporations.

    And so, please, don't just say 'not for profit', but tell us what these groups do. The New York Stock Exchange was always a 'not for profit' corporation. Does anyone think that they weren't all about getting rich and making tons of money for hte officers of the corporation?

    'Not for profit' has become a meaningless moniker for organizations.

    We need trust fund and 'not for profit' scrutiny. We need more accountability for these groups.
    And if a group is supposedly 'not for profit' then do they easily provide links to accounting for their group? Do they list all the compensation of the corporate officers?

    I am sure that there are very many very generous and sincere 'not for profits'. Too often I see them and they are just money laundering for the powerful, a way to add a seeming virtue to the organization.

  42. Make a *.pls for content on demand... by Anonymous Coward · · Score: 0

    To make a *.pls just open notepad or any textpad of choice and simply paste the URL location of a hosted file and then if you want to add more than one, skip a line and add another URL and so forth.

    When a user clicks on the *.pls linked on your website it will bring up a playlist of every file pointed to in the *.pls. The first one will automaticly be downloaded and played usualy and then it will go on to thte next and so forth. Kinda like streaming only its on demand downloading.

    Have this along with your torrent link and even a direct download if you want...

  43. LX Systems is able to do what you want via p2p by microbrewer · · Score: 1

    LX Systems(TM) technology helps multimedia providers efficiently market and distribute content to millions of consumers. Powered by Wurld Media's patent-pending Cooperative Communication Network(TM) (CCN(TM)) protocol, LX Systems harnesses the true power of Grid Computing and applies it to the commercial marketplace.

    http://www.lxsystems.com/index.html

  44. CUseemee by Noodlenose · · Score: 1

    actually, what DID happen to CUSeeme? That was such a cool little proggie.

    1. Re:CUseemee by jd · · Score: 1
      CU-SeeMe was originally from Cornell University and was black-and-white only, though the Mac version may have supported colour. I didn't use the Mac version much. White Pine bought the program, lock, stock and barrel, and switched it from being free to being $50 a copy. They added colour, but it wasn't terribly impressive, and the stability went to shit.


      A bunch of CU-SeeMe enthusiasts, meanwhile, produced a full colour version of the free program. I don't believe the colour interoperated with the White Pine version. It was rock solid, it didn't have lots of bells and whistles that nobody used, and it was free. White Pine, if I recall correctly, went ape-shit and tried to stomp it out. That caused some ill-feeling. The reflector was OK but never evolved significantly beyond the freebie version that had been floating around with full sources for some time. I believe groups were added, but that's about it.


      Later on, some other fans of CU-SeeMe reverse-engineered the new protocol and produced a library supporting it (I think it was called CU3) but this seems to have died a death as well. I can find no surviving source from this era.


      Somewhere down the line, White Pine was bought out, completely, by First Virtual and the program was renamed "Click To Meet". First Virtual was then bought out by RADvision. Despite the disasterous commercial exploitation of CU-SeeMe, there still seems to be a persistant effort to prevent any free/open source rivals that interoperate with it. All evidence I have seen suggests that this prohibition may actually have led to the downfall of White Pine and later vendors, as the userbase for CU-SeeMe was extremely high at the outset and all existing videoconferencing services combined don't even have a fraction of what was there, despite the massive increase in numbers with computers and high-speed Internet access in the past ten years.

      --
      It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  45. lbnamed-loadbalance improvement to round robin by X29turtle · · Score: 1

    Perl based, works with ICS's DNS. Load balance based on load avg from uptime.
    Works great, we use it for application login servers, proxy pac file sites, citrix servers, etc. DNS will return IP address of least loaded machine. simple easy and definately cost effective.

  46. Freecast, Peercast by yomguy · · Score: 1

    Let's have a look to :

    http://www.peercast.org/
    and
    http://www.freecast.org/ (java based)
    ;)
    yomguy

  47. Yes. by jd · · Score: 1
    The MBONE operated this way for some considerable time. Multicast tunneling is trivial to set up between multicast "islands" of that kind. If you want to set up a single multicast tunnel on a Linux box, create a tunnel as per normal and have traffic for 224.0.0.0/240.0.0.0 directed through the tunnel.


    If you want your box to act as a "junction" between multicast islands, you'll want a software multicast router - pimd is good, I'm not sure if Zebra of Xorp support multicasting but they really should at this point. Just configure the kernel to support pim routing and configure the router with the tunneling information.


    The one thing you have to be careful of is that Linux does NOT support being a multicast host AND a multicast router at the same time. That is a real pig and whoever coded it that way should be forced to listen to the next State of the Union speech. WITHOUT ANY CAFFEINE. From the front row. AND answer questions on it later.

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  48. You are in error at line 10 by jd · · Score: 2, Insightful
    If this guy is broadcasting to one person in Topeka, one in Taipei and one in Tennessee, does he need multicast? He doesn't.

    Think again. Three copies means you chew up three times the bandwidth to get the same file out. If you multicast, you can: (a) transmit to all three the same information at the bandwidth of a single person, (b) transmit to all three three times the information at no extra bandwidth, (c) anywhere in between.

    The first option basically means you can run a broadcast station and be doing other things on the Internet (surfing, downloading, whatever). Because broadcasts eat a lot of bandwidth, cutting out two redundant copies frees up a lot of the broadcaster's resources. Alternatively, as bandwidth costs money, the broadcaster can now reduce the speed of service they've bought, save money, AND still transmit to their entire audience.

    The second option is also an important one. If you're doing a video feed, three times the bandwidth can mean the difference between b/w or full colour, or between low res or high res. For audio (such as Internet Radio operations), the difference can be between 8 bit mono and CD-quality MP4-AAC with full Dolby-like stereo.

    The other important consideration is that multicast scales. If you go from an audience of 3 to an audience of 300, unicast uses 100 times the bandwidth. What could be done on a cheapo DSL line now takes a fractional T3 line, after which the broadcaster jumps off a bridge from crippling debt. With multicast, you could go from 3 to 3 million and not increase your bandwidth consumption by so much as a single byte.

    (If you're running a mobile Internet broadcasting station, using nearby wifi access points or a nearby phone line plus a 56K modem, you'd better damn well have multicast if you expect to reach an audience of more than one.)

    Should every router on the Internet participate in the creation of PIM trees or allow the inclusion of hundreds of thousands of /32 routes under the 224 prefix? They shouldn't.

    Dunno where this comes from. If there's nobody downstream in the group, then the router doesn't carry that group. Plain and simple. Routers only send to routers to which there is at least one connection with a user subscribed to that group. Routers do not need to know every single group, they need only know of those groups they are explicitly forwarding. In consequence, multicasting is actually very light on the router requirements. (With IGMPv3, the tree can be further reduced. If more than half of the connections want the stream, then the router can invert the logic and transmit to all EXCEPT for those who don't want it. Routers can also filter by source, if instructed to do so, so the tree doesn't even have to carry excess traffic any more.)

    How do I know this for sure? Well, aside from having run multicast routers myself, I know that the Internet backbone has been running native multicast for the better part of eight to ten years. Has the Internet obvious suffered from this? Not that I'm aware of. Sure, there have been partial meltdowns of the Internet, but those are invariably unicast, not multicast sessions. Of those, had multicasting been used instead of unicast, the Internet would have barely noticed the impact.

    It sounds to me as though you've been learning about multicasting from some highly uninformed sources who aren't aware of the distinction between a broadcast protocol (where everyhing is sent to everyone) and multicasting (where only specifically requested streams within specifically selected groups are forwarded only to explicitly interested parties).

    If that is the case, feel free to point them in my direction and I'll be more than happy to go through in meticulous detail every aspect of multicasting that they could possibly want to know about. And more. The same is true of anyone else on Slashdot - I am more than happy to provide detailed information on any aspect o

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    1. Re:You are in error at line 10 by TallMatthew · · Score: 1
      If there's nobody downstream in the group, then the router doesn't carry that group.

      So every core router on the Internet should passively accept multicast JOINs and maintain state for every single multicast session going on across the entire Internet? I don't think so. Do you have any idea how vulnerable that would make your core? There's a reason the MBONE is routed discretely.

      Turning on multicast so you can process OSPF HELLOs on 224.0.0.5 doesn't mean you're multicast routing. Your argument that it saves resources on the transmit end is perfectly logical but expecting everyone else's core to do the work for you (maintain state, duplicate frames, process paths, discover loops, weed out bad guys) is nuts.

      It sounds to me like you've learned multicasting (probably for a CCIE) but haven't done any gigabit routing. I stick my my statement. Nice in theory, not in practice (at least not on a global scale). Do yourself a favor and be a proponent of something that's actually useful.

  49. Don't know if they're cheap... by csoto · · Score: 1

    but some friends rely on PowerStream from time to time.

    --
    There exists no way of exchanging information without making judgments. --Bene Gesserit Axiom
  50. Yeah, well *I'm* on Internet III by elrous0 · · Score: 1
    How is this possible when Internet II is still a fledgling, you ask? Well, the Internet III connection is so fast, with so much bandwidth, that it's able to violate the laws of conventional physics and actually warp time. From my relative perspective, I'm posting in 2018.

    -Eric

    --
    SJW: Someone who has run out of real oppression, and has to fake it.