Slashdot Mirror


New Ethernet Standard — Both 40 and 100 Gbps

Artemis recommends a blog entry that does a nice job of summarizing the history and current state of the Higher Speed Study Group and the IEEE's next-generation Ethernet standard. "When IEEE 802.3ba was originally proposed [there] were multiple possible speeds that were being discussed, including 40, 80, 100, and 120Gbps. While there options were eventually narrowed down to just two, 40 and 100Gbps, the HSSG had difficulties [deciding] on the one specific speed they wanted to become the new standard... [T]wo different groups formed, one which wanted faster server-to-switch connections at 40Gbps and one which wanted a more robust network backbone at 100Gbps... Unable to come up with a consensus the HSSG decided to standardize both 40Gbps and 100Gbps speeds..."

141 comments

  1. In other news by superpulpsicle · · Score: 4, Funny

    Major telcos has increased the upload speed to 800k at a cost for only $70.00 a month.

    1. Re:In other news by Anonymous Coward · · Score: 2, Insightful

      The Telco's know full and well that once they let the genie out of the bottle, there is no turning back. REAL* broadband service (10+Mb/s at minimum) across the entire US, i.e. DIAL-UP becomes infrastructurably(new word??) unmanageable and non-existent, means Cable TV and Satellite become unstable as a market. Period. The media companies know this, which is why HD mandates keep getting pushed back. Its an all out fight for who can get their fist in the cookie jar first.

      Better get used to the idea that HIGHSPEED* Internet EVERYWHERE, is still years away. There is one hope though. And its name is Google......

    2. Re:In other news by Anonymous Coward · · Score: 5, Funny

      "There is one hope though. And its name is Google......"

      No. There is another.

    3. Re:In other news by nuzak · · Score: 1

      > There is one hope though. And its name is Google

      Google's proposed free ad-supported wi-fi for SF is like 300 kilobits. Better than nothing, I'll grant, but the phone companies are pitching a screaming hissy fit over even that. Why on earth do you think Google can implement or is even interested in universal high-speed access?

      --
      Done with slashdot, done with nerds, getting a life.
    4. Re:In other news by Poltras · · Score: 1
      Luke Skywalker?

      /out

    5. Re:In other news by Ngarrang · · Score: 1

      Google's proposed free ad-supported wi-fi for SF is like 300 kilobits. Better than nothing, I'll grant, but the phone companies are pitching a screaming hissy fit over even that. Why on earth do you think Google can implement or is even interested in universal high-speed access? Because it will make them more money?
      --
      Bearded Dragon
    6. Re:In other news by jd · · Score: 1
      But now his provider is complete...

      (Given that last link, expect the RIAA to become part of Homeland Security.)

      The Japanese have gigabit with IPv6 to the home already, but this makes that look like dial-up in comparison.

      --
      It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    7. Re:In other news by morcego · · Score: 1

      REAL* broadband service (10+Mb/s at minimum)


      Isn't broadband defined as 2Mbps+ ? From what I've heard in my telco days, that was the speed threshold.
      --
      morcego
    8. Re:In other news by Detritus · · Score: 2, Informative
      Not really. Broadband usually means FDM, like a cable plant or a microwave relay.

      I like this definition:

      Narrowband, Wideband, and Broadband

      Narrowband is a transmission medium or channel with a single voice channel (with a carrier wave of a certain modulated frequency). Wideband is a transmission medium or channel that has a wider bandwidth than one voice channel (also with a carrier wave of a certain modulated frequency). Broadband refers to telecommunication that provides multiple channels of data over a single communications medium using frequency division multiplexing.

      Through the Wires: Bandwidth

      --
      Mea navis aericumbens anguillis abundat
    9. Re:In other news by DrSkwid · · Score: 1

      ntl: got 128k officially recognised as broadband for advertising purposes here in the uk.

      --
      There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
    10. Re:In other news by Anonymous Coward · · Score: 0

      But [itnews.com.au] now [freerepublic.com] his [geek.com] provider [theregister.co.uk] is [bbc.co.uk] complete...

      Does that look at all readable to you? :p

    11. Re:In other news by agulliford · · Score: 1

      Voice over pots is not modulated, so is BASEBAND (having the bottom 12Khz of a phone line.) Broadband is anything that is not baseband. (eg: ADSL freqs starting from 12KHz upwards.) It has nothing to do with speed for anyone except beaurocrats and politicians.

    12. Re:In other news by Hucko · · Score: 1

      Not in Australia. Here it seems to be defined as faster than dial-up. I can't believe the speeds you people talk about as slow! My Isp starts at 256/64 kilobits per second. :( That's AU$44/month 20Gb download. Looking at USA sites, USA is only a little better (some offered 785kbps @ USD44 the same, though most were cheaper and bigger numeros)

      --
      Semi-automatic amateur armchair Australian philosopher; conjecture ready at any moment...
    13. Re:In other news by morcego · · Score: 1

      Not in Australia. Here it seems to be defined as faster than dial-up.


      Defined by who ?
      --
      morcego
    14. Re:In other news by jd · · Score: 1

      Sure, but then I have always been a little.... odd.... The doctors say they can treat most of it, but my insurance won't cover the surgery needed to stop turning into a bat.

      --
      It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    15. Re:In other news by Hucko · · Score: 1

      What most ISPs refer to as broadband. That means Telstra essentially, and everyone else just follows on.

      --
      Semi-automatic amateur armchair Australian philosopher; conjecture ready at any moment...
  2. Cable Length by fishybell · · Score: 4, Interesting
    Interesting to see that the faster 100Gbps also has the longer cable lengths built into the standard. From TFA:


    40Gbps can be 1 meter long on the backplane, 10 meters for copper cable and 100 meters for fiber-optics. The 100Gbps standard includes specifications for 10 kilometer and 40 kilometer connections over single-mode fiber.

    I'm seeing the 100Gbps used for infrastructure with its larger bandwidth and longer cable length while the 40Gbps would be used for datacenters, server rooms, etc. with its faster "connect" speeds (clarification on what exactly this would mean?).

    --
    ><));>
    1. Re:Cable Length by rdejean · · Score: 3, Informative

      The FA says that 40gbps is intended for server-to-switch connections. 100meters should be plenty for that. How often is your server 40 kilometers from the nearest switch?

      I'd also suspect that 40gbps will be a whole lot cheaper than 100gbps.

    2. Re:Cable Length by shaggy43 · · Score: 1

      Just as single-mode and multi-mode are used today, and using the same principles:

      http://www.fiber-optics.info/articles/fiber-types. htm

    3. Re:Cable Length by jd · · Score: 2, Funny

      Given the way people wire this office? I'd want a network that supports at LEAST 40 kilometers, just to reach the server in the next room!

      --
      It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    4. Re:Cable Length by pacman+on+prozac · · Score: 1

      Does current tech allow 100Gbps signals to travel 40km over singlemode without using some kind of repeater?

    5. Re:Cable Length by anticypher · · Score: 1

      Do I know you? Do we work in the same circus^Woffice?

      If not, then my worst suspicions are confirmed, screwed up cabling plans exist everywhere.

      the AC
      my monomode fibre from home to datacentre is 38Kms, 100GigE will soon be mine

      --
      Hemos is like...sci-fi fans;he thinks technology is cool, but he hasn't bothered to understand the science it's based on
    6. Re:Cable Length by hackstraw · · Score: 4, Funny

      How often is your server 40 kilometers from the nearest switch?

      My mom's basement is HUGE!

    7. Re:Cable Length by pkphilip · · Score: 1

      The 40KM limitation is the current limitation of dark fibre.

  3. speed vs. robustness? by volpe · · Score: 1

    one which wanted faster server-to-switch connections at 40Gbps and one which wanted a more robust network backbone at 100Gbps

    Why is the 40 Gbps one considered "faster" and the 100 Gbps one considered "more robust"?

    1. Re:speed vs. robustness? by ciroknight · · Score: 4, Informative

      You misunderstand; one group said "We need to connect our servers to the switches with a faster connection." The other group said "we need to make our network backbone more robust by adding faster connections between buildings and such." The group that needed faster server-switch speeds don't need 100Gbps, they just need better than what they've got. The group that needed faster building-building/infrastructure links didn't believe 40Gbps is fast enough.

      Adding both takes care of both groups of people.

      --
      "Victory means exit strategy, and it's important for the President to explain to us what the exit strategy is." G.W.Bush
    2. Re:speed vs. robustness? by GeckoX · · Score: 1

      That's where I'm confused on this though...adding ONE would appear to take care of both groups of people...what am I missing? What does the 40Gb standard have that the 100Gb standard doesn't cover?

      If the answer is nothing, than this seems to be a pretty stupid move...

      --
      No Comment.
    3. Re:speed vs. robustness? by Doctor+Memory · · Score: 3, Interesting

      I wonder if it has something to do with latency. Maybe the 40Gb connections are faster because they have a simpler routing protocol or they use smaller packet sizes with no CRC. I haven't been able to get through to the actual proposed spec yet, so it's hard to say...

      --
      Just junk food for thought...
    4. Re:speed vs. robustness? by Anonymous Coward · · Score: 1, Informative

      Looks like the 40 allows for fiber or copper connections, while the 100 is pretty much fiber-only (for now?). Fiber is still far more expensive than copper, especially when you're just interconnecting two switches that are next to one another in the rack.

    5. Re:speed vs. robustness? by Midnight+Thunder · · Score: 5, Informative

      What does the 40Gb standard have that the 100Gb standard doesn't cover?

      In one word: cost. The 100Gb connection is limited to fibre optics, whereas the slower connection support copper. Fibre optics are still more expensive than copper. It should also be noted that backbones deal with more traffic than non-backbone networks. Think of the difference between inter-city high ways and local back streets and you should get the picture.

      --
      Jumpstart the tartan drive.
    6. Re:speed vs. robustness? by steveo777 · · Score: 2, Funny

      Think of the difference between inter-city high ways and local back streets and you should get the picture.

      So does that mean that their either coated in ice or being dug up by MN/Dot?

      --
      This sig isn't original enough, it's time to come up with something witty...
    7. Re:speed vs. robustness? by jabuzz · · Score: 1

      That is just such complete nonsense. Firstly fibre is not "far" more expensive than copper, it is a bit more expensive. However look at the cost of a 10Gbps switch, and now tell me that the cost of fibre is prohibitive. If you can afford the switch you can sure as hell afford a few fibre patch leads. Not only that I bet it will be CX4 type Infiniband cables which are not cheap, and far more trouble in a rack than a fibre patch lead.

      What beats me is why they are bothering with multimode fibre. The cost of stocking both types quickly outweighs the slight increase in cost for single mode.

    8. Re:speed vs. robustness? by Anonymous Coward · · Score: 1, Informative

      Let me clarify this even more. The 40Gb standard is aimed at LANs. The 100Gb standard is aimed at WANs / the Internet backbone. One is a method well suited to connecting machines in one room or a building to each other, the other is a way to connect cities. This is actually a very remarkable new role for "ethernet" standards, since most backbone trunk lines use special protocols today.

      Make sense?

    9. Re:speed vs. robustness? by GeckoX · · Score: 1

      Yes actually, thanks :)

      --
      No Comment.
    10. Re:speed vs. robustness? by psmears · · Score: 1

      That is just such complete nonsense. Firstly fibre is not "far" more expensive than copper, it is a bit more expensive. However look at the cost of a 10Gbps switch, and now tell me that the cost of fibre is prohibitive. If you can afford the switch you can sure as hell afford a few fibre patch leads. Not only that I bet it will be CX4 type Infiniband cables which are not cheap, and far more trouble in a rack than a fibre patch lead. I'd be surprised if they did that—the biggest advantage of copper over fibre is that everyone still has it! If you're going to move to Infiniband (multi-coax) cables, you might as well go for fibre as you say...—

      What beats me is why they are bothering with multimode fibre. The cost of stocking both types quickly outweighs the slight increase in cost for single mode. There are plenty of places where it's practical and economical just stocking multimode fibre...
    11. Re:speed vs. robustness? by Slashcrap · · Score: 1

      I wonder if it has something to do with latency. Maybe the 40Gb connections are faster because they have a simpler routing protocol or they use smaller packet sizes with no CRC. I haven't been able to get through to the actual proposed spec yet, so it's hard to say...

      As a general rule, Ethernet does not concern itself with routing protocols. It's to do with that whole "layering" thing you may have heard of. It's really quite popular in the world of networking.

      And I would bet a whole lot of money that they aren't going to drop frame checksums from any new Ethernet standard either, unless they've taken to holding their meetings in the local crackhouse.

    12. Re:speed vs. robustness? by haruchai · · Score: 1


        Is it still true that fiber costs more than copper? Considering that copper's price
        has long been at the point where thieves have been stealing copper plating off church
        roofs, that is a shocking statement of the relative cost of fiber-optics.

      --
      Pain is merely failure leaving the body
    13. Re:speed vs. robustness? by Midnight+Thunder · · Score: 1

      Is it still true that fiber costs more than copper? Considering that copper's price has long been at the point where thieves have been stealing copper plating off church roofs, that is a shocking statement of the relative cost of fiber-optics

      The cabling is not the only thing that needs to be taken into account. Think of optic network cards, switches and routers, since none of the come cheaply.

      --
      Jumpstart the tartan drive.
    14. Re:speed vs. robustness? by cthulhu11 · · Score: 0

      Ten meters over copper doesn't cut it in any but the smallest "data center" settings. Switches are centralized and the run up to the overhead trough and back down alone eats half that.

  4. 'HSSG'? by Anonymous Coward · · Score: 0

    HSSG decided to standardize both 40Gbps and 100Gbps speeds...

    'HSSG'? Is that some weird acronym for 'market'?

    1. Re:'HSSG'? by Linkiroth · · Score: 2, Insightful

      High Speeds Standards Group. How hard is it to read the summary? Slashdot: where people don't only RTFA, they don't RTFS.

    2. Re:'HSSG'? by fbjon · · Score: 3, Funny

      You must be... no, you're definitely new here.

      --
      True confidence comes not from realising you are as good as your peers, but that your peers are as bad as you are.
    3. Re:'HSSG'? by TechyImmigrant · · Score: 4, Informative

      >High Speeds Standards Group. How hard is it to read the summary? Slashdot: where people don't only RTFA, they don't RTFS.

      No. It's High Speed Study Group. In IEEE 802 this makes a huge difference.

      A study group studies and recommends what standards are to be written by a Working Group (in this case, the WG is 802.3). They do this by arguing for a while then drafting a scope and purpose for the new spec (you'll find this in the first few pages of each IEEE spec). This is sent up the hierachy (the IEEE 802 EC (executive committee) and IEEE SA NESCOM (IEEE Standards Association New Standards Committee)The Working Group then goes off and writes the spec if the EC and NESCOM approve the PAR (Project Authorization Request).

      So the HSSG is not a standards writing group at all, it is a bit of pre work to decide what work is going to be done. Arguing over link speeds is exactly the sort of arguing it is chartered to do.

      --
      Evil people are out to get you.
    4. Re:'HSSG'? by Anonymous Coward · · Score: 0

      Except it is actually the Higher Speed Study Group not the High Speeds Standard Group. How do I know this? I read the summary.

    5. Re:'HSSG'? by serge587 · · Score: 1

      Wow looks at his user id... maybe he was trying to be funny? (jees I hope so)

  5. Ars Technica? by conigs · · Score: 5, Interesting

    I'm normally not one to do this, but the article linked is nearly identical to the coverage over at Ars Technica. It seems that only a few words were changed and without even a link to the original ars article.

    --
    Slashdot: where repeating an article in a post is "+5 Insightful"
    1. Re:Ars Technica? by Anonymous Coward · · Score: 1, Insightful

      More likely is that they both cribbed the same press release.

    2. Re:Ars Technica? by Red+Flayer · · Score: 2, Informative

      It's a press release. Check out ITwire.au, or do a google news search for HSSG. You'll see that the release went out 7/23, with almost everyone publishing on 7/24. This guy was just a day late (7/25).

      --
      "Trolls they were, but filled with the evil will of their master: a fell race..." -- J.R.R. Tolkien on Olog-hai
  6. Standards by edittard · · Score: 1, Offtopic

    The great thing about standards is ther's so many to choose from.

    --
    At the bottom of the /. main page it says 'Yesterday's News'. Well they got that right.
    1. Re:Standards by andrewd18 · · Score: 1

      The great thing about standards is ther's so many to choose from.
      Unfortunately, not everyone chooses to follow them.
    2. Re:Standards by Anonymous Coward · · Score: 0

      You got me ther!

  7. MOD PARENT UP! by Anonymous Coward · · Score: 0, Offtopic

    Mod parent up!

  8. Is this standard by committee just newspeak? by Anonymous Coward · · Score: 0

    Will these two standards interoperate compatibly? Or will I have to pay great attention to which interfaces I am purchasing and deploying? If not, it could hardly be considered a standard in the "standard" sense. Is this just a committee that couldn't come to agreement so they just "declared" a non-standard as a standard?

    1. Re:Is this standard by committee just newspeak? by Anonymous Coward · · Score: 2, Informative

      There is already precedent for this at 10G. The LAN people wanted the data rate to be 10.0 Gbps so that it was exactly 10x 1G while the WAN people wanted something compatible with SONET OC-192 wide area transport gear (9.95328 Gbps including framing bits). So they adopted both. They're not compatible at the physical layer so you'd never plug one into another. However they use compatible layer 2 formats so it's easy to switch packets from one to another.

    2. Re:Is this standard by committee just newspeak? by Lehk228 · · Score: 1

      They're not compatible at the physical layer so you'd never plug one into another. However they use compatible layer 2 formats so it's easy to switch packets from one to another.

      never as is won't fit or never as in Ethernet crossover into ISDN never?

      --
      Snowden and Manning are heroes.
  9. why ethernet? by irw · · Score: 1

    Exactly how far will ethernet efficiently scale? As I understand it there were problems with 1Gbp/s as first planned leading to jumbo frames, and ethernet isn't (wasn't) that efficient a protocol.

    Are there any other serious contenders which could/should be examined as a replacement for ethernet?

    1. Re:why ethernet? by XSforMe · · Score: 1

      Yep, Token Ring was indeed more efficient. Good luck reviving it.

      --
      My other OS is the MCP!
    2. Re:why ethernet? by hardburn · · Score: 2, Informative

      The big problem with ethernet's design was its "spew everything to everyone" mentality. In practice, this was fixed by good switches becoming almost as cheap as hubs.

      The main alternative to ethernet was token ring, which works much like a meeting where you have big stick that's passed around, and only the person with the stick can talk.

      --
      Not a typewriter
    3. Re:why ethernet? by DFDumont · · Score: 3, Insightful

      >Yep, Token Ring was indeed more efficient. Good luck reviving it.

      Token Ring (spitting) was only more efficient as compared to the original ethernet specification, with all of its collisions. Once we went to a switched architecture and reduced all conversations to two participants that advantage evaporated.

      Remember this, being deterministically bad is still bad. Have you ever been on a ring with > 200 nodes? Don't.

      Ethernet won because it was cheap. It beat token ring to switching. It beat everything else to get to 100Mbps. Now with 1Gbps and 10Gbps firmly entrenched in the market I look forward to deploying 100Gbps links.

      Ethernet is (and was) better.

      Dennis Dumont
      P.S. I've already scavenged all of my lobe cables for their copper.

    4. Re:why ethernet? by Intron · · Score: 1

      fibre channel arbitrated loop was pretty much like token ring, and has been largely abandoned for the same reasons. Switched fabrics support multiple connections, and single misbehaving machines can't create havoc for everyone else on the loop.

      --
      Intron: the portion of DNA which expresses nothing useful.
    5. Re:why ethernet? by On+Lawn · · Score: 1


      Good advice for a meeting. Speak softly and carry a big stick...

    6. Re:why ethernet? by silas_moeckel · · Score: 2, Insightful

      Ethernet is useful because it's cheap, I can attach a 10bt host to a switch and have it transmit the same frame over 100kbt with very little work. I have clients that love Ethernet it's orders of magnitude cheaper than it's main alternative Packet over Sonet. So pretty much it's good enough for most and cheap. In the PC server world the marketing guys want to say they have the latest and greatest copper Ethernet built in and supporting every old standard back to 10bt. This means they ask there chip suppliers to build it and make it cheap. Scale and cutting every corner possible drive down the costs so that it's a couple bucks to add multiple ports of 1000bt today and 10kbt is getting cheaper and cheaper.

      --
      No sir I dont like it.
    7. Re:why ethernet? by sharkey · · Score: 1

      As I understand it there were problems with 1Gbp/s as first planned leading to jumbo frames

      So we'll move on to Hyper and Monster frames as the tech speeds up. Going along with those will be Mini-Hyper and Mini-Monster frames, of course.

      --

      --
      "Outlook not so good." That magic 8-ball knows everything! I'll ask about Exchange Server next.
    8. Re:why ethernet? by gad_zuki! · · Score: 2, Insightful

      Probably for quite a bit. The biggest hurdle with ethernet is dealing with half-duplex connections and all the collions/detections. These new standards dont even do half-duplex. Everything is full duplex, thus requiring a switch. You've tossed out your biggest setback right there.

      Ethernet still is pretty lean. I can imagine an alternative to it, but it might not be worth the trouble, like the anyLAN stuff from a while back. We also still used TCP, but really dont need all the overhead it generates.

    9. Re:why ethernet? by jabuzz · · Score: 1

      Except most if not all fibre channel devices still support arbitrated loops. I have an arbitrated loop at 4Gbps at work hooking up a tape library to a server. I would have been nuts to buy a fibre channel switch for the job.

    10. Re:why ethernet? by Intron · · Score: 1

      If you only have two connections, you can do point-to-point, there is no need to run the arbitrated loop protocol.

      --
      Intron: the portion of DNA which expresses nothing useful.
    11. Re:why ethernet? by Nynaeve · · Score: 1

      Ethernet ... beat everything else to get to 100Mbps.

      Are you forgetting FDDI/CDDI? As I recall, it was available before 100 Mbps Ethernet.

      "The Fiber Distributed Data Interface (FDDI) specifies a 100-Mbps token-passing, dual-ring LAN using fiber-optic cable."

      "Copper Distributed Data Interface (CDDI) is the implementation of FDDI protocols over twisted-pair copper wire."

    12. Re:why ethernet? by Detritus · · Score: 1
      Collisions are good. That's how you arbitrate access to the media. The important part of CSMA/CD is the CD part, which removes most of the penalty from collisions. Token ring salesmen spread a lot of FUD about how Ethernet behaves under load, which many people still believe.

      See:

      D. Boggs, J. Mogul, and C. Kent, "Measured Capacity of an Ethernet: Myths and Reality," WRL Research Report 88/4, Western Research Laboratory, September 1988. http://citeseer.ist.psu.edu/boggs88measured.html

      --
      Mea navis aericumbens anguillis abundat
    13. Re:why ethernet? by Short+Circuit · · Score: 1

      It was called the conch. When I was president of my college's computer club, people would occasionally start talking over each other. Once or twice, I shouted, "I've got the conch!" ... Though with less symbolism. :-)

      It can be a fun way to see if anyone in a group has read Lord of the Flies.

    14. Re:why ethernet? by systemBuilder · · Score: 2, Insightful

      The scaling issue had to do with CSMA/CD, collision detection. To detect collisions, the network propagation diameter/delay must be at most the slot time.

      These newer versions of Ethernet apparently don't bother supporting CD. All links must be switched through a hub, period. The hub saves up your packet and prevents collisions, and forwards your packet onto the next link. The "Ether" and "Like Talking" aspect of Ethernet has been lost. Ethernet has become just another framing choice other than SONET, for optical fiber.

    15. Re:why ethernet? by tbuskey · · Score: 1

      A place I worked at had a FDDI/CDDI backbone at 100Mbs before 100T. They also had 155Mbs ATM. This was used to develop the 100T switch. It turned out to be too late.

  10. Two For One by shutupkevin · · Score: 0, Offtopic

    In other news... A major open source project could not decide between GPLv2 and GPLv3 today, so they dual licensed it!


    And then the world exploded.

  11. Looks like by iminplaya · · Score: 1, Funny

    the network will soon be faster than the computer. Any chance we can syphon off of this speed to do some computing? Make the network become the computer?

    --
    What?
    1. Re:Looks like by DaMattster · · Score: 2, Insightful

      Well, if you think about it, Beowulf and similar Linux clusters take advantage of network speed to distribute processing load. This isn't really a case where the network does the computing but with 40 GBs of bandwith, you can perform some serious parallel processing.

    2. Re:Looks like by brsmith4 · · Score: 2, Insightful

      With the 12x QDR InfiniBand spec, 96Gb (after factoring the protocol's overhead) is already on the table and at much lower latencies. This is more helpful for parallel applications (though it really depends on the properties of your application). I've not even worked with 12x nor any applications that would benefit from it. We currently run a 4x SDR setup (which will soon be upgraded to DDR) and it is ample for most of our needs. A cheap 40Gb ethernet solution would be killer for consolidating node management and a storage pathway onto one network. Our current storage solution over 10Gb leaves us with a 25:1 oversubscription ratio which will work quite well for our current crop of applications and how they are used, but it could become a bottleneck in the future.

      I think having 40Gb will be really nice once pNFS implementations start to take off. Imagine a pNFS cluster of 32 fully loaded x4500's with 40Gb links between hosts and a 100Gb copper uplink to feed an army processing nodes. Getting close to 1PB of really really fast storage... over NFS and with today's capacities, no less.

    3. Re:Looks like by iminplaya · · Score: 1

      ...you can perform some serious parallel processing.

      You know, I wish people would make up their mind on these things. First we are being told that parallel is faster, then it's serial. Using hard drive interfacing here. What's it gonna be? Are we going to be told ten years from now the inline serial processing is faster? This is like these "nutritionists" telling us that eggs are bad for you and margarine is good. Later they come out with just the opposite. I guess I'll just keep what I have until it runs out of smoke and then buy whatever is out there. Well, okay, dumpster dive for whatever is in there.

      But anyway, your point is well taken, it's like using RAID to move data faster in and out of a set of hard drives. I can hardly wait for the same speeds to come out of my service provider :-)

      --
      What?
    4. Re:Looks like by gad_zuki! · · Score: 1

      You can think of it this way:

      If CPUs are so fast that pushing the data to be executed elsewhere over a LAN is a performance hit then parallel processing will go out of style.

      If networks are so fast that pushing data to be executed elsewhere over a LAN is a net perofrmance gain then parallel processing is back in style.

      Right now, we're seeing some pretty damn fast CPUs with multiple cores. Once these gains show down and network gains increase you'll see parallel stuff everywhere again.

    5. Re:Looks like by CETS · · Score: 1

      Whooooosh.

    6. Re:Looks like by DrSkwid · · Score: 1

      IBM's Blue Gene still uses Ethernet. Eric's added Jumbo Frame support to Plan 9 From Bell Labs which boots on the cpu and I/O nodes now.

      In that case the network has it's own dedicated nodes, so yes, the network is the computer!

      --
      There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
    7. Re:Looks like by RobRyland · · Score: 1

      naturally, it depends on the operations per I/O byte of the problem. Example: your CPU can do 3gflops and you have a network doing 10gbps (or ~300M single precision floats per second). if on average you need to do >> 10 operations per sp float input, then it will likely pay to share the problem in a cluster. -Rob

    8. Re:Looks like by Short+Circuit · · Score: 1

      Apples and oranges. (And the dietitians would be talking about heads of lettuce...)

      Different factors affect the parallel vs serial debate in different fields. In storage attachment, things like capacitive coupling tilted the balance in favor of SATA. In processing, things like component cost tilt the balance in favor of parallel processing.

      The only thing the two fields have in common is that their major limitations arise from signal frequency. Problems associated with signal frequency (specifically, capacitive coupling) made improving PATA more difficult than creating SATA. Problems associated with signal frequency (specifically, current leakage and, subsequently, heat generation) has made increasing the speed of parallel systems easier to achieve than equivalently increasing the speed of single-processor systems.

      The only thing frequency has to do with dietitians is how often they get ulcers. And I bet they'd have problems, too, if you increased that frequency.

    9. Re:Looks like by jsiren · · Score: 1
      Scott McNealy can now say "I told you so."

      Since 1982, we have maintained that the network is the computer.
      http://www.sun.com/aboutsun/company/index.jsp
      --
      Usage: km/h for speed (kilometers per hour); kph for very slow impulses (kilopond hours).
    10. Re:Looks like by Anonymous Coward · · Score: 0

      40 GBs of bandwith, you can perform some serious parallel processing.


      With distributed computing latency is almost, if not sometimes more, important than bandwidth.

      See other comment about InfiniBand.
  12. Read all the gory details yourself by evw · · Score: 5, Informative

    If you want all the gory details rather than a copy of a summary of a summary, here is a link to all the presentations at the meeting.

    http://www.ieee802.org/3/hssg/public/july07/index. html

    Read through the minutes (warning PDF) to get a summary.

    Motion #4: Move that the HSSG adopt the following objectives in replacement of
    existing HSSG objectives:

    o Support full-duplex operation only
    o Preserve the 802.3 / Ethernet frame format utilizing the 802.3 MAC
    o Preserve minimum and maximum FrameSize of current 802.3 standard
    o Support a BER better than or equal to 10-12 at the MAC/PLS service interface
    o Provide appropriate support for OTN
    o Support a MAC data rate of 40 Gb/s
    o Provide Physical Layer specifications which support 40 Gb/s operation over:
    - at least 100m on OM3 MMF
    - at least 10m over a copper cable assembly
    - at least 1m over a backplane
    o Support a MAC data rate of 100 Gb/s
    o Provide Physical Layer specifications which support 100 Gb/s operation over:
    - at least 40km on SMF
    - at least 10km on SMF
    - at least 100m on OM3 MMF
    - at least 10m over a copper cable assembly

  13. nice increase by poetmatt · · Score: 1, Interesting

    Considering that this stuff was doing 10 GB in 2005, to see 100 in 2007 is a pretty nice upgrade...my question is, given that the speeds are increasing, will we see any of this as consumers in the US? Not a "providers suck" (which we already know), but more of a "will this potentially make connections cheaper"?

    1. Re:nice increase by Martin+Blank · · Score: 2, Interesting

      Those of us in security are dreading this. IDS/IPS companies are only now dealing efficiently with multi-gigabit solutions for a reasonable price, and no one that I have talked to will do line-speed 10Gbs processing (some boxes can use parallel processing to handle streams from multiple inputs going up to 10Gbps, but not from a single line through a single processor to ensure that attack streams are properly reviewed). I shudder to think of what a 40Gbps stream will be like to monitor.

      --
      You can never go home again... but I guess you can shop there.
    2. Re:nice increase by TooMuchToDo · · Score: 1
      40Gbps is from server or desktop to the switch chief. Try doing IDS/IPS on a 100Gbps link.

      I'll be able to cook eggs on my Snort box.

    3. Re:nice increase by Kadin2048 · · Score: 1

      I think the problem with connections in the U.S. is mostly related to problems with the last mile, or the "last few miles" (the backhaul from the local node to the C.O.).

      I suppose that this might make the node-to-CO link faster/cheaper, which would be good because it would raise the amount of actual capacity that the ISPs have to oversell, meaning that when everyone else in your neighborhood is trying to get online and play WoW, there's still some bandwidth left ... but in terms of actually making your internet connection dramatically faster? I don't really think so.

      What's holding back domestic broadband right now is less technological than economic problems. The ISPs know they can get away with taking a 256kb/s connection and sell it as a "6 megabit!!!111" pipe, and I don't see why they'd change that, particularly when there's basically no competition to speak of.

      --
      "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
    4. Re:nice increase by Martin+Blank · · Score: 1

      I suspect that we'll be seeing 40GBps on the switch interlinks long before I see 10Gbps links to the servers here. There just isn't a major call for quite that much on a regular basis, and the 100Gbps ports are going to be very, very pricey.

      --
      You can never go home again... but I guess you can shop there.
    5. Re:nice increase by Ceriel+Nosforit · · Score: 1

      The practice of using general-purpose processors for 'streamed' data is being phased out in favor of FPGAs and DSPs, since they excel at the task.

      --
      All rites reversed 2010
  14. Edit much? by sakonofie · · Score: 3, Funny

    When IEEE 802.3ba was originally proposed [there] were multiple possible speeds that were being discussed, including 40, 80, 100, and 120Gbps. While there options were eventually narrowed down to just two, 40 and 100Gbps, the HSSG had difficulties [deciding] on the one specific speed they wanted to become the new standard...
    Slashdot editors and their homonyms have a wonderful relationship. There may be "there"s in the summary, but they're subject their edits.
    1. Re:Edit much? by rackirlen · · Score: 1

      I misspeak and write these words all the time, all the while understanding their proper meanings, but nonetheless... say what?

  15. OT: Close to 2,000,000 posts! by JJRRutgers · · Score: 1

    Who will be the lucky slashdotter?

  16. Watch: 40 in USA, World: 100 by Ralph+Spoilsport · · Score: 0, Troll
    Watch the captains of American Industry opt for the 40 for the public because "it's easier and cheaper" while the rest of the planet and big business goes to 100.

    I'm just sayin'....

    RS

    --
    Shoes for Industry. Shoes for the Dead.
    1. Re:Watch: 40 in USA, World: 100 by Gothmolly · · Score: 0, Troll

      -1, Troll.

      --
      I want to delete my account but Slashdot doesn't allow it.
    2. Re:Watch: 40 in USA, World: 100 by Gadgit · · Score: 1

      Granted it seems like the US is often time far behind the world in most things, but speaking from experience there are quite a few TelCo's throughout the country that are currently, or soon upgrading to, using 10Gbps links within their core. Every mention of these speed increases always seems to make people think that they will have 40Gbps to their household. The purpose of these technologies is almost always to provide transport for a bunch of other traffic MUXed onto it whether it be DS3s, OCns, etc... That coupled with DWDM technology which already allows providers to send up to 80 'channels' of 10Gbps each of a single pair of fiber...it's hard to imagine ever needing that much bandwidth...

    3. Re:Watch: 40 in USA, World: 100 by Anonymous Coward · · Score: 0

      umm. you must not understand the diff between where 40 is to be used and where 100 is to be used. you fail!!

    4. Re:Watch: 40 in USA, World: 100 by Anonymous Coward · · Score: 0

      Hahaha, you're wrong! Teh rest of the world is gonna crank it all the way up to 110, baby!

    5. Re:Watch: 40 in USA, World: 100 by Rod+Beauvex · · Score: 0

      Don't you mean 220?

  17. I for one... by Anonymous Coward · · Score: 0

    welcome our New Ethernet Standard overlords

  18. Re:OT: Close to 2,000,000 posts! by gregarican · · Score: 1

    Actually 20,000,000 posts. Of course in honor of the fencepost effect I wonder if t he first post was #0?

  19. excellent! by hcdejong · · Score: 2, Funny

    Why have one standard when you can have two instead! This strategy has worked so well in the past...

    1. Re:excellent! by jeffasselin · · Score: 1

      If you'd read the information properly, you'd realize they're directed at different needs and cost. The 40Gbps can work over copper, but has limited range, whereas the 100Gbps is high-distance but fiber-only.

      --
      If he explores all forms and substances Straight homeward to their symbol-essences; He shall not die.
  20. Apple is coming up it seems by Anonymous Coward · · Score: 0

    I for one am glad that for once they're thinking about MACs while designing standards, and not only PCs.

    Hardy-har-har

  21. Re:OT: Close to 2,000,000 posts! by Anonymous Coward · · Score: 0

    Moooo!!!

  22. netwurking iz ghey by kayditty · · Score: 0

    lol.

  23. Re:OT: Close to 2,000,000 posts! by Anonymous Coward · · Score: 0

    FailGET !!!

  24. 10 gig still not totally utilized... by Odinson · · Score: 1
    Assuming it's adopted, the 40gb standard may be the first Ethernet standard to have widespread fraud in the capabilities of hardware sold. Lots of hardware will be built that can't even come close to actually getting 40 gigabits advertised. Why? Many motherboards still can't utilize the full 10gbps even if the card can. The bad guys will catch on to this the second time around.

    If you are the type to do the numbers and get a MB with sufficent bus speed. Buyer beware. The lack of speed may not be obvious without an order of magnitude jump.

    1. Re:10 gig still not totally utilized... by Slashcrap · · Score: 1

      Assuming it's adopted, the 40gb standard may be the first Ethernet standard to have widespread fraud in the capabilities of hardware sold. Lots of hardware will be built that can't even come close to actually getting 40 gigabits advertised. Why? Many motherboards still can't utilize the full 10gbps even if the card can.

      And who exactly do you think is going to make a motherboard with a 40Gb Ethernet connection in the next 5 years? Are there any motherboard designers who were dropped on their heads as babies?

      This standard is not being designed in order to lower your Quake 4 pings. It is for use on backbones served by extremely high-end routers and switches.

      By the time it filters down to the consumer level, I'm sure your 96 core box with 128 lane UlatraPCI-e 4 slots will be more than capable of handling it.

  25. Thank you for the answer, lots more questions by poetmatt · · Score: 0

    I am not trying to rationalize this but as computing power increases doesn't the capability to handle a larger data stream become realistic or no? I'm looking it this from a fairly simple perspective.

    Also isn't someone already having to handle such streams? Don't tier 1 networks have to be able to handle far more than such things already? What about the likes of Google or MSFT perhaps? (not that it means that it's viable for the rest of the world). In another thread with similar questions(but not the ones I pose here) I mentioned a similar idea and people expressed that it is not difficult to handle large amounts of traffic, the idea seems circular once again.

    Can you give me a general idea of how much bandwith a computer could handle and/or what type of computer? Being someone who has never worked in such security I have no quantifiable idea of how much processing is needed. Would this be like a dual 8core pc with 16gigs of ram can handle 1/2 a GB of continual data? Would this be essentially a server with a built in switch?

    In addition, if there was sufficiently high amounts of bandwith for everyone, would you have to monitor anything other than variants of DDOS or other distributed attacks that use multiple pcs? If everyone on the planet had a 1 or 2GB/S down and upstream connection (think perhaps 10,20,30 years down the road I have no idea how long really), would it matter what else slows down the internet connection on their PC's?

    1. Re:Thank you for the answer, lots more questions by Martin+Blank · · Score: 1

      While IDS is still available for use on server equipment, it maxes out well below the 1Gbps levels. The high-end equipment is going to custom-engineered appliances now, with dedicated processors developed specifically for ultra-high-throughput with extremely low latency (for those cases where IDS is in-line). It's not always the overall throughput, though. Many IDS boxes can be brought to their knees with high VoIP throughputs. VoIP in large volumes can spray packets at high throughputs with packet counts that are disproportionately high compared to normal traffic. For example, an average packet size on a network may be 1000 bytes, whereas VoIP may slice that down to a couple of hundred bytes per packet while still sending high overall packet rates, stressing the scanning engine since it has to pay attention to the headers of every packet but doesn't have as much work to do on each payload.

      Right now, I'm working with several of the larger IDS companies, and when we ask them about 10Gbps throughput, they all -- every one of them -- hedge their answers. There is work underway, and we have indications that new multi-gig hardware, possibly including line-speed 10Gbps scanning in one or two cases, will be available in the next few months. However, the cost for these units is much, much higher than for a unit that handles 10Gbps aggregate throughput, and so we have some decisions to make regarding placement if we're to keep a proper eye on our network.

      --
      You can never go home again... but I guess you can shop there.
  26. Stevens by Kryptonian+Jor-El · · Score: 1

    This should take care of the "Enormous amounts of material" the great Ted Stevens warned us about.

    --
    All your 09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0 are belong to us
  27. Re:OT: Close to 2,000,000 posts! by Anonymous Coward · · Score: 0

    All the posts are odd numbered, so the actual post count is lower.

  28. Can you imagine... by CautionaryX · · Score: 1

    ... making a Beowulf cluster with these?

    (I'm sorry... I just had to!)

  29. Parasitic Computing by loimprevisto · · Score: 1

    Saw it in Nature magazine- the short answer is yes we can:

    http://en.wikipedia.org/wiki/Parasitic_computing

    --
    Much Madness is divinest Sense --
    To a discerning Eye --
    Much Sense -- the starkest Madness
  30. I want one for my home! by cyberjock1980 · · Score: 1

    So they couldn't come to a resolution on who to make happy, so they decided to make both people happy. If only Microsoft offered 2 versions, 1 for those hardcore performance nazi's(myself included) that has no extras, just the OS and that's all, or a slow performance sapping, DRM loaded, 'feature' full version! Microsoft should take notes from these guys. So 40 Gbps or 100 Gpbs? I'll settle for just the 40Gbps internet connection for now.

    1. Re:I want one for my home! by DrSkwid · · Score: 1

      If only my turds were made of paper, I could write on them.

      --
      There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
  31. Nothing new by Wesley+Felter · · Score: 2, Informative

    When 10Mb Ethernet came out there was widespread debate about its performance, because computers weren't fast enough to saturate it. It was probably the same for 100Mb, and I know the early 1Gb NICs could only handle ~700Mb.

    1. Re:Nothing new by Anonymous Coward · · Score: 0

      Yep. I put a 3C501 card into a machine (3com's first ethernet card -- 8-bit ISA.. the driver says "don't install this even as a joke. The performance is horrible and it's broken in many ways), -- this card would max out at 150KB/sec (that is, about 1.2mbit).

                The cheapest of the old 100mbit cards were like a cranked up NE2000 clone, and would from what I've heard max at about 70mbits/sec.

                Gigabit? That's 125MB/sec more or less; PCI maxes at 133MB/sec (well, 32-bit 33mhz) so I'm sure there were plenty of cheapo gigabit setups that wouldn't reach max speed (given overhead, it'd be hard to get a real 125MB/sec if 133 is theoretical peak.)

                10gigabit and up, I'm sure many cards either can't or won't max out the link.

    2. Re:Nothing new by Lehk228 · · Score: 1

      PCI-E 16x can handle it just fine, though the machine might not be able to find enough sources or sinks to actually DO anything with that much data for a while.

      --
      Snowden and Manning are heroes.
    3. Re:Nothing new by Short+Circuit · · Score: 1

      Forget Beowulf.

      Can you imagine a RAMTorrent over this?

  32. OT: cid=20000000 by Kadin2048 · · Score: 1

    It didn't happen in this thread, apparently.

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
  33. great analogy, just one request by ImaLamer · · Score: 1

    Would you mind coming to my office to explain a 'database' to the manager?

    Then you can move onto normalization.

    Thanks in advance.

  34. Exactly! by Anonymous Coward · · Score: 0

    You're point so perceptive! That is exactly why 10/100 MPS ethernet cards were such a failure!

  35. Re:why ethernet? Why not LocalTalk? by xquercus · · Score: 1

    Exactly how far will ethernet efficiently scale? As I understand it there were problems with 1Gbp/s as first planned leading to jumbo frames, and ethernet isn't (wasn't) that efficient a protocol.

    Are there any other serious contenders which could/should be examined as a replacement for ethernet?

    Perhaps we should look toward a high speed LocalTalk or PhoneNet implementation?

  36. Cheap fast optical networking? by joib · · Score: 1

    Hopefully we might soon be able to let copper cabling die.

    Cheap high speed optical chips: http://hardware.slashdot.org/article.pl?sid=07/07/ 25/2046208

    Flexible, robust optical cables: http://theinquirer.net/default.aspx?article=41171

  37. Re:OT: Close to 2,000,000 posts! by Ant+P. · · Score: 1

    Not true, I saw post 15000000 happen. Or was it 10 million...

  38. Re:OT: Close to 2,000,000 posts! by DrSkwid · · Score: 1

    curl 'http://slashdot.org/comments.pl?sid=25[595-611][1 -9]&cid=20000000' -o 'sd#1_#2.html
    each one contains :
    We can't find a comment with that ID (20000000)

    i'm too lazy to keep looking

    --
    There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
  39. Re:In other news, You are correct Broadband=2Mb/s+ by OldHawk777 · · Score: 2, Insightful

    You are correct Broadband=2Mb/s+, all other contrary comments are silly marketeer-spin for politicians and corporatist.
    Also, the USA ranks 20+ in telecommunications (we ain't #1), because of corporatist marketeer-spin to silly politicians.

    AAMOMFF, the USA ranks #1 in international debt only. We're #1, We're #1, We're #1 in debtor nations. THANK GOD and POLITICIANS!

    !HAVEFUN!

    --
    Unaccountable leaders are masters, and unrepresented people are slaves. How do US and EU fare?
  40. Grammar Nazi by Zashi · · Score: 1
    I swear, this is the first time I've ever corrected someone's grammar on slashdot.

    Defined by who?
    should be:

    Defined by whom?

    Yeah, I know.... Stupid pet peeve....
    --
    Skiffy is Spiffy, but Ort is tort.
  41. Re:OT: Close to 2,000,000 posts! by Nullav · · Score: 1

    Every GET is a modGET. Nothing for you to see here. Please move along.

    --
    I just read Slashdot for the articles.
  42. Re:Uhhmm by somersault · · Score: 1

    ...

    In Soviet Russia, meme fails YOU!

    --
    which is totally what she said
  43. Adhocnet by Catbeller · · Score: 1

    Why do will we need ISPs? For some things, anyway?

    We can string backbones using standard ethernet, at these speeds. We can use radio to bridge gaps. As I understand it, using copper across open outdoor spaces is electrically mad, so optical cabling is necessary, but the cost is dropping. We can run our own naming system. As for file sharing piggies, they can be screened out. We need a simple communication system that isn't under the boot.

    Let's face it, the corporations and the moral police have taken over the old internet. Time for the ad hoc, mobile, difficult to pin down, constantly adapting citizen's net.

    And no, I don't care about the "pedophiles" or the old men dating younger girls. As for the pedos, all this "knowledge" about their presence is garbage. If you know where to find underage stuff, YOU are a pedo; if you haven't looked for it, you couldn't possibly speak to the subject. Everyone is making the problem up, citing each other as sources. Witchcraft, satanism, terrorists and commies, oh my. We always need a reason to break down the doors, don't we? Otherwise why would we need all these expensive, newly militarized police we've acquired? We've the safest, wealthiest society that's ever existed, so we wouldn't need all that surveillance and LED blinders and tasers and strip searches and drug tests and armed guards in schools if we didn't constantly find new threats, even if they don't, strictly speaking, actually exist, as compared to, say hurricanes making landfall.

    A dark night is coming, and we are exporting the darkness to others around the world at gun- and market-point. A network cloud that is relatively immune to corporate and government shutdown and surveillance is essential to keep mankind free. No exaggeration.

    1. Re:Adhocnet by 42forty-two42 · · Score: 1

      Problem one is there's no proven routing algorithm for flat networks. Also, how do you screen out file sharers? Most routers under this system will be run by ordinary people who don't want to sysadmin, so they won't screen them out, and with no central authority getting a new address will have to be trivial.

  44. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  45. How does it work? by scarboni888 · · Score: 1

    PC's with 1Gbps on the backplane xferring to each other through a Gigibit switch I get a peak speed of about 300mbps (mega-bits). This is using only about 33% of the speed of the network & my assumption is that it's faster than the drives can write. So my question is what computers can transfer data at 40Gbps let alone 100?