Slashdot Mirror


Is There a Place for a $500 Ethernet Card?

prostoalex writes "ComputerWorld magazine runs a story on Level 5 Networks, which emerged from the stealth startup status with its own brand of network cards and software called EtherFabric. The company claims they are reducing the load on the servers CPUs and improve the communications between the servers. And it's not vaporware: 'The EtherFabric software shipping Monday runs on the Linux kernel 2.4 and 2.6, with support for Windows and Unix coming in the first half of next year. High volume pricing is $295 for a two-port, 1GB-per-port EtherFabric network interface card and software, while low volume quantities start from $495.'"

423 comments

  1. Is There a Place for a $500 Ethernet Card? by Anonymous Coward · · Score: 5, Funny

    Yes, there is a place for a $500 ethernet card, far, far away from this guy.

    1. Re:Is There a Place for a $500 Ethernet Card? by Anonymous Coward · · Score: 3, Funny

      pffft.... they don't have an ipod killer.
      They just lost my business.


      It's only funny if you see the site.

    2. Re:Is There a Place for a $500 Ethernet Card? by Anonymous Coward · · Score: 0

      Wow...normally I don't click on links, but that was perhaps the funniest thing I have seen all day.

    3. Re:Is There a Place for a $500 Ethernet Card? by Anonymous Coward · · Score: 0

      That's what the USBkiller/FirewireKiller are for.

    4. Re:Is There a Place for a $500 Ethernet Card? by Anonymous Coward · · Score: 0

      Umm... I think that's a slightly different market.

      I guess you could start a new trend though...

    5. Re:Is There a Place for a $500 Ethernet Card? by Bazman · · Score: 1

      Dont you mean:

      "Imagine a Beowulf cluster connected by these things!"

    6. Re:Is There a Place for a $500 Ethernet Card? by noidentity · · Score: 1

      pffft.... they don't have an ipod killer.
      They just lost my business.


      Dear Sir,

      I offer iPod killing and disposal services for free. Send me your working iPod and I will take care of it, at no cost to you. Working iPods only.

      Sincerely,
      iPod Resell^H^H^H^H^H^HHandler

    7. Re:Is There a Place for a $500 Ethernet Card? by tcr · · Score: 2, Funny

      Ah, I see you have constructed a new EtherKiller.
      Your skills are complete.
      Indeed, you are powerful...

      --


      Information wants to be beer.
    8. Re:Is There a Place for a $500 Ethernet Card? by steveyT · · Score: 1

      Seriously,why would you do that?

    9. Re:Is There a Place for a $500 Ethernet Card? by springbox · · Score: 1
      Seriously,why would you do that?


      For the same reason script kiddies attack people, probably

    10. Re:Is There a Place for a $500 Ethernet Card? by karnal · · Score: 1

      iPod Resell^H^H^H^H^H^HHandler

      Ew.

      You're an iPodophile. Are you required to register that fact in your neighborhood?

      --
      Karnal
    11. Re:Is There a Place for a $500 Ethernet Card? by asadodetira · · Score: 1

      No. AFAIK the story behind that is related to some faulty card which was sent for repair over and over. They fried it and made sure they would buy a new, more reliable one.

    12. Re:Is There a Place for a $500 Ethernet Card? by SirNAOF · · Score: 1

      Yup.

      Been there, seen the destruction. Video cards smoke really well...

      --
      Jeremy Baumgartner
    13. Re:Is There a Place for a $500 Ethernet Card? by Anonymous Coward · · Score: 0

      And that also explains all of the other destructive equipment there too like the IDE killer and the SCSI killer?

    14. Re:Is There a Place for a $500 Ethernet Card? by BoneFlower · · Score: 1

      No, the Pentagon would buy a 10 dollar ethernet card and put 490 dollars towards Area 51.

    15. Re:Is There a Place for a $500 Ethernet Card? by RevWhite · · Score: 0

      I was going to offer a similar service, but I guess you pounced much earlier.

      --
      Hey, can I bum a sig?
    16. Re:Is There a Place for a $500 Ethernet Card? by riprootin · · Score: 0

      Gotta love him, he's versatile.

  2. A look into the past by bananahead · · Score: 5, Insightful
    This sounds very similar to the 'smart card' concept back in the late 80's and early 90's. Intel had the 586-driven smart-cards, and I believe 3Com had them as well. They were intended to offload the CPU by putting parts of the stack on the card. They failed because the performance gain and CPU offload numbers were never enough to justify the price difference.

    I wonder what has changed? I have never known the CPU to get dragged down by network traffic, but maybe in the network server markets it is different, However with the Ethernet chipsets being designed into the motherboard and integrated into the tight circle of RAM and CPU, it isn't clear there is a need for this.

    How long before the network control is put into the CPU? It is going to be tough to beat that type of performance.

    --
    A most overlooked advantage to owning a computer is if they foul up there's no law against wacking them around a bit.
    1. Re:A look into the past by bhtooefr · · Score: 3, Informative

      The only time I've heard of that was with Ethel, an Apple II ethernet card. It used a PIC that ran the TCP/IP stack, and fed stuff to the A2.

      Of course, the A2 is perfectly capable of running it's own TCP/IP stack - Uther doesn't do any of that, IIRC, and nor does the LANceGS (although, it seems that the LANce can only do pings on the //e - either that, or it just costs too much).

    2. Re:A look into the past by bluelip · · Score: 5, Interesting

      I've noticed a slowdown in computer response when using gig cards and moving lotsa' data. I thought the bottleneck may have moved to the file systems. Didn't seem to be the case as pumping dummy data throught the nic also caused issues.

      I didn't pursue it far enough to see where where the actual problem was. These cards may help, but my money is on a faster cpu.

      --

      Yep, I never spell check.
      More incorrect spellings can be found he
    3. Re:A look into the past by linzeal · · Score: 1

      With part of the stack of the network card you are less likely to get more common exploits methinks. I would pay gladly for a card like this for the added 'security'.

    4. Re:A look into the past by Anonymous Coward · · Score: 0

      With part of the stack of the network card you are less likely to get more common exploits methinks. I would pay gladly for a card like this for the added 'security'.

      Me too. I'd easily pay $2000 for a 4-port card like this for my servers! After all, what hacker can modify hardware?!

      I just wish I could buy today, but I'm gonna put in my order ASAP! It'll save me tons over the next few months. Yahoo!!!

    5. Re:A look into the past by PONA-Boy · · Score: 3, Informative

      Back when our company was running ATM on the backbone and in our HQ offices, all of the FORE HE155 NIC's were "smart". That was also due, in part, to the particular nature of ATM. The NIC's handled their own routing in addition participating in LANE and PNNI services. Very little of the network load was actually handled by the server themselves. It was really very nice and the NIC's themselves were more than $600 a pop.

      Load on our servers from network processing increased easily by 20% when we moved to an all Ethernet/IP setup. $500 for a "smart" NIC, hell yeah! As much as my boss may chide me about it, I sill lament the loss of ATM in our network.

      -PONA-

      --
      +that's funny...I don't FEEL tardy.+
    6. Re:A look into the past by dnoyeb · · Score: 1

      If you use an nforce motherboard under linux, you have to set it to high throughput or low cpu use.

      It causes studdering audio and other funky stuff on one of the settings. that was the nforce 1 I believe on RH8 and RH9 perhaps. I have not tested in a long while though. The issue showed up on windows at one point too. It could be poor drivers.

    7. Re:A look into the past by X · · Score: 2, Informative

      I wonder what has changed? I have never known the CPU to get dragged down by network traffic, but maybe in the network server markets it is different

      The thing that has changed is that the frequency that frames arrive at has gone up. Unless you can use jumbo frames (and even then, if the payloads are small), GigE is delivering the same sized frames as fast ethernet, just 10x faster. This tends to create a hell of a lot more interrupts for the processor to handle (a condition made worse by the deeper pipelines in processors like the P4). If you can offload the processing of the frames a bit, just enough to give a processor a chance to get something done, you could dramatically improve performance.

      That being said, changes to the protocol (such as jumbo frames) can also have a positive effect in a lot of circumstances, and have the advantage of being cheaper to implement.

      --
      sigs are a waste of space
    8. Re:A look into the past by llzackll · · Score: 2, Informative

      There are a lot of Cards that do this now. You can get a 3com 3c905c, which does at least partial offloading, for about 20 bucks.

    9. Re:A look into the past by __aaclcg7560 · · Score: 3, Interesting

      Jerry Pournelle had a column in the February 2005 issue of Dr. Dobb's Journal about Gigabit hardware. If you have a Gigabit PCI card, expect to see a doubling of speed over 100Mb PCI card. If the motherboard has a built-in Gigabit port, you can see a five to six times speed over 100Mb PCI card or port. PCI cards are limited by the PCI bus, but built-in ports have direct access.

    10. Re:A look into the past by Cylix · · Score: 1

      It's not exactly uncommon when you get into high load non-pc derived devices.

      Take for instance the APX-8000..

      This beast has a dialup port density that will serve an entire small town.

      The ethernet controller has it's own intel risc processor... though the versions I had were using the older cast of that cpu which looks like a pentium die cast. (newer ones are the size of a pinky)

      Looks like they salvaged parts from the ascend/lucent max series to build one. (the early units were interesting)

      In any event, the point being, it's not uncommon to have an entire ethernet controller dedicated to doing all of the works... it's just a bit different then the norm in PC land.

      --
      "You should always go to other people's funerals; otherwise, they won't come to yours." -- Yogi Berra
    11. Re:A look into the past by bananahead · · Score: 1

      But while the frame rate has increased, so has the CPU. In 1990, we were looking at 200 Mhz CPUs max and the frame rate was 10Mb less collision loss, which was at least 50%. Now we have 3.5GHz systems dealing with ethernet over 1GHz fiber with the same collision rate problem. If you do the math, we haven't really made the problem any worse.

      --
      A most overlooked advantage to owning a computer is if they foul up there's no law against wacking them around a bit.
    12. Re:A look into the past by globalar · · Score: 1

      Remember how hardware used to be so much more expensive (transistor prices were magnitudes more expensive) in the 80's? It is now economical to distribute load throughout the system. Price/performance is favorable - we have so many extra cycles it makes sense to no longer centralize them. High bandwidth between systems are much in demand so this product addresses the lower end of that need.

      Multiport (4+) gigabyte network traffic can generate significant load on a machine. This can be multiplied with bandwidth limitations between the CPU and card interface itself. A card integrated with the motherboard can still be hollering for the CPU quite often.

      The real price advantage to this is probably in two cases: 1)small to midrange servers that you want to scale a bit more to delay upgrading and 2)small to midrange clusters where you really want the extra cycles. Ideally this can save you time and money by allowing you to scale the setup you already have.

    13. Re:A look into the past by ProfaneBaby · · Score: 2, Insightful

      Built-in ports have direct access... depending on the chipset/motherboard.

      I've seen some 'built-in' broadcom gig-e ports that were on the PCI bus, even though they were technically built into the board. Horrible performance.

      --
      Video Phone Blogs send video messages straight to the web.
    14. Re:A look into the past by z4ce · · Score: 1

      Any NIC worth its salt has DMA, which drastically cuts down on the number of interrupts.

    15. Re:A look into the past by toddestan · · Score: 2

      I have found that the CPU load due to the disk I/O is usually a lot worse than CPU load from the network card. A nice test is to take a computer with both SCSI and IDE drives, and try moving data off of each of the drives over the network. The IDE drive will cause the system to slow down noticably, while the SCSI drive will barely (or not at all) affect the system.

    16. Re:A look into the past by Anonymous Coward · · Score: 5, Informative

      Plain old 32-bit PCI has a bandwidth of 32 bits * 33 MHz = 1.056 Gbps. A 64-bit bus would obviously be twice that. Unless there is a lot of other traffic on the PCI bus, I suspect the limitation is the driver, not the bus.

      Peripherals like that built into the motherboard are generally on a PCI bus segment anyway. You can see by looking at the device manager in Windows or by using lspci in Linux. In both cases you will see a vendor ID, bus number, and slot number.

    17. Re:A look into the past by Fweeky · · Score: 4, Interesting

      I expect you can get an Intel 1000/Pro for around $30; full TCP/IP checksum offloads in both directions, interrupt moderation, jumbo frames, and Intel even write their own open source drivers.

      Heh, my on-board Realtek GigE chip has checksum offloads too, but even with them on, 300Mbps would have me up to 70% system/interrupt CPU load (and I hear the checksumming is a bit.. broken); I barely scrape 30% with a PRO/1000GT.

    18. Re:A look into the past by ebuck · · Score: 1

      The biggest thing that has changed is the speed.

      10BaseT (mabye even 100BaseT) isn't slamming the bus with interrupts at the rates possible for Gigabit Ethernet. Add enough interrupts to the CPU and you're going to have the CPU running the network interrupt handler at the cost of moving whatever it was working on off of the CPU. Even modest gains can make a big difference in performance.

      If there's a group of people believing it would be more cost effective to buy "super" network cards than to rewrite their applications to use a distributed server farm, there will be a market for this. Hardware solutions always come to the rescue for code that won't be redesigned.

    19. Re:A look into the past by Detritus · · Score: 3, Informative
      I/O and interrupt handling, like many things, doesn't scale with CPU clock rates.

      Collisions are not a problem on switched networks. Even on older shared media and hub based networks, collisions were not the evil thing that they were portrayed as. Ethernet is not Aloha. See Measured Capacity of an Ethernet: Myths and Reality by David R. Boggs, Jeffrey C. Mogul, Christopher A. Kent. It debunks much of the misinformation that is still prevalent.

      --
      Mea navis aericumbens anguillis abundat
    20. Re:A look into the past by Anonymous Coward · · Score: 0

      You're obviously using some shitty IDE hardware.

    21. Re:A look into the past by SailorFrag · · Score: 1

      A minor nitpick: gigE and 10gigE are full duplex and don't have collisions. Full-duplex 100BaseTX or 10BaseT don't have collisions either (the usual situation these days, since switches are so cheap now and have far better performance than hubs, for that very reason).

      1990 didn't have 200 MHz CPUs either. That's more like 1995-1996.

      so, if I do the math...
      10 years ago: 200 MHz CPU - 10Mbps ethernet
      Now: 3500MHz CPU - 1000Mbps ethernet
      Change: 17.5x MHz - 100x Mbps

      17.5x is a lot smaller than 100x. Thus the problem has been made worse. That's not even including the fact that gigE is full duplex, when most networks 10 years ago weren't.

    22. Re:A look into the past by jamesh · · Score: 2, Interesting

      If you've ever had one of the recent worms come in behind a linux router, then you'll see how network traffic can make a cpu stop.

      I made a boo boo in a firewall rule and opened up an unpatched mssql server to the internet (*hangs head in shame*). Within 30 seconds it had caught one of the mssql worms and had stopped the linux router dead. Pulling the network plug from the mssql server caused the linux router to come instantly back to life. With TCP and all its flow control goodness it's probably not a problem, but when something is sending udp or icmp packets at you as fast as it can, you'll really see the difference.

    23. Re:A look into the past by toddestan · · Score: 1

      Standard IDE drives connected to the onboard IDE controllers. So yeah, pretty crappy I guess.

    24. Re:A look into the past by Phil+Karn · · Score: 4, Insightful
      And how long ago was that? What kind of servers had loads increase by 20% when you dumped the "smart" NICs? How much faster have general purpose CPUs gotten since then? And whose unusually inefficient TCP/IP stack and/or Ethernet driver were you running?

      "Smart" network cards are one of those bad ideas that keep coming back from the grave, because computer science seems to lose its collective memory every decade or so.

      Fifteen years ago, Van Jacobsen did a wonderful presentation at SIGCOMM 1990 on just why they were such a bad idea. The reason is very simple. A modern, well-tuned and optimized TCP/IP stack can process a packet with only about 20 instructions on average. Very few "smart" controller cards have host interfaces that can be spoken to with so few instructions! The switch to and from kernel context will usually cost you more than TCP/IP.

      Not only that, but the coprocessor on the "smart" controller card inevitably ends up being considerably slower than the host CPU, because typical host CPUs are made in much larger quantities, enjoy large economies of scale, and are updated frequently. So you often have the absurd situation of a blazingly fast and modern host CPU twiddling its thumbs waiting for some piss-poor slow CPU on a "smart" controller to execute a protocol handler that could have been done on the host with fewer instructions than it takes just to move a packet to or from the "smart" card.

      And if that weren't enough, rarely do these "smart" network controllers come with open source firmware. Usually the company that makes them obsoletes them quickly (because they don't sell well) and/or goes out of business, and you're left with a very expensive paperweight.

      Since his talk, Ethernet interfaces have totally obsoleted "smart" network cards. They now come with lots of internal buffering to avoid losing packets when interrupt latencies are high, and they take relatively few instructions per byte of user data moved. What more could you want?

    25. Re:A look into the past by Anonymous Coward · · Score: 0

      tttttttt

      stuTTering.

      learn to pronounce your Ts and you'll spell better.

      but what do I expect on the "innernet"?

    26. Re:A look into the past by andreyw · · Score: 1

      That would be *shared* bandwith, buddy.

    27. Re:A look into the past by systemofadown · · Score: 0

      I don't know this is true or not but i heard a while back that intel is planning to put a tcp stack in the cpu.

      --
      Science is but a perversion of itself unless it has as its ultimate goal the betterment of humanity. -Nikola Telsa
    28. Re:A look into the past by jonsmirl · · Score: 1

      This sounds very similar to the 'smart card' concept back in the late 80's and early 90's. Intel had the 586-driven

      I was product manager for the Intel cards. Back then we had DOS and the 640K RAM limit, coprocessor cards provided a way to move all of networking off into it's own RAM space. That was more important than the preformance gains.

      TCP checksum offload works and RDMA is a big win. Offloaded iSCSI will probably be a win too. Anything else is marginal.

      Spend your money on a faster CPU, more main memory or 10Gb Ethernet.

    29. Re:A look into the past by cymen · · Score: 2, Funny

      It won't just stop a linux router. It will stop other routers too.

    30. Re:A look into the past by Anonymous Coward · · Score: 0

      that doesn't prove that network traffic can "stop" a cpu. that only proves that linux sucks.

    31. Re:A look into the past by Anonymous Coward · · Score: 0

      The issue showed up on windows at one point too.

      Interesting. I've been having just that problem on a nforce 3 board under XP SP2. Any file transfer bigger than a few megs over a gigabit connection will cause stuttering sound. It's a throughput issue, as transfers over a slow (802.11b) connection don't have the same problem.

    32. Re:A look into the past by YU+Nicks+NE+Way · · Score: 1

      Although I agree with you about the stupidity of smart ethernet controllers, the interesting thing about this one is that it claims to not need to transition to kernel space to set up a packet for sending. In principle, that might actually make a difference in throughput...it it's true.

      Now, I don't think it's true, or, at least, I can't figure out how it could be done. Maybe I just suffer from a lack of imagination.

    33. Re:A look into the past by Jah-Wren+Ryel · · Score: 0, Offtopic

      Jerry Pournelle had a column in the February 2005 issue of Dr. Dobb's Journal about Gigabit hardware. If you have a Gigabit PCI card, expect to see a doubling of speed over 100Mb PCI card. If the motherboard has a built-in Gigabit port, you can see a five to six times speed over 100Mb PCI card or port. PCI cards are limited by the PCI bus, but built-in ports have direct access.

      Pournelle is an idiot.

      But, from the sound of it, he got it right. But then again, a broken watch is still right two times a day.

      Seriously, the guy has written good fiction in books and lots of bad fiction in his columns. You can not take anything he says at face value, chances are he missed one or two or 10 key facts about whatever he's going on about today.

      --
      When information is power, privacy is freedom.
    34. Re:A look into the past by Jah-Wren+Ryel · · Score: 3, Informative

      Although I agree with you about the stupidity of smart ethernet controllers, the interesting thing about this one is that it claims to not need to transition to kernel space to set up a packet for sending. In principle, that might actually make a difference in throughput...it it's true.

      The thing driving smart ethernet cards is stuff like rdma and scsi over ip. The part of thinking behind it for rdma is that the card exerts the same load on the host as local dma (i.e. almost none). For scsi over ip, they think that doing scsi is already enough for the host cpu so let it treat the network interface as "send it and forget it."

      As for avoiding the kernel context switch, I haven't looked at how this card is implemented, but with the right smarts on the card, and a replacement socket library, they could enable each process to talk directly to the card - bypassing the kernel once stuff is initialized - kind of the way an X server can talk directly to the frame-buffer without involving the kernel.

      --
      When information is power, privacy is freedom.
    35. Re:A look into the past by EtherMonkey · · Score: 3, Interesting
      Agreed, but it's even been more recent than the early 90's. The late 90's also had its run of so-called "Intelligent" network cards.

      I worked for a large HP/Intel VAR at the time and I we were selling $500 Intel Intelligent Server NICs like they were Big Macs. Then one day one of our biggest customers called in a fit. It seems that his manager asked him to do a quick comparison between a smart Intel NIC and a regular Intel NIC, so he could tell his bean-counters to get stuffed. It turns out that we were NOT ABLE TO FIND ANY SYSTEM OR TRAFFIC CONFIGURATION that would result in higher throughput, lower CPU utilization or lower memory utilization when using the smart NIC.

      In other words, the standard $100 Intel NIC (PILA8465B, as I recall) beat the piss out of the much more expensive Intel intelligent NIC with on-board co-processor.

      Within 3 months we stopped getting any orders for the smart NICS. In 6 months Intel retailiated by disabling server features (adapter fault tolerence, VLAN tagging, load balancing and Cisco Fast Etherchannel support) on the basic NIC, in an effort to save the smart NIC. When this didn't work they modified the driver so the server features would only work with a re-released version of the "dumb" NIC at a higher price (the only difference between the cheapest and most expensive version was an ID string burned into a PAL on the NIC).

      Similiar experiences with earlier cards from Intel, IBM, and others. In every instance I tested, a plain old NIC (not junk, but the basic model from a reputable manufacturer) always outperformed the NIC's with on-board brains and/or co-processors.

      Maybe this Level-5 NIC has some new voodoo engineering, but I'd have to see real-world testing to believe it. Especially from a company that apparently intentionally is playing-off Level-3 Communications' name recognition for its own benefit.
      --
      --- A man with a briefcase can steal more money, than any man with a gun. [Don Henley]
    36. Re:A look into the past by tylernt · · Score: 1

      "I have never known the CPU to get dragged down by network traffic"

      Unusual at 100Mbps, but when you scale up to gigabit and higher, the overhead starts to add up. See http://sd.wareonearth.com/~phil/jumbo.html.

      --
      DRM 'manages access' in the same way that a prison 'manages freedom'
    37. Re:A look into the past by evilviper · · Score: 1
      This tends to create a hell of a lot more interrupts for the processor to handle (a condition made worse by the deeper pipelines in processors like the P4). If you can offload the processing of the frames a bit, just enough to give a processor a chance to get something done, you could dramatically improve performance.

      Actually, FreeBSD is far ahead of the curve here. They have device polling support for select cards (dc, fxp, sis) which means they eliminated NIC interrupts entirely.

      The chart on the linked page gives quite an impressive example of the difference.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    38. Re:A look into the past by Splab · · Score: 1

      They do have collisions - they are alot more rare, but try being on a 500+ windows network during a worm outbreak - all those arps screws up your network bandwith due to collisions.

    39. Re:A look into the past by klui · · Score: 4, Insightful
      It would depend on the implementation. Not all mobos with built-in ports have "direct access." Some of them go through a shared bus or worse, the PCI bus.

      Intel's implementation for the 865P/875P chipset goes through the memory hub directly http://www.intel.com/design/chipsets/schematics/25 281202.pdf while the i845 chipset has the ethernet interface connected to the ICH4 controller hub that is shared among other devices like the PCI bus http://www.intel.com/design/chipsets/datashts/2519 2401.pdf. VIA's PT894/PT880 ethernet connection goes through a "VIA Connectivity" bus much like the Intel 845 http://www.via.com.tw/en/products/chipsets/p4-seri es/pt894pro and http://www.via.com.tw/en/products/chipsets/p4-seri es/pt880. There were some value motherboards that although I recall that they use good/decent chipsets, their designers decided to connect the built-in gigabit ethernet ports off the PCI bus. I cannot recall what these were but I read about them in anandtech several years ago.

    40. Re:A look into the past by Anonymous Coward · · Score: 0

      No it doesn't, troll.

      Now go back to sucking the Cock of Ignorance.

    41. Re:A look into the past by minion · · Score: 1

      And how long ago was that? What kind of servers had loads increase by 20% when you dumped the "smart" NICs? How much faster have general purpose CPUs gotten since then? And whose unusually inefficient TCP/IP stack and/or Ethernet driver were you running?

      "Smart" network cards are one of those bad ideas that keep coming back from the grave, because computer science seems to lose its collective memory every decade or so.

      Fifteen years ago, Van Jacobsen did a wonderful presentation at SIGCOMM 1990 on just why they were such a bad idea. The reason is very simple. A modern, well-tuned and optimized TCP/IP stack can process a packet with only about 20 instructions on average. Very few "smart" controller cards have host interfaces that can be spoken to with so few instructions! The switch to and from kernel context will usually cost you more than TCP/IP.


      Smart cards do more than just offload the CPU from handling TCP data. They offload the PCI bus from handling interrupts. Every packet of data triggers an interrupt. Do the math on a busy 100mbit network, where your standard ethernet packet is 1500. And thats the maximum packet size. You have much smaller packets on your lan, for the majority.

      Now bump it up to a gigabit, or even the latest 10gigabit. See where this is leading? If the card can do the processing of the data without generating an interrupt, the host is much better off.

      If interrupt congestion wasn't so much of an issue, we wouldn't have multiple PCI buses in servers, DMA, bus mastering, etc. These are all means to help keep the load on the host down, and allow the other cards in the system a chance to talk.

      --

      -- If we don't stand up for our rights, now, there will be no right to stand up for them later.
    42. Re:A look into the past by Anonymous Coward · · Score: 0

      The CPU does matter. Using dd and nc I can pump about 66 MB from my G5 to my old 500 Mhz G4, but only about 30 MB the other way. I have a P3 laptop with a 100 Mb interface that gets about 11 MB either way.

    43. Re:A look into the past by adolf · · Score: 2, Insightful

      Ya know, that's the same sort of argument I've been using to promote software RAID vs. hardware RAID.

      I've learned this: Nobody cares. People will blindly spend hundreds, sometimes thousands, of dollars on specialized gear to offload their precious CPUs.

      When it is explained to them that better system performance can be had for less money by simply buying a faster CPU, they throw up their hands and blindly reassert that dedicated hardware must be better, by simple virtue of the fact that it is dedicated. That such reasoning is plainly a crock of shit seems to escape them.

      Van Jacobsen be damned, people are an illogical bunch. They're always doing stuff for all the wrong reasons, and trying to solve problems with solutions that are only vaguely related.

      That all said, if the card manages to improve ethernet latency even a little bit, it might be worthwhile in some circumstances. I'm thinking of applications like Cobranet for professional audio (where latency is always critically important), or perhaps clustering.

      I mean, can you imagine a Beowulf cluster with these?

    44. Re:A look into the past by Anonymous Coward · · Score: 0

      Smart cards do more than just offload the CPU from handling TCP data. They offload the PCI bus from handling interrupts. Every packet of data triggers an interrupt. Do the math on a busy 100mbit network, where your standard ethernet packet is 1500. And thats the maximum packet size. You have much smaller packets on your lan, for the majority.

      At least in Linux the answer to this problem is called RX polling (NAPI) and packet mmap. Most newer e100/e1000 cards support these features and are significantly cheaper.

    45. Re:A look into the past by 0rbit4l · · Score: 4, Informative
      The reason is very simple. A modern, well-tuned and optimized TCP/IP stack can process a packet with only about 20 instructions on average.
      No, Van Jacobson showed that the fast-path receive could be done in 30 instructions. This doesn't include ("smart"-NIC features, which you ignorantly deride) TCP/IP checksum calculation, nor is it even remotely realistic for a modern TCP/IP stack that supports modern RFCs. You're not including timeout code, connection establishment, state updates, or reassembly on the receive side, and you conveniently completely ignore segmentation issues on the send side. If "smart" NICs are such a bad idea, then I guess Intel and Sun are really up a creek - Intel currently supports TCP segmentation offload (pushing the packet segmentation task from the TCP stack onto the hardware), and is moving to push the entire TCP stack to a dedicated processor + NIC combo.
      Since his talk, Ethernet interfaces have totally obsoleted "smart" network cards.
      You couldn't be more wrong. Since the 90s, the boundary of what the NIC should do and what the OS should do has been repeatedly re-examined, and industry leaders in networking have successfully deployed products that big-iron servers rely on.
    46. Re:A look into the past by advocate_one · · Score: 1
      Peripherals like that built into the motherboard are generally on a PCI bus segment anyway. You can see by looking at the device manager in Windows or by using lspci in Linux. In both cases you will see a vendor ID, bus number, and slot number.

      eh voila!!! lspci gives

      0000:02:09.0 Ethernet controller: Marvell Technology Group Ltd. Yukon Gigabit Ethernet 10/100/1000Base-T Adapter (rev 13)
      --
      Donald 'Duck' Dunn: We had a band powerful enough to turn goat piss into gasoline.
    47. Re:A look into the past by arivanov · · Score: 2, Insightful

      No.

      Realistically there are bottlenecks all over the place and out of them these 2 prevent nearly any computer from reaching 1G.

      1. Interrupt handling bottleneck. Even with interrupt mitigation your typical pps value for a single CPU P4 is under 100 kps. It falls down to under 60 kps when using Intel dual CPUs (dunno about AMD or Via) or SMT due to the overly deep pipeline on the P4. That is way less then 1G for small packets.

      2. IO bottleneck. Many motherboards have IO-to-memory speeds which are realistically way under 1G in total, usually around 600-700 Mbit.

      No card can help for these 2 problems.

      --
      Baker's Law: Misery no longer loves company. Nowadays it insists on it
      http://www.sigsegv.cx/
    48. Re:A look into the past by TCM · · Score: 1

      Within 30 seconds it had caught one of the mssql worms and had stopped the linux router dead. I'm not sure you diagnose the problem correctly. How should it be able to affect the router? If a Linux router is "stopped dead" by worm traffic, it's obviously flawed. I could understand if the worm saturated your line or whatever, but disabling the router completely?

      --
      Of course it runs NetBSD. BTC: 1NT7QvbetmANwaMzhpVL6
    49. Re:A look into the past by Anonymous Coward · · Score: 0

      Mod parent up!

    50. Re:A look into the past by Dwonis · · Score: 1

      Um... We'd have to see the rest of the entries to determine anything from that...

    51. Re:A look into the past by Eivind · · Score: 5, Informative
      Smart cards do more than just offload the CPU from handling TCP data. They offload the PCI bus from handling interrupts. Every packet of data triggers an interrupt.

      With newer Linux-kernels this is quite simply not the case.

      To avoid the torrent of interupts from a fast nic the Linux-kernel detects that the card gets packets so often that essentially there's "always" one or more packets waiting in the cards buffers.

      It responds to this condition by disabling interupts for the card in question and switch to polling it regularily.

      Normally polling is inefficient, because it amounts to asking over and over again "got anything for me now?", where in most situations the answer is "no" 99.99% of the time, which makes it a waste of resources to ask in the first place.

      This changes when the answer is "yes" basically all the time. There's no need for the network card to tell the cpu over and over and over "I got a packet for you", instead the cpu collects packets regularily.

      It's sorta like having your lawyer receive legal letters for you.

      If you get very few, it'd be a waste for you to drop by him every day and ask if he's gotten any for you (polling) most of the days you'd be making the trip for naught. In this situation interupts (i.e. having your lawyer call you and inform you on the rare occasions when a letter *does* arrive) makes more sense.

      But if your letter-flow increases to the point where there's normally 3-5 letters every day and it's rare that no letter arrives, then it no longer makes sense that the lawyer calls you every day to tell you you got letters (interupts), you already assumed that. In this scenario it makes more sense for you to come by regularily and pick up letters without being prompted to do so. (polling)

      Thus, the flow of interupts from a Gb-nic being flooded with 100byte small-packets (say a loaded dns-server) is not 1 million interupts every second -- it is zero interupts.

      (allthough what you write is correct for kernels older than 2.6.10 and for less clever OSes.)

    52. Re:A look into the past by Anonymous Coward · · Score: 0

      I don't know what curve it is far ahead of, but it isn't Linux's curve.

      FreeBSD's polling is basically as-dumb-as-you-get continual polling, it introduces an average HZ/2 latency to each packet in low load situations, and it doesn't work on SMP.

      Linux's NAPI is a smart load based interrupt mitigation and polling framework with neither of the above problems. Linux also supports TSO, and generally has lighter weight send and recieve paths than most operating systems, including FreeBSD.

    53. Re:A look into the past by superpulpsicle · · Score: 1

      http://www.znyx.com/support/drivers/ZX346Q_drivers .htm

      It could be worse. A $1000 quadfast ethernet card for linux that performs top of the line at the enterprise level at one time.

    54. Re:A look into the past by tob · · Score: 2, Interesting

      100kips is actually enough to get 1Gbps throughput. 1 ethernet packet = 1500 bytes = 12k bits. 100k ethernet packets are 1.2Gbits.

      In practice (did some testing 2 years ago, on very modern hardware for the time) you can do 70 MB/s NFS on an untuned Linux box. By tuning buffersizes and using jumboframes (9kB ethernet packets instead of 1.5kB) you can get 110MB/s which is amazing if you realize what kind of everhead is in that transfer (NFS, RPC, TCP, IP, Ethernet).

      Tobias

    55. Re:A look into the past by Anonymous Coward · · Score: 0

      You cann`t process a tcp packet with 20 instructions. Not unless you`re ignoring the checksum calculation (the most costly part of tcp handling is the checksum verification).

      Post from people who haven`t got a clue about something? Must be Slashdot....

    56. Re:A look into the past by jamesh · · Score: 1

      Seriously, even the keys i pressed didn't come up. The server/router in question is a Compaq Proliant 1600 with a single 350Mhz CPU.

      If you consider a server sending UDP packets as fast as it possibly can over a gigabit network link to another server (router) which may have to do NAT and filtering, and QoS (only 2mbit outgoing from the router), it can cause enough interrupt activity that the cpu just doesn't have time for anything else.

      For some quick (and possibly incorrect calculations), say it is sending 100 byte packets.
      100 bytes = 800 bits
      +50% to account for overhead to put the packet on the wire = 1200 bits
      1200 bits @ 10^9 bits / second ~= 833000 packets / second
      assuming a 1 interrupt per packet ethernet card, and a 350mhz cpu, that gives you 420 cpu cycles to process the packet.
      processing the packet will consist of:
      . ethernet validation (checksums and whatever else)
      . de-encapsulation of the ip payload
      . ip validation (source, dest address etc)
      . traversing the routing tables
      . traversing the firewall tables

      and that doesn't include sending it out the other interface again. Also consider that being a linux router, it's also doing a few other minor tasks like traffic accounting.

      Remember UDP is different to TCP, with TCP the dropped packets would be detected and the transmission slowed to a rate that the routers outgoing interface could accept them at. UDP has no such flow control.

      And as I said, unplugging the network cable brought the router back to life instantly.

      I've seen this happen with cisco routers too, so it's not just a limitation of linux, although I imagine the load required to down my low powered linux router would be less than that required to have the same effect on a cisco router.

      Other than a few cases of overload that I have experienced caused by either my stupidity, or an infected laptop being plugged into the network, the router has performed admirably.

    57. Re:A look into the past by Anonymous Coward · · Score: 0

      I just read in another post that your solution is to get a kernel 2.6.10 or newer (no more '1 interrupt per packet', and a decent card with tcp offloading (intel gbit).

    58. Re:A look into the past by TCM · · Score: 1

      1. Interrupt handling bottleneck. Even with interrupt mitigation your typical pps value for a single CPU P4 is under 100 kps. It falls down to under 60 kps when using Intel dual CPUs (dunno about AMD or Via) or SMT due to the overly deep pipeline on the P4. That is way less then 1G for small packets.

      from http://lists.freebsd.org/pipermail/freebsd-net/200 4-September/004840.html

      "PS: Linux guys where pretty much floored that FreeBSD 5.3 can route 1Mpps and
      they can't do much more than 100kpps. ;-) Yes, way to go!"

      --
      Of course it runs NetBSD. BTC: 1NT7QvbetmANwaMzhpVL6
    59. Re:A look into the past by Elshar · · Score: 1

      Actually, its more than that because the 64 bit pci slots run at 66MHz. So, 64*66Mhz = 4.224 Gb/s. Keep in mind also that PCI-X is even faster still.

    60. Re:A look into the past by cowbutt · · Score: 1
      Important features for good Gbit performance in PC-like systems:

      PCI-X: a full-width (64 bit), full-speed (133MHz, quad-clocked) PCI-X bus gives 1064Mbyte/s peak bandwidth, shared between all devices on that PCI-X segment

      Multiple PCI-X segments: this is already happening on some high-end boards (e.g. the Newisys board used in Sun's quad-Opteron v40z).

      Network drivers which support NAPI (e.g. Intel's PRO/1000 NICs) are much more likely to achieve Gbit speeds in practice

    61. Re:A look into the past by Anonymous Coward · · Score: 0

      I mean, can you imagine a Beowulf cluster with these?

      was that really necessary?

    62. Re:A look into the past by shippo · · Score: 1

      At work at the time we ran a Xenix system with an Excellan 205T NIC. This was 82586 based, and ran it's own network stack.

      It probably cost the equivalent of $500 back then.

    63. Re:A look into the past by anti-NAT · · Score: 1

      Intel currently supports TCP segmentation offload (pushing the packet segmentation task from the TCP stack onto the hardware), and is moving to push the entire TCP stack to a dedicated processor + NIC combo.

      I'm curious, where have Intel said they're going to push the whole TCP/IP stack onto a dedicated processor ? I've seen a bit of speculation they're going to do it, but not a statement from Intel themselves. Does one exist ?

      You couldn't be more wrong. Since the 90s, the boundary of what the NIC should do and what the OS should do has been repeatedly re-examined, and industry leaders in networking have successfully deployed products that big-iron servers rely on.

      I don't necessarily think that just because some customers have bought them, means its a good, well thought out and useful idea. A lot of people buy Britney Spears music, does that make it good or just popular ?

      I suggest having a read of any threads on the Linux netdev mailing list, with "TOE" in the title. There has been quite a lot of discussion about the pros and cons, and it seems that the consensis of the main Linux kernel networking hackers is that TOE isn't a good idea.

      Here is a quick TOE netdev search link for you.

      --
      The Internet's nature is peer to peer - 20050301_cs_profs.pdf
    64. Re:A look into the past by rsynnott · · Score: 1

      That's not necessarily true; particularly if you lack a PCI-X or other super-PCI bus, the integrated network interface will often be on the PCI bus anyway.

      --
      Me (Blog)
    65. Re:A look into the past by rodac · · Score: 1

      be serious.

      a tcp checksum is essentially a 16 bit add with overflow wrapped back to the LSB.
      there is no way ever that is going to consume any measurable amount of cpu compared to actually processing the data.

    66. Re:A look into the past by chrysalis · · Score: 1

      Even cheaper and faster, you can get a Syskonnect NIC.

      --
      {{.sig}}
    67. Re:A look into the past by Anonymous Coward · · Score: 0

      They offload the PCI bus from handling interrupts. Every packet of data triggers an interrupt.

      As opposed to .... doing what?

    68. Re:A look into the past by Anonymous Coward · · Score: 0

      "eh voila"?

      I think you mean "et voilà!", which is french for "and see there!".

      Hope that helps. Have a nice day!

    69. Re:A look into the past by Thaddeus · · Score: 1

      Just because a slot is 64-bit doesn't mean it's 66 MHz... e.g. I'm working with some Dell PowerEdge 600SC systems that have 64-bit, 33 MHz slots.

      --
      ^X^S ^X^C
    70. Re:A look into the past by 3rd_Floo · · Score: 3, Informative

      And everyone forgets about the good higher PCI-X standard (Now in 2.0a!), which permits not only 100MHz and 133MHz like 1.0, but also 266MHz and 533MHz. Although you will be hard pressed to find 2.0 devices, the 66-133MHz devices are very common in the server market, infact I have a nice 133MHz GigE card here, a very nice 64-bit addition!

    71. Re:A look into the past by petermgreen · · Score: 1

      its nice to see such progress being made but unless this info hits some form of big tech news its going to be a while before most linux servers are running 2.6.10 or above. many people are still running 2.4.x because they do not belive that 2.6.x is currently a proper stable series (apparently the regreesion count in 2.6.x is very high).

      --
      note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
    72. Re:A look into the past by Kizeh · · Score: 1

      Of course this only applies to a basic, simple TCP/IP stack. Once you have to deal with Vlan trunking, QoS, load-balancing and similar things the load on the computer grows quite a bit. I can certainly see why it would make sense to put reasonable buffers, queing logic and other fairly advanced features on a card if performance is more important than price.
      None of these cards are intended for people's home PCs. They're meant for servers with 64-bit buses and SANs, where many of the other bottlenecks discussed earlier in this thread don't exist.

    73. Re:A look into the past by pigscanfly.ca · · Score: 1

      I thought they chose there name from the OSI layer they brought the data up to.
      From the article "The name Level 5 refers to the network protocol stack where level 5 delivers data from the network to the application, according to Karr. "

    74. Re:A look into the past by Cramer · · Score: 1

      wtf are you talking about? You can get those things for 25$ on eBay. I have a stack of them that I paid 24$ each for them about 2 years ago -- before zynx stopped making them.

      They're pretty good -- damn good for 25$. But they are certianly not "top of the line".

    75. Re:A look into the past by Anonymous Coward · · Score: 0

      Ah, sounds like Robert X. Cringley. Must be a job requirement these days for columnists.

    76. Re:A look into the past by rpozz · · Score: 1

      An excellent point. For that price, you could seriously upgrade the CPU instead.

    77. Re:A look into the past by afidel · · Score: 1

      No, no they don't. You can overload your switching fabric, or exceed the packet routing capability of your switches processor, but you will never get a collision on a gigabit network. A collision is the existance of two overlapped messages on the same physical segment, this is an impossibility in a full duplex switched network (which is required by the gig ethernet spec).

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    78. Re:A look into the past by afidel · · Score: 1

      4 port gigabit cards make very little sense. You are unlikely to get a disk subsystem that do in excess of 200MB/s so it makes a LOT more sense to go with two dual port cards with the second card set as a failover pair.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    79. Re:A look into the past by tzanger · · Score: 1

      What are you smoking? onboard network is still on the PCI bus, just like on-board controllers are. Now the on-board ethernet may be on a separate PCI bus (one server I have at the office here has *7* PCI busses) or it may be part of the chipset (yuck!) but don't be fooled, it's still on a PCI bus.

    80. Re:A look into the past by Mojo+Trolljo · · Score: 1
      These are probably RDMA capable which should save CPU because of some offload capability plus zero-copy unlike TCP/IP which needs to transfer the buffer between the user memory into kernel buffers.

      The type of customers for this would be database clusters and scientific clusters mostly.

      My guess is for applications that use only TCP/IP there won't be much if any performance gain, but if the app is RDMA-aware it could be boosted by this.

      --
      This post was made by I, Mojo Trolljo, for you to read that was written by I who is Mojo Trolljo!
    81. Re:A look into the past by X · · Score: 1

      I see you haven't played around with GigE. DMA doesn't solve the problem with networking. Sure, the hardware can handle the processing of the ethernet frame, but unless the network card does layer 3 (like the cards in this article), each frame still needs to go to the CPU so it can handle the network protocol (say TCP/IP). Sure, you can try delaying the processing until you have a few ethernet frames together, but of course that's already part of the trick that's going on with a fast ethernet card, and the frames are coming 10x faster with GigE. You delay too much, and it starts to actually slow down the networking.

      --
      sigs are a waste of space
    82. Re:A look into the past by Anonymous Coward · · Score: 0

      You really should go visit Alcatraz. It's a great tour.... Tours sell out quickly, but you can buy your tickets online ahead of time.

      Sorry about your friend.

    83. Re:A look into the past by 0rbit4l · · Score: 1
      I'm curious, where have Intel said they're going to push the whole TCP/IP stack onto a dedicated processor ? I've seen a bit of speculation they're going to do it, but not a statement from Intel themselves. Does one exist ?
      It's called "TCP Onloading". Here's an article about it (paid subscription required for the whole article - the abstract is free). Notice that it's coming from Intel research labs.
      I don't necessarily think that just because some customers have bought them, means its a good, well thought out and useful idea.
      The two most popular gigabit ethernet chipsets (intel's gigabit interface and broadcom's gigabit interface) are "smart" NICs that are based on programmable processors and that feature varying degrees of offload capability. The parent poster was blindingly stupid to claim that such NICs have been failures and that we should dismiss the idea outright because of some special case discussed in a 15 year old paper on a 15 year old architecture.
      A lot of people buy Britney Spears music, does that make it good or just popular ?
      No, but popular doesn't necessarily == crap, either. As much as the slashdot masses love to believe that people spending IT money are all PHB fools, people who are developing and maintaining mission-critical datacenters have thought various forms of smart NICs and TCP calculation bypass have been an intriguing and good idea for a long time.
    84. Re:A look into the past by Anonymous Coward · · Score: 0

      100 kilo penguins per server?

    85. Re:A look into the past by jandrese · · Score: 1

      This is a documented phonominom.

      We had some 3Com cards at work that had special hardware on them to offload the encryption. They were expensive and when I ran tests with them I couldn't manage to get them to provide any better performance than a run of the mill Ethernet card. On the other hand, I'm not sure the drivers were ever quite working right either.

      --

      I read the internet for the articles.
    86. Re:A look into the past by Lee+Cremeans · · Score: 1

      Not only did LANceGS cost too much ($150 plus drop shipment from Germany), but it also seems the developer refused to release any specifications for a long time -- even the photos on the website had the markings on the Ethernet chip ground off. (It's since been revealed that it uses an SMSC LAN91C96, and the latest release of Contiki supports it just fine.)

      -lee

    87. Re:A look into the past by Anonymous Coward · · Score: 0
      Lay off the crack.
      So you often have the absurd situation of a blazingly fast and modern host CPU twiddling its thumbs waiting for some piss-poor slow CPU on a "smart" controller to execute a protocol handler that could have been done on the host with fewer instructions than it takes just to move a packet to or from the "smart" card.
      What you have are reassembled packets being DMAed into the application program's address space. This has amazing benefits for cluster supercomputing, video processing, and many other applications.
      Not only that, but the coprocessor on the "smart" controller card inevitably ends up being considerably slower than the host CPU, because typical host CPUs are made in much larger quantities, enjoy large economies of scale, and are updated frequently.
      The network processors in question are made on fast semiconductor processes (several hundred megahertz clocks at the very least), and the data paths are insanely wide and insanely pipelined.
      Since his talk, Ethernet interfaces have totally obsoleted "smart" network cards. They now come with lots of internal buffering to avoid losing packets when interrupt latencies are high, and they take relatively few instructions per byte of user data moved.
      A NIC designer who burned a big chunk of die area for a buffer would be shot and fired, in that order. Think DMA into prearranged buffers in the host computer's RAM.
    88. Re:A look into the past by Lennie · · Score: 1

      packets

      --
      New things are always on the horizon
    89. Re:A look into the past by briantf · · Score: 1
      Yep, I still have a stash of those NIC's, they were the 2nd gen Intel PRO/100B (first gen was not great). I bought a value pack (5 NIC's plus a 12-port Bay Networks FE hub rebranded by Intel). Intel was loss leading to get a foothold in the market at the same time 3Com came out with the atrocious 3C590/595 and I quite buying 3Com (apparently so did everyone else). I was impressed and bought a bunch of new servers with that specific NIC. Used them for a bunch of customer sites as well.


      Fabulous card, Intel promised the future drivers would optimize the firmware for Novell NetWare/Windows NT servers even though the shipping drivers wouldn't. I was transitioning from NetWare 3.x to NT351, and by Sept. 96 to NT4. The new drivers did improve performance in the servers, just as advertised.


      They also wrote the drivers for FreeBSD (2.2.x can't remember, maybe 3?) and they were *really* fast for the day. FTP from a Windows server at like 6.5 MB/sec (P133's on both ends) was HUGE when compared to 10Base-T at 800 KB/sec.


      The hack for ganging together the later PRO/100+ or PRO/100S desktop adapters was to stick one server adapter in and then you could use the onboard NIC's and any other PRO/100. The dual-port PRO/100+'s worked really well with Cisco's FEC on HP's switches, for example. Sweet.


      Thanks for reminding me of the olden days.

    90. Re:A look into the past by Jozer99 · · Score: 1

      There are dozens of bottlenecks for gigabit ethernet. The point is not to transfer 1 gb/s, but to transfer more than 100 mb/s. Cards with processors on them is not a new idea. Lots of "managed" ethernet cards already exist. This may be the first gigabit one, though. They are useful in severs who's processor has better things to do than cruch TCP/IP crap. In conclusion, there is a place for a $500 ethernet card, but it is in one of the orfaces of an SCO exec.

    91. Re:A look into the past by Anonymous Coward · · Score: 0
      If you're building an iSCSI SAN, or if you're transitioning from a Fibre Channel SAN to an iSCSI-based SAN, an iSCSI HBA to offload the iSCSI encapsulation and TCP/IP overhead can fulfill a real need. A forklift upgrade of your server farm might be a bit more expensive than equipping each machine with an offload engine of some sort.

      These things have their place...the market ends up dictating that a niche product like this will be more expensive, but that doesn't mean everyone who buys one is an idiot. I'll agree that people don't always make sensible decisions here...often the job can be done in software with a minimal (or negligable) performance penalty. Sometimes it cannot.

    92. Re:A look into the past by evilviper · · Score: 1
      it introduces an average HZ/2 latency to each packet in low load situations

      You can raise the clock interrupt frequency to get the latency reasonably low.

      However, that's the inherent trade-off you have to make. In general, a system cannot switch methods quickly enough for polling to be effective after an interrupt.

      and it doesn't work on SMP.

      It works in SMP systems, though it would only use a single processor.

      From what papers I've found with a quick search, it seems NAPI doesn't get much benefit from additional processors anyhow.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    93. Re:A look into the past by anti-NAT · · Score: 1

      You don't seem to be distinguishing between cards that have relatively minor optimisations to increase performance, such as the Intel and Broadcom ones you've mentioned, and the card that is the topic of this article, which runs the whole TCP/IP stack (ie. managing the connections including sequence numbers, round trip times etc. etc. etc. independently of the OS).

      This article is about a separate card running the full TCP/IP stack, and it is this card that Phil Karn's criticisms apply to. I don't think can turn that into a criticism of all on card optimisations, such as TCP Segment Offload, which is what I understand is one of the the optimisations that the Intel and Broadcom cards implement. I think you're expanding his opinion wider than it probably is.

      As an alternative example of opinions on NIC hardware optimisations, Dave Miller, the main networking subsystem maintainer for Linux, does not like TCP Offload Engines (which is what this article card is) at all, yet he's quite happy to come up with new and better ways to use TCP Segment Offload. Here's an example of his opinion on TOE. Here's his recent post regarding new TSO code he has written and how he is happy with its performance.

      It's called "TCP Onloading". Here's an article about it (paid subscription required for the whole article - the abstract is free). Notice that it's coming from Intel research labs.

      I could only read the abstract. I really can't see how to interpret it as saying that the whole TCP/IP stack was going to be moved on to the chipset.

      --
      The Internet's nature is peer to peer - 20050301_cs_profs.pdf
    94. Re:A look into the past by Anonymous Coward · · Score: 0

      You can raise the clock interrupt frequency to get the latency reasonably low.

      Well, not really. 1000 is already putting strain on the system, and 10000 is crazy - and you're still adding .1ms on there in that case.

      However, that's the inherent trade-off you have to make. In general, a system cannot switch methods quickly enough for polling to be effective after an interrupt.

      Yes it can. There was a large amount of research and development and testing into this when NAPI was implemented. It is definitely a win - ask the 10GbE vendors testing with Linux.

      It works in SMP systems, though it would only use a single processor.

      OK, well FreeBSD's networking stack is pretty well single threaded, so I guess not.

      From what papers I've found with a quick search, it seems NAPI doesn't get much benefit from additional processors anyhow.

      Umm, yes it does. You didn't actually look at any papers, did you? Linux routes 1.05Mpps with a single CPU, and 2.1Mpps with dual CPUs. And let this post also shut up all those idiots saying "Linux can barely do 100kpps".

    95. Re:A look into the past by Eivind · · Score: 1
      Fine. But we're not talking existing servers here, but rather new ones (the cards are not even on the market yet).

      So the question is, how many of the ones that buy a new server *after* these cards become available on the market will install a kernel older than 2.6.10?

      Perhaps a few, but probably *not* the ones for which performance is important, nor the majority which simply takes whatever is default in their distro.

      Fedora and Mandriva both have newer default kernels (2.6.11 I think), and I guess even Debian uses 2.6 now ?

    96. Re:A look into the past by Man+Eating+Duck · · Score: 1
      I have a Compaq Armada 7800 acting as a gateway / various servers with a second-hand el-cheapo Realtek pcmcia card.

      The card is 10/100, but I have to run it in 10 Mbit, or it takes down the net connection when the load increases.

      I did some research, and it turns out that the 266 Mhz CPU in the old laptop couldn't drive the Realtek because of bad chip design requiring too much processing from the CPU.

      I know that Realtek 8139 isn't exactly among the high quality cards, but I wonder to which degree this becomes an issue with 1 or even 10 GBit Ethernet cards...

      I remember some choice quotes in the driver source on behalf of the frustrated driver coder:
      +/* Note from BSD driver:
      + * Here's a totally undocumented fact for you. When the
      + * RealTek chip is in the process of copying a packet into
      + * RAM for you, the length will be 0xfff0. If you spot a
      + * packet header with this value, you need to stop. The
      + * datasheet makes absolutely no mention of this and
      + * RealTek should be shot for this.
      + */
      :)
      --
      Are you a grammar Nazi? I'm trying to improve my English; please correct my errors! :)
    97. Re:A look into the past by Phil+Karn · · Score: 1
      In nearly every case, really substantial performance increases can be had with very simple and transparent changes; you don't have to get fancy. If you can't handle an interrupt on every packet, then don't interrupt on every packet! It's that simple. Just put lots of memory on the Ethernet controller and let the host transfer a whole bunch of packets on a single interrupt.

      When I did my TCP/IP stack for the PC in the mid 1980s, I learned a very simple lesson about interrupt handling: do as little at interrupt time as possible, and do it as seldom as possible. Device hardware, and by extension their interrupt handlers, really have only one function: to buy time until the operating system and upper layers can get around to you. The device and/or interrupt handler (ideally the former) should therefore be able to run as long as possible without host intervention. That means having as much memory as possible to buffer incoming data to ensure that nothing gets lost.

      This approach adapts nicely. When the host CPU is fast or lightly loaded and/or the input data rate is low, the host can easily service an interrupt on every packet. But when the data rate is high and/or the CPU is slow or heavily loaded, multiple packets are handled on each interrupt, thus cutting interrupt overhead per packet precisely when you need it.

      The same approach has been long used in simple devices like serial ports; the National Semiconductor 16550 UART, for example.

    98. Re:A look into the past by Phil+Karn · · Score: 1
      Okay, so maybe it was 30 instructions -- it's been 15 years and I came up with that figure from memory. BFD. Whether it's 20 or 30, it's a small number, and as CPUs get faster, it's an even smaller number of nanoseconds to execute. How many instructions will that same CPU execute to process that same data at the application layer? The likely answer is "orders of magnitude more". That means the protocol processing is already down in the noise, and you're just pounding the rubble by trying to optimize it further.

      You mentioned "fast path" but you obviously didn't understand what it meant or why it was important. Timeout code, connection establishment, out-of-order reassembly etc, etc, are all irrelevant to performance because they're rare events. You only have to optimize the most common case, which is that the TCP packet you're processing is in sequence and has only the ACK bit set (and maybe the PSH bit, though most OSes can just ignore it).

      That's what the fast path code handles, and that's precisely why VJ could do it in only 30 instructions! You're just wasting your time optimizing the stuff that rarely happens; that's basic software engineering.

      The only other protocol operation that takes any significant time is the checksum calculation, and here the memory access time dominates. So VJ's answer to that was to build a memory copy operation (which you need anyway) that simultaneously computes the checksum in a single memory access. Simple, and no special hardware is needed.

    99. Re:A look into the past by Phil+Karn · · Score: 1
      I still don't think those things necessarily call for a lot of smarts on a host network card. Several of the features you mentioned, such as VLANs and QoS, put most of their complexity on routers, not hosts.

      For those operations that do involve the host, I can't think of any that require a lot of complex code to be executed on each and every data packet. For example, setting a VLAN or QoS value just involves copying a constant into a packet header; that's trivial since you're already copying a whole bunch of other header constants (IP addresses, port numbers, etc).

      The one thing you do want on a network card is lots and lots of buffering so the host can take its time to service it and transfer lots of data in each servicing operation.

  3. Sure there's a place for them by grub · · Score: 5, Insightful

    Is There a Place for a $500 Ethernet Card?

    Of course there is, assuming the card performs as advertised. Sheer conjecture: the card likely has a lot of the smarts onboard. Maybe it has some of the TCP and IP stuff on board too (checksum, etc). Compare that to a crapbox $10.95 RealTek[a] card which generates interrupts like mad because it has no smarts and you'd probably be very suprised. (Think of comparing a decent hardware modem to a software based WinModem.)

    [a] I had a sales-drone at Computer Boulevard here in Winnipeg just RAVE about RealTek cards. I said I really wanted 3 Intel or 3COM cards for a new work proxy server and he said 'Why? RealTeks are way cheaper and run at the same speed!' Retard.

    --
    Trolling is a art,
    1. Re:Sure there's a place for them by nfdavenport · · Score: 0

      Think of comparing a decent hardware modem to a software based WinModem

      *shudder* I try not to.

    2. Re:Sure there's a place for them by Anonymous Coward · · Score: 0

      Heh, I was just trying to draw an analogy :)

    3. Re:Sure there's a place for them by Foktip · · Score: 1

      Since there is Linux support, yes.

    4. Re:Sure there's a place for them by salimma · · Score: 1

      Amazing. You'd think he'd be more than happy to sell more expensive items to you. Maybe he's trying to build your trust so he can pull a sleight-of-hand later? Or he really thinks RealTek cards are better. Ugh.

      --
      Michel
      Fedora Project Contribut
    5. Re:Sure there's a place for them by njcoder · · Score: 1

      From the article I couldn't tell how this different from TCP/IP Offload Engines (TOE). Looks like there are a bunch of companies coming up with TOE implementations, is this going to be a product that fails once the TOE standards come out?

    6. Re:Sure there's a place for them by MerlynEmrys67 · · Score: 1
      Uh - what TOE standards...

      The standard it TCP - has been around for 20 years or so, not likely to change much.

      What you might be thinking about are these abominations called RDMA protocols coming out of the RDMAC (Remote DMA - think about it and shudder) - the idea with strict TOE is that external to the box, you can't tell it is running TOE or just a BSD networking stack (or your favorite flavor of TCP anyway)

      --
      I have mod points and I am not afraid to use them
    7. Re:Sure there's a place for them by grub · · Score: 1

      I really think he though they were equal to or better than the Intel & 3Com cards and was just trying to save a dumb customer some money. His motives were fine just misguided.

      --
      Trolling is a art,
    8. Re:Sure there's a place for them by moosesocks · · Score: 1

      The fact is that RealTek and the likes are very much responsible for the proliferation of ethernet on inexpensive desktop PCs.

      Sure, you may not like them very much because their equipment is cheap, but in order to put $300 PCs into homes, you're going to need to cut corners somewhere, and thankfully we were able to support broadband in the process.

      Although I'd rather have a 3com in a server, I honestly don't see the huge benefits of having premium network gear anymore. The divide between the Premium and Cheap stuff has become very narrow, even though the price gap has grown wider.

      --
      -- If you try to fail and succeed, which have you done? - Uli's moose
    9. Re:Sure there's a place for them by Anonymous Coward · · Score: 0

      Haven't you noticed, /. readers don't understand analogy.

    10. Re:Sure there's a place for them by pchan- · · Score: 2, Informative

      This is different from a TCP/IP offload engine in one critical feature: it is designed so that the network interface is run directly out of user-space, without involving the kernel. It may still do the network stack in software, but it does it in-process. This means that there is no copying from/to userspace and no context switch for every read or write. When you're handling gigabit-speed traffic, this becomes a big issue. Just like video players today use special OS features to open a video port directly to the graphics card without routing it through the windowing system, this does the same with network data. Obviously, you and I won't be buying this thing, unless you happen to work in an environment where you have massive network traffic.

    11. Re:Sure there's a place for them by darkonc · · Score: 1

      Perhaps he just didn't have anything better than a $10.00 RealTek. Not many sonsumer-level users have the kind of network load that makes a 3Com card worth the money.

      --
      Sometimes boldness is in fashion. Sometimes only the brave will be bold.
    12. Re:Sure there's a place for them by njcoder · · Score: 1

      Yeah but does anyone know if this is going to be better/worse than the TOE cards from people like Chelsio which Novell and Sun seem to be partnering with?

    13. Re:Sure there's a place for them by hjf · · Score: 1

      wrong. i have a realtek on my 486 linux router and dmesg is full of "eth0: TOO MUCH WORK AT INTERRUPT". and i have a 512k dsl.

      imagine what happened when I used (boss' orders) a onboard 8139 on a server. yes. 10 users and it goes mad with too much work. that server has been running over a year already with a 3C905C and not a single problem. tcp offloading really helps in that situation too.

    14. Re:Sure there's a place for them by Triumph+The+Insult+C · · Score: 1

      3com cards (3c905, 3c920, etc) aren't really that good to begin with. better than a realtek, sure. but no where near syskonnect (sk) or intel (fxp, em)

      i think people think they are good because they used to be expensive. even then, people were paying for the name

      --
      vodka, straight up, thank you!
    15. Re:Sure there's a place for them by Triumph+The+Insult+C · · Score: 1

      3com is *hardly* premium gear

      replace that 3com with a syskonnect or intel and you will be blown away

      --
      vodka, straight up, thank you!
    16. Re:Sure there's a place for them by darkonc · · Score: 1

      I actually like 3com cards because I sometimes teach Solaris courses, and 3com's seem to have the best support under Solaris/x86. I really don't care how good they are because I almost never stress them. Truth of the matter is that I think that it would be hard to stress a modern box with anything slower than a gigabit card

      --
      Sometimes boldness is in fashion. Sometimes only the brave will be bold.
    17. Re:Sure there's a place for them by Swaffs · · Score: 2, Interesting

      I walked into Computer Boulevard about three weeks ago looking for a replacement hardware modem (unfortunately I don't live in Winnipeg anymore, but about 250 km north east, no cable or even DSL here.)

      So the sales guy asks me if I need help and I tell him I want a 56k hardware modem. So he ushers me to the modem section to let me browse. Sure enough, there's nothing there but winmodems. He comes back a couple minutes later and asks if I found what I was looking for. I said no, and that what I was looking for was a hardware modem, because I'm running linux. I told him they probably only had it in OEM.

      So he goes and gets the big book of parts and finds it, and I tell him that yes, that's exactly what I came for. Well off he goes and comes back several minutes later to tell me that those are in the back, which is why I couldn't find it. Gee, thanks, that's why I mentioned it was OEM, since they don't usually put OEM parts on the shelf. So he asks if I want one, and I say yes, and off he goes only to come back and report that they're out of stock.

      I went over to Computer Avenue and was met with someone (unforuntately I didn't get his name) that knew what he was talking about and was quickly walking away with what I needed, albeit at a $10 higher price than I would have paid at CBIT if they'd had one.

      The sad part about this is that I'm not a computer professional, just a user, and one that's not even that familiar with hardware. I'm all isolated from the computer world and out of the loop up here on MTS's when-they-feel-like-it internet access. I don't think I should know more than the clerk at the store.

      --

      --
      "Karma can only be portioned out by the cosmos." - Homer Simpson [1F10]

    18. Re:Sure there's a place for them by gad_zuki! · · Score: 2, Insightful

      >I don't think I should know more than the clerk at the store.

      I don't really think that's a valid complaint. In a perfect world, yes, but in retail? Not really.

      Running linux is like owning a foreign car and expecting GM/Ford guys to fix it just as easily. Its one of the real liabilities of not running the monopoly/defacto standard OS. As a linux user, you should know what you're buying. I mean, users ofter get criticized for being ignorant of their systems, but you want the same ignorance and expect retailers to spend all this extra time and traning on what is really a minority OS they might get a tiny amount of sales for?

      I *always* expect the salesman to be next to useless, that's why I do a little research and buy what I need. The retail sales position is there to push product, not to solve problems. It blows my mind when I see friends and family chat up the salesman and be semi-sweet talked into something thats good for them, but actually costs them an extra couple hundred of dollars or has things they don't need or is missing things they'll want in the future all because they wouldnt spend 10 minutes on the internet researching the purchase or reading reviews.

    19. Re:Sure there's a place for them by pafrusurewa · · Score: 1

      Realtek cards do have their place. I always buy 8139s for home networks; they are fine for 10/100 Mbit/s environments. In my experience they break as often as 3com cards but are only EUR 5 a piece.

    20. Re:Sure there's a place for them by rikkards · · Score: 1

      Slightly offtopic.

      I was in a local mom and pop store and he was raving to this guy about getting a hardware 56k modem for his 3Ghz new machine for three times the price than a software as the software modem will affect his CPU performance.

      His point was valid... when processors were running at 200MHz!. Nowadays sure the maximum throughput of 56k worth of data that the cpu needs to deal with may affect that fraction of a percent of cpu power.

    21. Re:Sure there's a place for them by rikkards · · Score: 1

      Should have mentioned there was no bloody way he was looking to run a linux machine so for him a winmodem would more than do.

    22. Re:Sure there's a place for them by grub · · Score: 1

      Computer Boulevard is a steaming dog pile. Ever notice how they sell POS systems but don't actually use one? I asked someone about that once "Too many SKUs" he said. Riiiight. My theory is that it's done on hard-to-trace written bills to rip off the tax-man.

      I go to Computer Avenue for almost everything nowadays. Fellow there named Jason is a real nice guy and won't bullshit you. Fun to talk geek with, my gf loves going there with me :)

      --
      Trolling is a art,
    23. Re:Sure there's a place for them by Anonymous Coward · · Score: 0

      Can't let that criticism pass :-)

      Realtek cards can be golden in a lot of situations. In particular, if you're maintaining a lot of older equipment like me, the 8029AS ones are transparent in terms of drivers for all OS, (mostly auto-install no fuss) and tough physically. Generally realtek are the best bet for compatibility when onboard, handle restarts strongly, are cheap..

      Yeah the speed sucks, its not everything. If I were suggesting a card for a home/light user a realtek would be a candidate. And keep those 8029AS's they are the best ;-)

    24. Re:Sure there's a place for them by Anonymous Coward · · Score: 0

      It does have much of the TCP/IP stack on-board, including connection set-up and tear-down. But there are a few interesting questions to ask at this point. Why buy the card? For this price, I can get a pair of dual 1Gb (Intel PRO/1000) cards and distribute my network load across those ports. That does not solve my CPU load issue, but it certainly allows for traffic separation and can help load on high-end systems that bottlenecks at a PCI-bus (many high-end systems have more than one PCI bus).

      At this price, however, you may find your application better suited to abandon Ethernet and go to IP over FC. You can buy an Emulex 2Gb/s FC-AL card, for example. If you only care about small amounts of high-speed connectivity, this may be more cost effective (including infrastructure costs).

      The next step up is probably 10G Ethernet, but another alternative includes Myricom.

    25. Re:Sure there's a place for them by petermgreen · · Score: 1

      the cheap realteks seem to be cheap reliable and compatible with every linux system of whatever age that i've thrown at them out of the box.

      afaict thier only problem is they use a lot of CPU under heavy load.

      --
      note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
    26. Re:Sure there's a place for them by mendred · · Score: 1

      well it depends on the margins he's getting doesn't it? if he is getting a higher margin for the cheaper card (probably because he is buying in bulk as there is demand for that cheaper card say it costs him 7$ and he sells at 10$, he gets a 3$ margin) if the card were more expensive he might have to reduce his margin since he can't buy it at bulk as there mayn't be demand for that card (he could acquire a 19$ card and have to sell it at 20$ because no one would buy it above that price thus margin at 1$, he can't buy it at 17$ because there isn't as much demand for that card as for the 10$ one). And therefore he would push the cheaper card as he earns more per card sold

      Bharat

    27. Re:Sure there's a place for them by Swedentom · · Score: 1

      > " Just like video players today use special OS features to open a video port directly to the graphics card without routing it through the windowing system"

      Just FYI, video in Mac OS X goes through Quartz, and not straight to the video card. This is great, because it allows for taking screenshots of movies and DVDs, and having transparent windows over video. :-)

      --
      Sig Nature
    28. Re:Sure there's a place for them by infinite9 · · Score: 1

      Sheer conjecture: the card likely has a lot of the smarts onboard.

      HK, is that you?

      --
      Disconnect your television. Do your own research. Draw your own conclusions. They're probably lying. Don't be a sheep.
    29. Re:Sure there's a place for them by Anonymous Coward · · Score: 0

      ??? I don't follow.

    30. Re:Sure there's a place for them by oddfox · · Score: 1

      Most likely a reference to the HK-47 unit in the Star Wars: Knights of the Old Republic series of games. The way he speaks in the game is quite similar to how grub wrote "Sheer conjecture:" and then the rest of his statement. Really amusing character to speak with, especially when you start bothering him and he lets you know. "Exasperated statement:"

      --
      "We invented personal computing." - Bill Gates
    31. Re:Sure there's a place for them by arkanes · · Score: 1

      Nobody does this on Windows, either. Probably on Linux, using a framebuffer. Now, DirectX and Quartz do indeed talk directly to the hardware (simplified explanation, I know...), but the software talks to DX/Quartz, not the hardware. Same with games.

    32. Re:Sure there's a place for them by Swaffs · · Score: 1

      Well, you make some good points there. However, I did know what I went there to buy, but the clerk couldn't even find it for me. Also, this isn't a big box store, its a store that mostly sells OEM stuff and parts for customizing computers. Their main clientelle are people who know what they're doing. I don't think it should be too much to ask that their clerks know how to find things in their store.

      --

      --
      "Karma can only be portioned out by the cosmos." - Homer Simpson [1F10]

    33. Re:Sure there's a place for them by runderwo · · Score: 1

      The problem is that a modem is a realtime application, and general purpose operating systems and computers are notoriously bad at realtime tasks. HCF modems are somewhat better than HSP modems, because only the UART is offloaded to the CPU. When the actual signal processing is also placed on the CPU, you are inviting latency and dropped connections when the CPU gets busy doing something else. Most of the time it won't happen, but when you're doing something like playing a game where the CPU has its hands tied up doing plenty of other things, the utility of offloading even simple realtime tasks to hardware becomes clear.

    34. Re:Sure there's a place for them by runderwo · · Score: 1

      If you are running a 2.4 kernel this was a known bug (google for it).

  4. yes there is a place for it by Anonymous Coward · · Score: 3, Funny

    right inside my computer :)

  5. My Answer. by Anonymous Coward · · Score: 0

    No.

    Move along please.

    1. Re:My Answer. by Anonymous Coward · · Score: 0

      Exactly. We just learned, here on Slashdot, that stealth startups are always failures.

  6. Short answers: PHB's by Anonymous Coward · · Score: 2, Funny

    Short answer;

    Where there are PHB's, there is overpriced hardware.

  7. yes, there is by commo1 · · Score: 3, Informative

    Million dollar PCs (sans gold-plating) and (quite seriously) mission-critical blade servers, customer ip routers, etc.... I have clients that pay upwards of $600 canadian now (though that's for quad cards with ample on-board processing to off-load from cpu horsepower).

    1. Re:yes, there is by ImaLamer · · Score: 1

      But at $500, and running linux, it's like having a router in my PC. I could be wrong, but this allows me to make my media center PC a firewall and router... all kinds of stuff.

      Not that I own a media center PC - but I suspect this type of thing will catch on with the geeks if they can login to it.

    2. Re:yes, there is by ianr44 · · Score: 1

      You can do the same thing with a pair of regular NICs for a lot less money. A quick google turned up this HOWTO on the subject, I'm sure you can find plenty similar docs out there or just read man pages for the relevant packages. Have fun!

    3. Re:yes, there is by ImaLamer · · Score: 1

      I was under the impression that the cards actually ran Linux...

      Now, give me a PCI or PCI-X card that has three IP's. One to connect to from the localhost, two going out to other machines/routers/switches. Make that card a system on a chip that boot with power taken from the mainboard...

      Let me login to that card and use the command line, SSH, whatever... now we are talking a $500 card. Linux on the card with the right packages installed will let me basically put a Cisco router in my machine...

    4. Re:yes, there is by ianr44 · · Score: 1

      I was under the impression that the cards actually ran Linux...
      I'm not under that impression.

      Now, give me a PCI or PCI-X card that has three IP's. One to connect to from the localhost, two going out to other machines/routers/switches. Make that card a system on a chip that boot with power taken from the mainboard...
      I think you're confusing IPs (no apostrophe) with RJ45 jacks.

      Let me login to that card and use the command line, SSH, whatever... now we are talking a $500 card. Linux on the card with the right packages installed will let me basically put a Cisco router in my machine...

      These cards are serious overkill for average home use, they're made to move insane amounts of data around without needlessly troubling the CPU with networking details. Everything you're looking to do can be accomplished by having a pair (or more) of regular old NICs in any old computer and setting up the OS accordingly. People do it all the time, you can easily put together the entire system for well under $500 and have features well beyond what you've listed (toss in server type stuff, home automation, whatever.) Want an even cheaper solution? Grab a Linksys WRT54G(s) and put whatever software you want on it- that's what I did and it works beautifully!

    5. Re:yes, there is by Blastrogath · · Score: 1

      Now, give me a PCI or PCI-X card that has three IP's. One to connect to from the localhost, two going out to other machines/routers/switches. Make that card a system on a chip that boot with power taken from the mainboard...
      >I think you're confusing IPs (no apostrophe) with RJ45 jacks.

      I think you are: 2 rj45s, 3 IPs. 1 for each of the card's rj45 ports and 1 for the PC. It probably would be good to have it be selectable which rj45 port the PC shares with the card. Have the card be a full but small server focused on routing.

      The parrent could also possibly have meant having the PC talk to the card over an internal equivilent of a crossover cable, but that'd probably mean using NAT for the IPs, and regardless it's then 4 IPs and 2 rj45s.

      --
      "The price good men pay for indifference to public affairs is to be ruled by evil men." -Plato
    6. Re:yes, there is by swb · · Score: 1

      Didn't somebody make a hardware (own CPU) Firewall on a PCI card at one time?

      I guess ideally what you'd like a system on a PCI card with 4x NICs.

    7. Re:yes, there is by ianr44 · · Score: 1

      So maybe I misunderstood the OP about RJ45/IP, maybe I didn't. Regardless, we're not talking about a server on a card here. This is a fast network card that handles part of the networking stack onboard rather than having the CPU deal with everything. Cool? yes, but not a new concept. Worth $500 to someone for a home router? No way, you can do the same thing the OP was describing (fancy home router/firewall) for a LOT less money with junk bin components.

    8. Re:yes, there is by Blastrogath · · Score: 1

      I'm not sure that even junk bin components are cheaper than a purchased router unless your time is free, and regardless of that you end up with a 2nd full PC cluttering up your desk. But people will pay a lot for gagetry, sometimes even more than it's worth. I doubt it's worth $500 even for the purpose it's designed for. But like the OP said, a full PC on a card? That I could see spending a few hundred dollars on.

      --
      "The price good men pay for indifference to public affairs is to be ruled by evil men." -Plato
  8. What good is such a fast Ethernet card... by kc32 · · Score: 1, Insightful

    if your internet connection is anything less than fiber, which is about 99.9% of all connections? Not to mention the fact that not many computers can actually handle that much data at once anyway.

    1. Re:What good is such a fast Ethernet card... by MonoNexo · · Score: 1

      If you RTFA, you'll figure out this is not currently targeting Average Joe with his Dell computer - they are talking to servers, workload clusters, etc. In that case, there is a use for "such a fast Ethernet card".

    2. Re:What good is such a fast Ethernet card... by Jimbookis · · Score: 0, Offtopic
      If you RTFA...

      You must be new here.

    3. Re:What good is such a fast Ethernet card... by MonoNexo · · Score: 1

      Not that new, but nieve never-the-less.

    4. Re:What good is such a fast Ethernet card... by djdavetrouble · · Score: 1

      if your internet connection is anything less than fiber
      um,
      you _do_ know that people use networks without having to connect to the 'internet', right ? Some type of real time type database thingy like a stock market or a really kick ass low latency lan party. In conclusion, yes there is a place for a $500 whachacallit, card.

      --
      music lover since 1969
    5. Re:What good is such a fast Ethernet card... by Phroggy · · Score: 3, Insightful

      if your internet connection is anything less than fiber, which is about 99.9% of all connections?

      The other 0.1%, obviously.

      --
      $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
      $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
    6. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 5, Insightful

      if your internet connection is anything less than fiber, which is about 99.9% of all connections? Not to mention the fact that not many computers can actually handle that much data at once anyway

      Listen, when I've got 30 web servers banging away on a single database server, I want each web server in and out as quickly as possible. Every bit of the handshake, query, and results is going to wrap up that much faster if things are faster, period. When you're dealing with a huge data-driven e-commerce site, where every page renders around a hundred or more queries, and there are dozens or hundreds of concurrent page views, this stuff really counts in the aggregate.

      If you sell one more widget per day, all year long, because your web presentation layer is just a little more snappy, that's sure as hell going to pay for a $500 NIC.

      --
      Don't disappoint your bird dog. Go to the range.
    7. Re:What good is such a fast Ethernet card... by njcoder · · Score: 4, Insightful
      " When you're dealing with a huge data-driven e-commerce site, where every page renders around a hundred or more queries, "

      Each page renders a hundred or more queries? Sounds like you're better off investing in a better design than better hardware.

    8. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      when I've got 30 web servers banging away on a single database server

      Sounds like your database server is in the critical path, not your webservers.

    9. Re:What good is such a fast Ethernet card... by grub · · Score: 1

      The cards are running gigabit. What type of physical stuff your layer 1 is is irrelevant and you still have the speed hits associated with ethernet and IP above that.

      --
      Trolling is a art,
    10. Re:What good is such a fast Ethernet card... by llZENll · · Score: 1

      Perhaps, but I doubt that 1 sale per day will offset the costs you will incure to set it up properly, maintain it, and get a backup quickly when your network card crashes, or when joe hacker finds a security exploit in the card somewhere.

    11. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 1, Informative

      Each page renders a hundred or more queries? Sounds like you're better off investing in a better design than better hardware.

      It's a farm of servers that looks at incoming requests and renders the pages based on the host header name. The same boxes might be serving up transactional content for a couple dozen businesses off of a common code base, with all of them having wildly different look/feel and behavior. Much of what differentiates one merchant's presentation from another is data driven, to say nothing of a page that must pre-calculate municipal tax rates for each of maybe a hundred different types of items on an order, take into account the shopper's account status, order history, affiliate referals... to say nothing of real-time inventory availability checked on every page load, multi-language and currency behavior, intrusion and fraud detection, item kitting, etc. Grabbing a hundred scraps of data from the underlying database (including session management, and all sorts of other housekeeping, including writes traffic logging) is actually pretty minimal when you consider what it's all doing.

      Add on top of that the layers that have to monitor all of that activity for the company that's running all of this for those merchants (and reporting to them on traffic, visitor search behavior in real time, and so on) and you'll see what I mean. So, sure, slightly faster 1GB ethernet cards can definately help out. Would a few slightly better designed stored procedures help? Maybe a tiny bit. But really complex online selling through a managed service with lots of users... there's a certain amount of complexity that can't be designed away.

      --
      Don't disappoint your bird dog. Go to the range.
    12. Re:What good is such a fast Ethernet card... by cujo_1111 · · Score: 2, Funny

      And you can't spell, you will fit right in...

      --
      If I point out that you are incorrect, making me a foe does not make you any more correct.
    13. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 1

      Sounds like your database server is in the critical path, not your webservers.

      Well, sure. The database is the most critical thing. It performs find, as will its hot standby if it pukes. The point of my comment is that we're doing business on the rig in question, and if the web servers can have a marginally faster conversation with the database server(s), then that's a good thing. When you're handling thousands of orders a day through the system, even a few people wandering off because a page is a little sluggish is something worth spending some money on.

      --
      Don't disappoint your bird dog. Go to the range.
    14. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 1

      Perhaps, but I doubt that 1 sale per day will offset the costs you will incure to set it up properly, maintain it, and get a backup quickly when your network card crashes, or when joe hacker finds a security exploit in the card somewhere.

      I can't comment on the product in question, just on the notion of faster interaction between the front and back ends of the system. Faster is always better.

      As for selling more widgets... a typical transaction (in the case of the system I'm talking about, here) can range from perhaps $100 to $5000. So, if we can land 10 or 20 more of a set of those transactions, we're talking about a noticeable difference. Certainly enough to pay for swapping out a NIC. If the product is crap, of course, or a pain in the ass to actually put to work, well, I wouldn't do it any farther than the workbench.

      --
      Don't disappoint your bird dog. Go to the range.
    15. Re:What good is such a fast Ethernet card... by njcoder · · Score: 1

      I'm assuming you're doing it in PHP then?

    16. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 1

      I'm assuming you're doing it in PHP then

      Nope. All multi-tier MS stuff running on IIS, talking to SQL Server. Start the bash if you want, but it takes a punishing amount of traffic, can be administered by a single person with many other responsibilities, hasn't been cracked, and is making both those of us who run/sell it, and the merchants using it, a living. And I've got my pick of a huge army of coders, admins, analysts, content specialists, etc., who can walk right up to the platform and pitch in on changes, given its complete familiarity.

      We're working on another flavor of it, and it may be *nix-powered, but that remains to be seen. We've had the current version doing business for 5 years, now - it started back in old timey ASP days, almost as a lark, and have been evolving since.

      --
      Don't disappoint your bird dog. Go to the range.
    17. Re:What good is such a fast Ethernet card... by jbplou · · Score: 1

      Internet connection is not the only way someone connects, connections on the lan in a large corporate network. Now that said I still find no place for this card.

    18. Re:What good is such a fast Ethernet card... by HardCase · · Score: 1

      If you sell one more widget per day, all year long, because your web presentation layer is just a little more snappy, that's sure as hell going to pay for a $500 NIC.

      Only if your profit on the widgets is at least $1.37. Heheh.

    19. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 1

      Only if your profit on the widgets is at least $1.37. Heheh.

      Well, we actually lose $2 per sale, but we're going to make up for it in volume. We're so dot-commy!

      Kidding. Some sales are $1000+ with 15-25% margin, so you betcha that a sale or two more every day at least partly driven by better performance is worth chasing.

      --
      Don't disappoint your bird dog. Go to the range.
    20. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      Always some fuckhead has to take a pretty simple example and inject a smartass comment.

      That person is now you.

    21. Re:What good is such a fast Ethernet card... by njcoder · · Score: 2, Interesting
      asp on iis 5 years ago, ok, that makes sense too.

      Not trying to knock your design if it works it works. Since you're working on another flavor of it, let me give you my opinion on what I would have done differently. I've worked on webapps like this in java, not sure if you could do the same in php or asp.net. For something like this I would go with Java from my experience with it and also doing PHP. Whatever you do it in this advice might be helpful.

      Your merchant info.... This probably doesn't get updated every day so you can cache it on an application level and let the cache refresh itself in a smart way when there are updates. You can do the same on a per session basis with shopper info. Sounds like your tax logic can be streamlined a bit as well. You might want to think of havinga seperate process that does the tax and can keep a cache of all the information, that way you don't have to hit the database for each item like it sounds you're doing now. Most of your logging probably doesn't have to be done in real time to the database. Or even in the database at all. There are ways to link your application logic with the webservers logging mechanism. The webserver usually does it in a smarter way, then you aggregate that info on a regular basis. If that doesn't work for you try asynchronous logging. Start up a seperate thread that writes to the log. That way the user doesn't have to wait for the logging to finish. Also caching the logs locally and then aggregating it even every minute or so on a heavy site should increase network and db performance since a few larger writes are faster than a lot of smaller ones. Even with everything you mentioned I don't see how you can have a hundred or more queries per page. I'm thinking at most 5-10 queries per page will get you all of what you need to display products, cross reference products/specials, and a bunch of other stuff. Your checkout pages might need a little more because you'll want to make sure you get fresh data from the database even though a good caching method shouldn't require it. Doesn't hurt to play it safe when the money actually trades hands. Your datamodel might need some going over as well.

      You might want to add some more ram to handle the extra caching and there are many open source distributed caching tools that make it easy. OSCache is good for Java apps, memcached is in C but can be used with other languages including PHP and Java and I think ASP?

      Since you're thinking of doing another version of it, you might want to consider these things, and probably more. Hard to say concretely without knowing much more. YOu can probably cut down on your hardware too. A site like hotornot.com, which is granted a lot simpler can serve up about 20 million pages a day across I think 50 servers. If you have a strong DB with 30 front end webservers (assuming you got them all 5 years ago and they're standard issue type webservers) I would expect a well designed, complex e-commerce site to be able to handle around 6-9 million page views a day with good response times easily. That's trying to be conservative too considering what you said.

      Getting this NICs for 30something servers is going to run you between 10-15k depending where the volume discount sits in. Like I said I don't know your whole system but that money being spent so you're pages don't hit the database 100 or more times per page should do more for you than these cards. That's my long answer so you don't think I was just being flippant.

    22. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      What everybody is saying is that latency to the database is the bottleneck, not CPU usage due to huge bandwidth. You should be caching smarter.

      My guess is that if you run top on your webservers, CPU usage will be low. This network card will not solve your problems.

    23. Re:What good is such a fast Ethernet card... by AngryElmo · · Score: 1

      Have you looked at Sybase Replication Server which allows low-latency, "realtime" replication of data between various DBMS platforms (Sybase, MSSQL, Oracle, DB2 etc). Might be useful in allowing you to spread the load for certain categories of data. It is certainly useful in a hot/warm redundant failover server scenario.

      Sybase replication Server Home

    24. Re:What good is such a fast Ethernet card... by truesaer · · Score: 2, Insightful

      Not only that, but you set up your internal network to operate at gigabit speeds, can't you? There is more to the network than the connection to the public internet even for those who don't have a fiber connection.

    25. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      Posting anonymous, since this is going way off-topic. In fact, I have mod points right now, and would gladly mod you up "informative", but your post is specific to its parent, and not directly relevant to the overall topic.

      Herein, I recount an anecdote of my own about transferring load from overworked databases to underworked app servers.

      A few years back, while I was still at university, I got a summer job at a dot-com, which failed a few months after I started. (They were living day to day off venture capital, and it pretty much dried up. Interestingly, everyone was told we were closing up shop on September 12th, 2001, though the decision had been made once and for all a week earlier, which goes to show that the dot-com bubble burst was a distinct event which really started to build up steam in early 2001. Luckily for me, I just turned around and went back to school with the money I had saved up over the Summer. I felt really bad for my coworkers who had just decided to buy houses, since interest rates had finally started to drop.) We may have been able to stay afloat, had our major client been willing to commit to a long-term contract. Unfortunately, they were concerned that our web application might not be scalable enough to accommodate their full load (since it was starting to choke under their half-company pilot project).

      Not long after I started, I was given the following vague task: "Our software slows down under heavy load. Fix it." So, after doing some profiling (which was awkward, since we were using a proprietary app server), I managed to find a number of database queries which were major performance bottlenecks. Nearly 75% of our run time (under moderate load) was spent blocking on DB queries to look up information which changed maybe once per month. So, I set up an application-level cache for that data. Then, I went into the update apps for this data, and added one line to say "When you update, send a quick signal to our main webapps to tell them that this material is dirty." The overall change in code was only about 201 lines. (200 lines to implement the application-level caching, and 1 line to taint the cache.) Had we not been using such a nasty proprietary app server, I could probably have just used some existing cache infrastructure. As is, I just implemented a class which encapsulated a HashMap, along with some way of tainting the data (which I think may have actually just involved removing that element, and all those which depended on it, from the HashMap).

      The moral of the story is that you can potentially keep a company from going under just by migrating less-frequently updated data to the application servers, with appropriate caching.

    26. Re:What good is such a fast Ethernet card... by njcoder · · Score: 1

      Hmm... 2001.. most of the appservers from that time are out of business or have significantly improved. Ccurious which one you used. Back then I think you even had to code your own connection pooling in some cases. I still have my connection pooling code somewhere. Not suprised about the cachinig.

    27. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      Hmm... apparently, they are not out of business yet. Still, the company I worked for started using them since they offered a VB-based appserver. By the time I got there, most of the code had been migrated to Java (after they added Java support and Java/VB datatype translation).

      Over the past few years, I've seen numerous libraries appear which would have made the caching I implemented redundant. Sigh...

      I still take pride in the native Java (single-threaded) profiling I implemented that Summer. I used jacc, I think (a Java implementation of yacc), along with an Ant method to apply my pre-compilation to every method in every class in our library. It would insert a call to my static Profiler class to output <method name="%method name%"><starttag start_time="%start_time%" /> at the start of every method invocation, and <endtag end_time="%end_time%"/></method> at the end of every method invocation (whether the method ended with a "return" statement xor the end of the method definition). The resulting XML output could be read into one of the many XML tree viewers to get a nice hierarchical view of the call structure of the program. By comparing the start and end times, I could assess whether or not to dig deeper into the call hierarchy.

    28. Re:What good is such a fast Ethernet card... by dlippolt · · Score: 1

      I'm sure you know this and were just generalizing, but often times in horizontally scaled applications its the needless and dizzyingly large number of tcp/jdbc/etc. handshakes that kill the database host.

      persistent database connections (pools) help alot here.

      http://dev.mysql.com/tech-resources/articles/conne ction_pooling_with_connectorj.html

    29. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      scrap the 30 servers, $500 dollar ether cards.
      I got a amd 500 that should handle that load np.

      of course you need to scrap the ms stuff also.

    30. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      No, you don't need fiber for having GigE, ordinary copper works quite well thank you.

    31. Re:What good is such a fast Ethernet card... by vjsd1 · · Score: 1
      You should atleast read the referenced article before posting.

      If you were to read the article, it would be clear that this is being sold in to the HPC (i..e grid/cluster computing) market. The referenced customer was talking about deploying this in a 512-node cluster.

      In HPC environments, 300 bucks a node is peanuts. And of course they have fiber-optic interconnects.

    32. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      Contrary.. it could be an excellent design. It could be the best possible way to design it with current tools. You can't make that judgement without knowing the problem.... It's amazing this comment is modded up. ;-(

    33. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0

      Would a few slightly better designed stored procedures help? Maybe a tiny bit.

      I would look into using hibernate with some sort of caching routine, like ehcache. Don't design a caching routine yourself.

      Just doing that would save hundreds of hits to the database.

    34. Re:What good is such a fast Ethernet card... by chrysalis · · Score: 1

      If each page needs around a hundred or more queries, your application was very badly designed.

      You need to use caches, like Smarty, PEAR::Cache, AdoDB cache or Skycache.

      --
      {{.sig}}
    35. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 1

      Thanks for the thoughtful response. You know how it goes: and architecture gets into a groove years before you know where it's really going to wind up... these things tend to grow organically. That being said, a lot of the cache-related (especially app-level) things you mention are in various stages of use, with more coming. It's really amazing how much optimization you can do, without changing the general architecture, if you look at the code again, and again, and again. We're still bumping into things that just seemed like no big deal several million records ago, but which now are, indeed Very Big Deals, performance-wise. The real lesson here is about being honest about how much scalability you're likely to need. On the other hand, if you budget to develop something on the expectation of huge operations, and in doing so eat up so much cash (on dev and platform) that you kill the business unit you're trying to launch, then that's no good either. Always the balancing act!

      --
      Don't disappoint your bird dog. Go to the range.
    36. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 1

      If each page needs around a hundred or more queries, your application was very badly designed.

      That's a pretty absolute conclusion to draw without your really knowing much about the nature of the data that's being pulled, how often it's changing, or what sort of business logic drives the aging (or not) of any of the data. More caching would be nice, but we've got it pretty well optimized. I'm guessing you've never built a business-to-business site that has to look at real-time inventory (to the second, not the minute), and which has to re-evaluate every aspect of every page (which might be displaying dozens of items) based on the current conditions of every other item, including the user's history, account status, and what other users on the account might be doing right that moment. Rendering a given page can involve over 1200 pieces of information, so grabbing only 100 of them from a database is pretty damn good.

      Oh: and the whole thing is completely load balanced... so the user could be getting different pieces of different page views from different servers. That means trusting the database, not a local cache, for pretty much anything dynamic.

      --
      Don't disappoint your bird dog. Go to the range.
    37. Re:What good is such a fast Ethernet card... by ScentCone · · Score: 1

      Have you looked at Sybase Replication Server which allows low-latency, "realtime" replication of data between various DBMS platforms (Sybase, MSSQL, Oracle, DB2 etc).

      Haven't, no. Though I will. Part of the mandate has been to, as much as possible, keep the O/S, and everything running on it (other than scripts and the custom commerce app) totally vanilla MS. Introducing third party pieces to the puzzle can give some management and admin people hives, as you know. But, that's a lot better than down time or a suckingly slow web site, that's for sure.

      --
      Don't disappoint your bird dog. Go to the range.
    38. Re:What good is such a fast Ethernet card... by njcoder · · Score: 1

      The important thing is you got it going andd are making a profit.

    39. Re:What good is such a fast Ethernet card... by Anonymous Coward · · Score: 0
      Sounds like you're better off investing in a better design than better hardware.
      It's a farm of servers that looks at incoming requests and renders the pages based on the host header name. The same boxes might be serving up transactional content for a couple dozen businesses off of a common code base, with all of them having wildly different look/feel and behavior. Much of what differentiates one merchant's presentation from another is data driven, to say nothing of a page that must pre-calculate municipal tax rates for each of maybe a hundred different types of items on an order, take into account the shopper's account status, order history, affiliate referals... to say nothing of real-time inventory availability checked on every page load, multi-language and currency behavior, intrusion and fraud detection, item kitting, etc.

      So in other words, "Yes, that's exactly right."
  9. latency by j_dot_bomb · · Score: 1

    They mention latency without saying what it is in the press release. I couldnt find it on the site. Maybe the tech docs have it. They compare it to Myrinet without saying what the latency is. It could be great. It could be crap.

    1. Re:latency by chill · · Score: 1

      From their website:

      Low Latency - EtherFabric provides sub-10 usec (micro-second) latencies between application instances on different servers, improving application-to-application inter-server communication by 3-5x over conventional Ethernet.

      http://www.level5networks.com/prod_etherfabric.htm

      --
      Learning HOW to think is more important than learning WHAT to think.
    2. Re:latency by Kent+Recal · · Score: 1

      10usec?

      Man, gimme a baseball bat and I'll route them packets myself!

  10. These things will be commonplace in the future... by bigmanjq · · Score: 1

    They may even be integrated onto the motherboard and cost very little, relative to what we pay for standard onboard ethernet today. That is, if the technology is as good as advertised. If not, it will fade away from the memory of /.ers everwhere. The market will justify whether it is a quality product and worth the money. If it is, it will be mass-produced, competition will increase, and prices will fall!

  11. Specific acceleration cards nothing new by Sv-Manowar · · Score: 2, Insightful

    This isn't exactly an entirely new concept. Intel have been selling their ethernet chips with built in SSL accelerators for quite some time, and the advantage of offloading duties from the software to the hardware (see Intel etherexpress vs RealTek style cards) is obvious. Whether these cards offload enough of the normal duties of a typical cluster node to be worthwhile should be interesting to see, as there are a wide variety of cluster load types and obviously these cards will have a niche to fit into alongside their competitors in the diverse set of demands around cluster networks. As for the price tag, I seem to remember gigabit cards being extremely expensive a few years back, and its probably pretty competitive with where they're aiming this product, alongside myrinet and infiniband.

    1. Re:Specific acceleration cards nothing new by evilviper · · Score: 1

      I agree with you. Most people here just don't seem to realize $500 cards wouldn't just be competing with $10 Realtek cards.

      Besides the clustering technologies, this could potentially get into the SAN market. Fibre Channel and the like are quite expensive, and could be removed if NICs could provide the same throughput with little resources.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  12. Knock-Offs by randomErr · · Score: 4, Insightful

    I give Realtek 6 months tops to make thier own knock-off of the card for $24.95.

    --
    You say things that offend me and I can deal with it. Can you?
    1. Re:Knock-Offs by evilviper · · Score: 1
      I give Realtek 6 months tops to make thier own knock-off of the card for $24.95.

      Are you kidding? This card is extremely low CPU utilization, low latency, etc. That's the exact opposite of everything Realtek has ever made.

      3com might make a similar card (they already have NICs with hardware encoding/IPSec chipsets on them) but it would surely cost just as much.

      The only possibilities I see are Linksys and Intel (who really make good NICs that don't drag your machine down), and neither is going to be nearly that cheap.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    2. Re:Knock-Offs by QuickFox · · Score: 1

      Are you kidding?

      Yes, [s]he is. Laugh.

      --
      Terrorists can't threaten a country's freedom and democracy. Only lawmakers and voters can do that.
    3. Re:Knock-Offs by evilviper · · Score: 1

      Ah hah... It was the "Insightful" mod and the lack of humor in the post that confused me... ;-)

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    4. Re:Knock-Offs by QuickFox · · Score: 1

      Heh! Never let moderations guide you! Especially today -- today seems to be an exceptionally clueless moderation day (currently rated "Informative"). :-D

      --
      Terrorists can't threaten a country's freedom and democracy. Only lawmakers and voters can do that.
    5. Re:Knock-Offs by Anonymous Coward · · Score: 0

      I think the point of that post is that each of those links goes to Amazon.com. Which, considering Amazon.com is a huge retailer, and has a huge amount of ethernet traffic, I think this comment makes sense, and I could certainly see it being moderated informative.

    6. Re:Knock-Offs by geekoid · · Score: 1

      the lack of humor was not in the post...

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  13. I doubt by Anonymous Coward · · Score: 0

    Frankly, now even moderately priced Ethernet card do at least some TCP Offload and buffering. I was surprised to see that the Marvell Yukon PCIe onboard chip on my new consumer motherboard did it.. Even on a seriously loaded server, I mean the kind of server that can output 1.8 Gbit/sec over a bonded link using samba, there isnt that much load on the CPU.

    This is the kind of product that is very cool, that was built by engineers without looking at the market needs. I would have no pity piting it against a good network card like an Intel, 3Com or Tigon3 and it would be VERY VERY hard to justify the price difference. At that kind of price, you can get myrinet which will get you a different kind of performance (2.4Gpbs per link.. up to 2 per card internally bonded .. and latency mesured in microseconds, not milliseconds..)

  14. Is There a Place for a $500 Ethernet Card? by Anonymous Coward · · Score: 1, Insightful

    The Pentagon.

  15. I think there is definately a market for this... by Famanoran · · Score: 5, Insightful

    But not necessarily where the vendors think it is.

    Back when I was working at a startup developing anti-DDoS technology, one of the biggest problems we were faced when implemented GigE, was the load on the PCI bus. (This was before we started using PCI-X).

    It depends on exactly how customisable the network card software is, but if you could plonk a couple of those into whatever system you wanted - and if the cards themselves could do, say, signature detection of various flood types, or basic analysis of traffic trends then that is a very definite market.

    I realise the core issue is not addressed (if your physical pipe is full, then you're fucked), but it takes the load of dropping the malicious packets off the host CPU so it can attempt to service whatever valid traffic actually gets through.

    And then there is IP fragmentation. Bad fragments? Perhaps a dodgy fragmentation implementation in the stack? (you know which OS I mean) Lets just drop that before the host sees it and crashes.

    I don't know, I can't find any real information describing what they do, but I can certainly see uses for this.

  16. NCP by sysadmn · · Score: 1

    Wonder how if differs from Sun's Network Coprocessor, which used an onboard 16 MHz M68000 to offload TCP packet processing from the mighty 40 MHz SPARC processors in an SS690. Sounds like the Level 5 company's product (not Level 3, as the intro implies) also includes "improved" networking protocols that are supposed to be compatible.

    --
    Envy my 5 digit Slashdot User ID!
  17. Linux before Windows by mepperpint · · Score: 3, Interesting

    It's nice to see a piece of hardware that ships with linux drivers and promises Windows support later. So frequently applications and hardware are first supported under Windows and occasionally ported to other platforms.

    1. Re:Linux before Windows by E-Rock · · Score: 1

      Unfortunately is on a product that may not have any market. :(

    2. Re:Linux before Windows by jpardey · · Score: 1

      I would think that high end equipment would be supported on *nix before windows. I doubt that ISPs or web hosts use windows for very high traffic sites that often. The largest of the local ISPs in my region (excluding Telus, not local) has red hat for its 250 mbps connections.

      What suprieses me is that other Unix drivers are not released at the same time as the Linux ones. Or is BSD dead?

      --
      I have freaks! I did something right...
    3. Re:Linux before Windows by Liquid+Len · · Score: 1

      It's nice to see a piece of hardware that ships with linux drivers and promises Windows support later. So frequently applications and hardware are first supported under Windows and occasionally ported to other platforms.
      I don't think the fact that an overpriced piece of equipment comes with linux drivers before windows drivers is going to do any good to the linux marketshare. I'd even say the best that could happen is no harm.

    4. Re:Linux before Windows by Kz · · Score: 1

      Like the http://coraid.com/ boxes?

      --
      -Kz-
  18. High Performance Computing applications by Anonymous Coward · · Score: 0

    The big place this will be beneficial is high performance computing solutions that currently use low latency application networks like Myrinet or Infiniband. By offloading the networking to the NIC, you free the CPU from having to handle the traffic and actually crunch numbers. Also, it allows you to use commodity gigabit switches rather than specialized, low volume Infiniband or Myrinet switches.

    It would take a 4GHz processor to process the data involved in a 10Gb connection without this offload technology...THAT is why there is room for $500 network card.

  19. Apple fiber by a_greer2005 · · Score: 1

    Apple has fiber NICs as an option in the G5 Powermac, they are $500 and if none were noving, they likly would ditch them or lower the price...

    1. Re:Apple fiber by Anonymous Coward · · Score: 0

      Correction, Apple has 2Gb Fibre Channel HBA's they offer for $500. There is a difference. If it makes you feel any better, I believe they include support for TCP/IP in addition to SCSI over Fibre Channel. FYI - Fiber refers to optical only, Fibre can mean optical or copper. The Apple HBA's ship with copper cables but you can use 2Gb SFP's and fiber cable with them as well.

    2. Re:Apple fiber by Anonymous Coward · · Score: 0

      And what does that have to do with anything? Fiber HBAs and NICs have been available for years on almost every platform.

    3. Re:Apple fiber by Anonymous Coward · · Score: 0

      he was probably talking in reference to the price point ("is there a place for a $500 ethernet card?" -> "well $500 networking cards already exist")

  20. A network card for gamers too? by Anonymous Coward · · Score: 0

    So I wonder how this compares to this product by Bigfoot Networks. They won the moot corp contest, but it seems like someone beat them to it. They seem to want to make a network card like this, but for gamers. It seems like a similarly awful idea to me.

    1. Re:A network card for gamers too? by DigiShaman · · Score: 2, Informative

      Pfffttt...please!

      All the TCP/IP acceleration isn't going to do you jack shit if the server is running like crap. Also, you will need a good gigabit switch or router with CAT6 in place to remotely take advantage of this new NIC.

      Basic rule of thumb still applies. "Your fastest connection is your slowest link"

      --
      Life is not for the lazy.
    2. Re:A network card for gamers too? by Anonymous Coward · · Score: 0

      Off topic but along the same lines...

      Just like the audiophiles that pay more then $300 for a power cable for their equipment because it sounds better. I find that really odd considering that power came from probably a minimum of 50 miles away at the power plant and ran through transformer after transformer, into your house, through your circuit box and into the wall in your room over plain old copper wire. How that last three feet from the wall to the piece of equipment and final connection makes such a difference is beyond me. I guess those that get power from coal fired power plants can notice a "warmer" sound then those with nuclear powered plants. After all, the gamma and beta energy that gets into the electrical distribution system from the nuclear plants throws off the tonal balance.

    3. Re:A network card for gamers too? by Sj0 · · Score: 2, Insightful

      It's just like people who see gold ends on something and figure it's the automatic winner in any contest.

      Never mind that using gold connectors and non-gold connectors together causes corrosion. :P

      --
      It's been a long time.
  21. A rose by any other name... by Ingolfke · · Score: 4, Insightful

    The name Level 5 refers to the network protocol stack where level 5 delivers data from the network to the application, according to Karr. The company isn't concerned about any potential confusion with Internet Protocol telecom Level 3 Communications Inc. On the contrary, he quipped, "It's working in our favor. People say, 'Yes, we've heard of you. You're a big company.'"

    As lawyers at Level 3 begin salivating at thought of all of the potential lawsuits.

    1. Re:A rose by any other name... by KieranElby · · Score: 1

      Call me a geek, but the first company I thought of was Level 9 Computing ...

    2. Re:A rose by any other name... by Leers · · Score: 3, Funny

      "As lawyers at Level 3 begin salivating at thought of all of the potential lawsuits."

      Actually, salivation does not come till Level 8. However, at Level 3 you do get "Detect Potential Lawsuit." Don't worry, once you hit Level 3 you'll be a Level 8 in no time.

    3. Re:A rose by any other name... by geminidomino · · Score: 1

      Given the spammy, worm-ridden clusterfuck that is L3, I'd say these guys could probably come up with a countersuit for "damage to their good reputation" or something...

      All depends on how slimy both sides' lawyers are, I guess.

    4. Re:A rose by any other name... by Anonymous Coward · · Score: 0

      The first company I thought of was Level One - they make Realtek-based network cards.

    5. Re:A rose by any other name... by sootman · · Score: 1

      Ah yes... nothing I hate more than companies glomming onto a closely related technical term as their name... just as bad as Gigabyte motherboards or a jewelry company called "999 Fine."

      --
      Dear Slashdot: next time you want to mess with the site, add a rich-text editor for comments.
    6. Re:A rose by any other name... by tedhiltonhead · · Score: 1

      ...which is wrong. In the TCP/IP model, it's "Layer 5", not "Level 5". I was initially tricked into thinking of Level 3 when I saw their company name. I hope they have good trademark lawyers.

  22. Deja Vu Mainframe days by justsomecomputerguy · · Score: 2, Interesting

    Back in the early-mid 80's (and probably even before then) IBM mainframes using SNA instead of TCPIP used special networking processors that handled all of that "networking stuff" so that the mainframe CPU (which really was a "unit" and not just a single chip) could just concentrate on running its jobs and not be interrupted by the communications end of things. Everything old is new again. Same situation, just smaller and faster (CPU and helper communications card take up 1U in a rack instead of 1 whole corner of the head end room).

    1. Re:Deja Vu Mainframe days by AngryElmo · · Score: 1

      FEP or Front End Processors are what you are thinking about I suspect...

    2. Re:Deja Vu Mainframe days by justsomecomputerguy · · Score: 1

      Thanks. I was really trying to remember the exact term FEP, couldn't, and tried to get away without actually naming them. So, do you think I'm right or just reaching in using this as an example of everyting old is new again?

    3. Re:Deja Vu Mainframe days by AngryElmo · · Score: 1

      Yes and no. Whilst a FEP is indeed intended to reduce the load on "expensive" mainframe CPU's it went far beyond merely a communication protocol accelerator. FEPs had to be programmed for the particular network structure using NCP (Network Control Program) to achieve this offload. They also performed routing and polling of devices (amongst other things).

      So a FEP did more than the product being discussed, but it was more complex to configure. Whereas this promises more plug 'n' play type functionality for TCP/IP hosts.

      Of course I'm talking from memory here, so I my have missed something critical in the differences.

    4. Re:Deja Vu Mainframe days by hey! · · Score: 0

      so that the mainframe CPU ... could just concentrate on running its jobs and not be interrupted by the communications end of things.

      You've just described my ideal job.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    5. Re:Deja Vu Mainframe days by Jayfar · · Score: 1

      Further back than that I think. In the 60s the IBM 360 had Channels and Control Data mainframes had Peripheral Data Processors.

  23. There is a place in an NFS environment by crusty_architect · · Score: 4, Insightful

    We use Filers for storage at Gigabit speeds. Compared to our SAN/FC evironments, we see much higher CPU utilisation on our Sol 8 boxes, especially when attempting to get to Gigibit speeds.

    1. Re:There is a place in an NFS environment by rodac · · Score: 1

      SAN does not share and but can cache data on clients.

      NAS can share but can not cache on clients.

      So exactly why is it surprising that NAS access requires more resources than SAN ?

    2. Re:There is a place in an NFS environment by Big+Jason · · Score: 1

      We found performance to be so abhorrent with our Filers and Sun boxen, that we are making the switch to SAN. Of course, my company cheaped out on their NAS implementation so maybe that's to blame.

  24. sorry, no by dangermen · · Score: 1

    Sorry, no. Intel and Broadcom have this sewn up. Why would we want to have to put ANOTHER network card driver through its paces?

  25. Day late and a dollar short. by Anonymous Coward · · Score: 0

    InfiniBand is the answer for whatever problem this is attempting to solve.

  26. It is less import today then it was 10 years ago. by jellomizer · · Score: 3, Insightful

    $500 for a network card you have to have a good reason that you will need it. I am sure there are applications that will utilize it but for the price it may not be worth it. With sub $500 computers coming to age. It is probably cheaper just to split all your services onto smaller boxen and have a load balancing switch/router. Computers are cheap today $500 for a network card is steep and will only fill a niche market. Perhaps if the price was in the $50 range it would be more widely accepted. But with good enough systems at 1k and additional 500 could be used for a faster CPU other then a faster network CPU

    --
    If something is so important that you feel the need to post it on the internet... It probably isn't that important.
  27. $100 razors; blades are extra by Doc+Ruby · · Score: 1

    How about they sell it for $100, when you buy the $600:year remote network admin package? Premium packages can include live security monitoring by companies like Counterpane. If you've got a need for network performance like that offered by these cards, you've got a need for sysadmin, including security. Or you've just got too much money.

    --

    --
    make install -not war

    1. Re:$100 razors; blades are extra by Anonymous Coward · · Score: 0

      Or how about no.

      You'll get root on my box when you pry the halon test key from my cold, dead fingers, mmm k?

    2. Re:$100 razors; blades are extra by Doc+Ruby · · Score: 1

      No, you'd pay your $700 for the package, including the support contract. The "$100" is only the itemization for the HW, inside the bundle. If you buy it without the bundle, you pay $500 for the unsubsidized HW.

      --

      --
      make install -not war

    3. Re:$100 razors; blades are extra by Doc+Ruby · · Score: 1

      Of course your box, and its network peers, lack any network security holes. Because you and your key are better than the Counterpane team, right?

      --

      --
      make install -not war

    4. Re:$100 razors; blades are extra by geminidomino · · Score: 1

      Because you and your key are better than the Counterpane team, right

      Well, I can agree with him on one thing... I'm definitely better than them in that I personally know me, so I can trust me with root. :)

    5. Re:$100 razors; blades are extra by Doc+Ruby · · Score: 1

      There's more to trust than intimate knowledge. Competence, for example. While some degree of intimacy is required, there's little return past that threshold. While the open-ended nature of the threat against which you retain the other party means that the degree of competence, given the adequate intimacy, varies directly with the potential threat. That is, the more competent, the better - while intimacy is only just so important. That's why so many others, most probably with more to lose than you, trust Counterpane with root. Or not - I'm sure some of their useful services don't require you to trust them with root.

      --

      --
      make install -not war

    6. Re:$100 razors; blades are extra by geminidomino · · Score: 1

      Absolutely. There's also the added personal preference of "if I'm gonna get fucked, its gonna be with my own dick," i.e. if someone is gonna screw up and destroy my boxen, it's gonna be me.

  28. Moving on up... by OmegaBlac · · Score: 1
    FTA...
    "EtherFabric was developed by "four chaps in a garden shed" in Cambridge, England, according to Karr."
    Well, at least they move out of their respective mothers' basements. ;)
    1. Re:Moving on up... by jimicus · · Score: 1

      It's fairly unusual for houses in the UK to have basements.

  29. $500 can't compete, especially today. by Tavor · · Score: 1

    The lower end of computers is going for ~300-400 dollars, from the latest Dull circular mailing I've recieved. How, preytell, is an ethernet card designed to "(reduce) the load on the servers CPUs and improve the communications between the servers" when you can just buy another server for the price of a few of these bad boys?

    --
    Windows has detected an undetectable error.
    1. Re:$500 can't compete, especially today. by Beolach · · Score: 1

      The servers this type of card is meant for are not going for ~300-400 dollars. Closer to ~3000-4000 dollars, likely more.

      --
      Join moola.com, play games to earn money.
    2. Re:$500 can't compete, especially today. by Anonymous Coward · · Score: 0
      Here are some hints:

      1) It's two words,

      2) It's spelled "pray tell"

      No thanks necessary!

    3. Re:$500 can't compete, especially today. by NanoGator · · Score: 1

      "How, preytell, is an ethernet card designed to "(reduce) the load on the servers CPUs and improve the communications between the servers" when you can just buy another server for the price of a few of these bad boys?"

      Depends on what you're doing and why. A company I used to work for did some cool stuff with GigE and real-time image processing. If they can spend $600 to offload some of the CPU cycles to the card, they'd probably have been ecstatic. Anything to squeak out a few more FPS. Adding more boxes to the network wouldn't have done them any good, in this case.

      The question is: Are there enough customers like that to generate a decent profit. If so, then they'll do just fine.

      --
      "Derp de derp."
    4. Re:$500 can't compete, especially today. by Brandybuck · · Score: 1

      $300-400 isn't a real server. At best it makes a disposable print server or workgroup file server. For a real (as in profit generating) server you want reliability and efficiency, and you're not going to get that for $300-400.

      --
      Don't blame me, I didn't vote for either of them!
    5. Re:$500 can't compete, especially today. by Desert+Raven · · Score: 1

      Companies that plan on being in business for more than a week generally don't buy $500 crappy desktop systems and use them as servers.

      Even for my own personal side business, I spend 3-4 times that much for a server.

    6. Re:$500 can't compete, especially today. by Anonymous Coward · · Score: 0

      $400? What planet are you on?

      I just bought an 8 CPU machine with 32 GB of RAM (high performance database server supporting 10's of thousands of users). Three redundant hot-swappable power supplies. All RAID disk, error correcting RAM, redundant ethernet and redundant fiber HBAs.

      This machine won't go down unless someone physically attacks it. And yes, it's in a secure datacenter, with battery backup and diesel backup and redundant internet connections coming in from two different sides of the building via two different vendors.

      A $500 ethernet NIC is nothing.

    7. Re:$500 can't compete, especially today. by Anonymous Coward · · Score: 0

      Dont forget, those internet connections are both uphill, both ways.

    8. Re:$500 can't compete, especially today. by Tavor · · Score: 1

      You're right. I took two parts of an idea, and forgot to connect them.
      /me baps myself across the forehead.
      What I was trying to point out, was the declining cost of computer hardware in general, and trying feebly to question why a networking card would have such a high price point. Seems like charging a bit much for one special feature. When you have businesses questioning if it is worth the extra cost...

      --
      Windows has detected an undetectable error.
    9. Re:$500 can't compete, especially today. by Desert+Raven · · Score: 1

      Even so, when you look at the cost of component's businesses buy, $500 isn't that far out there. It's kind of like saying it's not worth it to buy high-end RAID cards because base-level IDE cards are so cheap. Not to mention that first-gen devices of any type tend to be expensive. You don't want to know what I had to pay for 100mbit *hubs* back in the day.

      Also keep in mind that these are server-class gigabit cards, which tend to price in the $500 range *anyway*.

      Businesses only question the cost if the benefit is questionable. If these cards live up to their promise, the benefit may very well be worth the cost to employers like mine, who have to deal with massive data throughput issues.

  30. Funny you should mention it... by Momoru · · Score: 1

    Level 5 Networks, which emerged from the stealth startup status with its own brand of network cards and software

    I just saw a story on slashdot today that related to this.

  31. Wheel of Reincarnation by Anonymous Coward · · Score: 1, Informative

    This is all just part of a well-known cycle, with its own jargon file entry. In a few years they're going to be saying, "Hey, CPUs are so fast, it'd be cheaper to build a dumber network card and spend the money upgrading the CPU to compensate" and they're going to say that that's a new idea, too.

  32. Re:It is less import today then it was 10 years ag by Desert+Raven · · Score: 2, Insightful

    I highly doubt they're aiming these cards at the general public. The kind of folks who worry about this kind of performance aren't buying $500 computers, they're buying $5,000 + computers, and trying to tweak every ounce of performance out of them. I'm willing to bet my employer is going to look pretty seriously at these cards for some of our heavy-use systems.

    Sometimes you can't "split all your services onto smaller boxen and have a load balancing switch/router". Not everything on the network is a web server.

  33. Re:It is less import today then it was 10 years ag by linzeal · · Score: 1

    Electricity is not free, esp in a datacenter. You should strike out for mid-grade boxen in most applications and be willing to pay a premium for anything that is going to be doing 24/7 traffic like a search engine. The idea of many smaller boxen being the best route is only true in university and research and developement type settings.

  34. Yes, there is a place ... by all+yr+bass+r+belong · · Score: 1

    ... and all your place are belong to us!!!

    1. Re:Yes, there is a place ... by killa62 · · Score: 0, Flamebait

      it's all your BASE are belong to us
      Dumbshit...

      Must be a canadian...

    2. Re:Yes, there is a place ... by Sj0 · · Score: 1

      There is only one country that's allowed to make fun of Canada.

      Austria. I don't know why either.

      Judging from your inability to put 2 and 2 together, I'm guessing you're not Austrian.

      --
      It's been a long time.
  35. What I would do with it by parasonic · · Score: 0

    Etherfabric, aye? I wouldn't even wipe my butt with it.

  36. Shorter answer: Geeks. by Anonymous Coward · · Score: 0
  37. Re:It is less import today then it was 10 years ag by 0racle · · Score: 1

    Your PC is not the target market. Clusters, large datacenters and applications that require communications as close to instantaneous as possible are. $500 is a drop in the bucket with the potential of a huge payback for those installations

    Not everything is about Slashdotters home computers.

    --
    "I use a Mac because I'm just better than you are."
  38. spend the money on more CPU, not specialized stuff by SuperBanana · · Score: 4, Interesting
    . Intel had the 586-driven smart-cards, and I believe 3Com had them as well. They were intended to offload the CPU by putting parts of the stack on the card.

    You're probably thinking of the i960-based cards, though Intel's PRO series adapters (not i960 based) do something similar (TCP checksumming is now builtin to the chipset and most OS drivers now know how to take advantage of that). That processor, and variants, were used in everything from network cards to RAID controllers.

    They failed because the performance gain and CPU offload numbers were never enough to justify the price difference.

    Ding ding ding. I forget who said it (maybe Alan Cox, but I'm REALLY not sure about that), but the opinion was along the lines that it would always be more benefitial to throw the money at a faster processor (or a second processor etc), because you'd get a performance boost everywhere. $300 buys quite a bit extra CPU horsepower these days, and there's no need for the hassles of custom drivers and such. Nowadays CPUs are just so damn fast, it's also not really necessary.

  39. Exploitable? by ArcCoyote · · Score: 1

    If this becomes popular, we're going to see exploits that pop the OS of the network card and get a bot or backdoor running on it.

    Or better yet, tamper with the packets going to the system so they appear trusted.

    I'm still waiting to see it happen to all the little bitty Cable/DSL routers.

    When you can get eth0 to lie, it's all over.

    1. Re:Exploitable? by bombadier_beetle · · Score: 1

      When you can get eth0 to lie, it's all over.

      I think I just found my new sig.

      --

      If you mod me down, I shall become more powerful than you can possibly imagine.
  40. bad analogy by Anonymous Coward · · Score: 0

    My desktop p4 with a USRCourier gets lousy throughput compared to this pII softmodem laptop.

  41. Is there a place? by ChozCunningham · · Score: 3, Funny
    Only one place. Amongst gamers.

    "A $500 LAN Card? Oh my God, Stevie, thats almost as much as my GeForce9900XTLSI+ cost!" Said the kid with the Lone Gunmen T-Shirt.*

    "That's nothing, This 8-Track-ROM player off of ThinkGeekcost almost a cool grand" Stevie said, as the other nerds bowed around his glowing and chromed Frag Machine.

    *Lone Gunmen T-Shirts coming soon. 8-Track-ROM's, too.

    1. Re:Is there a place? by vjsd1 · · Score: 1

      You should atleast read the article before posting. If you were to read the article, it would be clear that this hardware is being sold into HPC (High-Performance-Computing, i.e. grid/cluster computing) market. For HPC, 500 bucks a node is peanuts, and it exceeds the outermost bounds of absurdity to compare this to the prices of commodity hardware.

    2. Re:Is there a place? by Anonymous Coward · · Score: 0

      Either way, LAN party, a shit loads of hi spec gamer PCs, with these in == no lag.

      But a big bill

    3. Re:Is there a place? by ChozCunningham · · Score: 1
      I'm so sorry to have made a joke. Please forgive me. And forgive the moderators that marked it up as such. I guess I should have been considered uninsightful instead.

      At the least, if you want to apart my post, mock my missing closing quotation mark!

      That a $500 NIC for HPPC's is /. front-page-worthy should be the focus of your derision, not my smartass comments. Thank you for your time.

    4. Re:Is there a place? by ChozCunningham · · Score: 1

      Final note, I'm scared that a $500 NIC in a gaming rig is more absurd than a 8-Track-ROM. No, really!

  42. Is There a Place for a $500 Ethernet Card? by sporktoast · · Score: 2, Informative
    --
    In a related story, the IRS has recently ruled that the cost of Windows upgrades can NOT be deducted as a gambling loss.
  43. In a word, no by bofkentucky · · Score: 3, Interesting

    Take sun, some of their new server kit this year is going to ship 10Gbit/s ethernet on the board, which acording to their docs, is going to take 3 USIV procs to keep the bus saturated (6 cores). But when you are looking at 8 to 64 way server boxes, who cares about those 3 procs, especially when in 24-30 months it will take less than one proc to handle that load (Quad Cored + Moore's Law), and the eventually one thread will have the horsepower.

    Surely those smart dudes at Via, AMD, Intel, Samsung, Nat Semi, and/or Motorolla aren't going to:
    A) FUD this to death if it really works
    B) File patent suit until doomsday to keep it locked up
    C) Buy them out
    D) Let them wither on the vine and then buy the IP.

    --
    09f911029d74e35bd84156c5635688c0
    1. Re:In a word, no by MarkCollette · · Score: 1

      Moore's Law does not apply to Sun's SPARC chips.

    2. Re:In a word, no by bofkentucky · · Score: 1

      You'll notice I said 24-30 months, instead of the 18-24 for the normal moore's law. Never mind the fact that sun is having to speed up their proc development/release due to pressure from x86/x86-64 and power5/6.

      --
      09f911029d74e35bd84156c5635688c0
    3. Re:In a word, no by MarkCollette · · Score: 1

      I wasn't disagreeing with you, so much as I was taking a jab at Sun.

  44. Thanks for the ad, been doing this for years by InsaneGeek · · Score: 1

    It's called a TOE card, and companies have been producing them commercially for a few years now.

  45. Sure. About the same market as USD 30K Servers by WoTG · · Score: 1

    I've had a hard time learning that there is a lot more to computers than a thousand dollar workstation or laptop.

    There are a LOT of > USD 10K servers bought every year. If a USD 500 NIC can improve the total performance of such a server by 5%, then yeah it's worth it.

  46. High-Performance Computing by amjacobs · · Score: 2, Informative
    The place where things like TCP offload and RDMA support really matter is the high-end space. The major limitations on building really large clusters is the interconnect. If you look at the top 500 supercomputer list, you'll find that the top computers all use something better than gigabit ethernet. (Mostly Infiniband and maybe Myrinet) The reason for using Infiniband is that the communication latency is around 5us. For comparison , a standard GigE card has a latency around 70us.

    That being said, http://www.ammasso.com/ makes an Ethernet card (priced around $495, I believe) that utilizes both TCP offload and RDMA. The latency of the cards is around 10us. This is great for people needing a high-performance cluster, but can't afford the Infiniband interconnect.

  47. Re:These things will be commonplace in the future. by cujo_1111 · · Score: 1

    That is, if the technology is as good as advertised. If not, it will fade away from the memory of /.ers everwhere.

    Not necessarily true, there are /.ers that still go on about Blu-Ray discs.

    --
    If I point out that you are incorrect, making me a foe does not make you any more correct.
  48. IPSEC by Omnifarious · · Score: 3, Insightful

    If this card can do most of the work of IPSEC for me, it'd be a big win.

    My main concern though is that with two ports, how can I be absolutely certain the packet has to go through my firewall rules before it can go anywhere?

    Of course, the extra ports could be an advantage. If it could handle all the rules for you, then it might even be capable of functioning as a layer 4 switch and sending out a new IP packet before completely recieving said packet.

    But, I'd want all the software on that card to be Open Source.

    1. Re:IPSEC by dbIII · · Score: 2, Informative
      If this card can do most of the work of IPSEC for me, it'd be a big win.
      Snapgear/Cybergaurd make little embedded firewall/VPN/router cards that can do this and plug into a PCI slot and pretend to be a network card as far as the host computers OS is concearned - but that's a completely different thing to what is talked about in the article.
      I'd want all the software on that card to be Open Source
      They run on linux and the IPSEC implementation is open source as well.
    2. Re:IPSEC by Big_Al_B · · Score: 1

      My main concern though is that with two ports, how can I be absolutely certain the packet has to go through my firewall rules before it can go anywhere?

      FTA, the card is supposed to coexist nicely with ethernet, so I would assume it presents a single MAC address at layer two and a single IP address at layer three. From other posts, it appears that layers four through seven are handled "normally" by the CPU, as always. Most firewalls and IDS start at layer two or three and go up the stack to at least layer four, so they should work normally with this technology.

      If it could handle all the rules for you, then it might even be capable of functioning as a layer 4 switch and sending out a new IP packet before completely recieving said packet.

      But with a cut-through[1] switching algorithm you give up layer four visibility, because by definition you start forwarding the frame as soon as you complete a layer three lookup (or cached-flow check) to assign an egress interface. In order to access the layer four header, you need to inspect the first 12 bytes of the layer three payload. Point being, your packet would already be partially out the door before you cracked it open far enough to apply layer four rules.

      [1]One popular switch vendor's term for what you described.

      But, I'd want all the software on that card to be Open Source.

      May I ask why? Is it for operational performance e.g. you believe you can increase the code's quality, operational comfort e.g. you can validate the code, or just a personal preference for open source architectures? Or is it something else? Not implying any criticism; I'm just curious.

      You know that at least some of it will likely be in assembler for speed's sake. Even if it is open, it would be a royal pain to modify safely and correctly.

    3. Re:IPSEC by Omnifarious · · Score: 1

      But with a cut-through[1] switching algorithm...

      But, that's what I meant by layer 4 switch. It wouldn't start sending the packet out the door until it had gotten the first few bytes of the layer three payload so it could apply the layer 4 rules.

      May I ask why? Is it for operational performance e.g. you believe you can increase the code's quality, operational comfort e.g. you can validate the code, or just a personal preference for open source architectures?

      All three reasons to varying degrees.

      • I don't really think I can increase the code's quality significantly, but I would like to be able to stuff in some new algorithm because, say, SHA-1 or AES was broken. And I don't want to have to depend on the vendor to do this for me.
      • I don't necessarily trust the vendor's code. For CPU microcode (as an example), this is only a little important. There aren't a lot of ways for a CPU to purposely leak information to the outside world, though I would like to be able to disable any DRM technologies I found. But, for a network card, especially one I trust to do encryption for me, this is supremely important.
      • I also have a preference for Open Source technologies. I think Open Source is more efficient for the economy as a whole, even if it makes it slightly harder for some particular company to make money or keep themselves technologically ahead of their competitors.
    4. Re:IPSEC by Omnifarious · · Score: 1

      That sounds kind of interesting. I'll have to look into it. I suspect though that the card might end up with 2 IP addresses unless they're doing some really ugly munging that I'd prefer they not do.

    5. Re:IPSEC by Big_Al_B · · Score: 1

      But, that's what I meant by layer 4 switch. It wouldn't start sending the packet out the door until it had gotten the first few bytes of the layer three payload so it could apply the layer 4 rules.

      Hm, did you mean that it would not start sending the packet out until it had the layer *four* header in hand? Because, if it only has the first few bites of the layer *three* header, then it would not have enough information (destination addr/port) to forward the packet correctly.

      And, my point was that if you start sending a packet based on layer three info prior to receiving the layer four header, then you won't have the information you need to apply layer four rules prior to forwarding the packet.

      In the case where a layer four rule blocks forwarding, then you'd have a partial packet on the wire already. A large flow of partially blocked packets could conceivably cause a great deal of "runt" congestion and result in higher next-hop switch|router|server cpu loads.

      All three reasons to varying degrees

      Ah. I can relate on all counts.

    6. Re:IPSEC by Omnifarious · · Score: 1

      Yes, I meant that you wouldn't start sending it out til you had the first few bytes of the layer 4 header. :-) That's more latency than a layer 3 switch, but less latency than a layer 4 router when there isn't enough traffic to queue more than 1 packet.

      Of course, I don't know how much benefit there'd be to that really. Most of the time when you're close enough for the speed of light to not swamp the latency you can use a layer 3 switch since you don't generally need the added security and checking of the layer 4 forwarding and filtering rules.

      I guess if apartment level ISPs started being commonplace, there'd be a use. Or maybe in hosting centers, though most traffic at such places isn't between machines at the hosting center.

  49. One word... by jcdick1 · · Score: 2, Insightful

    Virtualization.

    These are the kinds of NICs that would be put into a datacenter that is leaning heavily toward VMware GSX or ESX servers. Any bit of offload of the CPU in sharing the NICs is a good thing.

    --
    What?
  50. Re:I think there is definately a market for this.. by Sampizcat · · Score: 1
    and if the cards themselves could do, say, signature detection of various flood types, or basic analysis of traffic trends


    What would be really cool is to have a programmable network card - so you could program it to recognise DDOS attacks, or signatures, or whatever. Kindof like taking your old Pentium 200Mhz that you run Linux on now as a router, and squeezing into a network-card size. I imagine something like that would have a huge market in the hacker/geek crowd, plus IDS companies would love it too (provided you can protect it from being re-progammed, maybe a jumper on it to turn off programmable mode or something).

    Does anything like this currently exist?

    Anyway, just my 2cents.

    Sampizcat

  51. News or press release? by m101 · · Score: 1

    Is it just me or does this news headline seem to be nothing more than a press release?

    1. Re:News or press release? by Anonymous Coward · · Score: 0

      /shrug, dunno....either way, The Register ran this yesterday, it's already old news.

  52. $500 Ethernet card? by thundercatslair · · Score: 1

    How about a $1300 rocket modem?

  53. Re:It is less import today then it was 10 years ag by Anonymous Coward · · Score: 0

    Unless you are google... they seem to be doing just fine with lots of smaller boxes running in clusters. Heck they don't even care about flakey hardware. Just because you can't see a use for something doesn't mean someone else can't.

  54. No. by jbplou · · Score: 1

    Short answer no. Long answer some moron will buy it , but no one else.

  55. As soon as my broadband upload goes above 1G (HA!) by Anonymous Coward · · Score: 0

    I'll need one of those baby, ... oh my broadband upload only go up to 384Kbps? Forget it.
    My CPU is still sleeping 99.9% of the time waiting for data over the internet

  56. Re:I think there is definately a market for this.. by Duncan3 · · Score: 1

    Hrm, you mean a router? ;)

    --
    - Adam L. Beberg - The Cosm Project - http://www.mithral.com/
  57. Support int13? by flying_monkies · · Score: 1

    Well, if it supports int13, you could use it to boot from iscsi. $500 network card compared to $1000+ fabric board that requires a seperate fabric/copper infrastructure... Don't know that it's a way I'd want to go with a server, but I can see some people thinking it's a Good Thing (tm)

    --
    I disagree with what you say, but I'll defend your right to say it to the death - Voltaire
  58. Ever buy a gig NIC for an RS/6000? by C-Dogg75 · · Score: 1

    I bet you can't get one for less than a grand. But if you buy one, it means you need it.

    1. Re:Ever buy a gig NIC for an RS/6000? by Anonymous Coward · · Score: 0

      thats because nothing for an RS/6000 comes alone... you get the NIC, the backup NIC if the first has a hardware failure, the Reporting NIC to call home when the first breaks, and a few extra do-dads and attachments so that everything remains backwards compatible to that punch card machine in the corner.

  59. Re:I think there is definately a market for this.. by rodgerd · · Score: 1

    The programmable car would almost certainly cost more than a cheap upgrade from your 200 MHz pentium to a much faster MoBo/CPU.

  60. Looking into EPSRC by mislam · · Score: 2, Interesting

    I would wait on jumping to any type of conclusion and see what happens when EPSRC adopts this for ther 512 node cluster. If it really improves the performance by 10% it certainly should be something to look into. Now, is there is a market for it at end user's desktop? I don't think so. 9$ Realtek card would be just fine. :-)

  61. Re:It is less import today then it was 10 years ag by taylortbb · · Score: 3, Insightful

    "Smaller boxes" is relative. Google's cluster nodes are dual Xeons with terabyte+ HDs. For Google it is small, for anyone else, that is powerful computer you're going to be paying alot for. If you're buying one of those computers you're probably going to look at one of these cards, and that is exactly the market they're looking for.

  62. 30k is peanuts. spent over 10x that on 1 box. by teknickle · · Score: 2

    I have a few servers right now that cost close to $30k each. (and this is at a 29 employee non-tech company).
    $30k might seem like a lot to a Windows technician, but that is a cheap box for high-end Unix servers (won't even touch mainframe for that).

    6 years ago, when I ran a network for a large company (in a very rural community, mind you) the most expensive server there cost over $320,000.
    It was an AS/400 and it was/is a phenomenal piece of equipment.

    Heck, it cost $900 just for 1 10/100 ethernet card back in 1999. (and PC nics were $15)

    $30k is peanuts. Go checkout some 8-way IBM boxes. Or HP or high-end chompaq. And no, you do NOT reboot a $300k+ server during maintenance.

  63. Lies, damned lies and benchmarks by Harry+Balls · · Score: 2, Insightful

    I looked at their benchmark web page http://www.level5networks.com/prod_etherfabricperf .htm where they claim that a typical PC with "conventional" ethernet burns 83.5% of CPU for communication overhead while only 16.5% remain to the application.
    But they don't say which CPU was used - probably an 850 MHz Pentium III or something similar outdated.

    Fact is, on a current 3.x GHz Pentium IV or an equivalent Athlon or Opteron the communication overhead is in one digit range, percentage-wise.

    A famous computer science quote is:
    "Lies, damned lies and benchmarks"
    and another one is
    "Don't trust any statistics that you haven't forged yourself."

  64. Is There a Place for a $500 Ethernet Card? by threaded · · Score: 1

    Of course, in a Beowulf cluster.

    HTH

  65. Re:Sure. About the same market as USD 30K Servers by AngryElmo · · Score: 1

    Thank you. I notice a tendency for people to immediately think about home/workstation class stuff when looking at new software or hardware. The problems are entirely different in the data-centre, which is where this product and TOE are aimed at.

    Similar arguments can be had over the cost of storage. They say "Hey I can buy a 400GB hard-drive for $300 - why do you say it is going to cost you $500 per GB?"
    "Well," I say, "I have to worry about MTBF, Seek times, IO channel bandwidth, backup, redundancy, vendor support etc. You dont."

  66. Re:30k is peanuts. spent over 10x that on 1 box. by ebuck · · Score: 1

    Reminds me of the GS60's I worked on a few years ago. They were expensive enough that trading them in could buy housing for my whole extended family, and NICE housing at that.

    And no, it wasn't a client with deep pockets and no common sense. Some software isn't architectured to work nicely on a distributed cluster, and people cannot wait for a solution to be developed. These GS60's paid for themselves in the first few months of deployment because they were used to reduce the over-generation margin of the power companies while still keep an acceptable safety margin for unexpected demand spikes.

    Sure, another software architecture could be developed, but who's going to wait the two to three years for a prototype? And in some fields, they expect several years of proven technology before making the switch to "new" and less-tried solutions.

  67. Victory at last. by deep44 · · Score: 1

    The bastards who rejected my idea for an Irwindale-based PS2/USB combo-card should be having second thoughts right about now.

  68. Re:I think there is definately a market for this.. by Famanoran · · Score: 1

    You mean kind of like the Intel Network Processors?

    http://www.intel.com/design/network/products/npfam ily/

  69. Um, no. by holysin · · Score: 5, Interesting

    If you have a machine (say on a machine running linux kernel 2.4.20-30.9smp) with a built in gig port (say with eth0 identified as eth0: Tigon3 [partno(BCM95704A6) rev 2003 PHY(5704)] (PCI:66MHz:64-bit) 10/100/1000BaseT) connected to a decent gigabit switch, and another machine (same card, same os)with a gigabit card, those two machines will achieve 940Mbps talking to each other (results via iperf, 0.0-10.0 sec 1.09 GBytes 940 Mbits/sec).

    However, if you plug a windows box (2000 or xp, didn't have a 2003 handy) with either an add on card, OR built in gig (2000 vs xp) you get a rather less impressive figure of 550-630. Coincidentally, you'll get the same basic number if you run two instances of iperf on the same computer... This tells me the bottleneck isn't the PCI bus, it's the OS. If you can prove me wrong please do so...

    1. Re:Um, no. by klui · · Score: 1

      I ran into this when I had an old (read: unsupported) Macintosh (w/ G4 upgrade) running OS X 10.2.x/10.3.x via a PCI 100baseT ethernet card (DEC21x4-based) transferring to a Windows 2K3 box (i875P Intel PRO/1000MT-based w/ cygwin ssh) and I was getting something like 2-2.5MB/s using ssh (connected to a Netgear FS108 switch). When I used an iBook G4 to do the transfer, I got something like 3-3.5MB/s. I never figured out why it was slower on the Windows box. Memory and CPU were not the bottlenecks and the network had plenty of bandwidth. Maybe it was the QoS in Windows... but like I said there was plenty of network bandwith.

      Anybody w/ more experience under Windows know more?

    2. Re:Um, no. by AoT · · Score: 1

      I may be talking out of my ass, but it sounds lika you had an encryption/compression collision. If you encrypt data it makes it more random; and the point of compression is to use the patterns to make things less random.

      The point: maybe the randomness becomes to great when you run too much encryption.

    3. Re:Um, no. by anno1602 · · Score: 2, Informative

      If you encrypt data it makes it more random>

      Encrypted data should look completely random, not "more" random, or else you can use the patterns in the stream for malicious activity. That's why, if you want to compress and encrypt, you always compress and then encrypt. Compressing an encrypted stream is impossible if your encryption is worth its salt.

    4. Re:Um, no. by Professor_UNIX · · Score: 1
      Compressing an encrypted stream is impossible if your encryption is worth its salt.

      Put down your hash pipe for a second. If you compress the data before encrypting it you shouldn't have a problem.

    5. Re:Um, no. by p3d0 · · Score: 1
      Did you even read the post you replied to?
      That's why, if you want to compress and encrypt, you always compress and then encrypt.
      --
      Patrick Doyle
      I mod down every jackass who puts his moderation policy in his sig. Oh, wait a sec....
    6. Re:Um, no. by Feyr · · Score: 1

      there was a thread on nanog a few months back. something about freebsd kicking the shit out of every other OS out there for massive transfers like that, including linux. though if i recall it's really down to a matter of drivers :)

    7. Re:Um, no. by laffer1 · · Score: 1

      My experience has been that Windows XP, etc. allocate 80% of the bandwith to regular apps and reserve 20 percent for QoS apps. Its impossible to use more than 80% for file copies over the network. That cap is based on the link speed though.. so say 80MB/s for a 100MB/s connection. Presuming its a 100 base T switch, you should have pushed more traffic than that. I typically only get 10MB/s or less with sftp transfers on my home network using an ibook g4 and a dual xeon dell with a built in 1000MT intel nic builtin. (64bit pci bus nic) I've got a netgear switch/router 100 base t. Using samba i can use 80% of the connection in windows copying to my wife's powermac g4 (samba) or my FreeBSD machine (samba or nfs with ms sfu)

    8. Re:Um, no. by laffer1 · · Score: 1

      It also depends on the version of freebsd and if a firewall like ipfw is running. My experience has been that freebsd 4 is faster than 5.x and 6 current in networking so far. Its getting better though. For certain services like apache 2, freebsd 5 seems peppy though. ipfw has a noticably impact on performance, although it could be my ruleset. I know in early 5.x builds, ipfw required giant lock.. that might have been the problem.

    9. Re:Um, no. by Gerald · · Score: 1

      It's more likely there was a duplex mismatch. What the hell is an "encryption/compression collision"?

    10. Re:Um, no. by Anonymous Coward · · Score: 0

      Its not the drivers. The post said that he had gotten faster transfer rates with windows if iperf was installed.

      It really was a case of OS load problem.

      And the drivers aren't the problem in the freebsd benchmarks you have given. Its still the load transfer stack that is the problem.

    11. Re:Um, no. by Dastardly · · Score: 1

      Well, Windows does occasionally just take over the processor from anywhere from 15ms to a 100ms randomly. Which is a killer when you are trying to blast data over 10Gbit ethernet, but limit you buffer sizes.

    12. Re:Um, no. by Lennie · · Score: 1

      Windows is probalby using a smaller tcp-window than Linux.

      So Linux is actually has bigger windows than Windows. :-)

      --
      New things are always on the horizon
    13. Re:Um, no. by beerman2k · · Score: 1

      Did you realize that this is Slashdot?

    14. Re:Um, no. by klui · · Score: 1
      It's more likely there was a duplex mismatch.

      Well, under OS X, ifconfig says

      media: autoselect (100baseTX <full-duplex>)

      while under Windows, the adaptor's setting is "Auto Detect" under the Link Speed & Duplex.

    15. Re:Um, no. by klui · · Score: 1

      I recall looking at the Networking tab under Windows Task Manager and I'm using less than 30% of the available bandwidth. That's why it is so strange. I find that I could actually initiate 2 or more sessions and I can get around 3-4MB/s for all combined transfers. Anyone else know why?

  70. Re:It is less import today then it was 10 years ag by ebuck · · Score: 1

    Well, if it came to buying 4 of these network cards, or rewriting pieces of code to fit the new load balancing architecture, I'd buy the cards.

    $2000 is nothing compared to extended development costs.

    Not everything can be load balanced, and load balancing can incur more overhead if the protocol you are considering is a bad match for load balancing.

    You can't load balance a database transaction, a backup file, or a streaming video feed. Don't assume that it's all HTTP / only HTTP.

  71. Ok, kids, a quick education on sessions & late by postbigbang · · Score: 2, Interesting

    All GBE cards are FC on the MAC layer. Get over it.

    Here's where the problems come in:

    1) buses suck. PCI-X is fast; a faster bus clock is better still
    2) the problems for GBE NICs are, in no special order: dropping crap packets; cleaning up dirty cache (a huge problem for clusters, where this product is poised); session/protocol relationship managment; buffering up misrouted UDP; managing evil ports (setting them up and tearing them down); managing proxies and work arounds (a little SIP anyone? Burping up your IPSec???)
    3) making the driver aware of what's going on so sessions don't vomit
    4) not bothering the freaking CPU chipset every few milliseconds with useless crap

    So, if they do any of these things, bless them and send me the bill. Because (save TOE cards), all of them hassle the drivers and chipsets to no end with stuff that could easily be offloaded. And to those that say, just put more cheapo load-balanced hardware on the job-- you're a chump and deserve to have stuff blown to bits when you mulitply failure points with junko doorstop hardware boxes with all of the brains of a goose.

    --
    ---- Teach Peace. It's Cheaper Than War.
  72. Disagree - more valuable now than before by jimsingh · · Score: 2, Insightful

    As CPUs get faster an interrupt costs you more in terms of lost CPU time. So, reducing the number of interrupts is more important now than ever before.

    My 100 Mbs ethernet card generates about 5k interrupts / second when transferring data at about 30 Mbps. Gigabit cards are engineered to hold interrupts until a few packets of data come in so that a DMA can move a larger chunks of data. If this NIC reduces the use of interrupts even further (say by off boarding computation or even the entire TCP/IP stack and thus allows for even larger DMA transfers) the impact could be substantial.

    Unfortunetly, my knowledge of computer innards stops here, so I can't calculate how much cpu time 5000 interrupts actually take or how the new PCI-Express bus changes interrupt processing or how much a benefit it would be to have say only 1000 interrupts / second instead of the 5000.

  73. [OT] Computer Boulevard by |<amikaze · · Score: 1

    [a] I had a sales-drone at Computer Boulevard here in Winnipeg just RAVE about RealTek cards. I said I really wanted 3 Intel or 3COM cards for a new work proxy server and he said 'Why? RealTeks are way cheaper and run at the same speed!' Retard.

    Computer Boulevard, as in what used to be Techtronics? I wouldn't take a single thing they say as fact, but that's just based on personal experience...

    1. Re:[OT] Computer Boulevard by Jiilik+Oiolosse · · Score: 1

      My personal experiences with that shop have been mixed. If the parts they sell you work, then great. If you get a dud, they won't exchange it (even in the 14-day period they claim). Gotta wait for RMA. Nonetheless, the hardware is cheaper there than just about anywhere else in the city. Assuming you go in with the knowledge of exactly what you want, you'll have no problems.

    2. Re:[OT] Computer Boulevard by |<amikaze · · Score: 1

      Assuming you go in with the knowledge of exactly what you want, you'll have no problems.

      And it's not DOA. Or counterfeit. I'm not 100% sure about the counterfeit thing, but I seem to remember hearing something along those lines from the Regina store. Could be wrong.

  74. Re:spend the money on more CPU, not specialized st by evilviper · · Score: 2, Insightful
    Ding ding ding. I forget who said it (maybe Alan Cox, but I'm REALLY not sure about that), but the opinion was along the lines that it would always be more benefitial to throw the money at a faster processor (or a second processor etc), because you'd get a performance boost everywhere.

    Interrupts are the one place where it's not remotely true. A faster processor will allow your system to handle significantly more interrupts. The whole interrupt model needs to be thrown out and replaced with something much better.

    And while I'm at it, there are many cases where it's not true. Wherever you have a significant bottleneck, hardware acceleration helps tremendously. Tasks like encryption and (HighDef) video playback can max-out the highest-end systems available, while a $50 card can handle those tasks easily.

    I don't think purpose-built hardware everywhere is the answer, but I do think having an FPIC/ASIC as a standard computer component could make for incredible speed improvements in most/all of the tasks that are hard for CPUs to perform.
    --
    Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  75. Re:spend the money on more CPU, not specialized st by evilviper · · Score: 1
    Ah dammit... A correction if you please:

    A faster processor will NOT allow your system to handle significantly more interrupts.
    --
    Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  76. Re:30k is peanuts. spent over 10x that on 1 box. by Anonymous Coward · · Score: 0

    A recent installation of our product had hardware specs something like two 32 processor IBM p690s, and a dozen smaller boxes (4 or 8 processors, I forget exactly).

    Agreed, $30k is nothing in that market.

  77. Is There a Place for a $500 Ethernet Card? by Anonymous Coward · · Score: 0

    Yes. Blizzard needs these to run their World Of Warcraft servers.

  78. I'd rather have this 10 Gigabit NIC for $795 by Harry+Balls · · Score: 1

    http://www.myricom.com/ and http://www.myricom.com/news/050620a/

    These babies used to cost $2500 just half a year ago. Now they are down to $800. Awesome.

  79. Win 95 by Anonymous Coward · · Score: 0

    Will it work with Windows 95 ? :)

  80. Search for "Dealing with high network loads" by anti-NAT · · Score: 2, Informative

    and have a read of why the interrupt problem isn't a problem anymore, at least on Linux. Note the date too - October 2001.

    LWN.net

    NAPI has been implemented in the kernel.org kernels for a number of years now.

    --
    The Internet's nature is peer to peer - 20050301_cs_profs.pdf
  81. Wow!! by EightBits · · Score: 2, Interesting

    I can't believe what I'm seeing here. The majority think this is a bad thing, it seems. I disagree.

    I have a few Sun E450s in my shop and I am going to be moving them to gigabit ethernet soon. A gigabit ethernet card from Sun costs considerably more than this so it is an option as long as it will run on Sparc hardware with Solaris drivers. Sorry, but the Intel e1000 just isn't going to cut it here.

    I'd like to see that article about 20 instructions (I assume these are ML instructions) handling an entire packet. This may be the case on CISC CPUs, but I just don't see it happening on RISC CPUs. I am not saying it's impossible, but I would definitely have to see that to believe it and I am genuinely interested in reading this article. Please let me know where I can find it.

    I don't think some of you understand the difference between intelligent network chips and networkchips with a CPU core inside them. Take a look at Cisco's solutions. Their line is moving hastily towards ASICs. The idea here is that specialized hardware designed to perform a task will ALWAYS be faster at handling that task than a CPU running on the same clock. Cisco is proving this with Layer 3 switching vs routing. It's not clear what their solution is, but I'm willing to bet this NIC is an ASIC optimized for the purpose of handling TCP/IP traffic from an ethernet network. I have a hard time seeing how any CPU will be able to beat out an ASIC in this field today.

    Also of note is memory and bus bandwidth. I have seen some comments about CPU usage and how it's negligible and what not. While I don't believe that either (I pay a lot for those cycles, I want to use as many for data processing as possible), I do believe that the CPU handling the TCP/IP stack takes a little more BUS bandwidth as well as memory bandwidth. If this is all handled on the card, both bandwidth usages will be reduced. Bus and memory bandwidth is already lagging way behind CPU speed as it is. It is my number one system performance limiter right now. The more I can eliminate it, the more productive I can be. Someone already mentioned large numbers of packets. This is a good argument as well. When dealing with large numbers of small packets, CPU usage on a CPU-based TCP/IP stack increases as opposed to a smaller number of larger packets. So in some cases, it depends on your network and it's configuration.

    Also, consdier that maybe I do only get 10 more cycles per second from using this card. Is the card worth it? With CPU cycles at a premium and everyone here trying to purchase as many as possible and never a single idle CPU in any of my servers, I have to give a resounding YES! 10 cycles per second per CPU times the numebr of CPUs and seconds the NIC is in place is a LOT of cycles and most certainly worth $500 over the lifetime of a $30,000 machine. If they can prove it does what they claim on my hardware, count me in.

  82. That applicable to RAID controllers too? by TheLink · · Score: 1

    Is that reasoning applicable to RAID controllers too?

    --
    1. Re:That applicable to RAID controllers too? by Phil+Karn · · Score: 1
      Pretty much, I think. (I'm a big fan of Linux software RAID).

      The arguments for hardware RAID seem to have to do more with functionality than performance. For example, you can't boot off a software RAID-5 array, but you can with a hardware controller. (I get around this on my own system by making the boot volume RAID-1 and having a separate RAID-5 array for large, static databases.)

      Also, I've had some system lockups when a drive in a software RAID array fails, probably because the controller and/or its driver got confused. This isn't really a strong argument for a hardware RAID controller (the non-RAID disk controller and/or driver simply ought to be made more robust) but a hardware RAID controller is probably more likely to tolerate a drive failure without hanging since tolerating drive failures is precisely what a RAID controller is designed to do.

      If there's a problem with RAID, in software or hardware, it's that there are too many single points of failure in most inexpensive RAID boxes as they're actually constructed. Unless you buy a expensive box with dual power supplies, the power supply is one of them. So are the CPU, memory and software of the host machine to which the RAID array is attached. I've thought about building a "network RAID" where I construct RAID arrays out of network file systems exported by physically separated servers over gigabit Ethernet. No matter how any one PC/controller/drive combination fails, the client machine should recover. Problem is, even that scheme is vulnerable to a failure of the client machine. So RAID isn't the only answer, and higher level data replication schemes are needed to complement it.

  83. Admission of trademark confusion: by Chmarr · · Score: 2
    From the article:
    The name Level 5 refers to the network protocol stack where level 5 delivers data from the network to the application, according to Karr. The company isn't concerned about any potential confusion with Internet Protocol telecom Level 3 Communications Inc. On the contrary, he quipped, "It's working in our favor. People say, 'Yes, we've heard of you. You're a big company.'"

    Congrations guys... you just admitted to causing actual trademark confusion... have fun in the courtroom.
  84. Re:30k is peanuts. spent over 10x that on 1 box. by B2382F29 · · Score: 2, Funny

    they were used to reduce the over-generation margin of the power companies

    By using up the excess power? :)

    --
    Move Sig. For great justice.
  85. If you don't have a clue, shut the hell up!!! by Anonymous Coward · · Score: 0

    Damn straight there is a need for cards like this. Companies like Alacritech, Adaptec, Intel, and many others make very expensive offload cards for a reason. I realize that most of the readers here have got no experience outside of their mothers basement computer room but, if you don't know what you are talking about then please, stopping wasting bandwidth with your drivel.

    Many high servers, high and low end benifit greatly from offload cards. These cards offload SSL, IPSec, iSCSI, and just the TCP stack and make high bandwidth servers fly. And yes, even a high end server by todays standard can have 30%-60% of a CPU chewed up by network traffic. iSCSI in particular will bury the fastest CPU if you have multiple gig interfaces running off a PCI-E bus and no offload engine in place.

  86. TOE cards.. by HockeyPuck · · Score: 1

    It's not just TOE (tcp offload engines) that are coming along but full fledged iSCSI offload cards that offload the iSCSI stack as well as the tcp stack. Since the majority of hosts out there can't benefit from a $1000 2Gb fibre channel HBA, as they don't push that much data.

    But an iSCSI connection might just be what the dr ordered. Plus have you priced a gigE port vs a FC port lately?

  87. Yes, if you're IBM by Anonymous Coward · · Score: 0

    About 5 years ago I had to buy a new ethernet card for the AS/400 at work. It looks like a standard PCI ethernet card. The cost $AUS3000 ($US2300). So in comparison, this is cheap.

    We also needed to get a new token ring card for an RS/6000. The IBM price was $1500 for that one, but someone tried taking their card out of their PC (an IBM card, still overpriced at $200) and it worked.

    So yes, if you are dealing with the corporate world then there is a place for overpriced technology, regardless of whether there is any actual performance benefit.

  88. Re:spend the money on more CPU, not specialized st by johu · · Score: 1

    >> Intel had the 586-driven smart-cards, and I believe 3Com had them as well.
    >You're probably thinking of the i960-based cards

    Actually Intel did have "586" named chip well before 486. Most people assume 586 means first Pentium processor, but they already used that number in late 80's. Never seen Intel ethernet card with one, but 3Com 3C505 aka Etherlink+ used it. 586 chip was ceramic version that got burning hot. 3C505 was supposed to be somekind of smart ethernet card and to be used with 3Com's own network OS. It never succeeded. There were drivers for Netware as well and that's what we used.

  89. Re:It is less import today then it was 10 years ag by Sj0 · · Score: 1

    My condolences concerning your functional illiteracy.

    --
    It's been a long time.
  90. Yeah by AoT · · Score: 0, Redundant

    Hate to say it but, imagine a beowolf cluster *with* these things

  91. Re:not all built-in ports are equal by Anonymous Coward · · Score: 0

    Depends on what bus the built-in port is running off, normally they are attached to the same PCI bus as your expansion cards. If you are lucky they will be in a seperate PCI bus so at least you audio card want be fighting for bandwidth.

    If you have an i875 chipset, the built-in NIC will be running over the CSA bus, which is a purpose built bus with more bandwidth.

    Some server boards onboard chipsets use a PCI-X bas.

    Hopefully this will all go away when PCI express takes over

  92. I worked on TCP offload card at Adaptec by Krellan · · Score: 4, Informative

    Accelerating Ethernet in hardware, while remaining 100% compatible with the standard protocols on the wire, isn't all that new. Just over 2 years ago, I worked on a TOE (TCP offload engine) card at Adaptec.

    http://www.adaptec.com/worldwide/product/prodfamil ymatrix.html?cat=%2fTechnology%2fNAC+Cards%2fNAC+C ards

    It was a complete TCP stack in hardware (with the exception of startup/teardown, which still was intentionally done in software, for purposes of security/accounting).

    Once the TCP connection was established, the packets were completely handled in hardware, and the resulting TCP payload data was DMA'ed directly to the application's memory when a read request was made. Same thing in the other direction, for a write request. Very fast!

    I'm not sure of the exact numbers but we reduced CPU utilization to around 10%-20% of what it was under a non-accelerated card, and were able to saturate the wire in both directions using only a 1.0Ghz CPU. This is something that was difficult to do, given the common rule of thumb that you need 1Mhz of CPU speed to handle every 1Mbit of data on the wire.

    To make a long story short, it didn't sell, and I (among many others) was laid off.

    The reason was mostly about price/performance: who would pay that much for just a gigabit ethernet card? The money that was spent on a TOE-accelerated network card would be better spent on a faster CPU in general, or a more specialized interconnect such as InfiniBand.

    When 10Gb Ethernet becomes a reality, we will once again need TOE-accelerated network cards (since there are no 10GHz CPU's today, as we seem to have hit a wall at around 4Ghz). I'd keep my eye on Chelsio: of the Ethernet TOE vendors still standing, they seem to have a good product.

    BTW, did you know that 10Gb Ethernet is basically "InfiniBand lite"? Take InfiniBand, drop the special upper-layer protocols so that it's just raw packets on the wire, treat that with the same semantics as Ethernet, and you have 10GbE. I can predict that Ethernet and InfiniBand will conceptually merge, sometime in the future. Maybe Ethernet will become a subset of InfiniBand, like SATA is a subset of SAS....

    1. Re:I worked on TCP offload card at Adaptec by rodac · · Score: 1

      Adaptec + TOE ? it wasnt the 7212 iSCSI HBA was it?

      question? did you guys ever fix the data corruption issue where the hba reassembled multiple data-in pdu's incorrectly with an 8 byte overlap between segments (and filling out the missing 8 tail bytes out with uninitialized data)?

      also, did you fix the issue where the hba would only do 512 bytes of i/o every roundtrip, making high-latency comms "slow" ?

      anyone that want to test the "slowness" can just try to set max tcp window-size to 512 bytes. enjoy.

      to try the datacorruption issue, just try
      dd if=/dev/random of=/dev/hda

      By the way, RFC2581 was published in april 1999, this rfc even explains why this rfc sucks and why rfc2582 should be used. tell your friends not yet laid off to read rfc2582.

    2. Re:I worked on TCP offload card at Adaptec by Krellan · · Score: 1

      Wow, that's nasty, and an embarassment.

      Can't blame me for that one, though, I worked on just the ANA-7711 cards (TOE only, without any additional iSCSI support). At Adaptec, there was an internal division between TOE-only cards and iSCSI cards, and I was not part of the iSCSI group.

      The ANA-7711 cards didn't accelerate anything past layer 4, so if you wanted encryption and iSCSI, the CPU still had to handle that.

      We tested and solved many data corruption issues, and interactions with TCP stacks on various other operating systems. To my knowledge, no ANA-7711 cards ever shipped with data corruption problems.

      Unfortunately, just this year they laid off my last friend I knew who was still working there. It's a real shame what has happened to Adaptec over the last few years. There were, and may still be, some really good engineers working there....

  93. Cost of redesign vs extra hardware by threaded · · Score: 1

    It's simple really, if (s)he can get on with a little more hardware then that is surely so much cheaper and quicker than a redesign, build, test etc. etc.

  94. Re:It is less import today then it was 10 years ag by tigga · · Score: 1
    You can't load balance a database transaction, a backup file, or a streaming video feed. Don't assume that it's all HTTP / only HTTP

    It depends on configuration. I agree with your's can't, but you can run those transactions, backups and feeds in parallel.

  95. Security Issues by Anonymous Coward · · Score: 0

    The web page for EtherFabric suggests that this approach passes a lot of or all the IP stack processing responsibility to the application.

    Surely there are going to be a lot of security issues here? What will a malicious application be able to do with this level of access to the underlying services?

  96. Re:spend the money on more CPU, not specialized st by rsynnott · · Score: 1

    > The whole interrupt model needs to be thrown out and replaced with something much better. Any ideas? ;)

    --
    Me (Blog)
  97. Too expensive by Anonymous Coward · · Score: 0

    Way too expensive for a NIC.
    Rather buy a no-name $10 NIC.

  98. Why it's faster by Anonymous Coward · · Score: 0

    The best explanation of what they've done is a bit hidden away on their site:

    http://www.level5networks.com/sol_approaches.htm

    This has some block diagrams comparing conventional ethernet, other things like infiniband, and their technology.

    The main reason why it's fast is that it reduces the number of context switches, since less work is done by the kernel, and reduces the number of times that the data is copied from one buffer to another.

    These people have been working on this for some time and really know what they are doing. I'm suprised that it's as cheap as $500. If you need to accelerate a file server, web server, etc., then this is almost certainly a very cost-effective way of doing it.

    And please be happy that they've released it for Linux *first*! This really shows how important Linux is to server applications.

  99. Large ethernet packets by Colin+Smith · · Score: 1

    There's a good case for making use of large ethernet packets, e.g. 9k instead of 1.5k. Huge numbers of small packets do have a significant effect on systems. I have benchmarks which show a doubling or tripling of throughput and significant reduction in CPU overhead on some cards by changing the packet size.

    You do have to make sure all the machines on that particular LAN are using the same packet size and you're not routing the packets on to the general network, you'll see horrible performance problems if you do. So there's a case for a private backbone between high performance servers, used for inter server NFS, database queries, network backups etc.

    --
    Deleted
    1. Re:Large ethernet packets by NoMoreNicksLeft · · Score: 1

      Not to be picky, but an ethernet datagram is a frame. Packets are 1 level up.

  100. re: it's the OS ... maybe by pbhj · · Score: 1

    Could be the driver(s). Whether you consider that part of the OS or not is probably debateable (sp?).

  101. This'd typically go into an RDBMS server by Colin+Smith · · Score: 1

    Oracle, Sybase, Informix, MySQL, PostgreSQL etc.

    The problem is that splitting an RDB out over 10 sub $500 machines *isn't* simple and isn't necessarily going to increase your performance, it is quite likely to reduce it.

    It's a server network card and on a server, I/O is king, the CPU spends much of it's time waiting around for disk, then waiting around for the network. That isn't to say you can just grab all the CPU time to process ethernet packets, because you want the CPU available to run the application.

    These types of cards are just as important today as they have ever been.

    --
    Deleted
  102. no. busses arent fast enough... by anon+mouse-cow-aard · · Score: 1
    wild guess:


    cpu offloading makes sense if you have enough IO bus
    capacity to drive many cards. With PCI, you can saturate one gige network, and half of another. In a supercomputer from a few years ago, they used to use two slot PCI buses (had dozens of buses.) That would be a great place of TCP offloading, but most people arent going to notice.


    You need for the IO-bus to be vastly (say 10x or 100x) faster than the networking bus for it to be worthwhile, say to use SCSI-over-IP and get several Gbytes/second in real throughput over multiple channels. Commodity servers are stuck with a couple of hundred megabytes per bus, which cpus can handle. There isnt any point to scale to.


    Worse, Infiniband is going to make inside and outside buses, networking and storage technologies, go pretty much at the same speed.

  103. There is a huge market by varjag · · Score: 1

    Just find a way to promote it among the audiophiles.

    --
    Lisp is the Tengwar of programming languages.
  104. Alacritec is making accelerated adapters by scattol · · Score: 1

    Alacritec is/was making such accelerated adapters so the answer to this is yes, there is a market for them since there already is a competitor.

    However their website seems to have gone dead so maybe the ultimate answer is: No there is no place in the IT market for accelerated network cards.

    1. Re:Alacritec is making accelerated adapters by Anonymous Coward · · Score: 0

      It is spelled Alacritech. See www.alacritech.com.

  105. The Great Circular migration of Hardware by Ancient_Hacker · · Score: 3, Insightful
    This is yet another round of the GCMOH. Anytime there are idlle hardware engineers they find something that can be moved off the main CPU to hardware (or these days, almost always, another processor). This is almost always a bad idea:
    • Erecting yet another edifice brings on the huge and unavoidable overheads of yet another different CPU instruction set, yet another real-time scheduler, another code base, another set of performance and timing bottlenecks. Another group of programmers. Another set of in-circuit emulators, debugging tools, and system kernel. Another cycle of testing, bug fixes, updates.
    • It sets up a split in the programming team-- there's now much more reason for finger-pointing and argument and mistrust.
    • The extra money would usually buy you another CPU and lots of RAM, resources that would benefit every part of the system, not just the network I/O.
    • The separate I/O processor usually requires the geekiest and least communicative of the programmers-- not a good thing. The manuals for the I/O card are likely to be very brief and sketchy, and rarely up to date.
    • The I/O processor is almost always at least one generation of silicon technology older than the CPU, so even though the glossy brochures just drip with Speeeed! and Vrooom!-y adjectives, it's not that speedy in comparison to the CPU.
    For examples, see the $4000 graphics co-processor that IBM tried to sell for the PC (IIRC the CPU could outdo-it). The various disk-compression cards for the PC. Also see the serial ports on the Mac IIvx (very expensive and not noticeably better). Don't forget the P-code chip for the PDP-11/03. All very expensive and blase' performance/$.
    1. Re:The Great Circular migration of Hardware by Anonymous Coward · · Score: 0

      > Anytime there are idlle hardware engineers they
      > find something that can be moved off the main CPU
      > to hardware

      Actually what they're mostly doing is moving software out of the kernel and into user space. The hardware is not really much more complex than a standard card, just different.

    2. Re:The Great Circular migration of Hardware by MikeBabcock · · Score: 1

      I call FUD.

      I remember when Intel first tried to get soft modems introduced to sell faster CPUs. I kid you not -- the internal memos were that if you could sell soft modems which used CPU power to run the modem instead of hardware DSPs and whatnot, you'd save the consumer money on parts you don't produce (modems) and convince them to buy faster CPUs in the long run.

      USB has similar links to CPU horsepower, as does IDE, and AGP. Intel has always promoted such technologies to promote their CPU business, nothing wrong with that, but take their ideas with a grain of salt.

      That said, I prefered when my sound card had a DSP on board that could produce *quality* Yamaha music or do its own mixing well, without CPU time. How about modems that don't slow down your online gaming?

      You do realize that TCP checksumming on a 1Gbit ethernet link takes about 1GHz worth of CPU power?

      I have better things for my CPUs to do. CPUs *do not scale efficiently*. That's why we're all moving to multi-core, remember? Dedicated DSPs are much more efficient, even if redundant in cases where they go unused.

      In other words, sell soft modems for $10 and real modems for $80 and let the consumer buy the one that works better for them. Ditto for network cards. My home PC is only a Barton 2500+ but with a quality video card and $100 server network card, it performs better in online gaming that most of my friends' 3.2GHz machines.

      --
      - Michael T. Babcock (Yes, I blog)
    3. Re:The Great Circular migration of Hardware by marcosdumay · · Score: 1

      Don't generalise so much, GPU are usual nowadays, and some systems see great improvements from FPUs.

      Historicaly, almost every time that someone developped some co-processor, everybody uses it* (the most clear exceptions are math and network co-processors). But a lot of times the first one to develop the co-processor can't sell it because it is done too early and is very expensive by the time.

      * Or don't you use disk controllers, bus controllers, DMA, sound cards...

    4. Re:The Great Circular migration of Hardware by Ancient_Hacker · · Score: 1

      >You do realize that TCP checksumming on a 1Gbit ethernet link takes about 1GHz worth of CPU power? It's been a few years since I worked on TCP checksum routines, but IIRC on a Pentium you can interleave two 32-bit checksum ops, filling up the ol U and V pipes. Unroll the loop a few times and the code runs faster than memory can fetch. But you're correct-- this is an excellent example where a very little hardware (NOT another CPU!), can free up a CPU from humdrum additions. But most ethernet chips already have built-in checksumming hardware, so it's a bit OT.

  106. Low power systems by Halvard · · Score: 1

    These would be a good place for these, either with embedded slower x86 or non-x86 systems, Via C-3 processors, etc. It could provide an excellent way to reduce network bottlenecks and retain low environmental costs. Those are things that throwing money at faster CPUs can't touch.

  107. Well Duh... by sysadmn · · Score: 1

    If I'm going to spend $38,000 on a Sun V40Z, soon to have 4 dual-core Opterons, 16 GB RAM, dual fast SCSI disks, wouldn't I spend another $500 to keep it busy? If the product really works, it would be cost effective for squeezing a dollop of additional performance out of mid-to-high end "commodity" servers ($5-50K). Not everything is a $2k white box server or desktop. There are a lot of applications (Oracle, Apache, third party app servers) where it is already cost effective to buy the fastest processors and lots of memory. Paying a 10% premium (or less) for better network performance is easy to justify.

    --
    Envy my 5 digit Slashdot User ID!
  108. Clusters! by Globby · · Score: 1

    See subject... -G

  109. That's too much by dtfinch · · Score: 1

    I've been buying gigabit ethernet cards for $25 each. They're not as bad as the first generation. Beyond $100 or so you might be wasting your money.

  110. There May Be Truth by xcomm · · Score: 1

    I just think there could be some truth with this smart cards.

    It may be similiar to SCSI against ATA/IDE.

    I have some older workstation with an 3Com 3cSRV97 Thyphoon smart NIC and it is quite fast despite its age.
    Before some days I did a dd over netcat and the load was 2.65 IDE/Realtek Crap against 0.25 15K SCSI/3c97SRV NIC.

    Maybe there ist not all about CPU speed here, despite most people are only looking for this.

  111. only if.... by GweeDo · · Score: 1
    "Is There a Place for a $500 Ethernet Card?"

    Well, that depends. Does it support the following?
    • 256MB DDR2 memory
    • 16 Unified Pixel and Vertex Shaders
    • OpenGL 2 and DirectX 9
    • SLI mode for extreme performance
    If not...then nope, I will stick with something cheaper!
  112. It's NOT TOE!!! by Anonymous Coward · · Score: 0

    It surprises me how many people on slashdot either cannot or will not read. From the official website:
    http://www.level5networks.com/prod_etherfabric.htm

    "...
    In the conventional network I/O architecture, applications make Sockets or MPI function calls to interact with the network, and the Sockets library software converts these to system calls into the operating system kernel TCP/IP stack. With the EtherFabric architecture, Sockets and MPI function calls from applications invoke EtherFabric library routines that perform the necessary TCP/IP protocol processing in the user, or application, space. They move data directly to or from the virtual hardware interface that has been assigned to the specific user context. This approach eliminates context switching and greatly improves cache locality for both instructions and data, producing substantial reductions in latency and improvements in CPU efficiency.

    Furthermore, EtherFabric hardware notifies each user process about incoming packets by placing events on the event queue for the relevant virtual interface. EtherFabric software de-queues these events and performs protocol processing on incoming packets without the need for interrupts. Substantial further savings in CPU cycles are made by avoiding the inefficiencies of interrupt processing"

    What they are saying here is that ALL TCP/IP Processing is done in USER-SPACE. From what the blurb says I would assume the actual stack is in user-space and that only interaction with the kernel would be on connection setup/teardown. They don't say how they actually move data in and out of the application but I would bet my bottom dollar they probably do memory mapping or some other trick to allow data movement in and out of the application without corssing the kernel/user application boundary.

    The actual design seems like a combination of a very smart ethernet NIC and a kick-ass user-space application space IP stack. I can see a lot of advantages with this approach

    1. User-space network processing means more efficient resource usage and accounting
    2. User-space network processing means more efficient data transfer between application and stack.
    3. By doing the network processing in user-space on the host as opposed to a typical TOE, you are not constrained by the NIC. A faster CPU means you benefit from faster TCP/IP processing.
    4. This also makes upgrades and software bugfixes much easier and more maintainable -- replace a library as opposed to having to replace the card or firmware of the card.
    5. By using an efficient NIC with hardware support for virtual channels you have very efficient demultiplexing, you dont waste cycles in software oding this.

    Overall, it seems to have a lot of benefits --
    a)Because it's Ethernet based no need to rip out existing infrastructure
    b)Because it's normal tcp/ip as opposed to some weirdo network protocol it's well understood and compatible with existing technology
    c)because it's a drop in solution no need for application or kernel redesign and re-engineering.

    IMHO, if this does what it says it does, it will revolutionise traditonal ethernet cluster/data centre processing. It's analagous to a turbo-booster on a car, just switch it on and hold on to your hat. Their benchmarks [ http://www.level5networks.com/prod_etherfabricperf .htm ] seem to indicate just this.

    As faster networking technologies become more prevalent (eg 10 Gig Ethernet) the problem of network cpu consumption will become a bigger and bigger issue for server type applications. The toss up will be between this approach and the TOE approach -- coupled with the advent of multi-core CPU's I can see this being a much more flexbile solution than TOE's. However, time will tell.

  113. Why does the Slashdot crowd never get it??? by sugedaddy · · Score: 1

    It always seems to me that so many people who comment on Slashdot have an incredibly narrow view of the IT industry. A product like this is not intended for the home user. This is an enterprise product, designed for use in compute environments where you are shipping large volumes of data amongst computers, where removing the CPU load from the system free's up cycles for the system to do the real work it is intended for, and keep those CPUs supplied with enough data, so you're not waiting on IO. Enterprise adapters demand a significantly higher price than the $25 card you're putting into your uber gaming machine. When you're talking about systems with 20+ CPU's and 40+ gigs of RAM, you're in a different league altogether.

  114. It's NOT TOE!!!! by Mr5ingh · · Score: 1

    It surprises me how many people on slashdot either cannot or will not read. From the official website:
    http://www.level5networks.com/prod_etherfabric.htm [level5networks.com]

    "...
    In the conventional network I/O architecture, applications make Sockets or MPI function calls to interact with the network, and the Sockets library software converts these to system calls into the operating system kernel TCP/IP stack. With the EtherFabric architecture, Sockets and MPI function calls from applications invoke EtherFabric library routines that perform the necessary TCP/IP protocol processing in the user, or application, space. They move data directly to or from the virtual hardware interface that has been assigned to the specific user context. This approach eliminates context switching and greatly improves cache locality for both instructions and data, producing substantial reductions in latency and improvements in CPU efficiency.

    Furthermore, EtherFabric hardware notifies each user process about incoming packets by placing events on the event queue for the relevant virtual interface. EtherFabric software de-queues these events and performs protocol processing on incoming packets without the need for interrupts. Substantial further savings in CPU cycles are made by avoiding the inefficiencies of interrupt processing"

    What they are saying here is that ALL TCP/IP Processing is done in USER-SPACE. From what the blurb says I would assume the actual stack is in user-space and that only interaction with the kernel would be on connection setup/teardown. They don't say how they actually move data in and out of the application but I would bet my bottom dollar they probably do memory mapping or some other trick to allow data movement in and out of the application without corssing the kernel/user application boundary.

    The actual design seems like a combination of a very smart ethernet NIC and a kick-ass user-space application space IP stack. I can see a lot of advantages with this approach

    1. User-space network processing means more efficient resource usage and accounting
    2. User-space network processing means more efficient data transfer between application and stack.
    3. By doing the network processing in user-space on the host as opposed to a typical TOE, you are not constrained by the NIC. A faster CPU means you benefit from faster TCP/IP processing.
    4. This also makes upgrades and software bugfixes much easier and more maintainable -- replace a library as opposed to having to replace the card or firmware of the card.
    5. By using an efficient NIC with hardware support for virtual channels you have very efficient demultiplexing, you dont waste cycles in software oding this.

    Overall, it seems to have a lot of benefits --
    a)Because it's Ethernet based no need to rip out existing infrastructure
    b)Because it's normal tcp/ip as opposed to some weirdo network protocol it's well understood and compatible with existing technology
    c)because it's a drop in solution no need for application or kernel redesign and re-engineering.

    IMHO, if this does what it says it does, it will revolutionise traditonal ethernet cluster/data centre processing. It's analagous to a turbo-booster on a car, just switch it on and hold on to your hat. Their benchmarks [ http://www.level5networks.com/prod_etherfabricperf .htm [level5networks.com] ] seem to indicate just this.

    As faster networking technologies become more prevalent (eg 10 Gig Ethernet) the problem of network cpu consumption will become a bigger and bigger issue for server type applications. The toss up will be between this approach and the TOE approach -- coupled with the advent of multi-core CPU's I can see this being a much more flexbile solution than TOE's. However, time will tell.

    1. Re:It's NOT TOE!!!! by Anonymous Coward · · Score: 0

      Yeah sounds more like Tandem/Compaq ServerNet (vintage 1995?-2000) without the proprietary physical layer.

  115. Is there a place for it? by Java+Ape · · Score: 1
    Oh, I know this one, I've played this game before (from the techie side!), here's how it goes:

    So, you've developed a fine product, produced a few of them, and now you want to find "a place for it". This is called "marketing". My name is Mike, and I'll be your "marketing consultant" today.

    No,I don't actually produce anything, and all of your techno-babble is hurting my ears. Give me a one-sentence summary of your product, and sign this simple contract granting me 60% of the gross proceeds. Then I'll wave my magic marketing wand and generate an absurd list of overinflated or technically-impossible claims vaguely based on your one-sentence summary. Then I'll whip off some glossy copy (I'll need some up-front budget for that), and hang out with the lovely models we'll hire to promote your product. . . .

    Yes sir, that's how it's played. I'm Mike, are you ready to find your market?

  116. the PGA and the IIfx by YesIAmAScript · · Score: 1

    You meant the serial ports on the IIfx, not IIvx. They were 6502s that babysat the ports. Yeah, they pretty much sucked. They were worse at most things. They were actually better at receiving LocalTalk packets with virtual memory turned on than the standard ports though. But honestly, if you paid that much for your computer, you probably had an ethernet card.

    My understanding was the PGA actually accelerated autoCAD, which was enough for some people. Overall, it was a huge flop.

    Apple also had some video accelerators. The 8*24GC was their first one, it was rarely faster than the regular video card* and vastly less compatible.

    *The 8*24GC was faster for line-drawing operations, and also somewhat helped overcome the slow NuBus in the IIfx. But any decent onboard video (like the IIci and later) was much faster at all standard cases.

    On the topic, Apple also had a smart ethernet card (it used A/ROSE). It was also slower than a non-smart card. Apple released a "dumb" driver for it at some point that bypassed the coprocessor and was faster than the "smart" driver. They then released a card with all the smarts stripped off. It was much cheaper.

    I while I'm posting, I'm gonna say that I think that there is a market for smart NICs, for certain operations. I don't need one, but packet filters/forwarders definitely find them useful.

    --
    http://lkml.org/lkml/2005/8/20/95
  117. How it works. by JQuick · · Score: 2, Informative

    The white-paper and the web pages on the company site which describe the implementation talk about how this is done.

    This card, and the software which drives it, differ from traditional ethernet accellerator cards and from alternative network protocols (like myrinet and iWarp) in several ways.

    Alternative protocols not only require using a different software API but also require custom hardware at both communication endpoints.

    Traditional hardware TCP/IP accelerators run the bottom half of the stack in custom silicon. This does tend to help reduce host CPU load but suffer from a number of problems. Since host CPU speeds have tended to increase regularly, they often helped for only a brief period of time. They also tended to help most for large packets but helped little or not at all for small packets.

    This technology claims to help large and small packets equally well, and also claims to reduce packet latency across the board. It does so by running the bulk of the TCP/IP stack in user space rather than via system calls. The hardware runs ethernet Rx and Tx processing but does not implement the higher level IP protocol processing. Instead, once connections are established, the ethernet frames coming from the hardware, are fed via a system call interface to the application process to which they belong. Then, no further context switching between kernel and the process are required. The top end of the hardware driver and all of the subsequent IP layers, are executed in the context of the user space process. They are linked to the app via shared libraries.

    Basically, instead of the linking the IP calls against code which requires frequent switching between user and kernel space, the entire upper half of the stack is run by the application sending and receiving the packets. This offers uniform benefits in packet latency across all packet sizes, and offers improvement in throughput as well.

    I assume that all that is required is to link against a different set of shared libraries to gain these benefits (and of course to have the custom hardware on at least one side of the comm. link). This looks very good in principle.

    The following page provides an overview of the technology and compares it to each of the competing mechanisms.
    http://www.level5networks.com/sol_approaches.htm

    1. Re:How it works. by Phil+Karn · · Score: 1
      This is weird. The board was billed as an accelerator, but it seems little more than a conventional Ethernet controller with an unconventional host interface. Why that should cost $500 is beyond me.

      User-space TCP/IP is hardly new. I did it in 1986 on the IBM PC, mainly because there was no protected-mode OS available for the 8088 and 80286 at that time.

      I still think that as CPUs get arbitrarily fast that the conventional network protocol architectures will work just fine as long as the Ethernet hardware can actually run at full network speed and have halfway decent host interfaces.

  118. $500! That's ridiculous! by theendlessnow · · Score: 1
    Shoot all of my high end servers already cost me $200! What's next? A $130 copy of an operating system??!!!

    Sheesh... prices are just getting out of control.

    Now where did I put those 30pins SIMMs... time for an upgrade to 20M!!! Whoo hoo... I know sounds extravagent for somebody who is against $500 ethernet cards. So maybe I'm just being hypocritical.

  119. How do you have a job? by ad0gg · · Score: 1
    Listen, when I've got 30 web servers banging away on a single database server

    Where is your middle tier? Where is your redundancy? And you gave direct db access to web servers that on are on the public internet? So when your web server gets owned, the hacker has full access to the DB?

    Every bit of the handshake, ... is going to wrap up that much faster if things are faster

    Look up connection pooling.

    where every page renders around a hundred or more queries

    Wow. I'm lost for words. Seriously though, how do you have a job? This has to be the saddest architecture i've ever seen.

    --

    Have you ever been to a turkish prison?

    1. Re:How do you have a job? by ScentCone · · Score: 1

      Wow. I'm lost for words. Seriously though, how do you have a job? This has to be the saddest architecture i've ever seen.

      For crying out loud. All I'm doing it painting a very broad picture of a situation where somewhat faster local networking can improve performance. Of course I'm not describing it in greater detail (and don't really want to). There's pooling, caching, a middle tier (of redundant machines), load balancing on the web servers, failover clustering on the SQL side, and the whole thing's been running more or less like this for almost 5 years. It's kept patched, intrusion detection does a pretty good job, and the budget that paid for the architecture has actually paid itself back through actual use by real people paying real bills. Never been owned, doesn't go down. How do I have a job? The revenue that this (and other) systems generate more than pays for me. Is it perfect? No. But neither is it static, or written in stone. And it's paid for. Explore the rest of the thread a get a sense of the comparitively unusual nature of the pages being served, and the very difficult business rules being dealt with. You sure seem spoiling for a fight without much to go on - what axe did you think I was grinding, exactly?

      --
      Don't disappoint your bird dog. Go to the range.
  120. Why doesn't anyone want a company... by Anonymous Coward · · Score: 0

    ... named "Level 7"? The abbreviation would be L7. I guess that would just be too square, eh?

  121. Re:spend the money on more CPU, not specialized st by Tower · · Score: 1

    Of course, if everything used MSI or other "smarter" interrupts, things would be a little better, but the whole context switch problem is still costly regardless.

    --
    "It's tough to be bilingual when you get hit in the head."
  122. It's not a 1GB card FFS by Anonymous Coward · · Score: 0

    How can Timothy and the poster possibly feel entitled to comment on networking news when they cannot even distinguish between 1Gb ( GigaBIT, what this card is ) and 1GB ( GigaByte, what they wrote ).

    Stick to posting Apple Ads guys.

  123. Re:spend the money on more CPU, not specialized st by evilviper · · Score: 1

    Well, if Intel was to grant me a few million dollars for research, I'm sure I could come up with some ideal system within 12 months...

    Off the top of my head, I'd say some type of hybrid approach, using both polling and interrupts would reduce the problem immensely.

    Alternatively, you could stick to the old tried and true method of having a seperate chip in the system that does nothing else but service interrupts.

    --
    Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  124. Performance-Niche Markets Don't Last Long by billstewart · · Score: 1
    Hi, Phil - As long as you and I have been in the industry, there's been a constant process of people wanting to run applications that they think they can't do efficiently on their current CPUs, designing and sometimes building separate processors to implement them, people thinking that that's silly and inefficient and finding the real bottlenecks, fixing them, and moving the applications back into the main processor or the mainstream support chips, sometimes at the expense of building other I/O channels into the main processor.

    From a market perspective, there's often a period when it's more efficient to build new capabilities into a fancy expensive coprocessor than to fix the underlying bottlenecks. Sometimes you can start shipping boards before the problem goes away, sometimes you even sell enough to make tons of money, but sometimes only the top 1% of computers in the market are really affected so even if you sell it to everybody you don't make back your development costs. And sometimes people would buy the fancy cards for a while even if there were better approaches - back when Van Jacobsen was getting a 3 MIPS Sun 3/60's Ethernet to push 8 Mbps of FTP traffic by fixing the TCP and IP stacks, faster Intel 80386 and 80486 machines generally needed accelerator cards to get 4-5 Mbps instead of 1-2 Mbps, much of which seemed to be related to intricacies of DMA and interrupt handling on the PC as well as on slow bus speeds. Of course, the prices have changed by a few orders of magnitude - it was hard to make money selling $1000 cards when the bottom end of the market was $500, but it's a lot harder when the bottom end of the market is $19 (for gigE, or $3 for 10/100) and the moderately-expensive cards cost $79.

    The grandparent article was talking about ATM processor cards, so I'd guess the timeframe is about 5-7 years ago when some people still believed in ATM to the desktop. It looks like my online copies of Fore manuals are from 1999, and when we bought the switch in my lab, the vendor threw in a couple of PCI-based ATM cards which could ostensibly work in both a PC and our blazingly fast Sparcstation 5, though we never did try it in the Sparcstation. The card had some critical ATM features implemented in hardware - segmentation/reassembly between AAL-5 data frames and the layer 2 53-byte cells, priority queuing for different types of ATM PVCs, and ABR flow control. It probably also did AAL-5 frame headers and checksums, and it wouldn't surprise me if it also did UDP checksums just because it had hardware around. Ethernet cards in those days had reputations ranging from deadly stupid to adequately smart to way too clever to be actually useful, pretty much as they do today.

    These tradeoffs happen in lots of other parts of the architecture - people like Henry Spencer used to argue in favor of dumb-framebuffer graphics systems with CPUs doing the heavy lifting, but most of the higher-end graphics cards today use the card for SIMD crunching on features like shading and textures, with an AGP*N channel into the CPU because PCI is too slow, and the CPU-vs-card arguments are mainly for geometry calculations (I think CPU is mostly winning?) Serial I/O, to the extent anybody still uses it, seems to have mostly moved into the Southbridge chips, but before that you could get a major performance win by using a 16550A UART instead of the dumber UARTs, and of course I remember the Sys3 / Sys5 folks using Unibus KMC11s to service the DZ11 I/O processors for functions like cooked-mode I/O rather to avoid bothering the CPU (I don't remember the BSD folks ever adopting that, but I don't remember why at this point; perhaps emacs made cooked-mode uncommon enough that it wasn't worth the bother, or maybe the new tty driver could get more work out of a dz11.)

    One other place where there's an ongoing argument between using the CPU vs. an I/O board is modems - the Windows side thinks it makes much more sense to do most of the work in the CPU, and use a dumb modem with a fast PCI interface, while the Linux fo

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
    1. Re:Performance-Niche Markets Don't Last Long by Phil+Karn · · Score: 1
      Hi Bill, long time no see!

      My position on smart vs dumb peripheral cards is really limited to network interfaces. There, the protocol operations to be performed on every data byte are way down in the noise compared to the operations to be performed on that same data in the application.

      Video controllers are an entirely different story since a lot of very specialized processing has to be done to produce every tiny pixel of image data. There it makes a lot of sense to have specialized graphic engines, especially since there is a large gaming market to amortize the non-recurring engineering costs.

      The same can be said of modems since many specialized DSP instructions also have to be executed to send or receive a byte of data. However, dialup modems operate at such slow speeds (and, thanks to Claude Shannon, will never operate faster than 64kb/s) that even these complex operations can be done in real time on modern host CPUs with most of the CPU left over. And all the latest general purpose CPUs implement a pretty powerful DSP engine in the form of MMX, SSE, SSE2, SSE3 and Altivec. So I think Linux's problems with the Winmodem have more to do with the inability to implement standard dialup modem functionality in open source software because of patents than any fundamental technical reasons. Also, there is (still) a large enough market for dialup modems that the NRE can be easily amortized. I.e., external modems are dirt cheap, so why not just use them?

      Yes, you're right that there have been (and probably will continue to be) short windows of opportunity for so-called "smart" (and expensive) network cards, most often in legacy systems that can't easily be replaced, but in the long run I think Van Jacobson's position has already been adequately vindicated. You just can't compete with mass produced general purpose CPUs when you're executing a network stack.

  125. Re:you're a moron by Omnifarious · · Score: 1

    It's certainly not my best post. But I don't think it's quite that bad.