Slashdot Mirror


Can You Purchase Switch Hardware Without an OS?

dhahn asks: "I have a project where I'm building a large Linux router (about 40 ports or so). At this point, my only hardware solution is to purchase a box with lots of PCI-ish slots and fill them multi-port ethernet cards. I've looked into currently available solutions and haven't found anything that gives me the control I want. Does anyone know of where I could purchase a 'naked switch?' I just want the switch hardware with enough guts to allow me to customize a Linux OS and load it up." If anyone else has been in this situation, what did you do?

23 of 70 comments (clear)

  1. VLAN by bartjan · · Score: 4, Interesting

    Why not use any managable switch, configure each port into its own vlan, hook up the Linux box to a trunk port and use Linux's vlan support, like anyone else does?

    1. Re:VLAN by Cecil · · Score: 2, Insightful

      That doesn't seem like a great solution. It's possible I don't understand what you're suggesting, my experience with high end switches is limited, but from what I understand, if I've got Port A transferring to Port B at 100Mbps, and port C transferring to port D at 100Mbps, it would all have to go over the the same trunk (twice!) to be switched by the Linux box, no? Even if the trunk was gigabit and the ports only 100mbps, you can still only have at most 8 ports transferring before you've saturated your switch. If the ports are all gigabit, then you've just hamstrung yourself completely, no?

      If you want to correct me, go ahead, I am a networking newbie, but that just doesn't seem efficient to me compared to actually running Linux at the switch's hardware level.

    2. Re:VLAN by silas_moeckel · · Score: 2, Informative

      Your numbers are fairly correct, the biggest interface that you can buy for a PC is 10ge assuming multiple cards per server you can get some decent bandwidth. Now PC's are not designed to do this they have high latency's and comparatively slow bus speeds as compared to say a cisco 6509 (very common managed switch) I would assume that they are looking to something more complex than just switching.

      --
      No sir I dont like it.
    3. Re:VLAN by operagost · · Score: 3, Informative
      You do realize that 64-bit, 66 MHz PCI cards are readily available and nearly universally supported in enterprise hardware? And that PCI-X cards running at 133 MHz are not exotic? Oh yeah... and there's PCI-Express.

      You're not even correct about the crossover. Automatic crossover is supported on all kinds of 100baseT gear, although it is not required as it is in the 1000baseT standard (because the Fast Ethernet standard predates the tech).

      --

      Gamingmuseum.com: Give your 3D accelerator a rest.
    4. Re:VLAN by Short+Circuit · · Score: 2, Informative

      Thanks for the info. And the civil tone.

  2. if you would like by Amouth · · Score: 4, Funny

    if you would like i can buy a switch and flash it with nothing and sell it to you.. but money frist and no returns.

    --
    '...if only "Jumping to a Conclusion" was an event in the Olympics.'
  3. PCI-ish? by gEvil+(beta) · · Score: 3, Funny

    I'm not sure if I'm familiar with the 'ish' variant of the PCI slot. Could you please elaborate?

    --
    This guy's the limit!
  4. bandwidth limitations, and large PCI backplanes by Robbat2 · · Score: 5, Informative

    Limitations:
    - PCI bus bandwidth is going to hurt you hard. 32-bit PCI @ 33Mhz = 127Mbyte/sec. 64-bit PCI-X @ 66Mhz = 508Mbyte/sec.
    - 100Mbit ethernet = ~10Mbyte/sec (assume 10b8 encoding, easier numbers).
    - 127Mbyte/sec / ~10Mbyte/sec = 12 100Mbit ports only.

    If you aren't deterred by this:
    1. Get a motherboard.
    2. Get a decent PCI backplane. A quick Google search brings this company:
    http://www.commell.com.tw/Product/Peripheral/Backp lane/backplane.HTM
    and they have a backplane with 17 PCI slots.
    3. Buy 4-port PCI 100mbit network cards (http://www.americanpredator.com they don't list it on their site, but I'm certain they do custom quad port cards, or can point you to somebody that can, $500/card for industrial grade hardware).
    4. 17*4 = 68x 100Mbit ethernet ports.

    --
    ICQ# : 30269588
    "I used to be an idealist, but I got mugged by reality."
    1. Re:bandwidth limitations, and large PCI backplanes by kneecap · · Score: 5, Informative

      Use PCI Express instead, it has dedicated serial bandwidth to each slot instead of shared bandwidth for all PCI or PCI-X slots connected to a PCI controler.

      From http://en.wikipedia.org/wiki/List_of_device_bandwi dths
      PCI 32-bit/33 MHz 1066.66 Mbit/s 133.33 MB/s
      PCI Express (x1 link) 2500 Mbit/s 250 MB/s
      PCI 64-bit/33 MHz 2133.33 Mbit/s 266.66 MB/s
      PCI 32-bit/66 MHz 2133.33 Mbit/s 266.66 MB/s
      PCI 64-bit/66 MHz 4266.66 Mbit/s 533.33 MB/s
      PCI-X 133 8533.33 Mbit/s 1066.66 MB/s
      PCI Express (x4 link) 10000 Mbit/s 1000 MB/s
      PCI Express (x8 link) 20.00 Gbit/s 2 GB/s
      PCI Express (x16 link) 40.0 Gbit/s 4 GB/s

      The big routers and switches use PCI/PCI-X on their backplanes and when some of them started doing 10Gig ethernet ports the ran into the PCI-X bandwidth limit of abouth 8.5 Gbit. So do like Cisco & the others did and start using PCI-E. I saw another post here mentioning multiport gigabit ethernet cards for PCI-E slots made by Silicom: http://www.silicom-usa.com/

  5. OS-Less-Switch won't help by Anonymous Coward · · Score: 5, Insightful

    Even if you could buy just an "OS-less" switch, I don't think it would do you any good. Most switches have hardware fast-paths for switching packets. You'd have to completely disable the switching logic, and redirect all frames through the host CPU.

    Some of the switch ASICs I'm familiar with [medium range broadcom, vitesse] are in fact slower at sending a packet through the host control interface, than at simply switching it to a port on which a host cpu might be connected. [Reference designs from the above have the host CPU connected to the host interface, and control packets, ssh, telnet, http, depending on the design captured and sent through it]. In that case, you'd need your host CPU to be connected to one of the ports of the switch, and then of course your routing speed is limited to the maximum speed that can be sent through a single port.

    One of the posters above me mentioned buying a managed switch and using VLAN's, thats what I woulda suggested had he not beat me to it.

    Good Luck!

  6. Get a Cisco by grub · · Score: 2, Insightful

    Forget your hackish idea. Get a Cisco 3750-48 style switch and all will be well.

    --
    Trolling is a art,
  7. Is this even a good idea? by ErikTheRed · · Score: 5, Insightful

    The poster leaves a lot of stuff out - like what's the bandwidth per port? Are they routing analog dial-up lines or gigabit ethernet? What protocols are they routing? Do they need ACLs? How many? Other filtering? Proxying? And if the installation is really that big, just lay out the $jack for a layer-3 or higher switch or router or firewall or whatever.

    Not to be a dick, but if the poster has to Ask Slashdot about this sort of configuration, he or she has no business messing with this and should leave the design and configuration to grown ups (unless it's a lab experiment or something).

    --

    Help save the critically endangered Blue Iguana
    1. Re:Is this even a good idea? by grub · · Score: 3, Funny


      Not to be a dick, but if the poster has to Ask Slashdot about this sort of configuration, he or she has no business messing with this and should leave the design and configuration to grown ups (unless it's a lab experiment or something).

      You're being a dick, but the truth can be dicky. :)

      --
      Trolling is a art,
  8. What are you looking for? by mnmn · · Score: 5, Interesting

    You want to build a router, but you are looking for switch hardware.

    You are asking for independent ports. If you need to route through each port seperately and not 'switch' data between ports but 'route' it among them then you need router hardware not switch.

    See the thing with switches is that chips are available with 4 ports or 8 ports and it automatically switches data in ASIC between ports. Usually these chips cannot be interfaced to a microcontroller and almost never have PCI interfaces.

    You do need individual ports, not a switched collection of ports. So you need something with 7 PCI ports (7x4=28). There are plenty of 4-port PCI cards out there, but there must be 8-port cards too. I have seen plenty of 6-port motherboards. You will have to use PCI extension devices to get to 7 or 8 ports unless you find those 4+ port ethernet cards. Do keep in mind you cannot switch between all ports at wire speed. You'll need faster busses and powerful processors. At this point you're looking at highly specialized hardware like cisco juniper etc.

    It is inefficient to route between that many ports on a single CPU. Its better to cascade entire routers if your design allows it or add switches to routers with fewer ports. Unless you are a telco providing high speed connections to ISPs or a central location breaking the bandwidth for many branches, I dont see why anyone will need a router with 30 ports. In any application when you need more processing power, you'd divide the algorithm and use multiple CPUs or multiple computers. In this case you can almost definitely use cascaded routers if you need that many ports in the first place.

    I have a Cisco 4700M router with 12 10-mbit ethernet ports. Never needed more than 3.

    --
    "Give orange me give eat orange me eat orange give me eat orange give me you." -Nim Chimpsky
  9. more data needed by clydemaxwell · · Score: 2

    Are you routing or switching? What purpose do you have that requires linux specifically? Are you just anti-Cisco, anti-brand name?

    You specify that you are building a router then request a switch hardware. What level are you managing your network at? What kind of throughput are you trying to get (10/100, 100 full, gigabit?) Are you managing at the port level or at the IP level (switching vs routing)?

    Elaborate and maybe then we can get you some answers :)

    --
    Browsing with classic discussion, noscript, at -1 and nested
    no hidden comments and I only mod UP
  10. VLANs work great for this. by jafo · · Score: 2, Insightful

    Get a normal Linux box with 1 or maybe a few ethernet ports (you can bond them together, if you like), and then connect a 48-port switch that supports VLANing. Set up the ports to the Linux box to pass all 40+ VLANs tagged, and then set the ports that are not connected to the Linux box as untagged ports. You now have each of the switch ports effectively as an interface on the Linux machine.

    I've done this for cases where I needed a small machine to run with more ethernet ports than it's actually got. Works great.

    Sean

  11. Used cisco or foundry by anticypher · · Score: 3, Interesting

    Depending on how adventurous you feel about getting linux running on strange hardware, you could buy a used cisco or foundry L2/L3 box for cheap. I know there are a lot of linux projects at cisco, there must be something you can google about how they went about compiling for the platform. The CPUs inside will be something non-mainstream, i.e. not a pentium, but chances are there is a linux distro for it. It shouldn't be that hard to find some archived info on how to bootstrap a linux distro onto one of those boxes.

    Used cisco 3500s or 2950s with 24 or 48 ports are on the market for a few hundred (dollars or euros) each. Foundry workgroup switches are less than 100 euros right now. Cisco 7200s are just PCs inside, but their PCI buses are a different layout to allow hot swapping. Cisco Pix 515s are just commodity 1U intel pc motherboards, cisco didn't even bother doing a redesign to remove the superfluous connectors.

    If you have enough money for a PCI-ish box and many quad ethernet NICs, then you probably could afford a used Juniper M5. It already runs BSD, and pretty much looks like standard PC hardware inside. A used M5 without any interface cards should be had for less than a new PC, its the interface cards that will cost you dearly.

    If you follow my advice, then with any luck you will document everything you did along the way, and release a linux distro for some otherwise proprietary hardware. I'd like to see a cisco 2950 turned into a linux box with all kinds of extra linuxey features. What I'd love to see is openBSD's pf on a switch, so I could set per port ACLs and bandwidth shaping.

    the AC

    --
    Hemos is like...sci-fi fans;he thinks technology is cool, but he hasn't bothered to understand the science it's based on
  12. Re:Hmmm by amorsen · · Score: 3, Interesting

    I would suggest investing time looking into something such as Cisco 3750 series switches.

    I can't speak for the original poster, but in our case we needed VLAN's to be unique per port. That is, VLAN 100 on port 1 should be switched to VLAN 105 on port 2, and VLAN 100 on port 2 should be switched to VLAN 200 on port 3 and 4, and so on. Trivially easy to do in Linux, not so with a 3750. You can do it with VLAN mapping, but you can also buy quite a server for the price of a 3750 and the Advanced IP Services image. Oh and the 3750 supports only 24 VRF-lites, whereas you can run quite a few more OpenVZ instances with routing on a Linux box.

    --
    Finally! A year of moderation! Ready for 2019?
  13. Router Hardware != Switch Hardware & Suggestio by grondak · · Score: 5, Insightful

    Hardware switches can look straight at layer 2 encapsulation and shuffle packets based on that information. The switch's main CPU never sees the packet. The "naked" version of the switch still has enough main CPU in it to program the switch controller chip(s). More "clothed" switches have the spanning tree protocol, SNMP bits, and any other cool features you might have.

    Routers have to look at layer 3. Back when I was writing code for a major switch/router manufacturer, most switch chips didn't pass the (de-encapsulated) packet up to the main CPU (or back down). The chip only gave notification that a packet arrived (etc) in the form of an incremented register. This meant the chips were unsuitable for routing because the main CPU had no visibility into the packet whatsoever.

    Either of these designs generally require a separate Ethernet NIC for the main CPU, as the switch ports are too busy with external connections. That NIC might be connected to the switch chip on the switch's main board, or it might appear externally as a "management interface port." You'll be programming this NIC, too-- but hopefully, just with ifconfig(1M)

    Suggestion: Look for commercial switch chips that can pass the packet to and from the main CPU. Find a company which has a COTS switch with the combination of your favorite switch chip and a CPU that will run your Linux version (or uCLinux). Make sure the implementation hardware is wired properly to be able to get the packets to and from the main CPU-- your favorite chip might have a separate HW interface for communicating with the main CPU that could be unconnected in the implementation hardware. At this point, you essentially have the naked switch that can route. Learn how to boot Linux on the implementation hardware and build a flash filesystem that the switch's bootloader will read. Then start writing code to add the capability you require (to routed?).

    Suggestion: Once it works, sell the thing. Or open the source up for others. You went through a lot of trouble to get that capability in the system, and it's got to be so cool because it isn't already in a commercial router. You might consider selling it on the open market yourself, or finding someone to sell it to. Or drop it on Sourceforge for others to upgrade.

    Suggestion: Or, you can get your cool feature embodied as an RFC and get the main router vendors to build it in. Or contribute the code to routed(or whatever). You can probably skip the effort of building this one-off switch/router.

    --
    [Error 407: No signature found]
  14. Try ImageStream by mossmann · · Score: 2

    Many people have pointed out reasons why this kind of thing is probably a bad idea, but if you still want to do it, ImageStream sells hardware platforms that can include several multi-port ethernet boards. There are reasons why they are marketed as routers and not switches, but they might be useful as switches for some unusual purpose.

  15. "Switch" by CmdrPorno · · Score: 3, Funny

    AFAIK Apple only sells their hardware with OS X. And if you bought it without an OS, you probably wouldn't be switching. Also, the "Switch" ad campaign has been replaced with the "Get a Mac" ad campaign:

    http://www.apple.com/getamac/

    --
    Sent from my iPhone
  16. linuxdevices by marros · · Score: 2, Informative

    If you go to www.linuxdevices.com and look around, there are several vendors who sell sbc's that have ethernet switches as backplanes, you can add as many as you want. The underlying cpu is either a strong arm, or x86 compat cpu, some have mini-pci slots, etc. And they all run linux!

  17. Zorch depends on your needs by davidwr · · Score: 2, Insightful

    A 40-port router or switch that has typical office workstations with typical "office" use doesn't require a HUGE amount of power. Most users will drive minimal traffic during office hours except when accessing network resources, which will probably be bursty and random in nature. Realisticly, an office like this would probably have a 48- or two 24-port switches costing a few hundred dollars each, with a router to manage external traffic.

    Now, throw half a dozen servers on there along with a few machines that are accessing the outside world 24x7, and now you need some beef and the corresponding dollars.

    If it's 40 servers in a server farm, then you are absolutely correct, the user should be prepared to spend big because a cheap router or switch or PC-based solution just won't do the job.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.