Slashdot Mirror


1.6 Million IP Connections on FreeBSD

An anonymous reader writes "FreeBSD developer Terry Lambert, in a recent posting to the 'freebsd-hackers' mailing list, mentioned that he'd tuned a FreeBSD 4.4 box with 4GB of RAM to achieve 1,603,127 simultaneous IP connections, and goes on to say: 'As far as I know, I hold the single machine connection record for an x86 box.' This is an impressive achievement any way you look at it (though it begs the question of whether or not the box had any resources left to actually do anything with those connections...), and it speaks well of both FreeBSD's capabilities and Terry's skills and knowledge. I'm curious, though, if anyone has approached, matched, or exceeded that number elsewhere?"

74 comments

  1. Nobody cares by xdfgf · · Score: -1

    Next article please

  2. Alternative Headline: by leviramsey · · Score: 5, Funny

    *BSD handles 1.6 million connections without dying.

    1. Re:Alternative Headline: by Anonymous Coward · · Score: 0

      Somebody meta-mod this moderator.

      This is a funny post in my opinion. A good response to the BSD dying trolls.

    2. Re:Alternative Headline: by Directrix1 · · Score: 1

      The real question here is what is the other machine he was connecting too. Man that sucker must be one bad ass mother.

      --
      Occam's razor is the blind faith in the natural selection of least resistance and in universal oversimplification. -- EF
  3. No need to beg. by gaj · · Score: 0, Offtopic

    It doen NOT beg any damn question. The claim may suggest a question, or raise a question or perhaps.

    Does any-fucking-body know the meaning of "begging the question"? I don't believe I've heard correct use of the phrase even once in the past year.

    </peeve>

    1. Re:No need to beg. by remou · · Score: 1

      sweet...:-)

      as a non native english speaker I had
      no bloody clue about the correct use of
      begging the question...

      thanx

      remosito

    2. Re:No need to beg. by Tesseract · · Score: 0, Offtopic

      how in the hell did you get mod'd to 2?

      --
      Show me what you want, and I'll show you how to get along without it...
    3. Re:No need to beg. by Anonymous Coward · · Score: 0

      I don't believe I've heard correct use of the phrase even once in the past year.

      Well, you deserve at least one correct usage, so how about this?

      "If God didn't intend us to eat animals, it begs the question, 'Why did he make them out of meat?'"

    4. Re:No need to beg. by NDPTAL85 · · Score: 0, Offtopic

      I want food, water and air. Now show me how to get along without those.

      --
      Mac OS X and Windows XP working side by side to fight back the night.
    5. Re:No need to beg. by Anonymous Coward · · Score: 0
      "If God didn't intend us to eat animals, it begs the question, 'Why did he make them out of meat?'"

      Of course this begs the question of whether or not your sentence is really correct usage.

    6. Re:No need to beg. by Tesseract · · Score: 1

      1. deprive yourself of food, air, and water
      2. ?????
      3. PROFIT

      --
      Show me what you want, and I'll show you how to get along without it...
    7. Re:No need to beg. by DAldredge · · Score: 1

      No one on slashdot uses that phrase correctly just like everyone on /. thinks alot is a word.

      You can't win. Just give up, you will live longer.

    8. Re:No need to beg. by NDPTAL85 · · Score: 0

      ROFL

      --
      Mac OS X and Windows XP working side by side to fight back the night.
    9. Re:No need to beg. by Arnold_Crenshaw · · Score: 1

      Insightful, yes.

      But what of the idealists? Perhaps we don't care how long we live, but just to spread the truth! (e.g., that conventions are found in a dictionary, but ignored out of arrogance.)

      This has its problems, of course. For example, how do you really know if you get through to someone? And then, after a while, should you care at all? If you question someone, you are consistently attacked for being hubristic; when in reality you really can't fathom what they're thinking, yet they know they know everything.

      There's a point at which clear speech doesn't work anymore, but establishing clarity goes a long way to extending its possibilities. Sarcasm, meta-funny jokes, and textbook "trolling" can make anything mean anything else. Acknowlegding this is the first step in making one's intent clear. But how do you make people desire clarity? I sure as hell don't know.

      Perhaps unfortunately, I can't help but realize that people are wrong most of the time (I think slashdot is fairly representative of real life s:n, believe it or not). That's what I know. I know very little else.

      If everything were not a personal attack on someone's faith in their own knowledge (which is humourous: they proclaim to posess the knowledge, yet refuse to show it for fear of being proven wrong, yet defend it anyway), then... well, that would be love.

    10. Re:No need to beg. by Phantasmo · · Score: 1

      No matter how much you drag your feet, you won't be able to stop English from evolving.

      Don't worry, though - it happens to alot of languages. ;)

      --

      The US Army: promoting democracy through unquestioned obedience
    11. Re:No need to beg. by Anonymous Coward · · Score: 0

      It helps if you think of it as "beggaring the question" i.e. "devaluing the question".

      Politicans do it all the time.

  4. sure by pizza_milkshake · · Score: 4, Funny

    my webhosting box does twice that during peak hours, but then i'm hosting free porn so it doesn't count ;)

    1. Re:sure by tigga · · Score: 1
      my webhosting box does twice that during peak hours, but then i'm hosting free porn so it doesn't count ;)

      It was not quantity of pages served - it was amount of concurrent opened connections to box.

    2. Re:sure by Anonymous Coward · · Score: 0

      i host my free porn at sexiestserver.com and when i flood it with tgp traffic it sure holds up.. i asked them what OS they are using and they said they are "running freebsd, what else?"

    3. Re:sure by Anonymous Coward · · Score: 0

      Ah, there's nothing like TGP traffic to verify if the server is configured right. :)
      That and all those annoying .jp users with their silly download agents that never fail to travel an entire tree of links of no value to them.

    4. Re:sure by ickyfreak · · Score: 0

      tgp? eh?

      --

      ---------------
      100% Australian

    5. Re:sure by Anonymous Coward · · Score: 0

      Testicular Goat Porn

    6. Re:sure by pizza_milkshake · · Score: 1

      yeah, i know.

  5. Oh please by Anonymous Coward · · Score: -1, Offtopic

    I was seriously considering using BSD based on this awesome stat, but the illeteracy displayed by this improper useage of "begs the question" has changed my mind.

    1. Re:Oh please by Anonymous Coward · · Score: -1, Offtopic

      I think you mean illiteracy , Mr. Grammar.

  6. FreeBSD v. Linux by Groganz · · Score: -1, Offtopic

    Nah, just kidding.

  7. Prove it... by aridhol · · Score: 4, Funny

    Post the address of that box here. We'll give it a real stress test.

    --
    I can't say that I don't give a fuck. I've just run out of fuck to give.
    1. Re:Prove it... by Anonymous Coward · · Score: 0

      d00d it's goatse.cx

  8. Intellectual Property connections? by merlyn · · Score: 1, Funny
    That's a lot of connections to the intellectual property of others. Perhaps he should get a lawyer.

    "What kind of artist are you?"

    "I'm a 'Prior Artist'."

  9. More Interesting by mnmn · · Score: 4, Insightful


    What has been tested is simply the number of concurrent connections. More practical would be simple retrieving of say 1kb data from a database and printing it out on a very simple HTML, and checking the maximum number of THESE connections. In effect trying to really httpblast DDoS style the FreeBSD with sheer number of connections. The box will have to be massive with 4GB RAM at least (we're testing OS here not hardware) and the connection maybe (multiple?) gigabit ethernet. The result would theoretically be lower than 1.6 million but we need to show FreeBSD can scale in practical tests like these. Results from a test like that will have the power to change vendors' minds from trying to run IIS and MS SQL for a high volume site.

    --
    "Give orange me give eat orange me eat orange give me eat orange give me you." -Nim Chimpsky
    1. Re:More Interesting by hfastedge · · Score: 2, Interesting

      theres no point in the mysql test on top of the ip test, it then becomes even moreso a pure kernel test (eg scheduler/vm....), plenty of which have been done.

      But i do think that serving out 1k of html would make the test a bit more solid.

      Id be interested, given this narrow field thats being tested on how linux would hold up under the same tweaking, and what tweaking exactly that would require as compared to the freebsd (yes its probably trivial, but im just curious).

      --

      -- -- --

      Help my mini cause: My journal

    2. Re:More Interesting by Anonymous Coward · · Score: 0

      Results from a test like that will have the power to change vendors' minds from trying to run IIS and MS SQL for a high volume site.

      I think looking at the table at the bottom of this page should convince people.

      "If it's good enough for Microsoft, it's good enough for you" makes a good slogan.

    3. Re:More Interesting by wabb1t · · Score: 2, Funny

      Great! There were rumours that FreeBSD was still being used at Hotmail, and this seems like possible proof.

      Now if we could only see some actual hotmail pages served by that machine...

    4. Re:More Interesting by DotComVictim · · Score: 2, Insightful

      The test you propose is not a more interesting test. It is simply a different test.

      The original test is designed to stress the theoretical maximum number of connections, which exercises the network stack, in particular the pcb hashing mechanisms and multiple IP address handling.

      The test you propose is a real world scalability test, which has a much different purpose.

    5. Re:More Interesting by bigberk · · Score: 1

      Wow! 64.4.22.23 is a Microsoft hotmail.com server and it does appear to be running Apache on a BSD server.

  10. *BSD is dying by Anonymous Coward · · Score: -1, Troll
    It is official; Netcraft now confirms: *BSD is dying

    One more crippling bombshell hit the already beleaguered *BSD community when IDC confirmed that *BSD market share has dropped yet again, now down to less than a fraction of 1 percent of all servers. Coming on the heels of a recent Netcraft survey which plainly states that *BSD has lost more market share, this news serves to reinforce what we've known all along. *BSD is collapsing in complete disarray, as fittingly exemplified by failing dead last in the recent Sys Admin comprehensive networking test.

    You don't need to be a Kreskin to predict *BSD's future. The hand writing is on the wall: *BSD faces a bleak future. In fact there won't be any future at all for *BSD because *BSD is dying. Things are looking very bad for *BSD. As many of us are already aware, *BSD continues to lose market share. Red ink flows like a river of blood.

    FreeBSD is the most endangered of them all, having lost 93% of its core developers. The sudden and unpleasant departures of long time FreeBSD developers Jordan Hubbard and Mike Smith only serve to underscore the point more clearly. There can no longer be any doubt: FreeBSD is dying.

    Let's keep to the facts and look at the numbers.

    OpenBSD leader Theo states that there are 7000 users of OpenBSD. How many users of NetBSD are there? Let's see. The number of OpenBSD versus NetBSD posts on Usenet is roughly in ratio of 5 to 1. Therefore there are about 7000/5 = 1400 NetBSD users. BSD/OS posts on Usenet are about half of the volume of NetBSD posts. Therefore there are about 700 users of BSD/OS. A recent article put FreeBSD at about 80 percent of the *BSD market. Therefore there are (7000+1400+700)*4 = 36400 FreeBSD users. This is consistent with the number of FreeBSD Usenet posts.

    Due to the troubles of Walnut Creek, abysmal sales and so on, FreeBSD went out of business and was taken over by BSDI who sell another troubled OS. Now BSDI is also dead, its corpse turned over to yet another charnel house.

    All major surveys show that *BSD has steadily declined in market share. *BSD is very sick and its long term survival prospects are very dim. If *BSD is to survive at all it will be among OS dilettante dabblers. *BSD continues to decay. Nothing short of a miracle could save it at this point in time. For all practical purposes, *BSD is dead.

    Fact: *BSD is dying

  11. What's your IP? - Re:sure by pbulteel73 · · Score: 1

    Maybe I've visited...

  12. BSD has many uses..... by Anonymous Coward · · Score: -1, Troll

    Attention Ladies!
    Every 14th of February men get the chance to display their fondness for
    their wife's or girlfriends by showering them with gifts, flowers,
    dinner, shows and any other baubles that women find romantic.
    Secret... guys feel left out. That's right... left out. There's no
    special holiday for the ladies to show their appreciation for the men
    in their lives. Men as a whole are either too proud or just too
    embarrassed to admit it. Which is why a new holiday has been created.

    March 20th is now officially "Steak and a Blow Job Day"

    Simple, effective and self explanatory. This holiday has been created
    so you ladies can have a day to show your man just how much you love
    him. No cards, no flowers, no special nights on the town. The name of
    the holiday explains it all... just a steak and a BJ. That's it. This
    twin pairing of Valentine's Day and Steak and a Blow Job Day will usher
    in a new age of love as men everywhere will try THAT much harder in
    February to ensure a more memorable March! It's like a perpetual love
    machine.

    1. Re:BSD has many uses..... by Anonymous Coward · · Score: -1, Offtopic

      What about gay couples?

  13. "Connections" -- ? by brianjcain · · Score: 1

    What are IP "Connections"? AFAIK, the transport layers can have connections, but not the network layer. IP has datagrams. I did RTFA, but there's not a whole lot of context in that message, and I was too lazy to go read the whole thread. Are they just talking about TCP connections, or what?

    1. Re:"Connections" -- ? by cperciva · · Score: 2, Informative

      You evidently didn't RTFA carefully enough -- the subject line ("max simultaneous TCP connections") should have been a giveaway.

    2. Re:"Connections" -- ? by brianjcain · · Score: 1

      I'll be danged. Sure enough, there it is. I sit corrected.

  14. FreeBSD is dying by mcgroarty · · Score: 5, Funny

    ...to take on heavy server loads.

  15. Bahhh. by Anonymous Coward · · Score: -1, Troll

    This is just something else Apple will steal from the BSD'ers.

    1. Re:Bahhh. by tigga · · Score: 3, Insightful
      This is just something else Apple will steal from the BSD'ers.

      You can't steal anything that already free.

    2. Re:Bahhh. by Arandir · · Score: 5, Insightful
      This is just something else Apple will steal from the BSD'ers.

      There once has a fabulous apple tree. No matter how many apples one would take from it, there were just as many as before! When this was heard by the villagers they all rushed to the apple tree and took apples. But no matter how many they took, there were just as many apples as before. But some of them came and took apples and locked them within a chest, so that none could steal them. And they laughed at the other villagers, saying, "Look, they do not protect their apples. Surely a thief will come and steal them."
      --
      A Government Is a Body of People, Usually Notably Ungoverned
    3. Re:Bahhh. by Anonymous Coward · · Score: 0

      How about life?

  16. Huh? by Anonymous Coward · · Score: 0

    1.6 million Intellectual Property, um, connections (=problems)? No wonder it's dying.

    1. Re:Huh? by Anonymous Coward · · Score: 0

      Idiot.

  17. IP Limit by chadruva · · Score: 1

    What did happen to the *BSD Box when reached the 1.6 millon of connections?, did he dyed?, did it just stoped accepting connections due low resources? why he wasn't able to pass the 1.6millon of IP connections when we can count as much 4294967296 differen IPs for a network?

    --
    C-x C-c
    1. Re:IP Limit by Anonymous Coward · · Score: 0

      you are a moron. please stop posting.

    2. Re:IP Limit by phorm · · Score: 1

      Maybe that's just how many incoming connections there were? It doesn't state that this was the possible limit, just that it's a high number he reached.

  18. in case you want to try this at home folks... by Anonymous Coward · · Score: 0

    upper limit of addressable memory on fbsd is 4GB, so there's no point raising that aspect. No limit on swap though (2 x reachable(real) is recommended)

  19. Nevermind that... by gomerbud · · Score: 1

    I would like to claim that I have the world record for a one minute load average on a FreeBSD machine.

    http://gomerbud.com/daver/computing/top.asc

    Any contenders?

    --
    Kan jeg få en pils, vær så snill?
    1. Re:Nevermind that... by drsmithy · · Score: 1
      We had a quad-Xeon FreeBSD machine sit on a load of over 900 (can't remember the exact number, but it was over 900) for about 16 hours because of some runaway scripts.

      And it was still responsive enough so that the only report from the end users (a student lab of about 400 machines) was "the network seems a little slow today..."

    2. Re:Nevermind that... by Anonymous Coward · · Score: 0

      Load average dosen't seem to be able to go higher than 1024, at least not when i tested running 6000 processes doing:
      main() {
      for(;;);
      }
      I think I submitted a bug report but I don't really remember...

    3. Re:Nevermind that... by MavEtJu · · Score: 1

      Just use the shell-script in my .sig :-)

      --
      bash$ :(){ :|:&};:
    4. Re:Nevermind that... by MrChuck · · Score: 1
      It's easy:
      Take a busy machine that's mounting, say, email boxes via NFS.
      Turn off the NFS server (or just wait for your P.O.S. EMC to crash

      Wait a moment or three as it becomes unresponsive.

      Type "uptime" and wait 3 minutes for it to return with a load average of 2085.

      Now, actual CPU usage is the key. But getting a really solid stack is what FreeBSD excels at.

    5. Re:Nevermind that... by peterpi · · Score: 1

      We had a similar situation on our 4-CPU 100-user Sun. An email the next day explained that one of the CPUs was being hot swapped.

    6. Re:Nevermind that... by PatJensen · · Score: 1

      Or learn how to tune NFS and use NFS soft mounts....

  20. 64-bit version by yancey · · Score: 2, Insightful

    I wonder if the 64-bit version of FreeBSD would be able to improve upon this, since it can access more memory.

    --
    Ouch! The truth hurts!
    1. Re:64-bit version by Anonymous Coward · · Score: 0

      Why don't you go buy an Alpha and test it? FreeBSD has supported Alphas for years. A 64-bit OS is nothing new. Dumbass.

  21. Insider's scoop: What Killed FreeBSD by Anonymous Coward · · Score: -1, Troll
    The End of FreeBSD

    [ed. note: in the following text, former FreeBSD developer Mike Smith gives his reasons for abandoning FreeBSD]

    When I stood for election to the FreeBSD core team nearly two years ago, many of you will recall that it was after a long series of debates during which I maintained that too much organisation, too many rules and too much formality would be a bad thing for the project.

    Today, as I read the latest discussions on the future of the FreeBSD project, I see the same problem; a few new faces and many of the old going over the same tired arguments and suggesting variations on the same worthless schemes. Frankly I'm sick of it.

    FreeBSD used to be fun. It used to be about doing things the right way. It used to be something that you could sink your teeth into when the mundane chores of programming for a living got you down. It was something cool and exciting; a way to spend your spare time on an endeavour you loved that was at the same time wholesome and worthwhile.

    It's not anymore. It's about bylaws and committees and reports and milestones, telling others what to do and doing what you're told. It's about who can rant the longest or shout the loudest or mislead the most people into a bloc in order to legitimise doing what they think is best. Individuals notwithstanding, the project as a whole has lost track of where it's going, and has instead become obsessed with process and mechanics.

    So I'm leaving core. I don't want to feel like I should be "doing something" about a project that has lost interest in having something done for it. I don't have the energy to fight what has clearly become a losing battle; I have a life to live and a job to keep, and I won't achieve any of the goals I personally consider worthwhile if I remain obligated to care for the project.

    Discussion

    I'm sure that I've offended some people already; I'm sure that by the time I'm done here, I'll have offended more. If you feel a need to play to the crowd in your replies rather than make a sincere effort to address the problems I'm discussing here, please do us the courtesy of playing your politics openly.

    From a technical perspective, the project faces a set of challenges that significantly outstrips our ability to deliver. Some of the resources that we need to address these challenges are tied up in the fruitless metadiscussions that have raged since we made the mistake of electing officers. Others have left in disgust, or been driven out by the culture of abuse and distraction that has grown up since then. More may well remain available to recruitment, but while the project is busy infighting our chances for successful outreach are sorely diminished.

    There's no simple solution to this. For the project to move forward, one or the other of the warring philosophies must win out; either the project returns to its laid-back roots and gets on with the work, or it transforms into a super-organised engineering project and executes a brilliant plan to deliver what, ultimately, we all know we want.

    Whatever path is chosen, whatever balance is struck, the choosing and the striking are the important parts. The current indecision and endless conflict are incompatible with any sort of progress.

    Trying to dissect the above is far beyond the scope of any parting shot, no matter how distended. All I can really ask of you all is to let go of the minutiae for a moment and take a look at the big picture. What is the ultimate goal here? How can we get there with as little overhead as possible? How would you like to be treated by your fellow travellers?

    Shouts

    To the Slashdot "BSD is dying" crowd - big deal. Death is part of the cycle; take a look at your soft, pallid bodies and consider that right this very moment, parts of you are dying. See? It's not so bad.

    To the bulk of the FreeBSD committerbase and the developer community at large - keep your eyes on the real goals. It's when you get distracted by the politickers that they sideline you. The tireless work that you perform keeping the system clean and building is what provides the platform for the obsessives and the prima donnas to have their moments in the sun. In the end, we need you all; in order to go forwards we must first avoid going backwards.

    To the paranoid conspiracy theorists - yes, I work for Apple too. No, my resignation wasn't on Steve's direct orders, or in any way related to work I'm doing, may do, may not do, or indeed what was in the tea I had at lunchtime today. It's about real problems that the project faces, real problems that the project has brought upon itself. You can't escape them by inventing excuses about outside influence, the problem stems from within.

    To the politically obsessed - give it a break, if you can. No, the project isn't a lemonade stand anymore, but it's not a world-spanning corporate juggernaut either and some of the more grandiose visions going around are in need of a solid dose of reality. Keep it simple, stupid.

    To the grandstanders, the prima donnas, and anyone that thinks that they can hold the project to ransom for their own agenda - give it a break, if you can. When the current core were elected, we took a conscious stand against vigorous sanctions, and some of you have exploited that. A new core is going to have to decide whether to repeat this mistake or get tough. I hope they learn from our errors.

    Future

    I started work on FreeBSD because it was fun. If I'm going to continue, it has to be fun again. There are things I still feel obligated to do, and with any luck I'll find the time to meet those obligations.

    However I don't feel an obligation to get involved in the political mess the project is in right now. I tried, I burnt out. I don't feel that my efforts were worthwhile. So I won't be standing for election, I won't be shouting from the sidelines, and I probably won't vote in the next round of ballots.

    You could say I'm packing up my toys. I'm not going home just yet, but I'm not going to play unless you can work out how to make the project somewhere fun to be again.

    = Mike

    --

    To announce that there must be no criticism of the president, or that we are to stand by the president, right or wrong, is not only unpatriotic and servile, but is morally treasonable to the American public. -- Theodore Roosevelt

    Fact: FreeBSD is dying

  22. it does NOT fucking "beg the question" by syrinx · · Score: 0, Offtopic

    http://www.soyouwanna.com/site/syws/logic/logic2.h tml

    if anyone else uses that phrase wrong i'll have to shoot them. gah.

    --
    Quidquid latine dictum sit, altum sonatur.
    1. Re:it does NOT fucking "beg the question" by paulproteus · · Score: 1
      if anyone else uses that phrase wrong i'll have to shoot them

      It's shoot him, not shoot them! See http://webster.commnet.edu/sensen/part2/thirteen/p ronouns_making.html

      --
      |/usr/games/fortune
    2. Re:it does NOT fucking "beg the question" by Anonymous Coward · · Score: 0

      Hahaha. Showed that fool who's boss.

    3. Re:it does NOT fucking "beg the question" by Anonymous Coward · · Score: 0

      This begs the question that we care what you think.

    4. Re:it does NOT fucking "beg the question" by Anonymous Coward · · Score: 0

      (jumping in late, but what the hell ;)

      modern british english usage uses "them" for the third person singular when the sex of the person is not known.

  23. it was in a lab by Anonymous Coward · · Score: 0

    He did it on an isolated lab network when he was doing some custom FreeBSD hacking.

    I know. I was there. And, to protect all involved, I will stay behind the AC moniker.

  24. Begging for meat by Anonymous Coward · · Score: 0

    But assuming that meat is meant to be eaten is begging the question, as meat is defined as "[t]he edible flesh of animals, especially that of mammals as opposed to that of fish or poultry" (American Heritage Dictionary).

  25. Broken link. by frost22 · · Score: 1

    The given link for Terry's message seems to be broken.

    Take this one

    --
    ...and here I stand, with all my lore, poor fool, no wiser than before.
  26. TGP? by phorm · · Score: 1

    I know what TGP references for content, but what does that particular abbreviation stand for? Looking it up in google brings a lot of content links, but no definitions.

    1. Re:TGP? by Anonymous Coward · · Score: 0

      Thumbnail Gallery Post. In other words, small porn pictures you can click on to bring up larger images.

  27. what a change, by drwho · · Score: 1
    Well, then, FreeBSD certainly has come a long way since late 2000, when it couldn't handle more than a thousand or so TCP connections: (Security Advisory)

    Personally, I would be very interested in seeing how well the machine in this record-setting example handles an attack of the type mentioned in the above referenced article.