Slashdot Mirror


Secure, Efficient and Easy C programming

cras writes "Feeling a bit of masochist today.. First in the morning I wrote Secure, Efficient and Easy C Programming Mini-HOWTO. And since I already spent a few hours with it, I figured I might just as well see what Slashdot people would think about it."

147 of 347 comments (clear)

  1. Secure, Efficient and Easy by Anonymous Coward · · Score: 5, Funny

    Pick any two.

  2. future plans? by napoleonin · · Score: 5, Funny

    "First in the morning I wrote Secure, Efficient and Easy C Programming Mini-HOWTO..."

    Damn. What are your plans for the rest of the day?

    1. Re:future plans? by Reality+Master+101 · · Score: 5, Funny

      Maybe make it a HOWTO rather than a Mini-HOWTO? Hell, I could write a mini-HOWTO right here...

      SECURE

      1) Don't use strcpy.

      2) Don't assume data coming in from the world is within valid limits

      EFFICIENT

      1) Avoid moving/copying large amounts of data whenever possible. Work in place.

      EASY

      1) Don't redefine the language using macros (e.g., define BEGIN {, #define END })

      2) Comment your source

      3) Use The One True Brace Style. All others are heretical crap.

      Damn, now what do I do with the rest of my day?

      --
      Sometimes it's best to just let stupid people be stupid.
    2. Re:future plans? by vsprintf · · Score: 3, Funny

      Use The One True Brace Style. All others are heretical crap.

      As long at that's my brace style (K&R), you are correct.

    3. Re:future plans? by gmack · · Score: 2

      "1) Don't use strcpy."

      Don't use strncpy with the third var of strlen(sourcevar) either.

      Seriously .. I've seen it done.

    4. Re:future plans? by CaseyB · · Score: 3, Informative

      The One True Brace Style is K&R, by definition.

    5. Re:future plans? by vsprintf · · Score: 2

      The humor was lost on you? Sorry.

    6. Re:future plans? by MAXOMENOS · · Score: 2

      Note on ESR's article: one notable place where the GNU style is found is in Sedgewick's second edition of Algorithms in C++.

    7. Re:future plans? by 0x0d0a · · Score: 4, Funny

      "First in the morning I wrote Secure, Efficient and Easy C Programming Mini-HOWTO..."

      Damn. What are your plans for the rest of the day?


      "If you've done six impossible things this morning, why not round it off with breakfast at Milliways, the Restauraunt at the End of the Universe?"

      -- Douglas Adams

    8. Re:future plans? by Decimal · · Score: 2

      Couldn't all of these petty arguments be solved if the command was not if (...) {...}, but instead {if (...) ...} or if {(...) ...}?

      --

      Remember "Bring 'em on"? *sigh
    9. Re:future plans? by iangoldby · · Score: 2, Funny

      NO!!

    10. Re:future plans? by Decimal · · Score: 2

      Er... Why not? "NO!!" isn't very descriptive. :)

      --

      Remember "Bring 'em on"? *sigh
  3. Hmm.. Question by Loki_1929 · · Score: 4, Funny

    "First in the morning I wrote"

    So did you wake up early this morning, or are you still up from the night before, like me?

    --
    -- "Government is the great fiction through which everybody endeavors to live at the expense of everybody else."
    1. Re:Hmm.. Question by cras · · Score: 2, Funny

      Read the article ;) 27h uptime or so now. I woke up around 6pm though.

  4. a little short?? by AmigaAvenger · · Score: 4, Interesting
    I think this might be a little bit too soon to have it posted on slashdot, you only have a few pages covering memory and string handling, and nothing ground breaking at that.

    It does look like a good start, add a few more chapters and you will be halfway there...

    1. Re:a little short?? by cras · · Score: 5, Informative
      It does look like a good start, add a few more chapters and you will be halfway there...

      Sorry, but I think this is about all I have to say. Secure Programming HOWTO should take care of the rest.

    2. Re:a little short?? by crimsun · · Score: 4, Interesting

      I agree that it's a good start. I would also add in links to vsftpd's design & implementation documentation; see here, here, and here. For what it's worth, Maradns's string library is worth examining as well.

    3. Re:a little short?? by inode_buddha · · Score: 2

      Decent -- this is the sort of info I can use. I'm trying to teach myself C without having to un-learn bad habits, so it helps to see the kind of things I should look out for. Where do you plan to post it when you consider it done? The LDP? I'll go grab a copy, thanks!

      BTW the "s" in Sunday should be capitalized (the part where you mentioned "Sunday morning".

      Sorry about that (former English major)

      --
      C|N>K
    4. Re:a little short?? by TheAncientHacker · · Score: 2, Funny

      Impossible. C, itself, is a bad habit.

    5. Re:a little short?? by PissingInTheWind · · Score: 2

      Impossible. C, itself, is a bad habit.

      Damn true, using C for other thing than low-level stuff really is a bad habit.

      --

      A message from the system administrator: 'I've upped my priority. Now up yours.'
    6. Re:a little short?? by TheAncientHacker · · Score: 2

      Yep. It's not a bad, somewhat portable, structured assembler but is just as dangerous as assembler and shouldn't be used where you wouldn't use assembler.

    7. Re:a little short?? by TheAncientHacker · · Score: 2

      Well, sure, programmers as good as you and I and a tiny number of others are should but do we trust everyone to use assembler for everything?

    8. Re:a little short?? by vsprintf · · Score: 3, Funny

      Damn true, using C for other thing than low-level stuff really is a bad habit.

      Oh, God, another Visual Basic user who writes code with a mouse. Spare me.

    9. Re:a little short?? by PissingInTheWind · · Score: 2

      What about: I write Lisp compilers for a living?

      Poor soul.

      --

      A message from the system administrator: 'I've upped my priority. Now up yours.'
    10. Re:a little short?? by vsprintf · · Score: 2

      Lisp! I'm not gonna do all my Lisp jokes about parens here. I've sworn off. Really!

    11. Re:a little short?? by dvdeug · · Score: 5, Funny

      Damn true, using C for other thing than low-level stuff really is a bad habit.

      Oh, God, another Visual Basic user who writes code with a mouse. Spare me.

      Yes, because it's better to spend weeks and months carefully constructing a GUI by hand then to put it together in a couple days with a mouse. Especially if it's going to be used by three or four people; by God, it's more than worth it to the company for me to spend two or three months on the project (@ $60,000 a year) so those people can get their results back in a couple seconds rather than a couple minutes.

      It's also better to spend weeks and months writing an efficent text processing program in C and worrying about buffer overflows and memory leaks, rather then writting it in a couple days in Perl or Snobol. Who cares that the results will inevitably be piped to less and studied for a few minutes; the fact that we shaved off 40% of 2 seconds (and added an obscure error case) is more than worth it!

      Actually: Oh, God, another C programmer that will make me suffer through anonymous core dumps because his programming language is so much more macho, and so much more efficent (really wish he understand how to use Big-O notation and switch algorithms, but he spent so much time programming this one and dubugging it that he can't afford to switch. Too bad he doesn't use a language with efficent control structures predebugged and optimized.)

    12. Re:a little short?? by PissingInTheWind · · Score: 3, Funny

      Did I sense irony? :-)

      But my infinite loops runs *so* fast!

      And what would I do without my precious core dumps?

      I can't trust the computer to manage his memory!

      Who cares about algorithms if the language is fast?

      I could not live without '\0' delimited strings!

      Strong typing sucks. Dynamic typing sucks. I like my types to have no purpose other than sizing the fields in memory.

      Error control and safety are for wimps.

      Macros should be dumb text substitution tools.

      --

      A message from the system administrator: 'I've upped my priority. Now up yours.'
    13. Re:a little short?? by vsprintf · · Score: 2

      Too bad he doesn't use a language with efficent control structures predebugged and optimized.

      If you're talking about Visual Basic, then that's hilarious, especially since the the buffer exploits are generally MS-specific. Someone mod that up +FUNNY. Get a real machine. Get a real language. Get real. BTW, how are wages these days at MS?

    14. Re:a little short?? by vsprintf · · Score: 2

      I can't trust the computer to manage his memory!

      Hmm. Not sure about your sexism with regards to computers, but computers don't do memory management. You have to trust the language to do GC if you're so inclined, which is slow and error-prone. Real programmers can manage memory and do it well. Others use sissy languanges like VB. Yeah, it's flamebait, but it's true, so what?

    15. Re:a little short?? by dvdeug · · Score: 2

      If you're talking about Visual Basic, then that's hilarious,

      What's your obsession with Visual Basic? High level languages go vastly beyond one implemenation from a company that doesn't rate correctness as a very important attribute.

    16. Re:a little short?? by dvdeug · · Score: 2

      You have to trust the language to do GC if you're so inclined, which is slow and error-prone.

      Error-prone? Any decent GC is not in the least error-prone. True, most of them aren't precise, but the memory leaks that cause problems are the ones that leak and continue to leak, and every decent GC catches those.

      Real programmers can manage memory and do it well.

      I invite you to run valgrind on some random binaries. I've found that valgrind finds leaks with many programs that in all other ways are good programs. Maybe there are 'real' programmers out there who don't ever make memory leaks in C, but most programs are done by programmers who aren't perfect.

    17. Re:a little short?? by axxackall · · Score: 2
      C, itself, is a bad habit.

      Changing the value of the variable is not less bad habit. It's like goto (changing the address pointer) is bad.

      Use Functional Programming instead.

      --

      Less is more !
    18. Re:a little short?? by johnnyb · · Score: 2

      Actually, Visual Basic's GUI builder isn't near as nice as Borland's. The choice of language also has nothing to do with whether or not a GUI-builder comes with it. personally, I will use a GUI builder only under the following circumstances:

      * I can load the GUI with whatever language it is I'm using on the rest of the project

      * The GUI builder DOES NOT WRITE CODE. I will use GLADE only in libglade mode - writing property files is good, writing code is bad.

      * The GUI builder actually is faster than writing it by hand

    19. Re:a little short?? by dvdeug · · Score: 2

      Why do the VB apologists always like to use the argument that if you program in C that you have to write everything from scratch?

      What makes you think I'm a VB apologist?

      There are nice GUI tools available for C

      That would writing code with a mouse, now wouldn't it? And how many of them honestly integrate with the programming language as smoothly as VB?

      And you can run your programs on more platforms than just Windows!

      Not likely. Most likely, you plugged Windows GUI code into Windows database code; either way, you're looking at a lot of rewriting. Anyway, for many purposes, who cares? There is a lot of mono-system code out there, including GNOME and KDE, both written in C/C++.

      There is nothing worse than the app that was written in VB because it was "quick and easy" (and easier to learn than VC++) that then gets added to and added to until it grows into a god-awful, inefficient code bloat.

      No language can prevent you from writing quick and dirty code and it growing into an unholy mess. C's actually good at that; custom memory mangement, poor type checking, random pointers pointing everywhere can all make figuring out what's going on and how to fix it without breaking something else a pain.

      You'll eventually have to learn a more sophisticated programming language when MS lets VB die on the vine

      Look at how fast ALGOL 60 defeated the primitive FORTRAN. Nope, ALGOL 68 - PL/I? - C? - Ada - C++ - Java? I guess Fortran's still in the running. How about Jovial - it's been twenty years since the DoD replaced Jovial with Ada, and there's still an Air Force office to handle Jovial. Languages don't die until the last programmer and the last program die, and for something like Visual Basic, that's going to be a long time. Microsoft isn't getting rid of Visual Basic until they absolutely have to.

  5. Mirror of HOW-TO in case it gets slashdotted by CableModemSniper · · Score: 5, Funny

    1) Use python with C bindings

    --
    Why not fork?
  6. Voluntary slashdotting by tuxlove · · Score: 3, Funny

    It's kind of funny how this guy voluntarily slashdotted himself by submitting an article with a link to his own site, crashing it instantly. :)

    1. Re:Voluntary slashdotting by rob-fu · · Score: 2

      NOTE: This is a temporary location for this document, selected with slashdot people specifically in mind.

      I think he already planned for it. Seems to be holding up.

    2. Re:Voluntary slashdotting by cras · · Score: 2, Interesting

      Well, I didn't link it to original site, but from the look of this so called slashdot effect I think I just as well might have. Come on, I don't see any kind of load at all!

      [cras@foo] ~$ ps ax|grep apache|wc -l
      60

      [cras@foo] ~$ uptime
      20:32:54 up 127 days, 10:58, 56 users, load average: 0.23, 0.41, 0.37

      Those loads were pretty much the same before slashdotting.

    3. Re:Voluntary slashdotting by Anonymous Coward · · Score: 3, Funny

      I think Slashdotting only really happens to sites with dynamic content or to sites with a topic more people care about. Oh yeah, and also sites that run on a calculator powered by a potato.

    4. Re:Voluntary slashdotting by vsprintf · · Score: 2

      The subject will keep most slashbots away. If you had written a howto on securing IE, then you'd get a slashdotting. :)

  7. Unportable? by Anonymous Coward · · Score: 5, Interesting

    I found strlcat and strlcpy easily ported - simply toss them in the same .c file and dump it into the makefile!

    On a more serious note, why in Bob's name don't these two functions exist, standard, in Linux? IMO, they should be added, and gcc should give deprecation warnings about the use of non-safe buffer handling functions - sprintf, strcat, strcpy, etc. No offense to purists, but screw the standard. I'll sacrifice some portability of software and such for security.

    Oh, and on a side note, you may take my malloc() when you pry it from my cold dead fingers. ;) Eh, I suppose we all have a certain way of doing things that we don't wish to part with. (*points at the unsafe buffer people*)

    1. Re:Unportable? by Arandir · · Score: 2
      STRLCPY(3) FreeBSD Library Functions Manual STRLCPY(3)

      NAME
      strlcpy, strlcat - size-bounded string copying and concatenation

      LIBRARY
      Standard C Library (libc, -lc)

      SYNOPSIS
      #include <string.h>

      size_t
      strlcpy(char *dst, const char *src, size_t size);

      size_t
      strlcat(char *dst, const char *src, size_t size);
      --
      A Government Is a Body of People, Usually Notably Ungoverned
    2. Re:Unportable? by thogard · · Score: 3, Informative

      char buf0[4]="Ok?";
      char buf1[4];
      char buf2[4]="Hi!";

      strncpy(buf1,"Bonk",4);

      printf(buf1);

      You will usually get either "BonkOk?" or "BonkHi!"

      With strlcpy you will get "Bon"

      strlcpy will put the null in the last position, strncpy won't if the last spot has a value it in.

      That can result in bad code later with:
      char other_buf[4];
      strcpy(other_buf,buf1); // strcpy is safe because buf is only 4 :-)

      Or even:
      strncpy(other_buf,buf1,strlen(buf1)); //buf1 is only 4 char

      Strncpy isn't much safer than strcpy and gets and scanf are right out for the same reasons.

    3. Re:Unportable? by e-Motion · · Score: 2, Informative

      void my_strncpy(char *s, const char *t, int n){ while((*s++ = *t++) && --n) ; *s = '\0'; }

      If written

      void my_strncpy(char *s, const char *t, int n){ while(n-- && (*s++ = *t++)) ; *s = '\0'; }

      Then it will work when n==0, and continue to have the same behavior for all n > 0 as well. I like strlcpy()'s interface better, though, because the "number" parameter is the number of elements in the destination array, whereas my_strncpy takes one less than the number of elements in that array.

    4. Re:Unportable? by spitzak · · Score: 2

      strncat() does produce a null-terminated string. The problem is that for normal use into a buffer of N characters you have to do strncat(buffer, N-strlen(buffer)-1). People often get this wrong, just passing N or forgetting the -1.

    5. Re:Unportable? by Anonymous Coward · · Score: 2, Funny
      No offense to purists, but screw the standard. I'll sacrifice some portability of software and such for security.
      A famous founding father of C reputedly said:

      [Those] that can give up portability to obtain a little temporary security deserve neither portable code nor secure code.
  8. Definitely useful by ttfkam · · Score: 5, Interesting

    in that folks who use C can avoid common pitfalls. But so much of this seems like it has been tackled by C++. Only C++ did it cleaner. C++ is complex though. So this only leaves (horrors) a higher level language that removes all of these implementation details that lead to insecure programs.

    Do it in a higher-level language first. Make sure your algorithms are clean and efficient. If and only if you see a performance or resource problem do you rework portions(!!!) in C. As a bonus, the higher level language acts as a code template for faster C development.

    Once you are at that point, this Mini-HOWTO will definitely be a great resource to use.

    --

    - I don't need to go outside, my CRT tan'll do me just fine.
    1. Re:Definitely useful by Kragg · · Score: 5, Insightful

      Wow. This is one of the few genuinely insightful comments I've come across.

      Prototyping in a higher-level language (c# is easy, java everyone knows) is a superb idea, provided you
      - can release the final product as interpreted, with slow execution speed
      - can afford the time to port all to C, in which case DO, this is an excellent way to make a watertight C program
      - are happy to learn how to make managed code/vm code call to native and vice-versa (this is far from a trivial problem)

      There are apps that fit into all 3 categories, and if your end-result should be a watertight C program, it may even be faster to prototype.

      Fight the conventional wisdom! make good code by doing it right, not by being a genius who can hold 4000 variables in his mind over a month-long project (because you aren't one anyway).

      --
      If you can't see this, click here to enable sigs.
    2. Re:Definitely useful by nzhavok · · Score: 2

      I've worked on large projects and this approach has worked just fine. The basic idea is not to write the entire program in the higher level language but rather to use this language as the glue for calls to functions in lower level languages.

      As a RL example a project I worked on used TCL as the glue for C TUXEDO services and Oracle. So to adress your points above WRT this project:

      1)There were no performance issues in the delivered product, if a part of the code is under performing in the glue language you rewrite it in C and bind to it instead.
      2)We did not need to port all the code to C, identify the small portions of code which benefit greatly from a port and port only them. The time saved here is enormous compared to implementing the entire project in C.
      3)calling to native code in TCL was trivial, if it's "far from trivial" for you perhaps you chose the wrong language for the glue. A popular language for doing this today is Python, in which it is also straightforward to create bindings for.

      --

      He who defends everything, defends nothing. -- Fredrick The Great
    3. Re:Definitely useful by HiThere · · Score: 2

      You are just picking the wrong higher level languages. There are much better choices, though which is best depends on your problem.

      If you are dealing with highly dynamic data, lots of strings, etc. Start in Python. Then locate bottlenecks and convert those sections to C.

      If you are dealing with a large application, that you need to control precisely, start with Ada. You probably won't need C at all, but be prepared for a lot of work. If you need to call libraries written in C, you can do so realtively directly.

      If you are dealing with a relatively complex application that needs garbage collection, Eiffel is a good choice. Links to C are easy, once you master them, but links back are... dubious.

      If you are dealing with something simple, or if everyone else is using C, then your best choice may be to just use C. (Eiffel can generate C code, but don't expect to be able to read it.)

      I don't like C for anything that isn't REALLY simple. But it's a lot better than the language I've ended up using most of the time recently (Visual Basic). (Currently I think I may have managed an escape from MSAccess into Java. [Wouldn't you know it! I need to learn a new language to escape from one of the worst environments on the planet. But Java is the only choice that mgmt. will accept.])

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    4. Re:Definitely useful by Kragg · · Score: 2

      I have no experience with Python - I'm withholding judgement till the cheerleaders quiet down a bit and i can find a sensible description of it's strengths and weaknesses (links anyone?).

      However, as for GC etc using Eiffel - you say links to C are easy once you master them - same with every other language, including c# and java.

      Especially if you're trying to get away from VB, why not use .NET? It may be the beast's but it is still easy and (almost) portable code. And there are a million guides out there on porting VB6 -> VB.NET. Tell mgmt they're wrong.

      --
      If you can't see this, click here to enable sigs.
    5. Re:Definitely useful by Kragg · · Score: 2

      glue != prototype. (in fact, it's E210: invalid type comparison, cannot compare apples and oranges.

      Yes, glue languages are designed to interoperate easily, but I defy you to create a full-blown app prototype in TCL.

      Go on, let's see it.

      --
      If you can't see this, click here to enable sigs.
    6. Re:Definitely useful by hobuddy · · Score: 5, Interesting

      ttfkam wrote:
      Do it in a higher-level language first. Make sure your algorithms are clean and efficient. If and only if you see a performance or resource problem do you rework portions(!!!) in C. As a bonus, the higher level language acts as a code template for faster C development.

      Amen.

      Kragg wrote (in his reply to ttfkam):
      Prototyping in a higher-level language (c# is easy, java everyone knows) is a superb idea, provided you
      - can release the final product as interpreted, with slow execution speed


      Most programs spend 90% of their CPU time executing 10% of their code. If that 10% is optimized in a low-level language such as C, a large-scale interpreted program can boast performance that's virtually indistinguishable from an equivalent program written entirely in a low-level langauge. However, there's likely to be a huge difference in programmer productivity.

      As a reference, see this Dr. Dobbs article, which states:
      """ ... 90 percent of the software's running time occurs in only 10 percent of the code. This is the whole basis for virtual memory: Potentially, a program can run at full speed with only 10 percent of itself--or whatever the working set is--loaded into memory at any given time. Unlike that nasty segment stuff, the programmer does not specify any of this in advance. The operating system "discovers" a program's working set on-the-fly, through page faults.
      """

      - can afford the time to port all to C, in which case DO, this is an excellent way to make a watertight C program

      Why port 90% of the application's code to a low-level and less productive programming language, when that 90% will inevitably evolve and require maintenance as the program is utilized in unforeseen ways? I've never written a large program that didn't end up having features added incrementally over a long period of time after the initial release.

      - are happy to learn how to make managed code/vm code call to native and vice-versa (this is far from a trivial problem)

      If it's "far from a trivial problem", you're using the wrong tool.

      Take Python, for example: it's simple to interface between Python and C using Python's C API. Recently, a tool named Pyrex has appeared that makes it almost trivial. Pyrex is amazing.

      Kragg suggested prototyping in C# or Java, but Python surpasses both of those as a prototyping tool. Python is higher-level than C# or Java (and thus better suited to prototyping and/or malleable fusion with C) because it features:
      - dynamic typing ("dynamic", not "weak" like Perl)
      - no obession with a particular programming paradigm; use procedural, functional, or OO as appropriate
      - high-level data structures built into the language
      - more convenient dynamic code loading
      - interactive development at a "Python prompt" (the value of this cannot be overestimated)
      - no separate compilation step in the edit-test-debug cycle
      - more concise syntax
      - excellent interface capabilities to C (or C++ via Boost.Python, or Java via Jython)

      I suggest that the fusion of a truly high-level (higher than Java-level) language with C is far more broadly applicable than Kragg claims.

      --
      Erlang.org: wow
    7. Re:Definitely useful by kfg · · Score: 2

      "Fight the conventional wisdom! make good code by doing it right, not by being a genius who can hold 4000 variables in his mind over a month-long project (because you aren't one anyway)."

      The hell I'm not! ( Not as good as my father though, who had a true photographic memeory, scan a book and read it back from the "image" in his mind at a later date. Very annoying to mere mortals)

      But this is irrellevant ( and how a relevant got into my pajamas I'll never know). The point is that anyone *else* who is ever going to look at your code can't be expected to spend weeks just figuring the bloody mess out. Write tight code and comment well and comment often.

      *Assume* that someone else will be responsible for maintaining your work and treat them decently.

      KFG

    8. Re:Definitely useful by nzhavok · · Score: 2

      TCL was originally designed to have a minimal syntax which was to be extended with custom bindings for a program. It is by it's nature a "glue" language, and I don't see how means the language can't be used for prototyping. In the way we used it it had bindings only for Oracle exec/selects and TUXEDO RPCs/FML buffers, nothing else. The rest of the app was built entirely in TCL and it works well as, is as fast as, and has much fewer defects than existing similar services written in C despite being developed by a more junior team with no experience in the project area.

      Your examples of prototyping languages were c# and java however my idea of prototyping languages are TCL or Python. I worked with java for years and you can develop some stuff quickly, but it's not a protyping language IMO. Python on the other hand seems quite good for prototyping, for instance you can write a threaded/forked/multiplexed chat server in about 10 lines of code, and it is suitable for building full apps without binding C code (although you may want to do this for speed reasons).

      I should qualify this by saying I am a C programmer profesionally, and don't have a problem doing it if thats what I'm payed for, I love C and every programmer should know it. If I have a choice I will program in Python because it's easily about 5 times quicker to develop in than C and I don't like to waste my time. I also like Java but don't see much use for it beyond EJB systems. I think the only advantage Java has is that it can be used for clients, servers, servlets, JSPs and EJBs. Management like it because they wrongly think (and the hype promotes the image) of their Java programmers as a pool resource who can be moved between these areas seemlessly.

      --

      He who defends everything, defends nothing. -- Fredrick The Great
    9. Re:Definitely useful by The+Madpostal+Worker · · Score: 3, Funny
      glue != prototype. (in fact, it's E210: invalid type comparison, cannot compare apples and oranges.


      I'm tired of this constant discrimination against the citrus fuits. One of these days the people will get up and say "I'm tired of people thinking that oranges aren't good enough for comparison." They'll say "I can compare apples and oranges". They'll run to the windows and say "This orange is much yellower than this apple". People will be running through the streets screaming "This apple is much more smooth than this orange."

      And then my group(The People for the Ethical treatment of Cirtrus (PETC)) will be happy.
      --

      /*
      *Not a Sermon, Just a Thought
      */
    10. Re:Definitely useful by Hezaurus · · Score: 2, Informative

      Kragg wrote: - can release the final product as interpreted, with slow execution speed

      Hmmm... goto the http://www.bagley.org/~doug/shootout/bench/heapsor t/ - you'll see that the gcc version is about 8 times faster. Now, get the sources and compile them yourself. Run three to five times to let the system stabilize then write the timings down. This is what you get:

      gcc with O6 (heavy optimizations) is almost 20% faster than the equivalent java code! Yet the author of those pages reports that the difference is more like 800%?! BTW: I tried that with three different VM's the best was IBM's 1.4.0, second one JRockit's 1.4 beta and the last Sun's 1.4.1 (each about 5% slower than the previous) the java code was run with '-server' the platform (linux/windows) didn't have any significant effect on the results.

      You are free to draw your own conclusions.

      --
      No matter how fast light travels it finds the darkness has always got there first, and is waiting for it. (T. Pratchett)
    11. Re:Definitely useful by johnnyb · · Score: 2

      I love Python, and have recently started using it a bit. Here are my thoughts:

      weaknesses:

      *third-party libraries not as mature as, say, Perl's (I LOVE CPAN!)

      *regular expressions not a language feature, but a library. Also, regexps differ dramatically from Python version to Python version

      *scoping rules a bit awkward at first

      strengths:
      *Supports objects directly

      *late-bound, and therefore do not need to specifically define interface classes (although they are still useful for documentation)

      *supports lexical closures (how does anyone in the world code sensibly without them?) - very useful for GUI callbacks. This takes away a huge chunk of work

      *Very simple

      *XML libraries are very nice indeed

      *excellent COM integration on Microsoft platforms (you can manipulate COM objects interactively in a Python session - very useful!)

      *on Microsoft platforms, py2exe will build whole application and runtime environment into an executable and a few DLLs.

      *Supports the "Generator" concept (new in Python 2.1)

      *Supports bound methods (this can be done on any language supporting closures, it's just easier with direct bound-method support)

      Basically, Python takes many of the excellent ideas in several languages - Lisp, Smalltalk, and Perl, and combines them into a simple, easy-to-remember language. The only difficulty I've had with python are remember it's scoping rules and dealing with regex compatibility between versions.

    12. Re:Definitely useful by HiThere · · Score: 2

      .NET? I've heard some interesting things about it in the last week. Seems to me that it isn't ready to be serious yet. Irrelevant, however. I switched to Java because that was what mgmt. would accept. They wouldn't accept anything else.

      Java seems "not that bad", especially if I compare it to C++. OTOH, it's not any more efficient than Python, but it does have a large library of portable gui classes. That's a definite plus. It means that sometime in the future I might be able to really break free of windows. (Actually, I'm doing the development on Linux, but the target environment currently has to be windows.)

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
  9. data stacks by larry+bagina · · Score: 5, Interesting
    What I haven't yet seen used anywhere outside my own software and some programming languages internals (eg. calling Perl code from C), is using data stack for temporary memory allocations. It has the most important advantage of garbage collectors; allocate memory without worrying about freeing it. It also has a few gotchas, but I'd say it's advantages are well worth it.

    The way it works is simply letting the programmer define the stack frames. All memory allocated within the frame are freed at once when the frame ends. This works best with programs running in some event loop so you don't have to worry about the stack frames too much. Here's an example program:

    That sounds a little like the NSAutoReleasePool in Cocoa/OpenStep. Objects use reference counting, when the count reaches 0, they deallocate themselves. When an object is created, it can get added to the most recent pool. When the pool is deleted, it decrements the reference count of all the objects within it, causing deallocation unless it needs to be kept around longer.

    --
    Do you even lift?

    These aren't the 'roids you're looking for.

    1. Re:data stacks by Handyman · · Score: 2, Interesting

      I've seen an especially nice version of these dynamic stack frames in Cyclone. For those of you who don't know it, Cyclone is kind of a type-safe, pointer-safe version of C, mixed with some good features found in languages like ML. It takes only simple transformations to compile C code as Cyclone (mostly having to do with minor pointer syntax differences).

      Cyclone has region-based memory protection, which means that you can't do stuff like return pointers to local variables etc. because it statically checks the pointer lifetime using region tags that are part of the pointer type. Example: you can have a pointer-to-memory-belonging-to-region-foo, where foo is a function or some other static scope, (written sometype * `foo, although the default region tag is usually correct, then it's just sometype *) which can point to heap memory because that's garbage-collected and guaranteed to live at least as long as function foo's memory, but you can't have a pointer-to-memory-belonging-to-region-Heap pointing to a variable on the local stack: if you have a local variable x and take the address, the type of that is pointer-to-memory-in-region-foo, and that type is not allowed to be cast to pointer-to-memory-in-region-Heap because foo's memory doesn't necessarily live as long as Heap does.

      They combined this region-based mechanism with dynamic "stack frames": You can open a dynamic region to open up a new "stack frame" or separate heap of memory bound to a scope in the program, so when an exception is thrown or when you exit the scope the memory is automatically deallocated. The good thing is, you can't go wrong, because the region-based pointer lifetime checking will prohibit you from casting a pointer into that specific region to a pointer into a region with a longer lifetime, so you will never have dangling pointers into such a dynamic region: you will get a compile-time error when you attempt to do this.

  10. It's a Sunday morning; So don't criticize. by dagg · · Score: 4, Funny
    I'm not a writer and I'm not too good at english, so sorry about all the spelling and grammar errors :) All of this stuff was written at sunday morning, tired after being awake the whole night and not being able to do anything useful...

    I'm going to start putting that at the end of everything I write so that people can't criticize anything I do. As a matter of fact... I think I'll only write on Sunday mornings after not sleeping the night before. It seems like it's always Sunday morning anyways.

    --
    Your sex on a Sunday Morning
    --
    Sex - Find It
  11. Maybe being in the business world by PaddyM · · Score: 3, Interesting

    But I can't follow this HOWTO very well. Does he have a global variable stored in the file with t_push and t_pop so that t_sprintf can use that variable? But if he has a global variable, than all he's really doing is allocating the maximum amount of memory his program will ever need at the beginning, and managing his memory.

    Perhaps working until 4 in the morning on C code has drained my ability to understand.

    1. Re:Maybe being in the business world by cras · · Score: 2, Informative

      Think about stack and how that works. t_push() and t_pop() basically create and destroy a stack frame, just like your control stack does at the beginning and end of function. So sure it needs to use some global memory for it (not in global variable though), just like control stack does. t_sprintf() simply returns a pointer inside the stack frame.

  12. masochist by mike77 · · Score: 2, Funny
    Feeling a bit of masochist today...

    You must be to ask slashdot's opinion of your toils!

    --

    --Keeping the flame wars alive, one post at a time

  13. Is this news? by mthed · · Score: 5, Insightful

    Some guy spent a couple of hours writing a first draft of a Howto. Thanks Slashdot, I'm sure glad you didn't let this one slip through the cracks! Besides, who cares about these kludgy ways of handling memory. If you don't wan't to worry about memory allocation use C# or java or something. Otherwise, stop eating quiche and write solid code.

    --
    "There's a madness to my method." -mthed
  14. stack allocation?? by hanwen · · Score: 5, Informative
    (yawn)

    it starts off with denouncing GC as oldfashioned, and then proceeds to tout stack-based allocation, which has been available for ages as the alloca() function (which also has portability problems.)

    imho, you should use the Boehm Garbage collector, unless you have code that must be guaranteed to be free of space leaks.

    --

    Han-Wen Nienhuys -- LilyPond

    1. Re:stack allocation?? by p3d0 · · Score: 2
      Boehm GC can't do much with C.
      What does this mean? Have you used the Boehm GC? You may be interested to look into so-called conservative garbage collection, a technique that works quite well with C.

      No offence intended, but you definitely need to have some knowledge of conservative GC before you write a C memory management HOWTO.

      --
      Patrick Doyle
      I mod down every jackass who puts his moderation policy in his sig. Oh, wait a sec....
    2. Re:stack allocation?? by hanwen · · Score: 2


      To me it looks very much like I'm saying that the GC would be the best way to manage memory, except if it wasn't so crappy to use with C. Boehm GC can't do much with C.


      BGC recollects non-live objects in memory. It does so very efficiently: it's efficiency is comparable with malloc(). To top that, you can add finalization procedures to objects (more or less analogous to C++ destructors) that are called when an object is cleaned up.

      Reclaiming dead objects is what GC is for. If you claim BGC can't do much with C, then you have a different definition of GC than I have. Please be more specific: where is BGC lacking, eg. as opposed to stack based memory allocation?

      --

      Han-Wen Nienhuys -- LilyPond

    3. Re:stack allocation?? by PissingInTheWind · · Score: 3, Funny

      Boehm GC can't do much with C.

      I find it somewhat ironic that you make claims like that, and that you write a memory management HOWTO at the same time.

      But eh, keep hacking at that square wheel.

      --

      A message from the system administrator: 'I've upped my priority. Now up yours.'
    4. Re:stack allocation?? by hanwen · · Score: 2
      it's efficiency is comparable with malloc().
      Exactly. Which is not good enough.

      Not good enough? That is a blanket statement. Unless you have specific needs, and have actually measured that heap fragmentation is a significant cost, your home-brew non-thread-safe memory allocation mechanism will cost you more, since it restricts your programming style, and leaves you responsible for maintaining the memory allocation code.

      But that's not happening with C since moving data around has too many side effects to handle.

      Again, a blanket statement. There actually exists a conservative generational copying GC (Bartlett's mostly copying GC) algorithm that could be used for GC-ing C data. You would have to tell the GC the layout of your data structures. That is quite restrictive, but then again, the stack operations that you introduce are also restrictive, and only work for specific allocation patterns.

      Anyway, if you have repeated stack-based allocation patterns that must really be efficient, I would suggest to move the allocation outside the loop, so it only has to be done once.

      --

      Han-Wen Nienhuys -- LilyPond

    5. Re:stack allocation?? by cras · · Score: 2, Funny

      Well, I'm getting a bit tired of arguing. Even it the speed didn't matter at all, there's still the point that you can't create easily usable GC with C portably. And I don't feel restricted at all with the data stack. Yes, it's a bit more restrictive when comparing to fully automatic GC, but still much less PITA than having to free() the memory which everyone else are doing.

      I don't care about speed that much. Portability is one however which I really do care about and I'd hate to depend on requiring an implementation of GC for some specific platform I intend to use.

      Telling GC about all your structures sounds much more difficult and error-prone to me than my simple data stack.

    6. Re:stack allocation?? by dvdeug · · Score: 2

      you should use the Boehm Garbage collector

      I once ran a program over my mp3 collection; it was using 400 MB of memory by the time I killed it. I poked around in the code; turns out there was absolutely no attempt to deallocate the memory. I tried two things - first, plugging in the Boehm-Weiser GC, and then switching malloc to alloc (since it looked like the memory usage was function local.) The latter ran four times faster.

  15. You Forgot: by asv108 · · Score: 5, Funny
    You forgot to add the obligatory "in XX days" or "XX hours" to your title. So a better title for this story would be:

    "Secure, Efficient and Easy C programming in 24hrs"

  16. strncat/strncpy are *NOT* intuitive by Alejo · · Score: 4, Informative

    Did you really read the strncpy and strncat manpages?
    To both zero-terminate and check for truncation is arcane, that's why the OpenBSD ppl made strlcat and strlcpy in the first place.
    There are already other secure programming faqs, though AFAIR, they suck too. If I were you, I'd put a HUGE disclaimer to take this page as work-in-progress.
    (before flaming, write down the correct code to check for truncation for both funcs)

  17. Devils' Advocate by windex · · Score: 4, Interesting

    Okay, let's preface. This guy has a good idea in the memory allocation department.

    Problem 1:

    It's not easy, nor fast to write. Errors are severe if present and undetected. Code required to be reliable might not be a good place to test this allocation method.

    Problem 2:

    I'm not entirely sure these concepts are very portible outside of GCC. May not be a big deal to most, but uh, multiplatform code is required in some enviroments.

    Problem 3:

    Any speed increase without massive resource wasting is pure dumb luck during heavy usage, unless used in an application that takes little user input or has limits on the ammount of input.

    Just my $0.02.

    1. Re:Devils' Advocate by spitzak · · Score: 2

      You may be thinking like I did at first that he was advocating some trick with the stack pointers. That is wrong, he is advocating quite portable code that allocates a *different* "stack" in a block of memory and then uses normal pointers to allocate portions of that. It is not GCC specific.

  18. These are common tricks by pclminion · · Score: 5, Insightful
    It's a good start at a HOWTO, but needs some serious fleshing out. These are common tricks that most serious, experienced C programmers have in their bag.

    Some of my personal favorites include:

    • Exceptions in C. You can get quite natural-looking exception handling in C, with some convoluted macros. I'm sure most hardcore C coders have come up with their own implementations. Many security bugs happen in parts of the code that handle errors, precisely because errors are rare, and those parts of the code don't get tested well. Using a unified, exception-driven approach to error handling can cut down the risks. IF you do it right.
    • The alloca() function. This allocates memory directly off the stack, which is freed when the function returns. Very useful for cases where you want a stack buffer but aren't sure how big it needs to be. Like any other stack buffer, you need to take care not to overflow it. There are portability concerns with this function, but it can still be useful.
    • Variable-sized block-chained allocators, which pull chunks of memory out of preallocated segments. The segments are chained together in a linked list. Very effective when you need to make a lot of variable-sized allocations, and do it fast, dammit. It also makes freeing the allocated memory blazingly fast, although it's a "free all or none" approach.
    • "Hardened" allocators, which allocate blocks in multiples of the page size, and set memory protections in such a way that buffer overruns cause crashes. This is the easiest way to prevent ANY kind of buffer overrun vulnerability, but wastes memory. See Electric Fence.
    Look people.. It takes a keen eye and major discipline to write secure C code. It is not impossible. You have to get in the habit of subconsciously checking yourself at EVERY turn. "Am I accessing a stack variable? Am I doing it CORRECTLY?"

    DISCIPLINE, DISCPLINE, DISCIPLINE. I fully expect to see the usual barrage of comments to the tune of: "C is outdated, insecure, brittle, yadda yadda..." No. Some PROGRAMMERS are "outdated, insecure, and brittle."

    The C language doesn't write bugs. Programmers write bugs. If the programmer can't handle C, then take it away from him. But don't try to take it away from ME.

    1. Re:These are common tricks by pclminion · · Score: 3, Informative
      This is what my "data stack" is trying to fix and do it fully portably. And alloca() still can't be used to allocate return values from it, which I think is the most useful feature gained by using data stack. I don't know about you, but I use a lot of functions that need to return dynamically allocated memory.

      I'm not seeing the difference between your data stack and a memory pool, except that you can divide it into frames which you can collectively pop off, and free entire contexts at once. But by making the data stack independent of the call stack, you introduce the possibility of the two getting out of sync. A context frame should probably always map to a single function invocation. Or to put it another way, a data frame pushed in a particular function call should always be popped by that same function call. And that kind of defeats the purpose of being able to return stack-allocated data UP the call stack.

      In contrast alloca() is a simple manipulation of the hardware stack pointer, which will be automatically undone by the hardware itself at the end of the call frame (on any sane architecture, that is). There's no possiblity for abuse.

      Any strlcat(), strlcpy(), etc. don't solve the underlying problem in all string operations, which is making sure you always have enough room. They prevent overflows, but they can still truncate data without you realizing it's happened. Unless you check first. See my other comment.

    2. Re:These are common tricks by cras · · Score: 2, Interesting
      I'm not seeing the difference between your data stack and a memory pool,

      You could think of it that way if you wanted. I actually called them "temporary memory pools" before learning it had an existing name.

      A context frame should probably always map to a single function invocation. Or to put it another way, a data frame pushed in a particular function call should always be popped by that same function call. And that kind of defeats the purpose of being able to return stack-allocated data UP the call stack.

      Yes, but there's no need to create a new frame for each function call. You may not need to create more than one frame in the entire program if you know you're not allocating too much memory out of it. That's what makes it better than alloca(). You can do for example:

      t_push(); ret = alloc_some_data_from_stack(); /* do stuff with ret */ t_pop();

      All very simple. Sure there's still possibility breakages but they're not very common, and you know when you're doing it wrong. Simply forgetting a t_pop() call will be noticed at the bottom level t_pop() which would kill the program then - nothing got overflown but it might have allocated memory excessively.

      In contrast alloca() is a simple manipulation of the hardware stack pointer, which will be automatically undone by the hardware itself at the end of the call frame (on any sane architecture, that is). There's no possiblity for abuse.

      alloca() simply doesn't do what I want. I want to return dynamically allocated memory from functions without worrying about freeing it. Data stack and GC are the only possibilities for that.

      Any strlcat(), strlcpy(), etc. don't solve the underlying problem in all string operations, which is making sure you always have enough room.

      I'm not propsing strlcpy() either. I only mentioned them as being much better than strncpy/strncat which they definitely are. I've never used them though.

    3. Re:These are common tricks by hawkestein · · Score: 2

      DISCIPLINE, DISCPLINE, DISCIPLINE. I fully expect to see the usual barrage of comments to the tune of: "C is outdated, insecure, brittle, yadda yadda..." No. Some PROGRAMMERS are "outdated, insecure, and brittle."

      The moral is to always use the right tool for the right job. You wouldn't use a chainsaw to do heart surgery and you wouldn't fly a 747 to travel 30 miles.

      C is really good at certain things, but writing secure code isn't really one of them: meaning that you have to go through some extra effort to ensure your C code is secure. If you can solve your problem in another language with less effort and that language meets all your requirements (speed, memory use, portability, whatever else), then why pick C in that case? Not every application requires maximum speed or easy bit twiddling.

      The C language doesn't write bugs. Programmers write bugs. If the programmer can't handle C, then take it away from him. But don't try to take it away from ME.

      Nobody's advocating take C away. But you shouldn't be slavishly devoted to it as the One True Language. You should choose the language that will allow you to solve your problem with the minimum amount of effort, taking into account whatever constraints are relevant.

      --
      -- Will quantum computers run imaginary-time operating systems?
    4. Re:These are common tricks by Tim+Browse · · Score: 2
      Variable-sized block-chained allocators, which pull chunks of memory out of preallocated segments. The segments are chained together in a linked list. Very effective when you need to make a lot of variable-sized allocations, and do it fast, dammit. It also makes freeing the allocated memory blazingly fast, although it's a "free all or none" approach.

      Not necessarily - depends how you implement it. For example, the SmartHeap library would use fixed size allocators for common small block sizes that worked in pretty much O(1) time (they just popped an item off the head of a list). This was used as a GP replacement for normal malloc/free libs. When you free a block, it just gets put on the head of the list.

      Tim

    5. Re:These are common tricks by dvdeug · · Score: 2

      Programmers write bugs. If the programmer can't handle C, then take it away from him. But don't try to take it away from ME.

      And the best and the worst write security bugs in C. How many times has an innocent program, written by very good programmers, had a string buffer overflow? Way too many.

    6. Re:These are common tricks by loconet · · Score: 2

      "The C language doesn't write bugs. Programmers write bugs. If the programmer can't handle C, then take it away from him. But don't try to take it away from ME."

      Simply beautiful ..

      --
      [alk]
  19. Bad implementation of a heap... by lkaos · · Score: 4, Insightful

    See HeapAlloc and friends in Win32 for proper implementation.

    At any rate, there are better ways to make sure one never leaks memory problems:

    1) always set a freed pointer to 0. Most architectures have a predictable behavior in dereferencing a 0 (throws an exceptions).

    2) Limit all malloc/free pairs to the same function. If a function just has to allocate and return some buffer, give it a meaningful name to that effect and all a corresponding free version. Then, you can follow the above rule.

    3) assert()s are your friend. Use them religiously. They can always be shut off.

    4) Use memory tracking software (purify) before ship.

    Yes, it's easier to shoot yourself in the foot with C, but you'll gain a huge performance increase. It's all about using the right tool for the right job.

    --
    int func(int a);
    func((b += 3, b));
    1. Re:Bad implementation of a heap... by spectecjr · · Score: 2

      Is purify available for Linux?

      Probably not, but I'm sure the open source community can come up with their own version given a few years and a copy of the original.

      Simon

      (Oh, I'm sorry... was that bitter and cynical? My mistake)

      --
      Coming soon - pyrogyra
    2. Re:Bad implementation of a heap... by LizardKing · · Score: 2

      Is purify available for Linux?

      Probably not, but I'm sure the open source community can come up with their own version given a few years and a copy of the original.

      Check out valgrind. It gives far more useful information than purify and doesn't cost an arm and a leg. It also took far less than a few years to write.

      Chris

    3. Re:Bad implementation of a heap... by lkaos · · Score: 2

      http://www.rational.com/products/pqc/pplus_lx.jsp

      --
      int func(int a);
      func((b += 3, b));
  20. visual basic by Anonymous Coward · · Score: 3, Funny

    why not just use visual basic?

    say what you want about it, you don't have to use stupid hacks to avoid buffer overflows.

  21. As a lib and/or in general programming tutorials by Mas3 · · Score: 2, Insightful

    This looks like a good idea for a lib (or more) that covers those issues. It might be already exists, but it's not very well known. (To beginners)

    The other problem is that security issues usually aren't mentioned in general programming tutorials (and books).
    If beginners would be pointed to techniques like this (with explanations why) lots of typical mistakes would not happens.

    --
    Stefan

    Looking for Developers, new project members, testers or help? Want to provide your abilities ?
    DevCounter ( http://devcounter.berlios.de/ )
    An open, free & independent developer pool.

  22. C++ can do this, and it'll look cleaner by ademko · · Score: 4, Informative

    First off, C++ objects can force the use of all data access through assert()-filled methods, then in optimized mode can be inlined and thus reduced to their C equivalents.

    Second, destructors in C++ guarantee clean up of objects, regardless of how you leave scope (natural, return, exception, etc).

    Finally, you couple destructors and reference counting auto-pointers, and you have yourself a very nice allocation API that's as easy as Java, but without the performance or unnatural destruction logistics.

  23. And C said by racerx509 · · Score: 2

    Bite me!

    --
    13 year old white supremacists are shitty web designers.
  24. aggressive use of glib by chtephan · · Score: 4, Insightful

    In my last project, I used glib from the ground up. I wrote several thousand lines of code before testing it. I made some very aggressive use of glib and gobject. After the code compiled and did not give any runtime warnings anymore it did not contain a single memory leak (verified using valgrind).

    glib containts a lot of useful things: lists, trees, hash tables, memory pools, string handling functions and a lot more, everything thread safe.

    gobject contains tools on top of glib like "classes" and "objects". It's not the same as in C++ or java, but also very useful. Runtime classes oder data types, generic object properties, reference counting, signal callback, runtime type checking, etc...

    The code ist now full of g_... and it took longer than usual because I had to read the documentation, but I think these libraries are very great, and provide a solution for nearly everything that has to do with abstract data types and dynamic memory allocation.

    And it's very lightweight, fast and efficient.

    1. Re:aggressive use of glib by chtephan · · Score: 3, Informative
      > But portable??? I'm serious, does it currently run on BSD, OS X, Windows, and Linux? And if so, then how much bloat does it add?

      Sure. The libraries are basically standard C. The optional thread library has implementations for pthreads and win32 CriticalSections. And there are even some additional compatibility wrappers to make some things more portable (e.g. listing directories).

      They are just utility libraries or foundation libraries to build more functionality on top of it. Especially the gobject library is great as a foundation to do modular programs.

    2. Re:aggressive use of glib by LizardKing · · Score: 2

      I'll second the recommendation to use glib. It is not only a useful, portable library, but a great resource for code snippets when you don't want to force a dependency on the whole thing. In short, it's the really useful bits that a C++ programmer would expect to find in the standard C library, but without C++ obfuscation (operator overloading, generics and multiple inheritance - yuck). The only complaint I've got is that I can't find decent examples of how to create my own gobjects.

      Chris

  25. NO string copy function is intuitive by pclminion · · Score: 2
    Truncating string copies are always wrong, no matter whether you use them correctly.

    What if the result would be bigger than the output buffer? strncat() does the "right" thing, and doesn't overflow the buffer. But your string just got truncated! That's probably bad. So, suppose you check for this problem, by examining the string lengths beforehand. You verify that the result will fit, and not be truncated.

    But now that you've gone to that trouble, and you know that the result will fit, why bother with the strncat()? Since you already know there is no overflow, you can go ahead and use the (faster) function strcat().

    Now, in order to avoid these problems, you might write your own string concatenation function, that first computes the total size needed for the result, allocates it, and then copies the strings into this new buffer. Now, the issue of buffer ownership comes up, and you introduce a new class of possible bugs: memory leaks.

    The fact is, in any non-garbage-collected language like C, string handling is a pain in the ass. The problem runs deep, and can't be solved by any quick hack like strlcat().

    1. Re:NO string copy function is intuitive by thogard · · Score: 2

      trunkcating strings isn't alwasy wrong. When your accpeting input from a user and the valid inputs are always less than X bytes, truncating a larger string isn't a problem and easier than than the memory managment required to protect the grabage.

      strncat has a problem that if you give it a string thats too big it doens't trucncate, it can concatinate with the next thing in memory. Remember it won't put the null at the end if the source string exceeds the size of the buffer.

    2. Re:NO string copy function is intuitive by spitzak · · Score: 2

      If 99.999% of the time the string is shorter than the buffer, using strlcat is a huge win in speed.

      strlcat returns the length of buffer that is needed. It's design actually agrees with what you are saying, if it overflows the buffer it "wastes time" counting the rest of the characters, rather than just quitting with the buffer truncated. This is because it knows that the proper response is to allocate a new buffer.

      strlcat is much faster than calling strlen before every call, which for many programmers is extremely important.

  26. Re:+1 Insightful by Twirlip+of+the+Mists · · Score: 5, Funny

    Perl is for idiots who think regexps can solve all problems.

    s/idiots/wise souls/
    s/think/know/

    Problem solved.

    --

    I write in my journal
  27. What C can do that Perl can't by yerricde · · Score: 5, Insightful

    I still have yet to write a single useful C program that I couldn't have done in Perl.

    Can you write a video driver with acceptable performance in Perl? Can you write programs that do things other than text manipulation, such as (say) a 3D engine and make them faster in Perl than in C? Remember that in the real world, time is money because a shorter execution time means lower system requirements and thus a larger market for mass-market desktop applications.

    --
    Will I retire or break 10K?
    1. Re:What C can do that Perl can't by Anonymous Coward · · Score: 3, Insightful

      The claim was not "can", it was "have". Have you written a video driver? Have you written a 3D engine?

      Neither have I. Neither have most programmers. If you don't work for a company that makes graphics hardware or operating systems, I suspect you probably never will -- at least, not a "real world" one where performance really matters.

      For the majority of programs, there are more appropriate languages. Some programs may require C, but only a small percentage.

  28. Re:data stacks (NSAutoReleasePool vs. NSZone) by Jimithing+DMB · · Score: 5, Insightful

    Well, not quite. An NSAutoReleasePool does not allocate a large region of memory and suballocate objects out of that. What an NSAutoReleasePool does is make it possible to avoid explicitly sending the release message for temporary objects.

    For example, from Foo() I allocate an NSObject with [[NSObject alloc] init] and pass that as an argument to Bar() which takes ownership of it. However, I must then ensure that I release the object because Bar() is following good coding practices and retains it, so thus with alloc+retain it's reference count is now 2. So instead what I do is Bar([[[NSObject alloc] init] autorelease]) which allocates NSOjbect (with ref count one) initializes it, marks it for autorelease, and passes sends it to Bar() which retains it (ref count 2) and keeps a pointer to it (presumably it is a method of a class). Coming out of bar the ref count is now 2, and perhaps Foo() proceeds to do some other things. Presumably at some point higher up the call stack (or perhaps at the beginning of Foo()) an NSAutoReleasePool was allocated. At the corresponding exit point (either at the end of Foo() or the end of whatever higher up function) [whateverpool release] will be called. When the pool is released, it will call release on any objects it has been asked to take ownership of. At this point one of two things it true. Either the class that Bar() belongs to has already released the object and thus its reference count went back down to one, and now is going to zero (so bye-bye), or the class that Bar() belongs to has not released the object and doing this release merely brings the refcount back to one such that when the other owner releases the object, its refconut will be zero and it will be freed.

    Sorry if that was confusing, but in reality it's really not. It also really helps out when you are coding functions that allocate ObjectA, then allocate ObjectB, then ObjectC, and then find out something is wrong and need to "roll back" to the begining. If you allocate an NSAutoReleasePool at the beginning, and autorelease everything you alloc then if you error out you can free the release pool and everything gets released. If you don't you can simply retain what you need and then free the autorelease pool.

    Anyway.. what this guy is REALLY talking about is NSZone. NSZone allocates a chunk of memory which other objects will be allocated from. The caveat being that while the memory will be freed, the objects will not be properly destroyed. Now this guy was talking about holding C strings and the like, so this is not a problem. However, had he been holding some C++ or objective-C objects this would be a problem as none of the destructors/deallocators would ever be called.

    I think what it all boils down to is that programmers need to read more code than they write and that we should really be getting Masters of Fine Arts in Programming. I completely agreed with what Dr. Gabriel said. Programming is about as much like building a bridge as writing poetry is. That is to say.. not much.

    Going along with that thought, I think it should be pointed out that /EVERYONE/ here who programs in any language (but specifically C programmers, and ESPECIALLY C++ coders) needs to learn Cocoa and Objective-C. I imagine some of the C++ whiny bitches are going to continue to whine about how much easier and better C++ is, but for those of us who actually prefer to wrangle pointers, Objective-C is where it's at. It's like C with JUST enough object orientation, but not overdone in some committee like C++. Also, one should note that I do like C++ quite a bit, but sometimes there's too many provided ways to do things. With Objective-C, the provided ways are almost all good. In addition, like C or C++ you are not limited to doing it that way, it's just that Objective-C only makes it easy to do good things.

    Think for example of wxWindows vs. Microsoft MFC. wxWindows is suprisingly similar to Cocoa (although wxWindows does not do ref counting so making sure that one and only one class ever owns an object can be problematic at times). MFC, on the other hand, is rather a bear to work with as Microsoft has written it such that an MFC programmer /can/ do things multiple ways, none of which work very well. Obviously this is a generalization, but I think the average MFC programmer will understand where I'm coming from here. That is, again, except for the whiny C++ and MFC bitches who can't figure pointers out. Go home!

  29. Obstacks by p3d0 · · Score: 3, Informative
    The "data stacks" described in the article sound like a slightly less-evolved version of GNU obstacks. The main difference seems to be that the article uses a single global data stack.

    I think the HOWTO should have a reference to obstacks, rather than claiming data stacks are a new invention. (Hint: data stacks have been used many, many times in many, many projects. GNU obstacks are the only one for which I can find a URL at the moment.)

    --
    Patrick Doyle
    I mod down every jackass who puts his moderation policy in his sig. Oh, wait a sec....
  30. Re:Overly simplistic by cras · · Score: 2, Informative
    Granted, buffer overflows are the source of a great number of security issues, but with the right arsenal of helper functions (see the StrSafe API..

    That sounds like a yet another solution for safe string handling. Like I said, I think they're too highly advertised as being the only way to overflow buffers.

    The remaining are all the weird edge conditions (I've seen buffer overruns that only came about when there was race condition between two threads, for example.)

    Threads? Yeah .. I wouldn't really even bother thinking about security with threads.

    What about all the other aspects of writing secure code? They don't even get mentioned.

    There's now a link to Secure Programming HOWTO which talks about most of the other things just fine. Maybe I could write about a few other things that aren't too well discussed in that HOWTO, like integer overflows (although it's next version will contain several of my examples about them).

    Presume your security measures will fail, because eventually, they will.

    Not necessarily. Or are you talking about complete systems here instead of individual applications? If your application doesn't have external dependencies other than libc and you write it fully up to ANSI-C specs (that's a bit difficult actually) and in general you're careful enough, it's theoretically possible your program is secure now and forever. libc, kernel, user, etc. bugs are different things then, although you could try to prevent some of them as well (don't give dangerously parameters, don't use dangerous functions).

  31. reference counting by ttfkam · · Score: 4, Informative

    The main problems with it versus broader garbage collection schemes are circular references and overhead.

    If two (or more) objects have a reference to one another, the count can never reach zero even if nothing in the main logic points to those objects anymore.

    Also, every time an object gains or loses a reference, a check for a count of zero is made. In fuller garbage collection setups, periodic checks are made to all of the objects in a low-priority thread. In some cases, memory usage can be higher, but performance is also higher sometimes and it can handle circular references.

    Both are better than repeated use of malloc/free and new/delete though.

    --

    C also muddies this concept because there are no objects in C.

    --

    - I don't need to go outside, my CRT tan'll do me just fine.
  32. You just reinvented alloca() by lamontg · · Score: 3, Interesting

    From the FreeBSD manpage:

    ALLOCA(3) FreeBSD Library Functions Manual ALLOCA(3)

    NAME
    alloca - memory allocator

    LIBRARY
    Standard C Library (libc, -lc)

    SYNOPSIS
    #include <stdlib.h>

    void *
    alloca(size_t size);

    DESCRIPTION
    The alloca() function allocates size bytes of space in the stack frame of
    the caller. This temporary space is automatically freed on return.

    RETURN VALUES
    The alloca() function returns a pointer to the beginning of the allocated
    space. If the allocation failed, a NULL pointer is returned.

    SEE ALSO
    brk(2), calloc(3), getpagesize(3), malloc(3), realloc(3)

    BUGS
    The alloca() function is machine dependent; its use is discouraged.

    FreeBSD 5.0 June 4, 1993 FreeBSD 5.0

  33. What's the gain? by theSilentOne · · Score: 2, Informative

    You should more clearly mark, what gain can be expected by which measure. Allocating on the stack (with alloca() or something similiar) gains you speed, some convenience, but no security (buffer overflows are more readily exploited to inject harmful code, if the buffer is allocated on the stack).

    You failed to describe what's wrong with strncat(), strncpy() etc. IMHO people who can't comprehend the man pages for those functions probably should avoid C altogether, but definitively must be hindered to write security relevant software (as should sleep-deprived coders who try to do it on a Sunday morning ;-} .

    Said that, I can only appreciate your attempt to raise this issue (once more, maybe for a new generation of C coder).

  34. Re:Or Otherwise Known as by cras · · Score: 2, Interesting
    How to program in an amazing unthread safe manner!

    But then again, threads are useless for most applicatios, especially the ones I've written so far. Besides, it's easy to make it thread safe with per-thread data stacks and adding locks to other stuff.

  35. Re:+1 Insightful by Twirlip+of+the+Mists · · Score: 2

    Since when do personal attacks get moderated "insightful?" Somebody throw this guy a "-1, flamebait" please.

    --

    I write in my journal
  36. Not complete? by mnmn · · Score: 2


    Seems a bit on the "strings" side, so I assume the text is not complete.

    What I wanted to read on was how to create modular programs with C, as in function pointer arrays and how to generally modularize the application. My attempts at building larger apps have resulted in instability, and I do not want to get into C++. Maybe some details on howto allocate mem less frequently in larger chunks would be also useful.. ..just my rusty 2c.

    --
    "Give orange me give eat orange me eat orange give me eat orange give me you." -Nim Chimpsky
  37. scanf and friends by usrerco · · Score: 5, Informative
    No such document should be without mention of scanf(3) misuse, and gets(3) use at all.

    Regarding scanf(3), many people don't realize this is Bad:

    • char cmd[80], arg[80];
      scanf("%s %s", cmd, arg); // BAD

    This is Good:

    • char cmd[80], arg[80];
      scanf("%79s %79s", cmd, arg); // GOOD

    This prevents a buffer overrun if a word contains 80 or more consecutive non-white characters.

    Ditto for sscanf(3) and fscanf(3). Never forget the N+1 when declaring the arrays (eg. char s[80] vs %79s) to leave room for the NULL.

    Here's a good command to run on all your .c files to find such problems:

    • egrep 'scanf(.*%s' *.c

    ..any lines that match are a potential problem.

    And in a document like this, *definitely* point out the whole gets(3) problem; the granddaddy of them all. Never use gets(3), period. Use fgets(3) instead.

    The gets(3) interface is inherently insecure; a problem waiting to happen by its mere existence. Any code that uses it is broken.

    There are probably some others (someone mentioned strcpy) I'll try to post more if I think of them.

    1. Re:scanf and friends by dvdeug · · Score: 2

      This is Good: [chopping off input at 80 characters]

      Silently truncating code at 80 letters is good? It's a quick security hack; it prevents a buffer overflow, at the cost of losing information and seriously annoying users if they had data that was more than 80 letters long.

  38. Vector class by Funkitup · · Score: 2

    I had a quick peruse at the web site. I must admit the vector class in the C++ STL is well worth learning. It's not as quick as the usual error checking you get with arrays, but it is very secure. And once you know that you can move onto lists and maps.

    But hey, it's not C. Ohhhh for a program that is so power hungry I have to write it in pure C. ;o)

  39. Re:+1 Insightful by Twirlip+of+the+Mists · · Score: 2

    Since when do personal attacks get moderated "insightful?" Somebody throw this guy a "-1,
    flamebait" please.


    (time passes...)

    Moderation Totals: Flamebait=1, Insightful=1, Total=2.

    Thank you. ;-)

    --

    I write in my journal
  40. I'll believe this when I see... by SensitiveMale · · Score: 2

    a Secure, Efficient, and Easy to use Windows OS.

  41. Re:+1 Insightful by vsprintf · · Score: 2

    I still have yet to write a single useful C program that I couldn't have done in Perl.

    Well, yeah, you can do the same thing as C code in Perl more slowly and less efficiently. Conversely, Perl is my language of choice for some tasks. The right tool for the right job. You obviously don't do any systems programming.

  42. Just another C string library by Nevyn · · Score: 3, Informative

    Some of the idea's aren't bad (and those have been done before), but mostly it's just another simple dynamic string library in C.

    As for efficency...

    t_strconcat() is one function that I also copied from GLIB. It's a bit dangerous though, the terminating NULL is too easy to forget. I've been thinking about removing it entirely, but it's much more efficient than t_strdup_printf() so I haven't yet had the heart :)

    ...this pretty much speaks for itself. Why Is strconcat() so efficient compared to just doing strcat() multiple times? Because you've got a model for representing the data that has ZERO metadata, and a model for storing the data that requires you to reallocate bits of memory all the time.

    Assuming you can just disacount all this overhead by using memory pools, is a simplistic outlook (for instance even if you waste gobs of memory so you don't have to call malloc that much you'll still need to do copies all the time)

    There are more than a few much better string libraries out there for C. Probably the best for an IMAP server is probably Vstr as that was deigned to work well in an I/O context (For instance it doesn't need strconcat() like calls in the API because doing repeat adds is just as fast).

    --
    ustr: Managed string API with ave. 44% overhead over strdup(), for 0-20B
  43. Re:cras, why you choose C ? by dead_penguin · · Score: 2

    And a lot of people want to use only C code. Writing IMAP server with any other language would quite likely have gotten only a couple of users.

    Sorry, but I don't understand how this can really be true, unless you really meant developers instead of users.

    When looking for a piece of software, I'd really only consider questions such as "Does it run on my target platform?", "Does it have the set of features I need?", "Is it stable?", and "How much will it cost me (in time and money)?". Performance is, of course, another issue I'd be interested in (I'd probably group this in with features).

    While the choice of language can influence all of these in one way or another, I seriously doubt most users are interested in *how* their criteria are met as long as they are.

    --

    It's only software!
  44. Henry Spencer said it all ... by Alain+Williams · · Score: 2

    about 15 years ago IIRC, see http://herd.plethora.net/~seebs/c/10com.html Still very good advice.

    Never forget that C is just a machine independent assembler, you need to have a good understanding of how machines really work to be able to write good C programs.

    Also: plan the code and code the plan. C is a language that bites you if you are sploppy.

  45. This is bollocks by Old+Wolf · · Score: 3

    Why is this bollocks?

    To summarise the articles: a bunch of small libraries providing object-based memory allocation and string handling.

    Kudos to the poster for enabling himself to write code in a way that's good for him. But that doesn't mean it's good for anyone else.

    For example, I'm not going to go and learn 20 more function names and have more library dependencies and I wouldn't recommend anyone else does either.

    Finally, suppose one wants a better string library or memory library. There are already plenty of good, with-much-work-done-on-them, open source libraries out there. Tried and tested. Not to mention the C++ STL.

    Pick one that means many other people will also be able to read your code and be familiar with the libraries you use! There's nothing I'd hate more than working on a project written by someone using these libraries. Not only do I have to analyze the code, I have to analyze these libraries, and also manage to keep them and their quirks in my head while I am reading the program. Yuck.

  46. Re:Nice little remark, there, michael by cubal · · Score: 2, Insightful

    no, no, no, that's a paradox... an oxymoron is two words or ideas juxtaposed that _imply_ contradiction, or that wouldn't normally fit together ("...pretty ugly","Microsoft Works","Military Intelligence")

    "Secure, efficient and easy" would at first seem to be impossible, but on closer inspection is not so... that makes it a paradox.

    (admittedly, it has oxymoron-like properties, but I think the fact that there are three parts to it rather than two negates that)

  47. Bjarne says "Use C++" :) by wray · · Score: 3, Informative

    Of course Bjarne Stroustrup would say this, but he has some nice examples backing his statements up, too. See his FAQ and his paper on "Learning Standard c++ as a New Language".

    Stroustrup explains some nice details on especially this issue of memory constructs. He makes a convincing argument for why C++ is easier for C-style programming... Especially for those of you (One I saw below) who "Don't want to get into c++", realize that you can edge into it pretty easily, and accomplish your tasks more easily and quickly -- give it a try!

    --
    Guess what? I got a fever! And the only prescription.. is more cowbell!
  48. I send you this post to have your advice by denshi · · Score: 5, Informative
    Prototyping in a higher-level language (c# is easy, java everyone knows) is a superb idea, provided you
    - can release the final product as interpreted, with slow execution speed
    - can afford the time to port all to C, in which case DO, this is an excellent way to make a watertight C program
    Sir! I wish to introduce to you to the strange new-fangled notion of compiled high-level languages! Yes, languages with higher-than-C-level abstractions have been sneakily producing native machine code for some time now. Some of the most popular are listed below:

    • O'Caml is a marvel of strongly typed object orientation, but you'd hardly know it from using it -- there are almost no C-style type declarations; as a ML child, O'Caml uses type inferencing to prove powerful assertions about program validity and improve programmer convenience. It's compiled! And if you watch the ICFP's, you might note that it consistently beats C compilers for speed of execution. '92, if I recall.
    • I never really bought OO, so S/ML is fine by me. Still compiled, since 1984.
    • And they both descend from ML, started in 1973.
    • Lisp was compiled in 59 or 62 (mccarthy or 1.5, chose your valid date). But then, I suppose it'd have to be compiled, since the notion of interpreted code hadn't been concieved of yet!
    • Erlang is the last, best, word in concurrent programming. If you want to write a high throughput, reliable threaded application, you shouldn't even think of the word 'C'. This broke out of its lab in '87, first compiler in '91.
    • Scheme is often thought of as a testbed for interpreted language concepts, but even it can be compiled, and with concepts such as continuations that can actually make a C programmer's head explode! Since 1982, commercial grade compilers have been available.
    • Even haskell is compiled, but as monadic programming is less than 10 years old, no one knows how to always write really fast code in it yet. Leave your number, we'll call you in 2034, right before you gear up to deal with your year 2038 rollover crisis.
    Welcome to the late 1970's! We look forward to your eventual arrival in the 80's and early 90's. Please enjoy your stay!

    ps. As modern coding is more about the manipulation of very complex structures, rather than how to say, walk a linked list; a higher level language, with native support for more complex constructs, has the potential for creating much faster applications than something on the level of C. The reason being is that the h/l compiler can reason about, and thus optimize over, larger components than the C compiler.

    1. Re:I send you this post to have your advice by Kragg · · Score: 2

      The reason being is that the h/l compiler can reason about, and thus optimize over, larger components than the C compiler.

      Links man, come on! This is Slashdot, you can't just make wild assertions without backing them up with facts. Or at least a random opionion off the web... there must be one out there somewhere.

      I'd love to see evidence of a functional (or any other) program that can outperform the naive C equivalent.

      As for bypassing the proto- stage and going straight to completed app using ML, if it's such a good idea, why doesn't this happen? Is it just because nobody ever released "MFC4ML"? Or are half the binaries I buy actually compiled Lisp? I doubt it...

      --
      If you can't see this, click here to enable sigs.
    2. Re:I send you this post to have your advice by Pseudonym · · Score: 2
      Links man, come on! This is Slashdot, you can't just make wild assertions without backing them up with facts.

      You're new around here, aren't you?

      Since you asked, though, the first thing to realise that you may well have written a program in a high-level language which can way outperform the naive C equivalent yourself. Ever used yacc (or bison)? It's a high-level language compiled to C, after all. I defy you to write a naive (the "naive" part is important) LALR(1) parser in C yourself which outperforms those generated by yacc and related tools.

      Slightly less facetious examples:

      Still, this is not the real benefit of high-level languages. The point is that in many situations, you gain a lot without paying too much. There's always C and assembly language below a high-level language if you find you really need it. If you don't, or for those part of an application where you don't, you get rapid development, higher robustness and better maintainability, and that's where you win.

      --
      sub f{($f)=@_;print"$f(q{$f});";}f(q{sub f{($f)=@_;print"$f(q{$f});";}f});
    3. Re:I send you this post to have your advice by Panaflex · · Score: 2

      Even Bjorn's paper says..

      "Comparisons of languages, libraries, and programming styles are notoriously tricky, so please do not draw sweeping conclusions from these simple tests."...

      Pan

      --
      I said no... but I missed and it came out yes.
    4. Re:I send you this post to have your advice by axxackall · · Score: 2
      Once we list here well designed, easy to use, rapid to program, fast to run, possible to compile FP languages, then don't forget about Oz/Mozart programming language and system.

      The preformance of the FPL programmers working with very extremely complex requirements will always outrun the performance of C programmers. And that is more important than the runtime performance (remember Javaistic argumets about cheap and fast hardware resources?). There are many cases when run-time performance of FP programs will be better than C one, as most of low level details are already optimized and hidden in libraries and interpreters, while C programmers are still moving through lots of errors and mistakes in their reinventing the wheel projects.

      The only problem is that all stupid managers, after reading commercials, don't want anythng else, but only C, Java and VB. I heard about projects where people use XML syntax for interpreted Lisp or Scheme code because they can tell the boss: "look, boss, it's not Lisp, it's just XML". Managers today just love XML and usually buy the trick. No wonder there is an official project of "flat" and XML notations for Curry, the language with Haskell and Prolog ideas.

      --

      Less is more !
    5. Re:I send you this post to have your advice by Pseudonym · · Score: 2

      While that's true, recall what the challenge was:

      I'd love to see evidence of a functional (or any other) program that can out perform the naive C equivalent.

      This is a C++ program which out-performs the naive C equivalent, at least on one platform. I don't draw any conclusions from this other than that there is evidence.

      Intuitively, though, languages which support compile-time specialisation of polymorphic code is always going to beat the naive C equivalent (probably based on callbacks) ll other things being equal. In the case of the comparison between C and C++, they almost certainly are equal, as most C compilers are really C++ compilers run (or compiled) with C++ turned off. Similarly, chances are good that your C library and your C++ library were written by the same people.

      --
      sub f{($f)=@_;print"$f(q{$f});";}f(q{sub f{($f)=@_;print"$f(q{$f});";}f});
    6. Re:I send you this post to have your advice by denshi · · Score: 2
      The reason being is that the h/l compiler can reason about, and thus optimize over, larger components than the C compiler.

      Links man, come on! This is Slashdot, you can't just make wild assertions without backing them up with facts. Or at least a random opionion off the web... there must be one out there somewhere.

      How is that a wild assertion? A higher level compiler can make more global optimizations than a lower-level one. Welcome to introductory CS... For example, C has the concept of structs; assembly doesn't; a C compiler can optimize a struct for packing, alignment, access speed, etc; the assembler can't make those kinds of decisions intelligently. This pattern is repeated all over computing...What are some things (affecting execution speed, let's ignore all the other cool things) that a high-level language can reason about that a C-level lang can't? Try memory management, real numbers, exception handling, real types (no casting), tail recursion stack elimination, co-recursion, lambda expressions, a large base of first class types, etc....
      I'd love to see evidence of a functional (or any other) program that can outperform the naive C equivalent.
      Why is that difficult? Dammit, Jim, almost anything done carefully can outperform the naive C equivalent -- C is only fast and effective when it is done as carefully as assembly usually warrants. C can be faster, if you can hold all the myriad low-level details in your mind and optimize all of it correctly; h/l/ls can reason about much of that themselves, assuring good mean optimization and leaving you to focus on fewer components. In practice, this dichotomy is noticed in that in a large random sample of programs written in a variety of languages, low level langs like C have a very large standard deviation - the lower point of the curve are very, very, fast programs, but the curve is so broad, you'll find C programs way out in O(n^3) land; the h/l/ls are a bit above the bottom, but their s.d. is much smaller - so they are more predictably fast than a product full of reinvented wheels.
      As for bypassing the proto- stage and going straight to completed app using ML, if it's such a good idea, why doesn't this happen? Is it just because nobody ever released "MFC4ML"? Or are half the binaries I buy actually compiled Lisp? I doubt it...
      It happens, but not that often. There are the issues of available coders ("how do I find people") which is usually a red herring; language bigotry from VCs, middle managers, & press ("you use what??") - example: since the AI Winter of the mid 80's, Lisp has been a dirty word; delivery method (desktop guis have a very strong impetus to write apps in the OS language, aka, C/C++); and a few others. There are successful companies developing software in advanced languages, and they tend to have a few things in common: they work with very small teams, they don't tell anyone what they dev with, and they write server apps or desktop apps for niche markets. Suffice it to say that popularity != quality. And how often, where you work, have you been able to choose tools regardless of the marketing-informed opinions of the suits? Programming is a wierd field where the actual craftsmen are often unable to control the choice of their tools.

      Anyway, would the /. kiddies please read a little history of computing? C is not the beginning and end of languages....

  49. Not to belabor the point by xant · · Score: 3, Informative

    You can write C code to extend Python. It's a very common technique. The advantage of C, and it is a big advantage, is speed... but most programs don't need that speed advantage everywhere, only in a few intense and heavily-used operations. (Optimize the innermost loop...)

    The advantages of Python for almost every other operation are really too numerous to list.

    Your point about "right tool for the right job" is well taken. _Good_ Python programmers learn the C extension API, and use it when appropriate. Guido van Rossum, the creator of Python, even states in one of his papers "If you feel the need for speed, go for built-in functions - you can't beat a loop written in C."

    --
    It's rare that you're presented with a knob whose only two positions are Make History and Flee Your Glorious Destiny.
  50. Boehm Garbage Collector for C and C++ by alienmole · · Score: 2

    Why do you say the Boehm GC can't do much with C? Have you actually tried it? Operation with C is one of its major strengths, and reasons for existence. It automatically collects allocated data that's no longer referenced. For memory management, what more do you need? Sizing buffer allocations is a separate issue, which can be dealt with separately.

    The one problem Boehm GC can have is if data on the stack or in the heap happens to look like it contains pointers to allocated data, but doesn't actually, which can lead to space leakage. In practice, in most applications, this isn't a problem. If it is, in many cases, there are ways it can be dealt with.

  51. Re:uh by JKR · · Score: 2
    He's trying to claim Windows doesn't have snprintf() - he is, of course, talking crap. Since it wasn't an ANSI C function, it's implemented as _snprintf in Windows.

    Jon.

  52. Exceptions in C? by Pseudonym · · Score: 2

    As a matter of interest, how do you combine cleanup and exceptions in C? I mean if you throw an exception, you want this memory deallocated and this file closed and this lock released and so on.

    I can think of a few ways to do it, but none of them are anywhere near "natural-looking".

    Do you have any references?

    (No, this is not a pro-C++ troll. I'm genuinely curious.)

    --
    sub f{($f)=@_;print"$f(q{$f});";}f(q{sub f{($f)=@_;print"$f(q{$f});";}f});
    1. Re:Exceptions in C? by pclminion · · Score: 3, Informative

      You use a hybrid stack. You push two kinds of objects onto this stack: environment frames and cleanup frames. When you use the TRY macro to open a new exception frame, you push an environment frame onto the stack. This frame includes a jmp_buf struct which is filled in by a call to setjmp(). If an exception is thrown, control will transfer back via longjmp(), using this jmp_buf.

      Then, as you allocate memory, open files, lock mutexes, or whatever, you register cleanup functions with another macro. This pushes a cleanup frame onto the stack indicating a function to call along with a single argument.

      Then, if an exception is thrown, you just pop cleanup frames off the stack and execute them, until you hit an environment frame. At that point you call longjmp() to transfer control to the user-code exception handler, inside the CATCH macro block. That user code can choose to do cleanup or error recovery, or it can THROW again and continue propagating the exception up the stack.

      Figuring out how to implement the TRY, CATCH, ENDCATCH, and THROW macros is fun, so I won't give away exactly how to do it. It's simple, and involves a creative use of a do-while statement.

  53. glib rules by 0x0d0a · · Score: 2

    If you use glib (that blessed library that makes C programming pleasant instead of miserable, not to be confused with glibc), you get a couple of extremely handy functions:

    g_strconcat() (mallocs a new string that's just large enough, concatenates all passed in strings to it)

    g_strdup_printf() (mallocs a new string that holds the result of a sprintf()).

    Most people's exposure to glib is usually through gtk+, which uses it heavily.

  54. Uh, huh by 0x0d0a · · Score: 2

    Wee bit of a functional bias, eh?

    You're right that C limits large-scale optimization too much, though...

  55. use C++, but use it almost like C by g4dget · · Score: 2
    Secure, efficient, and easy C programming is no problem--if you use C++ but program it in a C style.

    Many C++ programs and class libraries suffer from Smalltalk-envy. They want to be completely general frameworks, solving any possible future problem you might ever encounter. You find madness, bloat, and slipped deadlines if you go down that path.

    But if you stick to the standard C library (which is part of C++) and approach C++ like you would C, you can write programs that work with C-like efficiency yet are considerably easier to make safe and secure.

    For example, instead of the bloated and hard to debug STL, just define a 15 line template array class that does array bounds checking and deallocates its pointer when it's done.

  56. Jeez, just learn C++ already by Moses+Lawn · · Score: 3, Interesting

    OK, so that subject's a little inflammatory. But my god, I don't see why anybody is still writing new code in C in this day and age. C++ has been a fast, stable, standardized language for what - 10 years now? All the problems with buffer overflows that require hokey, kludgey workarounds in C are cleanly solved with any well-written string library (like, say, the one in the STL). Memory pools can be nicely wrapped with a class that pushes in the ctor and pops in the dtor, so you don't have to remember to call them in the right order everywhere (just declare an object at the top on the block).

    The arguments I've seen against C++ seem to fall into the following categories:

    * It adds bloat and it's slow
    No, not since optimizing compilers were perfected in the 90s. You can add a lot of overhead to your app by abusing the STL, but for non-trivial applications, you'll never notice it. GCC (at least for the pre-3.0 series) has a really unoptimized template implementation, where "Hello, world" using cout would make a multi-megabyte executable (and be forever compiling it), but more modern compilers, like VC++ and Intel's compiler, do a lot better. Either way, for a real-world app, any size increase will be unnoticable. As for speed, with an optimizing compiler and judicious use of inlining, a C++ program will run just as fast as one written in C.

    These complaints may have been true in the days of the Cfront preprocessor, but not today. I don't know about you, but I no longer write code for a 386 with 4 meg of memory.

    * I don't like/need/want to learn OOP
    You don't need OOP to use C++, but it helps. A class is just a struct where everything's private by default. If you know C, it takes about a day to learn the basics of constructors and destructors, references, and exceptions. Templates and STL will take a bit longer. One great about C++ is that you can just use small bits here and there if you don't want a full-blown OO program.

    * It's not as good as Perl/Python/Ocaml/Eiffel/Java/whatever
    That's not the point. It's not supposed to be. It's supposed to be as good or better than C. If you want a standalone-executable without linking in a complete interpreter and you don't need a lot of string parsing or regexps, you were using C anyway.

    * It won't let me write libraries that work with other languages
    Just declare all of your external APIs using 'extern C' and make sure they only use C types in their signatures. Done.

    The main reason not to use C++ in new development seems to be "I don't want to learn it" or "I don't know anything about it". If you use either one, I don't ever want to work with you.

    --

    What if life is just a side effect of some other process and God has no idea we exist?

  57. Re:+1 Insightful, PERL can do more! by Anonymous Coward · · Score: 2, Informative


    When I was a production coder for a decade writing internal apps, I could always find things that I could do in PERL that were almost impossible in C.

    My personal favorite was a typical "data pump" app that did some frontend work for a larger (15 GB+) data stream in order to massage it inline as it went from tape to an Oracle load (we didn't want to stage it on disk first).

    The PERL apps could *ALWAYS* soak a CPU on our Sun box while transforming the data.

    Try as I might, I could never get a C replacement program to do the same. At best, the C code posted percent utilizations in the low double digits.

    Pity, I like C, but if we keep using it, we will never be able to force management to buy another twin-CPU module. PERL rocks!
  58. it should have a section comparing C to C++ by small_dick · · Score: 2

    ...and while doing so explain how to hide data, make friendly header files, properly expose data, in C.

    --


    Treatment, not tyranny. End the drug war and free our American POWs.
    See my user info for links.
  59. Is it just me or does slashdot suck more and more? by sgml4kids · · Score: 2, Insightful


    1. There are more ways to exploit C code than looking for buffer overflows. race conditions are a more prevalent and portably exploitable vulnerability of a large body of C code (eg. config file integrity). Following the author's guidelines barely improves the security of any program. If you want to make your code secure, spend a month reading the 1000s of articles online (or at the ACM or IEEE or CERT/CC) about how software is compromised. This is so much crap.

    2. This is so not news for so many reasons. Slashdot is becoming so out of touch (yes, isn't it cool knowing some freak shoved a Pentium giga-twat up his ass and replaced his eyeballs with WiFi LCD projectors?) I sometimes get nauseated reading these stupid "news" items.

    Slashdot: News for the Herd. Stuff that goes "Baaaaaa"

  60. Re:Efficient how? by jeremyp · · Score: 2

    He doesn't realy address all security either unless you say security equals avoiding buffer overflows and memory leaks.

    --
    All I want is a secure system where it's easy to do anything I want. Is that too much to ask ~~ Randall Munroe
  61. Re:K&R designed for paper, not for monitors by psamuels · · Score: 2, Informative
    Yeesh - I never even knew that bracketing styles had their own fucking terminology before.

    So what do you type when M-x c-set-style asks you to pick a style? (:

    Your choices, btw, are: "bsd", "cc-mode", "ellemtel", "gnu", "java", "k&r", "linux", "python", "stroustrup", "user", and "whitesmith". Many of these are only subtly different from each other - frex, "linux" is basically "k&r" with an 8-space basic offset.

    That's why these styles need actual names - you can just blame it all on Emacs. (:

    --
    "How can you claim that you are anti-crack, while still writing a window manager?" — Metacity README
  62. My micro-howto by Hard_Code · · Score: 2

    Secure, Efficient and Easy C Programming

    * Not possible. Stop using C for the love of god.

    ---

    But seriously, am I the only one that thinks that circumventing C's lack of sophisticated memory management by using a hack involving surreptitiously using stack frame memory is BAD BAD BAD? Certainly not secure or easy?

    How about the next howto:

    "Shooting yourself in the foot, securely, efficiently and easily!"

    --

    It's 10 PM. Do you know if you're un-American?
  63. Exceptions in C - check out SIOD by alispguru · · Score: 2

    Exceptions in C. You can get quite natural-looking exception handling in C, with some convoluted macros. I'm sure most hardcore C coders have come up with their own implementations.

    The best exceptions-in-C implementation I've ever used is buried in SIOD by George Carrette. Despite using setjmp/longjmp, it's portable as all hell.
    --

    To a Lisp hacker, XML is S-expressions in drag.
  64. there already is one by WhiteDragon · · Score: 2

    it's called Net::TCP

    *duck*

    --
    Did you mount a military-grade, variable-focus MASER on an unlicensed artificial intelligence?
  65. Re:cras, why you choose C ? by ttfkam · · Score: 2

    Don't forget "secure." C allows no protection from buffer overflows and other sundry security holes. Is it possible to code safely in C? Sure, but 99% of all existing C coders cannot.

    An IMAP server is an example of a widely available network service. Even if the IMAP server is slower because it was written in Python, you have a dramatically lower chance of opening up a remote root exploit.

    It all falls on where your priorities lie. I'd say that programmers these days should err on the side of safety for the sake of their users and not on squeezing the last bit of speed out of an implementation detail (choice of language).

    --

    - I don't need to go outside, my CRT tan'll do me just fine.