Slashdot Mirror


Mars Failures: Bad luck or Bad Programs?

HobbySpacer writes "One European mission is on its way to Mars and two US landers will soon launch. They face tough odds for success. Of 34 Mars missions since the start of the space age, 20 have failed. This article looks at why Mars is so hard. It reports, for example, that a former manager on the Mars Pathfinder project believes that "Software is the number one problem". He says that since the mid-70s "software hasnâ(TM)t gone anywhere. There isnâ(TM)t a project that gets their software done."" Or maybe it has to do with being an incredible distance, on an inhumane climate. Either or.

92 of 389 comments (clear)

  1. I think it's the metric system by xanie · · Score: 2, Funny

    You know, 1/10th of something rather than 1/4. Damn engineers can't figure out the conversion between metric and standard!

    --
    Fundamentalism stops a thinking mind.
    1. Re:I think it's the metric system by uncoveror · · Score: 4, Funny

      It's not the metric system, it's the martians, or Zhti Ti Kofft as they call themselves. These probes will probably suffer the same fate as Mars Polar Lander. and Mars Climate Orbiter. We probably already know a little more about Mars than they want us to.

      --
      The Uncoveror: It's the real news.
    2. Re:I think it's the metric system by mikerich · · Score: 4, Funny
      Ahem, people of Earth, your attention please!

      On behalf of the Zhti Ti Kofft (and it is nice to see at least one of you using our proper names); I should like to take this opportunity to inform you of one simple rule when approaching our planet.

      We drive on the left.

      Thank you.

    3. Re:I think it's the metric system by rasilon · · Score: 5, Funny

      Since metric is the standard, there is no conversion needed. It's those damn silly imperial measurements that the Americans still use that causes the problems. Put it this way, we (the British) invented them, if we were willing to bin them decades ago in favour of something the French invented, they must have been really bad.

    4. Re:I think it's the metric system by macdaddy357 · · Score: 2, Interesting

      Did you know that a law allowing the use of the Metric system in the United States was signed into law by President Johnson? Andrew Johnson!

      --
      How ya like dat?
  2. It'll make me think twice by BlueTooth · · Score: 3, Insightful

    Before complaining at the lack of manned missions to mars any time soon.

    --
    SPAM
  3. We landed on the moon with 512 bytes of RAM by vasqzr · · Score: 3, Funny

    ...or so the story goes. I'm sure we can make it to Mars with our current technology.

    I think it's hard to get to Mars because it's far away and it it's in SPACE! It doesn't take a rocket scientist to figure that out! Well on second though....

    1. Re:We landed on the moon with 512 bytes of RAM by Niles_Stonne · · Score: 5, Insightful

      I think that is part of the difficulty...

      With 512 BYTES of ram you can literally look at the entire contents. You can be aware of every single bit on the system.

      Now, where we have gigabytes of ram, and even more other storage it is simply impossible to sort through every bit. This errors roll in.

      I'm not sure what to do about it, but I see why there is difficulty.

      --
      Sticks and Stones may break my bones, but copyright will always protect me.
    2. Re:We landed on the moon with 512 bytes of RAM by mcheu · · Score: 5, Interesting

      Thing is, space exploration isn't done with *current* technology. The computing technology used in a lot of aerospace applications is 20-30 years old. There are a number of reasons for this, but the ones I've heard of are:

      1. The projects are long-term, and have been in development for a lot of years. Especially when it comes to government projects. They can't just up and switch to the latest tech whenever it comes around, otherwise it will end up like DNF and never see the light of day.

      2. The engineers don't trust the latest and greatest. The technology isn't considered mature enough. All the bugs have been worked out in the older tech, so it's more robust, the engineers are more familiar with it, and more often than not, manufacturers have shunk and simplified the designs significantly since introduction.

      It's more likely that you'd find a 8086 processor in the space shuttle than a Pentium 4 unless someone brings a laptop aboard. It wasn't all that long ago that NASA put adds on websites and geek magazines appealing for old 8086 processors for spare parts. I haven't heard anything since, so either they found a supplier, or they're too busy piecing together the Columbia.

    3. Re:We landed on the moon with 512 bytes of RAM by AndroidCat · · Score: 3, Interesting

      Yeah but... The Apollo 11 LEM computer crashed several times during the landing.

      --
      One line blog. I hear that they're called Twitters now.
    4. Re:We landed on the moon with 512 bytes of RAM by Idarubicin · · Score: 2, Interesting
      How about this? We're launching fairly small, very complex probes, that aim to do a lot more than the moon missions in some respects...certainly the craft are responsible for accomplishing a lot more 'unsupervised'.

      With the moon missions, there were manned craft, and so every line of code had to be checked and rechecked--and hundreds of guys were on the ground watching everything that happened, twenty-four seven, until the astronauts were safely back on the ground.

      Now, windows for a Mars launch come much less frequently. There might be a temptation to rush some of the QA and just cross fingers. Speed of light delay means that NASA can't intervene in most situations--problems are resolved one way or another before anyone on the ground even hears about them.

      Moon launch hardware had to last for a few days in space--stressful, busy, lengthy days, but a few days nonetheless. We expect Mars craft to spend months in hard vacuum and harder radiation, and then land successfully without human help, on a planet with higher gravity than the moon...

      Just some thoughts. The parent is right--Mars missions are hard because it's far away, and you have to travel through space to get there.

      --
      ~Idarubicin
    5. Re:We landed on the moon with 512 bytes of RAM by bigpat · · Score: 3, Informative

      "gigabytes of ram"

      no, for instance the Mars Pathfinder spacecraft had "128 Mbyte mass memory" and used a R6000 computer. While the rover had "0.5 Mbyte RAM mass storage" The R6000 is much less powerful than the original pentium.

      http://mars.jpl.nasa.gov/MPF/mpf/fact_sheet.html #S CCHAR

      NASA computer technology has for the past decade or two been a few or more years behind the state of the art in consumer electronics. Largely because they have to put the electronics through more testing and only use chips that will withstand possible radiation with low power consumption. Plus add on the years of development of the spacecraft itself... means that your desktop probably (Anyone want to do the math?) has more computing power than all the deep space explorers ever launched, combined.

    6. Re:We landed on the moon with 512 bytes of RAM by EvilTwinSkippy · · Score: 4, Insightful
      means that your desktop probably (Anyone want to do the math?) has more computing power than all the deep space explorers ever launched, combined.

      Yes, but can your computer recover from a triple memory failure? Can you rewire your computer remotely to fall back on a redundent system? Frankly I keep the covers off my case to keep my CPU from overheating.

      State of the art is not always measured in Gigahertz.

      --
      "Learning is not compulsory... neither is survival."
      --Dr.W.Edwards Deming
    7. Re:We landed on the moon with 512 bytes of RAM by Lord_Slepnir · · Score: 4, Informative
      Frankly I keep the covers off my case to keep my CPU from overheating.

      A bit of advice: Leave the covers on, but make sure that you have enough case fans to ensure that the CPU has a constant air current over it. I have the fan on the front of my box blow in and the fan on the back (plus the power supply) blow out. If you leave your case closed, the improved air flow will actually lower the temperature of your CPU and motherboard.

    8. Re:We landed on the moon with 512 bytes of RAM by Waffle+Iron · · Score: 4, Interesting
      Even with only 20K or so of code, the apollo guidance computer software development nearly slipped the schedule of the entire moon program. This page on this very interesting site describes the software development.

      I haven't read the whole site in a while, but IIRC, it describes the typical problems with software: underscoping the problem (in the 60s, most people assumed that the computer hardware development would be the majority of the effort), code bloat (the computer required much more memory than originally planned), buggy production code, schedule slips, problems caused by cruft. When the project started, they just waded right in to coding with few tools and little awareness of the need for proper engineering practice.

      This particular case was made more difficult by the program loading procedure: the program ROM was made one bit at a time by hand threading magnetic cores on to tiny wires then embedding it in a solid block of epoxy. The write-compile-debug cycle could be weeks. If bugs were discovered late in the schedule, the astronauts just had to work around them. The software devleopers did have mainframe-based simulators for development, though.

      With the gigabytes of space available for today's software, I'm surprised that any modern space projects get finished at all.

    9. Re:We landed on the moon with 512 bytes of RAM by pmz · · Score: 2, Insightful

      no, for instance the Mars Pathfinder spacecraft had "128 Mbyte mass memory" and used a R6000 computer.

      The grandparent post's point still stands. 128MB is one huge mass of program and data to debug. I know I wouldn't stake my reputation on a "bug free" multi-megabyte program--only a fool would.

      Remember, the true complexity of a program increases exponentially with the size of the program.

      This is why I will never trust Windows for anything more than a gaming platform (millions of lines of hastily-written code == one hell of a buggy program). I would bet that any recent version of Windows has several hundred thousand bugs in it.

      From a complexity standpoint, UNIX is an order-of-magnitude better than Windows but is still big enough to have lots of bugs. Linux is similar to UNIX in complexity.

      No software in wide use today is bug free. I have never seen software that was bug free. Even the printf() call in a "Hello World" program probably has bugs in it, regardless wether the "Hello World" program exposes them.

      Personally, I would never feel confident enough to write software that puts human life directly at risk, unless there are fail-safe non-software-controlled mechanisms in place. Sometimes, we just have to put software aside and let real Engineers do what they do best. And, yes, there is no such thing as a Software Engineer (it is still very much a made-up job title that anyone can have, even me:).

  4. sabatoge by InvaderSkooge · · Score: 2, Funny

    I'm fairly certian it's sabatoge on the part of the Martians.

    --
    Erik
    YOU ARE SAYING IMPUDENCE TO ME! THAT IS IMPUDENCE!
    1. Re:sabatoge by EpsCylonB · · Score: 2, Funny

      What, exactly, is the insight? Maybe there should be a "+/-1, TinFoilHat" mod.

      I used to mock the whole tin foil hat idea, until I put one on. Once their signals stopped entering my brain I started to see things differently. If you have never actually tried a tin foil hat then you shouldn't laugh.

  5. Its a shame by Anonymous Coward · · Score: 2, Insightful


    because software is one of the only things that could and should be theoretically perfect

    maths (especially that based on 1 or 0 is either right or wrong it seems to be only when humans get involved that things go wrong and mistakes happen

    1. Re:Its a shame by OldAndSlow · · Score: 2, Insightful

      Nonsense. Software is not math. Math is "for each program there exists (or could exist) a specification which makes the program correct." Not very useful.
      Software is human beings communicating with each other in ambigous natural languages and then trying to convert what they think they understand into a hyper specific computer language that a program (ie compiler) will translate into machine code.
      The hard part is trying to eliminate all the killer misunderstandings. One of the early Geminis came down several hundred miles from the planned spot because some programmer assumed that there were 24 hours in a day. Not in celestial navigation!
      Software is hard to do right.

    2. Re:Its a shame by tomstdenis · · Score: 2, Interesting

      Why wait 100 years? I'm ashamed of most programmers *TODAY*. Stupid three week IT majors with a background in ASP.NET or some shit...

      Used to be comp.sci was about comp.sci not staying upto date with the latest code monkey script language.

      There is still a reason why the majority of *real* work is coded in C. Its a simple language that gets things done.

      The dot.com busta VB script kiddies [e.g. three week IT grads] come and go. True comp.sci'ers stick along better.

      Tom

      --
      Someday, I'll have a real sig.
    3. Re:Its a shame by pmz · · Score: 2, Insightful

      Its a shame because software is one of the only things that could and should be theoretically perfect

      And theoretically prohibitively expensive.

      I have yet to meet someone who is geniunely willing to pay for software quality. They simply don't care or understand. Once the software reaches some minimum threshold of "working", the project gets cut off or put on some other tangent.

  6. manned mars mission by lingqi · · Score: 4, Funny
    Of 34 Mars missions since the start of the space age, 20 have failed.

    I really hope this explains why there isn't a manned mission. =)

    --

    My life in the land of the rising sun.

    1. Re:manned mars mission by jellomizer · · Score: 3, Interesting

      Perhaps it explains why there should be a manned mission. The main problem with exploring the unknown is that there are a lot of unknown variables out their and computer technology is not always adaptable for all unknown variables. This is why there is software failure and lost contact. Manned missions give some extra control of the mission and gives the ability to improvise new solutions for unknown problems. Like Fixing a part that is broken by using an other material that is available. Or realigning so it will maintain contact. The big problem with mars is that it takes 20 minutes to send a signal for it do do something different remotely. A human who is well trained will be able to make these decisions and control the new instructions in far less time (within seconds). If it wasn't so expensive to do a Manned mission to mars. I am sure manned missions would have a much higher success rate.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    2. Re:manned mars mission by Waffle+Iron · · Score: 2, Funny
      I doubt lack of gravity would have that sort of effect.

      Cells are held together by the hydrophobicity of their phospholipid bilayers. This effect is not decreased by lack of gravity.

      You've told me zero-G isn't the problem . Now ... I want you to tell me: What ... is ... killing ... my ... men!!??

      You've got to the bottom of this .... before we all end up like Johnson. I'll be in my quarters.

  7. Men are from Mars.. by jkrise · · Score: 3, Funny

    That explains why it's so hard? :-)

    --
    If you keep throwing chairs, one day you'll break windows....
  8. I disagree, Mr. Editor by rosewood · · Score: 3, Insightful

    I am with NASA on this one (almost always a good idea to stick with NASA). From when I remember of fubar'd mars missions, its been screw ups by the programers.

    Just as in the NFL when a receiver drops an easy pass and someone yells that he gets paid to catch passes like that, programers get PAID not to fuck things up.

    1. Re:I disagree, Mr. Editor by Lord_Slepnir · · Score: 4, Funny

      When I can get paid $4 million a year just to show up to work every day for 4 hours, 6 months a year, get paid another $5 million just to say that I use XXX brand compilor (or reclining chair), get paid by a university to attend there just because they need a new star Perl Debugger (the last one graduated last year, and the backup got carpal tunnel), then I'll stop messing things up like that.

    2. Re:I disagree, Mr. Editor by Hal-9001 · · Score: 4, Insightful

      Software errors didn't just cause problems with the Mars landers--they caused a total loss of the spacecraft. We are just lucky that we made those errors before attempting a manned mission to Mars.

      Regarding the losses of the two space shuttles, it is hardly fair to compare hardware failure to software failure. The physical behavior of a mechanical system is not deterministic--stress something hard enough and it will break, and it is impossible to predict when a particular part will fail in advance. You can do lots of testing to get a sense of when, on average, a part will fail under certain conditions, and you can design and engineer as best as possible for something to work even if a part fails, but parts will fail and sometimes hardware failures are irrecoverable.

      Software, on the other hand, is completely deterministic. With error-checking and proper testing, it is possible, at least in principle, to write software that will not fail. Software failure that results in loss of life is simply inexcusable.

      --
      "It take 9 months to bear a child, no matter how many women you assign to the job."
    3. Re:I disagree, Mr. Editor by EvilTwinSkippy · · Score: 2, Insightful
      Software, on the other hand, is completely deterministic. With error-checking and proper testing, it is possible, at least in principle, to write software that will not fail. Software failure that results in loss of life is simply inexcusable.

      Software is NEVER deterministic in an operating environment. Just because you can put it on a bench and test the snot out of it does not certify it's behavior in the real world. I have written many programs that work perfectly in testing, only to have a user punch in an unexpected value and bring things to a crashing halt.

      Oh no, all design documents dissolve on contact with the real world. The best software is the type that realizes it is operating in an imperfect world, and takes pains to vet its data before processing, or die in a manner that is the least catastrophic to life and property.

      --
      "Learning is not compulsory... neither is survival."
      --Dr.W.Edwards Deming
    4. Re:I disagree, Mr. Editor by AKnightCowboy · · Score: 4, Insightful
      Software is NEVER deterministic in an operating environment. Just because you can put it on a bench and test the snot out of it does not certify it's behavior in the real world. I have written many programs that work perfectly in testing, only to have a user punch in an unexpected value and bring things to a crashing halt.

      That's just bunk. As a programmer writing software for spacecraft you must be able to anticipate every possible value and account for it. Every condition should be able to be gracefully handled by an error checking routine. There is zero room for failure. If that means it takes 20 years to write, test, rewrite, and retest the perfect program, then so be it. When human life is involved price is not an object. (well, within reason of course since there's a dollar value on human life in the space program, but the negative publicity value is astronomically more than the dollar value of the loss of human life.)

    5. Re:I disagree, Mr. Editor by calethix · · Score: 2

      "As a programmer writing software for spacecraft you must be able to anticipate every possible value and account for it."

      I think there's something wrong with that statement in regards to anything that's going to be exploring the unknown.

    6. Re:I disagree, Mr. Editor by Tablizer · · Score: 3, Funny

      I think there's something wrong with that statement in regards to anything that's going to be exploring the unknown.

      Their Mission Statement: "To boldly go where no man has gone before, and anticipate absolutely everything."

  9. Wrong Motivation by emo+boy · · Score: 4, Funny

    The motivation for achieving Mars is much less than the moon. The reason for this is because there was extreme speculation that the Moon was made of green cheese. Mars is already assumed to have red dust on it. For a society that gorges itself on Big Macs and Cheese Fries this is hardly a worthwhile goal. And as a programmer myself I understand the need to work on projects that will benefit the community as a whole, not on one that will invade a dirt planet.

  10. The software motto... by Xentax · · Score: 4, Insightful

    ...is "garbage in, garbage out" right? One of the mottos anyway.

    If you underestimate the resources you need to do software right, of course you'll have problems -- either getting it done on time, or getting the quality to the level it needs to be (or both).

    That problem is hardly unique to the space programs. And of course, it would be a little tricky trying to upload a software patch to a hunk of solar-powered metal a few million miles away.

    I wonder how much NASA et al. really tap the resources they should be tapping -- I mean, there ARE areas of industry where mission-critical or life-critical software has been developed and deployed for some time now. Maybe it's just a question of getting the right kind of experience in-house...

    Xentax

    --
    You shouldn't verb words.
    1. Re:The software motto... by rigorist · · Score: 2, Funny

      As my father always said, "Garbage in, gospel out."

    2. Re:The software motto... by marauder404 · · Score: 4, Interesting

      NASA software engineering is actually quite remarkable -- at least for the shuttle program. I read a paper once about how they actually break many of the paradigms of writing code that so many programmers are accustomed to so that the code is absolutely perfect. Deadlines are met well ahead of schedule and nobody works late. They're not allowed to work late, because the pressure or fatigue could cause an error to occur. The code is personally signed-off by the chief software engineer that it won't hurt anyone. Every line of code is fully documented. The code is virtually written twice by two separate teams. This article actually details some of it great length: They Write the Right Stuff. I don't disagree with you that maybe the way they write software needs to be reviewed, but it seems that they already go a long way to ensure that happens.

  11. Software not the problem... by Malc · · Score: 2, Insightful

    ... on the last two trips to Mars that failed. Communication and incompetence on Earth were the problem. Exactly how do scientists screw up and get the unit system wrong?

    1. Re:Software not the problem... by Malc · · Score: 2, Interesting

      What, the programming teams worked in a vacuum to each other? You're telling me that the products of their efforts didn't communicate with each other? The programmers should have noticed and/or documented properly. Personally, if I were a programmer on this project, I would have been VERY surprised if we weren't using ISO units, and I would have questioned it strongly. Anybody who's taken any physics courses knows that even in the US, people use ISO units. It was not a software problem - the software obviously did what it was told to do.

      GIGO.

  12. An opportunity here... by theophilus00 · · Score: 5, Funny

    âoeThe limiting factor in Mars sample return is mass,â he said. âoeDirect return [of samples] from Mars right now exceeds the cost envelope and performance envelope of the available launch vehicles and upper stages.â

    The first samples returned should have mystical properties ascribed to them and then sold on EBay. This should generate enough revenue to substantially increase the size of the "cost envelope"...

    cheers

    (I got engaged last night) =)

  13. Small Simple... Solid State by bigattichouse · · Score: 5, Interesting

    Make it simple. The original software used (like in the moonshots) was Very simple control loops... no OS, no overhead.. just a simple program doing a VERY simple job over and over. Read stick, fire retros as appropriate.
    Also, solid state, however big and bulky, isn't susceptible to the radiation that many mega-tiny chips are... by writing (and testing) the software in the simplest manner, and building a VERY specific piece of hardware out of solid state components.. and lots of unit testing... you're more likely to get there.
    For the same reason the 486 was the only space-rated intel processor for quite a long time (not sure if thats still true).

    I'd rather go on "slower" simpler hardware that does a very specific job... and you can repair with a soldering iron.

    --
    meh
    1. Re:Small Simple... Solid State by Anonymous Coward · · Score: 2, Funny

      as simple as

      10 REM my Martian exploration program
      20 GOTO MARS

    2. Re:Small Simple... Solid State by vondo · · Score: 2, Interesting
      Also, solid state, however big and bulky, isn't susceptible to the radiation that many mega-tiny chips are...

      Actually, the current microchips are inherently rad-hard (radiation resistance). This wasn't the case in the past. It's something about the size of the features being small and also shallow, so that not much charge is deposited as a charged particle passes through. 0.25 and 0.18 microns are apparently especially good. However, as feature size continues to go down, things will get worse again.

      You might find this link interesting too.

    3. Re:Small Simple... Solid State by mykepredko · · Score: 4, Informative

      The technology used in the Apollo Guidance Computers (GCs) were more a function of what their manufacturer (IBM) was comfortable with than what was available at the time. The GC's used IBM "Solid Logic Technology" (SLT) which was primarily a Resistor-Transistor Logic (RTL) technology in which discrete resistors and transistors were bonded to ceramic carriers which were then soldered to PCBs using traditional pin through hole manufacturing techniques. At the time, this was IBM's primary method of manufacturing computers (they did not start using integrated circuits in their computers until the early 1970s). IBM never gave up on SLT until the late 1980s.

      The GCs read only memory consisted of a series of peg-boards into which the code was wire wrapped (by hand). There were 74,000, 16-bit instructions that could be programmed in this way. There was 4k iron-core memory in the computer. There were two GCs used in Apollo. The CSM one was responsible for leaving earth orbit, mid-course correction(s), entering lunar orbit, etc. The LM GC controlled descent and ascent as well as autopilot functions for lunar orbit docking. The computers ran the programs for these manuevers from ROM, but using astronaut input parameters using the "noun-verb" input methodology.

      The software was actually very sophisticated and did not consist of simple control loops - joystick feedback was actually processed to ensure commands kept the spacecraft within limits. The most important parameter was keeping the antennae pointed at the Earth.

      AFAIK, there are no space-qualified Intel built '486s. There are space-qualified computer systems with '486s in them, which may seem like semantics, but these systems typically employed multiple '486s, with bus operations and data continually compared to look for differences indicating upsets. This is a point that always confuses people because at one point IBM/NASA indicated the AP101 Block IIs had the same amount of power as a '486 - this seems to be misinterpreted as the AP101s have '486s built into them.

      Half a lifetime ago, I helped with some hardware failure analysis for the IBM Orbiter Computer Systems Group (It was an intermittently failing memory board on STS-4) and I have to say that they were the most impressive software group that I have ever been associated with. They learned their skills with the Apollo CSM/LM GCs and Apollo Instrumentation Ring - you just don't make mistakes when the instructions are wire wrapped. The software engineers that worked on the shuttle software didn't have a problem with going with the (relatively) complex AP101s (originally designed for the B-1). Going from wire wrapped ROM to battery backed RAM was seen as a good thing, but it did not mean that the software development process changed in any way.

      I'm trying to remember if there were two or three support binders for each module of software in which the requirements were clearly defined, the science and reference information provided, all calculations/constants defined to support the software binder. Coding is always the last thing that is done and only if the support binders are complete and signed off. This process is very expensive, but the software produced is essentially perfect (I believe that there has been one non-safety of flight software error in shuttle history and several hundred thousand lines of code). Complexity isn't the issue.

      I think the issue is, is there a software development methodology/process that fits in with NASA's "smaller, better, cheaper" and produces the same quality as the Shuttle/Apollo?

      myke

  14. Budget and motivation by Anonymous Coward · · Score: 3, Insightful

    What we need is a bit of competition between nations. Let's face it, without Kennedy wanting to 'beat the Russians' to the moon, there would have been no Apollo programme. Nowadays we throw unmanned stuff around and expect it to perform flawlessly with (comparatively) little monetary backing and none of the incentives of older space programmes.

    However just throwing money at the problem isn't going to solve it, I'd suggest throwing away the rulebook and starting over for unmanned systems, better craft, less of the multimillion dollar single units and more cheaper devices that can carry out multiple landings at once.

    For once, it might be worth imagining a Beowolf cluster of those things - because with many cheaper devices, the mission would most likely have a modicum of success.

  15. Methodolgies by barcodez · · Score: 2, Insightful

    It's interesting that he blames the problems of software on external pressures such as management hassling of coders but there is no mention of project delivery methodology. I would be interested to know what methods they uses. Are they using continuous intergration techniques, unit testing, agile methodolgies, XP? These things in my experience are crucial to low bug software. Also who are they employing to write their software? Rocket scientists or coders. In my experience domain expertise counts for very little when it comes to writting rock solid code.

    --

    ----
    1. Re:Methodolgies by Jon+Peterson · · Score: 2, Informative

      Hmmm. I think you'll find the methodologies of the commercial world count for nothing when it comes to space-craft. XP indeed......

      http://www.fastcompany.com/online/06/writestuff. ht ml

      That's what they do, and I'm glad I don't.

      And as for domain expertise not counting for much, that may be true for some domains, but sure as hell is not for mine (medical informatics).

      --
      ----- .sig: file not found
    2. Re:Methodolgies by drooling-dog · · Score: 3, Insightful
      In my experience domain expertise counts for very little when it comes to writting rock solid code.

      Or, at least when it comes to writing rock-solid code that reliably does the wrong thing...

  16. Mistakes by Restil · · Score: 4, Interesting

    Of course, the stupid metric conversion problem only accounted for one of the failures, but it's indicitive of a larger problem. There's obviously a shortcoming in quality control and verification if such an obvious mistake could be overlooked. What less obvious problems are we missing all together? Most of the failures occured during the orbital entry phase, during which time they shut off the transmitter, and therefore don't have up to the second data on the reason for the failure. Sure, they likely wouldn't have much of an opportunity to save the mission, but they would have a good chance at figuring out what the problem actually was so it could be fixed the next time around. Instead, we're left to guess. Cost concerns are always mentioned as the reason, but how much have we "saved" really? An extra million $$ to keep the transmitter on would probably have paid for itself a long time ago.

    -Restil

    --
    Play with my webcams and lights here
    1. Re:Mistakes by varjag · · Score: 2, Insightful

      Most of the failures occured during the orbital entry phase, during which time they shut off the transmitter, and therefore don't have up to the second data on the reason for the failure.

      That's why some folks at NASA develop more sophisticated control software that can take of failures. The RAX experiment on DS1 probe successfully demonstrated this approach viable.
      However, at the moment the project suffers major rewrite in C++, notorious for its 'safety', for reasons having very little to do with engineering...

      --
      Lisp is the Tengwar of programming languages.
  17. Sorting out the stages by henrygb · · Score: 2, Insightful
    First, most of the launches go wrong, so they get improved. Second, the spacecraft hardware goes wrong, so that gets redesigned. Third, the software goes wrong, so more work is needed there.

    It looks as if the testing and debugging starts at the begining and works through the mission. I suppose this will eventially work, but it seems to be an expensive way to do it.

  18. almost /.dotted by lethalwp · · Score: 2, Informative

    1st page

    Why is Mars so hard?
    by Jeff Foust
    Monday, June 2, 2003

    This June will see the beginning of the most ambitious exploration of the Red Planet in a quarter-century. If all goes well, three launch vehiclesâ"one Soyuz and two Deltaâ"will lift off this month, placing four spacecraft on trajectories that will bring them to Mars by this December and January. Those spacecraft include the first European Mars orbiter, Mars Express; Beagle 2, the British lander built with a mix of public and private funding; and NASAâ(TM)s twin Mars Exploration Rovers, perhaps the most advanced Mars spacecraft even built. They will be joined at Mars by Nozomi, a Japanese-built Mars mission launched in 1998 and forced to take the long road to Mars because of thruster problems.

    This should be an exciting time for those interested in Mars exploration, and for scientists and activists alike, it is. If these missions are successful, they should offer new insights about what happened to the planetâ(TM)s water and the potential for past or even present life there: some of the most important questions in planetary science and astrobiology today.

    The catch is, if these missions are successful. The history of robotic exploration of Mars, stretching back more than four decades, is littered with failed missions and dashed hopes. Some of these failures can be chalked up to the growing pains of early planetary exploration, when a wide variety of spacecraft of all types failed. Others, particularly the 1999 failures of NASAâ(TM)s Mars Climate Orbiter (MCO) and Mars Polar Lander (MPL), are more indicative of management, programmatic, and other problems, rather than purely technical issues. Understanding these problems, and acting to correct them, are critical if current and future missions are to succeed in studying the Red Planet.
    The star-crossed history of Martian exploration

    Mars has been one of the most popular destinations for missions beyond the Earth. Since 1960 the United States and the former Soviet Union have launched 34 missions to Mars: 15 by the US and 19 by Russia and the former USSR. NASAâ(TM)s success rate is not too bad: nine of those 15 missions, including the Mars Global Surveyor and 2001 Mars Odyssey missions still in progress, can be considered successes. Russiaâ(TM)s luck has not been nearly as good: 14 of its 19 missions failed, and only oneâ"Zond 3â"can be considered a complete success; the remaining four are, at best, partial successes. Overall 20 of the 34 American and Russian Mars missions, or 59 percent, failed.
    Four of the seven NASA Mars missions since Vikingâ"Mars Observer, MCO, MPL, and Deep Space 2â"have failed.

    Digging into those statistics in greater detail shows some interestingâ"and troublingâ"trends. Many of the failed missions, particularly those launched in the 1960s, were lost because of launch vehicle failures, not because of any fault with the spacecraft itself. Many Russian spacecraft, from the earliest âoeMarsnikâ missions of 1960 to Mars 96, either failed to leave a parking orbit around the Earth or never made it into Earth orbit into the first place. However, in the last 30 years only one mission out of 16 attemptedâ"Mars 96â"was lost due to a launch vehicle malfunction. This can be most likely attributed to the maturity of launch vehicle development, including the use today of vehicles whose designs date back literally decades.

    The problem with Mars exploration now appears to be with spacecraft themselves. Four of the seven NASA Mars missions flown since the twin Viking missionsâ"Mars Observer, MCO, MPL, and Deep Space 2â"have failed, all due to spacecraft problems of one manner or another. (MCO is a borderline case, since there was no technical problem with the spacecraft itself, but rather with how ground controllers operated it.) The only other NASA Mars missions to fail, Mariner 3 in 1964 and Mariner 8 in 1971, were each lost due to launch veh

  19. Rocket Science is hard by fname · · Score: 5, Insightful

    Well, there are a lot of reasons thing go wrong. Landing a spacecraft on a different planet is inherently difficult, and when you read about how MER-1 and MER-2 will land, it's amazing that they can work at all.

    The flip side is that. After Mars Ovserver spectatularly failed in 1993 ("Martians"), NASA started to go with faster, cheaper, better. The idea was, instead of a single $1 billion mission every 5 years with with 90% chance of success, why not 2 $200 million missions every two years, with an 80% chance of success. Everyone loves this idea when it works (Pathfinder), but when a cheap spacecraft fails, the public doesn't care if it cost $10 million or $10 billion, all we know is that NASA is wasting money.

    So, the answer is, NASA has hit some bad luck. But the idea of faster, cheaper, better is ultimately a cost-effective one, so if we can solve these software problems (I mean, can't someone independently design a landing simulator?), and NASA can get 80-90%, we'll be getting a lot more science for the dollar. But NASA-haters will always have some missions to point to as a "waste" of money, and try to cut funding as it's mismanaged; other space junkies will insst that anything under 100% is unacceptble, and costs should double to move from 80% to 100%. I don't which attitude is more damaging.

    NASA has a "good" track record since Observer, unfortunately, the highest profile missions have generally failed. If MER-1, and MER-2 are both succesful, and SIRTF flies this summer, then everyone should get off of NASA unmanned program's back for a while.

  20. Tough assignment... by Kjella · · Score: 4, Insightful

    Seriously. Space is tough, as the US has experienced with both Challenger and Columbia, and those should only reach orbit. Going even further away in space is tougher. So much can go wrong, and so little can be done to correct it. Certainly a few blunders like the feet-to-meter bug is huge, but they try. I'm not so sure any private corporation that had been asked to do the same would fare any better. They are pushing limits, where you fail and (hopefully) learn from your mistakes.

    Which is why we should continue to try. Giving up, saying "space travel is just too costly and risky" is a big cop-out. If we could send people to a different stellar object (the moon) in 1969 with the equivalent of a pocket calculator but not now, what does that say of our technology? Or sociology? Sure you could take the narrow-minded approach and say "and what does that bring us? The ability to jump from rock to rock in our solar system?" If so, you might as well ask why people decided to go to the poles (just ice) or whatever. You're still missing the point.

    Kjella

    --
    Live today, because you never know what tomorrow brings
    1. Re:Tough assignment... by HerbalSpiderMonkey · · Score: 2, Insightful

      Some people are going to flame me like hell for this, but space travel was driven by communism. The USSR was first in space, and they drove the US to get to the moon by trying themselves. Only a large planned economy can support space travel unless a nation feels itself vunerable by not doing so (as the US did in the 60's). We are now in an age of self-interest, and nobody is going to cough up the kind of money required just because its a noble endeavor. They want a return, and fast. I can only hope the chinese get to the moon and scare the rest of the world into getting serious about space again.

  21. NASA Management Practices and Quality of Software by ChuckDivine · · Score: 5, Insightful

    In my years at NASA Goddard I saw a dysfunctional management operate in ignorance of reality.

    There was much praise of the employee who "went the extra mile", "put in long hours" and "served the customer" (that applied to contractor employees). There was also very little thought paid to the consequences of those practices.

    What's the first thing to go when you're tired? It's not your body -- it's your mind. That's right -- if you're staying at work until you're feeling tired, you're making mistakes that need to be corrected later. The tireder you are, the more mistakes. The tireder you are, the less you can actually do.

    I witnessed people who wore their exhaustion as a badge of honor. And, when they got into management, insist that others emulate their bad example. The result that I saw was people who should have been kept out of management becoming increasingly dominant. This was accentuated by the "faster, better, cheaper" ideology promulgated by former NASA administrator Goldin. This ideology was used to get rid of more experienced (and thus costly) people who were aware of the consequences of trying to squeeze more work out of fewer people.

    It could take a long time for NASA to recover from this culture. The failure of projects in the past few years, the crash of Columbia could be turning points -- or they could be used by incompetents to justify even more dysfunctional behavior.

    --
    "Beer is proof God loves us and wants us to be happy." -- B. Franklin
  22. Time for a standard RT OS and tools? by Larthallor · · Score: 2, Interesting

    Perhaps one of the reasons that the software isn't getting done on time is that much of the system is written from the ground up. Perhaps it would be better to design a common, open source spacecraft platform. So many of the basic tasks that spacecraft software must perform are essentially identical. The main differences for critical spacecraft systems would be the hardware. If a general purpose OS and spacecraft toolkit were designed, then the main things that would have to written from scratch for different missions would be drivers for the hardware and various configuration settings.

    I'm not sure how suitable RT Linux would be from a technical/performance standpoint, but having a highly portable open source OS would give a flexibility and availablility that would make adoption much easier.

  23. Chess is also a Formal System by Gerry+Gleason · · Score: 2, Interesting
    And it is finite as well, but I don't see anyone with a closed form solution to that either. Even with a very small, searchable code space for possible programs, it is not possible to completely characterize the program's behavior.

    Theoretically, all programs have latent bugs, unless they are too simple to do much.

  24. I'm not surprised. by dnnrly · · Score: 5, Interesting

    I've seen the code for some MAJOR blue chip companies and I really do wonder how these people stay in business with the rubbish that they put out. For example some of code drops from our clients don't even compile! The reason for all the crap is that it's very easy to cut corners without it being very obvious immediately. Typically, the first thing that gets stopped when things ar getting tight (either time or money) is documentation, quickly followed by testing. Next it's individual features, removed from the requirements 1 by 1.

    Since software engineering is still a 'black art' as far as most traditional engineers and project managers are concerned, there isn't the real intuition/understanding of when things are starting to look bad. Without looking at code AND knowing something about it, you won't stand a chance 'intuiting' whether or not things are going well.

    Writing software is an expensive business in both time and money. It's also a very young business without the same 'discipline of implementation' as other areas. Until the process matures and people realise that doing it on the cheap gives you cheap software, things aren't going to change and Mars probes are going to continue to produce craters.

  25. Programmers by Cujo · · Score: 4, Insightful

    Yes, programmers have erred. To err is human, to allow errors to propagate into mission failures is a failure of systems engineering, and I think that is where the real blame lies. A lot of the problem is thatspacecraft systems engineers often have a very amateurish grasp of software, if any at all.

    For example, on Mars Climate orbiter, a junior programmer failed to properly understand the requirements. However, systems failed to:

    1. Properly identify the thruster force data as a critical interface.
    2. Failed to demand proper, thorough and timely verification ON BOTH SIDES OF THE INTERFACE.
    3. Failed to make sure the requirements were properly understood by the implementers.
    4. Ignored or missed prima-facie evidence that the interface wasn't working (closely related to 1).
    --

    Helium balloons want to be free.

  26. It's really quite simple by foxtrot · · Score: 5, Insightful

    Space Exploration isn't easy.

    Look at the Space Shuttle. The space shuttle has never had a catastrophic computer failure-- but every line of code on that truck has survived review by a group of programmers. They've examined it, line by line, multiple times, in order to ensure that it's exactly right, because the cost of failure is 7 astronauts and a multimillion dollar orbiter.

    The new Mars programs, however, are part of the streamlined "do it on the cheap" NASA. NASA put the Mars Rover down using mostly off-the-shelf and open-source software and a small amount of home-brew stuff. No matter how good open source software gets, it still hasn't undergone the level of review that the Space Shuttle code has seen. No matter how popular an off-the-shelf package is, it's not cost-effective for the manufacturer to give it that sort of treatment. NASA can't afford to do that level of code review because that costs them the ability to do some other program.

    NASA is simply trying to do more with less in the unmanned launches, and the cost of that is we need to expect some failures. These failures are unfortunately very visible...

    -JDF

    1. Re:It's really quite simple by cheekyboy · · Score: 2, Insightful

      It reallity its a balance of prohabilities.

      You could do 1 500 million dollar mission or 30 $20m missions

      --
      Liberty freedom are no1, not dicks in suits.
  27. I don't get what's so hard ... by SuperDuG · · Score: 4, Funny
    Place sensitive computerized equipment on top of massive explosive materials. Ignite materials causing massive controlled explosion forcing upward and mixed with the pull of gravity causing somewhere in the ballpark of 9 G's of force pulling down every part of the sensitive computerized equipment. Then when all is said in done with the explosion, have another explosion in a vacuum of the coldest and most uninhabitable spot in the entire universe.

    Then after 3 months you are then shot into a planet and stopped by a parachute and then some air bags. The entire time literally thrown into the surface.

    And all this with the safety and security, of the lowest bidder.

    I dunno, you tell ME why these missions have a high failure rate. Could it be there is no humans on board therefore not as much care is taken to insure the safe delievery of these machines? Could it be the fact that they are designed not to go to mars, but to go to mars as cheaply as possible. Could it be that no one really has a whole lot of information so a lot about mars is (pun intended) hit or miss?

    --
    Ignore the "p2p is theft" trolls, they're just uninformed
  28. Software - The only thing right on the Shuttle by EvilTwinSkippy · · Score: 4, Interesting
    Funny. Of all of the things that went wrong mechanically with the shuttle, from enginees that had to be tweaked beyond what a Rice-Boy would consider safe, to a protective houseing made of glass, to strapping 2 solid fuel boosters just to jet the sucker off the ground, the software on the Space Shuttle worked well, and worked the first time.

    Part of it was the fact they had absolute geniouses working on the problem. Think of it, they designed a system in the late 1970's, tested it on the ground, and had it successfully fly for 20 years without a major "oopsie". Or rather, if a major "Oopsie" happened, they had ways around, over, or through it. They spent YEARS developing the flight software for the Shuttle.

    Software CAN be done right. It just has to be a priority.

    --
    "Learning is not compulsory... neither is survival."
    --Dr.W.Edwards Deming
    1. Re:Software - The only thing right on the Shuttle by EvilTwinSkippy · · Score: 2, Interesting
      The Apollo 1 accident was caused by bad wiring and a pure Oxygen atmosphere. It had nothing to do with the computers.

      And when I point out an aerospace system that does work, showing me a zillion ones that don't doesn't invalidate my point. The difference between the systems that work and the system that fail is crafstmanship.

      --
      "Learning is not compulsory... neither is survival."
      --Dr.W.Edwards Deming
  29. Disagreeing with Hemos by AntiFreeze · · Score: 4, Insightful
    Quoth Hemos: Or maybe it has to do with being an incredible distance, on an inhumane climate. Either or.

    I have to really disagree with this. NASA is used to dealing with alien climates and terrain and astronomical distances. NASA is also used to dealing with problems. They have some of the best problem solvers out there, and when something goes wrong, then tend to pinpoint why. When NASA says A, B, and C are the causes of failure, I believe them. When NASA cannot figure out why something went wrong, I worry.

    What I'm trying to say is, distance and inhuman conditions shouldn't have that much of an affect on how well a probe works. We built Voyagers I and II, didn't we? They worked even better than expected. And they encountered climates and conditions which make Mars look easy.

    NASA has dealt with so many varying circumstances and climates over the years, and been so blunt about their mistakes, I find it hard to believe that they would blame the failures of an entire class of missions on something "easy." And yes, blaiming failures on software is an easy way out, how many times have you heard someone say "Oh! It must be the software!" when something doesn't go as expected?

    Now, I know this guy doesn't speak for NASA as a whole, but as a NASA trained administrator, and the head of some very large projects, I'm willing to take his opinions at face value. If he says it looks like software has really been a cause of failure, who am I to laugh at his expertise and belittle his explanations? I might not like his explanation, but I buy it.

    --

    ---
    "Of course, that's just my opinion. I could be wrong." --Dennis Miller

  30. Interesting... by Idarubicin · · Score: 4, Funny
    Did anybody else notice today's witty quotation at the bottom of the page? Does this answer the question?

    Never test for an error condition you don't know how to handle. -- Steinbach

    --
    ~Idarubicin
  31. Software is Hard by Teckla · · Score: 4, Insightful

    Most PHB's haven't figured it out yet: SOFTWARE IS HARD. It's amazingly complicated. It's also notoriously hard to come up with realistic estimates.

    PHB's also haven't figured out that developers aren't interchangeable widgets. If you know C, it doesn't mean you'll be immediately productive in Korn shell scripting, and vice-versa.

    PHB's also haven't figured out that experience is key. There are exceptions, but generally speaking, a young hotshot isn't going to be as productive as an experienced professional. Sure, the young hotshot might get v1.0 done first, but it'll be buggy, unreliable, unscalable, hard to maintain, etc.

    The "problem with software" is almost entirely a management issue, imho.

    -Teckla

    1. Re:Software is Hard by CyberGarp · · Score: 3, Insightful

      PHB's also haven't figured out that developers aren't interchangeable widgets. If you know C, it doesn't mean you'll be immediately productive in Korn shell scripting, and vice-versa.

      I think this statement is true, but only because of the failure of education (or lack thereof). A good software analyst, is trained to think about the concepts, not the language. When I was a senior, we had a class where every project was a new language. One of the professor's summed it up, "Any monkey can learn a programming language by reading a book. An analyst will know what he's doing, no matter the language." It's all too sad that most employers hire based on language experience, and not successful software engineering practices.

      The "problem with software" is almost entirely a management issue, imho.

      For many reasons, but proper software engineering is understood but not popular. The results of a Cleanroom Engineering project have been well documented. Why isn't it popular? It doesn't have a fun sounding name and it's tedious to do correctly.

      --

      I used to wonder what was so holy about a silent night, now I have a child.
    2. Re:Software is Hard by Troed · · Score: 2, Insightful

      True. Once you know how to _engineer_ software the methods and languages will be irrelevant.

      Too bad the OSI doesn't believe in it.

  32. Management Failure by Gerry+Gleason · · Score: 2, Insightful
    In my view, when things go wrong with a big expensive science project, it is misleading at best to blame the programmer or engineer who may have made a mistake, etc. As you point out, programmers vary as to ability, but it is the system of engineering checks and balances that ensures the quality of the entire project. If a junior programmer introduces a bug that eventually becomes a catastrophic failure of the project, then perhaps the task was too difficult, but any programmer will make some mistakes so the bottom line is QA processes (code reviews, good testing, realistic schedules, etc.) must be good enough for the situation.

    We haven't seen software failures taking out manned missions, two shuttles failed from the high stresses of takeoff and re-entry. Just a guess, but the engineering standards are probably much higher for the manned programs, and more people review the code. Also, keep in mind that NASA has been experimenting with the idea of saving money with faster paced development which means some reduction in review and other QA standards, particularly on unmanned planetary missions. It may even be that this method is cost effective in spite of some high profile failures.

  33. It's like, sarcasm, or something, by Thud457 · · Score: 2, Funny
    "He says that since the mid-70s "software hasnâ(TM)t gone anywhere. "

    But it's gotten much prettier!

    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

  34. Certainly bad by comparison with Venus by MartyC · · Score: 3, Interesting

    According to this page only 3 of 26 missions to Venus have been total failures. When you consider that Venus is a much more hostile environment than Mars then you have to conclude that either Mars is just plain unlucky or mission planners are getting something wrong.

    --
    -- "Sponges grow in the ocean. I wonder how much deeper the ocean would be if that didn't happen."
    1. Re:Certainly bad by comparison with Venus by dinog · · Score: 2, Interesting
      Venus has a much thicker atmosphere, and this makes things easier. Many of the Mars craft have used aerobraking, and there just isn't much room for error when the atmosphere can't be measured in whole number milibars. Another failed attempt dealt with landing, which is also more difficult in a thin atmosphere because parachutes are far less effective. This is why some of the probes resorted to airbags. No one would even think about that on venus. An ugly option, but not much uglier than the alternatives.

      On the other hand, once the probes get to Mars, they last much longer than the ones sent to Venus. That is where the hostile environment on Venus becomes and issue.

      Dean G.

  35. Re:The ancient n-body system... by reddish · · Score: 3, Interesting
    They claim that "there was this crack" or "we confused metrics" but at the very core of the problem they didn't understood the problem and the tools to solve it.

    However much you may disagree, simple Newtonian dynamics and is all it takes to get a space probe from A to B in the vast majority of cases. It's a well-understood problem domain.

    Dragging in stuff like chaotic long-term behavior of n-body systems, while an interesting fact in itself and worthy of study, has very little to do with the engineering problem at hand. Ephemerides for all major bodies in the solar system for the coming hundreds of years are known up to uncanny accuracies (metres) and plotting the trajectory of a probe is simply a matter of numerical integration, to put it bluntly.

    Now when someone mixes up metres and feet things go awry. But don't claim stuff like this could have been prevented by hiring more mathematicians. It's simply a case of human error, something that happens in the Real World.

    Having a high IQ, my friend, is no excuse for making stupid claims about things you don't know anything about.

  36. Software by hackus · · Score: 3, Insightful

    I think the primary problem is that the technology to build and design probes changes too quickly, and affects design.

    I always thought that there should be a way, to build a probes navigation and propulsion systems in a standardized whay so that avionics software wouldn't need to change that much.

    Sort of a standardized platform if you will for doing solar system exploration.

    This platform would consist of a number of parts that would not change, and could be reusable in a number of different configurations for building a probe, depending on what its job was.

    Cameras, photometers, spectrometers, and power sources could all be packaged in the same why depending on the probes job.

    Every probe that nasa launches is always customized and built around cost and included packages.

    I am not so sure that is the best way to go about it as you have to reinvent all the software to manage the probe every time you build one.

    Probes should be cheap, produced in high volume, (thousands) and interchangeable.

    With a standardized approach, failure rates should come down a bit and costs should be reduced.

    -Hack

    --
    Got Geometrodynamics? Awe, too hard to figure out? Too bad.
  37. My space failure by TheSync · · Score: 2, Interesting

    Heh, I was a part of a space failure myself. We were using pretty much off-the-shelf equipment, but it passed NASA spec shake and thermal testing. What probably did it in was radiation...in low earth orbit we figured there wouldn't be much risk of radiation problems.

    If we were to do it again, we probably would have had some kind of radiation-resistant reset system, because building the whole thing in rad-hard would be very expensive (our budget was $1500 plus donated equipment!) But having a few rad-hard devices to reset the box in case of a crash would probably have been affordable.

    About 100 amateur radio operators contacted our payload, and relayed their GPS coordinates to others using amateur packet radio. At the same time, the GPS unit on board the Spartan satellite transmitted its position to listeners on the ground as well. But had it not crashed after about 17 hours, it is possible that several hundred other amateur radio operators would have used it.

  38. You think Mars is tough? by Noehre · · Score: 4, Funny

    Venus, like the woman she is, is a real bitch and a half.

    Thick sulfuric acid atmosphere?

    Gigantic storms?

    Temperatures that will melt aluminium?

    Ahh, I need to stop. I'm getting flashbacks of my ex-gf.

  39. My dad was on the Viking project... by 192939495969798999 · · Score: 3, Insightful

    and the Viking landed. Dad points out that the budget for the Viking was in the neighborhood of 1 billion dollars, and that was when a Mustang Mach 1 cost just over 4 grand. The space program doesn't have the money now to do the missions the right way, which is unfortunate... the developments of NASA when they had tons of money were numerous and wonderful (i.e. Tang!)

    --
    stuff |
  40. Things to consider... by stinky+wizzleteats · · Score: 2, Informative

    Before we continue to crucify programmers, we need to remember how hard it is to really get to Mars, from a purely spacefaring perspective.

    From my experiences flying to Mars in Orbiter space flight simulator (FREE!), several problems become apparent:

    Mars is a fantastically difficult target to reach for two main reasons. It has very little gravity, and very little atmosphere.

    If you shoot for something big, like Jupiter, you find that it is hard not to miss it. It's gravity well is so massive that navigational errors en route are relatively insignificant. Mars doesn't help you very much in this regard. An Earth to Mars flight has to be dead on.

    When you get there, you are likely going to want to use the atmosphere to do at least part of the braking maneuver to get into Mars orbit (as most modern probes do). The problem is that Mars has a very thin atmosphere. Think about the sheet of paper analogies with Earth re-entry. Earth's atmosphere goes MUCH farther into space than does Mars'. You have to get dangerously close to the surface (within 50 miles) to effectively aerobrake using Mars' atmosphere. So with Mars, you are more talking about a near-ephemeral gossamer thin 1 cell thick membrane you have to hit the edge of rather than a nice, thick piece of paper.

  41. Big difference between the shuttle... by sean.peters · · Score: 2, Insightful

    ... and the Mars vehicles. The Shuttle carries people. You can afford to cut corners a little if no one's going to get killed.

    Sean

  42. Failure by DrinkDr.Pepper · · Score: 2, Insightful

    We like to prey on these simple glitches only because it is poetic to do so. Saying the MPL failed because a programmer failed to initialize a variable sounds much more interesting and is much easier for a reporter to remember than saying MPL failed because a programmer failed to initialize a variable, which determined how close to the planet the retro-rockets would turn off, and that this was observed in the testing laboratory, but the test data was not annalyzed until after the crash.

    --
    0xfeedface
  43. Problem is the statistics are biased by mikerich · · Score: 4, Informative
    Most notably with the Soviet Union's dreadful record of getting spacecraft to Mars. A good number of the craft listed as failures actually never got away from Earth.

    Take their early record, before Mars 1 got to Mars, they had had a series of attempts. Two, known to the West as Mars1960 A and B reached Earth orbit then disintegrated.

    Mars1962 A exploded in orbit at the height of the Cuban Missile Crisis - briefly causing a panic with the Americans thinking a missile attack was underway. Fortunately the computers soon told them that doomsday had been averted.

    Next, was a partial success - Mars 1. Which smashed the record for deep-space communications with Earth across a distance of 106 million kilometres. Unfortunately it failed just before reaching Mars.

    Mars1962 B exploded in Earth orbit and didn't appear in the Soviet record.

    November 1964 saw the launch of Zond 2, a highly advanced probe using ion thrusters to perform stabilisation and orientation tasks. It may have also been the first probe to carry a lander. It died a long and lingering death before sweeping past Mars at only 1400 km altitude. (By this time the US had got their first Mars probe to the planet in working order, Mariner 4 took 22 pictures of the planet from 10 000 km. (Its sister ship, Mariner 3 had failed en-route)).

    Neither side went to Mars in the next launch window, but 1969 was a busy year. Three attempts for the Soviet Union, including at least one lander. Mars 1969A exploded in flight as did Mars 1969B. Mars 1969C was removed from the pad after cracks developed in the relatively new Proton rocket design. (Cracking in the Proton was also a major reason for the failure of the Soviet Union to send a manned mission around the Moon during 1969). The US had a twin success with Mariners 5 and 6 flying past Mars.

    On to 1971 and a pair of launches for the US, Mariner 8 ended up in the Atlantic, Mariner 9 went on to become one of the most successful missions ever and the first probe to orbit Mars. For the Soviets - mixed results again. Their first mission reached Earth orbit, but went no further and was named Kosmos 419. But then both Mars 2 and 3 left Earth orbit. They each comprised of a lander and an orbiter. The two craft jettisoned the lander before entering Martian orbit - just as the planet entered an intense dust storm with raging winds and almost total blackout.

    Mars 2's lander was apparently DOA, it remained silent and does not appear to have returned any data. It was however the first craft to hit (not land on) Mars. Mars 3's lander was more successful. It entered the atmosphere, deployed parachutes and landed on rockets. It deployed its antenna and began to transmit the first picture from the Martian surface. Sadly, just 20 seconds later the transmission stopped. The Soviets said that the lander's parachutes had been caught by the storm and pulled it over.

    Mars 2 and Mars 3 orbiters remained on-line and performed experiments on the Martian atmosphere and took photos of the surface. So I would call both missions a partial success and Mars 3 almost a triumph.

    The next window was 1973 and the Soviets planned no less than 4 missions to Mars. Mars 4 and Mars 5 would be orbital missions, studying the planet much like Mariner 9, but also serving as telecoms relays for the Mars 6 and Mars 7 heavy landers.

    Incredibly, bearing in mind the past track record of the Soviets, all four missions reached Mars in working order. Then everything went wrong. Mars 4's main engine failed and the probe did not enter orbit, it relayed images of the planet as it swept past into solar orbit. Mars 5 was next and was the only unqualified success of the year; it was the first craft to return colour images of Mars.

    The two landers then arrived, Mars 7 first, it deployed the lander, but an attitude problem meant that the lander actually missed the planet entirely! Mars 6 was more lucky, the probe entered the Martian atmosphere, took readings all the way down and went dead ab

  44. Well-placed typo by TFloore · · Score: 2, Funny
    I don't usually comment on typos, mostly because I make so many myself. (Pot, kettle, etc.)

    But in the article:
    âoeFaliures are simply due to human error, which is avoidable,â said Spear.

    That was just too perfect.
    --
    This is my sig. There are many like it but this one is... Oops. Frank, I've got your sig again! Where's mine?
  45. Many Moon Missions Failed Too by EccentricAnomaly · · Score: 4, Interesting

    Just look at the rate of failure for early moon missions

    It's a hard probelm to send a probe to the Moon or Mars. landing and aerocapture at Mars are dicy things.

    --
    There are 10 types of people in this world, those who can count in binary and those who can't.
  46. There's been a paradigm shift by confused+one · · Score: 4, Interesting
    We've all heard of the "faster, better, cheaper" game NASA's been playing lately.

    Here's the problem as I see it: As software and hardware have become more complicated, there's a need to increase testing. Instead, in order to meet NASA's new budgetary requirements, funding in general, and specifically for testing, has gone down. So, it's not possible to completely test all of the hardware AND software, as it should be.

    As an analogy: If we were talking about commercial airliners; these probes would never be certified to fly.

    I'm not putting all the blame on NASA here; although, it is apparent to me that they need to start reporting what it's actually going to cost. Having said that, Congress is equally complicit; they need to come to the realization that it's expensive to do work outside the atmosphere (they apparently don't understand this...)

  47. Faster, better, cheaper - choose any two by extremecenter · · Score: 2, Insightful
    "Faster, better, cheaper" was former NASA Administrator Goldin's favorite line. It worked well with Congress. Trouble is, he forgot the second half - you can't get all three. For years NASA was under a pressure to do things faster and cheaper, so "better" became a casualty. A couple of years ago I was at a NASA conference where a speaker started a sentence with "Former Administrator Goldin - I've waited so long to say that ...", whereupon the audience erupted in cheers and applause.

    Software can be done right. Anyone who doesn't believe this either (a) does not know how many millions of lines of software are involved in avionics and air traffic control, (b) never flies on an airplane, or (c) has a death wish. Of course I guess there's also a fourth possibility - when all else fails, blame the software. The space shuttle's record proves that software can be dependable, but also illustrates that making it that way is very, very expensive. Just a matter of priorities.

  48. Orbital Mechanics a contributing factor by Phil+Karn · · Score: 2, Insightful

    I think one of the factors contributing to the poor Mars success rate is orbital mechanics. The launch window to Mars opens for only a month or so every two years. This is the longest interval between window openings for launches from Earth to any other planet; windows to the other planets open at roughly yearly intervals or less. Since missing the launch window means waiting another two years, this undoubtedly creates enormous schedule pressures on any team preparing a spacecraft for launch to Mars.

  49. Re:It's physics, dudes. by Phil+Karn · · Score: 2, Interesting
    So how do you explain the significantly higher success rates to planets other than Mars, e.g., Venus and Jupiter? They share the same problems of long delay times and the need for autonomous control.

    Your comment about manned vs unmanned makes absolutely no sense. One could buy a hundred or a thousand unmanned planetary missions for what a single manned mission would cost, and there would still be no guarantee that the manned mission would succeed. Yet we could easily afford to have many of those unmanned missions fail.

    I say that the manned space program is one of the major contributing factors to the poor Mars success rate. More specifically, the enormous sums of money that the Shuttle and ISS have siphoned from the far more productive unmanned planetary program and flushed down the drain.

  50. A more detailed comparison by barakn · · Score: 2, Informative

    Unfortunately, that page is incomplete and misleading, as it only mentions the probes that actually got near Venus. For example, the page lists Mariner 2, but not Mariner 1. Mariner 1 went off course due to a sofware error resulting from a missing hyphen. Venera 1, though in the list, suffered a communications failure and was a complete failure. Also failing was Sputnik 7, whose 4th stage didn't ignite. Sputnik 23 and 24 never made it from Earth orbit. Sputnik 25's 3rd stage blew up the entire craft. Cosmos 21 failed to leave Earth orbit. Venera 1964A and Venera 1964B failed to achieve Earth orbit. Venera 1964C did, but couldn't leave orbit (renamed Cosmos 27. Soviets apparently named things in Earth orbit as 'Cosmos', even if they were failed missions to somewhere else). Zond 1 is on the list as being succesful, but contact was lost with it 2 months before it got to Venus. Also failing: Cosmos 96, Venera 1965A, Cosmos 167, Cosmos 359, Cosmos 482. Obviously there have been far more failed missions to Venus than your list implies.

    --
    "I'm so moist I'm sticking to the leather." -Kermit the Frog on The Late Late Show
  51. Re:NASA Management Practices and Quality of Softwa by johannesg · · Score: 2, Insightful
    I guess you are in management... How about these:

    (1) Schedule realistically, so that tasks can be completed without overtime. This may mean some things just cannot be done in the desired time period. Learn to accept that.

    (2) Hire and retain sufficient staff, so that the work can be shared between multiple people. This may mean that some of the time the company will be overstaffed. Accept that too.

    Obviously both these suggestions come with a pricetag, but lost missions aren't free either...

  52. Re:It's the programming language, stupid! by aebrain · · Score: 2, Interesting
    Well, yes.
    A quote from a recent Newspaper article:
    Spaceflight avionics software development is not for the faint-hearted either.
    "The question for software developers is not, 'Are you paranoid?', the question is, 'Are you paranoid enough?' " Brain says. "Every software module, every function, procedure or method has to assume that information coming in may have been spoilt by a malfunction and be prepared for the worst. The system must be ductile - bending, not breaking - when things go wrong. In space no one can press Control/Alt/Delete."
    A team of Australian programmers developed FedSat's onboard software, building on work done in Britain. It is written in Ada-95, a programming language designed for embedded systems and safety-critical software. All it has to work with is 16MB of RAM, 2MB of flash memory for storing the program, a 128K boot PROM (programmable read only memory) and 320MB of DRAM in place of a hard disk that would never survive the launch process. All essential data is stored in three physically different locations.
    Language is important. The numbers say it, the metrics say it, the successful projects say it, even some /. posts say it. But the "programmer gods" don't believe it, or more often, won't bother doing the research.
    The rest of us will just have to settle for actually doing this work, satellites, laser eye surgery systems, aircraft, subs etc instead of making yet another kludgy VB system to sell the latest in sportswear or whatever.
    --
    Zoe Brain - Rocket Scientist