Slashdot Mirror


'A Lot of Hoped-for Automation Was Counterproductive', Remembers Elon Musk (bloomberg.com)

Thursday Elon Musk gave a surprisingly candid interview about Tesla's massive push to increase production of Model 3 sedans to 5,000 a week. An anonymous reader quotes Musk's remarks to Bloomberg: I spent almost the entire time in the factory the final week, and yeah, it was essentially three months with a tiny break of like one day that I wasn't there. I was wearing the same clothes for five days. Yeah, it was really intense. And everybody else was really intense, too... I think we had to prove that we could make 5,000 cars in a week -- 5,000 Model 3s and at the same time make 2,000 S and X's, so essentially show that we could make 7,000 cars. We had to prove ourselves. The number of people who thought we would actually make it is very tiny, like vanishingly small. There was suddenly the credibility of the company, my credibility, you know, the credibility of the whole team. It was like, "Can you actually do this or not?"

There were a lot of issues that we had to address in order to do it. You know, we had to create the new general assembly line in basically less than a month -- to create it and get to an excess of a 1,000-cars-a-week rate in like four weeks... A lot of the hoped-for automation was counterproductive. It's not like we knew it would be bad, because why would we buy a ticket to hell...? A whole bunch of the robots are turned off, and it was reverted to a manual station because the robots kept faulting out. When the robot faults out -- like the vision system can't figure out how to put the object in -- then you've got to reset the system. You've got to manually seat the components. It stops the whole production line while you sort out why the robot faults out.

When the interviewer asks why that happens, Musk replies, "Because we were huge idiots and didn't know what we were doing. That's why."

16 of 208 comments (clear)

  1. best way to do it by phantomfive · · Score: 4, Insightful

    For a large automation project like this, it's better to start with something you know works. That is, a human assembly line (or a mix like all factories have these days). Then instead of redesigning the whole thing from scratch, replace one humn component at a time. Then you have minimal risk. (That may notbe the best way to do it, but it is a way that works)

    --
    "First they came for the slanderers and i said nothing."
    1. Re:best way to do it by Anonymous Coward · · Score: 5, Insightful

      Nothing particularly wrong with automation. I deal with it all the time, but my production is predictable, has accumulation to deal for errors and gives me a lot of balance. I find automation that starts to deal with vision systems where things completely fall apart. I've yet to find a "good" vision system, they're all pretty primitive, even for quality control, but if you allow for errors, you can develop things to mitigate the inherit problems with it.

      I don't know what Tesla's automation has or what particular situation they have, but I'm sure they have good people trying to think of new ways to automate things. But I do run into a lot of designers trying to eliminate any type of accumulation system (Because it takes up a lot of space) and then utterly fail because of low tolerances in the system. Human error translates into computer systems multiplied by a huge factor.

    2. Re:best way to do it by SWPadnos · · Score: 5, Interesting

      From TFS;

      That seems to me a lack of fault tolerance in the overall design approach. A major oversight if so. An entire line should not shut down due to one fault.

      Well, yes and no. Assembly lines are tuned so that you produce the correct quantity of each item in the same amount of time it takes to complete the "full product". It's called Takt time. There are just over 10,000 minutes in a week, so the production goal of 5,000 cars per week requires a new Model 3 to roll off the line every 2 minutes.

      Let's say they're building the battery packs as part of the assembly line, and it takes 60 minutes to build each pack. Just for grins, let's assume that it takes 10 minutes to install that battery pack. This implies that you need 6x as many battery assembly stations (or sub-assembly lines) to make batteries as you need battery installation stations.

      If you have a robot installing batteries, and that robot fails, then you want to stop making batteries before you fill up all the available space with battery packs you can't use (because you can't install them). Similarly, you no longer have chassis with batteries to move further down the line, so anything after the battery installation has to stop, at least for that line.

      There is slack in the process - it might be 59:30 to build the packs or 9:18 to install them, and there would likely be some parts storage as well, so the line could whether an employee going to the bathroom or something. It couldn't whether a continuous failure or a permanent change in process time (ie, it may take a human 13 minutes to install the pack and inspect their work).

      Most assembly lines work this way. The more slack you have, the less efficient your line is (because you have all this extra time ...). The less slack you have, the less you can tolerate a fault.

      I wonder how much $$$ was lost on that automation equipment now collecting dust.

      I'd bet most of the lost money is whatever was spent on programming the units, and the lost opportunity cost for both the hardware and its configuration. The robots themselves are likely still usable, but they'll need to refine how they're used in order to recoup that investment.

      --
      - The Sigless Wonder
    3. Re:best way to do it by ElizabethGreene · · Score: 4, Interesting

      This slack time is a serious consideration as you get toward the tail of a production line. A mile-long production line is a hugely complex dependency chain. Each of the hundreds of individual steps might have 99% uptime, but since each depends on the next the real uptime is 50%.

      Case in point: my father worked in the packaging/shipping area of an auto glass manufacturer. When the line had a problem he could go an entire shift or even two (with overtime!) with nothing to do. When things were running right, he could barely keep up.

      The former was much more common than the latter.

  2. Re:I am God's gift to you rotten bastards... apk by gravewax · · Score: 5, Insightful

    I don't like censorship, but seriously isn't it about time Slashdot took some measures to actively block this spamming cunt!

  3. Re:Elon Musk is like the facebook generation by Calydor · · Score: 4, Interesting

    Would you prefer a hundred 'erm' and 'uhh' while he figures out how to phrase the next few words so it's both accurate and relatively unlikely to be taken out of context?

    I have no idea why American interviews (and subtitles, I've noticed) don't do a bit of cleanup before posting but absolutely HAVE to be completely verbatim.

    --
    -=This sig has nothing to do with my comment. Move along now=-
  4. Re:Know thyself by jiriw · · Score: 5, Insightful

    You are mixing up long-term success (visionary) with short-term success (being a huge idiot sometimes). But you probably did that on purpose and are just trolling. Well, I like to feed sometimes ;) I have karma to burn.

    If you can't be a huge fucking idiot sometimes you will not accomplish anything in life. It's when we naively make our greatest mistakes, we grow the most as a human being. The point is, learning and not making the same mistake again.

    Do you know anyone that can operate an automatic assembly-line from birth, like it's in their DNA, other than its own digestive tract? No? Indeed, didn't think so. Eating and shitting all over the place comes naturally, as we see often enough here in the comments. The rest we have to learn. Sometimes we can learn from others, but if we want to do something innovative, we have to learn the hard way. That means being huge idiots until you know how to do it right.

    If you think you can do better than Musk, prove it to the world, or forever hold your peace.

  5. Re:Elon Musk is like the facebook generation by JaredOfEuropa · · Score: 5, Informative

    I prefer filler words such as "like" as well as the occasional "erm" from people who actually think about what they have to say, over people who talk and talk and talk with practiced ease but without actually saying anything. Too many interviews are just lips making noise with years of media training behind it, and an interviewer unable to break through that barrier. That's why these interviews with Musk are unusual and refreshing: he actually has something to say, speaks his mind, and isn't as prone to evade questions.

    --
    If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
  6. Re:So Musk Admits... by DeBaas · · Score: 5, Insightful

    Well I would choose the 'let's try something ambitious and if it doesn't work just admit and stop doing it' over the trillion dollar corporate method of 'very small, committee stamped and approved, steps towards innovation' any day.
    But admittedly, I am a fanboy...

    --
    ---
  7. Re: So Musk Admits... by Qbertino · · Score: 4, Insightful

    They are smarter. Also smart enough to admit when they've gone down a wrong path and need to retract.

    --
    We suffer more in our imagination than in reality. - Seneca
  8. Re:Automation does not start in production phase. by Corbets · · Score: 5, Insightful

    Ironically, that character flaw is also what has allowed him to succeed in breaking into markets the world thought he could never enter (upsetting established auto manufacturers with a tech electric startup, reusable rockets stealing market share from the Lockheeds of the world).

    So maybe we ought to write it as “flaw” with the quotes instead.

  9. Re:So Musk Admits... by MrL0G1C · · Score: 4, Insightful

    I'm not a fanboy but I'm still impressed at how well Musk gets this stuff working. They met their target, no-one thought they would, I was pretty sceptical myself.

    --
    Waterfox - a Firefox fork with legacy extension support, security updates and better privacy by default.
  10. Re:So Musk Admits... by bgarcia · · Score: 5, Interesting

    Would that be the same 120 year old trillion dollar auto industry which said it was impossible to design and develop an electric car that people would actually buy?

    --
    I'm a leaf on the wind. Watch how I soar.
  11. Re:Know thyself by magzteel · · Score: 5, Insightful

    You are mixing up long-term success (visionary) with short-term success (being a huge idiot sometimes). But you probably did that on purpose and are just trolling. Well, I like to feed sometimes ;) I have karma to burn.

    If you can't be a huge fucking idiot sometimes you will not accomplish anything in life. It's when we naively make our greatest mistakes, we grow the most as a human being. The point is, learning and not making the same mistake again.

    Do you know anyone that can operate an automatic assembly-line from birth, like it's in their DNA, other than its own digestive tract? No? Indeed, didn't think so. Eating and shitting all over the place comes naturally, as we see often enough here in the comments. The rest we have to learn. Sometimes we can learn from others, but if we want to do something innovative, we have to learn the hard way. That means being huge idiots until you know how to do it right.

    If you think you can do better than Musk, prove it to the world, or forever hold your peace.

    Well said.
    It's so easy to never fail. Just never try anything and spend all your time criticizing others who do.

  12. Re: So Musk Admits... by jiriw · · Score: 4, Interesting

    Then he still has a 100 years to make up for it, doesn't he?

    I jest. No-one will deny Musk isn't stubbornly trying to partly redo what the big car manufacturers already can do while sleeping. It's the other parts those big boys, also stubbornly, refuse to do that he tries to make a viable business from. Most EVs from other manufacturers are either 'show productions' with limited numbers or have known horrible flaws baked in (especially in battery degradation) from the start. I'd thank Musk for his tries to do it right (not saying he does already, but he's damned well trying) and I admire him for doing it in grand style.

    If I had a drivers license* and enough money to spare for a car, I'd buy a Tesla. Like I bought a Ryzen the moment they were released. I like to put my money in the camp that tries and manages to make at least a decent product over those that sit on their butts and make money while sleeping.

    (*By the way, I don't have a drivers license because I never had the need to - my job is a decent bike ride away - the exercise keeps me healthy, and we have proper public transport where I live.)

  13. Re:So Musk Admits... by raftpeople · · Score: 4, Insightful

    He thinks he is going to out-Toyota Toyota. If you think Toyota's approach is 'very small, committee stamped and approved, steps towards innovation' then I would encourage you to read up on the history and workings of Toyota's systems, it's pretty impressive. They were smart, from top down, no Dilbert Pointy Haired Boss stuff but rather thoughtful systems designed and tuned over the years.