Tesla Is Building Its Own AI Chips For Self-Driving Cars (techcrunch.com)

Yesterday, during his quarterly earnings call, Tesla CEO Elon Musk revealed a new piece of hardware that the company is working on to perform all the calculations required to advance the self-driving capabilities of its vehicles. The specialized chip, known as "Hardware 3," will be "swapped into the Model S, X, and 3," reports TechCrunch. From the report: Tesla has thus far relied on Nvidia's Drive platform. So why switch now? By building things in-house, Tesla say it's able to focus on its own needs for the sake of efficiency. "We had the benefit [...] of knowing what our neural networks look like, and what they'll look like in the future," said Pete Bannon, director of the Hardware 3 project. Bannon also noted that the hardware upgrade should start rolling out next year. "The key," adds Elon "is to be able to run the neural network at a fundamental, bare metal level. You have to do these calculations in the circuit itself, not in some sort of emulation mode, which is how a GPU or CPU would operate. You want to do a massive amount of [calculations] with the memory right there." The final outcome, according to Elon, is pretty dramatic: He says that whereas Tesla's computer vision software running on Nvidia's hardware was handling about 200 frames per second, its specialized chip is able to crunch out 2,000 frames per second "with full redundancy and failover." Plus, as AI analyst James Wang points out, it gives Tesla more control over its own future.

Comments

Different headline than I expected

[DontBeAMoran]

From the previous thread about Tesla, I expected this headline to read "Tesla is now building their own arcade cabinets".

Building proprietary silicon could be dangerous

[postbigbang]

For better and worse, keeping things proprietary means it's by definition both closed source, and tested only to one's own environment. Although it produces fast yields, it doesn't have many eyes. Many eyes and many hours are needed to vet the integrity and edge cases (like cliff edges) before safety can be assured.

It's a risky, expensive, and proprietary endeavor. If everyone (systems builders) were using similar development, the testing age could be completed in a concurrent time, rather than a serial/iterative time. I'm betting against this turning out well.

Re:Building proprietary silicon could be dangerous

[religionofpeas]

Neural net calculations are pretty simple, just repeated many times over. Testing the silicon should be relatively simple compared to general purpose CPU or even GPU design.

Re:To what end?

[dgatwood]

Maybe after a point, but up until that point, the main risk is reacting too slowly. Ask anybody with an AP2 Tesla how well it handled curves prior to earlier this year. Of they don't use the word "lag", they don't know software, and if their eyes don't bug out in abject terror, they don't know how to drive.

Basically, it had (and still has, to a lesser extent) trouble with lane keeping, because its reactions lagged behind reality, and it started turning way too late, resulting in uncomfortable turns, getting dangerously close to barriers and center lines, etc. This is better in current versions, but I still get scared enough to take manual control a couple of times per day.

So right now, performance is still their main problem. This is a very welcome announcement.

Re:To what end?

[philmarcracken]

That's the answer they want people to hear. The real answer is no longer having to pay nvidia.