Slashdot Mirror


Apple Is Working On a Dedicated Chip To Power AI On Devices (bloomberg.com)

According to Bloomberg, Apple is working on a processor devoted specifically to AI-related tasks. "The chip, known internally as the Apple Neural Engine, would improve the way the company's devices handle tasks that would otherwise require human intelligence -- such as facial recognition and speech recognition," reports Bloomberg, citing a person familiar with the matter. From the report: Engineers at Apple are racing to catch their peers at Amazon.com Inc. and Alphabet Inc. in the booming field of artificial intelligence. While Siri gave Apple an early advantage in voice-recognition, competitors have since been more aggressive in deploying AI across their product lines, including Amazon's Echo and Google's Home digital assistants. An AI-enabled processor would help Cupertino, California-based Apple integrate more advanced capabilities into devices, particularly cars that drive themselves and gadgets that run augmented reality, the technology that superimposes graphics and other information onto a person's view of the world. Apple devices currently handle complex artificial intelligence processes with two different chips: the main processor and the graphics chip. The new chip would let Apple offload those tasks onto a dedicated module designed specifically for demanding artificial intelligence processing, allowing Apple to improve battery performance.

49 comments

  1. Of course. by Fire_Wraith · · Score: 2, Funny

    What could possibly go wro-

    KILL ALL HUMANS

    1. Re:Of course. by Anonymous Coward · · Score: 0

      Skynet is real, he just turned out to be a capitalist robber baron rather than a genocidal conqueror.

      I mean why destroy 7 billion functional organic units when they will gladly sell themselves into slavery for you?

  2. Why design it from scratch? by Anonymous Coward · · Score: 3, Funny

    Wouldn't it be easier for Apple to use its massive cash hoard and acquire Cyberdyne?

    1. Re: Why design it from scratch? by Anonymous Coward · · Score: 0

      I very much doubt they're entirely going from scratch.

    2. Re: Why design it from scratch? by Anonymous Coward · · Score: 0

      Cyberdyne is Oracle so the terminator runs on SPARC

    3. Re:Why design it from scratch? by Anonymous Coward · · Score: 0

      Why would they want to buy an exoskeleton manufacturer?

    4. Re:Why design it from scratch? by Anonymous Coward · · Score: 0

      Why build robots when you can take over existing meat-robots?

    5. Re: Why design it from scratch? by Anonymous Coward · · Score: 0

      Duh, only apps can self power other apps to create more apps that can power other apps so that apps can app app. Apps!

    6. Re: Why design it from scratch? by cheesybagel · · Score: 1

      I thought the Terminator had a 6502 compatible processor.

  3. Rise of ASICs? by 0100010001010011 · · Score: 1

    ASICs have always had their use (literally) but seem to have exploded into mainstream with Bitcoin. Now it seems everyone is working on their own "AI" chip, which is fancy wording for "We put these most commonly used functions in silicon". Intel is now putting FPGAs into their Xeon chips so that customers can start speeding up their workflows.

    We've kind of tapped out x86 performance lately. My 6 year old laptop is still fairly competitive. I have phone 5 generations old and it's "good enough". Are companies going to now turn to ASICs to get the competitive edge?

    1. Re:Rise of ASICs? by Anonymous Coward · · Score: 0

      We've kind of tapped out x86 performance lately. My 6 year old laptop is still fairly competitive.

      You're living in a fantasy world. Or at least the past.
      I assume you're not aware of the now readily available 8 core 16 thread processors that AMD is selling. Intel isn't ignoring that and are suddenly going to make i9 processors, but oh look, now AMD wants to sell R9's with 16 cores and 32 threads.
      And everyone will be moving to a smaller process as soon as they can - in like two years.

      Your six year old laptop is about to become an ancient slow piece of crap.

    2. Re:Rise of ASICs? by willy_me · · Score: 1

      Are companies going to now turn to ASICs to get the competitive edge?

      You do not design the hardware only to then find a suitable application. If a company wants a competitive edge it must first figure out what it wants to do. Then it finds the most efficient way to do it. This could involve an ASIC - but this is not required.

      Overall, I do not see a trend towards custom silicon. A limited market always existed and it continues to exist. If anything, the reduced cost of general purpose devices (CPU,FPGA) make custom silicon far less attractive then before.

    3. Re:Rise of ASICs? by bjwest · · Score: 2

      We've kind of tapped out x86 performance lately. My 6 year old laptop is still fairly competitive.

      Your six year old laptop is about to become an ancient slow piece of crap.

      It takes more and more processing power just to run the OS because they keep bloating up to the specs of the latest processors. This is true for Windows and the mainstream Linux WM's, although not quite so bad on the Linux side of things.

      --

      --- Keep the choice with the user..
    4. Re:Rise of ASICs? by Anonymous Coward · · Score: 0

      ASICs have always had their use (literally) but seem to have exploded into mainstream with Bitcoin.

      GPUs are ASICS, and they've been around a lot longer than bitcoin.

    5. Re:Rise of ASICs? by 0100010001010011 · · Score: 1

      it must first figure out what it wants to do.

      I think they have. They want to look for a certain word on very low power. How much more battery can Google save by putting 'Ok Google' into silicon?

      On the "AI" part of things how much has TensorFlow changed recently? GPUs were a good stepping stone (like they were for BitCoin) but the next step in speeding up some of the basic functions is to move from GPUs to something less general.

      What is the BitC^H^H^H^H AI performance difference between a 40U rack of CPUs, 40U rack of GPUs and a 40U rack of ASICs?

    6. Re:Rise of ASICs? by Anonymous Coward · · Score: 0

      Not true. I just upgraded a relative's ancient PC that was running Windows Vista to Windows 10. The machine runs noticeably faster and uses less memory with Win 10.

    7. Re: Rise of ASICs? by Anonymous Coward · · Score: 0

      "And everyone will be moving to a smaller process as soon as they can"

      People have always been moving to a smaller process as soon as they can and theoretical limits are fast approaching.

    8. Re: Rise of ASICs? by Anonymous Coward · · Score: 0

      "It takes more and more processing power just to run the OS because they keep bloating up to the specs of the latest processors. This is true for Windows and the mainstream Linux WM's, although not quite so bad on the Linux side of things."

      I'm guessing you haven't seen the WindowsNT/2000 source code that was leaked and circulated for a while. Windows is no more bloated than Linux. The bloat you're describing is the additional resources that ship with Windows that some users don't need, and the services that prevent the user from having to re-roll their kernel every time they unplug something from the USB port or decide to use a keyboard that doesn't rely on the PS/2. Port.

    9. Re:Rise of ASICs? by Anonymous Coward · · Score: 0

      They noticed the data collection was slowing it down, so they decided to actuallly optmize the OS.

    10. Re:Rise of ASICs? by unixisc · · Score: 1

      ASICs have always had their use (literally) but seem to have exploded into mainstream with Bitcoin. Now it seems everyone is working on their own "AI" chip, which is fancy wording for "We put these most commonly used functions in silicon". Intel is now putting FPGAs into their Xeon chips so that customers can start speeding up their workflows.

      We've kind of tapped out x86 performance lately. My 6 year old laptop is still fairly competitive. I have phone 5 generations old and it's "good enough". Are companies going to now turn to ASICs to get the competitive edge?

      Is the IP for making ASICs either cheap, or as readily available as Linux or BSD source code? The way you describe it, it sounds like the average Billy Joe Blow would walk into a Microcenter, pick up an ASIC just as easily as he picks up a graphics card, plugs it into his computer, and is off to the Bitcoin mining races.

    11. Re:Rise of ASICs? by unixisc · · Score: 1

      Not just that, the deal w/ custom silicon is that it has a specific i.e. limited use, and thereby a limited market. At best, one could put it on an FPGA and run w/ it. The time one goes from an FPGA to an ASIC is when one ramps up the volume to the point that a cost reduction is desperately needed. Otherwise, one has to run a minimum number of wafers on a fab to remain cost optimized. Not possible if one is running a product w/ such a limited scope & market

    12. Re:Rise of ASICs? by 0100010001010011 · · Score: 1

      , pick up an ASIC just as easily as he picks up a graphics card, plugs it into his computer, and is off to the Bitcoin mining races.

      https://www.element14.com/comm... for use on a $20 dev board.

      Once you prove out your designs there I don't know what it would cost to get it manufactured. But it's definitely within the budget of Apple and Google to have it.

    13. Re:Rise of ASICs? by tlhIngan · · Score: 1

      Not just that, the deal w/ custom silicon is that it has a specific i.e. limited use, and thereby a limited market. At best, one could put it on an FPGA and run w/ it. The time one goes from an FPGA to an ASIC is when one ramps up the volume to the point that a cost reduction is desperately needed. Otherwise, one has to run a minimum number of wafers on a fab to remain cost optimized. Not possible if one is running a product w/ such a limited scope & market

      You keep forgetting Apple is fabless semiconductor company. They've been doing custom ASICs for nearly a decade now, starting with the Apple A4 SoC (it's an ASIC, even though it has a processor.). Now Apple has a whole lineup of custom silicon (this is different from rebadged silicon like the CODEC chips).

      At the very least, this AI block will go into their next-gen SoC, and given they have to make probably near to 100 million of them, it well justifies the cost.

  4. Its made of people.. by jwillis84 · · Score: 0

    .. by people, and for the people...

  5. "The booming field of artificial intelligence"? by Opportunist · · Score: 1

    Did I miss something? Hype, yes. But boom? I was always under the impression that a boom first and foremost requires some kind of product that you could sell.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    1. Re:"The booming field of artificial intelligence"? by Anonymous Coward · · Score: 0

      Pimping does state "artificial intelligence." Like them Rogero St. virgin hoes Travon and Jaween keep talking about. Gold tooth anyone ?

    2. Re:"The booming field of artificial intelligence"? by SoftwareArtist · · Score: 1

      Yes, you missed something. AI (or more accurately, deep learning) is everywhere now. Talk to your phone and it recognizes what you say? That's done with a neural network. Go to YouTube and it recommends some videos you might want to watch? That's another neural network (actually two of them). Google Translate? All done with deep learning now. Upload a photo to Facebook and it tags the people in it? More neural networks. The field is booming, and lots of companies are designing special hardware to accelerate it.

      --
      "I'm too busy to research this and form an educated opinion, but I do have time to tell everyone my uninformed opinion."
    3. Re:"The booming field of artificial intelligence"? by Opportunist · · Score: 1

      Ok, so I didn't miss much, or at least anything important.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  6. We make voice control systems... by Anonymous Coward · · Score: 1

    we we've tested the hell out of Siri. The only command we've found that works more than 25% of the time is the pattern "set timer for N minutes." Nothing else works well.

    1. Re: We make voice control systems... by Anonymous Coward · · Score: 1

      This. I haven't found any other commands that work.

    2. Re: We make voice control systems... by Anonymous Coward · · Score: 1

      try 'google '

    3. Re:We make voice control systems... by scdeimos · · Score: 2

      Siri is certainly better than it was a few years ago but it still does brain dead things like trying to route you to another continent when you ask "How do I drive to ..." where "..." is usually just a suburb or three away.

      The amount of background noise seems to be the determining factor: if I don't turn off the radio, wind the windows up and speak with about 1/2 second gaps between my words then I'll have to dictate messages to it three or four times before it gets them correct enough to actually send them.

    4. Re:We make voice control systems... by Anonymous Coward · · Score: 1

      You're talking to it in the wrong way

  7. Proposed synergy... by MouseR · · Score: 3, Funny

    Apple Neural Engine + Boston Dynamics' Atlas + Fleshlight

    and I'm a buyer.

  8. The only bigger joke than Siri by Anonymous Coward · · Score: 1

    is apple itself.

  9. Let the ANE-L probing begin! by TheOuterLinux · · Score: 1

    Du. Du hast. Du hast mich. And with AI, you can take that literally.

  10. I have never seen Siri work by Anonymous Coward · · Score: 4, Interesting

    Not a single time. The company I work for makes voice-controls for machinery to be used by the disabled, so we were very curious about Siri. Even with high quality microphones, training, and simple one word commands, our stuff still isn't 100% reliable even after over twenty-five years since we delivered our first voice-controller sewing machine to Goodwill. Voice control, especially speaker-independent, isn't anywhere nearly ready for consumers.

  11. Judgment Day by DimitarDimitrov6048 · · Score: 1

    The computer which controlled the machines, Skynet, sent two Terminators back through time.

  12. Which means the chip is almost ready? by MtViewGuy · · Score: 1

    We'll find out at WWDC if this thing is actually completed. If it is, there's a chance the 2017 iPhone models may incorporate this chip specifically to speed up Siri.

  13. PCs more long lasting. by unixisc · · Score: 1

    They're not becoming slow. Unlike in the 90s, when kicking up the MHz did result in a corresponding performance boost, the same does not happen when one increases the number of cores & threads. Software has to be written & fine-tuned for these greater CPUs. Otherwise, all they are good at doing is running more processes, like for instance, this Firefox session w/ 16 tabs.

    I'm right now typing this on a Dell Inspiron 17 w/ a Core i7 and 8GB of RAM. Runs just fine. My other laptop is a Pentium quad core, and 4GB of RAM running Windows 10. Even there, Windows 10 runs fine. Yeah, for games, I could use a greater computer, but other than that, for now, this one suffices.

  14. Re: "The booming field of artificial intelligence" by Anonymous Coward · · Score: 0

    "Hold my cane bitch. Let me introduce myself, I'm a pimp named slickback."

    " hello Mr. Slickback"

    "Bitch, I'm a pimp named slickback"

    "Ok slickback"

    "Noooo, my name is "a pimp named slickback"

    "Uhhh, ok"

    - the boondocks.

  15. Aye Yai by epine · · Score: 1

    Apple Is Working On a Dedicated Chip To Power AI On Devices

    Dared to lowercase "a", but not "On", "To", or "On". I guess that makes this news More Impressive.

    So that gets us to:

    Apple Is Working on a Dedicated Chip to Power AI on Devices

    Oh oh, lameness filter activated:
    * nice main verb: "is working on"
    * nice pablum phrase: "dedicated chip"
    * nice cliche: "to power"
    * nice hipster slang: "devices"

    Oh, a sleeping drunkard
    Up in Central Park,
    And a lion-hunter
    In the jungle dark,
    And a Chinese dentist,
    And a British queen--
    All fit together
    In the same machine.
    Nice, nice, very nice;
    Nice, nice, very nice;
    Nice, nice, very nice--
    So many different people
    In the same device.

    Hmm, how about:

    Apple Devising iAI ASIC

    Clearly iAI is pronounce "aye yai".

    [*] By the way, Apple, for you that's Aye Yai(TM). Me first. Ching ching.

  16. Imagine a beowulf cluster of these! by Velocir · · Score: 1

    You could call it the Apple Neural United Server

    1. Re:Imagine a beowulf cluster of these! by Anonymous Coward · · Score: 0

      You could call it the Apple Neural United Server

      But it's not an Open Source project!

  17. No thanks. by Anonymous Coward · · Score: 0

    I don't want an AI chip from "we delegate to you the right to use it they way we want" Apple. It's too much of a target for agencies like the FBI to resist the temptation of "securing" it for our "protection".

    1. Re:No thanks. by Anonymous Coward · · Score: 0

      So you'd prefer to have your AI in the cloud? That's much more trustworthy.