Slashdot Mirror


Siri Co-founder is Surprised By How Much Siri Still Can't Do (qz.com)

In an interview with Quartz, Norman Winarsky, a founder of Siri, suggests that Apple may have given Siri an overly ambitious collection of responsibilities and hasn't made the feature reliable enough. From a report: And while vastly improved from its earliest days, Siri still isn't a sparkling conversationalist. "Surprise and delight is kind of missing right now," said Winarsky, now a consultant and venture capitalist. Winarsky acknowledges that some of this disappointment stems from the sheer difficulty of predicting the pace of major technological advancement, which Bill Gates once summed up as the human tendency to "overestimate the change that will occur in the next two years and underestimate the change that will occur in the next 10."

But part of it is also likely because Apple chose to take Siri in a very different direction than the one its founders envisioned. Pre-Apple, Winarsky said, Siri was intended to launch specifically as a travel and entertainment concierge. Were you to arrive at an airport to discover a cancelled flight, for example, Siri would already be searching for an alternate route home by the time you pulled your phone from your pocket -- and if none was available, would have a hotel room ready to book. It would have a smaller remit, but it would learn it flawlessly, and then gradually extend to related areas. "These are hard problems and when you're a company dealing with up to a billion people, the problems get harder yet," Winarsky said. "They're probably looking for a level of perfection they can't get."

18 of 86 comments (clear)

  1. Siri has a "founder" by XXongo · · Score: 2

    Siri has a "founder"? Not a programmer? Do other apps have "founders", or just Siri?

    Really, Siri is just Hal by another name. They should have just called it "Hal-9000" and left it at that.

    1. Re:Siri has a "founder" by wonkey_monkey · · Score: 5, Funny

      They should have just called it "Hal-9000" and left it at that.

      I'm afraid they couldn't do that.

      --
      systemd is Roko's Basilisk.
  2. Re:Deep learning by iggymanz · · Score: 2, Insightful

    hahaha, nothing new in AI in the last couple of decades other than faster hardware. tell me what you think is new in AI and I'll tell you what decade in the 20th century it came from....

    what a farce, machines aren't going to be intelligent in the near future, artificial or otherwise....

  3. Siri's capabilities by OneHundredAndTen · · Score: 4, Insightful

    The problem is that the public has been led to believe that the capabilities of Siri (and its counterparts by other companies) wouldn't fall too short of those displayed by HAL 9000 and the Star Trek computer. When you start interacting with them under such expectations, you are bound to be sorely disappointed. Siri et al. remain gimmicks good for grins and giggles, and not really much else - just about anything they can do, people can do themselves, probably more efficiently. Plus, the things we would really want for them to do remain well beyond their capabilities. And the AI community still has the chutzpah (or recklessness) to carry on coming up with exuberant forecasts.

    1. Re:Siri's capabilities by swb · · Score: 2

      I found this wrong information on the web, which I won't read to you.

      How many times do I need that to happen before I stop caring?

    2. Re:Siri's capabilities by Anonymous Coward · · Score: 2, Funny

      And I can just glance out the window to check the weather quickly.

      You're forecasting the weather for the day by looking out the window? You do realize the weather changes over the course of the day right? And that you can't see the temperature? But yes if there's snow on the ground it's probably pretty cold.

    3. Re:Siri's capabilities by fatwilbur · · Score: 2

      For the weather, looking out the window might help, but the the last six months here in Canada, looking out the window in the morning it's just dark and snow covered. We've had an unusually long cold winter, many days below -20C, and the odd day it will swing anywhere up to 0C. Turns out it's real convenient to just ask for this information.

      As someone who has worked (a long time ago) with natural language processing, Alexa does a pretty good job of impressing me. I know the limitations and difficulties in the underlying technology, and Alexa is resoundingly good at figuring out exactly what I am trying to ask most of the time. Sometimes I'll stumble or forget what I was asking:

      "Hey Alexa! What time is the next.. uh crap..ummm. Hockey game.. yeah Men's olympic hockey game. That Canada is playing in!" Doesn't always work, but with many similar sentences she'll respond with exactly what I was looking for.

      Past that, a really good (and primary) use case I found for it is lighting control. To quickly dim or turn off lights across the room while watching TV, it's quicker to just ask Alexa.

  4. Digital Assistants suck in general. by jellomizer · · Score: 4, Insightful

    In general this technology, is just the command line interface all over again, with some rudimentary natural language parsing, with a default fail over of googling the question.

    The problem with All the Digital Assistants is that it doesn't really get context. So it comes up with silly answers to questions, because the context of the question isn't place in concern.

    --
    If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    1. Re:Digital Assistants suck in general. by Zak3056 · · Score: 3, Informative

      The problem with All the Digital Assistants is that it doesn't really get context. So it comes up with silly answers to questions, because the context of the question isn't place in concern.

      SOME things it has context for it and gets right in a downright scary fashion. Siri (and Google in the Samsung phone it replaced) know when I usually leave for work, or leave to go home, and pop up a notification with route, traffic, and anything else. They know that on Monday I take my daughter to Girl Scouts, that I leave work at a different time on that day and take a different route. The know that on Friday I drive to my Girlfriend's house, but that I have a doctor's appointment first, and that my ex-wife picks my daughter up on that day so I don't need to drive to school (except on those weekends I have my daughter, when I DO need to drive to school). That stuff (while, as noted, is REALLY freaking scary) is pretty useful.

      Almost EVERYTHING else, it's just downright shit for. As another poster put it, "I found this wrong information on the web, which I won't read to you."

      --
      What part of "shall not be infringed" is so hard to understand?
    2. Re:Digital Assistants suck in general. by Kjella · · Score: 2

      The problem with All the Digital Assistants is that it doesn't really get context.

      Well, they're still short on a lot of human context.. but they've made strides on linguistic content. Like if you ask who's POTUS, that's simple enough. But you continue to ask questions like how old is he, what party does he belong to, when is he up for reelection it'll understand that it's still in the same context. If you're told Trump is a Republican and follow up with asking if they have a majority in Congress, it'll understand the context switch to asking about Republicans.

      In general this technology, is just the command line interface all over again

      Yeah... how many in the general population do you know who can not use a command line? That's your market, if you're annoyed because Siri doesn't understand the regex search you were trying to make you're not exactly in the target group. I think it's like trying to program a computer with boxing gloves but a lot of the population seem like they can't read, can't reason and can't remember anything when they use a computer. It's easier to ask Siri for what you want than find the right menu item.

      --
      Live today, because you never know what tomorrow brings
    3. Re:Digital Assistants suck in general. by hey! · · Score: 2

      It's a bit like the uncanny valley: the closer we get to a computer system like the one depicted on Star Trek TNG, the more we'll focus on how it falls short.

      The thing about that Enterprise computer is that it could easily pass a pretty unconstrained Turing test. Used in a wide variety of tasks, it actually understood what the person was trying to do and could anticipate what they might want -- unless the writers required otherwise.

      At the extreme opposite end of the spectrum is the late 1960s AI program SHRDLU, which could respond reasonably to commands and queries about stacking blocks. You could tell it to "put the red block on top of the blue block," then ask it "Why did you move the yellow block?" and it would answer "To get at the red block." The performance of the program was astounding, especially if you look at the relatively small volume of code involved. I think this lends credence to the claim that we'd be a lot more impressed with Siri if its application domain were restricted to a constrained set of tasks like making travel reservations.

      The advances in natural language processing embodied by Siri are impressive, but positioning Siri as a kind of general purpose assistant means we're bound to be disappointed. We're continually reminded that the software doesn't actually understand us, canned humorous responses to anticipated questions notwithstanding. To impress at the job of general purpose assistant the program would need a fairly comprehensive understanding of us, something that a human upbringing naturally equips people with, or most people at least.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    4. Re:Digital Assistants suck in general. by 110010001000 · · Score: 2

      Well lets just try out your claims. I just asked Siri "Who is the president of the united states?" and it said "Donald Trump". So far so good. So I immediately asked "What party does he belong to?" and it came up with a wikipedia page for "Party Leader". So, yeah, total BS.

  5. Siri is a data science problem, not neuroscience.. by RyanFenton · · Score: 2

    Data science is about shaping databases to better match phenomenon - often VERY badly, but good enough to work for business or solving some immediate problem at hand with the resources at hand. I've worked at it, and it's powerful and amazing in its own ways - but it's not neuroscience, at all.

    Siri has some lovely canned responses, shaped to match common human inputs, and improved based on what new common inputs come in, largely by adding more human inputs rather than really dynamically generated content.

    Data science can help you shape an estimate to match previous responses better, can shape a curve to match an exponent better - but it isn't neuroscience.

    ELIZA and her informational descendants like Siri aren't immitating humans - they're selecting from a data set of mixed repeating inputs and canned responses, with a few lexical alterations for effect.

    They're not systems fooling humans - they're humans fooling humans using sliced up prerecorded clips.

    Almost all of artificial intelligence and even business intelligence is like that - focused on satisfying expectations to some percentage, not on actually modelling absolute truth. As long as customers are indicating improvement, managers give the thumbs up, it continues.

    It's very much more stage magic than anything else - under the hood, it's ugly framework and empty air, but dressed up to show the illusion just where it can be seen.

    Which makes sense - if you're spending millions, and millions, and millions on it - you expect some stagecraft, I mean "modern professionalism" painted on top to pretend every dollar was spend with perfect wisdom.

    Siri-ously though - it's a cool extension of previous technology, and a neat way to present it to cell-phone users and the like. But it's also cheesy use of such tools, and shouldn't be taken as more than window dressing to other tools as it is. The promise of 'virtual assistants' from the mid 90's is nowhere closer with this. Wolfram Alpha might be closer - but they're mostly in the same bag of oddball interfaces.

    Ryan Fenton

  6. Re:Hey Siri, fix this link! by Applehu+Akbar · · Score: 2

    UPDATE: See, it worked!

  7. Re:"Surprise and Delight" by hey! · · Score: 2

    I'm surprised and delighted when I get through a day without a piece of crappy software giving me grief.

    --
    Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  8. Siri's intelligence by Quasar1999 · · Score: 5, Funny

    Actual conversation I had with Siri.

    "Siri, what is my relationship status?" ... "I can't answer that"
    "Siri, what is my marital status?" ... "I can't answer that"
    "Siri, phone my wife" ... proceeds to phone my wife.
    "Siri, where is my girlfriend?" ... "Your wife is right beside you."


    That last one has me confused. Did Siri know that I am married and thus girlfriend means spouse? Or did she try to warn me that my wife was right next to me.

    --

    ---
    Programming is like sex... Make one mistake and support it the rest of your life.
  9. Siri solved hard problems, then bungled easy stuff by MorePower · · Score: 4, Insightful

    All my life, we've been expecting voice recognition "real soon now". And it always flopped. You had to shout really slowly and carefully to get the system to recognize maybe half the words you said.

    Then along came Siri, and finally there was a commercially available system that was good enough with normal speaking tone and pace (mostly) and... it dropped the ball miserably at doing simple stuff with the recognized speech.
    I haven't tried Siri in ages, so maybe they've improved it recently, but I already gave up on using it because of how dumb it was. For example:

    I could ask Siri for directions, say to my hotel, and she would understand fine. But if I asked for gas stations along my route, or restaurants near my destination she wouldn't do it. My old Tom-Tom could do that fine, you had to push the touchscreen as it had no voice capabilities, but it did it great. Siri could understand my voice, but could not do what my Tom-Tom could. To add insult to injury, Siri's canned response indicated that she understood what I was asking for (to use my route or destination as a search location instead of my current position), she just wouldn't do it.

    Another time, I wanted to call my wife from a rental car (my regular car has its own voice recognition that works better for this). So I asked Siri to call [wife's name]. She didn't understand, fine, my wife has a weird foreign name. So asked Siri to call [our last name]. She found 2 people with that last name in my contacts (myself and my wife ) and asked me which one I wanted to call. Great! I responded "[wife's name]" Siri then asked "what do you want to do with [wife's name]?" Siri you just asked me which of 2 people I wanted to call! Oh well, I responded "Call her". Siri didn't understand what "Call her" meant and looked up websites related to "Call her". Now even back in the '80s when playing Infocom text adventures like Zork, you could type commands like "hit troll" have the game respond "what do you want to hit the troll with?" and answer "axe". The game remembered just fine that it asked you to fill in some info, and was ready to plug in the new info into what you were doing a few commands ago. But Siri couldn'do that, 30 years later.

  10. Re: Deep learning by 110010001000 · · Score: 2

    Why is pointing out that AI is complete BS "worse than apk"? Siri is a joke and isn't AI. You guys are easily impressed by shiny things. I am just pointing out that they are utter failures at doing anything meaningful and you guys get so upset over it.