Slashdot Mirror


Apple's 3D Desktop Patent Filing Examined

phantomfive writes "The patent office has released some patent filings by Apple which indicate that the company is working on a 3D desktop of some sort. They call it a multi-dimensional desktop, according to the patent filing." There's also some commentary at ZDNet; both stories link to a detailed run-down at AppleInsider.

32 of 156 comments (clear)

  1. I love 3D by alain94040 · · Score: 3, Interesting

    Not surprising if you look at the 3D effects that Apple put into Time Machine and the document stack. I love these.

    What will make this really interesting is the navigation itself: since Apple is about to get rid of all buttons on the trackpad (and mouse?), I'm wondering if they have thought of some fancy 3 or 4-finger gestures to move around in 3D. I can think of some games that could use that.

    The first time I saw the idea of 3D navigation for the desktop was when Hypercard came out (was that 10, 15 years ago?). Someone came up with this concept of a house where you'd store various things. In the basement would be the backups. On the desk in the office would be the open documents, etc. You'd just walk around your house in what (at the time) felt like 3D.

    --
    http://fairsoftware.net/ -- where software developers share revenue from the apps they create

    1. Re:I love 3D by avandesande · · Score: 4, Insightful

      The problem is that your monitor is still in two dimensions- so what benefit do you get with a 3d interface that you constantly need to translate back in to 2 dimensions?

      --
      love is just extroverted narcissism
    2. Re:I love 3D by Tubal-Cain · · Score: 2, Interesting

      Who said the interface that will accompany this 3D desktop will be 2D?

    3. Re:I love 3D by ColdWetDog · · Score: 2, Insightful

      Who said the interface that will accompany this 3D desktop will be 2D?

      You think the next iteration of the MacBook is going to be a giant cube? Or a sphere perhaps?

      I don't know about you, but I'm not putting any stupid cube or sphere in my backpack, thankyouverymuch.

      --
      Faster! Faster! Faster would be better!
    4. Re:I love 3D by Tubal-Cain · · Score: 3, Funny

      It doesn't need to be a giant cube or sphere. All we need to do is harness the power of the Reality Distortion Field to travel to the Star Trek universe and bring back some holoemitters.

    5. Re:I love 3D by jdevivre · · Score: 2, Interesting

      The problem is that your monitor is still in two dimensions- so what benefit do you get with a 3d interface that you constantly need to translate back in to 2 dimensions?

      I don't completely disagree with you, but you must consider that what we meat-spacers generally experience *visually* as 3-dimensions is actually just a stereoscopic 2D image. Tie you to a chair with your arms bound, and that's really all there is to experience.

      I wear glasses that are smaller than my visual range, thus a ring of blur constitutes my peripheral vision. I am, if you would entertain it a moment, viewing the world through a "screen". The fact that objects at distance "react" 3-dimensionally to my eye/head movements is just a control problem... given the right interface and feedback, I could be fooled quite readily.

      However, the 3D desktop concept can and will be done well some day. I hope/hoped someone besides Apple pull it off though. They tend to take the arms-tied-to-your-sides concept too literally.

    6. Re:I love 3D by fprintf · · Score: 4, Informative

      They'll need to solve the motion sickness problem for some people first. I got quite sick at a 3D IMAX production, I think called "Deep Sea" a number of years ago. They had these big polarized goggles that would sit on your head and you would get a 3D effect from looking around. The problem was, as far as I could tell, was that any movement in 3 dimensional space was not accompanies by movement of the inner ear. So my eyes were thinking I was moving along the sea floor, but ears said "no way". I ended up taking them off and watching the movie in 3D. I was OK by the end of the movie.

      Second experience was riding on the Aladdin carpet ride at Disney World/EPCOT in Florida. I believe this is the virtual ride developed by Randy Pausch of Carnegie Mellon, the guy that gave that great speech when he got cancer. I got really sick on this one, in fact ended up puking after the ride. It was similar, one part of my brain said that I was moving in space but other parts said "no way". I am a sailor and was training to be a pilot, and hadn't been seasick in years... but this ride made me hot, sweaty and eventually pukey. Nastiest experience I have had in years.

      I am assuming that the display, if just used for navigation, won't have a lot of movement that might induce motion sickness. After all, I can look around in space now without a problem, changing focus on things near and far, looking from right to left etc. So maybe it won't be any kind of problem. I can tell you I won't be a first adopter though! Blech!

      --
      This post brought to you by your friendly neighborhood MBA.
    7. Re:I love 3D by coppro · · Score: 2, Informative

      If you RTFP (Read The F***ing Patent) (TM and Copyright (C) 2008 "coppro"), then you would see that it requires a "viewing surface", limiting the patent to a 2-D desktop environment. Also, my interpretation is that things can't hang in the middle, but I'm not nearly as sure about that (it's patent language, and the diagrams aren't loading).

    8. Re:I love 3D by diegocgteleline.es · · Score: 4, Insightful

      The same benefit you get from running a 3D game instead of a 2D one.

      The fact is, desktop has never been 2D. It has always been 3D. The shadows under a button that make it look pushed or not are a 3d effect, even if it's implemented as a black shadow in a bitmap.

      You can have top or botton windows. That's 3D aswell.

      3D desktops will not be about having a "3D room" in your desktop. They will be normal desktops just like they're today. The difference will be that instead of drawing a bitmap with a black line to make a button look like it's pressed, you'll have a 3D engine and the toolkit will tell the 3D engine: "move the button x pixel in depth" - and the engine will move the button and will draw the shadows according to the surrounding objects.

      IOW, you'll have a 3d engine powering your desktop, managing not just your windows (beryl can do that today), but also your widgets. Or icons. Icons won't be just a 2d bitmap/vector image, they will be a 3d object that will react to events with all kind of 3D effects - rotation, lighting, jumping, smoke...whatever

      As expected, it seems that Apple has the lead. It's a shame that nobody in Linux is doing something similar. It's an oportunity to take lead in the desktop.

    9. Re:I love 3D by initialE · · Score: 4, Funny

      But the directions clearly said not to taunt super fun ball.

      --
      Starbucks, Harbuckle of Breath.
    10. Re:I love 3D by Anonymous Coward · · Score: 2, Interesting

      uh...hello...helmet???

    11. Re:I love 3D by DittoBox · · Score: 2, Informative

      As expected, it seems that Apple has the lead.

      I agree with your post for the most part but Apple isn't leading here:
      http://bumptop.com/
      http://www.sun.com/software/looking_glass/

      They may "lead" in bringing something like this to the market quicker (like they did with desktop composition) but they didn't invent this stuff. Certainly not patent worthy.

      --
      Good. Cheap. Fast. Pick Two.
    12. Re:I love 3D by Tubal-Cain · · Score: 2, Interesting

      Technically, a helmet would still be a 2D interface... Although accelerometers and such to keep track of head movement/orientation could make a reasonable approximation.

    13. Re:I love 3D by mhall119 · · Score: 2, Insightful

      It's a shame that nobody in Linux is doing something similar. It's an oportunity to take lead in the desktop.

      Sun's Project Looking Glass has been running on Linux for about 3 years now. The hard part is not the 3D effects, but coming up with a way of making it usable. If Apple has figured that part out, I expect it will be copied by everyone else in short order.

      --
      http://www.mhall119.com
  2. Wasn't MS Bob 3D already ? by mmu_man · · Score: 2, Funny
    1. Re:Wasn't MS Bob 3D already ? by Tjp($)pjT · · Score: 2, Interesting

      I preferred the hack Bubba. Reportedly put together in 1 day by some non-MS VB programmer. Versus a dev team at MSFT for a full dev cycle. Bob is long gone, but Bubba lives on. Apparently even working on Vista. And APPL had there 3D experiment back in the 90's as well. I spaced on the code-name for the public beta but maybe Tabasco. Although that was a internal printer project as well. And there was "Ark Interface" as well.

      --
      - Tjp

      I am in wallow with my inner money grubbing capitalistic pig. ... Oink!

  3. Guess they haven't heard of... by jvd · · Score: 3, Informative

    This clearly shows that the patent system is broken. Sun have been working on a 3D Desktop since the early 2000s.

    More info: http://www.sun.com/software/looking_glass/

    --
    Insanity: doing the same thing over and over again and expecting different results.
    1. Re:Guess they haven't heard of... by Tubal-Cain · · Score: 2, Insightful

      And we have had the Spinning Cube for a while now.

    2. Re:Guess they haven't heard of... by CajunArson · · Score: 4, Informative

      That's like saying that since cars have existed for over 100 years it is impossible to get a patent on a new development for a car.
      Looking at the claims, this patent is (unsurprisingly) not trying to claim the use of 3-D technology in a computer GUI. Instead, look at independent claim 1:

      1. A graphical user interface, comprising:a viewing surface;a back surface axially disposed from the viewing surface to define a depth;one or more side surfaces extending from the back surface to the viewing surface;a visualization object receptacle disposed on one or more of the side surfaces; and one or more visualization objects disposed within the visualization object receptacle, the one or more visualization objects corresponding to one or more system objects.

            The Apple application is for the use of a room-like setting where there is organization of visual elements along the "floor", "walls", and "ceiling" of the room. This is definitely different than looking glass, about the closest thing I've seen would be a demo from Qt on a Wolfenstein + desktop elements interface: see video here. However, it is unclear if the Wolfenstein demo actually anticipates the claims of this patent on two grounds: 1. the use of a static room could be different enough from the use of a maze, and the Wolfenstein demo does not stack & arrange elements like Apple is claiming) and 2. The Apple invention likely predates the WolfQt code.
          Additionally, as is often the case with Slashdot, the readers do not understand the difference between a granted patent and a patent application. This is ONLY an application, and as any patent practitioner knows, what you originally apply for is often much different than what you eventually get granted as a patent.

            Finally, before everyone in here panics that Linux will be illegal in 2 weeks or some other nonsense, just look at the subject matter that Apple is patenting: It's a stupid room with windows pasted on the wall! Who cares!! Even if Apple gets the patent, just don't go out and copy them and you'll be fine. The attitude of panic on here is actually indicative of a deeper fear. It's not that patents "stifle innovation", but instead that patents mean you can't just make a direct knock-off of some other UI which is what really freaks some people out.

      --
      AntiFA: An abbreviation for Anti First Amendment.
    3. Re:Guess they haven't heard of... by sammyF70 · · Score: 4, Insightful

      Why do people always concentrate on the compiz cube?

      Along with the windows opening/closing animations and the wobbly effect, the cube ranks among the most useless effects in Compiz (though I must admit I like the windows effects a lot somehow)

      Expo, fading, windows preview, all the magnifier and zoom functions, the shift switcher, along with the shelf functions are actually very useful (and productivity enhancing, once you get past the WOW effect), but somehow nobody ever talks about them. Hell ... even the water function is useful, as it can be used as a silent (and cool looking) system beep.

      Yes, they are also very pretty and geeky, but so what? just because something does look cool doesn't mean it's useless

      --
      "DRM is like the Ford Pinto: it's a smooth ride, right up the point at which it explodes and ruins your day."-C.Doctorow
  4. Procting for the future. by jellomizer · · Score: 2, Interesting

    This may not yield to a product. It is just a Patent. So if apple does come up with a 3D desktop no one else can sue them stating it is theirs. 3D computing has been in peoples imaginations for years. Remember Star Wars Ep. 4 back in the 1970's.
    We may get a real 3d interface in January but probably 5-10 years down the line as Human Interface interaction has gotten more advanced and intuitive vs. the old mouse method. Gestures, and better ways of tracking your hand have made 3d Manipulation more feasible.

    --
    If something is so important that you feel the need to post it on the internet... It probably isn't that important.
  5. Re:It's a unix system! I know this. by mrdoogee · · Score: 5, Funny

    Aww fond memories there. I remember back in 93 watching that movie with a few friends in a crowded theater and I believe it went down like this:
    Lex:It's a UNIX system! I know this!
    Me: NO ITS NOT!
    Usher: Please leave.

  6. Re:Soooo.... by TyFoN · · Score: 2, Informative

    Well at least there is a ton of prior art like compiz etc.
    I remember in the end of the 90's at an oil company i worked for,
    we had 3-4 SGI machines that used an array of projectors to create
    a 3d world for the engineers to explore the ground. You used a glove
    and cloud pull apart the different geological layers and pull down
    menus with your hand.
    The US patent system is def. screwed if they pass something like this.

  7. Re:It's a unix system! I know this. by xZgf6xHx2uhoAj9D · · Score: 5, Informative

    It was, actually. It was fsn running on Irix (one of the few times something computery wasn't mocked up).

  8. Prior art? by danhm · · Score: 2, Informative

    That sure sounds a lot like Sun's Project Looking Glass.

  9. Story about a Software Patent by Concern · · Score: 2, Interesting

    Am I crazy, or is this an unskeptical report of Apple attempting to get a software patent?

    Knowing Steve Jobs this is unlikely to be a defensive patent, either. He may actually expect to be able to sue people to stop writing software that seems like his software.

    How sleazy. How ridiculous.

    You cannot patent software. Period.

    People who pretend we can are con men and shakedown artists.

    I don't care if it's GIF compression or one click buying or a goddamned 4D desktop. It can not be patented.

    You only have one choice: have a software industry, or have software patents.

    The only reason we have anything like an industry now is that they are totally ignored and almost everyone is not attempting to enforce them. But this status quo means a goldmine for con men who do enforce them, and a hit on the economy, from all the victims, as well as those who are intimidated away from innovating or competing.

    --
    Tired of Political Trolls? Opt Out!
    1. Re:Story about a Software Patent by Ravon+Rodriguez · · Score: 2, Funny

      I don't care if it's GIF compression or one click buying or a goddamned 4D desktop. It can not be patented.

      I'm very interested in this 4D desktop you mention. A desktop that lets you operate in three dimensions and travel through time. Awesome!

      --
      Jesus loves me, he loves me a bunch, because he always puts Jiffy in my lunch.
  10. Jobs is not an inventor by hellfire · · Score: 5, Insightful

    Jobs is a marketer. What happens is a programmer gets a cool idea, writes a prototype, and sends it up to the execs for review along with a dozen other ideas. Then jobs gets baked, reads through proposals, sees the cool one and goes "OMG I can so sell that to millions of n00bs! A brilliant marketing plan for this just popped into my head! I will 0wnz j00r w0rldz with my reality distortion field muahahahahahahaha!!" Developers get paid, Jobs is triumphant, and the result is not perfect but pretty good, incredibly stylish, and everyone except the most die hard slashdotters and luddites will want one.

    --

    "All great wisdom is contained in .signature files"

  11. N-dimensions -1 by StikyPad · · Score: 3, Interesting

    Setting aside for a minute the fact that data storage is already a multidimensional representation on any modern computer..

    The most efficient way to manipulate that data is in a 2D matrix. That's because we can see all of it at once -- at least, as much as can fit on the display and/or our arc of vision. If we lived in 4 spatial dimensions, it would make sense to represent data in 3 dimensions, because we could see all 3 of them at once (assuming we had 4D sensory input.. whatever that might be). Creating a 3D representation of data might look cool, but it's just not efficient to work with for any amount of data beyond 2-3 items. See: Win-Tab in Vista, Stacks in OSX. It's not that we need better ideas for how to represent data in 3D, rather it's a physical limit that we need to accept and stop trying to do it "because we can."

    If you still don't buy that, imagine living in 2 dimensions (which is probably easier than imagining 4). We exist only on a plane, and objects can be represented only on the axises around us; nothing above or below, and we could only see the 180 degree arc from left to right. It would make no sense to represent data as more than a 1D line. Sure, we could send a line to the front or back, but working with a set of data would be most efficiently accomplished along that line.

    It's always more efficient to work with a set of data in 1 less dimension than you exist in. (Unless you live in 1D.. then I guess you're screwed.) There's a reason we don't use a 3D writing system. There's a reason we don't stack monitors one behind the next. Store it in 3 dimensions, fine, as a book, or as a stack of 2D windows, but use it in 2 dimensions. A 3D desktop is form over function in the worst sense.

  12. welcome to 1999 by logicassasin · · Score: 3, Interesting

    Back around 99, I remember installing a little OpenGL accellerated 3D desktop for Win98. At the time, I had an STB Permedia2 based card (full OpenGL ICD) and it was one of the very few cards that could run this "desktop" of sorts. Icons could be placed ANYWHERE in a 3D field and I could navigate 3D space around them. I could move through all three axis, rotate, do all kinds of things, even lose icons if I placed them in an area of 3D space too far away from the rest of the desktop stuff. It was neat for about 6 days, then I stopped using it.

    I'm sure I still have a copy of this in my CD graveyard. I'll look for it later and post up something when/if I find it.

    --
    Fifty watts per channel, baby cakes.
  13. Re:Settle Down by DittoBox · · Score: 3, Interesting

    I think more realism in metaphor implementation would definitely help people crossover to computers easier. File organization, menus and multiple windows are a tough one for most folks. Being able to understand how three dimensional physics affects pieces of paper (documents), photographs, application windows (needs a good metaphor that doesn't conflict with paper documents) and folders for keeping it all in will help a lot of people who can't grok it as is.

    A lot of people bitch and moan about "terrible eye-candy". It might slow you down some, but for a lot of people visual hints and metaphors are the only way to understand this stuff.

    Work in any kind of design field for a while and you start to appreciate how simple visual hints help or hinder people. Being able to intuitively grok the way anything from a toaster to a can opener to an operating system works without having to really think about it is a Good Thing.

    I agree though, you shouldn't be able to patent a metaphor, an algorithm or an analogy. It's just dumb.

    --
    Good. Cheap. Fast. Pick Two.
  14. Please, STFU if you have nothing useful to say by crmarvin42 · · Score: 4, Informative

    It is apparent that you have never actually bothered to use one of the touchpad's in question. The whole pad is one physical button. It can be configured to act as a single button like the one present on all Mac portables, or to behave like the mighty mouse where the Left and Right sides are treated like separate buttons.

    It's also obvious that if you've ever used an apple portable, you've never bothered to look at the preference pane for configuring the pointer (trackpad or mouse). Their is a checkbox present that says "Ignore accidental trackpad input" that works flawlessly. There is also a checkbox that says "Ignore trackpad when mouse is present"

    Please, if you've never actually used a piece of equipment, don't give your ignorant opinion on it. It'd be like me giving you my opinion of Halo 3. Never played the game so have no worth while input on the topic.

    --
    Bureaucracy expands to meet the needs of the expanding bureaucracy.-Oscar Wilde