Slashdot Mirror


New X Proposal on Freedesktop.org

Bytal writes "Havoc Pennington (of Red Hat and GNOME fame) seems to have a very interesting entry in his blog on the development of a new extension to the venerable X server going on at freedesktop.org. More specifically it seems to provide for most things that people have clamoring for (alpha blending, flicker-free window compositing and switching, as well as even OpenGL integration) without altering the existing X protocol too much."

37 of 395 comments (clear)

  1. this sounds like a great idea by fizz · · Score: 4, Insightful

    its about time someone does some decent work on the actuyal framework of the xserver, because right now, most limitations are not due to the window manager, rather the server.

  2. FreeDesktop.org at SCALE 2x by irabinovitch · · Score: 5, Informative
    Seth Nickell will be speaking about the freedesktop.org project and his work with GNOME.org at the Southern California Linux Expo on November 22, 2003. SCALE 2003 will be held at the Los Angeles Convention Center. More information is available on their website at http://www.socallinuxexpo.org

    For a free exhibit hall pass use the promo code 'free'.
    For 50% off a full access pass use the code 'sctek'

  3. Mirror Early, Mirror Often by Scalli0n · · Score: 3, Informative

    For your enjoyment in case this server is /.'ed:

    2003-11-03: New X
    The freedesktop.org X hacking is low-profile unstableware at the moment, but one particular proposal interests me the most. Here is how I understand it, I'll probably get it wrong:

    The idea is to make the X server model-view. The server stores a tree of windows as it does now. However, unlike today, it keeps the full contents of each mapped window in memory at all times. For each window, the default view copies the window's contents over the contents of the parent window. This results in the same user-visible display you have today - but you could implement alpha blended windows by alpha compositing rather than copying each window into its parent, since we now have the parent window's contents.

    To this we add the ability for a "compositing manager" to replace the default view for a given window, using the aXe and XDamage extensions. The window manager might be the compositing manager for toplevel windows, for example.

    If a window has a compositing manager, it will not be composited into its parent automatically; the window is invisible until the compositing manager does something. An external compositing manager could emulate the default built-in compositing manager by using XCopyArea() (or alpha-aware equivalent) to copy windows into their parents.

    However, a more exciting compositing manager might apply embellishments/transformations to the window contents prior to drawing them, possibly drawing them using an API such as OpenGL. For example, you could add drop shadows. Or you could do effects similar to fast user switching or Expose. Or you could double-buffer the entire screen as a whole making workspace-switching, opaque resize, and other tasks flicker free. The compositing manager is rendering a scene in which the window contents are one element, so the possibilities are endless.

    Note that the window contents stay entirely on the server side, the compositing manager uses regular X protocol requests to manipulate them.

    Apps other than the single compositing manager can also use the damage extension; possible applications include VNC (desktop sharing), magnifiers, pagers with thumbnailing, and so forth. The compositing manager is a special kind of view in that it disables the default paint of the window to its parent, and is thus responsible for replacing that default paint. But there can be any number of extra views of a window.

    There are a lot of little complexities and open questions here, but the idea is pretty interesting. I'm waiting for something I can try out to appear in jhbuild so I can make metacity super-leet.

    --
    Sig & Below
    Yuck Fou
  4. without altering existing X protocol "too much"? by lplatypus · · Score: 3, Interesting

    How much is "not too much"? Any modification may be enough to break an existing X application. So what will it break?

    Thankfully most of my favourite X applications are open source and actively maintained, so if this takes off I suppose they will be fixed if necessary (or at least fixable). An exception to this would be the old Loki games, which are neither open source nor maintained. I suppose this demonstrates one reason why closed source is bad...

  5. cool, now give me media pipes by ikoleverhate · · Score: 4, Insightful

    cool! decent opengl integration will make all those little flashy transitons and funny shaped windows that mac users have a snap to implement! x finally becomes less about boring rectangles, and becomes truly fun to hack ;) Lets hope this gets support from enough different groups to make it a standard. And then we can start hoping for something similar to the venerable pipe, but allowing easy use for graphical / media components! (ok i'll go back to dreaming)

    1. Re:cool, now give me media pipes by julesh · · Score: 4, Insightful

      X already supports funny shaped windows. Have you never run xeyes?

      The only problem with it is that almost all toolkits other than Xlib don't actually support it, so you have to hack around at a low level to use it, but its there, and if toolkit implementors bothered, it would probably become easy to use, too :-)

      And then we can start hoping for something similar to the venerable pipe, but allowing easy use for graphical / media components!

      You mean some kind of graphical pipeline, where one application transforms the graphical output of another one, and so on? There are graphic libraries available today that allow this kind of operation, but generally they don't operate well with GUIs (i.e. they run with one window that all of their output goes to). My only question is: what would you do with it? I can see that an ability to shrink or enlarge a window might be handy, but that's a much simpler task than the possibilities of what you're suggesting allow for...

  6. Re:without altering existing X protocol "too much" by Short+Circuit · · Score: 3, Insightful

    Assuming xlib isn't statically linked, I don't think there'll be too much of a problem. I'd even venture a guess that simpler applications wouldn't be affected at all.

  7. How about high-DPI monitor support? by swordboy · · Score: 4, Interesting

    We returned a new 19" monitor the other day because it was native 1600x1200. The text was unreadable at that resolution and lower resolutions simply looked like crap. We replaced it with a 1280x1024 bit but that is still on the small side.

    The last time that this was brought up on slashdot, most of the arrogant jerks tried to point out that you can "simply adjust the font size in the control panel". This doesn't work for anyone who has tried it.

    Longhorn will take a big step forward in this area. They will be rendering the window system and applying it as a texture so that the DPI of the monitor is irrelevant. X will be light years behind if it doesn't do this first.

    --

    Life is the leading cause of death in America.
    1. Re:How about high-DPI monitor support? by Anonymous Coward · · Score: 4, Informative

      Sorry mate, you're wrong. When I change resolution with my XFree86 the fonts stay the same size. The font sizes are calculated based on the dimensions of the monitor. If your fonts were unreadable you had configured something wrong (your distro had configured something wrong, whatever). In this case Windows has been light years behind X for a long time.

      However widgets etc. are not generally vector based and thus can look tiny (esp. @ 1600x1200), in this region Longhorn could jump ahead of most free software you use with X. However, all this needs is the toolkit people (GTK, Qt, etc.) to make their toolkits vector based and this will cease to be a problem.

      I don't think you deserved your mod points personally.

    2. Re:How about high-DPI monitor support? by spydir31 · · Score: 4, Informative
      Try this on,
      If using gdm, open /etc/X11/gdm/gdm.conf with your favorite editor, find the following,
      command=/usr/X11R6/bin/X
      append -dpi 100 or whichever you prefer.
      HTH
    3. Re:How about high-DPI monitor support? by julesh · · Score: 4, Informative

      Its a reference to the fact that the bitmapped fonts are only available in those resolutions and might have to be scaled for other ones. Chances are, you aren't actually using any bitmapped fonts any more (most modern apps don't bother, the only one I ever use that does is xterm), so it shouldn't actually affect you. Give it a go and see.

    4. Re:How about high-DPI monitor support? by cymen · · Score: 4, Funny

      The obvious solution to your problem is to buy 200-300 19" "monitors" (we're actually talking about LCDs, right?) and donate one or two to any X hacker you can find. Your problem should be documented with numerous workarounds and possibly fixes within a couple months.

    5. Re:How about high-DPI monitor support? by 4of12 · · Score: 3, Interesting

      all this needs is the toolkit people (GTK, Qt, etc.) to make their toolkits vector based

      IIRC, SVG icons are starting to be supported by both KDE and Gnome.

      More SVG applications and more capable SVG authoring tools could be a really great impetus for migrating X away from the bitmap-centric universe.

      --
      "Provided by the management for your protection."
  8. Good idea, but not new by Chris_Jefferson · · Score: 5, Insightful

    The main principle here seems simply to be for the X-server to store each window, wether it be visable or not. At the moment if you stack windows on top of each other the X-server forgets what is on the covered up bits, and when the window becomes visable again it is redrawn. This was a good idea back when memory was scarce, because storing X full screen applications could take X*screensize memory. However today with more memory, we can store all those windows without forcing a redraw.

    This is long overdue in X, and also as stated makes things like alpha blending, and Mac OS-X style openGL window-dragging acceleration much more trivial, and also for those who like network transparency, won't require resending windows each time they become visable (although adds the new problem that unless you are careful you could end up spending lots of time sending updates to non-visable windows). It is of course nessasary to allow some chucking of hidden windows (because full screen 32-bit images still take up quite a lot of room), but overall its a good plan!

    --
    Combination - fun iPhone puzzling
    1. Re:Good idea, but not new by Anonymous Coward · · Score: 5, Informative
      This is long overdue in X

      Uh, this idea is called "backing store" and it's been around since, I believe, X11R4. I'm not sure what this proposal does that's new, other than offer new uses for it.

      Given the current bloat of GTK and Gnome when trying to run remotely (even over 100Mbit), backing store is a good thing. When an application lets you turn it on. Which GTK doesn't. Heck, I've even seen a GTK developer claim "X doesn't have any backing store concept." Geez, people, learn your existing technology!

    2. Re:Good idea, but not new by otaylor · · Score: 5, Informative

      Likely the GTK+ developer was me. I certainly didn't say that X has no concept of backing store. I may well have indicated that the current X implementation of backing store quite typically does more harm than good. For instance, under some circumstances, X will store arbitrarily large amounts of pixel data *outside* of the windows bounds in the windows backing store. (Having traced through the X server code to figure out why this was happening some years ago, I can authoritatively say that X does have a concept of backing store.)

      Keith's new extension is quite different from traditional X backing store; the obvious difference is the ability to control how the windows are composited to the screen. But there are other differences; the server, for instance, uses only a single backing store buffer for the entire toplevel window, instead of one for each subwindow.

  9. Discussion summary by binux · · Score: 4, Insightful

    Let's summarize the discussion that this is going to trigger:
    Whine 1: X is slow and bloated we need a replacement.
    Response 1: The XFree86 implementation may be slow and bloated and not the protocol.
    Response 2: Come up with something better and we'll talk.
    Whine 2: Who uses the remote display capability of X anyway?
    Response 1: On local displays X uses shared memory and is fast enough.
    Response 2: If 5% of the users need the feature it should be retained.

  10. This would be cool... by Realistic_Dragon · · Score: 3, Interesting

    It's really important for me to be able to get to my PC from the lab (as I am doing now) and run all my apps (thank god for switched networks and gigabit ethernet - I'm using 1100k/sec at present, it used to only be possible to use 16 colour mode 800x600 VNC because of network congestion, now 24 bit desktops forwarded over SSH is fine). As such the biggest reason I wouldn't consider jumping to Apple is the fact that on Linux X 'just works' in a networked environment. I can browse local and remote filesystems with no pain at all, and it's very responsive.

    If X is going to get the ability to do OS X's flash graphical tricks (the useful ones at least - functionality before form please) then this will make my desktop experience much more plesant, whilst still giving me a stable and predictable environment wherever I happen to be working. Even if the flash tricks are only available locally (at least until the college upgrades to terrabit ethernet...) it'll still be a pretty big bonus.

    --
    Beep beep.
  11. Extra Memory Usage by mickwd · · Score: 5, Informative

    "The server stores a tree of windows as it does now. However, unlike today, it keeps the full contents of each mapped window in memory at all times."

    What are the memory implications of this ?

    With many people using resolutions of 1280x1024 or 1600x1200 in 24-bit or 32-bit colour, dual-displays and multiple desktops becoming more common, this could chew up a lot of RAM.

    A single, maximised window at 1600x1200/32-bit is going to use 7.5MB, even if it's just a terminal window. I can quite easily have 10 windows open at one time, especially when web browsing (OK, not all maximised, but not all small, either). There goes 75MB of RAM, just for the screen display (let alone the extra memory X uses for pixmaps, etc). If it's constantly being accessed in order to update the display, it won't be easily paged out to disk, either.

    Things like tabbed browsers and terminal programs help quite a bit (assuming that the contents of each tab won't be stored in RAM - or will they ?). But not everyone likes using them.

    Would someone with more knowledge about the current workings of X care to comment ?

    1. Re:Extra Memory Usage by Erik+Hensema · · Score: 3, Informative

      The server can simply store the information in the video RAM, where it belongs. As long as the data fits in video mem, it won't cost you any main memory.

      --

      This is your sig. There are thousands more, but this one is yours.

    2. Re:Extra Memory Usage by mickwd · · Score: 3, Interesting

      Yes, but how fast can data be read back from video RAM to the processor ? I'm sure some visual effects can be processed by the card itself, but the main processor is also going to need speedy access to that data.

      In my (perhaps a little contrived) example, I was using over 64MB of video RAM. I'm sure the majority of people are still using graphics cards with 64MB or less of memory (hard-core gamers being an obvious exception).

      Actually, that brings up another question. What does X already support by way of backing-store and save-under memory ? (Excuse me, my memory of X operation is very hazy).

    3. Re:Extra Memory Usage by IamTheRealMike · · Score: 5, Informative
      I am not an expert but I'll answer as well as I can.

      What are the memory implications of this ?

      The reason keithp is going to be buffering each node in the window tree is for memory reasons - buffering entire toplevel windows is far too expensive. It involves two extensions, aXe and XDAMAGE to work correctly. I believe XDAMAGE is partly useful for reducing the work needed to implement eyecandy effects, but it's all new to me too so I'm prolly wrong.

      Secondly, MacOS X gets around the memory requirements partly through heavy use of video RAM and partly through compressing and decompressing toplevel windows on the fly (as far as I know). I wouldn't be surprised if the new X team take a similar route.

      Finally, I don't think OpenGL will feature in this. OpenGL is a neat 3D API but not so great at 2D work - we seem to be heading towards using XRender as our low-level 2D API with Cairo providing a Quartz style drawing system on top. That doesn't imply speed loss - both OpenGL and XRender are abstractions over the hardware acceleration engines of the card, so there's no reason why XRender based apps could not get the sort of speeds we associate with 3D HW accel (even if today it doesn't reach those speeds). The advantage of going the Xrender route is that it's much easier to mix and match the old style and new style rendering (note how OpenGL requires you to set it up for a particular rect but XRender can just be used as a standard drawing op).

      Like I said, no expert, keithp is the canonical source for this, but that's what I've gathered from reading and listening.

    4. Re:Extra Memory Usage by cK-Gunslinger · · Score: 3, Insightful

      Do you expect your grandma to open her box and install a new graphics card?

      No more than I would expect my grandma to update her X Windows library to incorporate new buffering extensions.

  12. Aqua has this (Display-PDF)! by null-und-eins · · Score: 3, Interesting

    Aqua is based on Display-PDF and is resolution independent. That was a really smart move by Apple because resolution is only going up. Even if there were small problems with resolution being to low on laptops (don't think so) this will go away in the future. All bitmap-oriented window systems will suffer from this design decision increasingly.

    --
    At the beginning was at.
  13. Ill advised by amightywind · · Score: 3, Insightful

    This seems to be a band aid solution and complex as well. With OpenGL being so prevalent why not create an X replacement entirely upon it?

    --
    an ill wind that blows no good
  14. Is there a new X logo out as well? by Zanthany · · Score: 5, Funny

    I seem to be seeing a new X logo as well from the slashdot page:

    slashdot.jpg

    It's so simple and plain. It just might work!

  15. Re:without altering existing X protocol "too much" by dmiller · · Score: 4, Informative

    Fortunately the X protocol can be extended without being replaced. OpenGL (GLX actually), Xrender, XVideo and the XSHM (the shared memory extension) are all examples of extensions that have been added without breaking old apps. Parts of X may be crusty, but overall it is pretty well designed.

    XFree86 has done even better than not breaking the protocol. IIRC they have been *binary* compatible for Xlib for over 4 years.

  16. Clarifying Vector-based display by MarcQuadra · · Score: 4, Informative

    You don't seem to understand the problem the way it was meant. I have a big monitor, I like to run at high resolution, but text is TINY, so I make the fonts bigger, but then everything is out-of-whack in terms of widget sizes and images.

    What we're talking about is a VECTOR-based display, so 'increasing the size' won't make it any less readable. In a vector-based system EVERYTHING gets scaled up, you could run the big monitor at 1600x1200 or 512x384 and the elements on the screen would be the same actual size (meaured by a ruler) but the higher-res monitor would just look a hell of a lot better.

    Now there ARE some issues that need to get worked out for this, a web browser, for example has to be prepared to have a bitmap GIF 'blown up', and it has to be done well enough to look decent but not take too much CPU power.

    NEXT had this, Aqua has the underpinning of it, I think GNUStep is coming along with it, Longhorn is going to have it. I don't see the XFree86 folks picking this up, I think the toolkit folks and KDE/GNOME will have to implement it themselves because the XFree folks are really conservative.

    --
    "Sometimes, I think Trent just needs a cup of hot chocolate and a blankie." -Tori Amos on Nine Inch Nails
  17. Integrated Audio. by Robert+Frazier · · Score: 3, Interesting

    What would be really nice is if we could have X11 with integrated audio. There are lots of ways of streaming audio, etc., but that is different.

    What I want is that when I log into a remote X11 box using xdm the audio is sent to the local X11 server, just as the video now is. All the processing would be done remotely, and just the video/audio rendering for local hardware would be handled locally.

    Best wishes,
    Bob

  18. Re:I don't understand the fascination with X by fault0 · · Score: 3, Interesting

    Every X replacement for UNIX has pretty much failed. FAILED. failed.

    Why? There is a huge investment in XFree86 in things like drivers. It would take *ages* to implement all of that again.

    X was made to be very small, clean, and extensible. It still is today.

  19. 15" laptop with 1600x1200... by tjwhaynes · · Score: 3, Informative

    My experience of running X on 1152x900 on a 17" monitor suggests that this is an appropriate resolution that doesn't cause too much issue; 1280x1024 should be more than fine.

    I've driven 17" at 1280x1024, and depending on your applications everything works OK. X is a lot more customisable than MS Windows: you can actually change almost any screen font in use in most situations.

    I run an IBM Thinkpad with a 15" screen at 1600x1200. In X Windows, I use the Xft2 font renderer, rather than the old core X font system, for almost every text string I see. Because I have also set the DPI for the screen to 133dpi, everything remains clear and readable and the fonts are all the correct size. So if the original parent poster was struggling with a 19" screen at this res, they should learn to configure their systems better.

    The biggest problem I have with high DPI displays is viewing web sites, which will need browser technology to change in order to be useful.

    Mozilla provides two useful functions at the moment, and there is another one almost there. Minimum text size is useful to stop the worst excesses of tiny fonts. Text zoom is an essential function on bad websites. Image zoom would be nice, especially if it simply runs in step with text zoom. Some tweaks would then be necessary to stop pages being limited to the 800 pixel width that some designers have decided is the perfect form factor.

    SVG also offers improvements for high dpi screens. I look forward to the day that Moz/SVG takes over the web browsing domination and web designers really push vector graphics out there.

    Cheers,

    Toby Haynes

    --
    Anything I post is strictly my own thoughts and doesn't necessarily have anything to do with the opinions of IBM.
  20. Backing store? by 10Ghz · · Score: 4, Informative

    How is this different from backing store?

    --
    Lesbian Nazi Hookers Abducted by UFOs and Forced Into Weight Loss Programs - -all next week on Town Talk.
  21. All I ever wanted from Xwindows... by zerocool^ · · Score: 4, Insightful

    ...was to be able to cut and paste between applications. A unified API for a clipboard system that uses a unified set of keys to cut and paste.

    Alpha blending should be miles and miles behind the development of a window system that actually works.

    But, this looks to be more typical X development. No brake pedal, but you can shift gears via the steering wheel, the stereo, or a series of buttons on the sunroof; it has 539 airbags, each requiring a different pressure to go off, and there's a seatbelt interface for every previous seatbelt in existance. Plus it has the most efficient 46 horse power engine ever made, even though opening the glove compartment causes it to stall, or at least backfire.

    ~Wx

    --
    sig?
    1. Re:All I ever wanted from Xwindows... by _Sprocket_ · · Score: 4, Interesting

      ...it confuses select with cut-and-paste...


      I have two main workstations that I use daily - my Linux desktop (currently running KDE) and my Windows 2K desktop. I am often having to retrace my steps while on my Win2K box because I try to paste some text and discover that I've forgotten to hit ctrl-c before moving to the next window. I've become used to copying text while selecting it (its not "cut-and-paste" by the way).

      Its all dependant on what you're used to. And I have found myself going to some lengths to get my Windows machine to act more like my Linux environment.
    2. Re:All I ever wanted from Xwindows... by tuffy · · Score: 4, Informative
      I love X... but I have to admit that you've hit the nail on the head. It's astonishing how bad cut and paste works between applications. It really only works for text, and then only if the text is flat ASCII. Because it's so bad, many applications have their own, internal version of the clipboard, and you're never really sure whether you're manipulating X's clipboard or the internal clipboard, or what information makes it onto X's clipboard and in what form. It's a total disaster.

      The X11 clipboard is already quite powerful and supports a broad array of selection types, not just ASCII. A lot of apps only support ASCII, but that's not X11's problem. If any toolkit or app is reinventing the wheel by implementing a whole new clipboard, that really is quite brain-damaged.

      --

      Ita erat quando hic adveni.

    3. Re:All I ever wanted from Xwindows... by ParisTG · · Score: 3, Informative

      Luckily the clipboard problems are simply a lack of standardization between applications. The freedesktop.org people are working on a spec to fix this, and already (afaik) most of KDE and GNOME apps, among others, follow the spec. It's only a matter of time now.

    4. Re:All I ever wanted from Xwindows... by Minna+Kirai · · Score: 3, Informative

      A lot of apps only support ASCII, but that's not X11's problem.

      Almost any shortcoming in X11 can be fended off by saying "That's not an X11 problem, it's outside the scope of the design". That's not a valid defense. Complaints like that are a sign that although the design may have been implemented acceptably, the design itself is flawed; the scope was too narrow to account for what's needed by a GUI system.

      The practical proof of the quality of an arch is the applications that run on it. And practically, non-ASCII clipboard contents in X11 suck. I've just pulled several major desktop apps off Debian Linux and tested their clipboard compatibility.

      You can't paste spreadsheet rows between OpenOffice and Gnumeric. You can't copy an image from Gimp and paste it into OpenOffice, Abiword, Kword, or Gnumeric. (Of those 3, only Gnumeric will recognize that the clipboard has anything in it, but it reads it as ASCII junk). An image will copy from Kword to Kword, but not into Gimp, OpenOffice, or Abiword. For every pair of apps I've tried in the past 10 minutes, none could paste an image between each other. Even copying a picture from Kword to Kspread doesn't work! (You'd think that those applications were written by the same team, and would share clipboard protocols)

      The only successful copying of images between different applications that I discovered was, rather bizarrely, from Mozilla into OpenOffice. That one surprised me. (Mozilla to Kword does nothing. Mozilla to Abiword crashes)