XiP Filesystem Primps For Linux 2.6.28

nerdyH writes "The Linux-Embedded discussion list has been abuzz the last two days over a flash filesystem designed to support binary code execution (sometimes called XIP, or "execute-in-place"). When combined with forthcoming "Phase Change Memory" products from Intel/ST JV Numonyx, the "Advanced XiP Filesystem" (AXFS) could radically change Linux systems of all kinds, replacing Flash, hard drives, and even DRAM with a single chunk of low-cost, non-volatile memory that can both store files and serve as a platform for program execution."

Comments

Huh?

[samcan]

Didn't read the article...

So this acts as both memory and "hard drive?"

If true, would data read times be affected at all? I mean, if the operating system is simultaneously accessing a file, and using something in memory, would there be a performance hit?

Re:Huh?

[larry bagina]

the currently executing code will be moved into the processor's cache.

Re:Huh?

[42forty-two42]

This filesystem is meant for embedded devices with Flash storage that presents itself as a portion of physical memory - essentially, it helps the kernel avoid the overhead of copying from Flash to RAM when you can just run it out of Flash.
XiP has been supported in other filesystems, this is more like a small improvement - nothing to get excited about. Moreover, you won't see it in use in any desktops - this filesystem is read-only; more like an archive format understood by the kernel.
More useful discussion can be found at kerneltrap.

Re:Huh?

[harrkev]

I think that the concept is that you have a processor with a boat-load of some type of RAM-look-alike (presumably non-volatile). This RAM is used as a RAM-drive (well, if the RAM is non-volatile, then you loose no data). Imagine a linux-based PDA that does not have the usual RAM/FLASH combination, but instead has a few gig of RAM that keeps its memory when powered off. So, you use the same memory for both "main memory" applications (loading programs, stack, heap, etc.) and also holds a file system.

So, you run your favorite application, which gets loaded into main memory from the file system.

Wait... your file system is also main memory. So, your favorite application is now in memory twice -- once in the file system, and once in "main" executable memory. That seems like a waste. This project aims to use the "file system copy" as the executable. Pretty smart, but possibly difficult to get right.

Re:Huh?

[MBCook]

The idea is for embedded systems that don't have a hard drive. Right now, at least with a normal file system, you have to take the data from flash and copy it into RAM. Even if the flash is mapped into memory, you still have to do this.

Execute in Place means letting the processor read the code directly from the flash (when available) so you don't have to make the (rather pointless) copy in RAM. It obviously wouldn't work in some circumstances (self-modifying code being the obvious one) but it would save embedded system guys on RAM requirements.

Some things already support execute in place. The article says that CramFS supports a version, but it seems as if this version may be able to work on smaller chunks of memory (a page) at a time than the CramFS version (which seems to only work on a full file at a time?).

Of course, all this only works well if your flash is fast enough at reading. If it is relatively fast (compared to your CPU) so you're only waiting a few cycles (perhaps a small overhead compared to RAM) it would be useful. If it was very slow to read (100s more cycles than normal memory) it wouldn't do you much good.

I hope LWN writes an article about this. I'd love to know more.

Re:Huh?

[Sprite_tm]

If anything, CramFS is readonly (think iso9660). This filesystem seems to be read/write, so that, if anything, is a big improvement.

Re:Huh?

[Microlith]

AXFS is read-only. The usage case tends to go as follows:

- Build a compressed filesystem
- Run a test case, interacting with the filesystem to generate page hits on your binaries.
- Take the profile the filesystem generates and rebuild the filesystem.

The article says that CramFS supports a version, but it seems as if this version may be able to work on smaller chunks of memory (a page) at a time than the CramFS version (which seems to only work on a full file at a time?).

Precisely. CramFS works by setting the entirety of a file XIP if its sticky bit is set. AXFS runs based off a profile generated by the kernel when page faults are caused. Individual pages are then left uncompressed and executed directly from flash.

Re:Huh?

[Curtman]

then you loose no data

I like nice tight data myself.

Re:Huh?

[DrYak]

Imagine a linux-based PDA that does not have the usual RAM/FLASH combination, but instead has a few gig of RAM that keeps its memory when powered off.

You mean, like Palm was doing for most of it early years until recently (5.4), because some patent troll had control on PDA-using-flash and a non volatile file system ?

Yup this has already been done. The only differences are :
- The old Palm OS used read/write storage, whereas according to TFA this file system is read-only.
- The old Palm devices used plain simple DRAM, that was kept powered when the rest of the device was shut down, simply because then, there wasn't such a thing as non-volatile RAM in production (this also had the problem of losing the data once the battery is completely drained). Whereas TFA mentions using this new file system on all thoses new sexy *non-volatile* memory technologies like phase-change that are going to reach market anytime soon.

Re:Huh?

[drinkypoo]

Windows CE stores files in RAM, too. It segregates off a portion, though. I don't know if it's auto-tuning now, but it wasn't on WM2003. It's a horrible, horrible idea though, if you don't have to do it.

Performance

[Anonymous Coward]

And what would the performance hit be from running code outside of RAM?

Re:Performance

[norminator]

The idea is that this is the new RAM (fast and Random Access), but since it's non-volatile (and cheap?), it can also be used for file storage.

Re:Performance

[Anonymous Coward]

Not every computer is a gigahertz-class desktop.

aha

[extirpater]

my new choice for bootloader

So we're going back to the roots

[Fry-kun]

This upgrade brings the computer closer back to the Turing Machine :)

For people unfamiliar to XIP:

[Sprite_tm]

The idea of XiP is that if you have a piece of storage that's directly accessible as memory to the CPU (e.g. a piece of old-school ROM, NOR-flash, battery-backed RAM, or phase-change memory), the CPU can just execute a program directly from there instead of first copying it to RAM and executing it there. Storing programs in this memory so they can be executed is something that normal filesystems can't do per default, and that's why this is something interesting: You'll still need RAM for the data parts of the program, but the programs and libraries themselves can remain on disk without taking up precious RAM.

Re:For people unfamiliar to XIP:

[stoborrobots]

The thing I'm confused about is - how is this different from MMIO? Or is the new thing that we can do MMIO for programs when they're on flash?

Must be memory mapped

[GreyWolf3000]

The flash medium must be memory mapped for this to work. This means that nand flash is out without sitting behind some other logic to bridge the nand controller to the memory bus. Nand flash won't lend itself too well to this sort of behavior, though, since when code 'jumps' outside a page boundary there will be a bus stall until the next page gets read. Also, 'real programmers' modify the code during execution :P

Re:Must be memory mapped

[drinkypoo]

It could be handy on older systems, though; My IBM PC-1 had more memory on its 8 bit ISA bus than it did on the motherboard :) Just because it's on the bus doesn't necessarily mean it's slower than "main" memory.

Classic Palm OS

[argent]

It's block rather than record oriented, but this seems similar to how classic Palm OS worked. In the Handspring Visor, which had directly addressable flash memory, this was used to execute code directly out of flash.

Primps?

[NMBLNG]

At first I thought it said XiP Filesystem Pimps For Linux 2.6.28...

Read headline slowly

[unitron]

"XiP" looks entirely too much like "XP". They should have gone with something like "XNP".

Re:Read headline slowly

[Anonymous Coward]

Well, XIP as a TLA predates XP by a *long* time.

Re:Read headline slowly

[unitron]

Well, XIP as a TLA predates XP by a *long* time.

XIP, however, is not the same as XiP, although from across the room both probably look like XP.

Interesting question....

[allaunjsilverfox2]

As processor caches increase, could you use this to run the kernel from the processor caches? Intel based processor caches will soon exceed 6mb. Just a idea.

Re:Interesting question....

[kasperd]

As processor caches increase, could you use this to run the kernel from the processor caches?

That idea doesn't really have anything to do with XiP support in the file system. You could run the kernel directly from flash as well. And since that is probably simpler, I'd be surprised if that isn't already done. As for running everything from the CPU cache, that is not controlled by the kernel but rather by the CPU itself. And it will try to use the cache for the mostly used parts of memory regardless of whether it is kernel code or not. Of course since the CPU caches are constrained by the number of gates used as well as the number of nanoseconds used to make a decision, they obviously can't always use the caches optimally, but caching all of the kernel wouldn't be optimal either, since there are some rarely used code paths in the kernel.

nothing to see here

[QX-Mat]

unless you're an embedded dev, nothing to see, move along.

the slowest part of the intel cpu cycle is decode - but before your cpu processes streams of op codes for decode you have to load the executable image into ram and then run the dynamic linker. the dynamic linker needs to parse every the segment to be worthwhile, otherwise you'll hit the linker each time you load a segment that's slightly interesting (weaker the symbols/IAT, the more likely) only to find out you didn't need to causing jitter.

its one of those "ill believe it when i see it" performance gains

Matt

Re:nothing to see here

[vidarh]

Thats what prelinking or position independent code is for. Modern Linux distros have supported prelinking for a long time.

6mb? what the heck is a milli-bit?

[pbhj]

6mb? What the heck is a milli-bit?

Perhaps you meant 6Mb, so 0.000715255737 megabytes?

Or just maybe 6MB or 50 million bits.

Ooo, did I just invent a new type of /. nazism - the SI-Nazi??

Re:6mb? what the heck is a milli-bit?

[Ant P.]

To quote an excellent post I saw a few days ago;

people who insist on seeing only the "literal" meaning (a nebulous concept to anyone who has studied language from any perspective) are basically illiterate.

Re:6mb? what the heck is a milli-bit?

[pbhj]

Yes, I'm illiterate! Netcraft confirms it.

If the parent post had just used email-case (aka lowercase) throughout I wouldn't have bothered. But it seems perverse to go the trouble of using capitals at the start of your sentences, where they are largely redundant, and then use lowercase where it changes the meaning entirely.

Oh, and could you read the above back to me because I can't ;0)>

---
Yes, I'm a fan of run-on sentences.

This comment is not very well wrote.

[suck_burners_rice]

That would be really cool because it is currently a waste that programs need to take up twice as much "memory" as their actual size: Once for the amount it takes up on the hard drive (or flash or whatever) and once for the copy loaded into memory when you run the damn thing. It would be very, extremely cool if memory didn't wear out like flash currently does after so many writes and whatnot, and if it were plentiful and cheap, and execute-in-place and whatnot. This would actually be a bit more in line with how Joe Sixpacks view their computers. They'll have a billion gigs of free hard drive space and 640 bytes of available RAM (that's enough for anyone, isn't it?) and then a program says, "Out of memory" and they go, "Duh, what the hell? I got a billion gigs of free space!" Or another Joe Luser has a hard drive so full of pr0n that there's about three bits of available space (not even a whole byte) but he has ten gigs of RAM. So the damn thing says, "Device full" or whatever Windoze says when there ain't no more space, and he goes, "Duh, but I got ten gigs of memory!" If it were all one big huge string of memory like the way it was envisioned with Turing machines, then although computers wouldn't make one bit of sense more to these Sixpacks fellows than they do now, at least the terminology will be correct with respect to the whole memory thing.