Slashdot Mirror


NZX Moves To Oracle On Linux

sn00ker writes "In this story in The New Zealand Herald, we learn that the NZX stock exchange has moved their database systems to Oracle running on RedHat Linux, running on commodity Intel-based hardware. What's really impressive are the performance numbers they're claiming. Quoth the article, "One key query - searching the data on historical trades to identify maximum trade values - has been cut from 36 seconds to 0.03 seconds." An improvement of over 1000 times is spectacular in anybody's books, and is one hell of a boost for the proponents of Linux at the back-end of the financial world."

24 of 213 comments (clear)

  1. Linux? by Dr+Rick · · Score: 5, Insightful
    "An improvement of over 1000 times is spectacular in anybody's books, and is one hell of a boost for the proponents of Linux at the back-end of the financial world."

    Oh come on! They consolidated 21 databases and moved to Oracle. That's why it is 1000 times faster. The move to Linux is a footnote as far as the performance issue is concerned -- as stated in the article, the move to Linux was for cost. I'm sure Solaris or god help me, Windows Server 2003 would have given similar performance results. Now if they had moved to MySQL...

    --

    Dr. Rick
    - "It's such a fine line between clever and stupid" (Nigel Tufnel)
    - Zort! (Pinky)
    1. Re:Linux? by killjoe · · Score: 5, Insightful

      The article is a bit short on details. There is no mention of the previous hardware or software for example. Did they move from 21 SQL servers running on windows to 1 oracle running on linux? Maybe they just got rid of a bunch of aging unix machines and build a cluster of intel servers running linux.

      Either way though the fact that a major exchange is running linux is big news. Their database is their life and they are trusting it to linux. That says a lot.

      --
      evil is as evil does
    2. Re:Linux? by Anonymous Coward · · Score: 5, Insightful

      So perhaps it's time we coin a new term here. anti-FUD? I love Linux, but it's been obvious to me from the get go over four years ago now that pro-Linux articles and pro-Linux users sometimes stretch the truth or slightly warp reality to make it seam better than it is. There is no doubt...Linux is better than MS anything in my mind...but come on let's be realists and scientific here...not religious. Linux needs to win on factual merits...not more marketing gimicks that look a lot like those latest MS Office comercials that give it's users joy gasms.

    3. Re:Linux? by 0racle · · Score: 4, Insightful

      You could argue that Linux was a factor if it was a move from 2003 to Linux, though to back that up you'd have to show that Linux handles assloads of threads better then 2003 does. Solaris on the other hand does handle assloads of threads and then some just fine, its one of Solaris's selling points and as far as I know it does handle them better then Linux currently does. So they may have lost performance by choosing Linux over Solaris, but that was more then made up for in the consolidation.

      --
      "I use a Mac because I'm just better than you are."
    4. Re:Linux? by orthogonal · · Score: 4, Funny

      NZX stock exchange has moved their database systems to Oracle running on RedHat Linux,... and [this] is one hell of a boost for the proponents of Linux at the back-end of the financial world.

      It's great news that Larry Ellison has Open Sourced Oracle!

      And to think people criticize me for getting all my news from Slashdot.

    5. Re:Linux? by rodgerd · · Score: 4, Insightful

      While you're correct that the article conflates a bunch of work that happened, it's entirely possible that Linux was an enabler for this - for example, the cost per (unit of performance) of Solaris is still (IMO) fucking ridiculous at the lower and middle ranges compared to the cost of the same on Lintel.

      And while Windows Server 2k3 can run on the same cheap hardware, can you get a production quality release for AMD64 if you need gobs of RAM? What about the cost of multi-CPU licenses, and any client licenses needed? All money that buys you more power in the Linux world.

      It may well have been the case "well, with Linux, we can buy enough CPU, I/O, and DBA tuning time to make this thing sing. With Windows we blow money of software licenses. With Solaris we blow it on licenses and proprietary hardware."

    6. Re:Linux? by christophersaul · · Score: 4, Informative

      You don't need to buy licences for Solaris, it comes with the kit. If you mean proprietary in the sense that Sparc doesn't have the largest market share, then Sparc is proprietary - in the normal sense of the word it's a lot more open than Intel.

      Using an Oracle RAC cluster of Sun V440s would have actually been cheaper than clustering 4 way Dells - Sparc kit's a lot cheaper than it was. You'd also have had some decent 64bit capable boxes. Check out the TPC/E benchmarks - Sun boxes blow everyone else away in terms of price/performance on a real world database app.

    7. Re:Linux? by supersnail · · Score: 4, Insightful

      An inprovement of 1000 times might not be that sectacular, it depends what the system was replacing.

      Most likely it would be some unix hardware circa 1997. (say 4 x 200 Mhz Solaris, 512MB, with SCSII II disks, or, perhaps even a VAX complete with snails pace IO would be typical for that period in that environment). So a 2 x 3 gHz, 2 GB, with fibre channel ought to be faster. Plus it looks like they rewrote the whole system to take advantage of Oracle 10 features.

      What is perhaps more interesting for slashdot readers is that for most people working at the trading end of finacial services this is very much a non news story. The last two sites I worked at had implemented or were implementing Linux cluster server based systems, and, these were both for volume performance critical systems.

      --
      Old COBOL programmers never die. They just code in C.
  2. Always check your indexes by Anonymous Coward · · Score: 4, Funny

    Obviously a much-needed index was added during the migration...

  3. Slashdot: fair and balanced by Anonymous Coward · · Score: 5, Funny

    A 1000 fold improvement in performance, just by moving to linux. Incredible. Unbelievable even.

    Comon guys. What kind of idiots do you take us for?

  4. 1000x performance increases... by david_reese · · Score: 4, Insightful
    are NOT gotten by changing your OS.

    I'm no windows sympathizer, but in the world of enterprise software, only optimizations at the database layer (or reworking badly written networking layer) can yield those kind of results.

    Sounds like they data warehoused and redesigned the schema/indexes to better match usage.

    1. Re:1000x performance increases... by chegosaurus · · Score: 4, Funny

      > 1000x performance increases are NOT gotten by changing your OS.

      I beg to differ. I have many Slashdot posts from exceptionally informed sources stating that simply by using teh gentoo with -O6 and optimizing for j00r CPU such performance increases are easily obtainable.

  5. I like the quote by Anonymous Coward · · Score: 4, Funny
    I couldn't think of anything funny to say, so I'll just post the quote :)

    "We went for Linux, not just because we hated Microsoft, but because the cost was compelling," Phillips said.

    (Insert funny remark here because I'm unfunny)

  6. Ja, ja by trifakir · · Score: 5, Informative
    There are even more impressive results with Kdb by Kx Systems.

    Financial organizations are very conservative but even Deutsche Bank are migrating to Linux some of their less important processes.

    In all the cases the future of the financial industry is in cheap linux clusters.

  7. Re:1000 times faster? by mcrbids · · Score: 4, Insightful

    I'm inclined to think that having a request suddenly run 1000 times faster might be due to something a DBA has done, rather than a change of OS.

    Yeah. My call would be that they were operating an RAM-starved server. I've seen similar numbers doing basic PC upgrades!

    I remember on case (this was a few years ago) where somebody with a customer information database of about 400,000 records came to me because generating a list from a query would often take several minutes.

    They were using a Pentium-90 with 32 MB of RAM. I set them up with a (then) top-of-the-line PIII 600 with 256 MB RAM. Query time dropped to 1 second.

    No matter what O/S you run, you're going to get JACK for performance if your running your app in swap.

    --
    I have no problem with your religion until you decide it's reason to deprive others of the truth.
  8. Some kind of cluster by autopr0n · · Score: 4, Informative

    According to the artcle, they built a cluster using Oracle Real Application Cluster, (I guess Beowulf is just for toy apps :P) which allowed them to spread the core DB over multiple machines (!).

    --
    autopr0n is like, down and stuff.
    1. Re:Some kind of cluster by killjoe · · Score: 4, Insightful

      I know that. I read the article. The question is what they were using before that. If you are going to say something is 1000 times faster the least you could do is explain both your old setup and your new one.

      --
      evil is as evil does
    2. Re:Some kind of cluster by nametaken · · Score: 4, Funny

      Old System: 5 x Apple IIes 1 x Dumptruck full of floppies 3 x Teams of disk-swapping runners

  9. Impressive, but.. by nayigeta · · Score: 4, Insightful

    The improvement is impressive - but I would credit the overall architecture, rather than some single specific factors - like Oracle10g+Redhat or DBA or systems consolidation.

    I mean, every part of the architecture has its role.

    Some other contributing factors not mentioned, I suspect, would includes - focused performance requirements, specific purpose optimised query framework.

    Can someone point to some public material on the architecture? It would be a interesting read.

    --
    Sunset over the lake, cool mist over the bridge; A leave upon the ripples, the snow reflects its glow.
  10. Re:A pretty telling statement in there... by Soko · · Score: 5, Insightful

    I doubt they're your garden variety "OMG BillG iz teh debil" Loonix fanbois, friend.

    They are a serious enterprise, and there must be a reason something as provocative as " not just because we hated Microsoft" would come out in an interview.

    IOW - It's likley that Microsoft's products and/or policies have left a very, very bad impression with these people, and they're glad that they have a compeditor with which to smack Microsoft in the head with.

    Soko

    --
    "Depression is merely anger without enthusiasm." - Anonymous
  11. Linux at the back-end of the financial world." by elucubra · · Score: 5, Funny

    C'mon, it ain't nice to call NZ that!

  12. Not really by CaptainZapp · · Score: 4, Insightful
    An improvement of over 1000 times is spectacular in anybody's books, and is one hell of a boost for the proponents of Linux at the back-end of the financial world."

    Unless specifics about the query and the physical database model are comparable in both systems this isn't really impressive.

    Comparable - not equal - since each database engines optimizer has it's individual quirks and strength.

    Assuming that you have large joins on huge tables a couple of good indexes, which make the optimizer happy can reduce execution time from hours to seconds.

    Table scans are expensive in database speak.

    --
    ich bin der musikant

    mit taschenrechner in der hand

    kraftwerk

  13. 10^3 performance increase.. No big deal.... by aauu · · Score: 5, Interesting

    I have achieved increases of 10^4 and 10^6 in production systems by recoding a small critical part of an application (usually less than a page of code).

    Most of the time the problem is stupid code or operational ignorance. Rarely is hardware, O/S or data base software changes the sole or main solution in performance problems. Hardware is only a factor when the system is underspecified to save money.

    Given that they consolidated 21 databases into a single database the problem could simply have been network latency between separate physical servers.

    The simplest way to get performance problems is to test on developers personal machines with tiny test databases and implement without full scale testing.

    For those of you who wish to ensure that Microsoft SQL server is slow, invoke a user defined function as part of the where clause that the optimizer cannot recognize as a determinate function when joining two tables. This will ensure a nested loop join that will take an eternity.

    --
    When I was young, I had to rub sticks together to compute.
  14. Ya, pretty much by Sycraft-fu · · Score: 4, Informative

    I've discovered that Oracle is pretty much OS agnostic because it pretty much takes over the system it is installed on. That aside, when a server is pure anything, the OS really isn't relivant. When all it does is run one app, the performance is pretty much tied to that app. All modren OSes provide good disk, memory, network, etc services. Now you can argue specifics till you are blue in the face, but when running one app, it doesn't much matter.

    Where an OS can shine is if you are running lots of stuff (eg webserver, scripts, database server, media server all on one box) and espically when you are screwing around and hence likely to cause problems. However when you do a DB install and run nothing but that, the OS is just a helper. It talks to the hardware and provides some simple APIs. Which OS it is isn't of much consequence to performance.

    The cost thing makes me curious too. We tried Solaris on Linux. The DBA couldn't get it to work, and neither could I. Then I looked at the requirements. We are trying SUSE, since that was listed... Well, sorta. It didn't run on normal SUSE, just SUSE Enterprise Server. Likewise not RedHat, but RHEL, and also UnitedLinux. In otherwords, high dollar server Linuxes. Oracle tech support wouldn't even talk to us unless we used a supported OS. We ended up option for Windows XP Pro, since it was supported. As I said, OS didn't much matter, just that it ran Oracle.

    Now while I'm sure (or at least pretty sure) Oracle could be made to run on a non-enterprise Linux, what would be the point? They wouldn't support you and support is one of the big reasons to buy Oracle (not cheap in case you were wondering).