Slashdot Mirror


PostgreSQL Inc. Open Sources Replication Solution

Martin Marvinski writes "PostgreSQL Inc, the commercial company providing replication software and support for PostgreSQL, open sourced their eRServer replication product. This makes PostgreSQL one step closer to being able to replace Oracle as the de facto RDBMS standard. More information can be found on PostgreSQL's website."

31 of 383 comments (clear)

  1. The defacto standard by jon323456 · · Score: 5, Insightful

    There is an enormous distance between "viable alternative" and "defacto standard" and the path between them is not paved with features.

    1. Re:The defacto standard by timbloid · · Score: 5, Insightful

      Very true...

      I have had experience with both Oracle and Postgres, and I would never go back to Oracle...

      Maybe I was not using all of it's "Enterprise features", but I find Postgres to be fast, and reliable... Plus I am not constantly bombarded with Oracle spam, like I was when I registered for an oracle devnet account...

    2. Re:The defacto standard by sporty · · Score: 4, Informative

      Yeah, but there are irritants to postgres as well.

      No source code packages. You can't create a library, like you would in oracle.

      When you have an sql error, it tells you the char it occured at, and not much more. Quite annoying if oyu miss a , in a multiline query and have to paste it back.

      You can't network two instances so to speak. You can't say.. "select * from slashdot.messages, freshmeat.list where..." Bloody useful for running remote queries over a dedicated line, w/o dump-replicationg stuff.

      Not easy to see, verbatim, what queries are running. Well, nothing i've seen so far. :\

      But you know what, I use it, and I like it. 'cuz it doesn't require a java installer and it is simple. But it doesn't hold a light to oracle in some ways :)

      --

      -
      ping -f 255.255.255.255 # if only

    3. Re:The defacto standard by mrroach · · Score: 5, Informative

      Not easy to see, verbatim, what queries are running. Well, nothing i've seen so far. :\

      Try adding
      stats_command_string = true to your postgresql.conf

      then, "select * from pg_stat_activity" for a list of users pids and queries

      -Mark

    4. Re:The defacto standard by rtaylor · · Score: 4, Informative

      I've got good news... PostgreSQL 7.4 beta 2 will reclaim index space and has a vacuum daemon in /contrib (preparation for a built in daemon).

      Oracle runs vacuum as well -- it just has a different name. It's what the undo / redo logs are for, to allow MVCC while maintaining an overwriting storage manager.

      --
      Rod Taylor
  2. Good Thing(tm) by mr_stark · · Score: 4, Interesting

    While this is a good thing, pseduo replication is possible at the application layer. Think using PHP to squirt a table in one DB into anther one.

    Now that Postgress can replicate at DB level other, more interesting things are possible. You can use replication for both failover and performance clustering.

    --
    I can't think of anything witty right now
    1. Re:Good Thing(tm) by msgmonkey · · Score: 5, Insightful

      Implementing replication at the application layer is about as much fun as implementing table locking at that layer.

    2. Re:Good Thing(tm) by TechnoVooDooDaddy · · Score: 5, Informative

      clearly the poster does not understand the intricacies of replication in a real-time environment.

      you can not pull the data out of table and stuff it into another table under even a reasonable workload.

      but i understand this is slashdot and technical relevance need not necessarily apply.

  3. mySQL gets more publicity by Anonymous Coward · · Score: 5, Interesting

    Check monster.com. More companies look for people with mySQL experiences. Check the book stores. You will see more books about mySQL. Even though PostgreSQL has more features and is more promising and powerful, mySQL gets more publicity. This means that mySQL will be the open source database that will replace most commercial databases. It's sad but true.

  4. Re:Postgre sucks! by delta407 · · Score: 5, Interesting
    Troll, but I'll bite.

    it doesn't support transactions
    Ever heard of InnoDB? MySQL lets you choose -- on a table-by-table basis -- exactly what parts of your application need to support transactions, foreign keys, etc.
    corrupts at every chance
    Odd, neither Slashdot nor Yahoo! Finance seem to be having corruption problems...
    is not scalable
    Adding extra memory, CPUs, or slave servers obviously has no impact on server performance. (Yes, replication is... clumsy, at best, but depending on the application, it can work quite well.)
    a resource hog
    Compared to Postgres?
  5. Re:Excellent by ShieldW0lf · · Score: 4, Informative

    I've been waiting anxiously for this. Postgres will definately be running my startup now... lack of replication was the only thing holding Postgres back. Wonder how long it will take for this to migrate to debs stable branch...

    --
    -1 Uncomfortable Truth
  6. Re:WOOHOO!! by timbloid · · Score: 5, Insightful

    You would still have to pay boatloads for support...even with postgres... Open Source does not mean 24/7 Support calls...

  7. PostgreSQL fanboy by realnowhereman · · Score: 5, Informative

    I can't say a bad thing about postgresql; this was really the only thing I felt the need for. For anyone who hasn't tried it you really should. Although I don't want to start a MySQL v postgresql flamewar, after trying both I think that postgres has the edge. Mysql was undisputably easier to work with and (at the time) was faster. PostgreSQL has moved on at a much faster rate though. In particular postgresql has solid support for transactions, large objects, subselects, object oriented tables. I'm convinced that if you use databases long enough you'll want every last one of these and won't be able to do without.

    --
    Carpe Daemon
    1. Re:PostgreSQL fanboy by TheRaven64 · · Score: 5, Funny
      I don't want to start a MySQL v postgresql flamewar

      Awww. Go one, you know you want to really. Here, I'll help get the ball rolling:

      I've only every tried MySQL once, and that was for a database course assigment. It didn't have the features required for Question 1, so I switched to PostgreSQL. From this I deduce that MySQL is crap.

      There. That wasn't hard, was it? All that is required is a strongly stated, yet uninformed, opinion about either. Now we just need some other contributors...

      --
      I am TheRaven on Soylent News
  8. eRServer and PG Replicator by juahonen · · Score: 5, Interesting

    This is indeed good news, as free software always is. But eRServer can only operate in single-master mode, which makes it unsuitable for high-availability kind of work. Single-master systems are good for load-balancing on installations where most of the queries to the DB are SELECTs.

    eRServer comes a bit late. We already have PostgreSQL Replicator, which is multi-master. Unfortunately PG Replicator is not supported anymore. The latest version it can work with is 7.1, and the project's latest news are timestamped nearly two years ago.

  9. plPHP by jdh-22 · · Score: 4, Informative

    They also have been working on a procedual language for PostgreSQL for server side triggers, and functions. Information can be found here, plPHP.

    PostgreSQL has made some pretty nice advancements post version 7+, performance and feature wise. I worked on a intranet where the company spent lots of money trying to get an Oracle solution to work, but found it was way to slow. The suggestion of PostgreSQL, and MS SQL came up. We tested PostgreSQL, and it was acutually faster, and easier to maintain then our Oracle database. The best part was, it was free!

    --
    Every Super Villan uses Linux.
  10. Re:Postgre sucks! by DAldredge · · Score: 4, Informative

    InnoDB Hot Backup is a tool which allows you to backup a running InnoDB database without setting any locks or disturbing normal database processing. You get a consistent copy of your database, as if the copy were taken at a precise point in time. InnoDB Hot Backup is also the ideal method of setting up new slaves if you use the MySQL replication on InnoDB tables.

    For how many server computers you want to order an evaluation copy, or 1-year licenses (390 euros or 450 US dollars each), or perpetual licenses (990 euros or 1150 US dollars each); discounts are available for large volume orders.

    This is from http://www.innodb.com/hotbackup.html

  11. Synchronous Replication? by Anonymous Coward · · Score: 5, Insightful

    While this is a nice step forward, the real reason large sites utilize Oracle is because of synchronous replication.

    The replication needs to be able to keep all data consistent across multiple servers, without any conflicts. Then, if a particular server goes down, the DNS can simply fail over to a second server.

    Once the above has been achieved, then we have a viable alternative to Oracle.

  12. OOS vs. Oracle by Baavgai · · Score: 5, Informative

    > This makes PostgreSQL one step closer to being able to replace Oracle...

    Please! While this may help win the hearts and minds of OOS geeks, it does little to improve their standing in the business world.

    Oracle is as established in the database world as Microsoft is on the desktop. This alone would doom any OOS wannabe to quiet places like web server back ends where they already do well anyway ( e.g. mySql ).

    Put aside the technical considerations, support, client base, etc and PostgreSQL still offers as much of a threat to Oracle as mySql or dBase. The only real threat I've seen to Oracle supremacy is Microsoft's SQL Server but, of course, that's only in MS shops.

    1. Re:OOS vs. Oracle by rcs1000 · · Score: 4, Insightful

      PostgreSQL and mySQL are real, undeniable threats to Oracle. Not threats in the sense that Oracle's business will disappear, or that either of these databases will become de facto standards, but threats in that they will indisputably affect Oracle's ability to grow its database revenues.

      My forecast, for what it's worth, is that Oracle's database business is in secular decline.

      It doesn't matter that mySQL or PostgreSQL can't do everything that Oracle 9i does. That they do some of it, do it better and do it cheaper is what is key.

      Five years ago, if you wanted to build a web-based application of any size, you probably went with Oracle. Now there is a free option. At the very least corporate purchasers will use this as a way to extract price concessions from their Oracle salesperson. More likely, in a few places (at first) PostgreSQL and mySQL will work their way into the corporate psyche by being used. Maybe for internal stuff, where budgets are tight. Or where projects are being "hidden" from management. But slowly, open source databases are taking hold.

      The next stage is for the enterprise application vendors (SAP, PeopleSoft, Siebel) to start supporting OSS databases. They'll want to, because it lowers the cost of projects to clients, while safeguarding their (falling) application license revenues. Hence, SAP "donating" SAP DB to mySQL. My forecast (number two) is that we'll see all three of the application vendors at least trialling OSS databases with beta customers by end '03. (Yes, I know SAP is already doing it, and that PeopleSoft has issued press releases but no product.)

      And in this way, in the same way Linux slipped quietly into corporates, OSS databases will take off.

      My only hope is that PostgreSQL, which is a much superior product to mySQL, will get the publicity it richly deserves.

      *r

      --
      --- My dad's political betting
  13. Is this only a partial solution? by MarkSwanson · · Score: 5, Interesting

    Please let me know if I'm wrong...

    I visited the site, and the commercial site too and it seems this is only simple replication with the master being a single point of failure. F.E.

    1. update a row in the master
    2. master replicates the update to multiple slaves
    3. clients perform select operations against the slaves (nice load balancing opportunity)
    4. the master crashes
    5. No one can write until the master comes back online.

    Here are the steps that seem to be missing:
    6. the slaves elect a new master
    7. if the old master comes back up it must realize a new master is present and become a slave.
    8. clients using JDBC would need some mechanism of finding out what the new master is when an update/insert/delete fails.

    Cheers.

    --
    Schedule your world with ScheduleWorld.com http://www.ScheduleWorld.com/ (Java Web Startable)
    1. Re:Is this only a partial solution? by ralphclark · · Score: 4, Funny
      6. the slaves elect a new master.

      6a. The slaves realize to their horror that the new master has become as evil as the old master was.

      7. if the old master comes back up it must realize a new master is present and become a slave.

      7a. Some of the slaves conspire with the old master to assist his return to power.

  14. IANADBA by WeirdKid · · Score: 5, Insightful

    I like PostgreSQL, and Open Source deserves capitalization, but I'd like to hear an enterprise DBA's perspective on if this really compares to Oracle's configurability, clustering capabilities, or the seamless swapping of redundant database packages when deployed on, say, an EMC 1000, for reliability and failover. BTW, for this request, "enterprise" = Fortune 100, not Joe's Web Hosting.

    Like the subject says, I'm not a DBA, but I know some pretty heavy-duty ones that say nothing beats Oracle running on HP Superdomes with EMC storage.

    1. Re:IANADBA by BigGerman · · Score: 5, Informative

      As someone who has been messing with Oracle for more than 10 years, I must say that NOTHING (in commercial or OSS world) comes even close on the high-end hardware you are describing. Properly tuned, humming Oracle database is a work of art.
      But it is also true that wast majority of Oracle installations are poorely implemented (due to enourmous and unjustyfiable complexity), Oracle's management software sucked (getting better recently), support far from stellar (telephone support hardly usable), yearly costs are sky-high.
      I started looking at PostgreSQL and the more I look the more I like what I see - it is conceptually simple, seems to have adequate performance with large tables, JDBC seems to work well too, stored procedures language is very close to Oracle's (I wish for better exceptions handling), and the whole thing is more than adequate replacement for 80% of Oracle installations I have personally seen.
      And I have to add that I tried very hard to like MySQL but it did not work for me.
      Everything above is IMHO and the usual disclaimers apply.

  15. MS SQL Server - Re:The defacto standard by Malc · · Score: 4, Insightful

    By the time PostgreSQL is capable of replacing Oracle as the de facto standard, MS SQL Server will already have done the job and be the new standard to beat. No matter how much people despise MS SQL Server, nor how much they over rate Oracle, it is now the standard for companies needing a low or mid range solution. As with all MSFT products, it improves with each iteration. Our needs aren't high-end, but it handles our 300GB databases with 170 million row tables remarkably well.

    1. Re:MS SQL Server - Re:The defacto standard by RealisticWeb.com · · Score: 5, Insightful
      I know people are going to eviscerate you for saying that, but I have to agree with you. I have always been against most microsoft products, but I just can't lie to myself anymore when it comes to MSSQL. Enterprize manager is the best GUI I have ever seen for SQL management and it makes my job MUCH easier. It lets you pump out all the raw SQL you want to make queries, but you can also use a visual tool that has all the ease of use that access has, but with the enterprize power of MSSQL. And what about the installers! I haven't used Oracle in a couple of years, but I will never forget how much it sucked to try and get 9i installed. Nothing but a java installer! I HAD to put java on my db server or 9i wouldn't install, no command line option at all. How dumb is that? Another caveat, make sure the numlock key is on, or the installer won't work anyway. There was a big fat button that said "install", but didn't do a thing because we had the num lock off. Spent 12 hours on the phone with Oracle and they could't figure out what was wrong. We happened accross the bug report on their web page months later. MSSQL on the other hand? Never a probelm so far on any of the hardare that I have tried it on.

      No I don't work for MS, no I'm not in bed with thier marketing department, no I'm not afraid of the command line, etc. I just can't deny that it is a good product. In my opinion the best product MS has ever released, and much cheaper than Oracal.

      Granted, I still don't trust MS to be secure, so I never let it be internet facing. To get around that you let the web server be internet facing and only allow connections to the db from that one box. They would have to comprimise you from the inside first, or take control of the web server. And there is nothing stopping you from using Linux and Apache on that web server. We do the same thing with Exchange. I don't like exchange nearly as much as I like MSSQL but the VP's demand it so we just put it behind the firewall and relay all the outbound mail to a Unix-based mailserver in the DMZ.

      Unix security on the outside, MS useability on the inside.

      Go ahead and flame me now, I'm ready for you.

      --
      Sigs are out of style, so I'm not going to use one...oh wait..
    2. Re:MS SQL Server - Re:The defacto standard by Malcontent · · Score: 4, Interesting

      MSSQL server is in a very odd place.

      It's not as scalable as oracle or db/2 but at the same time it costs 15K per processor which is a hell of a lot of money.

      Postgres has just about all the features (and more) of mssql server and it costs nothing. You can buy the EMS postgresql manager for a few bucks and it's much better the enterprise manager.

      BTW. The next version of postgresql will have world class replication the database partitioning.

      Honestly in the long run I don't see how people are going to justify spending 15K per processor on a database which only runs on windows, only works well with windows clients (the JDBC driver sucks and is slow as hell), has quite possibly the worst stored procedure language known to mankind. I work with it every day and every day it makes me want to poke sticks in my eye to distract me from the pain. Just today I got pissed because none of the string functions work against text fields (varchar only!). Postgres is so much more fun to work with.

      --

      War is necrophilia.

    3. Re:MS SQL Server - Re:The defacto standard by Malcontent · · Score: 4, Interesting

      "SQL has proven itself both faster and more stable than Postgres. I'm not a Microsoft fan, but if there's one thing they got right it's SQL Server."

      I work with both every day. I don't know why you think they got SQL server right. Lots of lock escalation bullshit, weird locking semantics, goofy functions that only work on some text types and not others, 8K row limit, crappy SP language, the list goes on and on.

      Things you totaly take for granted on mysql or postgres trip you up on sql server.

      Try passing some XML out of a stored procedure sometime and then tell me how great SQL server is.

      --

      War is necrophilia.

  16. PostgreSQL vs MySQL by mnmn · · Score: 5, Insightful

    Even though the article is about an improvement in the PostgreSQL community, the comments are mostly pgsql vs mysql. People in the bazaar need to have personal motivations to work on opensource projects, mostly to have something against Microsoft, but increasingly, it is becoming a series of team wars. Linux vs BSD, then we had KDE vs GNOME and now qmail vs postfix and mysql vs pgsql. More than a decade ago we had vi vs emacs and BSD vs SYSV.

    What the posters here need to realize is that it is exactly this competition that is driving the projects. If MySQL was not given the press and did not have its cult following, we would not see this pace of development for pgsql. The developments for FreeBSD really improved to compete with Linux although their developers claim they are not competing... they do have the fear Linux will supplant them.

    What is interesting to note is that in most of these project wars, both projects really survive and get two different niches of their own. This was true of bash vs csh, BSD vs SYSV, BSD vs Linux, KDE vs GNOME, and now MySQL will become the standard entry level database and pgsql the higher level.

    I use pgsql because my databases have complicated requirements that MySQL cannot meet. Yet MySQL is the quick and dirty solution when I have to set things up fast. For all new learners I always suggest MySQL. For people thinking of replacing or duplicating their ERP systems, I always suggest pgsql. I even know how to program in sleepycat's db and know where it should replace mysql in smaller embedded systems and where the mysql license cannot be used.

    I believe this competition is coming to a close since pgsql has taken a big lead over MySQL in features, and therefore made itself more difficult to deal with especially for newbies. All I can say about the postgresql replication is bravo, and hope MySQL doesnt follow suit so it remains the simple fast and easy database in its own niche.

    --
    "Give orange me give eat orange me eat orange give me eat orange give me you." -Nim Chimpsky
  17. IAAEDBA Re:IANADBA by vt0asta · · Score: 4, Interesting

    This is like shooting fish in a barrel. I often don't like to harp on the OSSDB fanboys, but Oracle's database solution is second to none, and continues to pull away from the pack.

    First things first. Online replication is generally considered by professional DBAs a fools errand. You have to babysit and it fails at the drop off a hat for a variety of reasons. The are no good reasons to do replication in the manner they are talking about, unless that is your ONLY option.

    There are however, reasons to replicate data. The reasons you want data replicated are usually for one of two reasons: availability or scalability.

    To address availability Oracle provides several options that are just plain better than regular/triggered snapshot logging or materialized view refreshing over a network.

    The best option is Oracle's Dataguard, which applies redo/archive logs to a duplicate remote databases. You can perform this option at the logical and at the physical level, and you can choose to maximize/guarantee the protection all the way down to best effort. This option provides the ability to have an absolutely current very warm site, a simple command and you're database is up and running.

    As for scalability, again Postgres or mysql doesn't hold a candle. There are too many options to list, so I'll discuss the big ones.

    Paritioning/sub-partitioning of data. The way Oracle lays out it's logical database block layer and physical OS block layer is absolutely perfect for being able to do anything you want with the database file layout. I can put my OLTP indexes and tables on fast raid10 devices, the historical and warehousing data on raid5 devices, but that's not all. I can increase parallelization of the hardware by putting a single table or index across N devices. The ability to sprinkle files and chop up data anywhere you want, is just one thing that makes Oracle configurable, scalable, and great.

    Real Application Cluster (was Oracle Parallel Server). This is a for REAL clustering solution. Oracle allows several servers (can be dissimiliar in capabilities, i.e. some can have 64gig of memory and 12 processors, and then the others could be smaller dual processor machines.) to connect to the same storage (usually shared over a SAN or SCSI direct connect to EMC gear). Each of the servers is connected to a crossover/ipc LAN (we use gigabit) and now each of the servers has access to the same data. One node goes down or needs to go down for maintenance or reconfig, that's ok, the other nodes are online and traffic can be configured to automatically transfers over to the other nodes MID-TRANSACTION and picks up where it left off and the application is none the wiser (i.e. happens in seconds). The nodes share cached data over the fast network, so there is often little need to go to disk. This kind of scalability can not be found on any other database.

    <rant>
    The real gain for OSS and Oracle, is Linux and Oracle running on Linux. OSS databases are too immature to be let anywhere near real money. I'm not talking about ecommerce money, I'm talking about the millions and bajillions of dollars that flow like water through companies. Linux has Oracle validation and certification, which goes a LONG way in getting Linux into the real datacenters. The price point for the hardware, and the OS and the special deals that Oracle cuts for it are the true win for OSS. The performance is more than there for Linux/Intel solutions, and the price point for Intel hardware is very attractive to companies looking to cut expenses. You still have to pay homage to the Oracle and EMC gods, but even they have felt the crunch, and they too are providing competitive price points.
    </rant>

    So Postgres is one feature closer to what Oracle was several years ago. So what, this is embarassing. Mysql has had transactions for how long? a few days? Please people, Oracle is not resting on it's laurels waiting for anyone to catch up. They have real companies, with real money, that are real threats to them. IBM and Microsoft. Oracle, is pushing the edge on the database front, and doesn't show any signs of stopping.

    --
    No.
  18. Places SQL Server can never go by emil · · Score: 4, Insightful

    SQL Server will never run on any version of UNIX. AFAIK, there aren't even (MS-supported) SQL Server client libraries for non-windows platforms. I realize that FreeTDS is available, but such a library would never be used in a highly critical sector.

    If you have to integrate multiple platforms, you cannot use SQL server. Closest similar product is Sybase ASE, but Microsoft broke Sybase compatibility on purpose.

    I think if people understood how irrationally obstinate SQL Server's platform dependence was, they would look elsewhere. I hope that this attitude holds them below 10% penetration - it certainly has up to now. They are a bit player.

    In any case, there is a cheap, new version of DB2 out for $500/copy.