Slashdot Mirror


.org TLD Now Runs on PostgreSQL

johnnyb writes "The .org domain, which has long run on Oracle systems, is now being transferred to a PostgreSQL system. I guess we can now dispel the "untested in mission-critical applications" myth."

45 of 379 comments (clear)

  1. not that impressive by LinuxCumShot · · Score: 5, Funny

    .ca runs on MS-DOS running some home brew DB that is just a bunch of batch files

    --
    -- OMFG = Oh My Floatse Goatse
    1. Re:not that impressive by liquidsin · · Score: 3, Funny

      Are you sure it's a joke? I was thinking it was 'informative'.

      --
      do not read this line twice.
  2. Oracle... by killthiskid · · Score: 5, Funny
    "No one ever got fired for selecting Oracle, so we asked ourselves, Do we take that option?" he said.

    Not true! I know someone who got fired for choosing oracle, then being unable to properly implement it.

    1. Re:Oracle... by sakeneko · · Score: 4, Informative
      "No one ever got fired for selecting Oracle, so we asked ourselves, Do we take that option?" he said.
      Not true! I know someone who got fired for choosing oracle, then being unable to properly implement it.

      Someone who worked for the State of California, perhaps? There were a bunch of people who lost their jobs over that debacle.... See here for more info.<wry grin>

    2. Re:Oracle... by jcr · · Score: 3, Funny

      I know someone who got fired for choosing oracle, then being unable to properly implement it.

      My standard rebuttal now when someone says "nobody every got fired for choosing (insert standard expensive mediocrity vendor here)" is: "No, they didn't get fired, they lost their job when their company folded."

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
  3. This is a great performance test by TerryAtWork · · Score: 4, Funny

    Now we get to see how PostgreSQL handles those 98 % of wasted inquiries from DNS servers that don't know .elvis is not a TLD.

    --
    It's Christmas everyday with BitTorrent.
    1. Re:This is a great performance test by bob@dB.org · · Score: 5, Informative
      Now we get to see how PostgreSQL handles those 98 % of wasted inquiries from DNS servers that don't know .elvis is not a TLD.

      org. is tld (top level domain).

      . (dot) is the root.

      the story on the wasted 98% was about the . (dot) root servers, not about a tld server. you (and sadly, too many others) should read rfc 1035.

      --
      Acts@core.mailboks.com Acrux@core.mailboks.com Adam@core.mailboks.com Adar@core.mailboks.com Ada@core.mailboks.com
    2. Re:This is a great performance test by micromoog · · Score: 4, Funny
      you (and sadly, too many others) should read rfc 1035.

      Well, I would read it . . . except that it's SO completely useless and uninteresting to me.

  4. Well, what are/aren't they using it for? by etcshadow · · Score: 5, Insightful

    Because they don't take context or purpose into account at all. There are things that Postress may be better for and things that Oracle certainly shines at. I mean, hell, I love MySQL, too, but I wouldn't want to use it as the backend for _my_ system. Not that the others are hollisticaly "bad", it's just that Oracle is the most appropriate for this situation.

    What's a TLD doing with a database? Making ridiculous numbers of extremely lightweight queries, and managing redundancy. That's not necessarily the same thing that everybody wants an "enterprise class" "tested" database to do for "mission critical" tasks.

    --
    :Wq
    Not an editor command: Wq
    1. Re:Well, what are/aren't they using it for? by someguyintoronto · · Score: 3, Interesting

      Actually, this is a good question. What is the database used for? Profile information for WHOIS searches? That would make the most sense, and isn't *that* big a deal. A database to handle name resolution is a bit of overkill I think.

      And not to distract that yes it's good to see PostgreSQL getting some mainstream fame.

    2. Re:Well, what are/aren't they using it for? by Zeinfeld · · Score: 4, Informative
      Actually, this is a good question. What is the database used for?

      The database is a buffer between the requests comming in from the registrars and the DNS resolvers. So you get a bunch of requests comming in once a day saying stuff like 'change asm.org DNS to 10.2.3.243' and the registry has to decide what to do with them. To do that they need to have a bunch of info stating what registrar owns the account at the time and so on. And yes it is not unknown for registrars to attempt to do things they should not.

      The DNS infrastructure that is queried by you DNS server is completely separate. Every hour or so the SQL database will do a dump which will then be checked and if it passes will be sent to the production DNS infrastructure which is essentially a read only affair.

      So no, this does not mean that every DNS lookup in .org is going to result in a mySQL transaction. Nor can you say anything about whether this deployment proves mySQL is ready for primetime, at least not yet you can't. You probably want to wait to see how the zone holds up over the next few months before drawing any judgements.

      BTW the technical name for Oracle features is 'complications'.

      --
      Looking for an Information Security student project suggestion?
      Try http://dotcrimeManifesto.com/
  5. slashdotted by gokubi · · Score: 4, Funny

    I hope computerworld isn't running on PostgreSQL!

    --
    I'm much funnier now that I'm a subscriber.
  6. Overkill. by grub · · Score: 5, Funny


    All they need is netcat, shell scripts and grep.

    --
    Trolling is a art,
  7. Wasn't Oracle, actually by kschendel · · Score: 5, Informative

    Verisign runs the shared registry with Oracle, but the registrar-specific data was and still is stored using Ingres.

  8. Um by TekReggard · · Score: 5, Insightful
    "Mohan said the decision to award the contract to a vendor deploying PostgreSQL vindicates the database as a reliable, stable management system."

    No, it simply means that its going to be tested in a larger environment and if it does well then they get to party and say "woohoo it worked!" and if it flops they're all gonna feel really stupid. It doesnt mean its stable at all. The common practice of paraphrasing "LOOK!! Someone is using our product so it MUST work perfectly." is actually quite disturbing.

  9. Not a surprise... by frodo+from+middle+ea · · Score: 4, Interesting

    I had the misfortune of dealing with oracle tech support team once and I can say I am not surprised the ".org" domain has shifted to PG.

    The DB was locking up when trying to retrieve data from a large table (>10 M rows) using a very complex query.The oracle guys kept suggesting that reduce the size of the table.

    Now seriously is that a valid option ? Hey man , I have a million bucks in my acct. and i can't withdraw from the ATM ??
    Just delete some of it and then try again ?
    Or the most common answer from Oracle tech team is "we know its a problem but we will not fix it in this release. Just buy the next version if you want it fixed ?

    --
    for the last time people, I am "frodo from middle eaRTH", not "middle eaST".
    1. Re:Not a surprise... by Chazmyrr · · Score: 4, Insightful

      You are retrieving data from a 10 million row table using a very complex query and you are having performance problems? Who would have thought that?

      Normally I get paid a lot of money to solve problems like this but I'll give you a little guidance for free since you didn't like Oracle's answer.

      1) Maybe you should think about optimizing your query a bit. Running complex queries against 10+ rows can be problematic even when the RDMS has a good optimizer. Is there a less complex way to accomplish the same thing? If not, you may have to give the optimizer hints. Can you use an index to pull a smaller dataset into a working table where you do your complex operations?

      2) Profile your system to determine where the bottleneck is to be found. Is it CPU bound or IO bound. If it's IO bound, would more memory help? Can your tablespace be spread across more disks? Would a beefier system be appropriate? Cost Effective?

      This is why you hire qualified developers and administrators. I'm not surprised the tech team gave you that answer. You call the tech team when there is a real problem with the software. If you were paying Oracle to develop the database for you, you might have a case. But then, if that were true, you wouldn't have called tech support, would you?

    2. Re:Not a surprise... by MmmmAqua · · Score: 3, Informative

      Or the most common answer from Oracle tech team is "we know its a problem but we will not fix it in this release. Just buy the next version if you want it fixed ?

      Actually, they suggest you upgrade to the newest version, not that you buy anything new. Licenses purchased from Oracle are for a product family for a length of time determined by the license. For example: if you bought a four-year single cpu Enterprise Edition license two years ago when 8i was the current release, you have the right to use 9i, and 10i when it appears, until the end of your license term.

      ...according to my Oracle sales rep.

      --
      Arr! The laws of physics be a harsh mistress!
  10. The point by Synn · · Score: 4, Insightful

    I don't think the issue is that PostgreSQL will crunch data as well as Oracle. It's just that PostgreSQL has always had an undeserved reputation as "the database to use when you can't afford a REAL database", when actually it's a very robust and secure system that can compete quite well with commercial systems.

    I'd really like to see some serious tests done with PostgreSQL. Database systems, especially Oracle, can be an expensive part of a datacenter. Considering that with Linux/PostgreSQL your only cost is hardware/support, it may very well scale more cost effectively than Oracle.

    There's currently way too much marketing and FUD to get a real idea how these systems compare though.

    1. Re:The point by ortholattice · · Score: 4, Interesting
      I'd really like to see some serious tests done with PostgreSQL.

      I love PostgreSQL, have used it in a small (million-record) transactional application with great success, and am pleased to see the implied advocacy of having .org run on it. Nonetheless 2.4 million records is hardly enterprise-level stress. I would really like to see some serious benchmarks against Oracle. My tests on a small PC-based Linux server last year showed that pg beat Oracle mainly because the bloat of Oracle caused excessive thrashing, but on a large mainframe-type application - billion-record type stuff - I simply have no idea. A couple of years ago some benchmarks were published on the web but got quickly taken down by Oracle under threat of lawsuit - their license doesn't allow publication of benchmarks - and I never got to see them. I think this is wrong. Perhaps the recent ruling against EDA benchmark restrictions will open a door towards Oracle benchmarks?

  11. Great idea... by Kenja · · Score: 4, Funny

    If it breaks they can just go to postgresql.org to get updates and.... oh wait.

    --

    "Have you ever thought about just turning off the TV, sitting down with your kids, and hitting them?"
    1. Re:Great idea... by sharkey · · Score: 5, Funny

      You'll note Slashdot uses MySQL and is very happy.

      You misspelled "real fucking slow".

      --

      --
      "Outlook not so good." That magic 8-ball knows everything! I'll ask about Exchange Server next.
    2. Re:Great idea... by sharkey · · Score: 3, Funny

      erm.. which slashdot are you using?

      Try reading during the day. When Slashdot takes 5-10 minutes to respond to a connection request, I'd say that's pretty damn slow. It's quite a bit faster at night. The daily slow-down is more an indictment of Taco's implementation than anything else, I suppose. Since Taco implemented this new interation of Slashdot Math (20+30+30=100), the site's been nearly unreadable during the US day.

      --

      --
      "Outlook not so good." That magic 8-ball knows everything! I'll ask about Exchange Server next.
    3. Re:Great idea... by tshak · · Score: 3, Informative

      I'll second that. I'm not proud of it but I hit /. at least 3 times a day. The response can be horrible sometimes. Many times, I get "server not found" errors or MySql errors (aka, "static page only whole MySql DB server is getting rebuilt/rebooted"). Of all the sites I frequent (FiringSquad, Tomshardware, Anandtech, etc.) this site as the worst performance. True, it does have the least amount of static comment (a huge threading system, but the other sites have small but active forums too). Still, Anandtech runs fricken Cold Fusion on Windows of all things and it runs better!

      --

      There is no longer anything that can be done with computers that is nontrivial and clearly legal. -- Paul Phillips
  12. Postgres in mission critical apps by j_kenpo · · Score: 3, Informative

    Well, we ran Postgres as our primary database for a Managed Network System Security,a nd the postgres database stored all alerts coming in from all our sensors, which included a .EDU that had qutie a bit of traffic going through it (our own implemented honeypot). The only issue we ran into was with disk space with packet logging, which was unrelated to the Postgres Database. We would get any number of hits per data into the database (sometimes over a million in a weeks time). Ive come to prefer Postgres over MySQL, although Id still take Oracle over each if I could afford the license.

  13. .nz also runs on PostgreSQL by Karora · · Score: 4, Interesting

    I was a designer of the system that runs .nz (New Zealand), which is also based around PostgreSQL, running on three replicated back-end application servers.

    The system was developed in mod Perl and went live on October 14th 2002.

    The plan is to release this (including client software) under the GPL after a stabilisation period.

    --

    ...heellpppp! I've been captured by little green penguins!
  14. Re:Nice. But who is supporting it? by Kenneth+Stephen · · Score: 4, Insightful

    Competency isnt the issue here. I am assuming that whoever the actual developer of the fix is, that they will be extremely competent in fixing the problem. With an external entity, contractual terms of delivery will twist their arms into fixing severity 1 problems with the urgency that they deserve regardless of whether the fix is the best possible coding / architectural solution for the overall Postgres project. With an internal entity, the pressure will be less on them because if management threatens to "chop the head off" because of trying to do the "right thing" instead of just fixing the problem, they will have to stop and consider that they are damaging their own organization. It is always easier for management to be brutal with external entities rather than one of their own.

    --

    There is no such thing as luck. Luck is nothing but an absence of bad luck.

  15. TCO by oliverthered · · Score: 3, Informative

    from the artical it didn't look like TCO was a factor.

    1: they liked versioning in postgress.
    2: they liked the open source comunity.
    3: Oracle didn't have anything over postgress[that wsa usefull]

    Maybe 2 relates to TCO, the amount you'd have to pay to get the same level of developer support on oracle would be huge.

    --
    thank God the internet isn't a human right.
  16. isn't it cool... by ubiquitin · · Score: 4, Informative

    ...that the entire O'Reilly Practical PostgreSQL book was put online?

    I've spent so much time lately in the (relatively) flat-table world of MySQL that I had forgotten about inherited tables, subselects, constraints in table definitions, and oh yes, vacuuming. ;) Looks like it is time to revisit postgres, especially for some db-agnostic PEAR apps I'm building. For me, it's the subselects that really make it worth the effort.

    --
    http://tinyurl.com/4ny52
  17. Re:vs. MySQL by Styx · · Score: 3, Informative

    MySQL performed better than Postgres, especially on select-only queries, until not too long ago. I did some profiling on a web-based app at work where MySQL outperforms Postgres, and it turns out, that only approx. 0.02% of queries are INSERTs or UPDATEs, so it seems MySQL still has an edge in some applications.

    Postgres also seems to have an (unfair, IMHO), reputation for being hard to set up.

    And yes, MySQL has come a long way in the last 3 years, and does support transactions now.

    --
    /Styx
  18. .. You are, but the real problem is... by Anonymous Coward · · Score: 5, Informative
    You can vacuum any time without shutting things down. You don't even lock a table thanks to the wonderful MVCC. But..

    The real problem with Postgresql, however, is that if you are doing lots of updates where the keys increase forever, the index files grow forever. You can, of course, drop and recreate them (which we do in a cron job), but in a real 24/7 environment you've got a real problem when your queries all turn into table-scans because the indexes aren't built yet.

    Here is some more information (seeIndex Maintenance? )

    The only option I know if is to have two sets of tables and swap between them.

    -- ac at work

  19. PIR transition details by shessel · · Score: 4, Informative

    The transition details can be found on the Public Interest Registry's Homepage. In short, they'll close the registry at 14:00 UTC tomorrow, transfer to Afilias's systems, and reopen the registrations on Sunday at 23:00 UTC.

  20. How to pronounce? by FireBreathingDog · · Score: 3, Interesting
    Will someone please tell me how the hell to pronounce PostgreSQL?

    Or are we supposed to pronounce it POST-GRE-SEE-KWEL? Or POST-GRES-CUE-ELL? Or POST-GRES-QUERY LANGUAGE?

    And where the hell did that name come from? Did they take "Ingres", and increment it (like how C became C++), thereby making it "Postgres"? Then "PostgreSQL" means "the better-than-Ingres query language"?

    I hate it when techies come up with names. It always ends up being something that's either stupid and meaningless, like C#, or self-referential and too-cute-by-half, like GNU. Recursive acronym my ass.

  21. Smoking crack... by NerveGas · · Score: 3, Interesting

    "untested in mission-critical applications"?

    You'd have to be a completely ignorant moron to believe that. A good number of large companies have been running PostgreSQL succesfully in mission-critical situation for *years*.

    It's been used in network-monitoring apps for deployment in military vehicles, $30 million POS systems, medical systems, ticketmaster, a good number of heavy-traffic web sites, and just about everything else you can think of.

    Anybody who told you it hadn't been tested was living long in the past.

    steve

    --
    Oh, you're not stuck, you're just unable to let go of the onion rings.
  22. Right tool, Right job by Anonymous Coward · · Score: 5, Insightful

    If I here those words again, I think my head will explode. I don't remember anyone saying to use a wrench for a hammer if you have both. When people argue these things, they are argueing that a tool is the right tool for a job. PostgreSQL is being argued to be a tool that can be used for enterprise jobs. Either confront that or not, don't just state the obvious. No one said PostgreSQL is the only database to use.

    I here this everytime a programming language is mentioned too. Either say Java can't do what perl can, or Java is slower than perl and back those up. Don't say Java is good and Perl is good because everyone knows that.

    I don't mean to take my frustrations out on you poor poster, it's just high time people realize that this is like argueing philips or flat-head. It should be a poll option because it's preference, not because there ever is a right or wrong database for a job. It's a choice. After this has been going for a while without problems, we can then proceed to choose PostgreSQL to save money or because we like it better than Oracle or DB2.

    It's as annoying as:
    1: In soviet russia, Vi>Emacs
    2: ?
    3: goatse.cx, "MOD PARENT UP"

  23. Re:Non-commercial? by stevel · · Score: 3, Informative

    As far as I know, there has never been any regulation as to who can and can't register a .org domain. The association with not-for-profits is a convention, not a rule. Same with .net, which initially was for ISPs and other network service providers.

    Nowadays, .org and .net are largely used by registrants who couldn't get the .com they wanted. (On the other hand, I have two .org domains registered for legitimate non-profits, a town band and a cat shelter.)

  24. Re:I could be wrong, but... by JohanV · · Score: 4, Informative

    Yes, you are wrong, as of PostgreSQL 7.2 VACUUM can run without locking the table completely.

    Garbage collection is a problem every database faces. Due to ACID requirements it is pretty much (absolutely?) impossible to run a database that updates rows without having multiple versions of the same row on disk at some time during the operation. So at some point in time you have to get rid of that duplicate. You can choose to do that after commit of a transaction (or the last transaction for which the row is still visible), but that would potentially make every transaction slower. So in PostgreSQL the choice was made to do this at an administrator determined moment (and I presume that choice also was the easy one).
    In older versions of PostgreSQL VACUUM would lock the entire table and physically force all the valid rows to be rewritten consecutively and then reclaim the space at the end. This mode is still available as VACUUM FULL, but nowadays there is a new mode (sometimes called lazy vacuum) that only marks space safe to be overwritten. Subsequent updates/inserts will overwrite it eventually.
    Regular running of this command will eventually lead to some steady state where there is some x% of bloat in the table, but there is no significant amount of locking required.

  25. Re:vs. MySQL by glwtta · · Score: 3, Insightful
    Postgres also seems to have an (unfair, IMHO), reputation for being hard to set up.

    Oh yeah, Oracle just shines there. In any case, postgres 7.3 took me about 20 minutes to set up, don't know what everyone's bitching about.

    --
    sic transit gloria mundi
  26. Re:vs. MySQL by Admiral+Burrito · · Score: 4, Informative
    But what I don't know is where PostgreSQL fits into all of this. I mean, if it IS the better system, why do I only hear mySQL when someone is talking about open source databases?

    Because...

    • MySQL has a commercial entity backing it, that actually makes money selling commercial MySQL licences (the MySQL licence terms are kind of weird, "fully-viral GPL unless you pay us $$$"). This seems to have resulted in some marketoid-speak, which is unusual in the context of an open-source project. For example, "MySQL now supports transactions!" and various other "features", ignoring how fundamental such things are to a real RDBMS and should have always been a part of the design.
    • There are lots of people who don't understand why you would need "subselects" or "outer joins", and didn't know about "transactions" until they read about it in the mysql change log. And MySQL will be a real RDBMS Real Soon Now (tm) so there's no need to switch to anything else and besides you don't really need a real RDBMS anyway.
    • MySQL has a nice Windows installer.
    • PostgreSQL used to suck, once upon a time.
  27. We put the ---- in dot-ORG by penguin_punk · · Score: 4, Funny

    Ok. I think I figured it out.

    Microsoft puts the "." in .CA

    Sun puts the "." in .COM

    PostgreSQL puts the "E_fatalError - Database error" in .ORG?

    I have a test on this tomorrow, so I just wanted to make sure.

    laugh.

    --
    HURD - Hurd's Under Research & Development
  28. Re:Fifth largest? by Jadrano · · Score: 4, Informative

    Unfortunately, I haven't found new data, but here is a list of January 2001.
    The top ranks are:
    1. .com: 21,174,751
    2. .net: 2,806,721
    3. .uk: 2,078,474
    4. .de: 1,732,994
    5. .org: 1,614,740
    6. .nl: 416,842
    7. .kr: 325,203
    ...
    The numbers have certainly changed since then, but perhaps the ranks are still similar. Maybe someone has found new data?

  29. On competing SQLs and performance by The+Gline · · Score: 3, Insightful

    I run a text-chat site that is -- please don't lynch me -- based on Win2K and MS SQL Server. The site does about 10-12 DB transactions a second on a slow day and about 100-150/sec on a fast day. At peak hours we have something like 30% CPU usage on the average (it's a 700 Mhz box, not bleeding-edge).

    A friend of mine put someone in touch with me who was trying to build a vaguely similar system and was having no end of problems. Transactions were timing out left and right, and his machine was more than twice as fast as mine. From his experiences -- and from what I've seen in a lot of parallel setups -- there is a difference between being able to code something functional and being able to code something that functions intelligently. I'd learned a lot of ways to cut down massively on system overhead -- use stored procedures, turn off locks when they're not required, don't use transactions unless they're absolutely needed, etc., etc. -- and all of them add up and pay off.

    As far as PostgreSQL goes, it's probably going to depend on how good a job they do coding it into their system. If they do it well, I'd imagine PostgreSQL is gonna be quite solid. If they do it like idiots, not even the best database solution in the world -- not Oracle, nothing -- is going to save them.

    Heck, even Oracle is going to break if you try to fetch a billion rows at once; the trick is to find smarter ways to partition and subdivide the data, to cut down the amount of time needed for every little step on the way. (I found out that adding ONE index in my system sped things up by about 30% alone, an index I would not have realized I needed until I ran a performance profile.)

    Let's see how well they do before we sling tomatoes, OK?

    --
    Honorary Member of Jackie Chan's Kung Fu Process Servers
  30. Re:hmm... by tealover · · Score: 4, Funny

    ...amusing when someone mispells...

    Is this real irony or Alanis irony?

    --
    -- You see, there would be these conclusions that you could jump to
  31. Overpricedacle by digitaltraveller · · Score: 3, Interesting

    One of the PostgreSQL developers is at Linux.conf.au right now. During his talk on Wednesday he mentioned this and that Oracle accused the .org registry guys of "criminial negligence" if they switched to PostgreSQL over Oracle. All I can say is: "HAH!" Feeling the pressure...

  32. Re:Fifth largest? by farnsworth · · Score: 4, Funny
    here are the latest numbers of various tld registrations:

    1) .com ORA-00936: missing expression
    2) .net mySQL:Cannot Connect to Local mysql server
    3) .de Filemaker Pro: 813, Record Synchronization error on network
    4) .org jdbc:postgresql:postgres Exception caught 101, error: Network is unreachable
    5) .nl "errr, I think I have that number scribbled on that big wooden shoe..."
    6) .kr "ENLARGE YOUR PENIS!!!!"

    --

    There aint no pancake so thin it doesn't have two sides.