Slashdot Mirror
Open Source Database Underdogs
implex writes "Interactive Week had an article called "Data Underdogs" which they compare offerings of present Open Source Databases with present commercial offerings. In one part they mention ...On the other hand, MySQL developers now have a much-needed transaction management system: NuSphere last month made its Gemini transaction manager for MySQL available as open source code on mySQL.org, a site that the company recently launched. Complicating matters, though, is NuSphere's blood feud with MySQL AB, a Swedish company that runs a competing open source development site for MySQL code at www.mysql.com. No mention of the fact that MySQL AB actually created the product was interesting."
I've spent a few years with Postgres as a production database on a fairly big application, and it seems pretty clear that the parts of Postgres that get worked on are the parts that are interesting/challenging/amusing to the developers. I think that's cool...it's what I'd do, and after all, they are (presumably) working on it for the pleasure of working on it.
But...it's that last 2 or 3 percent of not-very-interesting bug fixes, documentation and not quite implemented features that make all the difference. I'm not using Postgres for new projects.
Is that the one IBM bought?
Well, when people talk about market share it is usually by revenue, and given the low price of Open Source databases I'm actually surprised it's even as high as 3%.
But 3% of revenue might actually add up to a fairly substantial proportion of installations.
Maybe I'm just being dense (first reply: "Yes, you're fscking dense!")
Yes, you're fucking dense.
In regards to databases, what you have omitted is that the database problem is 2 decades younger than the operating systems problem. The OS problem was solved by the mid '70s. The RDBMS problem has only been 'solved', if you think it has been, by the early '90s. Linux was able to follow much more well-trod ground than Postgres, and I expect the development time of the latter to consequently lag. I have not, OTOH, seen any evidence supporting your assertion.
I'm afraid your argument isn't convincing.
Breaking it down, you're saying: "By my RDBMS having many OO features, good application design is unnecessary! Everything's done in the RDBMS!"
I'm positive that's not what you meant. But you phrased it assuming that if someone uses MySQL, they'll just write badly designed applications or simple weblogs.
Design is just as important with MySQL as it is any other RDBMS. And I fully appreciate MySQL for what it is.
So what's the moral here? Shitty applications and shitty developers are everywhere. That's not the fault of the RDBMS they use.
Take this over to comp.databases. There you will find a small, but extremely vocal, crowd of ODM developers with a habit of completely failing to learn relational theory. That, I suppose, more than anything else is the worst -- they dub their products 'post-relational', without ever learning what 'relational' is.
More importantly, you must learn the distinction between data models and programming languages. See my previous post for more details.
This is no doubt why Red Hat is getting into the DB game: So they can sell support for PostgreSQL.
I worked in a smallish Sybase shop for a while (tiny I suppose in comparison to a major credit card company) and I remember our DBA running around tweaking this and tweaking that to get the DB to run more efficiently. What struck me is that we had maybe 6 or 7 logical DB's all on one machine with no single table exceeding a million rows -- and he spends all day tweaking? Why didn't the damn thing just sit there and run? Why the need for all the tweaks? Sybase exposed so much configuration detail that even a competent DBA is bound to shoot themselves in the foot once in a while. Seems to me a decent DB system should hide and deal with as much complexity on it's own as possible.
If you actually read my post, you'll notice that I never claim that they implement all of SQL-92. I won't bother restating myself as the original post was quite clear.
P.S. Cursors with updatable columns did not actually work in MSFT SQL 6 until some time long after the marketing literature claimed they did. With PostgreSQL, you can expect more accuracy as to what is/isn't implemented.
In other words, instead of reading some redbooks or, heaven forbid, the DB2 manual, you spent all that time migrating an application to a totally different platform!
It must be great to be a consultant!
Conformity is the jailer of freedom and enemy of growth. -JFK
First, you have to define/document the core functionality. Then you have to define/document your data structure. Next you have to define/document the modules that will provide that functionality, including all the interfaces. Only then do you start to write anything other than throw-away, proof-of-concept code.
Does the Open Source community have the patience to go through three rounds of development without any code? I don't know.
I do know that this technique works. I've used it repeatedly. Many years ago I was asked to produce the first ISAM (Index Sequential Access Method) for a PDP 11 that only had sequential & relative I/O. I delivered a self-maintaining ISAM in about 6 weeks, having had no previous exposure to the issues, but following this approach.
I've used the same approach to produce enterprise-wide MRP & CRM systems.
I've also used it to produce package software for manufacturing firms that my company successfully delivered, with a full, money back guarantee -- and none of our customers ever asked for a refund.
So I know the technique works with projects of great complexity. Complexity is not the issue. Discipline, to achieve functionality, compatability and completeness, that's the issue.
I don't think you're likely to find that happening on the commercial level. It was so long ago I don't even remember where I read it (though it's the sort of thing that a /. poster might say), but I once heard it said that acknowledging bugs is probably a great way to tick off your investors.
"What, there's a flaw in your product?"
"Yes, but we can fix it pretty easily -- have the bug fix out tomorrow..."
Whereupon the non-technically-inclined investor writes the developer's comments as a sign of weakness and sells. I think that's also why commercial bug fix releases are such a big deal -- probably Microsoft's other reason for cramming all kinds of new features into their service packs.
/Brian
Instead of focusing in on the available solutions, the article simply spits out the idea that MySQL and Postgres are weak pretenders.
The FACT is that these databases are excellent solutions to a large number for MOST database problems. Sure, like all DBMSs, they can always use more features. But I don't want my DBMS to turn into an uncontrolled monster like Oracle.
For 99% of the applications out there, Postgres and mySQL fits the bill. If you're doing large scale distributed payroll using SAP, then I suggest you go with a big name...
But if you're an average-sized business, Postgres is a full-featured solution today. It is an inexpensive, fully-capable solution.
If you're into writing Oracle PL/SQL, a proprietary procedural extention to SQL, go with Oracle. (Note: PL/SQL doesn't work with Sybase or DB2 or anything else.) If you're into TransactSQL, another proprietary SQL extension, go with Sybase. Once you get into TransactSQL, you'll NEVER migrate out without expense. In fact, my shop, an Oracle shop, doesn't PERMIT developers to use the PL/SQL ewxtensions. We learned our lesson after migrating from proprietary MS-SQL-Server extensions to Oracle!
And if you need a big company to support your 20,000 person payroll, go with IBM's DB2. Again, another fine DBMS.
But for the average shop? Save your money and go with PostgreSQL.
OpSys? WTF language do you speak?
btw, an operating system is just a glorified BIOS and device driver.
What's the problem here? We've got and open source database that's being developed in two somewhat different directions by NuSphere and MySQL AB ... seems like in the end it'll lead to two different, but each (for their intended applications) excellent products. I just don't see a problem.
Maybe I'm just being dense (first reply: "Yes, you're fscking dense!")
You are evil. OSS can accomplish anything ... well, web browsers are hard! ... I'm sure a database is easy though!
One of the things that I like best about PostgreSQL is the fact that the developers are brutally honest about the software. The core PostgreSQL developers have always been quite frank about which parts of PostgreSQL were ready for production, and which parts were kludges, or were largely untested. The problem with commercial databases, even good ones like Oracle, is that the people who know where the rough edges are aren't talking about them. That sort of honesty goes a long way towards building my trust.
PostgreSQL has an amazing featureset, especially considering its price. I think that fairly soon Oracle is going to wake up to the fact that the database is becoming a commodity market, and quite frankly, they aren't likely to be competively priced.
Look at Great Bridge's website and you will find that 24x7 support is available, for a price. Great Bridge also employs at least one of the developers of the PostgreSQL database. I don't know about any of the MySQL options but you can have it with PostgreSQL.
With regards to DB2 verses MySQL, you could say the same thing about Windows versus Linux. Windows is much simpler for rapid development and prototyping.
-- ac
It's been my experience that the only thing really holding the major open-source DBMSs back were exposure and solid transaction management. I hope that, by now at least, many DBAs have at least heard that there are alternatives to Oracle and SQL Server. As a programmer and database designer, I know I've been trying to keep my co-workers' and employer's eyes open to the possibility of having to use an open-source DBMS when the need arises.
It seems to me that implementing MySQL doesn't seem any more difficult that getting an Oracle database built. Although, I must say I've gotten spoiled by the GUI that's available in Microsoft's SQL Server Enterprise Manager. It's damned nice.
I guess the long and short of it is that it's good to have an alternative to Oracle, which is, in my opinion, overpriced for what it is. As long as products like MySQL keep getting better, they'll continue gaining ground as not just "alternatives" to pricey DBMSs, they'll become the DBMSs of choice.
My sigs always suck.
Actually, I've noticed a growing trend in the crowd of programmers I run with is not to care about the implementation platform.. SQL is SQL, and you don't do transactional based stuff on the platform anymore, you abstract away from that into your middleware, and do things the way you want to. In REAL LIFE programming, you often don't have the chance or opportunity to spec out what your back-end platforms are, you have to deal with what's given, or what's legacy at Company XYZ Inc. You also are often dictated a programming langauge for the project whether it be java, c, cobol, perl, python or whatever. The real value lies in being able to adjust to whatever the PROJECT calls for, and being able to implement on just about any platform you need with strong good design patterns. MySQL and Oracle both do exactly the same thing from my point of view, hold data in a relational format for storage and quick retrieval. Putting too much logic into the database only serves to slow things down in the long run. Nasa Switches from Oracle to MySQL shows us why Oracle putting all those bells and whistles in their product may lead to a weakening of their marketshare ultimately. The fact is, bells and whistles cost memory and processor, and there's a balance between the two that Oracle seems to be blithly ignoring.
Sasha Pachev
MySQL Developer
The reality is that the presence of RI helps sophisticated query rewrite engines to do some very nifty transformations. So having RI actually helps you get better performing plans for read queries and hurts performance a little for writes.
I totally agree. If the backend knows that it can't compromise integrity though optimization (i.e. an optimization trial fails to maintain RI, etc.) then it also knows that when such tests don't fail, it has an optimized access method which kicks ass.
+++The solution is to develop with PostgreSQL regardless of what your deployment DB will be. Their docs favor standard SQL. The code you develop will work with the proprietary DBs as well.+++ Baloney. Their docs specificaly state they aren't SQL-92 compliant, and they don't try to be. Go ahead and create a cursor with updatable columns in Postgres, then come back and blabber on about "standard SQL."
--
You sure got a purty mouth...
Sub-Selects and Unions always work.
Some dribble cobbled together by a coder somewhere may not.
Conformity is the jailer of freedom and enemy of growth. -JFK
My only problem with Interbase (6.0 Borland Server Edition -- Commercial) is that in order to do even simple SQL based manipulation of data, you have to actually physically write the functions into the DB. They aren't there natively (not in 6.0 anyhow). I have only recently started playing with 6.1 Open Source, but after talking to Borland in the past regarding 6.0, I'd be surprised if they "fixed" the issue.
These functions include things as simple as SUBSTR(), but also limit doing things like DECODE() and NVL() (to allow conditional DB selects). MySQL and Postgres support such functions natively, or have a similar native function.
Actually, I believe that SAPDB is just a renamed ADABAS, which SAP purchased to round out their product offering. This is not to say, however, that SAP is not continuing development on SAPDB, as it makes sense to develop a database that works even better with their products.
By best practices, do you mean having warring companies in the midst of litigation seperately developing key database features?
Or do you mean not maintaining things like man pages in an operating system?
Conformity is the jailer of freedom and enemy of growth. -JFK
And as a long-time Oracle user, this is what pisses me off every time I use MySQL.
Well, that and the lack of referential integrity constraints, transactions and a sane backup mechanisim, which are the real reasons MySQL is never used in any kind of serious data environment.
Do you even know anything about perl? -- AC Replying to Tom Christiansen post.
For example, think of what it would take to organize your files. Then think of what it would take to automate the organization of files.
In other words, not only do you need to know what a relational database is, but also you need to understand it within the context of a database system. The article does an adequate job of keeping the discussion mostly on the former.
In other words,
some of your confusion may be over how databases view the world.
AND/OR
Some of your confusion may be how database systems implement databases.
It's boring, it's expensive, it's long winded, but it explains just about every aspect of a datase ad.nauseum, "An Introduction to Database Systems" by C.J.Date.
healyourchurchwebsite.com - WWJB?
Erm, no. This forces you to shut down the database to have it backed up.
I am talking about something like Oracle's archive log mode where you can have everything constantly backed up, and you can restore your backup to bring the database to its previous state at time X. And it works - every time.
Until you have something like that you are admitting that it is OK to lose lots of data in the event of a failure that requires restoration from a backup.
Do you even know anything about perl? -- AC Replying to Tom Christiansen post.
Did this number strike anyone else as too low? This is the first time I have seen any percentages on OS DBs. Alright, 3%, but of what? Does this mean that less than 3% of all bytes stored in any database are stored in an OS DB? That may be, but I cannot believe that less than 3% of all databases running are OS.
The thing is, when I started studying computer science, we only ever worked on mSQL boxes. My first job used Postgres and the second used mySQL. Anything I work on myself is mySQL. Granted these jobs have all been webrelated, but when you think about how many ISPs offer mySQL/Postgres preinstalled (not to mention linux distributions, if that counts), 3% seems rediculous.
Well I suppose MS Access runs on one or two computers out there... that might raise the non-OS score.
-Kraft
Live and let live
Besides that: any databasevendor uses its own sql-dialect. Get over it. If you don't want to use the dialect, write a layer on top of it or use a layer on top of it (like ADO/OLE-DB on win32).
Never underestimate the relief of true separation of Religion and State.
Take a look at this if you want to see php and MySQL working together. It shows you how to use two open source, cross-platform tools for creating a dynamic Web site.
No. The point is that the design of a great DBMS takes a lot more unity than the large-scale projects OSS has tackled previously. In a DBMS, there must be an internal set of standards for everything from datatypes to join optimization logic.
Databases just don't lend themselves to fragmented development the way operating systems do. Frankly, I'm skeptical that an OSS project could (using current development practices) pull together and produce something as capable and stable as DB2 or Oracle.
I've moved a major (~8GB) database from DB2 to PostgreSQL for a client. It runs faster and is easier to feed and administer now. I'm in the process of moving a similar-sized database and app from MS SQL Server to PostgreSQL for the same reasons (plus the openness of PostgreSQL and Linux).
I really like DB2, it's very powerful, robust, and scalable. But it requires a fair amount of admin expertise and time. Not so much as Oracle, but much more than PostgreSQL.
What, frankly, suprised the heck out of me was the fact that nearly all of my queries (this is an audit system, OLAP, not OLTP) ran between two and four times faster under PostgreSQL. That adds up pretty quickly!
As far as the application development support infrastructures, I'm not really sure what is meant by that. The current implementation of stored procedures in PostgreSQL falls short of what DB2 provides, I'll grant. But support for C, Java, Perl, PHP, Python is all there. It's a pretty high-speed/low-drag setup, IMHO.
The set of problems for which PostgreSQL is the best solution is expanding pretty rapidly. I won't pretend that it's the be-all RDBMS, I don't think such a thing exits. I would say that it's worth a serious look for many situations.
Gordon.
He that breaks a thing to find out what it is has left the path of wisdom.
-- J.R.R. Tolkien
We did recently quite a bit of Perl development using MySQL and InnoDB tables, and they worked (surprisingly) well. Having transactions (finally!!) in MySQL is a huge blessing.
Somewhat related...while the article mentions that MySQL and Postgres don't have the large application development support infrastructures that the bigger commercial database have, they can be a lot quicker to prototype and develop with because of their relative simplicity.
We're in the middle of migrating our application to DB2 on RS/6000, and I have to say I'm missing MySQL's simplicity of administration and configuration...you can try out a lot of new ideas quickly with MySQL, whereas a big chunk of our time at the moment is spent poring over DB2 manuals for obscure command switches and SQL options (the LOAD utility can be a barrel of laughs for newcomers)...of course if our DBA was a little more competent, but that's a different story :-(
(And yes I do realise DB2 is much more powerful/robust...I'm talking about ease of development and rapid prototyping!)
I highly recommend SAP-DB, an open source database (GPL) with Oracle 7.3 compatibility mode and features. http://www.sapdb.org
Daniel
I just run a cron job .. .copy the database file to a backup harddriver... works without any problems
cp /database/databasefile /backup/databasefile
Cruise TT
It's a pretty tall-order, but it lives up to it. Our internal benchmarking tests for our application purposes show it to be about 7x faster than an identical PostgreSQL 7.1.2 solution. I've seen reports on the mailing lists that it can be up to 18x faster. You also get the simplicity and maturity of MySQL. The InnoDB benchmark page has their own benchmarks, which pretty much mirror what we've seen internally.
Just a quick look at the benchmarks link tells me that they have fsync turned on on Postgres. What exactly is fsync? Every time Postgres touches the disk, it sync()s. Slow? Hell yeah. But you won't lose data in the cache. It's turned on by default.
I realize that Postgres isn't the fastest in the world, but it's not 7x slower on 100k inserts. That's just bad benchmarking. Deceitful even.
If fsync is not on, I apologize. However the link mentions no performance tuning other than buffer pools and log buffers. If Postgres is defeated by 7x (18x?!) in a fair test, I'll concede. However this looks like the MySQL testing benchmarks on mysql.org; bullshit, plain and simple.
Of course, MySQL has other drawbacks, namely that it doesn't support triggers or table inheritance or some of the more complex nuances of standard SQL, but the 95% of stuff it does have is very fast, and the other 5% can be handled in code.
The instant you decide to move data and/or referential integrity from the DB into 'code', you've lost the battle. I can't believe someone would even suggest this. Sure, stored procedures are a plus and most times they aren't necessary, but you simply cannot have your integrity checks outside the DB. That's the whole god-damned point of an RDBMS! If your integrity depends on unusual interactions in the data store, stored procedures are often the only way out. And you can't have stored procs that work to enforce integrity without triggers.
If you haven't got the integrity, you may as well be using a hashed filesystem to store your data for all the difference it would make. Hell, the hashed fs would probably be faster since it isn't pretending to be an RDBMS.
While I appreciate the sentiment of the article, it seems rife with misinformation. For example:
"Another feature that NuSphere is adding to MySQL is replication..."
Er, I'm pretty sure that's been in there for quite some time, through the master/slave system.
"The language resembles Oracle's PL/SQL (Procedural Language/SQL), except that PL/pgSQL offers the use of functions only, not procedures. A function call always returns some result, while a procedure may execute certain operations without returning a result."
Wow, that's certainly earth-shattering. Just discard the result. Cripes.
"PostgreSQL, like MySQL, also doesn't provide any native replication capability."
Maybe I misunderstand replication, but what's the matter with:
$ pg_dump mydb | bzip2 > dump.bz2
$ scp dump.bz2 newdb.host.com:
$ ssh newdb.host.com "pg_create mydb; bunzip2 dump.bz2 | psql -e mydb"
"But some Web businesses are finding that they can function perfectly well with open source databases."
Yeah, I guess the features I like are speed, stability, ease of deployment, and excellent development tools. PostgreSQL and MySQL have all of this in spades; the commercial databases I've worked with usually seem clunky and contrived by comparisson.
Apachetoolbox
Apachetoolbox actually installs everything from the original sources. It supports apache, mysql, php, over 60 modules for apache. Opensource to.
-io
Get thee glass eyes, and, like a scurvy politician, seem to see things thou dost not.--King Lear
One is tied up in this contractual mess, but the other, InnoDB has no such issues, and may even be faster for many purposes.
That might be the understatement of the year. InnoDB touts itself as the "fastest disk-based database" currently on the market. It's a pretty tall-order, but it lives up to it. Our internal benchmarking tests for our application purposes show it to be about 7x faster than an identical PostgreSQL 7.1.2 solution. I've seen reports on the mailing lists that it can be up to 18x faster. You also get the simplicity and maturity of MySQL. The InnoDB benchmark page has their own benchmarks, which pretty much mirror what we've seen internally.
Of course, MySQL has other drawbacks, namely that it doesn't support triggers or table inheritance or some of the more complex nuances of standard SQL, but the 95% of stuff it does have is very fast, and the other 5% can be handled in code. MySQL isn't popular because it's open-source, though. It's popular because it's good, free, and most importantly, extremely easy and intuitive to use.
When a product has 3% of a market that means that 3% of the total amount of money exchanged for that category of product is given in exchange for the product in question.
Now, you may argue, with considerable justification, that market share is a meaningless metric of open-source software acceptance, but for the mass of humanity that isn't still living with their parents, markets are what put food on the table.
22 processors and 1 GB of RAM? that seems like an impossible configuration! are you sure you didn't mean 1GB on each system board for a total of 22 GB?
get your dirty sig off me, you filthy APE!
Maturity? Just how mature is a RDBMS that doesn't even support referential integrity? Sure, it may speed things up sometimes, but do I really want to make my app code twice as big just to handle referential rules that should have been in the database in the first place?
J
One problem with proprietary DBs is that their docs will steer you toward non-standard SQL even when standard SQL will work. For example, Oracle will teach you to use NVL and Sybase will teach ISNULL, when COALESCE works in both databases.
The solution is to develop with PostgreSQL regardless of what your deployment DB will be. Their docs favor standard SQL. The code you develop will work with the proprietary DBs as well.
It baffles me that the author of the article could know about Interbase and yet seemingly not even look at it in the course of researching the article.
Why the need for all the tweaks?
Job security.
Seems to me a decent DB system should hide and deal with as much complexity on it's own as possible.
From the software developer's perspective, I agree. From an admin perspective, the more customizations available, the better - just like in an OS.
Developers: We can use your help.
OSS flies in the face of American ideologies, and this is just another example of big corporations not seeing the value.
Certainly Oracle is much more robust than MySQL right now, but I think the OSS ideology of trying to make the best product will eventually beat out the ideology of trying to squeeze as much money as possible. Technology will prove to be the end of traditional free-market theory, I think, because there is no longer a solid commodity with value. Things can be copied, so value has to be placed on the creators, not the product.
Your DBA was running around tweaking all day because he was supporting a poorly designed application that was completely unoptimized.
Because so many developers have a notion (prominently displayed in this story) that "SQL is SQL" many apps running on a database run horribly inefficient queries that bog the database down.
Studies have consistently found that80-90% of database tuning needs to take place in the application. The database tuning portion mainly consists of tweaking memory and parallel query options.
Conformity is the jailer of freedom and enemy of growth. -JFK
Actually that is not quite correct. DB2 UDB was a completely new product originally put together on OS/2 in the early nineties.
The MySQL crowd just continues to remain ignorant of the fact that full SQL-92 support is not wanking, and it is certainly not a perf hit.
My experience from about 12 years ago. The Air Force mandated that Oracle would be the "standard" DB, because it was "portable". There was an on-base Oracle representative. Our project was working just fine using VAX/DBMS, but we figured we would call up the Oracle guy and get a quote. It was something like 40K, or about quadruple what we were paying for VAX/DBMS. We choose not to switch.
Another time, myself and a friend were experimenting with Oracle on an AT&T 3B2 (also mandated by the Air Force as the "standard minicomputer"). It was slow as hell, but that may have been AT&T's fault. whilst creating a simple form, and trying to do something basic, like hit the function key to add a trigger to a field, the forms app would blow up. So we call the Oracle guy, who helpfully advises "Don't press that key". We were unimpressed with Oracle's tech support.
lack of a sane backup mechanism?
you can just copy the files around for backup...
and now, they've got live backup stuff (if thats what you meant) thats getting to be pretty well done (theres still some issues on some types of queries, and if you have two (or more i guess) servers backing up to each other w/ auto increment it can do some wierd stuff)
Need a Catering Connection
Thanx for pointing it out. You know that it is a whole feature they did... AFAIR if you click "next" on the bottom of the page, you will go through all the articles they wrote on the topic. I tried submitting this to /. but no luck.
If anyone else feels like submitting it, then please go for it.
-Kraft
Live and let live
You're thinking of their 4GL. Every major database vendor has a 4GL ("fourth generation language", not my choice of terms). Most of them are really awful, but they have their place in certain business settings (right next to COBOL).
Progress the database was actually pretty nice, and had some features that are still not supported well in the rest of the commercial databases.
The obvious solution is to buy the jet and then hire taxi cab drivers to fly it. Duh.
It's 10 PM. Do you know if you're un-American?
Companies keep everything on database systems. Hundreds of geek-hours must go into the design of a database application for a company. Whatever system a company chooses, they must be reasonably sure the system will:
- almost never fail
- be supported by a stable company and
- integrate well with other systems, into the future.
A smaller price tag may be a good start to target smaller companies that don't rely heavily on database applications, but the reason Oracle can charge $15k/CPU for 9i Standard: the reputation is worth it.SAPDB only runs on Linux/i386 and Win32/i386. The development tools (needed to compile the thing) are not yet completely opensourced.
and how long as SAPDB been opensource? Less than six months.
I agree with you though! >:|
Yeah, all the companies would immediately say "Let's base the future of our business on new and untested technology! Better yet, let's buy it from an unknown vendor!"
Please. The reason relational databases are still very much the dominant technology is that they work, they work well, and they've been working well for decades.
.. on the reg at http://www.theregister.co.uk/content/53/21003.html
This ones from M$ point of view though.
I only have experience (but lots of it) with Oracle and - unfortunately - SQL Server. Until SQL Server 6.5, I think it sucked compared to Oracle. But now they're more on level, although Oracle has always, and still does, handle huge data warehouses much better.
That aside, I worked for years with a 4TB data warehouse for a major credit card company. It was Oracle (7?) on a Sun E10000 (22 processors, 1GB ram) and it was screaming. We barely used any "advanced" features that were unique to Oracle. But what impressed me was Oracle's support. They had an office a few miles away and would send DBAs over to help out. Our DBAs were excellent, but when it came to very low-level tweaking, these Oracle DBAs knew their stuff. They would mess around with the OS to keep it as efficient as possible. And if there was ever any kind of failure or error, they came over to check it out.
Now granted, my company paid big bucks for the support, but at the moment that sort of support can't be found for an open source dbms. These were highly skilled experts in the database they supported. I realize (partly from the article) that the current goal of open source databases is to grow in the low-end market - smaller systems and such - and I'd bet they'd stand up to large warehouses. But one big advantage Oracle and DB2, and to a much lesser extend SQL Server, have is their support. You can have a highly skilled technician in your office very quickly if you need it, beyond the support of a consultant could provide. I'd like to see that kind of support in open-source companies. That's when I think they'll give closed-source databases a true run for their money... literally.
Developers: We can use your help.
Right. Way to disspell one of my statements -- but there's still no stored procs, still no triggers, still nothing that would make this more than just another "make do" open source solution.
MySQL is usable, yes, and fast, but PostGreSQL is more useful with similar speed. So why use MySQL? My guess is that most MySQL developers are of the dominant school in OSS that fights against anything taught in MIS classes, meaning no objects, no complex relations, no self-cleanup or code reuse. Me, I'm all about the OOP principle of modular design and self maintenance...PostGreSQL, thorugh stored procs and triggers, allows me to code "almost" as if it were an OODBMS. This makes adding new functionality much faster and less painless...meaning that for a slightly larger initial investment I don't have to much about in pages and pages of code to alter an update statement whereever it's used. And no, just putting the statement in an include isn't enough...this reduces your ability to include multiple statements within a single transaction, furhur reducing your number of necesary connections and vastly reducing the crosstalk which is always the biggest barrier in client-server applications.
So while you might be getting a few hundred extra connections per second by using MySQL, i'm reducing my connection count by a third. Your machine gun is highly effective, but I'll take my BFG.
Hey freaks: now you're ju
My question is, why is this? Is it a result of the DBMS itself? Is it a result of different training and methodologies? Is it a result of the developers being even more eccentric than program developers? It just seems like most often there is a much simpler way of getting the same result.
The answer is that our database applications are more complicated because they actually do something useful.
A lot of commercial apps have plugins for whatever DB you want to use. Once they wise up and provide plugins for DBs like RedHat DB, Postgres, MySQL and so on, we'll start to see higher market saturation.
The second thing which will help is when we get more commercial apps ported to Linux.
This is already happening. The product I use every day - SAP is available (commercially) for Linux. They support all the big DB vendors including Oracle, MSSQL (ok, not on Linux), Informix, DB2, and their own (open source) database SAPDB.
I'm doing my bit, my site runs on PHP/MySQL.
I am not a DB developer but, I think I notice something that I would like clarified.
It seems to me that database developers and the database applications that they produce use a totally different type of logic than other developers do. So often I see database applications that are enormously convoluted, very redundant and excessively complex. Furthermore, the actual logic itself seems twisted. They jump through hoops and hurdles to arrive at solutions that seem to require very simple formulas.
My question is, why is this? Is it a result of the DBMS itself? Is it a result of different training and methodologies? Is it a result of the developers being even more eccentric than program developers? It just seems like most often there is a much simpler way of getting the same result.
Is that the GUI that rewrites your query when you click "go"? Capitalising keywords is one thing, but rearranging the boolean terms in the WHERE clause, making non-trivial queries unrecognisable after they've been performed, is just obnoxious.
I miss Meept.
Do I need to say more. :-)
-- Tyler >+++++++[-]++++.---------.+.++++.++.
Interbase has ben opensourced for some time. Borland is attempting to make money off of the add-ons and services they attach to it. You can get the source on SourceForge.
No matter how little Red Hat, Nusphere and others charge for open source RDBMS licences the author ignores the most important aspect, standardization. Do the vendor really implement the official SQL standard? My experience is that this is so much more important than if the product is open source or not. Most products are terrible in this aspect, both open source and commercial products.
Why is this so important? Most systems are far more expensive to develop and maintain than to actually purchasing the RDBMS licence. An application built on non-standard features will inevitably becomae more expensive to maintain in the future since it becomes hard to switch RDBMS product if you for some reason become unhappy with the one you have used so far.
If RDBMS software were interchangeable we would really reap the benefits of market economy. We would see a real competition situation between vendors (and open source projects as well). Today, we live in a monopoly situation in which a majority of the applications out there only works with one RDBMS brand. Of course, the same situation exists in operating systems, that is why both Oracle and Microsoft are making so much money.
commercial development has the same problems - programmers don't stick around for ever, and it can be tough to maintain someone else's code
I agree with the second part (since thats what I'm doing at the moment). However as to the former, companies do have the advantage of stock options and lock in periods.
That's what's allowed Microsoft to gain the position it has done, staff are recruited for a project and they only get their stock options if they stay for 4.5 years or more. This way you can get the same people working on at least 3 releases of a product, so by the end of their tenure they should be able to solve most problems and know the code inside out.
And of course at the end of 4.5 years the company can then offer them even more to stay or go away. 8)
I agree having the source is good insurance but it still costs money to get people up to speed if the documentations crap so firms will always go to the org. which can supply the help required (e.g. support staff, documentation, bug fixes) even if it costs more in the short term.
Somehow, Oracle is saying that the Open Source comunity is not 'capable' of producing a dominant database...
Not being overly qualified on the issue - but I thought they would both involve much the same issues - concurrency (e.g. - SMP in OS's), failsafe (Hot swap raid, clustering, and a few features yet to be developed for linux), reliabilty/stability (Linux has this!), efficiency, etc etc. It seems several Free OS's have solved all the issues that database manufacturers would face - so what are they claiming could be so complex that Free software people couldn't cope with?
TimC.
"Databases are dramatically more complicated than any Web server or operating system technology."
The above is a quote from senior marketing director Bob Shimp, from the article. I will give him the Web Server - which is not to say that it is not complex, but likely not as complex as a robust relational database. I cannot do the same for the OpSys. There is a dramatic difference in the levels of complexity between a monolithic single-user non-multitasking operating system (such as DOS) and a multiprocessing distributed parallel asymmetric (etc etc) OpSys. The quote is not grounded in any sort of evidence, and I have serious doubts as to whether the 'marketing director' would have ever encountered a kernel that did not come from a bag marked 'Orville Redenbocker'. It is simply misguided and misinformed, and the general intent seems to be in undermining confidence in Open Source DBs. (... furthering the myth that open source is 'unreliable'.) Threatened? He likely should be.
I'd like to see an object data model (ODM) open source database come into the scene. Now that would cause a ruckus, challenging both the bottom line and validity of the relational model!
lack of a sane backup mechanism? you can just copy the files around for backup...
No. You don't want your web site to turn away customers for 20 minutes every night just because your database doesn't support live replication.
Will I retire or break 10K?
Actually, they employ 3 of the 6-man core PostgreSQL team.
Well, PL/PGSQL function definetly run inside the DB with full transaction management. The problem i had with them is that you cant return whole datasets (and afaicr not even a single row). And there are no out-parameters thus making some jobs unessecary hard.
MySQL has two table types that support row-level locking and transactions. One is tied up in this contractual mess, but the other, InnoDB has no such issues, and may even be faster for many purposes.
Actually, Interbase can do "hot" backups and has support for replication.
People really ought to look more closely at Interbase. It just works.
Because of MySQL's design, there's a silver lining here. The Gemini back-end (which, BTW is the guts of the Progress database (NOT PostgreSQL, which is a competing open source database), under a different name, and open sourced) is totally stand-alone in the sense that the MySQL folks just have to continue to support the table management API that they already had for things like Berkely DB and accept bugs from everyone including NuSphere.
Outside of that, they can stick their fingers in their ears and yell, "lalalalala, we can't here you!" all they like at NuSphere, and no harm comes of it. NuSphere for their part can stick their fingers in their ears too, because 99% of their effort goes into the Gemini back-end and their Apache/PHP/MySQL shrink-wrap bundle.
These two can feud all they like, and still work together seamlessly. This is the part of the open source benefit that most closed source types don't get yet. When they do, it's going to rock thier world!
Somehow, Oracle is saying that the Open Source comunity is not 'capable' of producing a dominant database...
The instant you decide to move data and/or referential integrity from the DB into 'code', you've lost the battle. I can't believe someone would even suggest this. Sure, stored procedures are a plus and most times they aren't necessary, but you simply cannot have your integrity checks outside the DB.
Most people think that you need to have RI in the database only for consistency and it's "easier" or "faster" to handle it "in code".
The reality is that the presence of RI helps sophisticated query rewrite engines to do some very nifty transformations. So having RI actually helps you get better performing plans for read queries and hurts performance a little for writes.
At all. If you use MySQL for anything more than a teenage girl's weblog, you're asking for trouble the first time your CPU spikes.
Better go inform Yahoo that all of their unscheduled downtime is a direct result from using technology that can only power a teenager's weblog.
We use MySQL because it's stable, fast, easy to use, and doesn't cost us a ridiculous amount of money to run. We've seen one of our systems scale up from 0 queries/sec to 1200 queries/sec on x86.
Statements like this poster's are so frustratingly inaccurate that I've written a paper on dispelling these stupid myths. People can and do and ENJOY getting work done with MySQL. Don't succumb to senseless prejudices.
MySQL Myths Debunked
Not to be snide, but as a long-time Oracle user do you have any similar complaints about postgreSQL? On MySQL, I agree. I wouldn't it for any serious database need. It's better than a raw filesystem, obviously... I might use it as the backend for a simple web database or for an MS Access replacement (if it saves me the hassle of convincing an ISP to switch to pgSQL or installing software), but I'd never consider it for any serious data warehousing, inventory control, or analytics types of uses.
But most of the limits you mention are not in postgreSQL, so what does it lack? And why do you think MySQL has caught on so well, where postgreSQL has not?
I do not have a signature
HAs anyone evaluated the sleepy cat database ? It was developed by some ex postgres folks.
Aren't we basically looking at a MySQL vs. Postgres situation between the two?
I thought Open Source was supposed to create competition, with the 'best work' winning out?
Isn't this competitive?
I suppose from now on, every Debian article should mention Linus created Linux, and each tool that's mentioned in any article should give credit to the creator. I don't remember any mention of who wrote 'fortune', or Apache, or Perl, when that kid was arrested for code unbecoming of a student.
You just need to chill on your personal gripes.
"I can't give you a brain, so I'll give you a diploma" - The Great Oz (blatently stolen sig)
I'd agree with the article that the Open Source offerings currently have many limitations when compared to the commercial ones, but this is more due to their lack of maturity than anything else.
We should remember that oracle & db2 have had over 20 years to get to where they are now. Have a look at this article to see what I mean about maturity of products.
However the open source community has several advantages and disadvantages over the commercial players. 1. we dont have all the legacy bloatware which makes the commercial offerings so large 2. we're able to design using current best practice, not something which was dreamed up 20 years ago and no longer applies (no I'm not talking about the relational model but things like distributed storage, sans, nas etc).
However, we also don't have the guarentee that the original developers will still be here in 10 years time, working on the software and adapting it for new needs. Admit it, how many people are prepared to dedicate their careers to a single piece of software? not many. so can you understand why commercial companies are less than eager to use open source for critical/production systems?
The language resembles Oracle's PL/SQL (Procedural Language/SQL), except that PL/pgSQL offers the use of functions only, not procedures. A function call always returns some result,while a procedure may execute certain operations without returning a result. In some cases, database developers prefer using procedures and "stored procedures,"
So call the function and ignore the results. Duh.. But seriously, the article must not be describing the problem correctly. Do these databases have true Stored Procedures, as in your code running inside the RDBMS with the benefits of transaction management? I doubt it.
The open source db's are way, way behind. Like 15 years behind. If you develop an App of any size, go straight to Oracle on Linux. You can use all the Open source tools with it.
Does that imply a fully fledged Java VM that executes stored procedures in Java?
Is something like PLSQL a mandatory part of something we call a relational database?
Oracle has a maximum view on relational databases, because it is their instrument to dominate adjacent markets; just as the OS is for M$.
PLSQL is something created for the benefit of Oracle, not for the benefit of the customer, who gets stuck in a proprietary language and horrible design consequences.
Think of how many VB-based desktop apps are out there - figure that probably 70-80% of them bundle some form of the Jet engine, and/or use Access locally. That's been spreading for *years* and if you count that, 3% of the market for MySQL, PostgreSQL and others doesn't sound too far out. Of 'web-related' databases, I'd figure MySQL and PostgreSQL are probably a lot higher - certainly in the double digits.
creation science book
Sasha Pachev
MySQL Developer
Doh. and thanx. This never even occured to me... measuring the success of OSS (ie. free) in terms of revenue seems a bit too weird :)
-Kraft
Live and let live
But does MySQL support Sub-selects?
Bah ! I remember in the early 80's when big iron buddies used to point ant laugh at dBase II. What they didn't understand, and what some of the big database boys and users don't understand now, is that larger isn't always better.
Databases like MySQL make it very easy for webhosting companies to offer free databases without loosing their shirts or minds. They make it very easy for students to learn SQL. They're also much kinder on resource.
Yes, I'd love to be able to roll-back pooched transactions, but then I have to commit everything as well. Certainly cascades would be slick, but poorly written, they can shoot your foot clean off. Likewise, I can see all the lame support calls coming in because users don't understand the triggers are attempting to maintain referential integrity on foreign keys.
Within a given context, sometimes smaller is suits the purpose better.
healyourchurchwebsite.com - WWJB?
The exclusion of the most robust Open Source database product makes the article complete crap.
If a database goes wrong (and in Oracles case, my experience is that that's often), and we can't solve it ourselves, we need to be able to get on the phone and speak to somebody who can help. Now, I know that there are companies that offer support for OS DBMS's, but Oracle, Sybase and IBM's round the clock support offering is what i'm after. and getting skilled technicians (possibly the development team itself) involved quickly. OK, so open source offers this as by merit of "use the source luke", but in a corporate environment, this is neither likely or necessarily sensible.
Another, and perhaps more important, aspect to bear in mind (and this is not covered by the article for obvious reasons) is that Oracle, Sybase and DB2 are not the be-all and end-all of RDBMS offerings. There are better, and often significantly cheaper, closed-source offerings out there. One of my current favourites (which I'm working with at the moment) is Clustra - a DBMS that offers 99.999% availability, scheduled and unscheduled, pretty much out of the box, with Linux as their first released OS for the latest 4.1 offering
So, in a nutshell - Open source support offerings need to be improved, but don't rule out the smaller fish in this crowded, and very competitive pond.
Who said databases were boring?
ooooooh! What does this button do? - DeeDee, Dexters Lab.
MySQL is a joke.
What? A web developer bashing the SQL server basically designed for web development? Yeah, and for very simple reasons:
1) No transaction protection means no reliability (and no, hacked add-ins do not transaction protection make) At all. If you use MySQL for anything more than a teenage girl's weblog, you're asking for trouble the first time your CPU spikes.
2) No triggers means relying on slow connections to do all your work across servers. Update a table and need to update its relations? Well, you'd better know their structures implicitly.
3) No stored procs: I couldn't fricking beleive this when I first used MySQL. What do you mean, no stored procs, no conditional logic in statements and no subqueries? MySQL basically requires you to code bad SQL...lots of crosstalk between servers and lots of iterative operations that should be done for you.
4) A very shoddy GUI. The shoddiest, in fact...it's the only GUI I've ever used for an RDB that was worse than raw SQL.
If you're doing any real development work, drop MySQL like a bad habit and pick up PostGreSQL. PGSQL does everything the big boys (db2, MS SQL, Sybase, Oracle) do and fairly well, meaning it can scale like a motherfucker. I ported our site from MS SQL to two PostGreSQL servers in a day and a half, after a week of trying to rewrite all our SPs in java and C and basically reducing the speed of our hefty article management work to a pittance.
MySQL has a slight advantage over using comma delimited text files or a good XML parser, but considering that there's a much better option in PostGreSQL, it will never touch my servers again. It's Free Software -- Free as in Free Dung.
Hey freaks: now you're ju
1. Fully transactional
2. Linearly scalable clustering
3. transparently fault tolerant. You can shut down a box in a cluster an clients don't notice a thing. 4. MUCH better performance (on a single box) than Oracle, MySQL, Postgress. When it's available in September download it, and prove it to yourself. The announcement will (hopefully) be posted here.
I don't think you can "abstract away transaction related stuff" from the RDBMS. Please correct me if I'm wrong; but I believe that you simply can not start with a RDBMS that does not support transactions; and slap a transaction processing middleware on top of it to instantly have a database application with transactions.
The standard transactional interfaces that are increasingly becoming popular nowadays (like JTA) depend on the database supporting transactions; most likely in the form of an XA-conformant programming interface.
Zigbee Central: A Zigbee weblog
It has been exceedingly difficult to get mysql evaluated for use in the corporate world due to its open source nature. (yes, the "but, who do we sue? mindset...). Wars like this one will make it even more difficult. Now we have to tell our managers the DB and the transaction processing come from 2 different and warring companies, but dont worry, they will always be compatable with each other... Oh well, back to oracle for even those projects that mysql is fully capable of performing.
COMPLETELY off-topic, but thanks for the link to the articles on drugs. (See the web address given by Kraft, above.)
We have the drug laws we do, I think, largely because there are members of our society who want to have gun battles. Most of our drug prevention laws don't prevent.
Bush's education improvements were
In any case, is it true that MYSQL AB doesn't ever integrate patches that they receive into their code? If this is true, then I can't help but worry that they're eventually going to try an establish themselves as a free software company, and then, since they are the original (and only) copyright holder, that they will suddenly decide to re-license mySQL under a non-free license.
mySQL was only recently re-licenced under the GPL, so it's not like this company hasn't ever had desires to control this code.
Help me out. Is this an irrational fear? If not, then I find myself glad that Nusphere has forked a copy, and abided by the GPL. I know that it was kinda in doubt as to whether or not Nusphere was going to do this, but isn't this a good thing if only to protect against MySQL AB deciding to relicense to a non-free license?
<disclaimer>
I am not employed by, nor related to Nusphere or MYSQL AB in any way. I'm just a curious user with a stupid question.
</disclaimer>
Key to financial independence: Spend less than you earn. Save and invest the difference. Do it for a long time.
Anybody notice that {the article mentions/ quotes NuSphere extensively, mentions InterBase (what is it?) prominently}
Mysql.com is mentioned as a competitor rather than an upstream developer.
Who paid for the booze/women?
helping build a case for MySQL against Nusphere. Sure.
I've seen it repeated dozens of times in the last month or two. I guess Apache on windows is really popular. And why bother with .NET (or change SMB) if windows already has the lion's share of the server market?
Nobody seems to have noticed SAP DB becoming Open Source last year, but it too is powerful and reliable and includes full transaction support.
Got time? Spend some of it coding or testing
But keep whining or Mr Nezzer will send his penguins out to find out why you've stopped. (-:
That's the big thing about open source: freedom (or call it control) - not price, not features. Don't like it? Change it or choose another.
Got time? Spend some of it coding or testing
As for data lossage, well, there's a lot to discuss about on-disc caches and power supplies, SCSI vs. IDE. The best guarantee against data loss is still a big-ass UPS and some really fscking attentive operators.
And besides that, you will (1) probably know why your code works and (2) not have to deal with next-version breakages anywhere near as often.
Got time? Spend some of it coding or testing