Slashdot Mirror


Open Source Message Queuing System

psicode writes "John Davies has announced AMQ, an effort at JPMorgan Chase & Co. to create an open-source message queuing system that can compete with proprietary message systems like IBM MQSeries and Tibco/RV. The announcement was made at the annual conference Web Services on Wall Street during Davies' presentation on February 1. eWeek has an article today with more details and some funny statements about Red Hat, SuSE and Sun possibly integrating AMQ into their "kernel". If JPMorgan Chase & Co. follows through with their announcement and they come up with a suitable open-source license, AMQ could become the Apache of messaging systems."

24 of 350 comments (clear)

  1. Re:"Kernel" by superpulpsicle · · Score: 2, Insightful

    Perhaps it's worth mentioning since they are integrating an app into the kernel. At least that's what it sounds like. Well if you wonder why kernels seem to get more and more bloated...

  2. "A suitable open-source license"? by Russ+Nelson · · Score: 2, Insightful

    "they come up with a suitable open-source license, AMQ could become the Apache of messaging systems."

    If they want to be the Apache, then they'll have to use the Apache license too. Effects have causes.
    -russ

    --
    Don't piss off The Angry Economist
  3. I bet this really pisses off the copyright expansi by ShatteredDream · · Score: 3, Insightful

    As a voting libertarian, I whole-heartedly encourage companies to actively develop whatever technical solution that best fits their needs. This is one example of how open source software really fits in with the libertarian world view. It's not the "free software versus only commercial software," but a mix and match that lets both coexist. If someone wants to develop their own software, then let them and don't even begrudge them the right to give it away.

    This is what really pisses me off about the copyright expansionists. They don't want people to be able to easily develop software for free. Copyright expansionism, as pushed by groups like the "Progress and Freedom Foundation" is not about freedom, it's about protecting business against hobbyists and other "asymmetric competition." I bet it makes such groups' heads spin to think that one of the biggest corporations on Wall Street is now about to dive head first into open source development and that the result of this development could send shockwaves through a segment of the commercial software industry.

    The freedom to write open source software is the same freedom to write closed source software. If you erode the foundation for the former, then you have no right to demand respect for the latter. That is why when the big copyright cartels lobby Congress, I see nothing wrong in doing things like buying academic licenses for software and taking them out into the real world. The copyright holder makes no profit on the academic license, only the seller does.

  4. a camel by St.+Arbirix · · Score: 3, Insightful

    an open-source message queuing system that can compete with proprietary message systems like IBM MQSeries

    Somewhere in IBM's headquarters there is a camel. A straw has just been placed on its back.

    --
    Direct away from face when opening.
  5. Re:Messaging = IMing? by jdray · · Score: 4, Insightful

    I have noticed the phenomenon you mention, though I would hardly call it "anyone." I suppose I could have elaborated on the details of how a system-based message queuing system is designed to be a lossless, connectionless method for intrasystem messaging, much like a small town post office, where one piece of software delivers a message, often packaged as XML or CSV, and marks it for entry into a particular queue or stack. When other pieces of software are subscribed to the queue in question, they pick up the messages that get registered there. The messages are either destroyed on pick up or stay in the queue, depending on what type the queue is. But all this is just a surface look at how MQs are used and how they work. A layman's introduction, it might be said. It also doesn't cover the fact that they can be used as the back-end for IM systems, if you write the appropriate client software. I was thinking that this person might like to have their choice of in-depth articles to read that would educate them far more than I was willing to in the short time alloted to me for reading Slashdot each day.

    But thanks for your concern. I'm done trolling for now, how about you?

    --
    The Spoon
    Updated 6/28/2011
  6. Savings by blackmonday · · Score: 3, Insightful

    Some years ago a company I worked for was quoted one hundred thousand dollars as the cost to license IBM MQ Series messaging. There could be some serious savings in using an OSS product like this.

  7. Flabbergasted by Anonymous Coward · · Score: 4, Insightful

    By the technical ignorance of some of the posters here... Before you post, please make sure you have at least an inkling about what you're talking about! A Message-Oriented Middleware system has absolutely nothing to do with IM, or Web Services (except in a very indirect way), or even REST systems. /. seems to be in dire need of real geeks, it seems...

    1. Re:Flabbergasted by slcdb · · Score: 3, Insightful
      As one other Slashdotter commented about the article itself:
      Buzzword, buzzword, buzzword, incorrectly used terminology, buzzword, buzzword, buzzword...
      The same could be said to summarize most of the Slashdot readers' comments.

      I guess somebody just needs to say it: the article was crap, and Slashdot was the wrong forum for discussing it.
      --
      Despite what EULAs say, most software is sold, not licensed.
  8. Re:"What Is Message Queuing?" by Anonymous Coward · · Score: 2, Insightful

    How is this different from e-mail? It sounds the just like e-mail that happens to be carrying messages that are intended to be parsed by applications, rather than humans. What's the magic? Is this just a more secure, reliable mail system?

  9. Re:"What Is Message Queuing?" by EsbenMoseHansen · · Score: 2, Insightful

    <sarcasm>Really hard to do, if it is meant in the MQSeries way.</sarcasm> If MQSeries can't deliver a message, it puts it on a dead.letters.queue. I am not impressed.

    --
    Religion is regarded by the common people as true, by the wise as false, and by rulers as useful.
  10. Re:I bet this really pisses off the copyright expa by Anonymous Coward · · Score: 2, Insightful

    >This is what really pisses me off about the copyright expansionists.

    I really appreciate source code licenses that actually let you use the source code permanently such as BSD.

    Copyright expansionist vehicles, such as GPL, end up costing too much in the long run.

  11. Re:JMS by leerpm · · Score: 2, Insightful

    Did you read the article? The whole point of this project, is they need something that can support more than just Java! As much as the people on the TSS.com like to feel, Java is not always the best solution and sometimes you do need to write some high perf. sensitive code in unmanaged code like C/C++. You can't do that with a JMS based solution, at least not easily.

  12. Re:"What Is Message Queuing?" by Greyfox · · Score: 2, Insightful
    It's not really revolutionary. It's evolutionary. I can tell you how this probably worked; someone probably noticed that they'd coded the same message code on top of TCP/IP several times and decided to make a reusable library and API so that they wouldn't have to do it again. They probably showed it to their manager, who probably thought it was cool beans and passed it up the chain. Sometimes, that's how commercial products are born, too.

    From what I've seen of MQ et al, they don't seem to offer that much on top of standard TCP/IP, but it eventually gets to be a pain in the ass to reimplement that sort of thing in every position. Especially when you factor debugging and stuff in.

    --

    I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

  13. Re:"What Is Message Queuing?" by azaris · · Score: 2, Insightful

    Surprise, surprise, this sounds just like SMTP.

    Ever had a situation where an SMTP server screws up the mail queue and deletes all the messages? Or the server goes down at the wrong moment and as a result all messages are delivered twice? Or a message gets stuck in a loop and gets sent over and over again, thousands of times until it fills the spool?

    If that message happens to trigger a large financial transaction, that would be a bad thing.

  14. please someone explain. by Lord+Bitman · · Score: 3, Insightful

    What is a message queue, why should I care, what does this have to do with anything, what are they talking about? In short: what kinds of messages are we talking about, what are sending them to what, and why do we need to queue them?

    "A message queue is a queue onto which messages can be placed."
    thanks a fucking lot google

    --
    -- 'The' Lord and Master Bitman On High, Master Of All
    1. Re:please someone explain. by demachina · · Score: 2, Insightful

      I imagine JP Morgan developed their message queue to send stock or other financial transactions from one place to another, for example from customer, to broker, to exchange and back again. I imagine if you've bought stocks online it was all done through message queue transactions and its unlikely there was ever a human in the loop. If that is the context the environment they are using it in it has to both be extremely reliable, since large quantities of money are involved, and it has to handle potentially very large and variable loads.

      Another example would be Walmart. Everytime you buy something in one of their stores the cash register is sending message is sent to a gigantic computer system in Arkansas which tracks everything sold. Every distribution center also sends messages when trucks arrive with new inventory or trucks leave for a store to restock a store that is running low on stuff, and the message(s) describe all the inventory taken off of or put on the truck. If they ever manage to RFID tag everything as is their desire then RFID tag readers will generate most of the messages automaticly when things move and there will be even fewer people in the loop.

      Walmart's messaging system allows them to know exactly what inventory is in every store(aside from shoplifting), every distribution center and every in transit truck. When a store gets low on something I imagine its nearly automatic for a distribution center to put the needed items on a truck and restock the store with minimal human intervention.

      Walmart's system also allows all of their suppliers to track, on a store by store basis, and near real-time, how their products are selling in every store so they know whats selling, whats not and how much of which products they will need to produce and have ready to deliver to Walmart, just in time.

      If you want to run a very high volume, high profit distributed business, with very high efficiency chances are you will have some very fast, high volume, reliable, and powerful message queues in the heart of it.

      --
      @de_machina
  15. Re:I bet this really pisses off the copyright expa by Changa_MC · · Score: 2, Insightful
    If you don't want to give your code away for free, don't take other people's code for free. I really get sick of people whining about how they want free code so they can sell it to other people.

    GPL = something for something.

    --
    Changa hates change.
  16. Queue Redux by Doc+Ruby · · Score: 4, Insightful

    Keep in mind that Wall Street was probably *the* major engine driving Web applications into the mainstream in the 1990s. One reason Wall Street went crazy touting the Web as an unlimited business panacea was that it was actually like that for its own industry. By the time they promoted it in 1995, Wall Street shops had been churning out httpd patches, CGI apps, Perl revisions and code, DB connection software and techniques, TCL patterns, and all kinds of R&D that underpinned much of the development momentum. Message Queueing has a similar arc, because Wall Street both inhabits the bloodiest edge on which they can survive, and has the least tolerance for failure. The flakiness of network messaging is the root of some of the worst inhibition on network growth among users and deployers - Wall Street has been there, and has answers. Let's use them.

    --

    --
    make install -not war

  17. Re:Web services by johnnyb · · Score: 2, Insightful

    I've found the general CORBA framework to be pretty simple, and even taught it in a C++ intro class. There's a lot of details, but that's true of any well-thought-out system. Often times complaints of "complexity" are actually complaints about something being well thought out. Attempts to "simplify" just bring about evil things like SOAP, which, despite it's acronym is not simple, has nothing to do with objects, and isn't even a specced out protocol. "access" is the only part of its name that isn't a complete fabrication.

  18. Re:"What Is Message Queuing?" by vidarh · · Score: 4, Insightful
    Except that most mail servers aren't designed to give the kind of delivery guarantees that message queueing software like MQSeries does. Most are also not designed for the kind of performance you can get out of many message queuing solutions that take advantage of the fact that the number of recipients tend to be low (compared to e-mail) and keeping persistent connections to some or all queue endpoints may be acceptable; and neither are they designed to provide support for transactions etc.

    It's not that this can't be done over SMTP, but that SMTP isn't practical for it - you'd need lots of extra data in the headers, and applications supporting it.

    Sure, you can write the support for all of it on top of SMTP, or FTP or SCP or HTTP or any protocol you can think of that can move data from one point to another, but the whole point of message queueing applications is that the heavy lifting has been done for you.

    If you don't care about the transactions, or it doesn't matter if your messages can be delivered twice by mistake, or any of the other features of a proper message queuing system, then sure, go ahead and use a mail server - a previous place I worked we used Qmail with good results. It's a trade off, but the difference is huge.

  19. open-source message queuing system by Scott7477 · · Score: 2, Insightful

    What JP Morgan and other Wall Street firms use message queuing software for is trading in the financial markets. So if the software bugs out, they stand to lose millions of dollars per minute or more depending on the size of the trades they are executing. So I see this story as a positive for open source software because if Wall Street people think they can get a usable mission critical piece of software out of the open source community then no other potential target for OSS is invulnerable.

    --
    "Lack of technical competence coupled with the arrogance of power, as usual, leads to no good end."
  20. Re:"What Is Message Queuing?" by molo · · Score: 2, Insightful

    There is no guarantee that the receiver will ever pick up the message from the queue. Just like SMTP, I can send you a message, but there is no guarantee that you will ever look at your mailspool/inbox/pop server/imap server. My point is that it is no better than SMTP.

    -molo

    --
    Using your sig line to advertise for friends is lame.
  21. Why? by Ratbert42 · · Score: 2, Insightful

    Everyone's asking "Why?" and debating the technical bits. I'll tell you why. So they can get a deep discount on MQSeries from IBM.

  22. I bet guys who make MQSeries must be nervous by Donny+Smith · · Score: 2, Insightful

    I bet it'll take at least 5 years before this new thing makes any inroads in financial customers, but this must be really scary for IBM's MQSeries folks.

    Things like MQ Series are bread-and-butter of many sales reps as there's no serious competition to their solution - I haven't talked to many banks, but those to which I did all use MQSeries.

    OSS is moving from the edge to the data center, it's already half-way there. Five more years and banks will be able to get 80% of their apps under GPL license.