Slashdot Mirror


The Open Source Dilemma for Governments

Sam Hiser writes "Tom Adelstein, open source consultant and Member of the Open Government Interoperability Project ("OGIP") working group, offers another incisive article in which he discusses the costs in the terms of lives and dollars when local governments do not deploy open standards-based software for data sharing. Asks Adelstein, 'Can local governments afford to create redundant applications to meet new Federal standards for first responder alerts, emergency services, law enforcement, broadcasters?' He posits that Open Source collaborative initiatives may provide the only solution for the US if the people want to create a safer environment."

30 of 163 comments (clear)

  1. The Open Source Software Institute... by tcopeland · · Score: 5, Informative

    ...is a big supporter of this sort of thing. Check them out here. The OSSI is chaired by John Weathersby, who seems to have a good handle on how to communicate effectively via standards, reports, certifications, and so on with folks in the U.S. government.

    1. Re:The Open Source Software Institute... by ReTay · · Score: 5, Insightful

      "So as more people use open source, the bigger target it becomes to hackers."

      Care to tell me why that Apache is so much more secure then IIS?
      Apache is the most popular web server in the world. But IIS has the most flaws....

    2. Re:The Open Source Software Institute... by dasmegabyte · · Score: 4, Informative
      Apache is more secure than IIS because:
      • Apache generally runs as an unprivliged user -- IIS by default runs as the local system and on some systems I've seen has been set up to run as a privlidged network user (to get around problems with content on networked drives).
      • Apache is designed to do less than IIS. Comparing the two isn't even fair...IIS is a web server, an email server, an ftp server, etc etc. It's designed to do EVERYTHING. So it's not apples to apples...more like apples to an appleseed.
      • By default, Apache only installs a few basic modules. Almost everything is optional. IIS, designed to be an end-to-end solution for internet servers, installs everything. If you lock it down, remove the crap you don't use, it's much better off.
      • Apache has more people working on it and more frequent bug releases. MS has to worry about massive overhead and support costs with every release...so they space them apart further. My company does the same thing.


      Anyhow, this article is a lot of FUD. I write software for local governments, and at least in this state (which is one of the richest in the US), OSS wouldn't save any money nor eliminate any problems. "Code Security" is not a big problem in local government -- as local governments generally only use their digital systems to warehouse and process publically available information. These guys keep paper records going back to the 18th century, and if anything seems out of the ordinary they check the paper. Heck, if tax rolls come out twenty cents unbalanced from the invoice, we have to audit the programs line by line. And if asked, we readily turn over our code to local auditors. Very rarely do we do this. Nobody cares about anything except getting the software to cut down on their workload.

      And that's the biggest problem in this market: accountability. Small companys come in, install software, and then disappear. So when laws and regulations change, there's nobody to update the old software. Most of these people don't have IT departments (some don't even have computers in some departments, or use their own personal machines...the assessor in my home town runs a computer shop and that's how he got the job!). There is so little money, that only by relying on companys to help with everything from installing printers to writing custom tax logic for way less than the standard consulting rate (hoping to get a chance to use it somewhere else) can these towns get their software written.

      Can you imagine the accountability headaches associated with asking a "community" to write custom tax logic? With not having a responsible party you can call when stuff breaks? You'd still have to pay somebody out of your budget (which is sometimes set five or more YEARS in advance) to support the program, only they wouldn't have any real interest invested in fixing the program quickly. There's incentive with private software to deliver the best, easiest to use stuff you can for whatever price you can get.

      Don't get me wrong...I like the idea of getting more eyes on my code...but I can't imagine injecting community code into a hectic development schedule like we maintain. It seems like it'd be inviting too much uncertainty in an arena that only thrives with a stable support structure. My boss would surely never go for it. Of course, I don't expect many of the OSS acolytes to agree with me...some people don't seem to understand that the minimum wage people working without possibility of overtime at the county clerk's office don't want to visit the newsgroups for help when they have bugs preventing their license software from printing.
      --
      Hey freaks: now you're ju
    3. Re:The Open Source Software Institute... by chrisreedy · · Score: 4, Interesting

      I have a lot of experience with software for local law enforcement agencies. This particular area is a morass of smaller and larger companies, each with their own software packages that may or may not interoperate with their competitors. I've seen a number of small police agencies that have been trapped by trying to support a package from a vendor that either (a) is out of business, or (b) is no longer supporting the package/version in question. In my judgement, a good open source package supporting local law enforcement could make major improvements to the situation.

      Having said that, I don't think the existence of such a package would, in fact, put many of these vendors out of business. Most local police departments don't have the expertise to manage the installation (including data conversion!), tailoring, etc. that is required for any such package. There would still be plenty of opportunity for companies to provide this as a service.

      However, the fact that the underlying package was standard, and known and understood by more than the employess of a single company would help insulate the local police from the problems that arise when their support organization moves on, for whatever reason.

      In addition, there is a big drive these days for national, state, and regional, and local interoperability between law enforcement agencies. Anything that helps to standardize data models, etc. etc. would be a big help in this area.

    4. Re:The Open Source Software Institute... by cmacb · · Score: 4, Insightful

      "Anyhow, this article is a lot of FUD. I write software for local governments, and at least in this state (which is one of the richest in the US), OSS wouldn't save any money nor eliminate any problems."

      That's a strong statement. I'd say that there is more FUD in your post than in the original article. Maybe you forget that a lot of Slashdotters are, or have been government workers too...

      '"Code Security" is not a big problem in local government -- as local governments generally only use their digital systems to warehouse and process publically available information. These guys keep paper records going back to the 18th century, and if anything seems out of the ordinary they check the paper.'

      I worked at a federal agency that had everything stored on paper too. One day they decided to double check some things and found out the off-site storage facility they had been paying for years had no idea where most of their documents were. Those that could be found were water damaged beyond being readable.

      So much for using paper as a back-up mechanism. I think part of the point of the article is that local governments do things on-the-cheap and that if they all shared more of their systems the systems would likely improve for everyone, even the smallest local agencies.

      "And if asked, we readily turn over our code to local auditors. Very rarely do we do this. Nobody cares about anything except getting the software to cut down on their workload."

      Sam here. But they never ask. Thats the problem. They don't know if contractors are sticking to standard coding practices, they don't know if third party "shareware" components have snuck into their systems (and they have) and they don't get involved with these issues until something breaks, and by then it's probably too late. More eyes on the code solves this too. Worst case, after the same breakage occurs for one local shop, other local shops will at least be aware that there is a problem that needs to be addressed (and most of them will only have to apply the fix, not invent it).

      "And that's the biggest problem in this market: accountability. Small companys come in, install software, and then disappear."

      Right, small companies like yours, supplying one of a kind mixtures of COTS software and local code. You most likely have a long term contract where you are because you have wired a dependence on your institutional knowledge into your systems. Good for you, not good for taxpayers.

      "Can you imagine the accountability headaches associated with asking a "community" to write custom tax logic? "

      Again, you seem to have missed the point, which was that there is not all that much variation from one location to another. The types of variation caused by different tax rates etc. should not be buried in code logic anyway, but should be in parameter control files and be alterable at a fairly high level.

      "Don't get me wrong...I like the idea of getting more eyes on my code...but I can't imagine injecting community code into a hectic development schedule like we maintain."

      Well, from what you have said, it most likely wouldn't be your code getting examined. Most likely in fact you would adapt code written at a larger, richer locality to your needs.

      "My boss would surely never go for it. Of course, I don't expect many of the OSS acolytes to agree with me...some people don't seem to understand that the minimum wage people working without possibility of overtime at the county clerk's office don't want to visit the newsgroups for help when they have bugs preventing their license software from printing."

      Both you, and your boss probably won't go for it until you see other similar localities going for it successfully. At the federal level almost everyone looks to other agencies for guidance. With no agency in a clear leadership position you end up with the same thing you get in any leaderless organizations, n

  2. Well i would have thought this is obvious by Anonymous Coward · · Score: 4, Interesting

    If we want secure software, it has to be open source.. Granted, at the start the code quality of open source stuff is around equal to closed source stuff but the resources available to check code that is public are far larger than any closed source firm can muster.

    Simon.

    1. Re:Well i would have thought this is obvious by Lord+Kholdan · · Score: 4, Insightful

      If we want secure software, it has to be open source.. Granted, at the start the code quality of open source stuff is around equal to closed source stuff but the resources available to check code that is public are far larger than any closed source firm can muster.

      Potential resources mean nothing. Open source code that no-one bothers to read isn't going to get better on it's own.

  3. Open Data formats more important by i.r.id10t · · Score: 5, Insightful

    I don't care if the US Senate or House chooses to use MS Office or vi or whatever - as long as the documents they produce are of an open format (text, rtf, XML, whatever), and can be read by us Citizens (and others, why not?) wihtout needing to have a particular piece of software. Same can be said of exchanging data between various levels, types, and branches of government.

    --
    Don't blame me, I voted for Kodos
    1. Re:Open Data formats more important by Anonymous Coward · · Score: 4, Insightful

      I'd rather my government spend my tax dollars on something other than Microsoft software.

    2. Re:Open Data formats more important by happyfrogcow · · Score: 4, Funny

      Score: -1, Use of the word "Terrorist" to strengthen argument

      ;) just kidding... mostly.. a little bit anyway.

  4. Text for the soon to be slashdotted.. by Anonymous Coward · · Score: 5, Informative

    The Open Source Dilemma for Governments

    by Tom Adelstein
    January 04, 2004

    If someone told you a hole existed in the competitive landscape for a large and highly addressable US market segment you would call them a niche miner. If I told you the cream of that niche totaled $56 billion and could be addressed in a three to five year time frame you might wonder how you missed it. Don't feel bad, it seems that the major computer companies have missed it too.

    In a nutshell, the local government software market has not drawn large software firms. Also, independent software vendors (ISV's) have failed to adequately satisfy this market's needs as they lack the resources to serve the large geographical base. People have viewed this market as fragmented, requiring too much one-off customization with long sales cycles. Since the tragedy of September 11, 2001 those barriers and the poor economics of serving this sector have changed. You might call this a new opportunity.
    What's At-Stake

    Local governments must upgrade their computer infrastructures. That means additional taxes, levies and bond issues lie ahead. They could ignore their ailing systems and that means putting people's lives at risk. If the American public understood this problem one might see some intense interest at town hall meetings. If mayors and city councils really understood this problem they might panic. Perhaps some of us also wonder how much frustration US agency and department personnel feel as they hurry to make a bigger impact in a faster time frame and run into muck of local government.

    An example of the problem local governments face exists on the website of the US Department of Justice - Office of Justice Programs, under the Global Justice Data Model http://it.ojp.gov/topic.jsp?topic_id=43. On that page, the authors write:

    Approximately 16,000 justice and public safety-related data elements were collected from various local and state government sources. These were analyzed and reduced to around 2,000 unique data elements that were then incorporated into about 300 data objects or reusable components. These components have inherent qualities enabling access from multiple sources and reuse in multiple applications. In addition, the standardization of the core components resulted in significant potential for increased interoperability among and between justice and public safety information systems.

    Many of those 16,000 fields contain the same type of information with a different naming scheme. For example, some databases use the field " name_first" and others use "first_name". Then you might find "firstname" or "givenname" or "given_name".

    As you go through the local government databases, you find a myriad of schemes for everything from last_name to zip_code. Obvious, the nation's information stores contain massive redundancies. These redundancies make it difficult to share data and provide alerts.

    So, add all the separate naming schemes of local government databases together and you get 16,000 variations. Create a standard and it goes down to 2,000. Put those into categories of reusable components and you wind up with 300 database elements. That's why they call it a standard. It allows disparate systems to work together. It starts to open the window of a manageable task when the interoperable elements number 300 instead of 16,000.
    Non-Compliance Problems and Their Costs to You and Me

    Recently, I received two requests to assist a local government and a university in the same area of deploying justice databases. The requests involved implementing a new, comprehensive application to provide services and a tracking system using a web-enabled database-driven application. The requirements of the applications seemed simple and with the use of the Global Justice Data Model, I estimated delivery within 90 days. In both instances, the people controlling those projects dismissed implementation of the standards-based model.

    What should one do when government entitie

  5. The reverse would seem to be true by Anonymous Coward · · Score: 5, Insightful

    For pure niche apps (patrol car suspect lookups, etc), I would posit that small commercial companies are in the best possible position to provide support and apps, not the FOSS world - after all, where does your teenage A-Patchy Webserver hacker get his hands on the specialty hardware used in patrol cars?

    1. Re:The reverse would seem to be true by worm+eater · · Score: 3, Insightful

      I would posit that small commercial companies are in the best possible position to provide support and apps, not the FOSS world

      Why wouldn't a small commercial company writing open source software be in this exact same 'best possible' position? Nothing about open source precludes it from being commercial, especially when we are talking about niche hardware. Making it open source would just allow citizens to know what is going on, and allow another commercial company to take over when the first one goes out of business.

      --
      Maybe partying will help...
    2. Re: The reverse would seem to be true by Black+Parrot · · Score: 4, Insightful


      > For pure niche apps (patrol car suspect lookups, etc), I would posit that small commercial companies are in the best possible position to provide support and apps, not the FOSS world

      I have a friend who works in IT at a small college, and her group's primary responsibility is maintaining a big commercial app that manages schoolish stuff like registration, etc. Schools all over the state use the same app, so they have a sort of loose association of maintainers across the state, several per college, adding up to several score programmers in total.

      She gripes a lot because every time a new release comes out the association has to hack back in all the customizations they've made over the years. I keep telling her that for the number of people and amount of effort involved, they could write their own FOSS application to do the same thing, and spend their time making improvements rather than restoring last year's hacks year after year.

      > after all, where does your teenage A-Patchy Webserver hacker get his hands on the specialty hardware used in patrol cars?

      Who says it has to be teenage hackers? If a dozen of the biggest cities' IT departments dedicated one programmer each, the job could be done easily at a dispersed cost, trivial in comparison to the total spent when thousands of cities buy the software at commercial prices.

      --
      Sheesh, evil *and* a jerk. -- Jade
  6. it's already been admitted by relrelrel · · Score: 5, Insightful

    by the UK goverment that they might "look-in" to open source software themselves simply because they know it scares Microsoft, like Germany, who got massive discounts.

    A goverment just has to say it's thinking about it to get Microsoft scared and giving out vouchers left right and centre.

    Expect to see alot more /. stories on goverments considering OSS and then stories a few months later about them receiving massive discounts.

    --
    --- any post that takes longer than 20 seconds to write, isn't worth writing
    1. Re:it's already been admitted by Teux · · Score: 4, Interesting

      The interesting upshoot of this has been that when governments actually commission a study on the total cost of ownership for a Linux/Open Source solution, they find switching is to their benefit

      Microsoft's is doing it's best to keep the bleeding to a minimum, but more companies and governments are realizing that moving away from their dependency on MS is a Good Thing(tm)

  7. Government not supposed to work that way by Anonymous Coward · · Score: 5, Interesting

    Can local governments afford to create redundant applications to meet new Federal standards for first responder alerts, emergency services, law enforcement, broadcasters

    No! With or without open source, we can't afford such nonsense.

    This is another clear example of the overgrowth of the role of the federal government. They're going to run our local governments deeper into debt with these ridiculous unfunded mandates that may be wildly inappropriate for a given locality. The constitution clearly states the roles of the federal government and leaves the rest to the states and localities. This along with over-regulation of personal lifestyles that's going to come with public healthcare, are the biggest disasters on the horizon.

  8. SLG does not respond well to Open Source because by pauly_thumbs · · Score: 5, Insightful

    1)"Free" is not a good motivator - coming in under budget is not a motivator if they want budget they need to spend budget

    2) it's too complex for SLG admins, it's not as easy to pass an open source torch on to your new team mate or underling.

    what will motivate Open Sopurce Adoption?

    those 400k novell seats and their admins that still run win9x and office 97 need an upgrade very badly. If Novell/SUSe and Ximian can pull off a compelling solution then you will see huga adoptions -- not these onsie twosie deals.

    Mod me down if you like but this is a strong emerging market.

  9. AMBER ALERT! by drdreff · · Score: 4, Insightful

    Sorry you need to update your version of Microsoft Office to 2003sp3 in order to report a child missing.

    When timing is critical a commercial solution can fall flat on it's face.

    --
    As seen on Wired: Get a free desktop PC
    1. Re:AMBER ALERT! by NanoGator · · Score: 3, Funny

      "Sorry you need to update your version of Microsoft Office to 2003sp3 in order to report a child missing."

      Careful about firing shots like that. Open Source has it's downsides too. You don't want anybody scoring a +3 funny on ya.

      --
      "Derp de derp."
    2. Re:AMBER ALERT! by IthnkImParanoid · · Score: 3, Insightful

      Sorry, but if someone takes down a critical part of an Amber Alert type system to update software without any sort of redundancy to keep the system going, the fault is with them, bot the software or OS. I dislike Microsoft software in general as much as the next /.er, but in what situation would this happen?

      --
      It's nothing but crumpled porno and Ayn Rand.
  10. Re:what's the dilemma? by Jim_Maryland · · Score: 3, Interesting

    Open source software plays a big role in many projects where I work, and our clients tend to be gov/mil related. While not all open source software is "good", you can't lump it all together and say it's "trash".

  11. Comment removed by account_deleted · · Score: 5, Insightful

    Comment removed based on user account deletion

  12. gov't lacking in expertise and money for software by poopie · · Score: 4, Interesting

    The issues that this article brings up are similar regardless of whether commercial software or opensource software is used.

    This article is really talking about standardization and consistency across government organizations -- a huge job.

    Imaging thousands of individual offices who have operated in a certain way for a hundred years. Imagine all of the paperwork, homemade spreadsheets, interoffice memos that spawn secondary spreadsheets, etc. This unfortunately is how the US government works.

    Now imagine someone coming in and promoting replacing whatever random assortment of tools is in use with opensource tools. This means retraining. This means new hardware. This means *A CHANGE*. Uh oh.

    Is this the right long-term thing to do? Yes!!

    Is this going to be easy? NO!

    In order for this to be successful, it will have to have very important people behind it pushing it from the top down and funding the proper resources (hardware and people) where necessary to bring the government into the 21st century.

    I for one, certainly hope it can be done, and it would be great for the US and the rest of the world (except Microsoft) if it can be done with opensource software.

  13. Re:Tactical considerations by miniver · · Score: 4, Insightful
    Would you really want your military systems to blue screen or dump core right in the middle of a firefight?

    There are much worse ways that software can fail. One of the worst is software that looks like it's working, but in fact is not displaying new / updated items -- this leaves the warfighter with the false impression of situational awareness. Another popular failure is software that has time-consuming processing steps that don't have adequate progress indicators -- this leaves the warfighter wondering 'Is it done yet?' when it hangs or fails.

    At least with a blue screen or core dump, you know you've got a problem, and you can restart / reboot to resume, with a well known startup time.

    --
    We call it art because we have names for the things we understand.
  14. Huh? by Call+Me+Black+Cloud · · Score: 5, Interesting

    The original Internet and Open Source standards came out of public monies mostly granted to university research departments by the Department of Defense. Who paid for those efforts? Why must the public have to pay for those technologies once again because companies like Microsoft adopt them and then resell them as proprietary software?

    What the hell is he talking about? In the previous paragraph he writes:

    If the Internet failed to follow accepted standards, it simply would not work

    So the Internet works because it "follows standards", and we know MSIE (price: free) has the largest share of the browser market. So MS hasn't broken the Internet. Can someone give an example of what he's talking about? And don't tell me Kerberos because it's not the example you're looking for (MS did not co-opt it - MS extended Kerberos in accordance with the spec).

    He started out reasonable and then got shrill. He throws out statements like, "Seventy-five percent of the municipalities and schools in the United States cannot afford proprietary software" So...that means 75% of the municipalities are either a) running OSS, b) using pen and paper, or c) pirating all their software. A source reference would have been nice.

    Oh no...he has recommendations too:

    the states should require the use of Open Standards and Open Source Software when applicable

    When applicable? So, who decides when the software "applies"? Availability? Cost? (cost of development for a custom solution vs cost of COTS software) Everyone knows offshore development is cheaper - since he beats the fiscal drum so loudly does he also advocate sending any custom programming jobs overseas? He did have one good idea:

    If we can pay for software one time and share it with all government entities, we empower Americans to participate in the security of the homeland.

    Solution: site licenses for America!

  15. Re:gov't lacking in expertise and money for softwa by kiwimate · · Score: 3, Interesting

    Excellent, the first poster so far that appears to have RTFA.

    The crux is standardization, or, for you DBAs out there, normalization across applications instead of databases.

    One of the examples he gives talks about differing field names (last_name versus surname, for example). Well, sorry, but that has nothing to do with whether you're using SQL Server or MySQL and everything to do with standardizing architecture.

    But how does one do that across an entity as large as a government? How do you tell programmers they must use only these field names? And how much will it cost to rename fields in existing applications, and ensure all the links, dependencies, etc., are rectified as well? It's not really anything to do with the platform; at the least, it doesn't have anything like the impact the author suggests.

    An important issue, as the author says, is that for many applications (such as SAP and JD Edwards), no open source equivalents exist. This is a big problem for purchasers, because it makes them wonder how long open source will take to give them the applications they need (or if they'll ever come). They may have to pay big bucks for that other software, but it integrates with their existing applications and it's a known quantity. Never underestimate the power of familiarity.

    And, although I hate to be a grammar nazi, the author might just find himself being taken more seriously if he learns how to use words properly.

  16. True enough but by crovira · · Score: 4, Insightful

    the problem lies not government "per se" but with the management thereof.

    The same government that you are railing about is the reason nobody's dying in low speed head-on crashes from getting a steering column rammed through their chest.

    The car companies were quoting "market forces" and "nobody will want to pay for collapsible steering columns," and people were pinned to their seats like butterflies to cardboard. Sound familiar? Its the justification of every elite to anything that's going to cut into sl/easy profit.

    Management of government by objectives without citizen input into what the objectives are is disastrous.

    Remember Clinton's medical plan fiasco that was thrown out, not by elected representatives like the congress, but by HMO lobby groups posing as experts, as being unmanagable.

    You didn't get to register so much as a peep for or against or make a suggestion. It was managed right out of your hands.

    People are dying because their only sin is being temporarily broke from the last scrape with the health care system.

    --
    MSBPodcast.com The opinions expressed here are my own. If you don't like 'em... Think up your own stuff.
  17. Pool all Government software. by crovira · · Score: 3, Interesting

    The costs of development would be borne once (quite likely whatever software they'd need has already been done by some community or other,) and used as is and/or modified under the GPL, and copied into the pool.

    Some existing body, like the GAO, could administer the pool and send CDs to any community, state or federal department that would require the software.

    --
    MSBPodcast.com The opinions expressed here are my own. If you don't like 'em... Think up your own stuff.
  18. Document formats, not software by beforewisdom · · Score: 3, Interesting
    One of the best ways to promote free(dom) software, would be for the government to mandate standard goverment document formats under a GPL.

    If someone wants the government to use their software then their software must be capable of saving to the government standard GPL format.

    Government documents will always be accessible.

    Goverments will be free to switch software and not worry about format incompatibility.

    They can choose to use the best software for their formats...free(dom) software or proprietary.

    The playing field will be leveled. No document lock. A software package will compete on its pricing and merits.

    Chances are all of these benefits will transfer to the private sector as the sheer volume of government documentation will force the inclusion of government standard gpl formats into software made for the private sector.

    As a bonus the GPL will get a shot in the arm as far as legitimacy go.

    The government formats will also spread and be improved being GPL as anyone will be free to use or change it.

    If the government sees a nice modification they can make it the standard.

    Steve