Slashdot Mirror


MN Bill Would Require Use of Open Data Formats

Andy Updegrove writes "A bill has been introduced in Minnesota that would require all Executive branch agencies to 'use open standards in situations where the other requirements of a project do not make it technically impossible to do this.' The text of the bill is focused specifically on 'open data formats.' While the amendment does not refer to open source software, the definition of 'open standards' that it contains would be conducive to open source implementations of open standards. The fact that such a bill has been introduced is significant in a number of respects. First, the debate over open formats will now be ongoing in two U.S. states rather than one. Second, if the bill is successful, the Minnesota CIO will be required to enforce a law requiring the use of open formats, rather than be forced to justify his or her authority to do so. Third, the size of the market share that can be won (or lost) depending upon a vendor's compliance with open standards will increase. And finally, if two states successfully adopt and implement open data format policies, other states will be more inclined to follow."

176 comments

  1. I hope it passes by pilot-programmer · · Score: 5, Insightful

    It is not hard to reverse engineer a proprietary format - several word processors can save in competitor's formats. So this is a symbolic gesture, but it will be good in the future when Microsoft and others copyright their file formats to try and extort money from OpenOffice.Org and others.

    1. Re:I hope it passes by Proof_of_death · · Score: 1

      OpenOffice support for .doc and .ppt (especially .ppt) is flaky at best, but it's not OO's fault that there's 5 or 6 different versions of the format. OpenOffice files are the xml, css, and embedded files for the document, all TARed together. xml, css, and tar aren't going away anytime soon; try opening DACeasy files these days.

    2. Re:I hope it passes by Anonymous Coward · · Score: 0

      It is not hard to reverse engineer a proprietary format - several word processors can save in competitor's formats.

      While that statement is true it does not come without formating losses and expenses.

      This is occuring for one very good business reason. It costs money to upgrade all that data every time a new format coes out. But if you had a well thought out open standard it might last decades or longer, be easier to get pre-made high quality code for and perhaps a high enough grade formating losses are minimal. And of course not be held hostage to single sourced vendors.

      RS232, still used today and it has lasted. SS7 (Telecom), T1 framing, etc. all allow different equipment to interoperate even if as you say, "symbolic".

      I would say someone actually passed a good law.

    3. Re:I hope it passes by Anonymous Coward · · Score: 0

      "It is not hard to reverse engineer a proprietary format"

      Try reversing the files CubaseSX produces.
      It's virtually impossible.
      So I have literally terrabytes of data that only a single program can make sense of.
      (The audio is readable, but is meaningless without the arrangement data to say where on the timeline it should be.)

    4. Re:I hope it passes by Anonymous Coward · · Score: 0

      Reverse engineering is also not the answer in the case of document models that provide for encryption. Granted, after x number of years, it may only take, say, 1/4 of the time required to break the crypto - but that can still be a major time and hardware investment per document.

    5. Re:I hope it passes by cgenman · · Score: 1

      As I'm sure other posters will point out, reverse engineering Microsoft Word formats is a MAJOR pain in the tail, and nobody has done it quite right. Rumor has it that for backwards compatibility, Microsoft must include the engine that drives previous versions of the software because even they don't quite know how it worked.

      Either way, with the best efforts of the Star Office, Open Office, Word Perfect, and many, many other teams of people focused on figuring out the standard, it is still impossible to get a decently formatted doc file on anything other than Word.

      I would guess that microsoft has more people working on obscuring that file format than they do working on improving the software.

    6. Re:I hope it passes by soulhuntre · · Score: 1

      Not only is it not hard - it isn't necessary in this case.

      The government HAS a copy of the source code availale - and always has. Microsoft routinely makes the source available to the larger clients and partners, and the govt certainly qualifies.

      As to paranoia about the legal status of a government driven replacement tool or reader, it's mindless pranoia. the governemtn has a long history of opting out of laws that constrain it in many situations the woudl simply declare the DMCA or whatever doesn't apply to the government itself.

      --
      --> Fight tyranny and repression.... read /. at -1!
    7. Re:I hope it passes by kbw · · Score: 1

      Agreed, I hope it passes too.

      And I disagree, it is not easy to reverse engineer proprietary file formats because you are always chasing a moving target. Also, you're usually violating some term/condition when you do so.

      For example, you cannot duplicate the Microsoft Office file formats because there isn't a single one. Each version of MS Word, for example, changes its file format. So which one do you follow?

      MS Office products have problems with forward compatibility, i.e. it's not even compatible with itself.

    8. Re:I hope it passes by Cutterman · · Score: 1

      "The government HAS a copy of the source code...."

      Supposedly. They've got a copy of something.
      But I wonder whether it compiles?

      It's probably not real, just Lorem Ipsum.

    9. Re:I hope it passes by ibm1130 · · Score: 1

      Well, the point is to avoid proprietary file formats. M$ cannot copyright what it doesn't own. An open standard would by definition be open not proprietary. And-uh the problem of M$ and others copyrighting their file formats to extort money from others would probably provoke the banishment of such file formats.
      We can expect M$ to fight this tooth and nail because their monopoly is largely dependent on their ability to break things in the OS or application and make the "fix" M$ only. With legally mandated open format conformance they can't do this. This ability is so critical to M$'s biz model that I fully expect to see some attempts made to lock users into their M$ filesystems and claim that the files themselves are still "open format". Good luck but I fully expect to see the attempt made. Nobody would force M$ to comply but they would risk losing a sizable portion of the market and please god the day the Federal Gummint got on the bandwagon would be a black day indeed for Mr Bill.

  2. Blue-state phenomenon? by Anonymous Coward · · Score: 4, Insightful

    Does anyone think it's significant that the two efforts are in states with "blue" histories (at least in election years)?

    1. Re:Blue-state phenomenon? by greyduk · · Score: 5, Interesting

      I don't think it's significant at all, Minnesota was closer to being red in the latest election than almost any time in the last century. It can all be directly attributed to the Twin Cities having a very tech-oriented community, often given titles such as "Most Wireless City" and other things. Outside Silicon Valley and Seattle, it is probably the most tech oriented metropolis. This would of course have an indirectly related effect on it's political orientation as well, but partison politics really seem insignifact cause-effect wise.

    2. Re:Blue-state phenomenon? by greyduk · · Score: 1

      I'd blame my fingers for thinking on their own, but I missed all the mistakes in preview mode too. There's gotta be a pill for this.

    3. Re:Blue-state phenomenon? by Phillup · · Score: 1

      Minnesota was closer to being red in the latest election than almost any time in the last century

      Couldn't that be said for most states during the last election?

      --

      --Phillip

      Can you say BIRTH TAX
    4. Re:Blue-state phenomenon? by bersl2 · · Score: 1

      Your post stinks of a fallacy of questionable cause.

    5. Re:Blue-state phenomenon? by Jason+Earl · · Score: 4, Insightful

      Don't get too excited. If it wasn't for Governor Mitt Romney (R) ODF in Massachussets would be dead, and it's primary opponent was state senator Marc Pacheco (D).

    6. Re:Blue-state phenomenon? by fyrie · · Score: 1

      True, but MN was for the first time in my lifetime considered to be a swing state in the last election.

    7. Re:Blue-state phenomenon? by -kertrats- · · Score: 1

      You've clearly never been to non-metro Minnesota.

      --
      The Braying and Neighing of Barnyard Animals Follows.
    8. Re:Blue-state phenomenon? by greyduk · · Score: 1

      Exactly... It's always been such a sure thing for the Dems, that it is a little more unique among other states with an increase in Bush votes.

      Little off topic here... I actually went to a Republican district level meeting, with an agenda of making it party policy to change Minnesota's electoral system to a proportional thing. I do understand the pros and cons, and I knew it wouldn't work, but I figured that if I could get it approved at the district level, the issue would at least receive the attention it deserves, and a more popular, revised version of my motion might be drafted. Nope.

      "For the first time in our lifetimes, the Republican party has a chance to win a majority in a presidental election. Why in God's good name would we take that and right away hand at least four of those votes back over to the other side? We must do everything we can to get every vote for the party!"

      I was disgusted by this "for the party" and not "for the people" idealogy. I wasn't naive, but I was hoping at a more local level, these people would be more neighboorly. I was wrong. That was my first and only delve into partisan politics! /End useless story

    9. Re:Blue-state phenomenon? by Fred_A · · Score: 1

      I don't know what a "blue history" is but both states start with a "M". It has to mean something !

      Like... ummm... Macaroni ?

      --

      May contain traces of nut.
      Made from the freshest electrons.
    10. Re:Blue-state phenomenon? by Chode2235 · · Score: 2, Informative

      It was briefly considered a swing state, more for sensationalism then for substance. Kerry carried the state by ~4%.

      True, it was closer than say 1984, but that was to be expected in a nation so equally divided by so many things (War, economic issues). Make no mistake though, MN is still very much a liberal state.

      The important thing to note also that MN has a very strong tradtion of 3rd parties, and that may have figured into it as well.

      http://uselectionatlas.org/USPRESIDENT/state.php?y ear=2004&fips=27&f=0

    11. Re:Blue-state phenomenon? by Chode2235 · · Score: 2

      Yes, I grew up in non-metro MN, and true it is much more conservative then in ther twin cities. However, there still exists a stong liberal streak. Not necessairly on issues like gay rights, or even open documents, but more on issues of economic opportunity, and equality. I think much of that sentiment grew out of the agricultural base and farmers and their families knowing the hardships of having the 'deck stacked against them'. Where did you go in non-metro MN? Not to troll, but am curious as I grew up in SE MN.

    12. Re:Blue-state phenomenon? by Anonymous Coward · · Score: 0

      Stop trolling with that. Gays already have the same rights as everybody else. What you are alluding to is the demand for extra privileges for gays. Take it to news:rec.bent.* or some where else but stop harping on about it here.

  3. Are the standards ready? by jdray · · Score: 2, Insightful

    I keep seeing these stories about governments deciding to legislate the internal usage of ODF. Is the standard really ready for prime time? I can't say I know much about the details of ODF (if anything), but it seems like it's such a new standard that there are likely issues that would need to be worked out before it's so widely adopted.

    Having said that, I think it's high time our public offices stop feeding monopolistic practices by continuing with document format requirements that more or less pre-determine software choice.

    --
    The Spoon
    Updated 6/28/2011
    1. Re:Are the standards ready? by TurboStar · · Score: 1

      "it's such a new standard that there are likely issues that would need to be worked out"

      This didn't happen with .doc since the most obvious problem with it is still trying to be addressed today. Sarcasm mostly aside, I think OASIS might be looking (or have looked) into these issues.

    2. Re:Are the standards ready? by greyduk · · Score: 0

      Nothing like the prime time to get it to mature quickly ;)

    3. Re:Are the standards ready? by iabervon · · Score: 3, Informative

      The MN bill is not specific to ODF. It would require use of some open format (i.e., one which is clearly specified and may be implemented without license restrictions) if such a format is available. Under this bill, ODF would only be required if it is, in fact, ready.

      The MA situation doesn't involve legislation, but is an executive order from the IT department. The IT department is responsible for implementing the switch, and there's no reason it couldn't abandon the project if it turned out to be unworkable. They're also perfectly able to make exceptions for cases where they can't get it to work or simply don't feel like dealing (if someone had an extremely complex Word macro that they use a lot, and the ITD couldn't figure out how to do it in ODF, they could just shrug and let it go), because it's just a policy, not a law.

      With respect to the maturity of ODF, it was developed by a group of organizations which, between them, are likely to have all of the needs that anyone has. For example, the Society for Biblical Literature was an active member of the technical committee. This may be a bit surprising, until you realize that they've got at least one document (a translation of the bible) in every known living language, documents in many dead languages, and things like illuminated hand-written manuscripts. Additionally, ODF was designed to include the concepts in Microsoft Office formats (based on existing converters and on inspection of the interface presented to the user).

    4. Re:Are the standards ready? by holloway · · Score: 1
      Well it only needs to be better than DOC and WordML... StarOffice/OpenOffice has about ten years of practical use in an Office Suite (not just a word processor, they had to consider integration), and then it went through a standardisation process (one that MS withdrew from). It's supported by OpenOffice.org, AbiWord, and KOffice.

      The format itself is a zip file with some xml and image files, etc. It's very easy to use.

      I'm unrelated to the OOo project or ODF, but as my .sig says I write a converter that deals with the format.

    5. Re:Are the standards ready? by jbolden · · Score: 1

      State governments have fairly large IT and IS departments. Its not like they can't handle minor problems as they arise.

    6. Re:Are the standards ready? by Petrushka · · Score: 1

      I think it's high time our public offices stop feeding monopolistic practices by continuing with document format requirements that more or less pre-determine software choice.

      That is a fantastic idea, and I completely agree with it. Basically what you're suggesting, it sounds like, is that we have document format requirements that actually guarantee any software provider the legal right to implement support for the format chosen. I totally support that.

      Yes, that would be a great cure for the abuse of monopolistic practices that these evil ODF people are threatening.

    7. Re:Are the standards ready? by Kihaji · · Score: 1

      ODF is what they mean when they say Open Format. True, ODF is an open format, but as soon as MS is approved for ISO standardization for their XML format, they will be also.

    8. Re:Are the standards ready? by denttford · · Score: 4, Informative

      Just as an aside, but the SBL isnt a religious group seeking to distribute the bible, its an very well respected academic society which publishes both books of academic interest (usually in Engligh, sometimes in German, and others) and maintains a peer journal, usually focusing on the ancient near east (not so many illuminated manuscripts, but if someone were writing on biblical translations in the middle ages, sure). That a group of historians, linguists, archeologist, sociologists, etc. might want to have a say in a document format meant to be distributable, portable, and designed to last isnt all that surprising.

      Moreover, I suspect they may have more technical insight than most - LTR/RTL, printed and script, heavy diacritical use, cuneiform, IPA and other transliteration schemes, etc. are technical hurdles they've been dealing with for quite some time now in both printed and electronic format. They have even been freely distributing a Hebrew font for years.

      Just wanted to clear that up, lest people think they are a group of bible thumpers or modern monks (e-monks?).

      --

      Leben Sie jetzt die Fragen.
    9. Re:Are the standards ready? by slide-rule · · Score: 2, Informative
      I keep seeing these stories about governments deciding to legislate the internal usage of ODF. Is the standard really ready for prime time?

      I'm far from any real expert on the format, but at my job, I have done some fairly non-trivial conversions of technical documentation (in DITA XML, if anyone cares) into ODF, and while what I'm doing is fairly rough (it's an in-house use sort of thing) the format does seem to support all the basic concepts of a word processing document... page layouts, running headers/footers, tables, frames, images, multi-column sections, bulleted and/or numbered lists, and other things I know I haven't had to worry about yet. The upshot with ODF is that it is really a zip file containing a bunch of XML files, so processing it around later is fairly easy (that is, nearly trivial when compared to a non-documented and binary *.doc file).


    10. Re:Are the standards ready? by iabervon · · Score: 1

      I didn't mean to imply that they were missionaries, let alone fundamentalists. I was a bit carelessly suggesting that they did translations of the bible; but I'd assume that all translations of the bible are relevant to their work, so they'd have some familiarity with the issues involved in documents in modern written languages with odd features, in addition to odd ancient languages that relate to their work.

      And it is a bit unusual for a group of humanities academics to get involved in technology, unfortunately. I know somehow who recently had a lot of trouble with quoting Armenian in her Byzantine Studies master's thesis and didn't get any help from her department. (This was a bit before ODF was actually specified and implemented.) So the SBL is a bit unusual in both knowing about exciting formatting needs and actually telling an OASIS committee what those needs are.

    11. Re:Are the standards ready? by m50d · · Score: 1
      I keep seeing these stories about governments deciding to legislate the internal usage of ODF. Is the standard really ready for prime time? I can't say I know much about the details of ODF (if anything), but it seems like it's such a new standard that there are likely issues that would need to be worked out before it's so widely adopted.

      It's not ready. I'm a koffice user and I keep seeing problems - not big ones, but problems - where the standard is ambiguous and it ends up being koffice changing to what openoffice does. That's not good - OOo may be open source but having a particular implementation being the standard is a very bad situation. I think the best format to go for under this bill right now would be RTF - it may be MS but it's a published standard implemented by just about every word processor in the past twenty or so years.

      --
      I am trolling
  4. Well, by XanC · · Score: 4, Insightful

    We know a hell of a lot more about ODF than we do about .doc, and that hasn't slowed it down.

    1. Re:Well, by apoc.famine · · Score: 1

      and we will *CONTINUE* to know a lot more about ODF, no matter what happens to the standard. The same in no way can be said about the .doc format, which has an ever increasing number of peculiarities and differences with each different version of Office. All closed and hidden.

      --
      Velociraptor = Distiraptor / Timeraptor
  5. More openness is only a good thing. by my+$anity++0 · · Score: 4, Insightful

    I am glad. Open Standards should be, well, the standard. If it passes there, and similar ones in other states, everyone will be able to read important gov't files without surrendering their freedom of choice, and the files will not become locked in an abandoned format. Hopefully the Federal Government will see the light.

  6. Wow, my state legislature is working. by type40 · · Score: 1

    it's nice to see the guys and gals in St. Paul talking about something other than that same-sex marriage ban. Now if the house, senate and governor could agree on a bonding bill thing might be looking up.

    --
    "You can see I know very little about pimp policy." George McGovern.
    1. Re:Wow, my state legislature is working. by Psiven · · Score: 1

      I haven't really been keeping up with the other allocations, but the house and senate have agreed on $11 million for the Minnesota Shubert Dance Center.

      Hopefully Pawlenty will bumb it up a bite more if it passes.

      http://www.minnesotashubert.org/

    2. Re:Wow, my state legislature is working. by SkjeggApe · · Score: 1

      I hear ya! I just emailed one of the authors, Paul Thissen (pthissen@mn.rr.com) to show my support. Right now, the bill is in the Governmental Operations and Veterans Affairs Committee ... If you're from Minnesota, I'd encourage you to send them your thoughts...

  7. Open Standards / Open Source by orkysoft · · Score: 4, Interesting
    While the amendment does not refer to open source software, the definition of 'open standards' that it contains would be conducive to open source implementations of open standards.

    But this isn't about Open Source, it's about Open Standards, two orthogonal issues. Of course, Open Source is preferable, but it's not required to have Open Standards. Microsoft could add ODF support to its next version of MS Office (which they'll of course try to resist for as long as possible, as it'll kill their market lock-in), and it would be viable as a software supplier, but it'd have to compete on ease of use, price, robustness, etc.. It'd have to compete on its merits for once, instead of being the mandatory choice because of the current platform lock-in (even though OpenOffice.org does an excellent job interoperating with MS Office files).

    --

    I suffer from attention surplus disorder.
    1. Re:Open Standards / Open Source by WhiteWolf666 · · Score: 3, Insightful

      No, I think you're incorrect.

      MS will incorporate ODF, and will do it very badly.

      Same as with the web. You'll have to have an OpenOffice.org ODF, and MS Office ODF, and the two will not meet without quirks in OpenOffice.org

      It's going to be ugly. MS's resistance is just their first bit of opposition.

      --
      WhiteWolf666 an exBush supporter. All you new-school,compassionate,save the children Republicans can rot in hell
    2. Re:Open Standards / Open Source by Anonymous Coward · · Score: 1, Interesting

      Open Standards are far more important. Most people do not care about the source code availability of a program, they only care about their data. If they can read their data with any program closed or open source, they'll love it.
      Computer users would not put up with image format XYZ only working in program XYZ and image format ABC only working in program ABC, etc. They choose open formats. The programs using open formats then compete on functionality not lock-in.
      An Open Standard also helps with data longevity.

    3. Re:Open Standards / Open Source by HolyCrapSCOsux · · Score: 1

      look how long it took IE to properly support png for christsake!

      --
      0xB315AA8D852DCD3F3DCA578FD2E0BF88
    4. Re:Open Standards / Open Source by j79zlr · · Score: 1

      Its "stable" version still doesn't.

      --
      I'm not not licking toads.
    5. Re:Open Standards / Open Source by I'm+Don+Giovanni · · Score: 1

      " Microsoft could add ODF support to its next version of MS Office (which they'll of course try to resist for as long as possible, as it'll kill their market lock-in)"

      Office 2007's default formats are going to be open standards anyway; they're going through the EMCA process as we speak, to be followed by ISO.

      Microsoft will resist supporting ODF because ODF was built around OpenOffice's already existing code base. It doesn't even support all of MS Office's featureset besides not being geared to MS's codebase.

      --
      -- "I never gave these stories much credence." - HAL 9000
    6. Re:Open Standards / Open Source by colinrichardday · · Score: 1

      And do the people of Minnesota need all of Microsoft Office's feature set? And how was ODF supposed to geared to Microsoft Office's codebase when that codebase was closed?

    7. Re:Open Standards / Open Source by SwashbucklingCowboy · · Score: 1
      But this isn't about Open Source, it's about Open Standards

      No, it isn't. The definition of "open standards" in the bill is all "open" and no "standards."

    8. Re:Open Standards / Open Source by Anonymous Coward · · Score: 0
      MS will incorporate ODF, and will do it very badly.

      The law requires that it be possible to verify that a document conforms to the open standard. If such a mechanism does not exist, the document format is not considered open.

      Granted, that won't stop Microsoft from throwing out footnotes from OpenOffice.org documents or shifting entire pictures over ten pixels but it at least sets a minimum standard for conformance.

  8. Minnesota is dead on target by NatteringNabob · · Score: 4, Interesting

    The real key to any 'open standard' is that it be implementable without payment of royalties or encumberments of any kind. That is what makes ODF or Ogg Vorbis 'open standards' and MS Office formats and MP3 non-open standards. Open standards are great for consumers and voters because it means they can buy which ever standard conforming product best suits their needs, and that encourages true competition. Vendors like Microsoft will off course complain loudly, but it isn't supposed to be about what is best for the vendors, it is supposed to be about what is best for the citizens, and Minnesota seems to understand that better than most. I expect that Microsoft will go in with all guns blazing to derail this proposal.

  9. Last time I checked.. by d_jedi · · Score: 3, Funny

    ASCII text is an "open data format".. and all word processors support that.

    --
    I am the maverick of Slashdot
    1. Re:Last time I checked.. by a.d.trick · · Score: 1

      Not quite. Last time I checked Microsoft still refuses to support the proper \n line break. Opening my text files in notepad causes all sorts of pain.

      Yeah, Microsoft, again.

    2. Re:Last time I checked.. by slide-rule · · Score: 1
      ASCII text is an "open data format".. and all word processors support that.

      You went for the humor mod, and there's nothing wrong with that, but once you unzip an ODF file, you actually have ASCII text. (Well, strictly, something like utf8-encoded XML files, but notepad/wordpad handles them decently... smart-quotes notwithstanding, but they're evil anyway. ;)

    3. Re:Last time I checked.. by Anonymous Coward · · Score: 1, Informative
      What makes \n proper?
      History says:
      ASCII was developed simultaneously by the ISO and the ASA, the predecessor organization to ANSI. During the period 1963-1968, the ISO draft standards supported the use of either CR+LF or LF alone as a newline, while the ASA drafts supported only CR+LF. The Multics operating system began development in 1964 and used LF alone as its newline. Unix followed the Multics practice, and later systems followed Unix.

      If it was my call I would have went with CR-LF (\r\n) too since it was supported by both ANSI and ASA

      Not trying to flame or anything, just wondering.

    4. Re:Last time I checked.. by Steve001 · · Score: 1

      slide-rule wrote:

      ASCII text is an "open data format".. and all word processors support that.

      You went for the humor mod, and there's nothing wrong with that, but once you unzip an ODF file, you actually have ASCII text. (Well, strictly, something like utf8-encoded XML files, but notepad/wordpad handles them decently... smart-quotes notwithstanding, but they're evil anyway. ;)

      That is one of the best features of the OpenDocument format: you can open a file and see what actually is in it. Its being in ASCII text makes it possible to view your data using nothing more than a text editor.

  10. Lock-in isn't the point by PCM2 · · Score: 4, Insightful

    The more important point is that governments deal in records that are meant to be more or less permanent, or at minimum long-lived. Proprietary formats exist at the whim of a single supplier -- a software company -- and those suppliers are subject to the whims of the market like any other company.

    If I buy some paper from the Bienfang company and write a report on it, that report will still exist and be readable possibly for hundreds of years after Bienfang goes out of business. If Microsoft stops making a word processor or (god forbid) goes out of business, the situation may be different.

    "So what," you say, "just reverse engineer it." But what if, in the intervening years, Microsoft has successfully lobbied for laws that make that a criminal offense? We're talking about future-proofing data here; whether it's implausible is not really the point. The point is that using a closed format introduced risk.

    Another, more likely scenario: Microsoft subtly changes its format, or changes the way that newer versions of its software interprets the older format files. The government is forced to upgrade because Microsoft stops supporting the older version of the program, but the newer version does weird things to all those old records when it opens them.

    There are various reasons to choose true open formats and standards beyond ideological ones.

    --
    Breakfast served all day!
    1. Re:Lock-in isn't the point by Kilz · · Score: 5, Insightful
      Another, more likely scenario: Microsoft subtly changes its format, or changes the way that newer versions of its software interprets the older format files. The government is forced to upgrade because Microsoft stops supporting the older version of the program, but the newer version does weird things to all those old records when it opens them.
      Sadly when Microsoft or any other company forces the government to upgrade. The public pays the bill. One of the nice things about open standards is that it promotes competition. That in turn lowers the cost. Saving the government money. This saved money lessens the need to raise taxes to pay for the ever rising cost of the next version of M$ Office.
      --
      I trust Microsoft as far as I could comfortably spit a dead rat
    2. Re:Lock-in isn't the point by tsm_sf · · Score: 2, Insightful

      Dead on. You just neglected to add the logical conclusion: Barring misuse of political power, open formats and standards must replace closed ones.

      --
      Literalism isn't a form of humor, it's you being irritating.
    3. Re:Lock-in isn't the point by Anonymous Coward · · Score: 0

      The case of Microsoft going out of business would not cause a problem:
      If Microsoft were to go out of business through bankruptcy there would be another company to buy Microsoft and therefore inherit its document formats.
      If Microsoft were to simply close down they would need to sell their assets (ie their document formats) to return funds to its shareholders. Again their would be another company to buy their assets.

    4. Re:Lock-in isn't the point by Steve001 · · Score: 1
      PCM2 wrote (indented):

      The more important point is that governments deal in records that are meant to be more or less permanent, or at minimum long-lived. Proprietary formats exist at the whim of a single supplier -- a software company -- and those suppliers are subject to the whims of the market like any other company.

      If I buy some paper from the Bienfang company and write a report on it, that report will still exist and be readable possibly for hundreds of years after Bienfang goes out of business. If Microsoft stops making a word processor or (god forbid) goes out of business, the situation may be different.

      This is also an argument for an open data format like ASCII. All of the other current formats might not be readable in 1,000 years, but an ASCII text file should be as accurately readable then as it is now (provided devices can actually access the media it is stored on).

      "So what," you say, "just reverse engineer it." But what if, in the intervening years, Microsoft has successfully lobbied for laws that make that a criminal offense? We're talking about future-proofing data here; whether it's implausible is not really the point. The point is that using a closed format introduced risk.

      In my opinion that day is already here due to the Digital Millenium Copyright Act. My understanding is that if a software company includes encryption as part of its data formats then it would be illegal to reverse engineer the format because that would require breaking the encryption. If I'm wrong please correct me.

      Another, more likely scenario: Microsoft subtly changes its format, or changes the way that newer versions of its software interprets the older format files. The government is forced to upgrade because Microsoft stops supporting the older version of the program, but the newer version does weird things to all those old records when it opens them.

      There are various reasons to choose true open formats and standards beyond ideological ones.

      Thanks for your time.

    5. Re:Lock-in isn't the point by MooUK · · Score: 1

      Unfortunately, so far misuse of political power has been far too common. This is not something we want to leave unchanged, though.

  11. Not a big story yet by jmorris42 · · Score: 4, Insightful

    Thousands and thousands of bills are introduced in legislatures around the US and worldwide it is probably a million or more. Far fewer pass and even fewer of those make it th erest of the way into becoming a law. (For the civics challenged/non-US readers: In most US states it will also need a sponsor in the other legislative body, passage in both bodies and either signing into law by the Governor or another vote to override a veto.)

    It is good that such an idea is starting to bubble up, but it has yet to pass into law ANYWHERE at this point. The political power, wealth and proven tendency to resort to outright illegal measures of the Foe is going to make this a long difficult struggle.

    --
    Democrat delenda est
  12. How government procurement works by Anonymous Coward · · Score: 1, Informative

    This is a lovely gesture. But ultimately I'm not sure it means a lot. This is a loophole the size of an 18-wheeler:

    where the other requirements of a project do not make it technically impossible to do this

    The thing is, 90% of government purchasing is steered by very, very careful tailoring of the claimed "requirements". The way government purchasing works, what this bill is very likely to do is just make it so all procurement requests are written up in such a way that it is "impossible" for a format to meet the "requirements" unless it can fully interoperate with Microsoft Word...

    1. Re:How government procurement works by man_of_mr_e · · Score: 3, Insightful

      This is very true. But there is a reason for this "carefully worded" requirments. All too often, vendors lie about their specs. "Sure, we're section 508 compliant" and in reality all it means is that they have alt tags on their images.

      So, what happens, is you specify all your requirements, and in reality, only a few vendors meet those requirements, but a dozen or so "cheaper" vendors who meet the specs on paper end up winning the contract, and then we're stuck with crap.

      This has lead to requirements being VERY specific, so that you don't end up with something that barely does what it claims to.

  13. NOT! by Ossifer · · Score: 2, Insightful
    the Minnesota CIO will be required to enforce a law requiring the use of open formats, rather than be forced to justify his or her authority to do so.
    No, he or she will now be forced to justify his or her authority to NOT do so, i.e. (s)he'll have to make up some excuse to just keep on microsoftin'...
  14. Put simply... by Dirtside · · Score: 3, Insightful

    ...it is the responsibility of a democratic government to be as open and transparent as possible, whenever possible. Saying that the tool chosen should be "the best tool for the job" must take openness into strong account when that tool is for use by the government.

    --
    "Destroy science and religion. Science would re-emerge exactly the same; but not religion." - Penn Jillette, paraphrased
  15. MECC by ScottCooperDotNet · · Score: 3, Informative
    Too bad Minnesota sold off MECC, the Minnesota Educational Computing Consortium. "The state of Minnesota spun off the company as a private corporation in the late 1980s. It was bought by a venture capitalist for $5 million, who sold it less than a year later to The Learning Company for $250 million."

    Government assisted-funding software could again have a positive impact as MECC did. OOo, Mozilla, etc. SE Linux even...

    1. Re:MECC by BenFranske · · Score: 2, Informative

      For those that aren't aware MECC was responsible for those memorable educational games in the late 1980s and early 90s. Most notably Number Munchers and Oregon Trail.

    2. Re:MECC by BlakeOPS · · Score: 1

      Here are some screenshots if anyone is interested...
      http://www.blakeops.com/gallery/view_album.php?set _albumName=MECC

  16. In Theory by mpapet · · Score: 1

    This is a big bonus for more open standards, but what is not mentioned is the reality of landing the PO/contract for all of those potential Microsoft licenses will still strongly favor incumbents because they can come up with a triple-special licensing bundle for OS+Office Productivity that can't be beat.

    Sadly enough, it puts the burden on WordPerfect to support ODF. Which isn't coming real soon. http://www.linux-watch.com/news/NS7758948461.html I think Wordperfect is the preferred word processor in the legal industry. They'd be wise to start now, but I have a feeling they won't.

    --
    http://www.maxineudall.com/2010/02/should-economists-be-sued-for-malpractice.html
  17. Re:I live in MN, stuff open source crap by njchick · · Score: 2, Insightful
    Because Word format is not guaranteed to work on future computers. Microsoft can switch to a different format or go bankrupt. An open standard is open for everyone to implement on any OS.

    As for "de-facto standards" - even de-facto standards are supposed to be documented and open to competitors. Standards exist for more than one entity to adhere to. Otherwise it's a "de-facto monopoly".

  18. Re:I live in MN, stuff open source crap by dr_turgeon · · Score: 1

    I live in Minnesota, too.
    So, you're saying you prefer the original, bloated office application that doesn't work properly... but costs a lot more?

    --
    Get out of my state, Red.

    --
    "...objectivity resides in recognizing your preferences, subjecting them to especially harsh scrutiny." -Gould
  19. Re:I live in MN, stuff open source crap by Demerol · · Score: 3, Interesting

    You're not being told that you cannot use Microsoft Office. The Government is also not being told it cannot use Microsoft Office. The subject here is how the _data_ will be _stored_. You can use Microsoft Office, but the files must be saved in an open format of some sort.

    This is certainly a Good Thing.

  20. Great... until the feds step in by hazem · · Score: 1

    And finally, if two states successfully adopt and implement open data format policies, other states will be more inclined to follow.

    This will be great, until, just as they're trying to do with food labelling standards, the federal government makes a law with a new standard that specifically invalidates any state laws that are more restrictive.

    But I guess you can't blame the lobbyists... would you rather bribe..err..payoff..err, I mean, lobby a handful of people in one town, or have to spread your efforts across 50 towns and a lot more people?

  21. Why just the executive branch? by Anonymous Coward · · Score: 0

    Why not the other branches as well?

  22. posturing by EmbeddedJanitor · · Score: 1
    Given the toothlessness of the judicial system (eg. the Seattlement), I would be very suprised if MS gets at all contrained by this.

    Still, if enough states and countries do this

    --
    Engineering is the art of compromise.
  23. Old story by Kesch · · Score: 1

    I don't see why these bills even qualify as news.

    There is nothing GNU about these.

    --
    If this signature is witty enough, maybe somebody will like me.
  24. It would nice to be more than just formats by MoogMan · · Score: 4, Interesting

    I'd love to see it become more than just Open "Formats"... it should also include Protocols. e.g. MS Exchange. Exchange essentially locking people into using MS Outlook.

    1. Re:It would nice to be more than just formats by 7of7 · · Score: 0

      Where will it end though? If every software protocol is forced to be open, no company will be willing to produce an innovative product because their product's formats will no longer be poprietary, thus some other company can essentially use the same format without paying for the research, thus be able to charge less for a similar product and still make money. Imagine if MS opened up Exchange, how long before there was a free Exchange alternative with some catchy name like Freexchange? People would use the free alternative and Microsoft wouldn't make any money off the format that they put all the research into creating. Having seen that, companies would certainly think twice about developing new data/software formats because there isn't any money to be made by being innovative.

      --
      *The most erroneous stories are those we think we know best - and therefore never scrutinize or question.*
    2. Re:It would nice to be more than just formats by Atzanteol · · Score: 1

      Companies can still compete on features, interface, etc. Just recently I was forced to use Excel rather than OpenOffice when trying to add a linear regression line to a graph. OOo couldn't handle this, but Excel has excellent support (even adds the function used to the graph).

      --
      "Ignorance more frequently begets confidence than does knowledge"

      - Charles Darwin
    3. Re:It would nice to be more than just formats by 7of7 · · Score: 0

      You're definitely right on the aspect that companies would be able to compete on features, but it's a possibility that features depend on the data protocols used. For example, imagine a new boot loader that a company does massive amounts of research into which allows for instant on computers. I'd suppose the boot loader would function on a set of protocols. If a company were to implement this boot loader in a way that only their OS would boot immediately, they could gain a sizable advantage over the competition. However, if they were forced to open the protocols for the boot loader, other operating system manufacturers could design their OS to function using the new boot loader and the company who developed the boot loader would not get any gain from developing the boot loader. Thus, the temptation would be to stay with the status quo and not do the research.

      --
      *The most erroneous stories are those we think we know best - and therefore never scrutinize or question.*
    4. Re:It would nice to be more than just formats by I'm+Don+Giovanni · · Score: 1

      Companies can compete on features, but you miss the parent's point that if all protocols must be "open" then one company would've spent the money developing the protocol and everyone else would use the protocol for free. Saying that they can still compete on features (I'm grateful you didn't say "support" ;-)), doesn't address the fact that the creator of the protocol was screwed. At least let the government pay a hefty fee to the protocol creator to "open" it (I say let the government do this, since in your scenario it's the government that is forcing the protocol to be open). If the government forces Microsoft to open the Exchange protocol for everyone to use, the government should *fairly* compensate Microsoft since Microsoft spent the money to create it.

      --
      -- "I never gave these stories much credence." - HAL 9000
  25. Duluth, Open Format Epicenter!! by micromegas · · Score: 1

    Minn, home of Wellstone, Gopher, and MECC. I have to find out who'se sponsoring this bill and give them my vote. >>baci of duluth

  26. It wont pass - They will try to Tack Gay Marrage B by aka_big_wurm · · Score: 1

    Some people in the MN goverment think its a good idea to try to tack a Gay Marrage Ban on every bill. So I dont think it will pass.

  27. This is not OpenOffice.org v. Microsoft by WhiteWolf666 · · Score: 1

    Guys, you aren't looking at this correctly.

    This is not about some OpenSource community effort versus Microsoft.

    This is about a Sun/IBM alliance versus Microsoft. IBM and Sun are both quite capable in terms of political efforts. I'd put IBM way above Microsoft, for that matter. Sun's StarOffice for smaller organizations, IBM's Workplace for enterprise class, and OpenOffice.org to fill in various gaps.

    Fortunately, this is not David versus Goliath. This is more like clash of the titans, and in terms of wooing government contracts my money is on IBM.

    --
    WhiteWolf666 an exBush supporter. All you new-school,compassionate,save the children Republicans can rot in hell
  28. Obligatory pessimists view by waferhead · · Score: 2, Insightful

    All this will accomplish is MS opening it's wallet, encouraging large "contributions" to varois politicians it never hear of before.

    OTOH, might be a way to eventually bleed MS dry, eh? ;-)
    (Might take 1000 years...must take the long view)

  29. I live in MN - What is the bill numbers? by nairb774 · · Score: 1

    Lacking the time to actually look this up (college student with a ton todo for tomorrow)...what are the bill numbers so those of us who are MN residents can write to our reps. and voice our opinion?

    Thanks

    1. Re:I live in MN - What is the bill numbers? by teknognome · · Score: 1

      The bill number in the House is H.F. 3971 (full text). I can't find a Senate version of it.

  30. Royalties by Craig+Ringer · · Score: 2, Informative

    With the latest MS Office XML license, I don't think there's any chance royalties might be required. The only real remaining issue is that the license doesn't make much of a guarantee about future versions, but IIRC MS released a binding statement addressing this. I would have to go and hunt up the details now to be 100% sure. Just be aware that there's a LOT of outdated information and misconceptions about what they're doing (and they didn't help by ignoring many questions for long periods, giving roundabout answers, etc).

    The only thing I'd really be worried about these days is who controls the format into the future.

    1. Re:Royalties by SgtChaireBourne · · Score: 2, Informative
      With the latest MS Office XML license, I don't think there's any chance royalties might be required. ...
      Actually, despite a lot of non-committal grunts, that's not announced yet one way or the other even for current versions of MOOX and its current licenses. Obviously MS knows the licenses are going to be scrutinized carefully so the odds of any gotchas being easy to spot are low. I'd be really careful about the wording in the license anyway. I wouldn't be surprised in the least if MOOX were dependent on something that MS would insist on royalties for.

      For example, in the US, MS has thousands of sw patents. One of these is on XML serialization. If the EU decides to cut of its own economic balls so to speak and suddenly allow US-style sw patents, then MS won't have to hold back on litigation and will be able to sue the living daylights out of anyone using XML serialization. Note: that's anyone using XML serialization, not writing code, not developing software, simply using it is enough to warrant a letter from MS asking for royalties. So yes, technically it might be possible that the specification for MOOX could be available royalty free, but then the laundry list of patents MS has filed do require hefty royalties or concessions. MS could then sue users or opponents into oblivion and, technically, still allow MOOX 'royalty-free'.

      --
      Beta is broken and the link to classic doesn't work. Stop wasting our time or there won't be anybody left here.
  31. Impossible ? by billcopc · · Score: 3, Insightful

    The beautiful flip-side to this is a play on words. They will use open standards unless it's technically impossible to do, which really just means a lot of people will say "It's impossible to do function Y in format Z, I'm sticking with MSWord". It's not so much about impossibility, as it is about ignorance.

    --
    -Billco, Fnarg.com
    1. Re:Impossible ? by jbolden · · Score: 1

      But then the IT can shift burden of proof. User would need a source that shows that they can't do function Y in format Z. This would only be one step.

    2. Re:Impossible ? by fyrie · · Score: 1

      Add fiscally impossible as well. I work for an IT dept in the exec branch of the MN government. We have proprietary solutions up the wazoo whither it be MS or our imaging backbone which is proprietary to Unisys. The truth is, unless they are going to throw the $ at us to rewrite 10 years of code and pay for us to run new open backends while it takes us years to migrate it ain't gonna happen.

    3. Re:Impossible ? by Anonymous Coward · · Score: 0

      Why would a FUNCTION need to act on a FORMAT? You read the format into memory using some software, and the function should work as part of the software package. We are talking about STORAGE forma here, not what's in memory or the functionality (for instance, Center-the-line) here.

    4. Re:Impossible ? by AmBirkieboy · · Score: 1

      hey, i don't know how old you are, but I'd rather bit the cost bullet now when the price tag is x rather than pass the burden along to my kids that very possibly will have to pass a bill to allocate funds to dig out the entrenched systems you seem intent to let stand. the FBI can help you get a good idea of how this sort of thing might happen. that said, the bill provides for incremented reviews of systems and where a new, open standard isn't available, the old one can stand. but at least some one is asking the question. As to your 'it ain't gonna happen': the Drive to Excellence and Jesse V. are jus two examples of how it 'can happen' if enough smart minnesotans want it to.

    5. Re:Impossible ? by fyrie · · Score: 1

      We have about 20 or so apps in production at the moment. The last one cost the tax payers approx 15 million (considered a steal for what other states are spending on the same federally mandated application). When I said fiscally impossible, I wasn't kidding. I work for one of many offices that would fall under this bill.

    6. Re:Impossible ? by AmBirkieboy · · Score: 1

      Look, nothing the State does is cheap. So the numbers you're tossing around are relative.

      Further, you yourself mentioned that you got an awesome price for a system that 15 -15- other States developed. You see cost savings? I see collaboration paradigms and technologies being flushed at the tax payers expense!!!

      Before you slam the bill and pat yourself on the back for implementing such a large system, perhaps you should ask yourself (and go public) with the ways you or your vendors have acted so other States -vis-a-vis fellow Americans- needing a similar system will be able to drive down their cost either through the sharing of technology, standards, etc.. I expect very little and its for this reason that your 'int ain't gonna happen here' is so intellectually, ethically and fiscally dubious.

      Indeed, it is this sort of myopic view of the world that, tragically, requires a more prescriptive approach -a law- that forces us to think of the greater good -in this case those other states that will need the system you're so eager to protect.

      perhaps there is no hope for the bill. but if there isn't the fault lies not with the ideas it constrains.
      Rather, the problem would appear to reside elsewhere. Someplace deeper.

      That said, Minnesota is made up of a proud tradition of people working together for the greater good. And i have no doubt that if any State is capable of understanding and acting on the principles of the collective good it is Minnesota.

    7. Re:Impossible ? by LaoThai · · Score: 1

      But the bill as it reads applies only to "encoding and transmission" of data - which presumably does not affect backend systems, right Birkieboy? If so, then as long as you can cough up the data in an open format for public consumption, no worries. OTOH, if it's meant to apply to backend systems, then the author is clearly nuts.

    8. Re:Impossible ? by fyrie · · Score: 1
      I think I came off the wrong way. I actually agree with the purpose of the bill and what you are saying. I was (poorly) implying that departments will do their best to say it's infeasible due to the price tag. I think careful wording and grandfathering of applications could be used to get around this.

      We were able to complete our system for 1/4 of the price of at least one state off the top of my head by building the system ourselves all onsite only using consultants as a boost to our dev team during the primary development phase. We own the software and have no maintenance contract because the in house staff is able to maintain the system. So guess you can say we saved money by just being fiscally responsible and forward looking.

    9. Re:Impossible ? by AmBirkieboy · · Score: 1

      I clearly understand the challenge you're pointing out.

      And you may hate the scale and the work this bill implies. But to a very real extent the system(s) of which you speak was designed sans a specification that the data should be accessible for a period of time known but to those who at some future date will need the data (Sarbanes Ox. Et al compliance lands this blow not me!).

      Further, that the data, post another 9/11 disaster, have multiple access points (potential interfaces) so as to ensure rapid, accurate and highly portable availability.

      And lastly, that the data exist in a state that is not bound by any legal encumbrances. Great example: American pilots had to borrow fighters from the English and French at the beginning of WWI b/c the Wright brothers sued for patent infringement anyone that attempted to build anything in the US that looked like plane.

      Sarbanes Ox., 9/11 styled data availability, and lastly Americans flying French fighters...

      You can think backend systems should be exempt, but what if it is a backend system you or your family relies on to remedy any of the above crises? I have two kids so please don't think i mean any disrespect by this. I'm just making the point that this bill is about way more than saving Word files in XML. It would be wrong to do otherwise.

    10. Re:Impossible ? by AmBirkieboy · · Score: 1

      I laud your efforts at saving money. And, yes, I have no doubt there will be those in State government that attempt to circumvent implementing the measures this bill tries to mandate.

      But this must start somewhere. And it must start sometime.

      Look at Northstar. Do a search. The documents come back mostly as html, word or pdf. In an exercise conducted at harvard nearly 80% of the html documents they looked at were syntactically incorrect. As a another post noted, PDF is not open (pdf/a exluded). And Word. Well, you know...

      The point i'm making is that Minnesota may be better off than others, but things aren't looking good. Heck, look at the Enterprise Architecture thing. Its got information stored in an MS Access database. How many Minnesotans have Acess sitting on the desktop? That aint' democracy when state information is maintained in a format that costs $300 dollars to access.

      This is about the very foundations of State infrastructure and accessiblity. And if its just you and me that's fine.

      As thomas jefferson said a little rebellion now and again is a good thing.

      You're not alone.

  32. so now we'll see very carefully tailored... by jejones · · Score: 1

    ...requirements.

    I recall, back in the days when IBM was the enemy, being told by someone that his boss handed him a copy of the specs for a 360/370 clone and a copy of Principles of Operation and told to find some difference betweeen the two. I imagine that difference was written into a requirements specification so that only the IBM iron would satisfy it.

  33. Minnesota by Anonymous Coward · · Score: 3, Funny

    Being a Packer fan, I don't generally pay much attention to Minnesota. But if this passes, it might just be enough to get me to acknowledge that Minnesota is a state.

  34. No Anti-Trust Trial? by js290 · · Score: 1

    And to think the federal government thought a transfer of wealth to lawyers was necessary to combat Microsoft's monopoly. Good to see the M-states realize that they own their data, not their software vendor.

    --
    "Tempers are wearing thin. Let's just hope some robot doesn't kill everybody." --Bender
  35. Anyone living in Minnesota by deblau · · Score: 1
    Write your State Representative right now, and express your support for HF3971, styled "Open data format usage by state agencies required", and HF3982, styled "Open source software usage by state agencies for creation of public documents required." The second bill says:
    For purposes of this section, "open source software" means software that: (1) is free for anyone to use, without payment of a royalty or other fee; and (2) can be used effectively without payment of a fee or royalty in combination with other software commonly used to create, store, transmit, receive, and access data.
    It's possible that "is free for anyone to use" could be construed as a libre position, and "without payment of a royalty or other fee" could be construed as an additional gratis position, but I don't know if that's how the committee will understand it. When you write your Rep, let them know if you want one meaning or both. (Is it two independent clauses, or is the second half subordinate to the word "free"? Damn ambiguous use of the comma in legislation...)

    You can find out who represents you here. If they hear from a lot of people, they will get a theoretical warm fuzzy knowing that the issue is important to their constituency, and that they're doing the right thing. More importantly, they'll get a very down-to-earth political message, that if they don't vote for this thing it could be their ass in the elections coming up in November.

    --
    This post expresses my opinion, not that of my employer. And yes, IAAL.
  36. Wont work by evilkiksass · · Score: 1

    Most gvt agencies are required by law to keep all the old records. Many of wich were created during the days of windows 3.1 and 3.2. For some odd reason documents created back then (this is all assuming they were made with microsoft office) can not be oppened with openoffice or any other present day software excluding microsoft office. Because the agencies will want to keep all their records uniform they will simply say that they prefer to keep using using microsoft office, and nothing will happen because nothing will ever force them to switch.

    1. Re:Wont work by waferhead · · Score: 1

      Reality is a hair different then you assume.

      I haven't tried it lately, but quite frequently those "ancient documents" open fine in OO.org, and DON'T in recent versions of Word. Not supported.

      I think I still have an ancient mac with system 6 and Word on floppy, probably v2x-v4x, V5 was too big for floppy based usage IIRC.

      I'll have to give it a go.

      You actually provided the PERFECT example of the reason for the law.

    2. Re:Wont work by 99BottlesOfBeerInMyF · · Score: 1

      Most gvt[sic] agencies are required by law to keep all the old records. Many of wich[sic] were created during the days of windows 3.1 and 3.2. For some odd reason documents created back then (this is all assuming they were made with microsoft office) can not be oppened[sic] with openoffice or any other present day software excluding microsoft office.

      What an interesting assertion. It contradicts both my personal experience and the general consensus among IT workers. I have inherited many old .doc files over the years. Many could not be opened by any currently available version of MS Word. Some of those that could not be opened in Word, could be opened by OpenOffice. Many IT people actually keep a copy of OpenOffice on hand just to open and update these old files.

      So my question for you is, why do you believe the opposite? Have you personally encountered this, or did you read this somewhere?

    3. Re:Wont work by evilkiksass · · Score: 1

      Yes I encountered this when doing volunteer work for the DMV, and the local police station. They had docs that were 8-10 years old and the only way i was able to open them was to use old versions of office, because as you said the newer ones dont work, I did try OO but at the time it did not work, maybee the functionality has been added since.

  37. OO and Semi-Permanent Objects by yintercept · · Score: 4, Interesting

    It is strange how our ideals affect information.

    In the olden days, people concentrated quite heavily on open formats. Many programmers saw the data as separate from the program. In this environment, one would expect multiple programs to be dinking with the contents of a file. In such a world, maintaining and adhering to published open formats was the key to success.

    One of the ideals of OO revolution was that object would own the data. Taken to extremes that means that one object should own the data through its entire existence. Early ideas on the problem of persistence was that OO would just save the internal state of the program to the disk, rather than going through the complex task of converting the data to an open format (risking the potential that other programs would be tempted to modify the data). It seems to me that OO ushered in proliferation of proprietary formats. It definitely provided an excuse for creating proprietary formats.

    It seems to me that open data formats is contrary to the ideals of object oriented programming. However, when dealing with data that last longer than the computer, it seems naive that one object will be able to own the data.

    1. Re:OO and Semi-Permanent Objects by Z34107 · · Score: 2, Insightful

      One of the ideals of OO revolution was that object would own the data. Taken to extremes that means that one object should own the data through its entire existence [...] It seems to me that OO ushered in proliferation of proprietary formats.

      You, sir, are obviously not a programmer.

      The object-oriented paradigm is just a programming idea for how a program should be "broken down." An OO programmer would look at a problem and think of how it can be broken down into more logical, programmable parts - like saying a car can be broken down and programmed as an engine object, a steering wheel/gas/brake "interface" object, and 4 wheel objects.

      Those objects would then be programmed as "black boxes" for the data, the idea being that whoever uses the objects doesn't have to know how the data is tinkered with and can just use the methods provided by the programmer. For example, you don't have to know what ratio of fuel and air at what pressure has to be achieved for optimal combustion in order to accelerate the engine - the "programmer" left you that nifty gas pedal interface.

      Obfuscated, undocumented formats and lazy hacks were around before OO programming, and OO programming doesn't encourage their use. An object "owns" data in the sense that it handles manipulation of the data for the end user - it sure would suck if you had to know how to mix fuel properly to make your car go. In fact, OO programming encourages the opposite - that you'd have one "file object" that would handle saving and loading, so that you could use that same object in future programs to load the same data. (Code re-use is another facet of the OO paradigm.)

      Whether or not the lazy programmer actually documents the file format or not has nothing to do with whether or not he adheres to OO programming principles.

      --
      DATABASE WOW WOW
    2. Re:OO and Semi-Permanent Objects by tubapro12 · · Score: 1

      okay this is off subject but the switch between OO as OpenOffice to Object-Oriented kind of threw me off for a bit there, despite being C++ programmer and a user of OpenOffice... anyways... its a good idea and one i wish my state (and the feds, for that matter) would adopt; i get tired of opening .doc and .pdf files everytime i view a government document.

    3. Re:OO and Semi-Permanent Objects by yintercept · · Score: 5, Insightful
      You, sir, are obviously not a programmer.

      That sounds pretty much like the same insults that were slung in my face umpteen years ago when I was trying to argue for using standardized formats for data in several projects.

      Anyway, I find it sad that so few "programmers" actually bother learning anything about the history of what they are doing.

      In "legacy programming" people pretty much saw data as separate from the program. In "legacy" programming you would generally go about a project in two steps. You would design the data format in one step and the program in another. In a project you would write and publish both documentation for the format and program.

      The problem with this "legacy" design methodology was that you have to keep your published data formats in sync with all programs that access the data. Let's say I had a data store where the lastname was 24 characters. In release 1.17, I change the lastname to 32 characters. If someone else had written a program that was directly accessing and manipulating this data; we would have a crisis.

      The bold statement of OO design was that the object owned the data. The object would have complete control of all data from start to finish. You would only publish the interface and not the data format (you would still write both documents, the latter would not be published). This ideal worked well in interface design, but fell flat when dealing with long lived objects saved to disk. Have you ever heard the phrase the "problem of persistence," or are you as ignorant as you are arrogant?

      The problem of persistence was this horrible challenge for pure OO design. No matter how you went about it, data needs to be stored, replicated and transferred outside of the control of a single program. Anyway, many of the first OO programmers took the bold statement that the object owned the data to its logical conclusion. They ended up writing programs that saved data in terse, obfuscated, proprietary formats.

      I know this happened because I was there with my little hexadecimal editor looking at the data.

      OOP was never able to achieve the goal of a single object controlling long lived data. The OO world gradually dropped its bold statement. This is the way history works.

      This long post is relevant to today's article because many OO languages still have objectStore methods that save the internal state of the object to disk. I suspect that any OO program using these object store methods are in violation of the MN law. Even though I dislike programs that store their data in bizarre formats, I don't like seeing them legislated out of existence.

      Sun and other companies use XML for object persistence. These files are more readable, but still hard to work with.

      Whether or not the lazy programmer actually documents the file format or not has nothing to do with whether or not he adheres to OO programming principles.

      Please note that I was talking about publication. Publishing a document is different from writing a document. If you hold that the the data should only be accessed through the interface, then you would not publish the file format, now, would you?

      The object-oriented paradigm is just a programming idea for how a program should be "broken down."

      I laughed when I read that line. The first OO adopters generally saw themselves as architects. The idea of "breaking things down into procedures" was part of the old "legacy" way of thinking. The OO architects build things up from objects. A person doing OOP isn't a computer programmer. When you think in OOP you are architecting systems, not programming computers.

      The really funny thing is that OOP is systematically becoming more like the traditional programming paradigms that it was supposed to transcend.

    4. Re:OO and Semi-Permanent Objects by Gorshkov · · Score: 1

      In "legacy programming" people pretty much saw data as separate from the program. In "legacy" programming you would generally go about a project in two steps. You would design the data format in one step and the program in another. In a project you would write and publish both documentation for the format and program.

      When was the last time you looked at an old mainframe, cobal/isam accounting application?

      Before "Object Oriented Programming", there was data-driven programming, and before that there was the idea of "compartmentalisation" and "decoupling" - (the ideas that initally led to the unix practice of defining structures in headers, and just refering to a POINTER to the structure, abstract data types, etc).

      And what, pray tell, led to these developments?

      A programmer's (understandably human) inclination to do things in the quickest, most convenient way possible - which usually meant taking a shortcut and saving the data THIS way, instead of THAT way, because it saved him 20 lines of code and a whole 87 bytes of machine code on his huge 32k multi-tasking time-sharing computer.

    5. Re:OO and Semi-Permanent Objects by Kristoffer+Lunden · · Score: 1

      This long post is relevant to today's article because many OO languages still have objectStore methods that save the internal state of the object to disk.

      Indeed they do, but things are perhaps getting better. Ruby, for instance, is switching to use YAML for this, a standard that is open, human-readable and terse, the two latter much more so than for instance XML. YAML has features specifically designed to allow object persistance for any language as well as persistance of any data.

      It works nicely without creating lock-in problems. Any language with a YAML parser (and most have one by now) can get at the data easily, and even without the YAML specification it's usually obvious how the data should be read just from looking at it.

    6. Re:OO and Semi-Permanent Objects by Anonymous Coward · · Score: 0

      Give me a break. You've completely misunderstood OO programming. Not only that, you also appear to beconfusing internal APIs with data storage and data interchange. Finally, your assertion that simply dumping a binary format to disk that represents an internal storage structure would violate this law is wrong. The key here is "open" not "plain text".

    7. Re:OO and Semi-Permanent Objects by srussell · · Score: 1
      You, sir, are obviously not a programmer.

      That sounds pretty much like the same insults that were slung in my face umpteen years ago when I was trying to argue for using standardized formats for data in several projects.

      Not only that, he's calling the kettle black, and I doubt he's a programmer himself. A real programmer has experience outside of OO, and is aware that there's a valid argument that there are other models than OO. One doesn't have to agree with the arguments, but no one calling themself a "programmer" should be ignorant of the fact that there are many smart people, who are indisputably "programmers", who disagree with the OO philosophy. Functional programming, while not as popular, is a serious domain with concrete advantages over OO -- the only debate is to whether FP is over better than OO for general purpose programming. There are a lot of people who think that it is, and that the data ownership that you describe in your original post is, in fact, a bad idea.

      Good posts, by the way. I'm glad the mods exhibited the rare wisdom to mark your posts "insightful".

      --- SER

    8. Re:OO and Semi-Permanent Objects by Nefarious+Wheel · · Score: 1

      Sigh... legacy programmers had their idiots, too. I am reminded of one VMS/Pascal programmer who tried to persist an entire hydrology database into an enumerated data type, then complained to me that the system was no good -- he'd run out of space. "Darn!" was my response.

      --
      Do not mock my vision of impractical footwear
  38. Has ANYONE actually thought this through??? by fortinbras47 · · Score: 0
    I like open formats, but REQUIRING them would be a disaster.

    Does Microsoft Word file formats qualify as an "open format?"
    Does Adobe Photoshop file qualify as an "open format?"
    Does Quark Express document file qualify as an "open format?"
    Does an Oracle database count as an "open format?"

    As far as I can see, all this proposal would do is to:

    (1) Stop the state government from using a TREMENDOUS amount of useful software.
    (2) Incur insane compliance costs when trying to get employees not to save in the default format. (These training sessions would be comically dumb... "No you can't click 'save', you must click 'save as' and select a format on this approved list...")

    As far as I can tell, the costs (including opportunity cost) would be gargantuan and the benefit insanely trivial.

    And just one OpenOffice/Microsoft anecdote. I have a couple of spreedsheets with tens of thousands of cells and thousands of formulas. Open Office running on my linux box has absolutely choked (speed = 0) trying to handle it, while if I boot into windows, Microsoft Excel is responsive and can compute it in a few seconds. In my experience, OpenOffice works quite well, but I've hit a number of cases where I need Excel (hehe, or Matlab)

    1. Re:Has ANYONE actually thought this through??? by KayElle · · Score: 1

      Not to mention that if we put it in an open format, citizens will not be able to open it and will call up complaining and we'll have to talk them through it.

      You haven't lived until you've tried to explain to a cranky 80 year old what acrobat reader is, nevermind open office.

      The real problem is that the open standards aren't useful for people and the standards that are used aren't open.

    2. Re:Has ANYONE actually thought this through??? by BenFranske · · Score: 3, Informative

      Yes, believe it or not. You obviously haven't ever read many state statues, I suggest you do, it can be both educational and entertaining. They always start off by defining terms. In this case:

      "Open standards" means specifications for the encoding and transfer of computer data that:
      (1) is free for all to implement and use in perpetuity, with no royalty or fee;
      (2) has no restrictions on the use of data stored in the format;
      (3) has no restrictions on the creation of software that stores, transmits, receives, or accesses data codified in such way;
      (4) has a specification available for all to read, in a human-readable format, written in commonly accepted technical language;
      (5) is documented, so that anyone can write software that can read and interpret the complete semantics of any data file stored in the data format;
      (6) if it allows extensions, ensures that all extensions of the data format are themselves documented and have the other characteristics of an open data format;
      (7) allows any file written in that format to be identified as adhering or not adhering to the format;
      (8) if it includes any use of encryption, provides that the encryption algorithm is usable on a royalty-free, nondiscriminatory manner in perpetuity, and is documented so that anyone in possession of the appropriate encryption key or keys is able to write software to unencrypt the data.

    3. Re:Has ANYONE actually thought this through??? by Anonymous Coward · · Score: 0

      You can be assured that Microsoft will implement whichever open standard is REQUIRED. The alternative would be to not even compete for the contract. I can't see that happening.

      The interesting part will be seeing how they chose to break it but even then, they've got to be careful.

      This legislation puts power back to the consumer (in this case, government). If Microsoft make it difficult to use the standard the government want (ie. not being able to set it as the default save format, not formatting the document correctly), there will be plenty of vendors queuing up to take over the contract. This is exactly why it's bad news for Microsoft. They'll have to compete on an open playing field.

    4. Re:Has ANYONE actually thought this through??? by O'Laochdha · · Score: 1

      No, no, no, and no. However, there's no need for any of those. There are thousands of database programs out there. Quark Express is a substitute for competence. The GIMP can do most things Photoshop can, and more than enough for government purposes. RTF is open, and that's even supported by Word.

    5. Re:Has ANYONE actually thought this through??? by SwashbucklingCowboy · · Score: 1

      The bill's definition of "open standards" is laughable. It's all "open" and no "standards."

  39. Only between characters 32 and 127. by jd · · Score: 1
    The characters from 128 through 255 are implementation-specific, the standard does not define them. (For this reason, any ASCII character set that goes into the undefined region may not be compatiable with other implementations, as it would be entirely possible to add things like continuation bits, etc, without violating the ASCII standard, but breaking all portability.)


    The actions taken as a result of characters from 0 through 31 are specific to the implementation and circumstance. (An embedded motherboard is unlikely to have a bell, for example.) This means that although the syntax is defined, the semantics are not. The semantics are part of what makes a format "open". Thus, ASCII is only an Open Format between characters 32 and 127. All others may have proprietary interpretation.

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    1. Re:Only between characters 32 and 127. by Anonymous Coward · · Score: 0

      Characters 128 through 255 are covered by standards -- a few hundred of them. Just pick one!

  40. Too broad, I think by sheldon · · Score: 1

    I'm a big proponent of Open Systems, and have been for years.

    If you look at this solely in terms of word processing, yeah it makes sense.

    But consider a database product like say Oracle. Since they don't document the file format, they're in violation of this bill. Yet it's relatively trivial to extract data from an Oracle database and use it elsewhere. And if your app uses ANSI SQL you can move relatively easily between Oracle and other database servers. Hence the historical definition of Open Systems, as opposed to other uses of the word Open.

    I understand the intent, but I think this is going to cripple the government's ability to procure technology. From my experience working with the state, further crippling is not something they really need.

    Good intentions. Bad Bill.

    1. Re:Too broad, I think by Anonymous Coward · · Score: 0

      Why?

      That's why there are exceptions provided in case open standards are not available. The user needs to demonstrate there isn't an open standard available and it would be ok with the CIO/CTO to use a proprietary standard. Of course, a review after 4 years might show an open standard being available.

    2. Re:Too broad, I think by hogfat · · Score: 1
      This is definitely a bad bill.
      (8) if it includes any use of encryption, provides that the encryption algorithm is usable on a royalty-free, nondiscriminatory manner in perpetuity, and is documented so that anyone in possession of the appropriate encryption key or keys is able to write 2.20 software to unencrypt the data.
      I'm fairly confident that this section cannot successfully be complied with. US federal law already codifies compulsive discrimination in the use and dissemination of encryption.
    3. Re:Too broad, I think by sheldon · · Score: 1

      Naw, this requirement will simply encourage people to use bad technology, simply to get out of having to write up paperwork justifying the purchase.

      Again, the point was... Ideally what you want are Open Systems. That is, the ability to interoperate, retrieve data, etc. in a useful manner. It's more complicated than just the file store specification.

      Sadly, I live in Minnesota, so I get to suffer in the pocketbook from this idea.

    4. Re:Too broad, I think by pingveno · · Score: 1

      The first thing I thought about when I saw the article was the problem with data formats such as Oracle's database. After reading the amendment, I noticed the rules apply only to formats for encoding and transfer. That would presumably not include backend files. Though I still think the bill is overly broad, it looks like the person who wrote it wasn't a complete idiot.

      --
      "it's not about aptitude, it's the way you're viewed" - Galinda
  41. So Sayeth... by Anonymous Coward · · Score: 0

    ---The East Minnesota Peanut Gallery.

    Seriously, y'all are wearing out the bridges getting over here. I wouldn't be yappin'.

  42. Unicode by tepples · · Score: 1

    ASCII is only an Open Format between characters 32 and 127. All others may have proprietary interpretation.

    Unicode UTF-8 text excluding control characters other than tab, return, and linefeed, is an "open data format", and all internationalized word processors support that. Even Notepad in Windows 2000 and later.

    1. Re:Unicode by jd · · Score: 1
      I've never been fond of Unicode (admittedly in part because I had much the same idea around about 1986, as it was pretty obvious that you could include language coding to a wide character). However, Unicode is unquestionably an "open standard". Anybody can download the definitions and all Unicode text should be 100% interchangable with the same revision and width of Unicode on any machine.


      (Unicode has gone through a few revisions, which I am also a bit concerned with. Once you have a formal specification laid down, everything else should be definable as extensions to the skeleton.)

      --
      It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    2. Re:Unicode by tepples · · Score: 1

      Unicode has gone through a few revisions, which I am also a bit concerned with. Once you have a formal specification laid down, everything else should be definable as extensions to the skeleton.

      As far as I know, this is the case. The revisions to Unicode have largely added scripts and added characters to existing scripts, not radically changing the underlying structure.

    3. Re:Unicode by jd · · Score: 1
      Ok, then their numbering scheme sucks. A revision of 5.0 implies five major revisions of the system, rather than a core plus four extensions. (Hey, naming policies can have bugs too - the SunOS/Solaris confusion proved that.) Their distribution method - single file, as opposed to one core plus each extension - is also confusing and harder to work with.


      Having said that, between this thread and a previous one on Unicode in which I debated the merits of the vatious bit-lengths, I'm now satisfied that Unicode isn't a monsterous carbuncle*.


      *Besides which, only the Prince of Wales gets to say that.

      --
      It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  43. Use MS-DOS Editor by tepples · · Score: 1

    Microsoft still refuses to support the proper \n line break.

    O rly? Do Start -> Run -> edit to open MS-DOS Editor, which has been part of Windows since Windows 95. When opening a text file, MS-DOS Editor treats both \r\n and \n as newline sequences, but it always saves with \r\n. Opening a UNIX text file in MS-DOS Editor, saving it, and reopening it in Notepad will work correctly.

  44. headline: "MN bill makes WA Bill Waah!" by Stephen+Samuel · · Score: 1
    Just you wait for it..

    I mean we don't need open standards -- we need we need competition, er, innovation, er, securit... uhm... you know what I mean!

    --
    Free Software: Like love, it grows best when given away.
  45. Law is too draconian by Anonymous Coward · · Score: 0

    Requiring use of ODF would mean that they would choose an inferior Open format over a better closed format. THat doesnt allow for the flexibility that is needed. THe law should say that the CIO should look at ODF first and see if it accomplishes the objectives, and if not, then move to closed and continue checking if the open format further develops.

    1. Re:Law is too draconian by I'm+Don+Giovanni · · Score: 1

      The law wouldn't require ODF, but open data formats (of which ODF is just one; or is on it's way to being one, it's in the EMCA and/or process right now as is MS Office 2007 formats).

      I commend MN for being consistent, and not throwing in PDF has MASS did, which showed MASS utter hypocrisy (only a small subset of PDF is recognized by EMCA as a standard; the full PDF is proprietary controlled by Adobe, yet MASS blessed it).

      --
      -- "I never gave these stories much credence." - HAL 9000
  46. Open Data Formats not Document by zbend · · Score: 1

    I don't think the intent of this bill has anything to do with the Open Document standards, MS Word, or OpenOffice. I work for a vendor that provides systems for MN state agencies (law enforcement) and there is big hoop-la with XML based web services and otherwise data sharing. There are several state run systems in place and many more up and coming to facilitate and even mandate XML based data sharing (with a state defined schema) for law enforcement agencies. It seems to me this has more to do with data-bases than data-documents.

  47. Probably a good idea, and probably a bad bill by bmajik · · Score: 3, Interesting

    I certainly support the idea that Govt and public-domain agencies should use file formats that are royalty free, published, and ideally, with a source-code reference implementation for reading them (assuming they aren't self-describing) and a bunch of sample documents to use as test data for said reference implementation.

    What might be surprising is that I hold this view inspite of being a Microsoft Employee. While I certainly want as many people as possible using MS software, I want them doing so because it's the best choice for their situation. I'd like to think that Word can deliver more value to its users than the ability to open Word files, so if govt agencies want to mandate that documents be created, shared, stored, etc in published, royalty-free formats, that's fine with me. Government agencies are a large customer of ours, so hopefully government action around requiring open file formats will push us to make our tools best-of-breed for dealing with those formats, or may even push us to open some of our own.

    I don't use WMA for my music files, even though I could just email the guy that designed it if I have a problem. Just because I can today, doesn't mean I can 5 years from now. And there won't ever be a supported WMA player for something like OpenBSD, which might otherwise be a perfectly good audio appliance.

    Now here's where I explain the title. As much as I am for the idealistic POV that open formats should be used where possible, I also beleive that govt is amazingly effective at turning a good idea into a bad law. (See also: 99% of current US laws). Another comment suggested that this story is more about Sun/IBM fighting MS via legislation, as opposed to some ideological position that is being done for the best interests of the people. If that's true, it's unfortuneate that our govt is continuing to do these sorts of things that are allegedly in the best intersts of "the people" but no one can explain exactly how, and ultimately, other businesses or politicians seem to derive the most benefit.

    --
    My opinions are my own, and do not necessarily represent those of my employer.
  48. Govt is ofter the first by AmBirkieboy · · Score: 2, Insightful

    In so many ways and so often government has picked up the ball where few others would. Where ideas that aren't popular, that are too expensive, or that appear to risk all, government is regularly mandated to take on the challenge we would not as individuals, groups or businesses.

    Whether building dams in Nevada or sending Americans to the moon, it is the one entity that can face risk of failure and not flinch. In part this is because it represents our collective courage to attempt the impossible.

    For this reason it is entirely logical to me that it is a state, in this instance the great state of Minnesota, that would take on the the challenge of ensuring that its technological infrastructure is solid and, if not, fix what needs fixing.

    Indeed, what other company or organization in recent memory has challenged itself with so introspective and potentially damaging a question in order to arrive at a better place.

    Open Formats are a difficult proposition to be sure. No one denies this. But it is becoming increasingly clear that without the safeguards associated with open formats the State abdicates control of the very information it is suppose to protect.

    Regardless of derived the system a solution must be constructed that returns balance and moves control of State information back to those with whom the trust has been placed.

    I for one will be writing my representative to support the Bill.

  49. Yes!, AND, require MN IT projects be opensource by Anonymous Coward · · Score: 0

    I pay tax money for my state to run their operations - they use IT / software just like everyone else. They hire consultants (big "6", etc), just like everyone else. They reinvent the same wheels (new tax laws, fishing lic, etc) just like all the other states. Each state does their own thing. Each state pays private firms to build their software. Each state currently has contracts, that, I am sure, give the consulting companies too much control (are they work-for-hire contracts?)

    States should self mandate that thier projects are opensource and any project start should require a review of available opensource software, or existing (read other States) projects before investing in a new start.

    Do we really need to be paying for the same tax code to be written 50 times?

  50. OT: Election Judges can't read software..... by Anonymous Coward · · Score: 1, Interesting

    Off Topic: Election Judges can't read software.....therefore elections must not be dependent on software for certification of the main balloting.

    I Say that as Citizens, with the "common man" as Citizen election judges, each group of election judges must, with their existing capabilites (say, high school education, in International Falls MN), shall not be precluded from personally certifying the ballots and the summation of counts up to the state level.

    Therefore, all software, Diabold, opensource, or otherwise, should be disallowed on the face of it.

    It could be that a shrink-wrap spreadsheet, self programmed to help with addition, and first tested by the local judges with known test data (and no vists from the "vendor") would fall within their capability and use.

    It is the common man (gender neutral) citizen judge, not some State (appointed) administrator that is RESPONSIBLE and therefor must have method and tool decision power.

    We don't need results before the polls close.
    We do need results that we, as citizens, can trust.

    All ballots should be paper.
    All intermediate sums should be printed (hand, adding machine, or personally coded spreadsheets).

    Paper Ballots:
    How about the Check printing business?
    Quick turn of anti-counterfit, serialized, personally labeled documents.
    Standard smallish size, easy to handle,
    Each precient can order their own color/background.
    Printers can know that they only take orders from the right person.
    Printer and precient and third parties can assure a single printing of the right number of ballots...

  51. Interesting... by RealmRPGer · · Score: 1

    It's not often my home state gets Slashdotted about. Despite U of M being quite techie, there doesn't seem to be much of that kind of news originating from the area.

  52. partisanship by ChristTrekker · · Score: 2, Interesting

    Both "major" parties have a vested interest in protecting the status quo. Nearly all states went to that sort of "all or nothing" EC allocation in the early mid-19th century, you know. It's not like partisanship is a new phenomenon. Geo. Washington warned us it.

    We need a system that reduces the dependency on partisanship. I don't have anything against partisanship, per se, but I do not like some of its effects. Making the system nonrewarding to those effects would help diminish those aspects. I believe the solution is making the political machine more multipartisan, and I think the way to do this is using Condorcet voting instead of plurality voting. When the electorate can vote honestly, rather than strategically because of "wasted vote" concerns, then you'll get true representation in office.

    BTW, you're more likely to find the minor parties more likely to work "for the people" than the major ones, because they are not (yet) in a position of needing to protect themselves. Their whole appeal is that they reach out to the masses not being served by self-serving parties. I used to live in MN and that's where I first got active in partisan politics - but it was a "third" party. The experience on the whole was great. Do make sure to pay attention to the "character" of the party though...any small party can be "for the people" when small, but you want to support one that will continue to be so when it grows, a "principle over politics" approach.

    1. Re:partisanship by greyduk · · Score: 1

      Nice Post.

      Yeah I wasn't very detailed with some things, and you are completely correct. I should have been more specific with some things, but you definitely filled in my blanks.

      Like I said, I never held hope for it passing all the way through the major party heirarchies, but I was hoping maybe my more local "hometown" people might be willing to discuss it. I understand the concept for them protecting themselves, but the way that rebuttal was worded to me was almost offensive. At least in public, parties still sugar coat things, it was like he was completely unaware of the fact that there were voters there (like myself) who hadn't pledged to voting for a particular candidate, and the people at our district level definitely lost my votes that day.

  53. Quick question: by Fanboy+Troy · · Score: 1

    Fist off: I agree with you totally. It's a sad way the world works, lobbying and all. Not only IBM or Sun, but MS also. Just look at the pro-software patents camp here in Europe.

    Anyway, the question: Why doesn't Microsoft just support ODF? It's in their interest, just as supporting wordperfect's formats were. I'm confident they have the manpower to compete on open standards and remain the market leader for a long time ahead, as much as I personally don't support them. It's a simple solution to a simple 'problem' these states brought up. They would most likely win any government contract either way, because they have 'better legacy support' for the doc format and they have the advantage of not having to make the government retrain existing users, or to have citizens buy or download another office suite. It would also be a tremendous PR boost, even if some of us would be careful in embracing microsoft again. The only good reason I can think of is MS's vendor lockin. Which is really sad in the same way lobbying is. IMHO, with the assets MS has, and with the bragging about innovation they do, they should be the first to embrace open standards to "Show people who the boss is". Today they just think and work the way a 'small player' would... It's embarrassing for a company their size... :(

    1. Re:Quick question: by Anonymous Coward · · Score: 0

      The main reason is that at this point in time it's just not worth it. For every release of Word (or any other product), only a limited number of features can be added. Certain features get prioritized largely based on what's most likely to get customers to upgrade to the new version (i.e., things they want, things that make them more productive and especially things that don't break the way things used to work). At this time, there's little to be gained by supporting ODF in terms of license sales. It would take valuable developer time away from other features to produce a format which will never be able to fully capture the structure of a document the same way the proprietary formats currently used do.

      Now of course if governments start mandating that they'll only buy software that supports ODF, it would take Microsoft no time at all to prioritize such features in order to maintain those big contracts.

    2. Re:Quick question: by Fanboy+Troy · · Score: 1

      I can understand what you are saying. But also, this means that MS will be disqualified from the government contracts they want in these two states right? After all, they are asking for open standards. What I'm saying is, ok, microsoft isn't prioritizing on supporting ODF. It's their call. But, why the big fuss over these two states then? I don't know the exact economic impact a loss in these contracts would have on MS, but how does such a loss weigh in when comparing it to the 'fuss' of supporting ODF? How much demand will it take for support of ODF to be a priority?

      ... a format which will never be able to fully capture the structure of a document the same way the proprietary formats currently used do.

      Why will they never be able to fully capture the structure of a document the same way the proprietary formats currently used do? I can understand a claim that ODF doesn't _currently_ support some features Word has, but not that it won't in the future. It is an extendable format. This is a good point someone could point out if I were to ask: 'Why doesn't microsoft use ODF as their default format', which I am not. What I am asking is 'why doesn't microsoft support ODF as it supports wordperfect, or RTF?'. In other words, to the extent the standard allows features of, say, Word to be embedded in it. Still, I get the point of the cost effectiveness of such an effort. Was the cost of losing business in these two states acounted for? Because I find it weird they portray their non-open format as an open one just to not lose their contracts there if it was... I believe it is more a matter of control of formats than it is a matter of resources. After all, they are the biggest software company in the world with billions in assets. Hiring a few more developers to support ODF can't be that much a problem...

    3. Re:Quick question: by bmajik · · Score: 1

      I am not sure. I can't speak for the office team (or any team, for that matter ;)), and if I was one of the people that could, I am not sure how much legal whitewashing my answer would need :)

      If I were going to speculate, I'd suggest that ODF isn't the "right" format. I'd think that MS would be more likely to "open" the Word XML document format in Office 12 than to adopt someone elses standard.

      One thing that can suck about an open format is that it's hard to understand when it's frozen. People really hate it when you rev file formats - Office had the same document format from Office97 to Office 2003, and it's still 100% back compat in the Office 12 builds I've been using. We're just getting ready to introduce our XML based Office formats (which btw, are smaller than word97 format for the types of design documents I write). A 180 degree turn towards ODF would be kind of awkward at this point.

      I wonder if the Office XML formats will satisfy the governments that are interested in this type of legislation.

      Failing that, perhaps in a few more years when the ODF format is realistically frozen, or at least the change and versioning process is well understood (they may be now, but I have no exposure to that information), we'll see MS supporting it natively in all it's office apps, and a group-policy setting that makes it the default format. That way govt agencies that want to mandate its use can deploy Office 15, deploy the GPO to make the Govt-compatible formats the default (only allowable?), and thing's just start working.

      I would be curious to know what people consider truly open file formats - I outlined some of my requirements in my original posting. To be realistically useful, you need more than just openness.. you also need a defined change control process, some sort of "owning body" etc. Fragmentation in the file format space makes everybody lose.

      --
      My opinions are my own, and do not necessarily represent those of my employer.
    4. Re:Quick question: by cdrguru · · Score: 1

      Sorry, a really usable open format cannot be "extensible". You can't change it without serious thought as to the consequences, even to add stuff that is ignored by other readers when it is not understood.

      For example, it is quite important to have italics in the right places. Let's assume that the first version doesn't support italics and there is an "extension" to that version that does. I would offer that this generates the possiblity of having a reader which will not render something in italics when it is required. Bad. Bad. Bad.

      OK, so italics is a trivial example, but there are others. The problem with an evolving open format is what is really needed is a fixed, unchanging open format that is THE standard. Period.

      Come back in five years when such a thing exists.

    5. Re:Quick question: by Fanboy+Troy · · Score: 1

      I am not sure. I can't speak for the office team (or any team, for that matter ;)), and if I was one of the people that could, I am not sure how much legal whitewashing my answer would need :)

      That's ok, I'm not trying to get you in trouble! ;)

      Good points by the way.

      A 180 degree turn towards ODF would be kind of awkward at this point.

      I don't think the government bodies are asking for a 180 degree turn of microsoft's direction. As I see it, they only need a 'save as' option that will work with office. Open XML could still lead the way features-wise until these features can be standardized so they can be embedded in the ODF format. Since the two file formats are esentially XML, I'm guessing it won't be a very painfull process, but I don't know the specifics.

      I wonder if the Office XML formats will satisfy the governments that are interested in this type of legislation.

      I think the problem is the patents on the formats that are in the way. If a company sues MS over patent infringement, they automatically lose the right to use these formats. This gives MS an unfair advantage over competition I guess. It is in the governments' interests to have viable alternatives, so aside the lobbying powers, I think ODF is the best way to go. Even if some features will not be present immediantly, long term MS and competitors will be 'fighting' on terms of merits and not formats.

      I would be curious to know what people consider truly open file formats

      I'm a linux user. Saying that, I find MS Office to be 'the best choice for their situation' in alot of cases as you say, let alone the interoperating problem I have when sending a windows user a document that needs features RTF can't support. I know asking for a port of Office to linux is a bit farfetched, but I believe a sufficient standard supported well by Office and any other competitor would be just enough to trigger healthy competition. Sadly, Open XML is not 'GPL compatible' and can be used against OS projects in the future. But I'm guessing that even if, say, Corel wanted to port wordperfect to linux, they would be in the same acquard position of losing 'patent power' over microsoft if they were to innovate under the current patent laws.

      I outlined some of my requirements in my original posting. To be realistically useful, you need more than just openness.. you also need a defined change control process, some sort of "owning body" etc. Fragmentation in the file format space makes everybody lose.

      This is what Oasis is for. Fragmenation won't be that much a problem, as the versioning sytem you pointed out. I admit that I don't have information on this myself, so I can't argue on how big a problem that could be also.

      Bottom line, what I want from microsoft is to just play fair and as you say, win on technical merits and not on patents and FUD or leveraging monopolies and what not. I know for sure that innovation is not a microsoft only thing, I see it daily in opensource projects. This is why I believe the management is the problem over there at Redmond and not the developers. Don't comment on the last remark... ;)

    6. Re:Quick question: by Fanboy+Troy · · Score: 1

      I don't get it. Why is adding to a standard bad, if it isn't done in a proper manner? Why the changes in HTML then? I like the microsoft employee's reasoning more. You need a 'defined change control process', not total staticness. If ODF currently has such a process (which I don't have knowledge of if they do, or do not, but I'll find it surprising if they don't), I don't see why it is so hard to add a 'save as ODF' option in Office. Office should only be required to add ODF support to the extent the standard supports features Office has to offer. If ODF doesn't support italics, MS isn't required to make it work. The end user can pick Open XML for his documents and pick ODF when he needs the portability or the openness. So there would be no case of 'having a reader which will not render something in italics when it is required to'. Anything that is, say, an ODF 1.0 document should open properly in any app that supports ODF 1.0. The problem for microsoft would be if this standard was to be 'added to' often and not in a timely/controlled manner...

      Should CSS not be further reviewed because some browsers don't support newer versions fully? Should RTF support in Word be outcasted because it doesn't display all the features open XML will or .doc does?

      As long as features are added, THE standard will never exist... ;)

  54. Brilliant! by Mutatis+Mutandis · · Score: 1

    I wholeheartedly approve. For years, one of my biggest and most complicated tasks has been the transfer of data from source A to target B. Usually A is in a format that is undocumented and inconsistent. Reverse-engineering can be a nightmare when formats are badly designed (although that explains why they are often considered propietary) and used randomly. You would be surprised by the vast number of programmers who neglect to start a file with an identification tag and format version number.

    I would happily go a step further than the MN proposal. I would require by law that all files produced by commercial software have to be in a formats that are documented and open, so that they can be read by any programmer skilled in the art and in possession of the documentation, which the supplier of the software has to give to you.

    Actually anyone who creates a new format should be required by law to deposit its description in a public, easily accessible facility. A kind of Congressional or British library of file formats.

    I am not totally opposed to patents on formats, but I would require any company that patents a file format to give any of its competitors a license for its use at small cost.

  55. RGB by Anonymous Coward · · Score: 1

    Goes to show: The real Green Party is flat and rectangular and comes in wads.

  56. It's getting harder to reverse engineer formats by Anonymous Coward · · Score: 1, Interesting

    It's becoming increasingly hard to reverse engineer formats. Why?

        Encryption
        Legal protection for the encryption, the DMCA
        Software patents
        The relatively new concept of being able to own a file format.

  57. Can we get the US Federal Gvt. to adopt? by Anonymous Coward · · Score: 0

    Can we encourage the Federal Government to adopt the same? Where should it start (Executive branch, National Archives, NASA, Intel agencies)?

    It is a real pain to have to use proprietary formats that cost hundreds or thousands of dollars to use or to convert to open formats. Most word processing in the Federal system is now in MS DOC format.

    Write your congress critter....

  58. Does too, bass ackward by Anonymous Coward · · Score: 0

    I'm sitting a government computer opening documenting in OpenOffice because MS Office won't open them. How sad is that? Not only that, but I've got modern documents that when the embedded spreadsheet get mangled, MS Office refuses to open them - and they are brand new.

    Guess what _does_ open them?

    Guess what the previous versions require me to do? Keep an old _operating system_ around because they won't run on XP.

    Yeah, you should hope your tax dollars goes to preventing this sort of waste.

  59. (re-)define "open" by Anonymous Coward · · Score: 0
    Microsoft have started telling anybody stupid enough to believe them that their proprietry or otherwise restricted standards are "open". I recently read an article[1] in an EE industry rag with the subtext, "Is it time to say no to open systems"? I have it in front of me now, here's a snippet:
    Systems can be considered 'open' if a common interface exisits to which more than one supplier conforms. It doesn't necessarily mean all of the systems elements need to be visible, removable or replaceable. So a system can be open, even if it's architecture isn't. This poses the question; 'how open does a system need to be?'.
    That probably isn't what many slashdotters would understand by the term, afterall we don't say 'partly open' or 'slightly ajar' do we? After attempting to redefine the meaning of a common word, the article quickly descends into buzzword fueled gibberish but to a less than astute reader the damage could already have been done.

    [1] The 'article' is an MS propoganda piece on EPOS (Electronic Point Of Sale), mentioning .NET, C#, J#, Java, MS DOS, Win32, XP, SQL Server, Systems Management Server... You get the idea.

  60. 3971 IS THE CORRECT BILL!!!!!!! by AmBirkieboy · · Score: 1

    NO NO NO S3730 IS NOT THE RIGHT BILL. it frankly looks like something put together quickly and almost has the FEEL of something submitted by MS to create confusion. 3971 IS THE CORRECT BILL AND THE LEGISLATION SUBMITTED TO SLASHDOT. It is more sophisticated and techncially sound. AGAIN 3971 IS THE CORRECT BILL AND THE LEGISLATION SUBMITTED TO SLASHDOT. It is more sophisticated and techncially sound.

  61. This is not about slamming MS!! by AmBirkieboy · · Score: 1

    this is about data in formats that will withstand the test of time and market churn. not slamming MS. it is also not about OS.

  62. YEA BABY THAT'S WHAT I'M TALKING ABOUT by AmBirkieboy · · Score: 1

    You're exactly right!

  63. Open Systems more important than Open Source by argent · · Score: 1

    I'm so glad this is a "we must use open formats" bill, and not a "we must use open source" bill. Open Source software can lock you in to closed formats almost as badly as proprietary software can, simply by putting an undocumented format/interface/protocol behind a complex API.

    It's a depressingly common situation to find oneself in: Reverse-engineering a protocol or format by playing with inputs and looking at outputs because that's easier than decoding (hah) the source that generates it.

  64. MP3 is an open standard by Anonymous Coward · · Score: 0

    Because unlike .doc it is fully documented. It is encumbered with patents (non-software patents AFAIK), but that doesn't revoke its status of being openly documented and currently a de-facto standard. The only advantage of Ogg Vorbis is that it's royality-free worldwide. (the MP3 patent only applies to commercial entities e.g. in Europe, not necessarily free Linux distributions for example)

  65. Hm. I wonder by Big_Al_B · · Score: 1

    if they're using G.729 to save bandwidth on their Cisco Call Manager based VoIP deployments?

    Unlike the other ITU-T G.X voice standards, G.729 requires licensing fees to the patentholders.

  66. Better make sure its free of patents by jocknerd · · Score: 1

    Microsoft is trying to get their .doc format certified through ISO. But will it be truly open after that? Or are there patents on it that will prevent open source projects from utilizing it?

  67. My Legislator has Positive Vibe About This. by JavaMouse · · Score: 1

    The bill was sent off to Rep. Tingelstad's Operations' Committee originally, but now has been joined into a larger bill, according to my state representative. Tingelstad's district neighbors mine - so I inquired about the bill to both Chairwoman Tinglestad and my representative.

    Within minutes, Chris DeLaForest, my (wonderful) state, rep replied to my inquiry as follows -

    ===============

    Michael,

    I believe the text of this legislation was incorporated into the State
    Government Finance committee's omnibus bill. There was no controversy
    regarding this language. Although it's touch to tell fortunes around
    here, I do not anticiapte any hostility to this language and believe it
    will become law.

    Sincerely,

    State Rep. Christopher J. DeLaForest
    House District 49A
    503 State Office Building
    Saint Paul, MN 55155
    Web: www.house.mn/49a

    ================

  68. HF3971 is the real deal by AmBirkieboy · · Score: 1

    HF3971 is the real deal. hf3982 is a very different bill. combining the two just confuses the situation. i'd suspect the two bills were written by very dissimilar people with very dissimilar objectives.