Slashdot Mirror


Programmer's File Editor With Change Tracking?

passionfingers writes "My business users regularly have to tweak large (>32MB text) data files manually. Overlords charged with verifying the aforementioned changes have requested that the little people be provided with a new file editor that will track changes made to a file (as a word processor does). I have scouted around online for such an animal, but to no avail — even commercial offerings like UltraEdit32 don't offer such a feature. Likewise on the OSS side of the fence, where I expected a Notepad++ plugin or the like, it appears that the requirements to a) open a file containing a large volume of text data and b) track changes to the data, are mutually exclusive. Does anyone in the Slashdot community already have such a beast in their menagerie? Perhaps there is there a commercial offering I've missed, or could someone possibly point me to their favorite (stable) OSS project that might measure up?"

286 comments

  1. vi/emacs/eclipse/whatever + svn? by FooAtWFU · · Score: 4, Insightful

    In the open-source world you edit your text file, finish for a bit, save it, and check it back into your favorite form of source control. You can then look at the diffs between various revisions.

    --
    The World Wide Web is dying. Soon, we shall have only the Internet.
    1. Re:vi/emacs/eclipse/whatever + svn? by Anonymous Coward · · Score: 1, Funny

      Yeah, there's no way I'd switch from vi, even if it meant better integrated version control. Of course, I'm sure that Emacs has an SVN server built in ;)

    2. Re:vi/emacs/eclipse/whatever + svn? by dedazo · · Score: 1

      Agreed. When doing the day job Visual Studio is nice (regardless of version control used) for this in the visual (no pun intended) sense.

      For my Python coding, vim + bash (or powershell) + svn + vimdiff gets the job done, if not as elegantly or real-time-ish.

      --
      Web2.0: I love when people Flickr my cuil and digg my boingboing until my google is reddit and I start to yahoo
    3. Re:vi/emacs/eclipse/whatever + svn? by moresheth · · Score: 1

      Netbeans has subversion integration built into it, and function as a real-time diff from your working copy. It sounds like that would solve the problem the best. I don't use it myself anymore, and I don't know how it handles large files, but it's available on every platform, free, and will do what you asked. You do need to have a subversion repository, of course, though.

    4. Re:vi/emacs/eclipse/whatever + svn? by dthrall · · Score: 2, Informative

      No offense, but using a java ide to edit text files doesn't seem like the most efficient way to do things, especially dealing with 32mb files (I find most of the java-based ide's i've used tend to choke on large files... Sure, the diff viewer is part of the whole bundle, but for the subversion functionality, TortoiseSVN is a decent windows client, as it sounds like the person inquiring is a more non-technical user. Of course, I'm not sure if you actually mean a true OSS way of doing this, or if you're just looking for a free way to do so...

    5. Re:vi/emacs/eclipse/whatever + svn? by agbinfo · · Score: 1

      Slightly off-topic but one feature I used to want from a text editor was to be able to split comments and formatting from the actual code. It would be nice if source control tools would do that. This way, I wouldn't have to rebuild an application because someone added a comment or changed the formatting in types.h. It would allow every programmer to work with files using their own preferences for indenting and usage of curly-braces. An additional benefit of such a feature would be to make it possible to place comments in several spoken-languages and only look at the ones you're interested in.

    6. Re:vi/emacs/eclipse/whatever + svn? by amRadioHed · · Score: 1

      Sounds nice but who's going to maintain comments in multiple languages? It's hard enough getting people to maintain comments in English.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    7. Re:vi/emacs/eclipse/whatever + svn? by CodeBuster · · Score: 1

      I speak from first hand experience when I say that TortoiseSVN is the way to go for basic version tracking and management with subversion in the Windows environment (you need to download the Subversion server to manage the repositories of course or else have access to a server maintained by another). Since my work primarily focuses on software development and project management I also make use of the CruiseControl.NET automated build service + website with NAnt to manage builds and VisualSVN (the only part of my setup which isn't free of charge, but the $50 fee is reasonable and well worth the price if you use Visual Studio) for Visual Studio integration (which wouldn't be an issue for the original poster).

    8. Re:vi/emacs/eclipse/whatever + svn? by Anonymous Coward · · Score: 0

      This way, I wouldn't have to rebuild an application because someone added a comment or changed the formatting in types.h.

      That's a problem with your make program, not with your text editor. Get a make program that determines whether a file has changed by looking intelligently at its contents, not its timestamp.

      (It's trivial in principle: all you need is a normalisation routine for each file format, then you store a list of digests. Omake does something like this, though I can't remember offhand whether it normalises files before calculating digests.)

    9. Re:vi/emacs/eclipse/whatever + svn? by grumbel · · Score: 1

      Checkout ccache, it caches compilation results and then on recompile it reuses the results when nothing has changed in the preprocessed file. Because it works on preprocessed files instead of the original source files it can ignore quite a few changes that would otherwise cause a recompile and thus can speed up recompilation a lot. It also happens to be very easy to use, just compile with "ccache gcc" instead of "gcc" and you are done.

    10. Re:vi/emacs/eclipse/whatever + svn? by dhasenan · · Score: 1

      If you're using svn with Visual Studio, there's also AnkhSVN, which is free but slooooooow.

      The main utility of Visual Studio integration is deleting files that are no longer referenced by any project. It's trivial to add new files and commit changes with tortoise, but orphaned files crop up unless you have some sort of integration.

    11. Re:vi/emacs/eclipse/whatever + svn? by GigaplexNZ · · Score: 1

      It would allow every programmer to work with files using their own preferences for indenting and usage of curly-braces.

      Why you would want this, I don't know. It makes it harder for multiple programmers to work on the same project. You want developers to spend their time fixing bugs and adding features, not trying to parse their way through an informal mess.

    12. Re:vi/emacs/eclipse/whatever + svn? by Count+Fenring · · Score: 1

      I think the idea is that it would strip all the indentation along with the comments, and then apply rigorous auto-indent (or, possible, indents stored with the sets of comments) of the nature you want. Either way, I think any advantages of this idea are canceled out by the fact that A)No one would use it, since it complicates producing source code by several factors if you want to make it useful, and B)It complicates the process of getting the functional source + comments mix to start working. I do see how being able to support multilanguage comments would be nice, though. The problem is, they're such ephemeral objects (non-programmatic sense) that the effort of constantly re-translating them when they change would be pretty constant and pointless-feeling.

    13. Re:vi/emacs/eclipse/whatever + svn? by eneville · · Score: 1

      gvimdiff + svn diff makes a nice version tracking system. Everything we do gets peer reviewed so we're all in the habit of using something like the above combination, be it plain diff or svn of some sort.

    14. Re:vi/emacs/eclipse/whatever + svn? by agbinfo · · Score: 1

      I think the idea is that it would strip all the indentation along with the comments, and then apply rigorous auto-indent (or, possible, indents stored with the sets of comments) of the nature you want.

      Pretty much. All you need is to normalize the code, do a diff -e between the normalized code and the formatted code and store the result. Now anyone that extracts the code can retrieve the normalize code and apply their own formatting or apply the diff'd output. The source control tool could do this automatically. When building, only use the normalized code.

      Either way, I think any advantages of this idea are canceled out by the fact that A)No one would use it, since it complicates producing source code by several factors if you want to make it useful,

      If done as above, it would have no impact on the coders that choose to checkout w/o applying their own rules since by default, you'd get the file with the last formatting applied. The source control tool would take care of that.

      and B)It complicates the process of getting the functional source + comments mix to start working.

      Can you elaborate on this?

      I do see how being able to support multilanguage comments would be nice, though. The problem is, they're such ephemeral objects (non-programmatic sense) that the effort of constantly re-translating them when they change would be pretty constant and pointless-feeling.

      OK. Let's ignore the multilingual comments for now. I still think that separating the code from its layout and comments would be relatively easy and would have more benefits than drawbacks.

    15. Re:vi/emacs/eclipse/whatever + svn? by agbinfo · · Score: 1

      Thanks.

      Clearmake (and OMake too - I think) does something similar. It remembers the command line used and the environment, creates a hash and compares that when asked to do a build. CCache is probably better because changing a comment in a file will not force a re-compile however, you need to parse the files all the time.

    16. Re:vi/emacs/eclipse/whatever + svn? by agbinfo · · Score: 1

      That's a problem with your make program, not with your text editor. Get a make program that determines whether a file has changed by looking intelligently at its contents, not its timestamp.

      (It's trivial in principle: all you need is a normalisation routine for each file format, then you store a list of digests. Omake does something like this, though I can't remember offhand whether it normalises files before calculating digests.)

      From what I remember of OMake, the program looks at the command line to execute along with the environment. If none of the files used have changed and the environment is the same, it skips the build. As far as I know, it doesn't normalize and will still rebuild if a comment is updated.

      I do agree that the editor shouldn't have to deal with this but the source control tool could reduce the workload of the make application.

    17. Re:vi/emacs/eclipse/whatever + svn? by palegray.net · · Score: 1

      Emacs actually has a calculator for the meaning of life built in, although it always returns "42" for some reason. Additionally, it contains functionality designed for carnal gratification, along with a module for making you a sandwich after the completion of the act (reference Barefoot::Kitchen::Bedroom for the Perl extension).

  2. Version control by Just+Some+Guy · · Score: 5, Insightful

    You don't solve that by changing editors. You solve that by standardizing on a version control system and using it. For example, you could stick a Subversion server somehwere on your network, then install TortoiseSVN on your client machines. When you edit the file, you commit it with a log message of why you made the changes.

    This is infinitely preferable to forcing all of your developers to use one specific editor (which is the universal holy war among programmers), when all of them will be half-assed at best when compared to real version control.

    --
    Dewey, what part of this looks like authorities should be involved?
    1. Re:Version control by Shaitan+Apistos · · Score: 5, Informative

      Some editors, netbeans for example, even have visual cues in the margin indicating what you've changed from the svn revision you've checked out since your last commit.

    2. Re:Version control by Shados · · Score: 1

      Yeah, I just don't think a 32 meg file in netbeans with svn and the change tracking in the margin will be a very efficient way of editing the file though, considering these features in most such IDEs tend to start choking after a few hundred kilobytes.

    3. Re:Version control by Oh+no,+it's+Dixie · · Score: 1, Interesting

      I know for a fact that Eclipse has this feature as well.

    4. Re:Version control by markov_chain · · Score: 5, Funny

      You must switch to version control, urgently!

      --
      Tsunami -- You can't bring a good wave down!
    5. Re:Version control by DRAGONWEEZEL · · Score: 1

      I read the link, and got the joke, but I am out of mod points...

      Here's a virtual +5 funny.

      --
      How much is your data worth? Back it up now.
    6. Re:Version control by HiThere · · Score: 1

      I didn't get the impression that most of the users were to be programmers, and apparently he was explicitly instructed to find a text editor with version tracking. Naturally that's basically impossible.

      What would probably be acceptable, if it could be found, would be a programmer's editor that had it's own file format which kept track of changes, and a *really good* export feature which turned the current version into export text (in your choice of ASCII, UTF-8,-16, or -32).

      Version control is a good choice for programmers, but with current interfaces (that I know) not for much of anyone else.

      OTOH, if it *IS* for programmers, perhaps he could talk his management into accepting his favorite version control system. (*IS* there a best version control system right now? How would he choose between svn, bazaar, mercury [aka hg], and git [or even cvs]? [I.e., on what basis other than familiarity?])

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    7. Re:Version control by Anonymous Coward · · Score: 0

      No, he must switch his overlords!

    8. Re:Version control by AmberBlackCat · · Score: 1

      So who's going to tell the boss he's nuts?

    9. Re:Version control by Anonymous Coward · · Score: 0

      Not always the case unfortunately. He didn't say "developers" he said "business users" which could mean anything.

      If said business users are working in a legal department/law firm there could very well be a requirement that all metadata associated with file accesses/changes/etc. travel with the file itself (ala. MS Office Word) as a matter of standard policy - no exceptions. At which point one can attempt to challenge the policy but first you have to show there's no workable solution prior to petitioning for the exception.

    10. Re:Version control by Just+Some+Guy · · Score: 1

      Version control is a good choice for programmers, but with current interfaces (that I know) not for much of anyone else.

      TortoiseSVN: right-click the changed file, select "commit". Write why you changed it. Click OK.

      I don't have to interact with Windows that often, but when I do, TortoiseSVN is one of the things that makes it more tolerable.

      --
      Dewey, what part of this looks like authorities should be involved?
    11. Re:Version control by Anonymous Coward · · Score: 0

      We recently switched from Subversion to Git as our version control. Subversion is better for Windows users as they have the TortoiseSVN client for Win32. It takes a bit of understanding to figure out how to work with version control software, but once you've got it, the benefits are immense. File versioning, edit tracking, central backup, etc.

      Another benefit with using version control are the Version Control tracking tools available. We use RedMine (www.redmine.org) which hooks in to Git or Subversion. Among other things, RedMine can "annotate" a file, and show you line by line who is responsible for the changes.

      "Trac" (http://trac.edgewall.org/) is another version control tracking software we tried, but after installing Redmine, I'm converted.

      Go with a version control system, and install vc tracking software to view the edits!!!

    12. Re:Version control by AigariusDebian · · Score: 1

      Using TortoiseSVN might be too complex for the intended use. Just using WebDAV SVN repo and an editor with support for editing a WebDAV file directly would do. You will not have commit messages, but in this case, I do not think anyone cares as long as history is kept and it is known who did what change.

    13. Re:Version control by Anonymous Coward · · Score: 0

      That's so ninitees... Get a wiki and edit on the web.

      One cool thing about wikis is that they automatically keep track of every change and every user, without them having to know SVN commands or GUIs.

      Doing things simply in the web is the way to go, dude.

    14. Re:Version control by Just+Some+Guy · · Score: 1

      A 32MB file being edited in a browser form. That's like what evil programmers have to do in hell.

      --
      Dewey, what part of this looks like authorities should be involved?
    15. Re:Version control by dubl-u · · Score: 1

      You don't solve that by changing editors.

      Well, perhaps you can.

      IntelliJ IDEA has three kinds of in-editor change tracking.

      Assuming the original poster is keeping these files in some version control system (which he sure should be) then it will highlight changes both in the left window gutter and in the scroll bar. That way you can tell exactly what you've touched.

      A second is a nice integration of the "blame" or "annotate" function, where in the left gutter it will mark each line with who made the last change and when.

      A third is that it has its own internal version control system that's more granular than checking in. So as you're working, you can look back at what you've been up to. Think of it kind of like a shell's command line history, but for editors.

      For working on code, I love all of these features.

  3. source control? by MariusBoo · · Score: 2, Insightful

    Are the overlords retarded? Just use source control (svn?). "Track changes" is evil.

  4. diff -Nrau by red_dragon · · Score: 4, Informative

    What's so bad about diff that you're not using it already? Certainly it would be a better choice for dealing with multiple text files: make a working copy (which can be an entire directory tree), do your changes on the working copy, and then run diff against the original and working copies. And I bet that there's an Emacs mode for that too.

    --
    In Soviet Russia, Jesus asks: "What Would You Do?"
    1. Re:diff -Nrau by Anonymous Coward · · Score: 0

      M-x ediff-files or ediff-directories?

    2. Re:diff -Nrau by Anonymous Coward · · Score: 0

      Or ediff-buffers...

      I also like adding:

      (setq ediff-diff-options "-w")
      (setq ediff-split-window-function 'split-window-horizontally)
      (defvar ediff-window-setup-function 'ediff-setup-windows-plain)

      -w to get rid of whitespace differences.

  5. CVS/SVN? by Jonah+Hex · · Score: 5, Informative

    I understand you want an all-in-one, however I believe that most "programming" editors can hook into some sort of change management program. I use one locally with my AutoIT3 scripts and the SCiTE editor, every time I compile it asks me for a "changes/reason" and enters that into my own local source management.

    SCiTE

    SCiTE for AutoIT with screenshots

    CVS/SVN wrapper for SCiTE with screenshots and instructions

    Jonah HEX

    1. Re:CVS/SVN? by nmb3000 · · Score: 1

      SCiTE

      I've also used Scite for AutoIt and it does work very well, but in general Scite is a royal PITA to configure. If you want to change text styles or colors you have to wade through several mountains of configuration files, hunting for just the right line to change, restart the editor and hope you picked the right place to edit.

      For Windows users, Notepad++ is a much better solution. It uses the Scintilla editor engine so it has the same capabilities as Scite, but the configuration is all done through a GUI editor. This makes configuring syntax highlighting and styles much easier and less time consuming.

      --
      "What do you despise? By this are you truly known." --Princess Irulan, Manual of Muad'Dib
      /)
  6. Custom tool by CaseyB · · Score: 2, Interesting

    In addition to joining the chorus that will suggest you use version control, I'll put in a suggestion to write a custom tool to view and make specific changes to the file. Multiple users editing *data* files by hand, with no validation, is silly.

  7. Real version control by pjt33 · · Score: 1, Troll

    SVN is "half-assed" when compared to real version control. Install git.

    1. Re:Real version control by blp · · Score: 1

      As I understand it: Git is not good at tracking large files, because it keeps a full copy of every version of a file. A Git repository that contains 10 versions of a 32 MB file will be 320 MB in size (before compression: Git uses gzip).

    2. Re:Real version control by Just+Some+Guy · · Score: 0, Flamebait
      1. It sounds like they're all editing the same master file. That's begging for centralized VC.
      2. VC didn't exist before 2005. Yep. It's a proven fact. No one ever used VC successfully before Linus invented it.
      --
      Dewey, what part of this looks like authorities should be involved?
    3. Re:Real version control by pjt33 · · Score: 4, Insightful

      It's not quite as straightforward as that, but there's a valid objection there, and I take the point.

      Of course, the real problem is the idea that users manually editing a 32MB file on a regular basis is at all a sensible idea.

    4. Re:Real version control by mweather · · Score: 1

      Solution: pay $200 for a terabyte hard drive. That should be enough space for a decade or two.

    5. Re:Real version control by pjt33 · · Score: 2, Interesting

      When I was young, we used RCS and we liked it! As the state of the art changes, so do the requirements to stay at the top. It's possible that SVN 1.5 qualifies as real version control by modern standards - I'll find out when it reaches my somewhat conservative distro - but previous versions have poor support for merging.

      I'm also rather unhappy at SVN this week because it managed to get itself in a horribly confused state in which it told me I needed to run svn cleanup to fix some locks, but running svn cleanup just got me an error message saying that I needed to run svn cleanup to fix the locks. I ended up having to delete and do a clean checkout, and was not impressed.

      As to the accusations of Linus fanboydom (yours is the second), the only reason I mentioned git is that I used it in my previous job and it worked well. I could equally have said Mercurial or BitKeeper, but since I have no experience with those I can't really recommend them.

    6. Re:Real version control by Dragonmaster+Lou · · Score: 2, Informative

      Actually, it only appears to keep a full copy for the most recent versions, and repacking the repository ('git gc') will delta-encode everything as necessary. At least, that's how I understand the way it's described on the git wiki: http://git.or.cz/gitwiki/Git?highlight=(delta)|(compress)

    7. Re:Real version control by Red+Alastor · · Score: 1

      It's not automatic but yes. Everything that is commited is merely zipped and stashed away (which yields good performance) until you manually go a git gc.

      The reason, I believe is that an operation that takes an instant could take a few seconds if it were to always repack. Using git, you get the habit of typing git gc at the command line when idle just like you get the habit of ctrl-s (or your editor's equivalent) all the time when you are idle when typing something.

      Once repacked, git is the most space-efficient.

      --
      Slashdot anagrams to "Sad Sloth"
    8. Re:Real version control by thsths · · Score: 1

      > Of course, the real problem is the idea that users manually editing a 32MB file on a regular basis is at all a sensible idea.

      The problem is a combination of two unusual requirements: big files and on-line change tracking.

      Anyway, I think the big file size is the more interesting issue. If you have a file with 32 MB size, it should have a very clearly defined structure - it is data. So the changes should also be presented in this structure, which means you need a custom tool. If your file does not have a very clear structure, you have lost already, and all the reviews in the world are not going to help.

    9. Re:Real version control by Kent+Recal · · Score: 4, Insightful

      It's not "unusual", it's simply nonsense.
      If your business process requires non-techie users to edit and share 32M-sized textfiles regularly then your business process is broken. The whole approach is broken beyond repair, the obvious solution would be to build some kind of frontend for the users.

    10. Re:Real version control by sylvandb · · Score: 1

      When I was young, we used RCS and we liked it! As the state of the art changes, so do the requirements to stay at the top.

      Yes, but it is also important to use the right tool for the job. In this case, it sounds to me like rcs might be that right tool. No central server or repository needed, just a little wrapper or plugin for whatever editor that puts the file into the archive (stored in the same dir with the file) after every edit.

      I'm also rather unhappy at SVN this week because it managed to get itself in a horribly confused state in which it told me I needed to run svn cleanup to fix some locks, but running svn cleanup just got me an error message saying that I needed to run svn cleanup to fix the locks. I ended up having to delete and do a clean checkout, and was not impressed.

      BTDT, but if I blew away my 10G sandbox I wasn't going to get anything done for a long time. Turned out to be fairly easy to fix. First an svnclean and then svn cleanup. Careful attention to the error messages led me to the problem. Can't remember if it was missing tmp dirs or what. I've had sandbox problems enough times to know svn is far from perfect, but my sandbox has been much more solid since I uninstalled tortoise and just use the plain vanilla cmdline client (from the apache package). Now windows uses more of my linux finger memory, and less problems with data integrity.

      sdb

    11. Re:Real version control by symbolset · · Score: 1

      When I was young, we used RCS and we liked it!

      And we wore an onion on our belt, as was the fashion of the day.

      --
      Help stamp out iliturcy.
  8. UltraStudio.... by Anonymous Coward · · Score: 0

    Umm, you mention UltraEdit... UltraStudio adds SVN or CVS control to it... whats wrong with that?

    1. Re:UltraStudio.... by Jonah+Hex · · Score: 1

      Just looked this up, it appears to support CVS/SVN servers, but it doesn't include one built in.

      UE Studio Tour: CVS/SVN

      Jonah HEX

    2. Re:UltraStudio.... by Anonymous Coward · · Score: 0

      I think its obvious there needs to be a new solution to this problem, using some RDB, but in answer to the question. VSS(visual source safe) by m$ft will fit the bill. Its got the right tracking features and is easy enough to use for the average moron. does multiple levels of diff's, etc..

  9. change the process by DragonTHC · · Score: 5, Insightful

    if your business users have to edit 32MB text files by hand, someone is a moron.

    Someone didn't know what they were doing in the first place.

    Change the process to make sense.

    Perhaps those "files" should actually be in a database. SQL makes automatic manipulation quite easy.

    --
    They're using their grammar skills there.
    1. Re:change the process by blincoln · · Score: 5, Insightful

      Perhaps those "files" should actually be in a database. SQL makes automatic manipulation quite easy.

      Exactly. That also makes it easy to build a change audit logging table.

      --
      "...always new atoms but always doing the same dance, remembering what the dance was yesterday." -Richard Feynman
    2. Re:change the process by DragonTHC · · Score: 4, Funny

      come to think of it, it sounds like you're asking us how to best manage spam hit lists.

      --
      They're using their grammar skills there.
    3. Re:change the process by cstdenis · · Score: 2, Insightful

      Thats silly. Spammers don't edit their lists. They just blast it out to all, valid or fake.

      --
      1984 was not supposed to be an instruction manual.
    4. Re:change the process by Anonymous Coward · · Score: 2, Insightful

      Agreed. Fix the real problem, which is "Having to hand-edit a 32 MB text file in the first place."

    5. Re:change the process by Anonymous Coward · · Score: 0

      That's assuming that the data isn't going to be imported into SQL after the data is repaired. It could be improperly structured EDI data or something of that nature that isn't importing properly because of errors in the file.

    6. Re:change the process by qoncept · · Score: 2, Interesting

      That's a pretty short-sighted comment. It's very easy to end up doing something that outwardly looks totally foolish. Maybe these files started out about 4kb (and as I imagine this example, I'm remembering when it happened in my project) and unforseen changes caused it to gradually grow to 32mb. Hand editing from the beginning wasn't a big deal, but now it is.

      Which brings up the issue of changing this "process." Have you worked in a fast paced environment with limited resoures? Processes don't just change. Projects just like this are thought up, planned, and indefinately postponed because they don't have extra resources to devote to the two months it would take to rewrite the process, allocate hardware, set up a database, migrate the data, train the users, test, install client software and so on.

      --
      Whale
    7. Re:change the process by jzu · · Score: 2, Insightful

      Yes, CVS/SVN/whatever is a good technical answer to a bad requirement. You probably cannot change anything at the requirement level, however, so your best bet would be to report your findings in a very technical and neutral way... And, as a side note or even a line in the corporate summary, just point out the deficiencies in the process and possible solutions if you can imagine straigthforward ones, leaving options open. BTW, the word "risks" has magical powers.

    8. Re:change the process by SparkEE · · Score: 1

      In and of itself, having to edit 32MB files may not point to a bad process. I'm write vhdl/verilog for a living, and when the designs are synthesized, most tools can create a gate-level vhdl or verilog output that can be used for back-annotated simulation. These files are typically very very large. In fact, I remember having problems years ago when the files went into the GB range. It's sometimes necessary to edit these files when a bug is found and a fix needs to be tested without having to re-run synthesis first (a very long process).

      That said, a "track changes" "feature" for a text file editor just sounds like a bad idea. I'm with everyone else here saying that version control and diff should be the answer.

    9. Re:change the process by Baddas · · Score: 1

      You still need to track changes in the file, so you may as well stick it somewhere. In the DB as a text field isn't a great idea, but it would be better than "We're just winging it" is.

    10. Re:change the process by Baddas · · Score: 2, Informative

      Sounds like they're in a non-sustainable environment. Once they run off the rails, or someone gets sick, or someone puts a comma where they shouldn't, the whole house of cards comes crashing down.

      Risk management via creating space to improve the process is surely a better option than that, right?

    11. Re:change the process by 91degrees · · Score: 1

      Perhaps, but changing the system entirely will take time and resources, an runs the risk of causing new problems. For now, the process works adequately.

    12. Re:change the process by Anonymous Coward · · Score: 0

      Or at least the poster should tell us what the "process" is to give us a laugh!

    13. Re:change the process by Anonymous Coward · · Score: 0

      That is, of course, the correct thing to do. Therefore, it is guaranteed that it will be virtually impossible to get permission from the PHBs to acutally do so. In the real world, the morons make the decisions and we, the annointed, get to grumble and implement the assinine plans of the morons.

  10. Source Control by Imagix · · Score: 5, Insightful

    I'll echo the same sentiments as everybody else... use source control. In addition, you're asking for the impossible. Word Processors can do "change tracking" within a file because the file contains more stuff than simply the text that you type in. Based on your description, the file you're talking about is simple text data, and has no provisions for storing "previous versions" directly within the text file. Where were you expecting this additional information to reside? And if it's in the same file, you would also have to change whatever tools you're using to process that file to be aware of all of this new (and to that tool, useless) information within the file.

    1. Re:Source Control by ysarig · · Score: 1

      Actually, this is not necessarily an issue. You can always store your changes meta data somewhere else (in a centralized location or in a "shadow" file like your_file_name.ver). Being able to do this, doesn't change the fact that this is still a bad idea :).

      --
      Yair
    2. Re:Source Control by edmicman · · Score: 1

      So it sounds like the solution is to work with the data file as an MS Word document! Sweet!

    3. Re:Source Control by Anonymous Coward · · Score: 0

      Your quite right of course but reading your post lead me to consider that it would be possible to store previous versions using Alternate Data Streams with NTFS. At 32MB per file, that would be bloat beyond compare, but it seems that it would be possible (however impractical).

    4. Re:Source Control by Anonymous Coward · · Score: 0

      And the beauty of it is that a 32Mbyte text file in word is only 4 pages!

    5. Re:Source Control by jim.hansson · · Score: 1

      but try to do backup or copy a file with ADS:s and see what happen then.

      --
      preview button, my computer does't have any preview button
  11. diff by Anonymous Coward · · Score: 5, Funny

    I just wrote one for you, and it is even using your favorite editor:
    cp $1 $1.bak
    `$EDITOR $1`
    diff $1.bak $1

    1. Re:diff by Anonymous Coward · · Score: 0

      No, diff is exactly the right tool for this. Finding the differences between two files is the whole reason it exists.

      If you're missing something, it's only realizing that people tend to complicate things more than necessary.

    2. Re:diff by Anonymous Coward · · Score: 0

      That ought to be:

      cp "$1" "$1".bak
      "$EDITOR" "$1"
      diff "$1".bak "$1"

      C'mon people, file names can have spaces! Also, those backquotes in line 2 are bad Jookie.

    3. Re:diff by Anonymous Coward · · Score: 0

      Let's handle that argument properly:

      cp "$1" "$1.bak"
      `$EDITOR "$1"`
      diff "$1.bak" "$1"

  12. Re:AskSlashdot: "Please Do My Work For Me" by Yurka · · Score: 4, Insightful

    Many of the Slashdotters actually pay for the opportunity to, among other things, answer questions like that. If you do not derive satisfaction from doing it, just step aside, no one is forcing you to post.

    --
    I can assure you, the best way to get rid of dragons is to have one of your own.
  13. Wiki? by mi · · Score: 3, Interesting

    Sounds like Wiki may be the best... It is easy enough to split the document into sections, which can be edited concurrently. It keeps the history available. And the format is (almost) text.

    Pick MediaWiki (the same software, that powers WikiPedia) or any other implementation (some may be easier to operate on a small LAN, and/or be able to export pure text, etc.)

    --
    In Soviet Washington the swamp drains you.
    1. Re:Wiki? by Anonymous Coward · · Score: 2, Insightful

      Did you ever open a 32mb text file in a browser?
      Or edit it in a textbox inside a browser?

      (Even if you split it in sections of, say, 1mb, it's still not gonna work comfortably. And then we're not even talking about reassembling the pieces to get the original big file.)

      And, like someone else said, if you need to start tweaking text files bigger than 32mb, then something in your business processes is wrong.

    2. Re:Wiki? by Fox_1 · · Score: 1

      yeah Mediawiki software has known issues with editing large files - more to do with the web browsers then with any failing on Mediawiki's part. Beyond that installing Mediawiki as a solution to this problems seems like a lot more overhead and extra work than is needed. Mediawiki is a collection of scripts and a SQL database. Unless you really want *those* particular Scripts and Database, it's probably easier to do what has already been suggested and just use a simple SVN solution or database.

      --
      The rock, the vulture, and the chain
    3. Re:Wiki? by Anonymous Coward · · Score: 0

      Yeah, run a data file through a markup parser. What could possibly go wrong.

  14. That's not fair by Scotteh · · Score: 5, Insightful

    When you don't know how to do something, where do you go? I usually got to Google first and look around. Sometimes I find something, sometimes I don't. When I can't find anything via Google, where then do you turn? A co-worker? A friend? Maybe an online community of people who would know? The latter sounds like the most promising to me.

    A company isn't concerned with how you find the answer (provided you come by it legally), they just want an answer as soon as possible. The faster, the cheaper the solution man-hours-wise.

    I wouldn't be surprised if you've posted for help on an online forum or asked a friend for help with something. It's no different. It's all part of research.

    1. Re:That's not fair by mweather · · Score: 1

      Just turn your cookies off and use Experts Exchange. If answering questions is your thing, you can even get free access. 'Course turning off cookies is easier.

    2. Re:That's not fair by spazdor · · Score: 5, Funny

      their domain name used to be "expertsexchange.com".
      Then one day that address suddenly redirected to "experts-exchange.com" You could almost feel the webmasters smacking themselves in the forehead.

      --
      DRM: Terminator crops for your mind!
    3. Re:That's not fair by blueZ3 · · Score: 1

      You can get free access by looking at the cached version using google.

      --
      Interested in a Flash-based MAME front end? Visit mame.danzbb.com
    4. Re:That's not fair by didroe84 · · Score: 2, Informative

      They've become slightly more tricky about it now. It uses Javascript to hide all the comments so even the cached copy doesn't work. Unless you use NoScript of course :).

      I'm not sure this would be a good idea but Google could offer a service where webmasters can register a key with their domains and then when the Google crawler comes along it could sign something with that key to ask for "protected" content. That way services you have to sign up for could still be indexed. Assuming you're willing to hand all your data over to Google of course, but nobody seems to have a problem with that at the moment.

    5. Re:That's not fair by FiloEleven · · Score: 2, Informative

      I've never had to turn off cookies or anything to view answers on Experts Exchange. Just scroll down past the masked answers and past all the categories: lo and behold, all of the answers are there in plain sight! This is the case for Firefox, at least.

    6. Re:That's not fair by wilder_card · · Score: 5, Funny

      I've got a list of "worst URLS" around somewhere that's got expertsexchange.com on it. Other memorable entries included an artist's site, speedofart.com, and the Mole Station Nursery, a wildlife non-profit, at molestationnursery.com.

    7. Re:That's not fair by spazdor · · Score: 3, Funny
      --
      DRM: Terminator crops for your mind!
    8. Re:That's not fair by ottothecow · · Score: 1

      Exactly. And that that has worked for all of these years as a business model just shows how stupid and lazy people are.

      --
      Bottles.
    9. Re:That's not fair by usrbinallen · · Score: 1

      Ask a Marine. D-uuuuhhh

      --
      Not everything that can be counted counts, and not everything that counts can be counted. Albert Einstein
    10. Re:That's not fair by A440Hz · · Score: 5, Funny

      Don't forget-- the company Pen Island decided to use their name (without dashes) as their URL. Capitalization being rare in URLs, it didn't work so well.

    11. Re:That's not fair by CecilPL · · Score: 1

      I don't know why this works for me, but I can get free access simply by scrolling to the bottom of the page. Seems to work on every question I've ever looked at - the locked out answers are at the top, then some ads, then the whole thread in plaintext at the bottom. (FF3/XP/Adblock/JS and cookies enabled).

    12. Re:That's not fair by Anonymous Coward · · Score: 1, Insightful

      I think that it would be a horrible idea. Content accessed by Google should be accessible to anyone. If you want Google to index your private site, pay them to do so and host the search within your site.

    13. Re:That's not fair by hotdiggitydawg · · Score: 3, Funny

      Neither did the URL for the Italian branch of a multinational energy company: "PowerGen Italia"...

    14. Re:That's not fair by Fez · · Score: 2, Informative

      They show up fine for me, just keep scrolling down. When I land on one of their pages from a google search, I see all of their gibberish posts but underneath all that, way down the page, I see the full text answers.

    15. Re:That's not fair by CharlieHedlin · · Score: 1

      I have free access and I haven't answered a question in years. Is this normal?

    16. Re:That's not fair by $1uck · · Score: 2, Insightful

      Bad Idea... I don't think google or any search engine should index things that aren't public. I think its retarded the way the search engine will point you to something you can't see or use w/o signing up. Really I wish google didn't index expert sex change. Its just more noise in the results.

    17. Re:That's not fair by Anonymous Coward · · Score: 0

      Ask a Marine. D-uuuuhhh

      I tried to enlist in the Marine Corps, but I was told I was unqualified. When they asked for my parents names, I knew both answers.

    18. Re:That's not fair by Oroki · · Score: 4, Informative

      Just scroll to the bottom of the page; all the answers are there.

    19. Re:That's not fair by Anonymous Coward · · Score: 0

      Hi Scotteh,

      I am a researcher at the University of Illinois. I am writing an article to be presented in Denmark and possibly be included in an upcoming book. I would like to send you an email about this post (I might like to quote you in my article). You can reach me at gcarls4 at uic.edu

      If someone else reads this and knows who Scotteh is could you please let him know to look here? Thanks.

    20. Re:That's not fair by amRadioHed · · Score: 1

      That trick doesn't work in IE. I assume this is because the experts-exchange guys are huge OSS fans and this is their way of rewarding users of non-proprietary browsers :)

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    21. Re:That's not fair by didroe84 · · Score: 1

      Yeah, that's why I said I wasn't sure it was a good idea. It would be useful though if you were signed up to those things. Maybe if they were all excluded by default but you could include the private parts of sites that you had subscriptions to.

    22. Re:That's not fair by didroe84 · · Score: 1

      OMG, the feeling of utter stupidity washing over me right now! I can't believe I didn't notice that!

    23. Re:That's not fair by dhasenan · · Score: 1

      You can turn off CSS and get answers at Experts Exchange, I've found. Provided someone chose to answer your question there earlier, of course.

    24. Re:That's not fair by Tacvek · · Score: 1

      Yes. It has always been possible to have a free non-premium account, but for the past few years it has been almost impossible to find the sign up form for that.

      One can get free premium account access by racking up enough points, but the non-premium accounts have always been free. But they have been trying really hard to make it look like only premium accounts exist.

      --
      Stylish sheet to fix many problems in Slashdot's D3: https://gist.github.com/801524
  15. Hmm, by Anonymous Coward · · Score: 0

    why not use diff/bdiff/sdiff or (gasp) some kind of source control system? Nah, too obvious...

  16. Simple, switch to VMS! by antifoidulus · · Score: 5, Insightful

    Automatic file versioning built right into the file system! Problem solved! Next!

    1. Re:Simple, switch to VMS! by Tsunayoshi · · Score: 1

      Of my limited 1 year of pain with VMS back in the 90s (the software got ported to Linux shortly after), I think the file versioning was awesome.

      We had a custom DIR alias to only show the current version, and custom purge scripts to keep the directories from becoming unwieldy.

      --
      "Get a bicycle. You will not regret it, if you live." - Mark Twain, "Taming the Bicycle"
    2. Re:Simple, switch to VMS! by UnderCoverPenguin · · Score: 4, Informative

      If the users are using Linux, there is also ext3cow, which was discussed on /. (http://linux.slashdot.org/article.pl?sid=07/05/02/0413253&from=rss), the newly announced Tux3 (http://lkml.org/lkml/2008/7/23/257), Wayback (http://wayback.sourceforge.net/) and others.

      --
      Don't try to out wierd me, three-eyes. I get stranger things than you, free with my breakfast cereal. --Zaphod Beeblebr
    3. Re:Simple, switch to VMS! by Lurchicus · · Score: 1

      >diff mybigfile.txt;11 mybigfile.txt;12 /out=vms_ftw.txt

      --
      Lurchicus - For Sig, see other side.
    4. Re:Simple, switch to VMS! by Richard+Steiner · · Score: 1

      Unisys OS2200 is better -- it supports file and directory "cycling" which is roughly similar to versioning, but you can also use a directory file ("program file") to store files ("elements") that are never actually delated (only marked as such) until the directory is packed. That means you can have dozens of older versions saved, but they don't clutter up your directory displays unless you choose to see them. :-)

      --
      Mainframe/UNIX Bit Twiddler and long time Windows/Linux Hobbyist.
      The Theorem Theorem: If If, Then Then.
    5. Re:Simple, switch to VMS! by Medievalist · · Score: 1

      Automatic file versioning built right into the file system! Problem solved! Next!

      Beat me to the punch. VMS was running on 64-bit processors with full version control built into the OS in 1992.

      The ISO-9660 standard used on most CD-ROMs has VMS-style version numbering built in, but more primitive OSes can't really do anything with it.

      *ix file system semantics are such a huge step backwards. As somebody once said (jwz perhaps?) "If you'd told me 20 years ago that unix was the great hope for the future, I'd have cut my own throat". Sadly, licensing and corporate greed have trumped technical issues, and now we just try to buy an OS that won't go unsupported if the vendor cashes out or decides to ram an upgrade down our collective throats.

    6. Re:Simple, switch to VMS! by serviscope_minor · · Score: 1

      Automatic file versioning built right into the file system! Problem solved! Next!

      Beat me to the punch. VMS was running on 64-bit processors with full version control built into the OS in 1992.

      IRIX was 64 bit by 1994. I don't know of any earlier ones, but there may be. I also don't know when workstations of the size that NUIX supported started supporting > 2G RAM. According to the wikipedia, the R10000 memory controller only supported 1G. Not much real need for 64 bit, then.


      The ISO-9660 standard used on most CD-ROMs has VMS-style version numbering built in, but more primitive OSes can't really do anything with it.

      *ix file system semantics are such a huge step backwards. As somebody once said (jwz perhaps?) "If you'd told me 20 years ago that unix was the great hope for the future, I'd have cut my own throat". Sadly, licensing and corporate greed have trumped technical issues, and now we just try to buy an OS that won't go unsupported if the vendor cashes out or decides to ram an upgrade down our collective throats.

      What's wrong with UNIX file semantics? These days, good version of unix have filesystems with versioning, such as: http://wayback.sourceforge.net/. In this case, the versioning is implemented using a very general machanism, instead of being built in. This allows, as a result, many more things than just versioning filesystems. You should look in to FUSE.

      --
      SJW n. One who posts facts.
    7. Re:Simple, switch to VMS! by Anonymous Coward · · Score: 0

      Oh yeah, let's all use IBM crap!

    8. Re:Simple, switch to VMS! by leighklotz · · Score: 1

      ITS had versioning in the filesystem way before VMS.

    9. Re:Simple, switch to VMS! by Medievalist · · Score: 1

      What's wrong with UNIX file semantics?

      It's not that there is anything wrong with it, it's just that it's so ridiculously primitive. I mean, rwxrwxrwx is such a incredibly limiting mindset... if you've never developed a large complex system on a more advanced filesystem (like VMS or Novell's Netware file system) you probably aren't aware of what you are missing.

      Limiting files to only one group membership, and only five possible file manipulation properties (rwxts) is really lame, it's a 30 year old paradigm that several other OSes surpassed 20 years ago. Novell even used to have "rename inhibit" as a filesystem attribute!

      Stacking ACLs on top of other architectures has always been a way to create system maintenance nightmares, ACLs enable as many problems as they solve in unskilled hands (at least you can back them up with the files they apply to these days, though, that's a recent improvement in the *nix world).

      These days, good version of unix have filesystems with versioning, such as: http://wayback.sourceforge.net/. In this case, the versioning is implemented using a very general machanism, instead of being built in. This allows, as a result, many more things than just versioning filesystems. You should look in to FUSE.

      Thanks for the link; I'm already familiar with FUSE. Wayback looks nice, especially for anyone who doesn't already have something based on Mike Rubel's paper set up, but it's not solving the same problem as a file system that cleanly implements version numbering.

      There's nothing wrong with a sharp rock. But I'd rather have a nice steel axe when I need to chop down trees. Once you've used a better toolset it's hard to go back to the stone age.

    10. Re:Simple, switch to VMS! by Anonymous Coward · · Score: 0

      Doesn't automatic file versioning become tedious? I'd think it would be a pain to flip back through the 5 versions of the file that didn't compile, the three that compiled bug had blatant bugs and hope you remember that 15 saves ago you had something you wanted.

  17. Re:AskSlashdot: "Please Do My Work For Me" by somersault · · Score: 2, Informative

    He points out that he has had a look himself, but he doesn't seem to have heard of version tracking software, or cpmsoders it overly complex for their needs. Personally I've never used any myself, but it sounds about right for this type of task.

    --
    which is totally what she said
  18. Re:AskSlashdot: "Please Do My Work For Me" by jimwelch · · Score: 2, Interesting

    "not to sound like a..." TOO LATE!

    Why complain? Too many people on slashdot are whiners! If you don't want to help, don't respond! That is the beauty of "open source". Help if you want or don't.

    I have been programming for over 30 years and am considered a guru by my peers. But I know my limitations. For example I would not touch a SAP project with out help, because I have no experience.

    Maybe the solution for everyone, is to have a category for "I need help" that people like you can tell slashdot not to show on your home page.

    For those who are not observant: this comment is recursive and sarcastic.

    --
    Never trust a man wearing a coat and tie!
  19. Um, Eclipse? by Progman3K · · Score: 5, Informative

    I seem to recall Eclipse saves your edit history

    --
    I don't know the meaning of the word 'don't' - J
    1. Re:Um, Eclipse? by Anonymous Coward · · Score: 0

      Important Stuff
          Read other people's messages before posting your own to avoid simply duplicating what has already been said.

    2. Re:Um, Eclipse? by bacchu_anjan · · Score: 1

      Hi there,

          I tried to duplicate what you suggested. As long as a file is in a project, eclipse tracks history BUT if the file is NOT in a project, then eclipse does NOT track history.

      BR,
      ~A

    3. Re:Um, Eclipse? by Anonymous Coward · · Score: 0

      Editing a 32mb file with eclipse. Seems a winning idea to me.

    4. Re:Um, Eclipse? by Anonymous Coward · · Score: 0

      IntelliJ IDEA from JetBrains does as well.

      Java IDEs FTW!

  20. It's Free and Open Tech Support by marcus · · Score: 1

    Using free software written by someone else is not the only way to take advantage of the community knowledge base.

    Come on man, get with the program. Everyone contributes, debugs, tweaks, uses.

    --
    Good judgement comes from experience, and experience comes from bad judgement.
    - W. Wriston, former Citibank CEO
  21. That's the file system's job by DrSkwid · · Score: 1
    --
    There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
  22. Your editor of choice + svn + scripts by Simon+(S2) · · Score: 1

    I think tracking changes should not be the job of the editor, but of something else that is good at it, like svn. I would let people use the editor they like, and add this script on their local machine to track changes. They can then commit the changes to the svn server and the Overlords can check out the changes (or any revision of them) from the main repo.

    --
    I just don't trust anything that bleeds for five days and doesn't die.
  23. Does the file format support it? by Richard_at_work · · Score: 4, Insightful

    a new file editor that will track changes made to a file (as a word processor does)

    A large part of the 'as a word processor does' feature is that the file format itself supports it - all the changes are saved right along side each other and the word processor picks and chooses what to display to you at any particular point in time. If your file format does not support change tracking, you need to look at external change tracking solutions such as SVN/CVS or something on the file system level.

    1. Re:Does the file format support it? by tsalmark · · Score: 1

      I'd give you Plus 6 Insightful if it raised you up the page any. Personally my vote is on SVN and which ever text editor works best with the dataset in question - config file/ flat database or novel would all get a different vote from me.

  24. Editor with hooks to Source Control by jimwelch · · Score: 1

    I use to use CodeWright for this.
    MS Visual Studio does this at work.
    Notepad++ does this for free at home.

    --
    Never trust a man wearing a coat and tie!
  25. Versioning file system by Anonymous Coward · · Score: 0

    Do something cool like have a samba/NFS share to the users with a versioned file system backend
    http://en.wikipedia.org/wiki/Versioning_file_system

  26. uhhh.. yeah by Anonymous Coward · · Score: 0

    My business users regularly have to tweak large (>32MB text) data files manually

    Sorry, I stopped reading right there. Quit your job. NOW

    1. Re:uhhh.. yeah by oliverthered · · Score: 1

      he may have difficulty getting another one if he doesn't know what svn is.

      --
      thank God the internet isn't a human right.
  27. emacs will have a plugin by thermian · · Score: 1

    It always does, for everything.

    --
    A learning experience is one of those things that say, 'You know that thing you just did? Don't do that.' - D. Adams
    1. Re:emacs will have a plugin by ckaminski · · Score: 1

      And if it doesn't, the collective weight of all the LISP in the world will spontaneously birth a plugin that does!

  28. SubEthaEdit might be the tool for this by Chainsaw · · Score: 1

    Basically, it's a realtime distributed editor, but has a native format that saves who authored what. Works really well.
    http://www.codingmonkeys.de/subethaedit/

    --
    War is one of the most horrible things a human can be exposed to. And one of the worlds largest industries.
    1. Re:SubEthaEdit might be the tool for this by Wingsy · · Score: 1

      Yes it does work really well. I use it every day.

      --
      If I didn't have absolutely NOTHING to do, I wouldn't be here.
  29. aboiut change tracking by UnderCoverPenguin · · Score: 1

    track changes made to a file (as a word processor does)

    A word processor (or other office application) can track changes because the format of the file is specifically designed to allow such tracking. You data files, which you imply are text, are just data. Unlike a word processing document file, the editor is showing you everything in the file - there is nothing in the file to provide for change tracking.

    Of course, the file format could be enhanced, but then everything that uses the data files would need to be changed.

    As suggested elsewhere, your best bet is to use some kind of version control system. Some editors have support for interfacing to version control built in. Others require a plug-in extension. Assuming your users are using Microsoft Windows, one nice tool is TortoiseSVN (http://tortoisesvn.net). It integrates with Windows, directly, so you have access to version control from Windows Explorer (aka "My Computer", "My Documents", etc.) or even from the File Open dialog of many (though not all) applications.

    --
    Don't try to out wierd me, three-eyes. I get stranger things than you, free with my breakfast cereal. --Zaphod Beeblebr
  30. Eclipse by Midnight+Thunder · · Score: 1

    Eclipse offers such a feature, but I need to ask what format is this 32MB file you are meant to be editing?

    --
    Jumpstart the tartan drive.
  31. Re:AskSlashdot: "Please Do My Work For Me" by Anonymous Coward · · Score: 4, Funny

    > cpmsoders

    I think you need to move your keyboard about this much (___) to the left. The scary thing is it made perfect sense!

  32. try SlickEdit by davido42 · · Score: 2, Informative

    I believe SlickEdit now supports change tracking directly. Not sure how well it works with plain text data files, but it is supported on several platforms, has hooks for version control integration, and so on.

    --

    BitWorksMusic.com -- odd tunes for odd times

    1. Re:try SlickEdit by Anonymous Coward · · Score: 0

      Yes, SlickEdit rocks. It does a pretty good job of backing up automatically and tracking it over time. I can go back months and find old versions.

    2. Re:try SlickEdit by Anonymous Coward · · Score: 0

      Yes, SlickEdit does. SlickEdit Tools for MS Visual Studio is supposed to as well.

  33. Re:AskSlashdot: "Please Do My Work For Me" by Your.Master · · Score: 1

    This isn't school and it's not cheating to copy. If somebody is willing to answer the question, then the OP has just found a cost-effective means of doing his job (mind you, part of his job will be to vet the answer against reality and common sense).

  34. Ohhh, something does come to mind... by mseidl · · Score: 1

    Microsoft Word?

  35. Not enough info to give an authorative answer by DaveV1.0 · · Score: 1

    Is it straight text? If so, does it have to remain straight text?

    Do the overlords want to be able to identify who made the changes, or just verify the changes were made and made correctly?

    Is there a reason the data is not in a DB, etc?

    Different answers result in different solutions.

    --
    There is no "-1 offended" or "-1 you don't agree with me" mod options for a reason.
  36. Ask Google, then ask Slashdot by tepples · · Score: 2, Insightful

    When I can't find anything via Google, where then do you turn?

    You could ask Slashdot or some other forum, but provide an example of a Google query that you thought was promising but didn't turn up anything relevant. This way, others can see that you at least tried, and people can use why the queries didn't work as a starting point for conversation.

    1. Re:Ask Google, then ask Slashdot by Larryish · · Score: 0

      Couldn't these alleged "others" just sort of "assume" that the OP "tried?"

      That's all we do here, we TRY and TRY and TRY and...

  37. Geany + SVN, CVS or even RCS by flyingfsck · · Score: 1

    Most any respectable programmer's editor has hooks for versioning and build systems. The nicest ones are Gedit and Geany.

    --
    Excuse me, but please get off my Pennisetum Clandestinum, eh!
    1. Re:Geany + SVN, CVS or even RCS by Anonymous Coward · · Score: 0

      They don't really "track changes" in the way a word processor can
      track all editing operations - typically programming-oriented version control only tracks diffs between files (or just the file contents themselves in the case of git) when explicitly told to snapshot a version.

      OpenOffice's change tracking is particularly good (basically it's like microsoft word's, only not so buggy as to be unusable).

      Emacs _nearly_ has this feature, in at least two ways - you could
      do the editing with the keyboard macro recorder active, using the macro recording to record the changes (never bothering to actually rerun the macro of course), or you could periodically rip a copy of the undo list from its guts.

      But in either case, you'd get stuck on one obvious point - a text file, unlike a word processing file format, has no provision for saving such data in the same file. It'd be a recipe for data loss and fuckups.

      Really, it sounds like the people editing these files _should_ be using a data entry frontend to some database. A simple RDBMS is not hard to set up, and, while it's insane to use MS Access' own "JET" embedded database engine, it (or OpenOffice) serve as fine frontends to a real database over ODBC.

  38. Fix The Bug In The Overlords Heads by Bob9113 · · Score: 4, Insightful

    Overlords charged with verifying the aforementioned changes have requested that the little people be provided with a new file editor that will track changes made to a file (as a word processor does).

    Apparently your Overlords' heads have some fault code and need to be debugged.

    Revision tracking is accomplished with revision tracking software.

    You may think it is easier to just do what they are telling you to do, but in the long run it is not. They need to understand the difference between editing and revision tracking. If they do not, they will not be getting what they are looking for.

    There are a variety of methods for tracking revisions, from diff files to Subversion. Word processors store delta histories in the document, which is a poor place to store such things because it is insecure and liable to corruption.

    Then again, if you're doing hand edits to 32M text files, you probably are working in a company with less comprehension of information science than the City of San Francisco (alas, my beloved home city, but boy do they have their heads up their nether regions).

    Seriously - you may not like this answer, but it is the only correct one. Fix their understanding of revision tracking.

  39. Re:AskSlashdot: "Please Do My Work For Me" by somersault · · Score: 2, Funny

    Oops! That's quite imcjaracjterostoc of me... my apologies.

    --
    which is totally what she said
  40. Microsoft Word! by Saint+Stephen · · Score: 1

    Keep your master copy in Microsoft Word with its Change Tracking turned on, then export it to .txt every time you save it. LOL. Perfect!

  41. Doesn't anyone vet these questions? by gujo-odori · · Score: 1

    Doesn't anyone vet these questions at all?! The market offers a choice of version control systems, and even just plain old diff might be good enough for the task (or not). It's very clear that zero research was done prior to tasking Slashdot. I've been mulling over whether it was a dumb question or a lazy one, and things have become clear: both dumb and lazy.

    Even a little googling would have yielded good answers to the problem, but more to the point, if they asked someone who could not, off the top of her/his head give an answer that a version control system, or possibly just diff, are good approaches to solve the problem, then the "overlords" were obviously asking the question of someone who is unqualified to answer it, or to be in charge of implementing whatever solution they choose.

    1. Re:Doesn't anyone vet these questions? by Orion+Blastar · · Score: 1

      It makes a good story when someone who doesn't do any research asks Slashdot readers to do the research for them. Stuff like asking if there is a PDF reader that isn't created by Adobe, or if there is an alternative to Windows that runs Unix code, or even if there is an open source alternative to Photoshop, usually are good submissions to Slashdot on a slow news day. :)

      --
      Remember, Slashdot does not have a -1 disagree moderation, and no, troll, flamebait, and overrated are not substitutes.
    2. Re:Doesn't anyone vet these questions? by Anonymous Coward · · Score: 0

      Q: Non-Adobe PDF Reader -
      Foxit - for Windows
      Evince - for Linux
      Preview (built into OS) - For OSX

      Q: Alternative to windows that runs Unix code -
      Linux or *BSD

      Q: Open source alternative to Photoshop -
      Gimp

      There. Just saved us from the next 3 questions on slow news days.
      (and yes, I know the parent wasn't trying to be serious)

    3. Re:Doesn't anyone vet these questions? by Orion+Blastar · · Score: 1

      They will ask those questions even if they already been answered. Because they won't even bother to look and search for them.

      --
      Remember, Slashdot does not have a -1 disagree moderation, and no, troll, flamebait, and overrated are not substitutes.
  42. Re:AskSlashdot: "Please Do My Work For Me" by JakeD409 · · Score: 2, Insightful

    If his job involves finding solutions, then that's just it: he needs to find solutions. He doesn't need to INVENT them.

    Oh, and unless you invented source control and diffs, or stumbled upon them in some lost dungeon, you probably found out about them by asking people too, meaning you're just as "bad" as him.

  43. AskSlashdot: "Please Don't Do My Work For Me" by OrangeTide · · Score: 1

    I'd "Ask Slashdot" but I am skeptical that people would come up with workable solutions. (I don't trust the idiot mob on here)

    --
    “Common sense is not so common.” — Voltaire
  44. Re:AskSlashdot: "Please Do My Work For Me" by EightBits · · Score: 1, Insightful

    Mod the parent up, please. He's not flame baiting and he's no trolling. It's a legitimate post.

    We see too many of these types of questions on Slashdot these days. While I also don't mind helping others, I would like to see less people asking how to do their jobs and more articles that give me good or interesting information instead.

    It's still good to have questions asked, but they should be challenging and puzzling. Simple questions like this do not even merit interesting responses in the comments. They most certainly don't motivate me to try to come up with a solution.

  45. What's wrong with sqlite? by Anonymous Coward · · Score: 0

    Use it.

  46. More Details Please by answerer · · Score: 2, Insightful

    I'm guessing the point of having change tracking is so that the Overlord can review and approve the changes. In that case, maybe UltraCompare(http://www.ultraedit.com/products/ultracompare.html) is what you're looking for?

  47. diff by slashflood · · Score: 2, Insightful

    Keep a copy of the original file and make a diff. Am I missing something?

  48. Eclipse/Netbeans for local history + SVN by postmortem · · Score: 0

    As others ahve said, best combo is

    *use Eclipse for lcoal changes that other users don't haveto se
    *use SVN (there's Eclispe plugin called Subclipse) for changes ready for others

    All from one tool. And it is as free as beer - and you might learn more by jsut using it.

  49. OpenVMS? by ryen · · Score: 1

    I was once on an interview where the interviewer showed me some stuff in OpenVMS. Apparently the file system has built-in change tracking of files. Whenever you saved a file the previous versioin got 'versioned'. I'm not an openvms export so I can't verify it. Seemed interesting.

  50. Re:AskSlashdot: "Please Do My Work For Me" by Anonymous Coward · · Score: 1, Funny

    v[,dpfrtd?
    b].f[gtyh?
    xonaiswea?
    zib UAQW?

    I am losing it!!

  51. WinMerge or Meld by ecloud · · Score: 1

    One place I worked, the lead developer was paranoid and liked to review and understand every change I made to the code before "committing" it to his own tree. (Yeah they didn't use source control much either. Very stupid...) So we got really good at using WinMerge. It has good keyboard shortcuts that let you step through the diffs between two files, one at a time, and merge them from one to the other.

    On Linux, meld is comparable (except the keyboard shortcuts are inferior, IMO, but you can probably change them).

    1. Re:WinMerge or Meld by Winter · · Score: 1

      WinMerge works under wine (version 2.4.x and 2.8.x at least, 2.6 didn't), and is actually my preferred merge utility under Linux.

      --
      main(i){putchar(177663314>>6*(i-1)&63|!!(i<5)<<6)&&main(++i);}
  52. "e" by Trillan · · Score: 1

    The best text editor I've sen for tracking changes has to be e text editor. I don't know if it's exactly what you want, but I think there's a demo so you can check it out. It falls down with 700MB files, but might do okay with 32.

  53. Emacs - ~/.saves directory by JBrow · · Score: 5, Informative
    Aside from using version control, I also have Emacs set up with an extensive save history. My settings are:

    ; backup
    (setq make-backup-files t)
    (setq
    backup-by-copying t
    backup-directory-alist '(("." . "~/.saves"))
    delete-old-versions t
    kept-new-versions 6
    kept-old-versions 2
    version-control t)

    --
    --- You are in a little twisty maze of comments, all different.
  54. Oblig. by zapakh · · Score: 1

    Text editors do not work that way!
    Goodnight!

  55. Use GVIM + any Revision Control SW. by m6ack · · Score: 1

    $ svn checkout svn://YOUR_REPO/trunk; cd trunk
    $ gvim your_file.txt &
    ia simple change<RETURN><ESC>
    :w
    :!svn diff
    :!svn commit
    :new
    :r !svn log your_file.txt
    :qall!

  56. Re:AskSlashdot: "Please Do My Work For Me" by ianare · · Score: 2, Funny

    well considering many of us here are at work, we are getting paid for it.

  57. Maybe an ETL tool? by Anonymous Coward · · Score: 0

    Are the 'tweaks' you are making the same each time you bring in the file? Are they structured (csv)? If they are, you might want to consider using an ETL tool to do the work (Pentaho Data Integration comes to mind - it's open source - kettle.pentaho.org). You can either read the original file, modify it, and write it out to another file, or you can even write it out to a database table. Pentaho is pretty flexible and I've found several 'off label' uses for it.

  58. Meld by InfiniteWisdom · · Score: 1

    I'll add my voice to everyone suggesting that you use a revision control system.

    Meld is a useful tool that lets you view diffs visually http://meld.sourceforge.net/. You can either ask it to diff two files or directories, or use the built-in subversion support. It shows the two versions of files side-by-side and highlights where stuff was added/deleted/modified.

  59. Existence proof: IntelliJ IDEA by HisMother · · Score: 1

    I agree with the folks who suggest version control is the answer, but if for some reason that's a problem, there are definitely editors that do this. IntelliJ IDEA, the commercial Java IDE, has what it calls "local history" that tracks changes like this very well. It will track changes for any file it can edit, and tag the changes with date, username, etc.

    --
    Cantankerous old coot since 1957.
  60. Wally: we like databases. by Anonymous Coward · · Score: 0

    32 MB of text isn't worth the overhead of the bloat-fests we call databases these days.

    Perhaps someone needs to learn gawk or sed... or step back from the problem and re-engineer it so that there aren't any 32 MB text files.

    1. Re:Wally: we like databases. by Tablizer · · Score: 1

      32 MB of text isn't worth the overhead of the bloat-fests we call databases these days.

      Until you need to reinvent things that databases either provide out-of-the-box or make easier to do via SQL and/or data browsers. Stop living in the 80's. There's small-footprint RDBMS like SqLite if you are really that hard-up for disk space.
               

  61. Re:RCS by SiliconSlick · · Score: 3, Insightful

    And here's one that will track previous changes as well as well as preventing edits by two people at once...

    $ cat edit.sh
    #!/bin/sh
    co -l $1
    $EDITOR $1
    ci $1
    co $1

  62. The Problem with Word Processors.... by Anonymous Coward · · Score: 0

    The reason why word processors are able to track such version changes is because a good percentage of the document is allocated for meta-data where this information and more is preserved. If you are editing text files you do not want to corrupt the files to which your program(s) utilize(s) by adding this meta-data garbage.

    So, I would agree with everyone else by saying that you should seek a version control application such as CVS, SVN, Borland's Starteam, IBM's Rational ClearCase, Seapine's Surround SCM, etc. There are so many out, some open source and other commercial and they are all extremely simple to install and manage (so long as you read the documentation).

  63. rent a geek by gabec · · Score: 5, Insightful
    The OP has a lot of things working against him:

    1) Obviously never heard of version control like (CVS, SVN, etc.). This is excusable, as setting up and keeping with your very own SVN repo isn't the top of people's lists, and it's entirely possible to not have heard of such a beast.

    2) Accepting the commandment of "thou shalt manually wade through gobs of data in a text file means he's no programmer. This is also perfectly fine, but means he's not the right person to be changing this file anyway.

    3) Is under the impression that revision history could conceivably be hidden within said plain text file, implying the OP doesn't understand basic file formats, which confirms that he is not merely the wrong person but absolutely the last person you want manually mucking with your data files.

    Therefore...

    My suggestion: Forward the request to your IT department (or rent a geek).

    1. Re:rent a geek by khellendros1984 · · Score: 1

      NTFS supports "alternate data streams", and there's no reason a diff couldn't be stored in a different file or something. My first thought was actually vim, where (depending on settings) it saves a file ~ that contains the old version of the file. That could be used to generate a diff patch.

      --
      It is pitch black. You are likely to be eaten by a grue.
    2. Re:rent a geek by Hotawa+Hawk-eye · · Score: 2, Funny

      3) Is under the impression that revision history could conceivably be hidden within said plain text file, implying the OP doesn't understand basic file formats, which confirms that he is not merely the wrong person but absolutely the last person you want manually mucking with your data files.

      Revision history can't be hidden within a plain text file?

      \documentclass{article}
      \begin{document}
      This is a \LaTeX document. It can have comments in it.
      % Here is a comment that will not be present in the LaTeX document output. The revision history could be stored here.
      \end{document}

    3. Re:rent a geek by amRadioHed · · Score: 1

      But the comment is hidden in the plain text document. It's right there where we can all see it.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    4. Re:rent a geek by Chuckstar · · Score: 2, Informative

      But that only works if the file format supports comments.

    5. Re:rent a geek by Snaller · · Score: 1

      Well put! :)

      That is all ;)

      --
      If Google really cared they would fix Android Chrome to reflow text, instead of discriminating
    6. Re:rent a geek by raftpeople · · Score: 1

      2) Accepting the commandment of "thou shalt manually wade through gobs of data in a text file means he's no programmer. This is also perfectly fine, but means he's not the right person to be changing this file anyway.

      He's not changing the file. Here's a quote from the first sentence of the summary, it's possible you missed it:

      My business users regularly have to tweak large (>32MB text) data files manually

      See the part where it's the end users that are editing?

      3) Is under the impression that revision history could conceivably be hidden within said plain text file, implying the OP doesn't understand basic file formats, which confirms that he is not merely the wrong person but absolutely the last person you want manually mucking with your data files

      So it's impossible to embed revision history in a plain text file? What about in a complementary file? What about all of the numerous methods that have been used in the past to solve this exact problem? Do you even know the nature of the requirements? Maybe it's ok to see revision history in the file, maybe it's ok to see it in a separate character for character change log file?

      Before you start trashing the OP without even understanding the situation, you might want to ask some questions.

    7. Re:rent a geek by blane.bramble · · Score: 1

      That is not a plain text file, that is a Latex document. If your chosen format supports storing comments, then guess what, you can store comments in the file. Now try storing comments or alternative versions in a file format that does not support this to begin with.

    8. Re:rent a geek by AigariusDebian · · Score: 2, Informative

      Storing version information in a complimentary file is the very basic description of what version control systems do.

      Give your users an editor with WebDav support and make them edit the files directly in the SVN repository using a HTTP WebDav repository feature of SVN.

    9. Re:rent a geek by try_anything · · Score: 1

      The OP has a lot of things working against him

      Obviously the biggest thing working against him is Slashdotters' aversion to reading.

    10. Re:rent a geek by spentrent · · Score: 0

      You are a pompous moron. Normally I try to avoid the ol' ad hominem crutch but COME ON. So I shall justify.

      He mentioned "business users" -- not himself, chief -- and you have no idea what they are doing with these files or why they are doing it. I'll help you understand.

      Business users: these are people who do the things that allow you to have a job. They need to get things done. No, not self-righteous code monkeys who prefer to spin their wheels in the pursuit of meh.

      They don't know CVS from the hole in your head and they probably wonder why it takes you an hour to edit something that would take them a minute.

      They answer the same question as you with Excel in five minutes while you spend two hours debating with yourself in the "nice" stall in the men's room whether you should apply a Schwarzian transform to the blahbiddy doodle.

      And yet here you are lambasting the poor poster;

      Yeah, that poor guy who continued to scroll furiously downward after reading the first sentence of your post, determined to find his answer and relegating your bile to poor me, who just cannot avoid wasting more minutes of his boring life to conclude meaningless posts with interminable sentences.

    11. Re:rent a geek by MoeDrippins · · Score: 1

      While you're certainly correct about comments, a "plain text" file refers to format, not content.

      According to your logic this a plain text file...
      ==============
      foo bar baz
      ==============

      ...but this isn't (now it's a "CSV Document")?
      ==============
      foo,bar,baz
      ==============

      Or did I misunderstand you?

      --
      Before you design for reuse, make sure to design it for use.
  64. Re:AskSlashdot: "Please Do My Work For Me" by Anonymous Coward · · Score: 1, Insightful

    They most certainly don't motivate me to try to come up with a solution.

    No, apparently they motivate you just enough to whine about them in the comments section of the post that you supposedly have no interest in.

  65. Source Code Revision Control by biblesage40 · · Score: 1

    My company uses ClearCase (as do most Government developers) for revision control and version organizing. The open source community has a similar program called "Git" which can do version control. Both programs have the capability of letting a file be edited on multiple branches by different developers and merged later.

    --
    Learn from science that you must doubt the experts. --Richard Feynman
  66. Don't over think this. by flibbidyfloo · · Score: 1

    It seems to me that since a text file doesn't have invisible data like Word doc, there isn't any where to store change tracking information in the file other than in comments. If whatever uses the files supports them, then it seems like the simplest way (though not necessarily the easiest training-wise) would be to manually comment the changes.

    If you can't have extraneous/ignored characters in the file, then I guess you'd need a version control system that stores the data outside the file. Even then you could have a manual "changes.txt" file.

  67. Windows editors by zcasper · · Score: 1

    My choice when using Windows: EditPlus - text editor WinMerge - difference Team Foundation Server - version control with a good comparison engine Zach

  68. Add svn-time-lapse-view or another frontend by Anonymous Coward · · Score: 0

    Once the data is stored in an SVN repository, people may want a graphical overview of the documents' history. Google has a small Java application that allows to browse through older revisions using a time slider and shows diffs of them.

    If such a time-lapse view is not needed, kdiff2, kdiff3 and meld are nice graphical diff frontends that work well with Subversion's command line client.

    1. Re:Add svn-time-lapse-view or another frontend by Anonymous Coward · · Score: 0

      Google has a small Java application that allows to browse through older revisions using a time slider [...]

      OK, so maybe I should have provided a link with that statement...

      svn-time-lapse-view is available via Google Code.

  69. No git! by scott_karana · · Score: 1

    While git is an excellent and fast version control program, it suffers from a huge flaw: it DOES NOT WORK tolerably on Windows.
    For projects like the linux kernel, and most FOSS applications, this isn't a huge problem, but in a heterogenous work environment, this is a large, critical problem.

    1. Re:No git! by Anonymous Coward · · Score: 0

      Why is that a problem ? Why would anyone in their right mind use Windows ?

  70. Gedit for the win by shellster_dude · · Score: 1

    If you use gedit, you can install Xdialog and svn. Then go to the gedit plugin's and enable the 'External Tools' plugin. Finally, go create a script with a short cut and use this code: #!/bin/bash Xdialog --title="SVN Comments" --no-close --no-cancel --keep-colors --inputbox "" 6 30 &>/tmp/commit.msg svn ci --file="/tmp/commit.msg" --username="your username" --password="your pass" $GEDIT_CURRENT_DOCUMENT_PATH rm -f /tmp/commit.msg Now you just have to hit the shortcut after saving the file and it will commit it for you.

  71. Emacs VC mode... by John+Hasler · · Score: 1

    ...supports six different version control systems. It is enabled by default. Read the manual.

    --
    Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
    1. Re:Emacs VC mode... by thermian · · Score: 1

      Read the manual? of Emacs?

      What, you think I have a year to spare?

      --
      A learning experience is one of those things that say, 'You know that thing you just did? Don't do that.' - D. Adams
    2. Re:Emacs VC mode... by Just+Some+Guy · · Score: 1

      You don't read it all at once. It's meant to be sipped, a mindful at a time as needed, then left be while you digest what you've taken in.

      'cause the alternative is just nuts.

      --
      Dewey, what part of this looks like authorities should be involved?
    3. Re:Emacs VC mode... by thermian · · Score: 1

      I taught a short course on it once to first years. I tried to like it while I was preparing the course but I guess I'm just not that kind of coder. Some of my colleagues used it for everything, and I do mean everything, but I didn't get further then a little lisp and some C editing before heading back to Vim.

      Stereotypical I know, doesn't stop it being true. I don't quite know what it is about it that puts me off, but something about the multitude of features rubs me up the wrong way.

      --
      A learning experience is one of those things that say, 'You know that thing you just did? Don't do that.' - D. Adams
    4. Re:Emacs VC mode... by Just+Some+Guy · · Score: 1

      I started learning it by playing with the menus, finding what I wanted, and using the displayed keyboard shortcuts to do it. I actually love Emacs and prefer it to Vim, but not a month goes by that I don't discover some handy feature that's been there for decades. "Learning GNU Emacs" was invaluable, too. Even the newbie chapters taught me things I didn't know that I didn't know.

      --
      Dewey, what part of this looks like authorities should be involved?
    5. Re:Emacs VC mode... by thermian · · Score: 1

      You know what , I've looked at that book and wondered if I should buy it. By coincidence I put it in my Amazon basket a couple of weeks ago and agonised over it for two days (I had a gift voucher associated with a research grant).

      As an undergraduate, and all through my phd I've been a committed C coder who doesn't like to stray beyond the console (GUIs just seem so wasteful, using up all those clock cycles), I have often thought I should persevere and see if I could grow to like Emacs. Not least because every other Stallman authored tool has been indispensable to me (especially the Stallman auto criticiser, aka splint), so I do sometimes think I'm missing out.

      Its just getting past that feature abundance, it puts me off in a way that's hard to explain.

      --
      A learning experience is one of those things that say, 'You know that thing you just did? Don't do that.' - D. Adams
    6. Re:Emacs VC mode... by Just+Some+Guy · · Score: 1

      Its just getting past that feature abundance, it puts me off in a way that's hard to explain.

      If it makes you feel better, I ignore a lot of stuff you can do with Vim. :-)

      --
      Dewey, what part of this looks like authorities should be involved?
  72. Use Word, seriously... by sjf · · Score: 1

    That's the model that the PHBs want, give it to them. Export as ascii so you can actually build the damn thing, and make sure that every single automated formatting feature is turned off: smart quotes, spell checking, etc...Word tracks changes creditably, of course as the chorus correctly says, version control is where this ought to be done, not in the file itself. You don't need the same degree of change tracking in a source file that you do in a legal document, but heck I'm a programmer not a lawyer, or a PHB.

    Also, just to stick it to the man, make sure that you order MS Office in the most expensive way possible...when they ask why it costs so much, tell them it's the "idiot tax".

    1. Re:Use Word, seriously... by jaredcat · · Score: 1

      I agree... Word 2007 can certainly handle 35mb files. You'll just have to save in .doc or .docx to preserve tracking changing and version control, but you can always do a "Save As..." to text cr/lf when you need to.

  73. MoonEdit is pretty good by zullnero · · Score: 1

    Give it a try. It's got version history built in. It's a collaborative text editor, doubt you need that ability, but it does the version history stuff as far as I recall. Or, you could do what everyone else is saying and cobble together a SVN/CVS/whatever system and use that, but that decision is up to you.

  74. Re:AskSlashdot: "Please Do My Work For Me" by tickticker · · Score: 2, Funny

    Then don't post, oh phallic one

  75. DMS (document management software) by strichards · · Score: 1

    Search the web for document management software, there is plenty. Basically a more "end user" friendly type of software than your typical developer oriented version control software. Usually quite expensive though.

    --
    Regards, Steve
  76. extra info in flat text file? by lasse_dk · · Score: 1

    how would it even be possible? in a flat text file where would you store such information? a version control system and whatever editor you like seems like the obvious solution

  77. Re:AskSlashdot: "Please Do My Work For Me" by AslanTheMentat · · Score: 1

    Many of the Slashdotters actually pay for the opportunity to, among other things, answer questions like that.

    [Citation Needed]

    As a proud BOFH (of which I would presume there are equally as many that would "pay to answer [stupid] questions"), I would immediately direct him to MS Word (which does have such brain-dead change tracking) in order to make the suffering more enjoyable for me to watch...*devilish grin*

  78. diff? by mnslinky · · Score: 1

    Have your users rename the file and run diff, or store these files within SVN.

  79. Versioning filesystem by Anonymous Coward · · Score: 0

    Use a regular text editor over a versioning file system.

  80. Re:Emacs - ~/.saves directory - MOD UP by mlrtime · · Score: 1

    This is freaking awsome, no more ~ files in my src directories.

    Much thanks.

  81. Wrong tool by Chris+Mattern · · Score: 1

    You're asking for a screwdriver that's good at hammering nails. You want a hammer--in this case, a change-control system, of which there are many good OSS choices available.

    1. Re:Wrong tool by Anonymous Coward · · Score: 0

      You're asking for a screwdriver that's good at hammering nails.

      Oh, you mean he wants Emacs. ;)

    2. Re:Wrong tool by Chris+Mattern · · Score: 1

      Emacs won't be complete until somebody adds a decent text editor to it. :-)

  82. Google Apps by spyrochaete · · Score: 1

    There are few circumstances under which I would recommend Google Apps to someone, but this is one of them. Apps does a great job of tracking incremental changes, saving versions, and allowing you to diff between them. Also, it's only $50 per seat.

    The only disadvantage is that your documents would be stored in the cloud, so if your internet connection is less than excellent you might have some frustration transferring those large files. Storage should be no problem though - I believe you get 10GB per license.

  83. Tracking Changes. Word! by Anonymous Coward · · Score: 0

    I didn't think of it until I saw that question, then hmm, I would love something like that too! Probably have to build an text editor that would generate a 'hidden' filename.track.xml(?) file and then build an add-on in the text editor that would parse thru the XML file displaying changes.

  84. Nah... by wondershit · · Score: 2, Funny

    ...a shingle is just fine.

  85. Filehamster by clgoh · · Score: 1
    Filehamster http://www.mogware.com/FileHamster/ is a little utility a I found. It monitors files, and copies them appending a timestamp to the file name each time they are saved. You can the use tools like winmerge to compare versions, and you can restore the file anytime to any version.

    I didn't try it much, but I think it could do the job.

  86. Version Control... by paploo · · Score: 1

    I think the reason why you are having troubles with this is because most developers use an external version control system (SVN/CVS/git) to manage their history much better than a text editor could. So most text editors don't even bother wasting resources trying to recreate a sub-par versions of what is already done when very few people will use it anyway.) :)

    It sounds like your company could use one of these collaborative version control tools to solve its problems correctly. These would also allow you to make edits to the file while the overlords make their edits, and keep track of who made what changes where, why and when.

  87. Google Docs? by Somecallmechief · · Score: 1

    Google Docs keeps a revision history, perhaps Zoho does as well (don't know). OpenOffice has a GDocs plugin that will sync back to your GDocs account, and Google Gears gets you offline access. I use Notepad++ and the GDocs Sidebar extension for Firefox to keep my workflow going. Of course, I only work in SQL and XML, so it's not really programming. It seems to me though, if you can find a way to either sync it back to GDocs or find an API implementation that will give you code friendly editing in browser, you could be set.

    --
    If it looks like a duck, let's call it a moose.
  88. Visual Studio may do the trick by nicenemo · · Score: 1

    Not Open Source, but Microsoft Visual Studio did the trick for me when I needed to clean up generated javascript and html code of about 30MB.

  89. Three Part Solution by Anonymous Coward · · Score: 0

    You don't mention what you are using now or what environment you are in. That might be helpful.

    However, you might consider a three part solution:

    1. Whatever editor is your favorite.
    2. A version control system - there are many.
    3. A good diff program. Look around but don't overlook BeyondCompare from Scooter Software - they have a Linux and Windows version in the works.

    As many people have suggested, you really do need a version control system no matter what else you do.

  90. Scratch head, hire developer by billcopc · · Score: 1

    Maybe I'm missing something here (hint: i'm not), but why would you want to be manually editing such a file anyway ? It sounds like this task should be handled by a lightweight interface, be it web or otherwise, that controls access to the file and natively logs edits to a database.

    --
    -Billco, Fnarg.com
  91. Microsoft Word??? by Anonymous Coward · · Score: 0

    Ctrl+Shift+E
    - Anonymous Coward!

  92. VIM / GVIM by robo45h · · Score: 1

    VIM & GVIM have built-in support for side-by-side display of two files with the differences highlighted (produced via "diff", of course). It's called a "split diff." Now all you have to do is train your business users to edit files with VIM. Good luck with that. But here's the deal: you need to figure out the problem you're solving (err, the problem the overlords are trying to solve). They may not understand this, but it is fundamentally and basically impossible for a text editing program to show you a change history that you can simply "hide" or "display" as Word and other word processors do. This is because they can store the data in a format that internally tracks changes. A raw text file, by definition, can only store one set of data. It is 100% inpossile to store the changes inside. Period. End of story. Thus, an editor could show changes made during a given session, or differences between two files, but it can never open a file and show a history of changes on a text file. If it were integrated with a source code control / versioning system, that's different. But in that case, it's not "opening a text file" it's "opening a repository".

  93. The 'e' editor (based on TextMate source) has this by Tetravus · · Score: 1

    Under the 'View' menu select 'Undo History' for a nice graphical interface to changes that have been made in the current document.

    You can even click a particular version to revert the document to that exact content.

    Of course it's not free-ware... but it is quite stable and the demo version _is_ free.

    http://www.e-texteditor.com/

  94. Assuming it's windows... by netux · · Score: 0

    Editpadpro would be a good place to start, it has Multi backup optins, and hidden history (creates a hidden __history folder and puts backup there), you can add a tool like svn/cvs with no pain. It has a tool option where you can make your own, very simple. If your looking at buying some kind of bulk, I'm willing to bet that Jan would add some kind of version control to the binary (database, cvs interface, local server, roll his own), or add the tool to your build. Download EditPadLight and open help, go to the index tab, and double click .bak (the first thing), it will take you to the page you want to see if it does what you want. Just a happy EditPadPro owner (for when I have to be on windows)

  95. Hammering nails: Shoe or glass bottle? by Anonymous Coward · · Score: 0

    "My business users regularly have to tweak large (>32MB text) data files manually."

    Sounds like an entry for The Daily WTF.
    And while you're at it, read this article.

    Then start using a database and maybe even build a proper editing tool, rather than insisting on editing 32 megabyte data files with a text editor.

    NO ONE should need to edit 32 megabyte files with a text editor.

  96. Given it looks to be a Windows shop... by mksql · · Score: 1

    Although this is a site where the obvious answer is snv/emacs/vim/etc., the OP mentioned using UltraEdit and Notepad++, implying a Windows environment where these choices are not obvious, nor perhaps easy.

    I transitioned (in part) from UltraEdit and SourceSafe to Vim and Subversion, and am happier having done so, but many of my colleagues are not ready to do the same - they went the Visual Studio and TFS route. To each his or her own.

    For this audience, tools such as http://www.e-texteditor.com may make sense.

    --
    I should have been a Geologist.
  97. if you must: UltraEdit, WinMerge, KDiff3 by Anonymous Coward · · Score: 1, Informative

    FIRST check if a different data representation may be more appropriate than those huge text files (e.g. split up into smaller files; or condense the data into a more compact representation; or put the data into a database with appropriate front end)

    SECOND, if you stick with text files I second the common advice to consider a source control system like svn or Mercurial.

    If you are still going with your head through the wall, WinMerge (winmerge.org) and KDiff3 (kdiff3.sourceforge.net) are handy and configurable tools. Their usefulness may depend on the data file structure and on the kind of changes applied.

    Or take a second look at commercial UltraEdit which easily handles 300MB files and, iirc, DOES have a built-in diff feature.

    Bernhard

  98. SlickEdit? by Anonymous Coward · · Score: 0

    SlickEdit maintains a nice file history, and it comes with a decent diff tool. It's meant to be an IDE, but it should be capable of editing large text files too. The only problem is that it costs about $300.

  99. I am compelled to reply by vimm · · Score: 0

    You should use M$ word. Then right before you finish editing it, copy the .~!23myfile.doc from /Documents and Settings/~/Application Data/MSOffice/MSWord/Shadow/etc/temp/.temp/hidde~1/ to your desktop, and then copy it from there to your backups folder.

    I suggest also using the mouse for all copying maneuvers.

  100. I'll write you one by Anonymous Coward · · Score: 0

    For $10,000

  101. ada editors by BenBoy · · Score: 1

    Meridian's Ada compiler, as I recall (this was more than a decade ago), came with an editor that saved information on edits; IIRC, you could 'undo' even across editing sessions.

    I seem to recall this being part of the Ada spec, but as I consider it, it sounds funny to expect a language spec to cover the development environment as well; perhaps it was aaaaaaaaaaalllllll just a dream ... Anybody else remember?

  102. Version Control isnt your problem by nurb432 · · Score: 1

    Your attitude is your problem: Overlords... little people.

    You are a jerk and they should just fire your ass.

    --
    ---- Booth was a patriot ----
  103. Jedit by nurb432 · · Score: 1

    Its multiplatform and suports CVS

    --
    ---- Booth was a patriot ----
  104. Netbeans + local history by nightstar007 · · Score: 1

    Netbeans, while normally used for java programming, has a text editor. When you combine it with the plugin named "Local History" you are able to see every version of the file that's saved. You can have it show you the differences also.

    --
    ~M "There is no moral precept that does not have something inconvenient about it." - Denis Diderot
  105. Re:AskSlashdot: "Please Do My Work For Me" by rumith · · Score: 1

    ...not to sound like a dick or anything :)

    If it walks like a duck and, um, talks like a duck... ;)

    Seriously, writing, fixing, implementing users' wishes and distributing free software can also be perceived as doing someone's work. Should we stop because we're not being paid (nor laid, mostly) for that?

  106. openoffice svn plugin by Anonymous Coward · · Score: 0

    OOoSVN 0.3.8

    http://extensions.services.openoffice.org/node/230

  107. File Journal by Anonymous Coward · · Score: 0

    A while back I was involved with a company that produced a piece of Windows software that would monitor the filesystem and create backup copies of what you were working on (only from specified directories). Full version history included, as well as a differening tool (they licensed Beyond Compare from scooter software). The product was called File Journal but the website (http://www.filejournal.com) is long since departed. The software worked very well; if you're interested I can send you a copy. I'm one of the ex-owners of the company so there'd be no issue with licensing. Risking spam, you can reach me at i a n -at- b e v a n t e c h -dot- c o m.

  108. Five line script by CustomDesigned · · Score: 1

    1. Checkout with "co -l $1" (RCS - has the advantage of no setup required) or your favorite SCCS
    2. "vim $1" (or your favorite editor)
    3. "rscdiff $1 (to check for changes)
    4. "ci $1" (to check in and ask for description)

  109. Try Trackback by FBSoftware · · Score: 1

    Trackback comes with Understand for Ada and seems to be separately downloadable for free from http://www.scitools.com/products/trackback/. I had Meridian Ada long ago but don't remember much about the IDE. Some editors can do multiple undos back through previous editing sessions.

  110. Re:AskSlashdot: "Please Do My Work For Me" by DrEasy · · Score: 1

    You mean to the right?

    --
    "In our tactical decisions, we are operating contrary to our strategic interest."
  111. 32MB text file version tracking by Anonymous Coward · · Score: 0

    You may:
    1)split your >32MB text data file into smaller files to get a better response in the programmer's text editor. split and cat are great linux tools.
    2)use something like subversion or cvs. This are called "version control" tools.
    3)Ok what else do programmers use to make their lives easier? Check out "meld" in order to let your buddies blend two versions of your > 32MB text data files.

  112. Just use ed by Anonymous Coward · · Score: 0

    Just use ed, it's been around longer than most unix-users have been alive (and consequently very stable).

    You can save incremental updates with w file[start],[stop]w file where start and stop are both line numbers, to write specific lines a file, if you want to keep a record just of changes you made.

    Don't make mistakes, though.

  113. CodeWiki? by Slur · · Score: 1

    Perhaps it's time we combine Wiki with coding. I could see this growing into something pretty cool, Ã la Google Docs.

    --
    -- thinkyhead software and media
  114. Re:AskSlashdot: "Please Do My Work For Me" by Anonymous Coward · · Score: 0

    Too many people on slashdot are whiners!

    There is a joke in here somewhere.

  115. E, as in 'editor' by AndyElf · · Score: 1

    You can do what you're looking for with E: http://www.e-texteditor.com/

    --

    --AP
  116. Eclipse by Anonymous Coward · · Score: 0

    Eclipse keeps a complete revision history of changes you've made, and you can restore any version. It's like a local, mini VCS.

  117. MultiEdit by llzackll · · Score: 1

    MultiEdit, http://www.multiedit.com/ will interface with CVS and other systems.

  118. Re:AskSlashdot: "Please Do My Work For Me" by DMUTPeregrine · · Score: 1

    g.bnaiocn?
    Clearly not good advice for a DSK keyboard.

    --
    Not a sentence!
  119. Re:AskSlashdot: "Please Do My Work For Me" by johanatan · · Score: 1

    Actually, it's only the right hand that needs to move--and only whilst typing that one word!

  120. "Programmer's File Editor" -- literally by johanatan · · Score: 1

    This free program (PFE) [if you can still find it] was only 20KB or so and was an excellent notepad replacement. It could probably handle 30 MB files (it could do about everything else).

  121. Tree Line by Anonymous Coward · · Score: 0

    tree line

    http://treeline.bellz.org/

  122. Use a ZFS server to keep your files by Anonymous Coward · · Score: 0

    And take a snapshot every time you need to edit.

  123. Perhaps.... by Anonymous Coward · · Score: 0

    You should check out a tool called File Hamster thers a free version and pro version for something around 20 $, you should check it out

  124. Re:AskSlashdot: "Please Do My Work For Me" by ppanon · · Score: 1

    Well, it would have been funny if his pseudonym was something like Phil Gramm. However James Welch is a Mass state representative, not a former US senator.

    --
    Laissez lire, et laissez danser; ces deux amusements ne feront jamais de mal au monde. - Voltaire
  125. Crisp by sebt · · Score: 1

    The commercial editor, Crisp, is excellent for these kinds of tasks. Crisp is a modern offering based on the Brief editor from days of old. This editor has a small following because it is buyware but is very multiplatform, very fast with large files and has a good macro language, keystroke macros etc.. It can track changed lines visually and also has a built in diff but I'm not sure if either can be harnessed through the macro language. Due to its enormous feature-set and the large amount of platforms it supports there are plenty of bugs in Crisp but it is regularly updated and its author is very responsive to bug reports. Also, and importantly, I've never found a bug that's crashed Crisp or lost me work: the core editing engine seems to be very efficient and bug free and most of the bugs lie in the extra functionality that's provided by way of the enormous amount of macros thrown in with it. My advice if you want to buy a copy is to contact Pacemaker software (the UK distributor) and broker a deal. The US has its own distributor (Vital Inc.) but you'll get a much more personal service (and price!) speaking to Pacemaker since the owner is on very good terms with the author of the software. The latest versions of crisp is available directly from the author's website here, unlicensed copies run in trial mode with writing disabled. Having used virtually every editor on the planet and been programming in a variety of languages since the eighties, I can say that no editor is perfect. Crisp has its faults but has overall speed, ease of use, a wonderful macro language and a solid editing engine. It won't do your work for you but this job sounds like countless little "challenges" that I've cut through with crisp in the past. Seb :)

  126. Looking at it differently... by w0mprat · · Score: 1

    If you have 32mb of text in one file, shouldn't you have broken that up into parts by the time it reaches that size? I'm having difficulty imagining code that in some way hadn't required breaking up into more than one file... Not everything that said 'overlords' request has a solution. I would suggest one goes back to the overlords and tells them their request is not practicable? (... or is that kind of questioning thy master thing juat not done?)

    --
    After logging in slashdot still does not take you back to the page you were on. It's been that way for 20 years.
  127. Eclipse by Anonymous Coward · · Score: 0

    Eclipse has its own version history. http://www.eclispe.org

  128. Emacs can do this. by jonadab · · Score: 1

    It doesn't come configured this way out of the box, but you can certainly set up Emacs to do this. Off the top of my head I don't recall the exact hook to use, but I know that there *is* a hook that's called after every operation, however small (even, say, moving the cursor), so at worst you could use that. Ideally, if there's a hook that's called only when something actually changes, that would be better. Anyway, you'd want to add a function to that hook that calls diff and appends the result to a log, or somesuch, depending on exactly how you want it to work. Anyone who's comfortable in elisp should be able to set this up in a couple of minutes.

    Of course, then your users have to learn Emacs, which might take rather longer...

    --
    Cut that out, or I will ship you to Norilsk in a box.
  129. Not enough information by Eternal+Annoyance · · Score: 1

    What type of information is in those huge documents?

    If it's code: split the code up in multiple files and put them under revision control.

    If it's a legal document: a decent word processor (no, not MS Word) is more appropriate, while splitting the document up in multiple pieces (if possible) might also help.

    If it's some sort of list, store it in a database.

    The list goes on, and on. Give us some more information, so we can give you some useful feedback.

  130. The Wikipedia answer by snoggeramus · · Score: 1

    Wikipedia has a compare versions function. And it's free. :-)

  131. Beyond Compare by Anonymous Coward · · Score: 0

    Didn't see this program mentioned here but my favourite is Beyond Compare. In my opinion the algorithm used for align matching lines is not that good but the UI makes up for that.

    http://www.scootersoftware.com/

  132. Undo history??? by klashn · · Score: 1

    I agree that version control is the absolute best way the 'track changes'.

    But, Within an editing session maybe there's a way to show the complete Undo history. It is all available in a stack, but does vi/m or emacs allow you to view without applying, say the 10th edit?.

    This may count as 'tracking changes', not sure how useful this actually is though.

  133. Re:AskSlashdot: "Please Do My Work For Me" by turbidostato · · Score: 1

    "No, apparently they motivate you just enough to whine about them in the comments section of the post that you supposedly have no interest in."

    Why not? If this ends up with editors learning these kind of questions are not welcome by "the Slashdot crowd" then maybe they stop bringing them up to head page making place for more interesting questions instead.

    I'd say that would be quite a good outcome.

  134. Why not let your FS do this :) by Anonymous Coward · · Score: 0

    Some File Systems allow for this (ext3cow comes to mind) so you can see exact state at exact times but you would also have to have somebody watching the watchers:)
    the guys cron tabbing the snapshots :)

  135. Mercurial by Anonymous Coward · · Score: 0

    Mercurial [ http://www.selenic.com/mercurial/ ] is a multiplataform (Python) distributed control version system.
    You only have to place docs in one directory, and run mercurial to update the changes.

    Is newer and more adaptable than cvs and svn

  136. subversion has a neat trick by jkitchen · · Score: 1

    If you publish a subversion repository over webdav, you can easily accomplish this with a feature known as AutoVersioning. As for using webdav to edit a 32MB file, I cannot vouch, but using this method is completely editor agnostic, assuming your OS has a method of mounting a WebDAV directory as a logical volume.