Idea Management/Navigation Software?

psychonaut asks: "My work involves a lot of research and writing, and I often find myself jotting down brief notes on scraps of paper, in text files, in the margin of books, etc. The idea is to later use these ideas as the basis for various papers or even books I plan to write. However, because I have no central repository for all these ideas, finding long-forgotten thoughts and citations months after I've recorded them becomes a nightmare. Can anyone recommend an open source knowledge management, visualization, and navigation software I could use to bring together and classify all these disjointed ideas?"

"The system should be hypertext-based, allowing explicit links between nodes, but it would be nice if it could also derive some relations on its own. Having built-in support for referencing web links, printed publications (BibTeX integration?), and arbitrary files would be great. Text-based and perhaps also non-text-based searching capabilities (e.g., graphical visualization of node relationships) would also be very useful.

I've looked at some wiki systems but the choices seem overwhelming, and most of them are geared towards collaborative rather than individual work. Is there some wiki or database system that does what I need, or should I be looking for something in an entirely different paradigm?"

Comments

Re:Bite your pride

[CoolHnd30]

Rather than going Microsoft, maybe you should use freemind. I've been using it the last six months on Linux and Windows, and am very pleased with it.

Maybe try DENIM?

[wan-fu]

The DENIM Project might be something you could look into. It is a tool for web page and UI design but it should be easily adaptable for your needs (especially with its export to HTML). You could also try Visual Thought though it is no longer developing nor supported (but is more tailored to what you're describing than DENIM).

try a book

[JackBuckley]

I don't mean this as flamebait, but how about keeping a medium-sized notebook with you all the time. As a professor and researcher, I have found that nothing works better than an "idea book" for keeping notes from reading, paper ideas, sketches, equations, proofs, diagrams, etc., all together.

I have a small notebook (between 3x5 and 8.5x11) that I keep in my briefcase to and from work and jot everything down in it. It never crashes, it takes only seconds to include complex graphs or equations (no equation editor or LaTeX tags needed!), and can even be backed up via xerox (which I have done with ripped pages--just staple the copied page back in!).

Palm Piece

[angst_ridden_hipster]

I use Memo Plus on the Palm, which is merely a hierarchical notepad.

I have things sorted into a hierarchy that works for me.

But oh, how I would love a cross-platform product that offered deep integration with email, address book, bookmarks, calendar, and random notes, with multiple hierarchical and/or directed graph maps, and good search capabilities. In my fantasy world, it'd run on my PC and on my Kyocera smart phone, and would be compatible with stuff on both ends: Firefox, Thunderbird, the Palm address book, etc. If I didn't have a job, that's what I'd be building right now...

Slim pickings

[eykd]

Open source offerings in this area are slim to none, and I've tried everything I can get my hands on. The best I've found is KeyNote, a Windows-only tabbed notebook/hierarchical outliner. I recently converted all my text-file notes over to KeyNote, and found it to be a sweet little package. Highly recommended, although it doesn't really meet any of your other specifications (no hyperlinking, etc., outline-view only).

If you don't mind a web environment, Wikis provide easy editing and hyperlinking, but visualization is not their strong suit. If you like the idea of wikis, but don't want the web, and don't mind paying $12 for closed-source, WikidPad is an excellent, flexible, Windows-only option (and mildly extendable with an embedded Python interpreter). Combines a tree/outline view and Wiki-like syntax & automatic hyperlinking.

If you don't mind closed source, The Literary Machine provides a lot of power in a Windows environment. The basic version was free last I checked, though he's ceased development on it in favor of the Pro version ($20), which is being actively developed and integrates a number of new features (but I haven't tried it yet). It organizes everything based on a non-hierarchical keyword association system, and while it takes some getting used to (and can be downright messy sometimes), it does allow for the discovery of connections between notes that you might not have put together otherwise.

If you don't mind closed source, paying through the nose ($145), and OS X, then there is one app which fits all of your other qualifications: Eastgate's Tinderbox has powerful hyperlinking, programmable agents, RSS and web integration, powerful search, graphical visualization, and plenty more. To tell you the truth, my next computer will probably be a Mac because of this one, though a Windows version is on the horizon (was slated for an early 2004 release, but looks like it's slipped back to Real Soon Now). This has been the sleeper hit of the past couple years--everyone who uses it raves about it, but it's relatively unknown.

todo.txt as recommended at ETCON

[quiddity]

life hacks notes by cory doctorow (more at bottom)
"It's the 10-second rule: if you can't file something in 10 seconds, you won't do it. Todo.txt involves cut-and-paste, the simplest interface we can imagine."
"Power-users don't trust complicated apps. Every time power-geeks has had a crash, s/he moves away from it. You can't trust software unless you've written it -- and then you're just more forgiiving.
Text files are portable (except for CRLF issues) between mac and win and *nix.
Geeks will try the Brain, etc, but they want to stay in text."

Re:Wiki or blog software

[WayneConrad]

Yes, minimalists love wikis. I'll describe a Wiki for those who haven't seen one: A wiki is a web site where you can modify the pages (usually cgi driven). In its purest form, a wiki is a collection of web page anyone can read or modify, but most wiki software now allows you to restrict access in various ways. Most wikis also version control their pages, so you can undo mistakes made by you, or if it's a world-writable wiki, undo mistakes made by others.

Ward Cunningham wrote the canonical wiki, but there are many others now.

A wiki is somewhat easy to modify (typing your changes into a CGI text box is OK but not the greatest), very easy to search, and pretty easy to link pages together. It's biggest advantage is that you can read and edit it from from anywhere you have a browser. I use a wiki to store notes and links -- I don't keep bookmarks on my browser anymore, so now it doesn't matter which browser I'm using or what computer I'm on. I just set my browser home page to my wiki page that has all my links on it.

If you don't want to run your own, there are wiki sites that will lend you space to do your own thing in (Here's one public wiki, but there are others.

Re:Personal Brain

[bergeron76]

Why doesn't the Open Source community come up with a common XML foundation for information organization and design toward it?

Seriously, by starting with VERY BASIC meta tags (NAME, KEYWORD, DESCRIPTION) we could exponentially expand the productivity of OpenOffice, etc...

The KEY (no pun intended), however, is going to be linking these features among different apps. I can't even count how many times I've done a "locate project | grep png" and NEVER found the image that I was looking for.

Unity is key...