Visualizing Stories On Current Events With Newsmap

hrbrmstr writes "Marcos Weskamp and Dan Albritton have created Newsmap, an extremely cool way of visualizing news stories. The site takes the aggregated content from Google News (globally) and maps it out into a visual space. That way, you get an immediate feel for news patterns (what the media in any particular region is gravitating to) - there's quite a bit of potential here."

Comments

Pretty cool

[dealsites]

It's obvious that this guy has some programming ntalent. I wonder if Google will chase him down and we'll see this at labs.google.com soon?

That makes me start to wonder... Maybe the best way to get a job with a company you like is to write some slick code that helps to benefit the company. Once the company finds out about your project, they might decide to hire you. It's kinda of like writting a customized resume for a particluar company.

--
No April fools jokes here. I promise!

Re:Pretty cool

[joeljkp]

Sorry, you saying "We did it" doesn't constitute evidence.

Google Cache to the Rescue!

[randomErr]

Get the cache!

Hold the front page!

[klokwise]

Stop Press!

... and all other amusing phrases to go with their breaking story of "500 Internal Server Error".

Maybe GUIs could learn from this

[syslog]

This is a pretty cool concept - maybe desktop environments like KDE and GNOME could do something like this. Something simple, like making most often used files, programs etc larger and more apparent, with the less used items growing smaller and smaller with disuse till they disappear entirely and are cleaned up from the system.

Of course such a system would require a bunch of gotchas to be taken care of... no one wants "ls" deleted just because a user didn't use it for a month :) Maybe only largish applications are affected by such an algorithm? Maybe the distribution marks certain directories as do-not-touch items, and the rest are affected? Maybe only user-installed apps are affected?

Thoughts?

-naeem

Re:Maybe GUIs could learn from this

[tiled_rainbows]

Trouble is, I have the opposite problem in real life: I have now problem finding the last ten documents or so that I've been working on, but if I want to find something from a couple of weeks ago, it's a real pain if I can't remember where I put it. And I'm bad at filing stuff in any sort of systematic way, so it's often a PITA.

Maybe your idea would be useful to me if I could rewind somehow and take a look at what my desktop looked like an a certain date in the past, showing all the files and stuff I was using most round that time.

Re:Maybe GUIs could learn from this

[Zog The Undeniable]

No thanks. I *hate* the personalized menus in Windows and Office XP, and they seem to have removed the ability to turn them off now.

Re:Maybe GUIs could learn from this

[Bertie]

I worked on something similar once. Used a fairly obscure mathematical technique known as formal concept analysis to group objects (which were documents in this system) according to their relationships to each other. Each document would be defined in terms of keywords (which were generated using an automatic text summarisation tool) and the system would output a graphical representation of the relationships between them, with the most general documents at one end, and the most common topics at the other. If you want to find out more, look up formal concept analysis and it should be fairly apparent how it would've worked.

I extended the basic technique, which usually produces "concept lattices", to have different strengths of links, and made it all work in an oh-so-1998 3D environment. There was a load of potential in it, but it was just something I knocked up in a summer placement and I don't think anything major was done with it.

Re:Maybe GUIs could learn from this

[millette]

maybe something like this blog treemap, or this one that represents file sizes

Re:Maybe GUIs could learn from this

[bheer]

> they seem to have removed the ability to turn them off now.

Windows: "Start | Setttings | Taskbar and start menu" has a checkbox (different locations I think for 2000 and XP/2003) to disable personalized menus. If you use XP's Luna theme (why?), the "All Programs" flyout is un-personalized.

Office (2000, XP, 2003): right click on the main toolbar, Customize, Options tab, uncheck "Menus show most recently used commands first".

Re:Maybe GUIs could learn from this

[SlashDread]

OMG, the TeleTubby startmenu from XP reinvented.
I -HATE- that auto-rearrange stuff.

My user manuals now read:
- Click the startbutton.
- Find wherever Windows XP has put you foo-app today.
- Select that.

"/Dread"

Re:Maybe GUIs could learn from this

[4of12]

I'm bad at filing stuff in any sort of systematic

Me, too.

I've tried to clean up my top level home directory so that there's only a screenfull of concise subdirectories listed, then everything goes into those.

Problem is, some of those subdirectories become chock full at the next level. I have a directory called "tmp/src" that includes about every imagined release of some interesting application tarball ever made.

Then, documents can hide way down in some particular project directory.

Instead of a static view of my files and work, I'd like VFolders that could be generated a lot like Google Searches, including criterion such as file type, time last accessed, keywords in the document.

I remember reading once of some crazy guy that used CVS for his home directory, but I think CVS is too clunky. But he had gem of an idea: time travel - "I want to see my desktop from 8 months ago".

And, yes, while a graphical tree is really nice, I'd like to be able to navigate through any tree using pure text-based tools, terminals if I desired.

Maybe then I could make my own "/usr/bin" sane instead of what my sysadmin thinks is a good idea.

Re:Maybe GUIs could learn from this

[six11]

Newsmap is based on Treemaps, which is both a conceptual GUI idiom as well as a commercial product. This is the work that Ben Schneiderman is most well-known for, and he's been working on different forms of interactive information visualization for decades.

The parent was asking about projects like KDE and Gnome picking up cool concepts like this. The HCI world is full of 'hey neat' ideas that on the surface really seem like they should be brought into the fold, but aren't for a variety of reasons. One company in particular that I worked for (and won't name) has a really cool project that I feel could become a standard UI idiom like radio buttons and scrollpanes, but the product is doomed to failure because the company is horribly mismanaged and (having been the sole coder--as an intern, even) I also know the code to be completely inflexibly designed. Furthermore, they want to make all sorts of money on the thing, which means they're charging customers an arm and a leg to use it.

The Linux desktop environment projects have issues equally as inibitive as the one described above, but rather than being financially oriented, their problems are more about ego and (with the exception of some of the KDE guys) a complete misunderstanding of what HCI is all about. I really wish KDE/Gnome would use these experimental UI metaphors, but alas, I think their structures prohibit this sort of thing.

To Save You Some Time...

[quantaq]

This one isn't a hoax. This actually looks like a cool and potentially useful product.

Re:To Save You Some Time...

[Ateryx]

This one isn't a hoax. This actually looks like a cool and potentially useful product.

The last time I believed anyone on slashdot I ended up with goatse all over my monitor.

Re:so?

[junklight]

The news is culled from many sources - each of those sources are edited by people who decide how important any given news item is. This shows an amalgamation of those decisions allowing you to see at a glance what is deemed important or not. But if you would rather read your local paper I am sure no-one will mind

It works!

[Rosco P. Coltrane]

hat way, you get an immediate feel for news patterns (what the media in any particular region is gravitating to)

I clicked on the link and Mozilla popped a window saying "The document contains no data" : this indeed matches exactly what I've been seeing in the TV news for years.

Well done!

Wow...

[scrm]

The main headline is Internal Server Error. Pretty neat.

Kinda Neat.

[jellomizer]

I guess the tech economy is improving. We are getting more cool stuff stories and less lawsuit stories (except for SCO).
The only problem I really have with this type of technology is that it makes a less popular story so small that you can't read it. It also may make some people think that a less popular story is not as important as a more popular one, which is not always the case. I often find the popular news stories to be things that people can easily take a stance on without reading the details. And the less popular ones you need to read the details to get.
I feel mapping like this could cause important information to be put away in a way that cannot be found.

It'll take some getting used to...

[SSJVegeto2001]

I tried to use this and I ended up with strained eyes. It seems like a good idea, but I think most people will stick to using what they are used to. It might help if they softened the colors a bit.

Maybe it needs a time factor ?

[thrill12]

While this is really cool, it is ofcourse a snapshot of current state of affairs: how many times is a certain news item highlighted.

The very small items could however be interesting too:
Take for example a small accident that gets catched on by more and more news companies as time goes on, simply because it is found out that an important person was involved.
Thus, 'small' news items that have a 'high rate of increase' across various sites should be voted more important than static ones.
For simplicity sake, perhaps this could be done visually (simply animate the news from a certain point in time forward to the now, and you see developments more clearly).

This thing is certainly an eye-opener however, applauds to the designer.

Screenshot

[Devar]

If anyone wants a screenshot of what the page looked like before its hosting server melted through the floor, here you go.

Cool, but why flash?

[scrm]

The idea is excellent and the implementation works well (for a beta). But I can't see why the programmer used flash when it seems like a tool that could be done so easily (and in a bandwidth-friendly fashion) using colored HTML tables.

Re:Cool, but why flash?

[ThePretender]

or some CSS work, so it is still up-to-date when using tables to format everything is finally put to rest.

But maybe Flash is just what he knows best, and other versions could follow if it becomes more popular. Can't please everybody with your proof of concept work.

cool. good. innovative.

[jpellino]

i feel abou this the same way i felt about bill herrick's glass topped trout stream coffee tables - now this is different in a good way.

assuming it's not a hoax, it'll be on my bookmarks bar at the top of the news list.

Re:so?

[angusr]

It's not the access to the stories that is the useful function. It's the visualisation of the relative importance of the stories, or - rather - how important the stories are perceived to be by the media (or how successful the propoganda/marketing has been, depending on the story).

1001 news sources have the same stories, yes. The vast majority have the placment and hence importance of those stories decided by editors who, because they're human, have biases and agendas. Google News (and some others) places the stories based on algorithmic results and hence only shows the "group bias" of the world's media. This is just an easy way to visualise that, allowing single-click filtering on various fields and the ability to see many more stories per page and pick out the "important" ones.

Yes, nothing terribly mindblowing (and I've seen a file display recently with a very similar layout, showing files as blocks with proportionate sizes and colours based on last access) but it's still neat, and did help me spot some interesting stories that I'd missed on my regular news sites.

Slashdot map:

[Dark Lord Seth]

<--- You are here.

The latest news article is over here --->

CmdrTaco is not here --->

<--- ... but here.

Also, articles in sector 24-D are down for maintenance and the MPF ( Moderator Patrol Force ) has had som skirmishes with GNAA trolls in sectors 12-C, 13-C, 13-D, 13-E and 14-D. Beware of crossfire and goatses.

Heatmaps in the trading space

[agslashdot]

Heatmaps have been around in the trading space for a while now. Every brokerage firm & most trading mags have heatmaps which show where the market is headed visually, exactly the way this "newsmap" works. eg. Nasdaq heatmap

Another area that could benefit from it is Google Zeitgeist

Re:Heatmaps in the trading space

[llin]

I think the exciting thing here is the excellent (not just neat, but surprisingly useful/usable) implementation of a treemap pulling from publicly available data.

Also, while treemaps aren't new (see Smart Money's Market Map, MSR Netscan), they are qualitatively different visualizations than the heatmaps you mention.

(Also, the Flash loads much more transparently and the overall design is much slicker and well designed than most of the Java versions out there)

Akin to Map of the Market

[Chriscypher]

The tool is very similar in concept to Map of the Market, found on smart money's site. It visually displays stocks positioned by market segment and sized by capitalization. It's very handy for distinguishing overall stock market trends.

Cool!

[WhiskerTheMad]

An all new way I can watch for SCO news spikes!!!

Usenet map

[GMO]

I can't see anyone having mentioned this, and I don't know if it has featured before on /. but:

http://www.cs.umd.edu/hcil/treemap-history/all10 20 01.jpg

show a 'treemap' of usenet. it's kind of inevitable that 'sex' and 'erotica' should be so large ...

More comparisons

[zoney_ie]

Hmmm... Interesting. France and Canada have a similar ratio of national and international stories to the US!

The German Google news has a whopping huge ratio of entertainment to news!

However, India and Australia are WAY low on National news! (Even the UK despite the highest proportion of international news has more national news)

That's all folks, I'm sick of waiting 5 hours for each page to load up (even if it is subst minutes hours)...

Great for media and cultural studies

[WebTurtle]

This is a great technology for those studying media and culture. It reminds me a bit of the HP technology that tracks the spread of stories on web logs. What would be interesting is a combination of the following:

• the information and utility of Newsmap.
• the tracking of the HP blog project.
• the ability to track the author, source, and parent company of each article.

It is interesting to see how much press a given story is picking up, but it is even more interesting to track what media giant is publishing that story in as many of its subsidiaries as it can. This would allow people to see just how much control each conglomerate has over what news the public is allowed to consume. By the same token, what stories are seeing the least coverage? What potentially important news is being "obscured by shit"? Who publishes the news first? What companies merely follow stories that others have already broken?

Font Size vs. Size of Story Block

[johnjay]

Interesting problem he has with choosing to emphasize the font size vs. the size of the story's block. Two stories with equal-sized blocks have different fonts based on the size of their headline. Being used to newspapers, I tend to think the headline with larger font is more important story. I think he is right to go with block-size as the indicator of a story's prominence in the media. Think of the opposite approach: A story with a one-word headline, but a huge font ("War") would have the same-sized block as a story with a multiple-word headline that was less important. I think that would result in a more confusing visual metaphor.

So, I think the programmer had a difficult design choice, but made the right decision. In order to use this effectively, I have to retrain my eye to judge importance according to the amount of real-estate being taken up, not by the size of the font.

Can't wait for pr0nmap

[Petronius]

headline #1 in big bold type: (.) (.)