Geographical Mapping of Website Traffic?

inputsprocket asks: "Having gotten into a project that involves doing some geo-statistic data mining analysis on Apache log files, I couldn't believe how there seems to be such a large chasm, in open source's vast library, for such a powerful analytical tool. Unless I'm wrong, then there is no such open source project available for *nix variants. There appears to be a great deal of brand software (heh — only for Windows off-site analysis though), yet there is are great open source tools for generic mapping tools (GMTs). The available GMTs seem to be overkill for mapping of weblogs and require a lot of in-house programming to map IP addresses to cartographic data using free geo-location databases. The closest I found was Palentir. Does one really have to rely on the powerful needs of Map Server, MapTools, Carto Web, or Map Builder to draw simple maps with statistics on web usage, given the extra programming needs required to do this? "To see what is possible, have a look at DeepMetrix's LiveStats.XSP — a commercial option, which isn't a problem. It's just a shame that it's only for Windows and for of-site browsing.

Somebody, please tell me there's more to open source geolocation of web traffic than Analog."

Comments

Try hostip.info

[Space cowboy]

I created the hostip.info website a couple of years ago which is an open-source geo-location system. I've since passed it to others to maintain.

On their front-page right now is a geographic map of website traffic, which is a "public-beta" of a mapping system (upload IP addresses, get a map).

They don't actually appear to give out the code (from only a quick look on the site, that may not be correct), but this ought to be pretty trivial to do yourself if you wanted... The public API of hostip.info returns the lat/long of any IP address it knows, and plotting lat/long on an image of the world ought not be too hard.

I designed the whole system so you could download and set up your own geolocation database, slaved from the master at hostip.info with regular updates. Then you can query IP addresses locally and generate charts however/whenever you wanted...

Just a thought,

Simon

Google?

[CodeMonkey22]

Google Analytics does a decent job of this. I wonder if they have an API you could hit against it...

Perl Module Geo::IP and MaxMind Database work ...

[xmas2003]

A while back, I wrote a quick little Perl script to do geolocation and other misc. info - see the page for more info, but it uses the free Perl Module Geo::IP and the MaxMind database. The free version of the later used to only provide country data, but they now provide lat/long and city info ... seems reasonably accurate, although with all of these things, the results can sometimes be way off.

So with that, it wasn't too hard to write another Perl script that parses the IP address from the Apache logs, acquires misc. geolocation info, and then dumps out the lat/long data in Javascript for the Google Maps API - see this graphically shown on my christmas maps page.

Azureus-RIAA.

[Anonymous Coward]

"Azureus can display the location of your peers on a world map."

Thanks

phpmyvisites

[inputsprocket]

Replying to my own question, but I think I found the most complete OS project out there for geolocation log statistics....

I've been playing with phpMyVisites and it looks a very nice and thorough implementation of what I was looking for.

Although it's method for country geolocation is a bit *cough* rough, I think a module to hook into Space Cowboy's hostip.info shouldn't be too difficult...

The only problem with it is it uses mysql to store the logs *grrrrr*

OpenLayers looks slick!