Slashdot Mirror


Looking At Pretty Graphics Of Dot Com Demographics

chris_robison writes "A talented guy wrote a great example of the quality of talent that is going to waste in these economic "hard times". An unemployed friend of mine put together a kickass tool which lets you query a database of craigslist statistics and generate graphs comparing various things such as job postings and apartments for rent. Although the stats are geared toward San Francisco and the Bay Area, it does make for some interesting reading, even if you aren't from around there. Here's his explaination of what he did (included below)" "hey kids.

I'm unemployed and bored.

With all the talk about dotcom booms and people moving away and all these really general statements people are making; i was curious as to what's really going on now, what went on four years ago and what effect did the boom really have on this community.

So.. i wrote a script that went through the craigslist archive on egroups and tallied the number of postings each day for each category then i stuffed it in a database and made a grapher tool.

It's kinda neat cos you can basically see some somwhat hard data on what the san francisco bay area has been doing over the past four years. you can graph job postings from various industries against things like apartments for rent or housing wanted postings, also for sale postings and resumes.

Some of the interesting things I found is that the number of housing wanted postings seems to be slightly down recently but pretty much unaffected by the drop in jobs. perhaps people are always in a state of wanting to move to a city.

One thing to bear in mind, this data isn't one hundred percent accurate for a few reasons... people do repost their information multiple times in a given month, sometimes people post a number of avaliable apartments in a single posting and craigslist has become significantly more popular over the years in question. however, I do still think that it makes for a decent general indicator of trends in our community. (I'm considering doing some kind of normalizing based on the total volume of posts- I need to think about it some more)

(Unfortunately, personal listings aren't archived. I guess that's a good thing... but I guess it also would have been cool to graph activity on the personals categories against some of the categories that reflect the general state of the economy. (maybe when people aren't tied up in career they start to think about more important things, or maybe not...) )

Either way, the data is there, you can look at it for different time periods and categories. draw your own conclusions and have fun!

The url is here:

http://www.signal11.com/charts/chart-o-m atic.cgi

take it easy..

--adam "

3 of 195 comments (clear)

  1. Re:Blame Adequacy! by SuiteSisterMary · · Score: 1, Offtopic

    That would be sung to the tune of 'Blame Canada' from South Park: Bigger, Longer and Uncut.

    --
    Vintage computer games and RPG books available. Email me if you're interested.
  2. Re:interesting choice of vars in PERL by NMerriam · · Score: 1, Offtopic

    signal11 proved that the karma system was easy to abuse (which was more of a social experiment than anything he proved about slashdot itself), and he racked up thousands of karma I believe.

    Because of him, they set a karma cap of 50, made the karma hidden from the user page and apparently deleted a lot of signal11's karma from his account.

    He was the original karma whore.

    (I should note I am still way above the 50 karma limit -- which is interesting because if you're a low UID and posted decent messages it was easy to do. But because you can't go above 50, it never credits for +1 when comments get modded up. But it DOES subtract when you get -1 on a comment!! So you're guaranteed to slowly watch your karma go down until you hit 50, which for me should be another year or two I guess)...

    --
    Recursive: Adj. See Recursive.
  3. OT: karma by Pope · · Score: 1, Offtopic

    Which of course, brings up the most obvious question: once you have enough karma to post at +1, what's the point of knowing or caring about how much you have?
    THe only thing worse is some low UID persons who assume that everything they say is Interesting or Insightful, simply based on their early arrival.
    Your post was Informative.

    --
    It doesn't mean much now, it's built for the future.