Slashdot Mirror


Geomapping Racism With Twitter

Hugh Pickens writes "Megan Garber writes that in the age of the quantified self, biases are just one more thing that can be measured, analyzed, and publicized. The day after Barack Obama won a second term as president of the United States, a group of geography academics took advantage of the fact that many tweets are geocoded to search Twitter for racism-revealing terms that appeared in the context of tweets that mentioned 'Obama,' 're-elected,' or 'won,' sorting the tweets according to the state they were sent from and comparing the racist tweets to the total number of geocoded tweets coming from that state during the same time period. Their findings? Alabama and Mississippi have the highest measures followed closely by Georgia, Louisiana, and Tennessee forming a fairly distinctive cluster in the southeast. Beyond that cluster North Dakota and Utah both had relatively high scores (3.5 each), as did Missouri, Oregon, and Minnesota. 'These findings support the idea that there are some fairly strong clustering of hate tweets centered in southeastern U.S. which has a much higher rate than the national average,' writes Matthew Zook. 'But lest anyone elsewhere become too complacent, the unfortunate fact is that most states are not immune from this kind of activity. Racist behavior, particularly directed at African Americans in the U.S., is all too easy to find both offline and in information space.'"

32 of 409 comments (clear)

  1. Actually Measured by kenh · · Score: 4, Insightful

    How did they account for multiple racists tweets from one "tweeter"?

    One racist sending 100 racist tweets is not the same as 100 different racists each sending one racist tweet each.

    --
    Ken
    1. Re:Actually Measured by stranger_to_himself · · Score: 5, Informative

      How did they account for multiple racists tweets from one "tweeter"?

      One racist sending 100 racist tweets is not the same as 100 different racists each sending one racist tweet each.

      Reading the article it doesn't look like they bothered. And they only found a total of 395 tweets which will lead to appalling precision in any of their findings. Sadly 'information scientists' don't always appear to be the best statisticians.

    2. Re:Actually Measured by Sir_Sri · · Score: 4, Insightful

      With only a couple of days work this isn't bad. But it's not science, it's interest and a proof of concept for doing actual research.

    3. Re:Actually Measured by stranger_to_himself · · Score: 4, Insightful

      With only a couple of days work this isn't bad. But it's not science, it's interest and a proof of concept for doing actual research.

      I accept they didn't work very hard on this but in that case its irresponsible to be promoting the findings among people who clearly won't bother to understand the (immense) limitations of the method. It's slightly irritating that as far as the general public is concerned this kind of back of the envelope calculation is indistinguishable from proper science. I wouldn't publicise any findings until I'd had them peer-reviewed and published. But then maybe I'm old-fashioned (and maybe this is why I don't have an academic blog)

    4. Re:Actually Measured by Anonymous Coward · · Score: 5, Interesting

      The story also does not count African-American ("black") prejudice/racism toward Latino/Hispanic ("brown"). In reading many articles and comments, most people are unaware of this "black-on-brown" racism but, for those who live and work in minority areas, it is noticeable.

      The Washington Times published a story (three weeks in the weekend issue, IIRC) about "black-on-brown" racism in some major metropolitan settings. One was Memphis (where I lived for 16 years as an adult). The article was full of African-Americans making interesting/telling complains about Latinos/Hispanics. Statements such as "they don't look like us"; "they don't talk like us"; "we can't understand what they say"; they don't eat the same food as we eat"; even, "they don't smell like us". Quite interesting and enlightening articles. Either African-Americans are just as racism as "white" people or the noticing of differences is a normal function of being a human and part of a group.

      African-American are just as prejudiced against people who are not like them or are not a part of their group as any other group.

      Personally, I am at a quandary. Since my ethnicity includes European (northern and southern), African (north and central), Asian (near, middle, and far), and the new "Latino" and older Hispanic, who should I disdain? Which part of me is less than the other individual parts? Quite a problem in our race-oriented political culture. Thankfully, the Knoxville News Sentential ran article on "white" Southerners quoting experts who said all had 5% African blood. This means all Southerners are African-American and can legally claim to be "black" and joint the NAACP, the New Black Panthers, the Democrat Party; they can also change their EEO status and qualify for Food Stamps, Scholarships, etc., etc. much, (Oops, which part of me am I ragging on now?) LOL!!!

    5. Re:Actually Measured by CajunArson · · Score: 4, Funny

      STOP POINTING OUT FACTS! We just want to hear reinforcement of our stereotype that all white people are evil racists and all minorities are racially superior since they are completely incapable of being bigots towards anyone!

      Now excuse me while I go to the Black Panther meeting where we discuss how we will be "poll volunteers" again in 2016 to make sure that [insert name of Democrate here] wins because any other vote is automatically racist.

      --
      AntiFA: An abbreviation for Anti First Amendment.
    6. Re:Actually Measured by ClioCJS · · Score: 5, Funny

      that person is probably 300 times more racist than someone with just one account

      --
      -Clio
      Karma: Bad (mostly from not giving a fuck)
      Blog: http://clintjcl.wordpress.com
    7. Re:Actually Measured by Hatta · · Score: 3, Informative

      BTW, I just checked out a sample size calculator. For a 95 percent confidence level with a +- 5% confidence interval, and a population of 400 million, guess what your sample size needs to be.

      384.

      Now this calculation for a survey is a little different from what the researchers are doing here, but it illustrates my point. You can do a lot with small sample sizes if the differences between groups are large.

      --
      Give me Classic Slashdot or give me death!
    8. Re:Actually Measured by Sir_Sri · · Score: 5, Insightful

      I wouldn't publicise any findings until I'd had them peer-reviewed and published.

      Then you'd never get funding for a project like this.

      They're demonstrating that there might be something interesting to study, the press lets them ask for money rather than beg, and they're not all that invested in a project that might not go anywhere.

      its irresponsible to be promoting the findings among people who clearly won't bother to understand

      I hate to break it to you, but the press doesn't understand peer reviewed work any better. Whenever media ever looks at any academic work they completely misrepresent it. That's something you get used to.

    9. Re:Actually Measured by stranger_to_himself · · Score: 4, Insightful

      BTW, I just checked out a sample size calculator. For a 95 percent confidence level with a +- 5% confidence interval, and a population of 400 million, guess what your sample size needs to be.

      384.

      Now this calculation for a survey is a little different from what the researchers are doing here, but it illustrates my point. You can do a lot with small sample sizes if the differences between groups are large.

      That's if they're only trying to estimate a grand rate. To make state-by-state estimates they need this number *per state*.

    10. Re:Actually Measured by stranger_to_himself · · Score: 4, Informative

      I hate to break it to you, but the press doesn't understand peer reviewed work any better. Whenever media ever looks at any academic work they completely misrepresent it. That's something you get used to.

      You are right but this means that the peer review filter is even more important so that what gets out to the media and beyond has at least some chance of being right. Also, having been through the process a few times I'd say academics are at least as guilty of overstating their findings as journalists. We want the headlines and the 'impact' as much as journalists to.

    11. Re:Actually Measured by jamstar7 · · Score: 3, Funny

      racists dont know how to sign up for 100 accounts.

      Not just a woofing. This condition is untweetable.

      Must be a canarial disease...

      --
      Understanding the scope of the problem is the first step on the path to true panic.
    12. Re:Actually Measured by Sir_Sri · · Score: 3, Interesting

      what gets out to the media and beyond has at least some chance of being right

      I don't think that has ever worked for anyone in the last 20 years I have no reason to believe it will start now.

      Not too long ago /. had posts from the communications department of the university of western ontario, which is where I am a researcher, and from our own university the document was a poor characterization of what the research actually was (HIV vaccine stuff in this case, though I'm in comp sci and they don't do our work any better). Somewhere along the line someone decided that the 'public' only understand high level concepts, so everything we communicate is written as thought it was for a 16 year old to understand. It doesn't matter than dozens of other research papers and groups will actually have to do the work to make the thing the 16 year old understand though, we talk about pieces of a puzzle as though they are a solution to the puzzle. And there's no central media authority who might change it.

    13. Re:Actually Measured by ganjadude · · Score: 3, Insightful

      To me, everything you just said, is in fact a racist comment.

      when person X cant get a scholarship to a college, eventhough their grades are higher than person Y, that is racism. when person X does not get a job as a police officer when they finish 3rd in the class, yet person Y -who finishes 15th in the class does get the job - that is racism

      sure "white people" who have been dead for 100 years held "black people" who have also been dead for 100 years as slaves. but that was then, There is no reason "black person" should get anything special from "white person" today because neither of them had anything to do with slavery

      --
      have you seen my sig? there are many others like it but none that are the same
    14. Re:Actually Measured by Talderas · · Score: 3, Informative

      395 racist tweets from a 0.05% sample works out to 790,000 racist tweets for the country. Even if you assume each racist only posted one racist tweet max, that's 0.25% of the country overall being racist. For the state with the highest rate (Alabama) that's 2%. In an effort to root out racism, this study is presenting their results in a careless fashion which could be used to justify discrimination and anti-Southerner stereotypes against 98% of Alabama residents because of a small minority of bad apples. It is doing the very thing it is criticizing.

      395 that contained search terms that the searcher decided indicated racist intent. There's no indication that any of the tweets that came up were filtered for actual racist intent. For example "Obama won bitch, niggers back" would have came up as a "racist" tweet. However it's likely that such a tweet was not a racist and that the author of it was probably black. If you look at the clustering of where tweets were coming from you see that a high clustering was occurring in cities like Atlanta, Georgia or Montgomery, Alabama which has a majority of a minority population (54% black and 56.6% black respectively).

      The study is flawed and was never properly scrubbed, but the results were posted because it fits a preconceived notion (the south is racist) when the majority of the effect that causes that effect to show may originate from the very population which is the victim of racism against blacks.

      --
      "Lack of speed can be overcome. In the worst case by patience." --Znork
  2. Anyone Have Original Numbers and/or Tweets? by eldavojohn · · Score: 5, Interesting

    I love data porn and tried to play around with this interactive map. I lived in Minnesota for 23 years and do not recall it to be very racist -- even in the rural areas. So according to that map there are five red dots in Minnesota which are strangely all centered around the twin cities area (the most populated and liberal part of the state). And that data puts Minnesota mentionably close to the top of the list? But if I look at Virginia, I can't even count the number of red dots there's so many and it's not even halfway up the list? What the hell?

    Do each of these red dots indicate a single tweet? What are the numbers and tweets that they're looking at here, I feel like the LQ value is not doing the best job of reflecting "racism."

    --
    My work here is dung.
  3. Careful by sideslash · · Score: 3, Insightful

    They're only looking for racism directed against Obama, so they won't find (for example) black against white racism in Philadelphia or Latino against Caucasian racism in California. It is truly regrettable that certain organizations like the SPLC dilute their otherwise honorable mission by turning a blind eye to hate in some of its notable forms.

    1. Re:Careful by postbigbang · · Score: 5, Informative

      The SPLC does in deed execute their honorable mission. Go to http://truthy.indiana.edu/ for other meme propagation and dissemination graphics so you can see that this is one lens to the output of a much larger engine.

      --
      ---- Teach Peace. It's Cheaper Than War.
  4. Congratulations, Slashdot -- achievement unlocked: by jeffb+(2.718) · · Score: 5, Funny

    "Make Trolls Stay On-Topic"

  5. Not surprising but the data is flawed by thetoadwarrior · · Score: 4, Insightful

    The data only accounts for racism specifically targetting Obama by the looks of it. So not surprisingly the states that lost the civil war have the most. But it appears to be counting tweets vs accounts. That makes a huge difference because it only takes one mouthy retard to drive your state up the ranks.

  6. Re:Wow, they have done it again by mariox19 · · Score: 3, Funny

    The most charitable explanation for your post is that you did not click on the link and take a look at the article.

    --

    quiquid id est, timeo puellas et oscula dantes.

  7. One Tweet for Utah, One Tweet for North Dakota by eldavojohn · · Score: 5, Interesting

    With only a couple of days work this isn't bad. But it's not science, it's interest and a proof of concept for doing actual research.

    I think it's absolutely horrible and the fact that these states names but not their numbers have found their way into headlines and a Slashdot summary makes me sick. They might have been right to indict the Southern states that we already know have issues along these lines but their map of tweets lists precisely one tweet for Utah and one tweet for North Dakota. The really appalling thing about the North Dakota tweet is that it is geolocated to Minot, a town that has seen an explosive growth in transient workers from states like Oklahoma and Texas in order to meet the demand for workers with oil specialties in the oil fields near there. It's probably a fifty/fifty shot the tweet was from an actual permanent resident of North Dakota.

    Basically if a low population states hits the top of your study and the data is that sparse (one tweet!) then I think you should omit that as an outlier and stricken those names from your press release. It's great to recognize these things in your data and to talk about them in your analysis. It's unjust to propagate just their names throughout the news making people think that North Dakota is not only cold and sparsely populated but it's also racist.

    Someone in Salt Lake City could have been joking in one tweet and suddenly Utah is one of the most racist states in a Slashdot summary. A transient worker who feels like lost his job in OK and had to use his CDL in Minot, ND because a black man was president could fire off an ignorant tweet and suddenly North Dakota is full of racists.

    --
    My work here is dung.
    1. Re:One Tweet for Utah, One Tweet for North Dakota by GrumpySteen · · Score: 4, Informative

      The floatingsheep page specifically says, "we are measuring tweets rather than users and so one individual could be responsible for many tweets and in some cases (most notably in North Dakota, Utah and Minnesota) the number of hate tweets is small and the high LQ is driven by the relatively low number of overall tweets." It's not their fault that the author of the Atlantic article left out those details.

    2. Re:One Tweet for Utah, One Tweet for North Dakota by GrumpySteen · · Score: 4, Informative

      LOL

      You clearly did not look at the website. The guys who did this are in academia, but the website is not an academic publication nor would any of the stuff they post garner funding. Their top articles include such things as "The Beer Belly of America", "The Price of Weed", "Church vs. Beer? on Twitter" and "Church, bowling, guns and strip clubs."

      They're doing this as a fun hobby, not serious academic research. There is no funding, no grants, nothing.

  8. Re:How about black-to-white racism? by Nerdfest · · Score: 4, Informative

    Why is it irrelevant? They claim they're measuring the geolocation of racism, but only pick one very specific type.

  9. Re:niggers by Opportunist · · Score: 4, Insightful

    Actually, it's not the word, it's the person that makes it racist. As George Carlin ($deity bless his smutty soul) said "Eddie Murphy talks about niggers, but he's not a racist, don't be silly. He's a nigger". Is Carlin a racist for using the word? I kinda doubt that he is. And even if, he's not for using the word.

    Words are, by themselves, nothing but just that. Words. Idioms to represent something, in case of a noun, to represent an item, a person or an idea. It's the intention behind the word that makes it racist or not. And that's not depending on the word. If a racist calls someone an Afro-American (or whatever the PC word is right now, sorry if I don't keep up with the bull but I prefer to be correct instead of PC), the intention is to use the word not only to ridicule PCness, but also to use the PC term to deem someone inferior.

    It is not the word. It is the person that is racist. And by changing the politically correct term for it, you don't change racism. You just paint the shit in a different color, but it still reeks.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  10. Re:niggers by postbigbang · · Score: 4, Insightful

    Not at all.

    Language is tricky. You can be what you want to be. My doubts about the nature of your posts has to do with your seeming self-reviling. You describe yourself in terms that don't connote pride, they connote self-loathing, which shouldn't be the case.

    Along thru this thread, I've told you that you can use any words that you want; they're protected speech. Your inference, however, is that you seem to despise these things. Being of mixed race, part of the LGBTQ rainbow, these are who you are as an individual. I respect individuals. I don't respect negative labels.

    For English, there is no real language police. There is, however, the semantical choices made by English speakers that contextually infer their contexts, and their meanings. Describe yourself in any way you see fit, but don't believe that others want to use the negative inference you've used as well. Indeed, these words are used to subjugate you by labeling you in negative terms. Those negative terms are viable. But they do little good.

    That you may be perceived by others negatively is their misfortune. For you to do so, however, validates their negativity and prejudice. Be proud. Pride is a positive quality, and eschews the negative.

    --
    ---- Teach Peace. It's Cheaper Than War.
  11. Re:niggers by Omestes · · Score: 4, Insightful

    As a person who isn't a kid these days, and is completely unfamiliar with hip internet parlance (i.e. lives in the real world), terms like "faggot" and the n-word (I don't even want to type it) are still highly charged, and loaded with ugly context. I really doubt that most gay people or black people would also find these words fully acceptable (go find one, call them it, then try to tell them that its okay on 4chan so they should relax).

    Words do have power. Words shape our understanding and conception of the world. Words with a loaded history of venom and hate still maintain a portion of that long after they stop being completely pejorative. It doesn't even matter what the speaker means, as meaning is created mostly by the perceiver.

    Further, your being a bit naive. If someone calls me a "fag", I'm pretty sure they aren't critiquing my fashion sense, they are trying to tie me to a group which (for some stupid reason) they find undesirable. It is an insult which hinged on the idea that homosexuals are bad or dirty. This is the actual content behind the word. The word isn't bad, but the connections it requires to have meaning are.

    Unless of course they are asking for a cigarette, or some firewood.

    Hell, "fuck" has pretty much become a normal word now, but there still are some connotations lurking in the background which keeps me from ever really wanting to use it (I do, and often, but don't find it a point of pride).

    --
    A patriot must always be ready to defend his country against his government. -edward abbey
  12. Re:This whole topic is full of shit by pclminion · · Score: 4, Insightful

    How is that when people speak their mind it is labeled "racist"? Isn't there a freedom of speech?

    Ding ding ding! We have a winner. Calling these idiots racists is an exercise of free speech.

    Oh, you wanted us to sit silently while you spew little-minded vitriolic bullshit? Is that how you think free speech works?

  13. Re:How about black-to-white racism? by Nerdfest · · Score: 5, Insightful

    I know another term for reverse-racism ... it's "racism". It shouldn't be made different in any way. If people keep doing things to treat any type of racism differently, it will never stop.

  14. Re:How about black-to-white racism? by shadowofwind · · Score: 5, Interesting

    When white people hate black people, the people who are harmed the most by it are black people.

    When black people hate white people, the people who are harmed the most by it are black people.

    In the US there are more white people than black people and the white people have more power. The situation is not symmetric.

    For now, the 'specific type' of racism that was measured is still important in a way that the others aren't, even if the others are important also. Soon white people will be a minority, but then black racism still won't be a large threat to white people, it will be asian and hispanic racism, or the absence of it, that affects them primarily.

    I agree that racism is a better term than reverse racism. But its BS when people (not necessarily you) bemoan the fact that black racism isn't treated like white racism. Likewise for when people complain of "class warfare" when rich people are criticized for abusing the power that money gives them. (When a poor person thinks that rich people should pay more taxes, and politicians pander to that, it doesn't harm the rich person in anything like the way the poor person is harmed by the self serving actions of the rich person. Getting laid off to increase the quarterly earnings of an already profitable company, for instance, is a lot worse than a multi-millionaire having to pay 20% capital gains tax instead of 15%. The argument is made that higher capital gains taxes would hurt poor people because it discourages investment. This ignores the fact that 'investment' activity is often more parasitic in nature rather than economically constructive. But even supposing the argument is valid, it still illustrates the asymmetry - its the poor person who suffers in both cases. This doesn't imply that rich people are 'worse' than poor people, or that poor people would be any kinder if their roles were reversed. But it does mean that when you're successful, the wealth you acquire gives you more power to affect other people, and you're responsible for what you do with that.)

    I consider myself to be racist, and its something I'm not entirely ashamed of. I don't think that cultures are in every sense equivalent, and I don't think that all kinds of intelligence are uniformly distributed across genetic groups. Its BS when black people act like their worst stereotypes then complain of racism when they get criticized for it. But its worse to use even real weaknesses and shortcomings of other people as an excuse to unjustly abuse and exploit them when you have the power to do that. From where I stand, white people who try to draw an equivalence between black and white racism generally don't see anything like the truth about how grievously black people have been fucked over by white people. And I'm not just talking about Jim Crow, that affected many still-living black people. Our entire social and economic order is still to a very large extent built around the values and strengths of non-black people. Its not being 'fair' when you define virtue in terms of your own best advantages then punish others for falling short by that standard.

  15. Re:How about black-to-white racism? by dbet · · Score: 3, Insightful

    It sounds like you decided that since it's not realistic for the whole of black men to have power over the whole of white men, that you've extrapolated that into believing that it's not possible for a black man to have power over a white man.

    White man walks through black neighborhood, gets attacked by black men because he's white. If you don't count that as racism than you should probably stop trying to use words at all.