Bloggers or High Schoolers, Where is the Literary Talent?
word munger writes "A few weeks ago, Chad Orzel read a New York Times article which analyzed the best high school writing on the new SAT test. The Times' writer appeared surprised that the best high school writing was so bad. Chad then wondered if the best bloggers could do any better under the same conditions and it was put to the test. Over 500 people tried the timed online test, but just 109 scoreable responses resulted. Professionals graded all the responses which were then posted on a web site where readers can rate the essays themselves, as well as find out the professional score. So who's a better writer, a blogger or a high schooler? You can also read Chad's analysis — or better yet, you can decide for yourself."
Who's a better blogger, CowboyNeal or your average New York Times reporter?
Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
Bloggers are experts at writing
take Slashdot for example
Just hazarding a guess, but I think one of these groups might have a class or two which covers essay writing for things such as the SAT, and a hint is that it's not the Bloggers.
For alot of Bloggers, High School (much less College) was quite a long time ago, and most employers aren't quite as pedantic as English Teachers are.
On a related note, on our 'Advanced English Comp' exam that all Juniors have to take at our College you get to make 3 mistakes or you have to take the English Comp course. No, I dont mean 3 major mistakes, I mean anything wrong gets counted against you. For example in this writeup alone, I'm sure I have more then 3 mistakes with comma usage alone, much less any of the other writing conventions.
Your hair look like poop, Bob! - Wanker.
I took the SAT in March '05. The essay portion then (assuming it hasn't been changed) is 25 minutes. Even the blog entries I (rarely) write take much longer than that to get a coherent thought properly written - and those take less thinking, usually, than the SAT essay prompt.
In Florida we have (or had, it's been a while) a law called the Gordon Rule. It requires that each student must write a minimum number of words in order to graduate from high school. Though I don't agree much with the quantity required, I think it's a good idea. For me it has always seemed odd that people will practice tennis, math, guitar in order to be proficient but will not do the same thing for writing. For many students the argument is, "I know how to speak English. All I need to do is write it down." Do bloggers write better than non-bloggers? I don't know... but at least it gives some practice in using words.
This is stupid on the face of it. Is the best writing produced in a timed setting from a random prompt?
Come on. Good writing isn't produced like this, and it's not reasonable for the population of a single SAT trial to produce good writing. # of SAT writers infinite monkeys, and SAT examination time infinite. So big deal.
There are lives at stake here!
Perhaps one paraphers don't cut, when experience required in writing introduction conclusion and ability to maintain flow over entire page or five.
That is a very odd comparison, to say the least. The 2 groups are different in too many ways. The testing styles are too different in too many ways. The requirements were different as well. Testing conditions were different. Etc. Hardly scientific. But, it does make great press, right? Odd that so many Slashdot stories moan about science vs. , but then they go with a weird story like this where a "study" is presented as science just because the authors used sort-of scientific "talk" to present their "findings." Isn't this the type of story that 20/20 or Dateline makes up to get viewers?
As a writer (yes, you can't tell from my slashdot writing, which proves my point...), one needs limitations when one writes. For example, what reading level shoudl I write to, who is the audience, what is the audience comprehension level, and what style or genre would you prefer for my text. The instructions for both tests give very little of this information. I would find it impossible to write to my audience here... the exam graders/judges.
"If you want to improve, be content to be thought foolish and stupid." - Epictetus
There seems to be a belief that the first draft of anything should be perfect.
You have an essay to write on a test? no problem, it should look like the finely crafted masterpiece someone else wrote over a period of days, months, or even years. And you have 10 minutes to do it.
People should be introduced to the first draft manuscript of any literature, I think they would be surprised at how awful much of it is.
i wuz up all nite wrkn on my essay to pub 2 my blog when i rlzed that it wudnt b reel w/o sum form of sweet lingo dun up in da house 2 sho 2 my othr HS students, so i only got a 2 outta 6 on dat essay when i got a 9/12 on my SAT 1
I want to know what happens when you take a cross section of bloggers. Like say, political bloggers, and then cross section that further. Take it down into standard authoritarian, authoritarian social, authoritarian economy, and true liberal. Be interesting to see the results.
The damn test gives 25 minutes to write a coherent well-thought out essay. Samuel Johnson wouldn't have been able to bang out a readable essay in twenty-five freaking minutes. Nabokov would have taken one look at the time limit, laughed, and then walked out. 25 minutes, holy crap. Are the people who come up with these tests insane?
For more on the reliability of SAT essay questions as a measure of anything except the ability to pile on verbage, here's an excerpt from another NYT article that ran last year:
"In March, Les Perelman attended a national college writing conference and sat in on a panel on the new SAT writing test. Dr. Perelman is one of the directors of undergraduate writing at Massachusetts Institute of Technology. He did doctoral work on testing and develops writing assessments for entering M.I.T. freshmen. He fears that the new 25-minute SAT essay test that started in March - and will be given for the second time on Saturday - is actually teaching high school students terrible writing habits...
In the next weeks, Dr. Perelman studied every graded sample SAT essay that the College Board made public. He looked at the 15 samples in the ScoreWrite book that the College Board distributed to high schools nationwide to prepare students for the new writing section. He reviewed the 23 graded essays on the College Board Web site meant as a guide for students and the 16 writing 'anchor' samples the College Board used to train graders to properly mark essays.
He was stunned by how complete the correlation was between length and score. 'I have never found a quantifiable predictor in 25 years of grading that was anywhere near as strong as this one,' he said. 'If you just graded them based on length without ever reading them, you'd be right over 90 percent of the time.' The shortest essays, typically 100 words, got the lowest grade of one. The longest, about 400 words, got the top grade of six. In between, there was virtually a direct match between length and grade."
So to any high schoolers about to take the SAT: when in doubt, write a lot, in third-person, and in cursive.
The reporter .. maybe .. for now. People want things said in sound bites, and in an entertaining manner. Hopefully it will make them feel good about themselves while blaming someone/something else for their inconvenience.
.. without bothering to udnerstand the whole situation.
..dumb down .. reduce verbiage .. and utilize deprecative humor against something (anything ..a straw man?). But if you want to appeal to long term common sense and to the humane and just thinkers .. well then be articulate, open minded, and well researched in your writings.
If someone writes a long winded treatise on a topic, most people will ignore, and even be annoyed by it. Even worse, they will go for an easy to understand, though inaccurate, criticism of it
So yeah, if you want to be popular
Will someone please tell me what the infatuation with standardized testing is about?
You get to rank kids, but you also get kids that have trained for the test. I have two sisters that are teachers that quite specifically teach to the test-du-jour. I mean not just a couple of weeks, but every single day's learning plan is oriented around the test the kids take that year.
So, we've got kids being trained for a test, which is certainly not an "education." Or maybe that's what passes for an education for the unwashed, shrinking middle-class masses in America?
http://www.maxineudall.com/2010/02/should-economists-be-sued-for-malpractice.html
This should not surprise anybody, for the following reasons:
1) The SAT writing section gives a student only the opportunity to write a first draft.
2) The SAT writing section is almost always on an incredibly boring and uninspired topic, because the subject of the essay must be as equally accessible to all test-takers as possible. It's also quite obvious that it is hard to write well on a subject you could not care less about. The intersection of good writers and those interested in the topic has to be miniscule, if nonexistant.
3) The SAT writing section is graded based on grammatical correctness and the logical ordering of ideas. It takes no account of whether those ideas make canonical sense, only that they were ordered in a consistent and logical manner.
The SAT writing section can not gauge anything besides one's ability to write in the style of the MLA.
It's been said a million times, but I'll say it again: The SAT score only measures one's ability to take the SAT.
Disclosure: I am a recent college grad who did very well on the SATs.
OTOH, in the real world, we seldom have to develop a formulaic arbitrary piece of writing on a topic that we might not only have no interest in, but no background in. That is a good thing because writing about what you know nothing of, and have no interest in, makes you a hack. Certainly no one going off to college is hoping to be a hack.
A while back an english teacher got a hold of one of my writing and proceeded to 'correct it'. The teacher found several errors on the page, some I didn't realize I made, some that did not change the meaning, some that were bad. Understand I feel like I know who to write, and I feel like I know English. I know to say 'on which side the bread is buttered'. I know that saying 'to boldly go' is wrong, but the correct structure changes the meaning. I understand that as a teacher of English one must be pedantic, but expecting a writer to produce a good product in 25 minutes, on a random subject, is just idiocy. Such a requirement is an insult to the adult process of writing, in which one starts off with an interesting idea, and develops it over time.
Many years ago Byte magazine had a silly essay comparing quality the writings of Hemmingway to the quality of a computer program. Even at the young age I read this, I understood that the analogy was daft, as a computer program must be perfect, and reflects a technical process that changes over time, while a published creative work of fiction is a snapshot of a creative process. The later need not conform to some arbitrary standard of perfection to be a perfectly wonderful tale.
In the end this is one of those studies by one of those people that believes a good SAT score has some bearing on your actual ability to produce a real product, creative, technical, or otherwise. This is not sour grapes. I have always had very respectable standardized test scores, scores in fact that probably overestimate my ability. OTOH my ability to produce has nothing to do with the test scores.
"She's a scientist and a lesbian. She's not going to let it slide." Orphan Black
--Robert Louis Stevenson
These essays seem to be running about 250 words... about a page.
Jack London was proud of himself for turning out 1000 words every day. George Bernard Shaw set his stint at five pages a day.
And of course a professional writer has been preparing to write those words and thinking about them well in advance. And they are on a topic that the writer has selected him- or herself, and has some knowledge of.
So they hit a _high school student_ cold with a topic the student has never seen before and give him or her twenty-five minutes (how on earth did they come up with that figure? Why not a round half-hour, at least?) to do, unprepared, what takes a professional writer a couple of hours, prepared... and people are surprised at the results?
This isn't a test of writing in any meaningful sense of the word. I don't know what it's testing, but it isn't writing.
"How to Do Nothing," kids activities, back in print!
The question the students were asked to respond to (in the sample essays) was "Do memories hinder or help people in their effort to learn from the past and succeed in the present?" With a question like that, how could you expect much more than rambling idea/word association? I mean, without memory, there is no learning.
Of course the students' essays were horribly written. The prompt was terrible:
Do memories hinder or help people in their effort to learn from the past and succeed in the present?
That is an incredibly difficult question that philosophers could spend a lifetime thinking about. In fact, I've found that many philosophers addressing these difficult issues often have glaring logical holes, unfounded assumptions, and most strikingly, atrocious writing.
For some reason, the SAT believes that ambiguous, poorly crafted prompts somehow judge a student's writing abilities. If they want to judge a student's writing skills, this would be a much better prompt:
Your friend is contemplating cheating on the SAT. Write a letter to dissuade him/her from doing so.
At least there are concrete and fairly obvious reasons here, and I wager that you'd very quickly be able to see which students can write well and which can barely craft coherent sentences.
I disagree with this comparison completely. At least how it's being judged and what it's being called. I think the real question here is,
"who is better at critical thinking?" The bloggers, or high school kids with little life experience under their belt?
To say this is a test of writing, is just sick. Writing requires passion, inspiration, and thought. After visiting the site and seeing what exactly the question/comment that the "contestants" were required to write about, I didn't even want to bother looking at any of the submissions.
Another big difference, is that the SAT test takers are under pressure to perform for their educational future, whereas the "bloggers" don't really have anything riding on it.
I like to fancy myself a writer, but I know i'm not consistant with it. I really only write when I'm inspired to do so, and usually it's to vent whatever crappy experience I'm going through or as a release valve to the craziness that goes on in my head from time to time.
That's a far cry from asking my opinion in regards to a certain subject, then timing me as to how fast I can composite an opinion and express it in writing.
If this were to be an accurate accounting of flat out writing skill and the use of the english language, a better test would be to have the "contestants" write out a technical manual, and judge it on who could clearly and best explain how to setup your widget du jour.
Directions: Think carefully about the issue presented in the following excerpt and the assignment below.
'I have learned that success is to be measured not so much by the position that one has reached in life as by the obstacles which he has overcome while trying to succeed.'
-- Booker T. Washington
Assignment: What is your opinion on the idea that struggle is a more important measure of success than accomplishment? Plan and write an essay in which you develop your point of view on this issue. Support your position with reasoning and examples taken from your reading, studies, experience, or observations.
The quote was not about accomplishment, it was about position. Those words have different meanings.
Do you even lift?
These aren't the 'roids you're looking for.
Not in a box,
not with a fox,
No here not there
Not anywhere.
Slashdot: Failed Car Analogies. Amateur Lawyering. Anecdote Battles.
...Reviewed for them...
Also, homework unfairly discriminates against students who choose not to do it...
Can you be Even More Awesome?!
I tried, but he kept wanting to know what I was wearing and what my penis size was.
The strong bias towards math probably exists because... well, this is going to sound stupid, but math is quantitative, and writing is qualitative.
It's easy to say that little Timmy is a math prodigy because he's solving integrals in his head by the time he's in seventh grade. It's very difficult to say that little Billy is a literary prodigy because the degree of assimilation and the quality of work produced are both measured very subjectively. In math and science, there are simple, fairly straightforward ways of measuring how well a student _recalls_ concepts and how well they can _apply_ the concepts. That latter one does require someone to read a bunch of logic on paper, and then estimate how well the kid has applied the concepts they've learned (i.e. does the student seem to understand "force" or is she just plugging and chugging), but that can be objectively determined (did she get the right answer, and do her steps to that answer clear and logical).
In writing, someone has to actually sit down and read everything they student has written, judge it as objectively as they can, and then assign it a number grade. You could give a test on sentence structure, comprehension, and so on--which they do--and still have no idea if the kid can write. The writing needs to be clear and logical, but what's clear and logical in an essay is by no means as straightforward as what's clear and logical in a physics problem solution.
What I'm trying to say, really, is that there is probably a bias towards math at least in some part because basic-level math is very easy to grade and evaluate, whereas to judge writing is more nebulous.
The essay portion of the Scholastic Aptitude Test does not measure Scholastic Aptitude. According to the College Board, students are given 25 minutes to digest a question, consider its ramifications, develop an opinion, prepare a response, and write it coherently, in a well-organized and persuasive fashion. The shortness of the test, therefore, encourages the test-taker to, respectively: misconstrue questions and jump to conclusions, consider issues only at the most shallow and superficial level, form opinions hastily, forego careful argument construction, and avoid correcting mistakes in grammar and diction in order to get everything down on paper. It's hard for me to believe that this test provides any useful metrics on critical thinking at all.
This post expresses my opinion, not that of my employer. And yes, IAAL.
Something like a full Kaplan course will get you an exta 30-40 points on an SAT. Beyond that, the returns rapidly diminish. All the studying in the world won't net you 100.
The primary alternative to test scores are grades, which are even worse. They are extremely coachable, greatly influenced by third parties (parents, tutors, smart friends), subject to teacher ass-kissing, and are often a measure of attention to detail and willingness to do the grind rather than mastery of the material.