How Scientific Consensus Has Gotten a Bad Reputation
nerdyalien writes From the article: "Fiction author Michael Crichton probably started the backlash against the idea of consensus in science. Crichton was rather notable for doubting the conclusions of climate scientists—he wrote an entire book in which they were the villains—so it's fair to say he wasn't thrilled when the field reached a consensus. Still, it's worth looking at what he said, if only because it's so painfully misguided: 'Let's be clear: the work of science has nothing whatever to do with consensus. Consensus is the business of politics. Science, on the contrary, requires only one investigator who happens to be right, which means that he or she has results that are verifiable by reference to the real world. In science consensus is irrelevant. What is relevant is reproducible results.'" As a STEM major, I am somewhat biased toward "strong" evidence side of the argument. However, the more I read literature from other, somewhat-related fields (i.e. psychology, economics and climate science), the more I felt they have little opportunity to repeat experiments, similar to counterparts in traditional hard science fields. Their accepted theories are based on limited historical occurrences and consensus among the scholars. Given the situation, it's important to understand what "consensus" really means.
No functioning computers would exist without "Science." Science is verifiable and reproducible often in a variety of ways, or it is not "science."
It's actually much worse than that.
Studies in economics and psychology tend to suffer from certain problems which limit their real-world application and the likelihood that they actually mean what people think they mean.
First, they are often based on correlation rather than causation. This is especially true with psychology studies, and readily allows confirmation bias, incorrect interpretations of data, and interpretations of data which are heavily influenced by the perspective of the researcher.
Second, they are often done on western college students. This tends not to yield rules of general applicability.
Third, most economics (and psychology of economics) experiments are advertising experiments. They are done by corporations for financial gain and the results are generally kept secret because they are part of a company's IP and help the company sell its products, and because it simply saves the company money to not bother publishing.
Science is about provability, consensus is about getting majority or even a plurality of opinions. These two things are mutually exclusive.
Piltdown Man was once "consensus". We know how that turned out.
Agent K: A *person* is smart. People are dumb, stupid, panicky animals, and you know it.
Me neither:
http://www.realclimate.org/ind...
"When information is power, privacy is freedom" - Jah-Wren Ryel
Consensus is something that helps us keep crackpots and bad actors (Say, those that pay for fake/biased studies that support their political or financial position) from pushing their agenda. Charisma and slick marketing are dangerously effective so the practice of gathering the collective opinion of all the experts in a given field is important.
It's not perfect. Occasionally the community is slow to move on new evidence, but science should be a careful and methodical practice.
We enjoy stories about underdogs and misunderstood geniuses or the rogue new guy that goes up against the "establishment" but in reality actual true stories of this nature are quite rare. Statistic noise rare. Real breakthroughs are nearly always the culmination of decades of work from hundreds of researchers.
Michael Crichton, frankly, was a hack that enjoyed the above fantasy a bit too much. He did do a bit of research for his projects but it was always just dressing for the same plot over and over again.
That man has done more damage to the world than he ever knew. When he fell in to the climate change denial camp he provided legitimacy to the anti-intellectual nonsense that we're struggling to deal with today.
Going along with your science department's political position so that you continue to have a job and funding.
If there is no way to set up a test to and verify the results it falls more into the field of pseudoscience rather than science. If there is a way to test and verify but the data to do so isn't provided then it is more likely that it falls into the category of scam rather than science. (e-cat anyone?)
Climate science is given as an example. I don't see any reason to why results based on a model can't be backed up by providing said model or even the source code for verification.
Peer review is an important part of the global scientific progress. "Piltdown Man" is an excellent example of the need for peer review, which keeps true psuedo science such as perpetual motion and quackery like so-called "Cold Fusion" at bay. I find it rather astonishing at s-called open source advocates who praise the peer review mechanism to spot out bad code yet downplay it's importance in any other field.
A consensus is a bunch of people who share an opinion. It has nothing to do with right or wrong.
A consensus is a bunch of people who share an opinion. You can have a consensus of scientists, but not a scientific consensus. Crichton was right (about that): science is about consistent, reproducible results, not opinions or consensuses. Politics often involves consensus.
Climate science doesn't care how many people, scientists or not, vote for a particular hypothesis. Climate politics do, and that's what's involved when we try to decide what to do. Unfortunately, people confuse the two.
It's absolutely true that science is not about consensus. Science is not a body of knowledge, but a process of (roughly speaking) formulating an explanation of phenomena, devising a means to test the explanation, and then using that test to determine whether the explanation adheres to the "real world". One of the criteria of a good test is that it must be reproducible, but nothing in the process of science actually requires "consensus".
However, you have a bunch of different scientists with different specialties studying different phenomena, so much so that no single person can actually be aware of it all. Certainly no single person can actually reproduce all of the tests and experiments. In the face of such complexity, we've developed another system which, speaking strictly, is not "science". It's more of a social/political system whereby the various experiments are reviewed by other scientists who attempt to determine whether the tests were good, and whether the tests actually tested the explanation/phenomena they were supposed to. In a formal setting, this process is called "peer review", but it also happens informally (i.e. scientists read each others' work, challenge it, devise other tests).
The upshot of this social system is that, if you aren't enough of a climate scientist to review the existing knowledge of global warming and evaluate its validity, then you should probably just trust the consensus. You trust that there are a lot of smart people working on the problem, and if 95% of the climate scientists agree, then the safe guess is that they're probably at least on the right track. It doesn't mean that they're absolutely correct-- no scientific or social process can guarantee absolute correctness-- but you're going to find more success going with the overwhelming consensus than going against it.
Of course, every once in a while, there is some genius who figures out that the overwhelming consensus is wrong. Most of the time, the scientific community catches on pretty quickly and the consensus changes.
The notion that climate science or economics can't repeat experiments is not entirely fair. While it's true that we can't conduct isolated double-blind experiments under identical conditions, we can conduct tests under analogous conditions to determine whether a given model is accurate or not, which is the real goal of such science. Given enough instances in which the accumulation of carbon compounds in the atmosphere leads to an overall increase in temperatures, or in which an increase in government spending or low-end wages stimulates economic activity in a market economy, we can make the inference of a correlation, and start looking for a mechanism of a causal connection.
http://alternatives.rzero.com/
Incorrect. Appeal to authority means accepting what a person says on a topic as probably correct because they are an authority. The difference is scientists are using research to back up their claims. They are not stating claims as fact simply because they are experts.
Thankfully, you can get climate data here http://www.ncdc.noaa.gov
And even more thankfully, you can see how both satellite and balloon data for atmospheric temperatures have consistently tracked each other since satellite data became available in 1980:
Graph of satellite, balloon, and climate model temps since 1980
You'll also note how climate model temps don't agree with reality.
'Let's be clear: the work of science has nothing whatever to do with consensus. Consensus is the business of politics. Science, on the contrary, requires only one investigator who happens to be right, which means that he or she has results that are verifiable by reference to the real world. In science consensus is irrelevant. What is relevant is reproducible results.'"
The phrase "One investigator who happens to be right" assumes one would be able to tell who is right and who is wrong immediately as it happens. The consensus is agreeing who got reproducible provable results.
People who do not understand science, who want to game the system are intentionally gaming the system. They bring in rules used in philosophical debates and legal arguments into science. Equal time for both sides works ok in philosophy and in courts. But not in science. Let us say one side has tons and tons of data and the other side is waving hands. Giving equal time to both is doing a great injustice to the side with data.
If one side is just asking questions, raising doubts, etc and the other side is actually answering the questions and clearing the doubts, it is a great injustice to give equal time to both. It takes much longer to answer questions than to raise them.
One should gain standing to raise doubts. Getting funding from industry groups with vested interests is not getting the standing. Must publish in the relevant field, get peer reviewed papers. Must risk reputation gained by hard long work to raise questions.
sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
And as soon as those many many many scientists can repeat and verify that experiment, the consensus very quickly changes to account for the new experiment, and the old consensus vanishes. (Or someone can come up with a counter experiment that shows how the first doesn't apply....) That's how Science advances. "Here's how the current theory works. X, Y, Z.". "Hey, I found a case where Y doesn't happen, if there is a presence of midichlorians (M)." "You're right. Ok, new theory: X, Y (if there are no M), Z.". Doesn't make the first consensus wrong. It was right for all of the available data at the time.
Sure, sure...
Utter nonsense. What's settled is that the climate is changing at the hands of man, what's open to debate is what the impact on us will be in the short and long term. The "consensus" is the same as the "consensus" that supports the modern understanding of evolution - it is a refinement and agreement across the field on the gross mechanism for something, and all the arguments lie in the details.
Kudos for tossing in the pinch of anti-government paranoia, it has to be that and not the desire for massively profitable fossil fuel corporations to defend said profits.
.
Scientific consensus is an group of scientists agreeing on a proven theory or the proof of a theory.
Political consensus is a group of people ganging together to push their opinions on others.
The latter has a negative connotation which Mr. Crichton is using to taint the former.
No, consensus isn't needed for science to progress, but it is an inevitable result of science. A theory comes out, it is tested, peer-reviewed, and people see that it best describes the data. So more and more scientists in that field will accept that theory until something better comes along.
Now, you can be that one guy who says "here is my theory which contradicts prevailing views." This has happened a lot in the past. However, the key point is that those contradicting theories need an extraordinary amount of evidence to prove them. If your radical new theory was that relativity wasn't actually true and you could explain everything with X, then you'd need a TON of reproducible proof to convince your peers that X is true. This is because we have so much evidence that relativity is true that it would take a lot to unseat it.
What you can't do is insist that a theory with broad consensus is wrong because you have a different theory, offer up little to no proof, and demand that those "in the consensus" provide extraordinary proof that they are right.
My sci-fi novel, Ghost Thief, is now available from Amazon.com.
That's what my math prof at the university said after he asked people who thought this or that answer was right (and the majority was wrong): Science is not a democratic process.
Sadly, it has turned into one.
Peer review sadly doesn't mean what it used to mean: That a lot of others who are experts in your field took a look and nodded their heads. What it means to day: A lot of other people in your field of study think likewise.
Scientists are humans, as much as they try to sit on high horses and claim they ain't. They don't like being wrong. They don't like to give someone else the satisfaction of coming up with some paradigm shifting discovery. And most of all they certainly do not want to admit that they wasted their life hunting the rabbit down the wrong hole.
Imagine we'd only discover today that the sun, not earth, is the center of our solar system. You think any of the scientists who invested their whole life perfecting deferent and epicycle calculation would budge to the overwhelming proof that they're wrong?
We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
It is proper English. It is the difference between the active and passive voice. "He was sick, but he got well." "He was sick, but he has gotten well." The difference is actually tangentially related to the story subject. When I was in university [mumble] decades ago, all scientific papers for publication, and by extension all term papers, were required to be written in the third person past passive voice. This was thought to appear more objective. Printing costs for scientific journals drove the change to active voice, because, in English, that voice uses fewer words. Now that journals are largely electronic, printing costs are less of an issue, leaving aside Dilbert's PHB's concern about using up electrons. Active voice may also be more readable, particularly for those being taught by teachers who say things like, "Me and him went to the store."
Some mornings it's hardly worth chewing through the restraints to get out of bed.
I think there is a subtle difference between being right (in the usual sense of providing a model that happens to accurately represent measurable stuff) and the process of scientific discussion. Consensus is just an outcome of a process, ie collaboration. That process is extremely important but does not guarantee being right.
In the end, without resorting to unnecessary complicated terms, if a bunch of people who are supposed to know what they are saying all agree on something that is not immediately testable (say, long-term human impact on the climate), odds are they are more likely to be right than some random wacko or idiot reporter because they spent some time discussing together and have highlighted potential errors.
In the absence of definitive hard data, which will only be available in retrospect, we have to pick sides. Consensus seems a safer bet than the probability that some random guy is the new Galileo or Einstein.
You are misinformed. American English is not English, it's not about the number of speakers, and never will be (you will find that the form of English spoken on the Indian sub-continent outnumbers your "largest group of English speakers" - maybe time to notice the world outside your borders?). English refers to the form of English spoken in England. Yes there are dialects within this, but the fact of the matter is, the originating country gets to set the baseline.
This whole discussion is distorted by the framing around "belief." As long as the result of a scientific inquiry is "belief" it's reasonable (in the "sound reason" sense) to hold the issue open and speculate that Einstein's General Theory (or the current version of Darwin's) might in fact be totally wrong.
But that's where the denialists play word games. They talk about open minds, and how consensus isn't dispositive, etc. and then use that as an argument against teaching evolution in schools or taking steps agains AGW. Or, for that matter, against teaching heliocentrism or plate tectonics.
The "scientific consensus" may not be dispositive in any epistemological sense, but when it comes time to collapse the waveform and make a decision it's certainly the way to bet.
Lacking <sarcasm> tags,
For climate change skeptics are always attacking the science and the scientists. But they never deal with the known facts.
1. CO2 concentration is measurably increasing year on year and accelerating. If you want a running tally have a look here: http://www.esrl.noaa.gov/gmd/ccgg/trends/
This is one of a number of different high quality analytical chemistry studies that all tell the same story. CO2 concentration is increasing significantly.
2. We know this is because of release of fossil fuel sequestered CO2. By careful investigation of the change in carbon isotopic ratios, and by simply accounting for the CO2 released. Human release of CO2 more than enough accounts for the CO2 increase in the atmosphere, and actually shows that a significant proportion is actually getting absorbed into the ocean and other carbon sinks. But clearly no where near all of it.
3. CO2 in the atmosphere traps heat due to the wavelengths of light it does and does not absorb.
This is all hard chemistry measurement, and are known with a high degree of confidence. These are not up for debate!
The only debatable point is what do these facts mean for the climate and the environment going forward. And here we get into prediction and modelling. The best models and predictions shows that the climate will increase in temperature, and that will have significant and mostly detriment effect on most of the worlds environments and sustainability of human populations going forward.
If you are a climate change skeptic scientist, what you have to come up with is a model that sensibly and scientifically shows why this increase in CO2 won't have any significant detrimental effects. Then put it up for publication in peer reviewed journals. And if your scientific argument has any legs it will change the scientific consensus. All the other stuff being thrown around is political motivated bull shit, with no scientific basis and should be simply ignored.
Translation: "I've made my mind up after watching some TV, and evidence can go screw itself".
>"Science requires only one investigator who happens to be right, "
The one investigator publishes a paper, his work is confirmed by many others, he wins the Nobel Prize, and a new consensus is created. This differs from one loud voice who disagrees with the current consensus. For a handy metric for differentiating the two, see John Baez's Crackpot Index.
Some mornings it's hardly worth chewing through the restraints to get out of bed.
True as that may be, people who are absolutely nuts tend to use the perpetual openness of science as an excuse to inject irrelevant, arbitrary insanity into discussions of fact.
You seem to be missing the point of TFA. Science doesn't need you to discuss it - it stands on it's own.
If this were true, we wouldn't have multiple physics/cosmological theories trying to explain observed phenomena or expected attributes on the nature of time and space.
If you have to discuss/debate it you have moved well out of the realm of science and into politics.
Kinda like the time when physicists were divided between those who theorized the Universe to be eternal and immutable vs those who thought of it as having a dynamic nature (expanding/shrinking with a creation starting point)?
Science not only relies on explanations of observations already taken. It also relies on PREDICTIONS (and the theories that proposed them) that are thought to be logical/inevitable based on what is has already been observed. Further experiments take place until these theories are debunked, reaffirmed or revisited. The process by which this takes place is strongly based on debate.
Even mathematical proofs are open to debate. You submit your proof. Peers attack it. If they find a chink in the armor, they send it back to you, and you now have to prove that the error is not fundamental, that your original proof can still be revisited and salvaged.
All politics are discussions. Not all discussions are politics - or are you not familiar with scientific discussions? If discussions have no place in science, then we pretty much close the door in the creation and presentation of scientific theories (which are just discussions and proposals which only become facts when experiments corroborate their predictions.) There is no exception to that and frankly it's disgusting you claim affinity for scientific knowledge and understanding and can't grasp such a basic concept.
Science is not consensus, and therefore my favorite random blog rant is equally credible? Somehow, I just don't see the former point supporting the latter...
I think there is a difference between what scientists mean by a consensus in the scientific community and how it is understood by the wider public.
If a climatologist says "there is a consensus" (s)he hardly means that a bunch of people came together to have a popular vote on the issue. Rather, it suggests that the majority of fellow climatologists have examined some evidence each and found the collection of all that evidence (and their respective analysis) to be conclusive (as far as statistically possible). However, no individual alone can "convince themselves by looking at the evidence" because the evidence consists of more data than anybody could study in a life time. So we have to put a certain degree of trust into our colleagues. An individual only has partial evidence, which by itself is insufficient to come to far-reaching conclusions about global climate developments. These conclusions can only be reached collaboratively -- in this sense it requires a consensus. Fortunately though I don't even have to trust any individual climate scientist or their data, just that there is no conspiracy by the majority. Furthermore, I know that I could examine any evidence if I wanted to, I just can't examine it all because there is simply too much of it. This applies similarly to other large-scale observational endeavours.
However, to a non-scientificially minded person "consensus" might indeed suggest something weaker (people sharing an opinion) and therefore mistrust the conclusions. And then they can't look at the evidence themselves because there is too much data and that data comes from exactly the people whom they mistrust in the first place. So instead they look at the evidence they can see and understand, which explains why acceptance of climate change drops on snowy days.
There wasn't a learned man in Europe who believed the Earth was flat. It may have persisted much longer in China, but in Europe and among Arab geographers, there was no one who seriously believed in the flat Earth. The Greeks had figured that out nearly 2000 years before Columbus ever accidentally ran into the Americas on his way to China.
The world's burning. Moped Jesus spotted on I50. Details at 11.
In a lot of ways, consensus in science is what is lacking in both controversy and ignorance. It is what goes into text books. If a subject is controversial then some people know somethings about it but the details have not been worked out and agreed upon. If a subject has had no study, for example is there DNA under the ice on Europa? Then that is a subject of ignorance and perhaps speculation but not subject to consensus.
So consensus forms on topics that feel like they have pretty much been studied to death. It should be noted though that contrarians may remain active even when a consensus exists. That may look like controversy, but really the contrarian's arguments have all been addressed to everyone's satisfaction except the contrarian's. So, basically, the contrarian is the guy who does not get it. The faster a field moves, the more likely a contrarian will still be professionally active.
http://www.skepticalscience.com/print.php?n=57
The ocean heat content is a better (though delayed) measure of global warming than the atmosphere for the obvious reason it has a larger heat capacity and so 'physically' integrates over many fluctuations.
Scientific consensus is like "you cannot exceed the speed of light." If you happen to demonstrate that you exceeded the speed of light, you want to be careful about how you present it--e.g. "we have this interesting result and can someone help show what we did wrong?"--but the community will take notice if you actually show that the consensus is wrong. The more consensus there is, the better the evidence you need to posit the question, but the community still listens.
"CO2 concentration is measurably increasing year on year and accelerating...this is because of release of fossil fuel sequestered CO...CO2 in the atmosphere traps heat...These are not up for debate...The only debatable point is what do these facts mean for the climate."
Here are some more facts. The atmospheric co2 concentration is increasing by about 2 ppm per year. The world currently produces about 4.9 x 10^13 kg of co2 per year from the combustion of fossil fuels. Therefore, the small total amount of co2 in the earth's atmosphere (atmospheric mass x co2 concentration) means that the earth currently sequesters ALL of the co2 produced by living organisms, decay, natural methane seeps, etc. as well as approximately 80 percent of all of the co2 produced annually from the entire world combustion of coal, oil, and natural gas. Based on all known reserves, there are approximately 75 years remaining of fossil fuels at current consumption rates. What this means is that, even if the natural sequestration rate remains unchanged (it is likely to increase with increasing co2 conc), the atmospheric c02 concentration will not increase more than 150 ppm ultimately reaching a concentration of approximately 550 ppm from the current 400 ppm. Even that increase, however, is unlikely, as rising fossil fuel prices and the diminishing returns of production will mean that global consumption of fossil fuels will decline over the next century as they are replaced by solar, wind power, nuclear power, conservation measures, and increased energy efficiencies. Therefore, rather than reach a maximum of 550 ppm and then decline precipitously as the last chunk of coal is burned, the atmospheric co2 concentration will more likely never reach that number as consumption tapers off and consumption continues at a lower rate of several centuries. What this means to an AGW true believer is that you have to believe that the earth's climate would dramatically warm if the atmospheric concentration of co2 went from the current 400 ppm to 550 (or less) and, there is absolutely no scientific basis for that belief. The atmospheric co2 concentration has increased by approximately 84 ppm since co2 measurements began in 1958 and the earth's climate has not changed dramatically. Even the small amount of warming that we have seen during that time is much more likely to have resulted from increased solar activity and long-term climate effects (we are in the middle of an interglacial warming period) than an increase in atmospheric carbon dioxide concentration. Moreover, there are actually signs of climate cooling as both the arctic and antarctic ice extent have increased in recent years. So, no, 'consensus' is not science.
Yeah, sure. And every time I jump, the Earth moves (a little bit) in the opposite direction. Right... No, what is far from settled, is whether the humanity's impact is anything to speak of — or whether a single volcano's eruption produces more "greenhouse effect gases", than the Earth's entire bovine population and thus there is little justification in limiting beef-consumption on that account.
In other words, what's very far from being "settled" is whether humanity's impact matches that of other factors. Counting CO2 — and making predictions based on that — has already been demonstrated to be stupid. By those predictions, for example, Arctic ice should've disappeared this summer — instead, it has grown.
The profits of fossil fuel corporations are not endangered by the "green" moves at all — the demand for oil and gas is unaffected. Besides, for each such corporation, there is a bunch of solyndras peddling their wares to the "green" crowd — you aren't going to convince many, that it is the corporate world, that opposes "green initiatives".
But for the government folks — those, who are sincerely convinced, they know better than their subjects — this is a perfect way to expand their control. And if the already government-heavy countries (like Cuba) are helping persuade the free world's scientists, then all the better. Let's look the other way...
In Soviet Washington the swamp drains you.
People believe what they want to believe. Humans are fallible and will act in their self-interest. The question are:
(1) Is science and are scientists responsible for "explaining" themselves and their discoveries?
(2) Is the scientific community responsible for calling out charlatans that pose to use the scientific method, but don't?
(3) Are scientific discoveries constantly open for debate? And does it make sense to have proper channels for inquiry and discussion, or can anyone jump in?
Passive voice example should have been, "He has been sick, but he has gotten well."
AAAAArg. This is NOT passive voice!! Does really nobody have the fainstest idea of grammar anymore?
People believe what they want to believe. Humans are fallible and will act in their self-interest.
True, but non sequitur to the nature of scientific debate (true scientific debate, not just "debate").
The question are:
(1) Is science and are scientists responsible for "explaining" themselves and their discoveries?
A) Yes they are responsible for explaining, and B) yes, they do explain themselves. But just because a explanation for a complex thing exists, that does not mean the explanation can be made to simple enough to reach a large untrained audience. Try creating an explanation to Wiles's proof for Fermat's Last Theorem that can reach anyone without any exposition to Algebraic Number Theory.
(2) Is the scientific community responsible for calling out charlatans that pose to use the scientific method, but don't?
Of course.
(3) Are scientific discoveries constantly open for debate?
Most of the time, of course. Just because something is discovered, that does not mean we know the mechanisms that make such a discovery a part of reality. Like, when we discovered that Archaea was a branch of life completely different from Bacteria (and not just a form a Bacteria). Then we have to debate, why are they different, how they came to exist, are they even closely related or separated from each other in a similar degree to which each of them is related or separated from from Eukaryota? Do they have a common ancestor (very likely) or they arose independently and their commonalities are just the result of lateral gene transfer?
Think a simpler question: what is electricity? We more or less have an idea of what it is, but for a very long time after its discovery we didn't quite know.
So, for as long as new discoveries and observations are made that cannot be taken into account from predictions made out of existing theories and discoveries, everything is up to debate by a) qualified people using b) the scientific method in c) a manner that is correct.
And does it make sense to have proper channels for inquiry and discussion, or can anyone jump in?
Of course. The scientific community must have channels to discuss the nature of, say, HIV, by qualified individuals (virologists, health specialists) using methods and observations that are reproducible by other qualified people.
OTH, the scientific community must not have a channel for someone like me (who has no fucking clue how to conduct virology studies) to come and say that HIV doesn't exist and that it is just a flu can be cured by eating peyote while looking at the stars from Stonehenge.