Slashdot Mirror
The Science That's Never Been Cited (nature.com)
An anonymous reader quotes a report from Nature: One widely repeated estimate, reported in a controversial article in Science in 1990, suggests that more than half of all academic articles remain uncited five years after their publication. Scientists genuinely fret about this issue, says Jevin West, an information scientist at the University of Washington in Seattle who studies large-scale patterns in research literature. After all, citations are widely recognized as a standard measure of academic influence: a marker that work not only has been read, but also has proved useful to later studies. Researchers worry that high rates of uncitedness point to a heap of useless or irrelevant research. In reality, uncited research isn't always useless. What's more, there isn't really that much of it, says Vincent Lariviere, an information scientist at the University of Montreal in Canada.
To get a better handle on this dark and forgotten corner of published research, Nature dug into the figures to find out how many papers actually do go uncited (explore the full data set and methods). It is impossible to know for sure, because citation databases are incomplete. But it's clear that, at least for the core group of 12,000 or so journals in the Web of Science -- a large database owned by Clarivate Analytics in Philadelphia, Pennsylvania -- zero-citation papers are much less prevalent than is widely believed. Web of Science records suggest that fewer than 10% of scientific articles are likely to remain uncited. But the true figure is probably even lower, because large numbers of papers that the database records as uncited have actually been cited somewhere by someone. "The new figures [...] suggest that in most disciplines, the proportion of papers attracting zero citations levels off between five and ten year after publication, although the proportion is different in each discipline," the report adds. "Of all biomedical-sciences papers published in 2006, just 4% are uncited today; in chemistry, that number is 8% and in physics, it is closer to 11%. In engineering and technology, the uncitedness rate of the 2006 cohort of Web of Science-indexed papers is 24%, much higher than in the natural sciences."
To get a better handle on this dark and forgotten corner of published research, Nature dug into the figures to find out how many papers actually do go uncited (explore the full data set and methods). It is impossible to know for sure, because citation databases are incomplete. But it's clear that, at least for the core group of 12,000 or so journals in the Web of Science -- a large database owned by Clarivate Analytics in Philadelphia, Pennsylvania -- zero-citation papers are much less prevalent than is widely believed. Web of Science records suggest that fewer than 10% of scientific articles are likely to remain uncited. But the true figure is probably even lower, because large numbers of papers that the database records as uncited have actually been cited somewhere by someone. "The new figures [...] suggest that in most disciplines, the proportion of papers attracting zero citations levels off between five and ten year after publication, although the proportion is different in each discipline," the report adds. "Of all biomedical-sciences papers published in 2006, just 4% are uncited today; in chemistry, that number is 8% and in physics, it is closer to 11%. In engineering and technology, the uncitedness rate of the 2006 cohort of Web of Science-indexed papers is 24%, much higher than in the natural sciences."
One main purpose of citations is to use prior observations and experiments to build the case for a hypothesis that is then tested in the remainder of the paper. The other main purpose is to provide support for portions of the methodology that aren't intuitive. There are other reasons for citations, but these are the main ones.
However, this is frequently abused by reviewers and editors. A comprehensive literature review is often expected at the start of papers, which really isn't necessary to support the hypothesis. Many times this is used by reviewers and editors to insist that their own works be cited and increase the profile of their own papers.
A comprehensive list a review shouldn't be necessary at the start of papers, yet it's frequently expected in the peer review process. Citing prior literature is important, but just to the extent necessary to support the hypothesis that the paper intends to examine.
[citation needed]
I was once the director of a university lab. I would expect completely uncited papers to be rare, perhaps the last in a series of useless papers. Most academics cite their own papers and the papers of a small circle of peers. The citation web has to be full of these self-scratching cliques. The papers that are cited across multiple cliques are the real influencers. These are much less common. Rather than debunking the uncited myth, they should be debunking the myth that cited papers are influential. Most are not.
well... if the research papers weren't in PAYWALLED journals then it would be possible for people to get at them and read them, wouldn't it? *sigh*...
Proof: Suppose, by way of contradiction, that uncited papers exist. Then one could be cited as an example. But then it would be cited, contrary to the assumption that it is not. This is a contradiction. Therefore there are no uncited papers.
I think the problem of uncited papers isn't that big of a deal, it's quite rare and it doesn't necessarily say that the paper was entirely useless (e.g. the industry will often use academic papers but rarely cite them since they do not publish, or do so very rarely).
What I find much more concerning is that modern peer-reviewed journals only care about successful hypotheses. Doing something interesting isn't enough, it also has to be demonstrably better, stronger, faster or something else along those lines. Failure is brushed aside and quickly forgotten, even though having access to all of the failed attempts of thousands of scientists would be an absolute treasure trove.
How many hours, days, weeks of work could be avoided by knowing that someone else has already traveled down your current path and figured out that it wasn't working? How many ideas have been lost due to a minor issue that the original would-be author didn't catch? How much more efficient would our science be if we also documented legitimate failure (as opposed to failure from sloppiness, outright bad ideas, and so on)?
An entirely predictable result from "publish or perish". People publish a lot of irrelevant, marginally incremental and generally boring and worthless papers.
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
My best article has only one citation. I have no idea why this is the case, except maybe because it's a very multidisciplinary work and all the disciplines tackle a complex scientific problem. It's an article difficult to read for one versed only in his/her narrow field of interest.
"The agriculture ministry is not in charge of Gundam" - Japanese ministry official.
Nah. Loathing is way more emotional input than she warrants.
We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
Considering you don't know the difference between "breathe" and "breath" you should probably hold your breath a while longer.
This.
Also classified research papers. They may in fact be cited, but we will never know.
Have gnu, will travel.
the conferences fight this by requiring the author to commit to presenting for themself.
Which breaks when nationalist governments get elected and enact travel policies making presentation in person impractical or impossible.
what percentage of articles contain fallacies or improper experimentation?
No one is going to write about how a paper reporting a negative result spared them from hours of wasted time.
I disagree with this. The right place to cite a negative result, as I see it, is at the end of the literature review, just before the methodology. This way, the cited negative result helps to justify the choice of one methodology over another seen not to work.
Not-Invented-Here is a major cultural component in engineering.
Citations only mean given research was used in further scientific research. But researchers aren't the only people who read this stuff. Engineers do to - and they don't publish articles, they make projects - they directly utilize results to create useful real-world creations. Never-ending tables of material properties, new chemical processes, new methods of simulation and analysis for implementation in software, this all comes from white papers. Engineers do a lot of own research, and use a lot of methods that are long-established, but often they just look for "new&better" in the scientific publications. And the source may find its way into the project, but it's unlikely to show up in the final product.
45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2