Slashdot Mirror


The Science That's Never Been Cited (nature.com)

An anonymous reader quotes a report from Nature: One widely repeated estimate, reported in a controversial article in Science in 1990, suggests that more than half of all academic articles remain uncited five years after their publication. Scientists genuinely fret about this issue, says Jevin West, an information scientist at the University of Washington in Seattle who studies large-scale patterns in research literature. After all, citations are widely recognized as a standard measure of academic influence: a marker that work not only has been read, but also has proved useful to later studies. Researchers worry that high rates of uncitedness point to a heap of useless or irrelevant research. In reality, uncited research isn't always useless. What's more, there isn't really that much of it, says Vincent Lariviere, an information scientist at the University of Montreal in Canada.

To get a better handle on this dark and forgotten corner of published research, Nature dug into the figures to find out how many papers actually do go uncited (explore the full data set and methods). It is impossible to know for sure, because citation databases are incomplete. But it's clear that, at least for the core group of 12,000 or so journals in the Web of Science -- a large database owned by Clarivate Analytics in Philadelphia, Pennsylvania -- zero-citation papers are much less prevalent than is widely believed. Web of Science records suggest that fewer than 10% of scientific articles are likely to remain uncited. But the true figure is probably even lower, because large numbers of papers that the database records as uncited have actually been cited somewhere by someone.
"The new figures [...] suggest that in most disciplines, the proportion of papers attracting zero citations levels off between five and ten year after publication, although the proportion is different in each discipline," the report adds. "Of all biomedical-sciences papers published in 2006, just 4% are uncited today; in chemistry, that number is 8% and in physics, it is closer to 11%. In engineering and technology, the uncitedness rate of the 2006 cohort of Web of Science-indexed papers is 24%, much higher than in the natural sciences."

91 comments

  1. Citations are abused by Anonymous Coward · · Score: 5, Interesting

    One main purpose of citations is to use prior observations and experiments to build the case for a hypothesis that is then tested in the remainder of the paper. The other main purpose is to provide support for portions of the methodology that aren't intuitive. There are other reasons for citations, but these are the main ones.

    However, this is frequently abused by reviewers and editors. A comprehensive literature review is often expected at the start of papers, which really isn't necessary to support the hypothesis. Many times this is used by reviewers and editors to insist that their own works be cited and increase the profile of their own papers.

    A comprehensive list a review shouldn't be necessary at the start of papers, yet it's frequently expected in the peer review process. Citing prior literature is important, but just to the extent necessary to support the hypothesis that the paper intends to examine.

    1. Re:Citations are abused by Antique+Geekmeister · · Score: 2

      I'm afraid it's worse. Certain classes of paper, such as those which do meta-analyses of other papers, cite them in doing statistical analyses of those papers. The result is a churn of analyses of analyses, with no actual experimentation or analysis other than statistical analysis of the other papers. It's no longer science because the underlying hypotheses are not falsifiable.

      I'm afraid that the result has been stunning skew in the results of the meta-analysis by tuning the analysis to the pre-disposed desires of the analyst. It's most visible in the publications of the "soft" sciences, such as political analysis, sociology, and economics, where direct evidence is very difficult to measure and direct experiments diffult to perform in a controlled or double blind method.

    2. Re:Citations are abused by slew · · Score: 2

      I wonder how the citation numbers would change if you subtract the citations with authors citing their earlier works and work of others in their own research groups...

      Actually the numbers for Engineering don't surprise me. Many of the IEEE journals I read are seemly are filled with reams of research that do not appear to be cite worthy (too specific and/or you are left wondering how it got past peer review)... ACM journals are a bit better (by a little). Often it appears that the lead-time to appear in some journals is working against getting cited (in some fast moving tech fields, a year later a paper can be obsolete) meaning high-profile conference papers get inordinate attention whilst others toil in obscurity until their are obsolete...

    3. Re: Citations are abused by Anonymous Coward · · Score: 0

      shut up nerd, itâ(TM)s swirly time

    4. Re: Citations are abused by Anonymous Coward · · Score: 1

      Most of the time, a researcher or their group will publish multiple papers that are related. That's because they're funded by the same grant or a follow-up grant from the original. When you publish a paper in a journal, you sign over the copyright to your work. Using your previously published work is then considered plagiarism. If you need to use the prior work in a new paper, the only option is to cite yourself or whoever in your group published that paper. It's a consequence of how journals and copyrights work. I suspect most people who cite themselves aren't really doing it to inflate their citations but because they have to do so.

    5. Re:Citations are abused by ShanghaiBill · · Score: 1

      I wonder how the citation numbers would change if you subtract the citations with authors citing their earlier works and work of others in their own research groups...

      You also need to subtract "cycles": I cite your papers, you cite mine. Sometimes citation cycles have 3 or more participants: A cites B, B cites C, C cites A.

    6. Re: Citations are abused by slew · · Score: 1

      Most of the time, a researcher or their group will publish multiple papers that are related. That's because they're funded by the same grant or a follow-up grant from the original. When you publish a paper in a journal, you sign over the copyright to your work. Using your previously published work is then considered plagiarism. If you need to use the prior work in a new paper, the only option is to cite yourself or whoever in your group published that paper. It's a consequence of how journals and copyrights work. I suspect most people who cite themselves aren't really doing it to inflate their citations but because they have to do so.

      Well, if the author (or others in their research group) are citing the paper, I'd argue whether it is "necessary" or not, they are effectively inflating their citations. One might also rightly argue that if these are the *only* citations of their research, that their research effectively falls into the uncited category since their "necessary"
      citations pushes their number above zero (which was the point I was trying to make).

    7. Re: Citations are abused by Anonymous Coward · · Score: 0

      I understand and actually agree with the point you're making. Researchers often benefit from publishing a few less impactful papers in lower profile journals instead of having fewer papers but more impactful and in higher profile journals. Publication count seems to be helpful than publication quality in obtaining grants, getting tenure, and getting promoted after becoming tenured. Another issue related to inflating publication counts is predatory open access journals. While they claim to be peer reviewed, often there is little or no peer review. As long as you're willing to pay the money, they'll publish just about anything that appears to be within the scope of the journal. It would be interesting to see if those journals are counted, because I can't imagine many of those papers merit being cited anywhere.

    8. Re:Citations are abused by Kjella · · Score: 1

      A comprehensive list a review shouldn't be necessary at the start of papers, yet it's frequently expected in the peer review process. Citing prior literature is important, but just to the extent necessary to support the hypothesis that the paper intends to examine.

      I think "support" is too narrow, very often you want to cite papers that are "sideways" to your own and explain how your research is different from theirs, like for example how it's not fully applicable, limitations of the model, choice of methodology, data quality issues and so on. I think it's also important to remember that citations was science's way of linking things together before you had hyperlinks and search engines, it's what set your research in context with other work in the field. It should be fairly relevant to what you're doing though, not just list everything marginally related.

      --
      Live today, because you never know what tomorrow brings
    9. Re: Citations are abused by Anonymous Coward · · Score: 0

      Review is normally anonymous, so it's hard to cite the papers of your reviewers. Yes, I have reviewed papers, and objectively. I've also had my own rejected for weak objections, but not related to citations.

      There are papers, though, in subject areas, that you are pretty much expected to cite, to show you have credibility in the area, even if it isn't really necessary for understanding the paper. Those tend to get cited in the first couple of paragraphs, and perhaps those should count as half citations.

    10. Re:Citations are abused by Shadow+of+Eternity · · Score: 4, Interesting

      You have no idea how bad this has gotten in the social sciences. These days even the most trivial MA coursework level paper is expected to have upwards of 50 citations and be several thousand words long. The only real place you have to pad your work out to meet the ever more obscene wordcount and citation requirements is your lit review, which has resulted in pretty much every single MA candidate cranking out multi-thousand word multi-decade lit reviews as a critical part of every single paper they write.

      Something I noticed while completing my own MA was that the further back I went the shorter papers and bibliographies got, to the point the original paper that first discovered the "Democratic Peace Theory" was a mere handful of pages and had somewhere around 12 citations. For all people talk of grade inflation my experience has been the opposite, almost no professor at a university today would be able to pass their own program or classes using their own work from when they originally got their graduate degrees. It's not grades that are inflating, it's expectations.

      It's the bastard spawn of the tenure-journal-complex and the modern idea that we can quantify and over-manage every little thing by just making numbers go up or down.

      --
      A bullet may have your name on it but splash damage is addressed "To whom it may concern."
    11. Re: Citations are abused by Anonymous Coward · · Score: 0

      There are significant moves towards considering journal quality when determining citation metrics to measure researcher performance. It is tricky to create meaningful metrics, though. For example, if you are involved in lighting design to help the partially sighted you are unlikely to get a paper in Nature, even if it's the best paper in the area for a decade, but it might go in Building Design Letters. So how do you rate the researcher? Do you give BDL a low quality metric, but rate the researchers against peers? Who decides that BDL has a low quality metric, and how low? And how do you deal with the potential for change in perceived journal metrics over time?

      Relative journal quality metrics matter, as if two researchers are competing for a post then a slight difference in the perceived ratings may alter who gets the post. On a wider scale, governments funding their students going overseas may require a certain average quality of research for a potential alma mater for their students, in which case targeting publication can be critical to getting those students.

    12. Re: Citations are abused by Anonymous Coward · · Score: 0

      Sometimes cycles are entirely reasonable for people working in the same area who are building on each other's work, and likely know each other and discuss things outside publication. It potentially has an overall benefit to society as research is progressed more quickly. That sort of collaboration should be encouraged.

      It can also be tackled with direct collaboration, on a single grant, but the administrative overheads can be annoying, even to the level of submitting expense forms to a different university which will only cover $15 a day for meals, thus won't honour the $18 you spent, when your own university's spending limit is $20. If one person isn't pulling their weight, and they are at a different location, then getting their supervisor to deal with it may be more complex . It can also work well, and tends to increases chances of funding. It works best in the context of decent institutional support for researchers.

    13. Re:Citations are abused by Anonymous Coward · · Score: 1

      These days even the most trivial MA coursework level paper is expected to have upwards of 50 citations and be several thousand words long.

      How is that bad? I have presented undergrad information theory papers that are 13k words and 45 citations just for midterm projects. The publishable novel bits take 4k and 30 citations.

      This is typical and necessary to explain without plagiarism.

      Something I noticed while completing my own MA was that the further back I went the shorter papers and bibliographies got, to the point the original paper that first discovered the "Democratic Peace Theory" was a mere handful of pages and had somewhere around 12 citations. For all people talk of grade inflation my experience has been the opposite, almost no professor at a university today would be able to pass their own program or classes using their own work from when they originally got their graduate degrees. It's not grades that are inflating, it's expectations.

      This is terribly true. It's really bad in technical classes where professors with PhDs need to be brought up to speed by the students on what they are teaching on top of setting up the lab and doing the work without any assistance from the professor and no fewer expectations. It's this absurd inversion where people are paying to do work and learning on their own instead of learning from their classes.

    14. Re:Citations are abused by Uecker · · Score: 3, Insightful

      Huh? There is nothing fundamentally wrong with meta analysis. I do not understand why you think "it's no longer science because the underlying hypotheses are not falsifiable". Most meta-analysis papers I have seen are about hypotheses which are falsifiable.

    15. Re: Citations are abused by Anonymous Coward · · Score: 0

      13k words is either something you worked on for a decade and never wrote about before (which is bad enough) or you are really horrible at explaining and getting to the core, and then you are just wasting everyone's time.

    16. Re: Citations are abused by Anonymous Coward · · Score: 1

      WTF? Plagiarism is not about copyright, it is about authorship or inventorship. And those can't be sold away.

    17. Re:Citations are abused by mindwhip · · Score: 1

      Maybe someone needs to write a paper with an statistical analysis on how the length of the lit review relates to the usefulness and citability of a paper...

      --
      [The Universe] has gone offline.
    18. Re:Citations are abused by Anonymous Coward · · Score: 0

      The only real place you have to pad your work out to meet the ever more obscene wordcount and citation requirements is your lit review, which has resulted in pretty much every single MA candidate cranking out multi-thousand word multi-decade lit reviews as a critical part of every single paper they write.

      Something I noticed while completing my own MA was that the further back I went the shorter papers and bibliographies got, to the point the original paper that first discovered the "Democratic Peace Theory" was a mere handful of pages and had somewhere around 12 citations.

      So you're saying that as you progressed in your education, the expectations your instructors had for you were increasingly complicated, and required more introduction in the form of a longer literature review?

      That sounds like a well-structured curriculum to me! Kudos to your faculty.

    19. Re: Citations are abused by dj245 · · Score: 1

      Most papers in my industry fall along the lines of âoeWe tested our proprietary weld filler / spray-on coating against some others, and ours is superior for this limited and specific applicationâ. These are more for marketing than scientific advancement, and are not useful for citing (especially if you are a competitor playing the same game!)

      There are entities in my field that are âoeindependentâ and arenâ(TM)t in the business of actually using the product. Their papers tend to be more useful for citing, but they are also usually behind their own âoegive me a bunch of money for access to our papersâ paywall and are not published widely and usually donâ(TM)t have DOI records. Maybe this is typical for âoethe real worldâ once you get outside of the acedemia bubble.

      --
      Even those who arrange and design shrubberies are under considerable economic stress at this period in history.
    20. Re: Citations are abused by Hognoxious · · Score: 1

      I thought the same; the former's an academic infraction (can get your degree torn up) and the latter is a civil matter (can cost many dollarpounds).

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    21. Re: Citations are abused by Anonymous Coward · · Score: 0

      Scientific papers intend to prove one point. Theory or implementation papers intend to handle many points in a specific context. Thoroughly describing the context can take many thousands of words.

      Academia is no place for those that have tweet sized thoughts.

    22. Re: Citations are abused by Anonymous Coward · · Score: 0

      Quite the contrary I'm afraid. The metaanalysis is done in search of a p value and then the hypothesis is crafted.

    23. Re:Citations are abused by Antique+Geekmeister · · Score: 1

      There are several common difficulties with meta analysis. Political or social whims can, and do, profoundly skew the data. So do commonplace procedural errors in the experiments that are being analyzed. So does the tendency of analyzers to discount outlying cases that may contradict the expected outcome as "obvious errors", even excluding them from mention in their meta-analyses.

      I'm afraid that meta analysis is a tool that can be and often is misused to confuse correlation with causation.

    24. Re: Citations are abused by Antique+Geekmeister · · Score: 1

      I'm afraid this is precisely backwards. The analysts explore the data with a hypothesis in mind. Discovering that your hypothesis is mistaken can lead to a paper, but leads to a much less _publishable_ paper. They and especially students involved have strong motivations to skew their findings, and I'm afraid that it is a matter of course that legitimate analysts try to remain aware of. It's a problem in all fields, but the purely mathematical analysis makes testing the hypothesis more difficult.

    25. Re:Citations are abused by RespekMyAthorati · · Score: 1

      It's most visible in the publications of the "fake" sciences, such as political analysis, sociology, and economics

      FTFY.

    26. Re:Citations are abused by Shadow+of+Eternity · · Score: 1

      I can do it with two words: "Inverse Correlation".

      --
      A bullet may have your name on it but splash damage is addressed "To whom it may concern."
    27. Re:Citations are abused by lars_stefan_axelsson · · Score: 1

      A comprehensive list a review shouldn't be necessary at the start of papers, yet it's frequently expected in the peer review process. Citing prior literature is important, but just to the extent necessary to support the hypothesis that the paper intends to examine.

      Nope. It's an important part of academic research. It serves multiple purposes. It puts the work in perspective for the reader, that isn't necessarily up to speed on that particular area. It demonstrates that you've done your homework when you claim that this work is new and an improvement on previous work (that's why its called "previous work"), and it helps to put your work in perspective; i.e. is it a major step, or a small incremental one. None of these are strictly necessary to "support your hypothesis", that's much too narrow.

      That's why its academia and not just engineering, for example. We don't just want to know that you did something or learned something new about the world. We want to also know how it fits into the bigger picture, and that's where presenting what has gone before and how compares is necessary.

      --
      Stefan Axelsson
  2. Ob by Anonymous Coward · · Score: 5, Funny

    Researchers worry that high rates of uncitedness point to a heap of useless or irrelevant research.

    [citation needed]

  3. Trump must go to prison for obstruction. by Anonymous Coward · · Score: 0

    That's the bottom line.

    1. Re: Trump must go to prison for obstruction. by Anonymous Coward · · Score: 0

      Aww don't worry, Jared is going to be there too so you can suck his dick in prison douchey republican traitor faggot comrade!

  4. Paywalled Science not cited! by Anonymous Coward · · Score: 0

    WOW! Who would have thought! Such insight. Much surprise.

    1. Re:Paywalled Science not cited! by PPH · · Score: 1

      This.

      Also classified research papers. They may in fact be cited, but we will never know.

      --
      Have gnu, will travel.
  5. Something u can cite by Anonymous Coward · · Score: 0

    is sucking upon my DAMN balls

  6. Citation cliques shouldn't be counted by laughingskeptic · · Score: 5, Interesting

    I was once the director of a university lab. I would expect completely uncited papers to be rare, perhaps the last in a series of useless papers. Most academics cite their own papers and the papers of a small circle of peers. The citation web has to be full of these self-scratching cliques. The papers that are cited across multiple cliques are the real influencers. These are much less common. Rather than debunking the uncited myth, they should be debunking the myth that cited papers are influential. Most are not.

    1. Re: Citation cliques shouldn't be counted by Anonymous Coward · · Score: 1

      As I posted elsewhere, you often have to cite yourself. It's reasonable that you need to refer to prior work when building upon it. When you publish a paper, you're signing over the copyright to that journal. If you simply go and reuse that, it's considered plagiarism. For that reason, if you need to reference work you've published previously, you have to cite yourself.

    2. Re:Citation cliques shouldn't be counted by Brett+Buck · · Score: 4, Insightful

      It's perfectly clear why this is. You *have* to publish something, whether it has wider merit or not. So you end up with a large number of probably correct and probably original paper, that nonetheless don't advance the state of the art and don't get any cites. There's a very strong disincentive to wait until you have something genuinely unique and innovative.

    3. Re: Citation cliques shouldn't be counted by Anonymous Coward · · Score: 1

      You obviously don't know how peer reviewed journals work. If you don't sign over your copyright, you won't get published. If you don't publish your results, you're not going to be able to get more grants, and that certainly won't help you advance in academia.

    4. Re:Citation cliques shouldn't be counted by Anonymous Coward · · Score: 4, Interesting

      Except the modern academic is, in many ways, rated on the number of publications. So rather than wait until a new paper, with some result that is unique and innovative, is written, you get a long series of papers.
      Here's a paper describing my idea. Here's a paper (citing the first) describing a hypothesis that might validate my idea. Here's a paper (citing the second) that describes an experiment that would test the hypothesis. Here's a paper...

      And then if you don't get the result you wanted (and you don't p-hack to get it) you can write a paper describing what went wrong, and restart the cycle again.

    5. Re:Citation cliques shouldn't be counted by Anonymous Coward · · Score: 1

      You have to realize you are in some niche of science and can't speak for the whole. For me, I'm not really in "science" but engineering. Most of my papers are read by folks in industry, not in academia, and as a consequence my citation scores are quite low. However as an engineer I don't care since this isn't a metric I am judged by. Some very important papers go uncited and unnoticed for years before their relevance is observed. For example, read this article: https://www.scientificamerican...

      I have also worked in materials science where it seems anything even tangentially related is given a citation just to boost the circle jerk citation ring of science [2][3][15][45]

      As another poster mentioned, citations are a rather simple and poor metric. It's a shame more papers aren't published with negative results, in line with the
      "scientific method". From my experience it's the "tenure method".

    6. Re: Citation cliques shouldn't be counted by Anonymous Coward · · Score: 0

      Similar things happen when reviewing funding proposals. Many proposal solicitations place limits on the length of project descriptions but exclude references from the limit. The reason is that some reviewers will check the references to see how often they are cited in the proposal, and allow that to influence their decision. The result is often citing as many papers as possible in proposals to please as many potential reviewers as possible. It's a total waste of time in proposal development and distracts from the goal of evaluating proposals on their merit. Unfortunately, my understanding is that this isn't uncommon at all.

    7. Re:Citation cliques shouldn't be counted by joe_frisch · · Score: 1

      Conferences have a similar problem. Most labs require attendees to present something. So if you want to go to a conference you need to put together something to show - even if you know it isn't very interesting.

      Its a classic problem of using the wrong metric of success.

    8. Re:Citation cliques shouldn't be counted by Anonymous Coward · · Score: 0

      "It's a shame more papers aren't published with negative results, in line with the "scientific method"."
      Thanks, that needed to be said. Over four decades, my Name is on exactly two papers, and I've been acknowledged in three others. Yet, in a somewhat humiliating circumstance, I was once still acknowledged for my contributions to Spectroscopy. I hated giving that speech, yet the Cake afterwards was quite good.
      Published Papers aren't even the tip of the Iceberg of Scientific Correspondence. Those shallow "publish or perish" types are those types that merely need to be gotten around. The more likely that they herald this concept, the more likely that they don't have a damn thing original to contribute. So they become the Gatekeepers; the Administrators. The Publishers.

      Very early on, I got taken under the wing of the right sort; not the wing of the Robert Oppenheimers, but that of his brother Frank. With Frank, the Work itself was important. His own Work was proscribed, yet the Optics that he and Alvarez developed six decades back, that of Wave Function Optics, is just now being investigated in the very National Labs that they developed. Their Maths... their Maths are just beastly. They throw out four centuries of Classical Optics, in favour of a Quantum Physical approach. This approach is just now essential to the studies of Plasma Optics. My own minor contribution to this was a debunking of Very High Pressure Paschen Discharges. For want of a better word: Lightning. The Collective Charge Flow Model is wrong, because it doesn't take into account the Coulomb Repulsion between any number of...
      (That Paper never even made it to the Preprint Stage. It was, after all, Pre-PrePrint Physics Gossip.)

      I may be considered lucky in a way. I was never required to Publish or Perish. Which meant of course, I was given craploads of impartial Peer Reviewing.
      Conzett in Polarized Fields and Harvey in Fine Line Spectroscopy, in their dotage, were enormous helps here. Bernie Harvey, between Full Width Half Maximums, told me often of his treasured Honeymoon in the South of France, where with his Bride, and his Nikon Camera, he first worked out by hand the High Resolution Optics needed for Conzett's Polarized Ion Spectroscopy. Bernie was absolutely tickled when I showed him how to put his old Matrices into Excel 2.3 Spreadsheets, some three decades later. (The early Microsoft Excels were even better than the Visicalcs that they were stolen from.) So now
      So now
      So now is December 16, 2017. Frank and Luis, and Bernie and Stretch, and Glen and Al and Mike, are all now long gone... ...and I am not far behind.

      Captcha: unionize
      Dammit Slashdot; this IP specific personalization of your Corporate Masters is getting out of control.
      unionize.

      Fuck yeah.

    9. Re:Citation cliques shouldn't be counted by Uecker · · Score: 1

      I don't agree with the sentiment that only genuinely unique and innovative things should be published. Science is incremental and also less important reports are useful for a various number of reasons. For example. - as many have pointed out - reporting even about unsuccessful or failed experiments is useful. Publishing intermediate results also helps preventing duplicate work or provides technical details helpful to others. For a scientist the primarily output to society are the publications. A scientist who does not publish is wasting tax-payer money.

    10. Re: Citation cliques shouldn't be counted by mapkinase · · Score: 1

      Yes. Has been in the field for 30 years. Yes.

      --
      I do not believe in karma. "Funny"=-6. Do good and forbid evil. Yours, Oft-Offtopic Flamebaiting Troll.
    11. Re:Citation cliques shouldn't be counted by Anonymous Coward · · Score: 0

      That is exactly correct. Of course I did not look at the "study," but I would be surprised if they did any real clique analysis.

  7. paywalled by lkcl · · Score: 2

    well... if the research papers weren't in PAYWALLED journals then it would be possible for people to get at them and read them, wouldn't it? *sigh*...

    1. Re:paywalled by tepples · · Score: 1

      The featured article covers that, though briefly:

      (It’s possible that a drive to make articles open-access is also helping.)

    2. Re:paywalled by Agripa · · Score: 1

      well... if the research papers weren't in PAYWALLED journals then it would be possible for people to get at them and read them, wouldn't it? *sigh*...

      This happens all the time with me. I either follow citations to papers which are unavailable due to being locked behind an exclusive paywall (or for other reasons are just unavailable) or exclude paywalled citations in my own articles in favor of ones which are at least nominally available through other means. Sometimes this results in me reinventing the wheel so to speak but that is the way it goes.

      If the authors of those papers wanted them cited, then they would have made them more easily available. My conclusion is that they and the people who hold the copyright on those papers do not *want* them to be cited and I am happy to oblige them. Let them cite among themselves.

    3. Re:paywalled by Anonymous Coward · · Score: 0

      That's not usually a problem for people who are writing papers, because their institutions generally have a subscription.

  8. There are no uncited papers by Anonymous Coward · · Score: 1

    Proof: Suppose, by way of contradiction, that uncited papers exist. Then one could be cited as an example. But then it would be cited, contrary to the assumption that it is not. This is a contradiction. Therefore there are no uncited papers.

    1. Re:There are no uncited papers by vux984 · · Score: 1

      Nice try. Here's an equivalent formulation...

      Proof: Suppose, by way of contradiction, that untouched gummybears exist. The one could be picked up as an example. But then it would have been touched, contrary to the assumption that it is not. This is a contradiction. Therefore there are no untouched gummybears.

      The problem with the proof? There is no contradiction. It was untouched. Then we touched it. That is not a contraction, that is a state change. For it to be a contradiction it needs to remain untouched even after we touched it.

    2. Re:There are no uncited papers by angel'o'sphere · · Score: 1

      But ... but ...
      I did not touch your gummybear! I swear!

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
    3. Re:There are no uncited papers by Opportunist · · Score: 2

      Oh my god, I feel another #metoo coming...

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    4. Re:There are no uncited papers by SirGarlon · · Score: 1

      For it to be a contradiction it needs to remain untouched even after we touched it.

      Schrodinger's gummybear?

      --
      [Sir Garlon] is the marvellest knight that is now living, for he destroyeth many good knights, for he goeth invisible.
  9. More worrisome is science that isn't published by Nemyst · · Score: 5, Insightful

    I think the problem of uncited papers isn't that big of a deal, it's quite rare and it doesn't necessarily say that the paper was entirely useless (e.g. the industry will often use academic papers but rarely cite them since they do not publish, or do so very rarely).

    What I find much more concerning is that modern peer-reviewed journals only care about successful hypotheses. Doing something interesting isn't enough, it also has to be demonstrably better, stronger, faster or something else along those lines. Failure is brushed aside and quickly forgotten, even though having access to all of the failed attempts of thousands of scientists would be an absolute treasure trove.

    How many hours, days, weeks of work could be avoided by knowing that someone else has already traveled down your current path and figured out that it wasn't working? How many ideas have been lost due to a minor issue that the original would-be author didn't catch? How much more efficient would our science be if we also documented legitimate failure (as opposed to failure from sloppiness, outright bad ideas, and so on)?

    1. Re:More worrisome is science that isn't published by gweihir · · Score: 1

      Indeed. That is an utter fail. Well founded and reasoned negative results are immensely important. At the same time, they are almost impossible to publish. This is damaging science as a whole to a large degree, because everybody has to repeat the failures.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    2. Re:More worrisome is science that isn't published by Anonymous Coward · · Score: 0

      The reason negative results are not published is because journals care about impact factors. No one is going to write about how a paper reporting a negative result spared them from hours of wasted time. So, you'll have to persuade universities to stop caring about high-impact publications. Of course, that helps them obtain grant funding, so I guess you'll have to persuade funding agencies to stop giving money to super-star researchers. Of course, funding agencies fear to give money to support crap research, so I guess you'll have to persuade the public in general that fundamental research has intrinsic value. Of course, that doesn't provide immediate gratification, so I guess you'll have to educate the whole world to solve that problem. I wish you the best of luck!

    3. Re: More worrisome is science that isn't published by mapkinase · · Score: 1

      Try to publish a paper disproving someone else's hypothesis. I have two of that kind - both were largely dismissed, despite one of them being in a prominent journal.

      --
      I do not believe in karma. "Funny"=-6. Do good and forbid evil. Yours, Oft-Offtopic Flamebaiting Troll.
    4. Re:More worrisome is science that isn't published by bn-7bc · · Score: 1

      I am tempted to bring up the Michelson–Morley experiment as an example ,maybe the definitive example, of a negative result beeing very importatnt.

    5. Re:More worrisome is science that isn't published by gweihir · · Score: 1

      Indeed. These are utterly perverted incentives.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    6. Re:More worrisome is science that isn't published by gweihir · · Score: 1

      At that time, publications were judged on importance and soundness. Not this "all must be positive" bullshit that currently rules scientific publication.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  10. Hate me... by Nexion · · Score: 0

    There are a mass of peeps who loathe me from the bottom of their hearts, but how can you look at the failure of of modern "science" and not see the fact that science has been replaced by conjecture on its best day.

    Your honesty has been eclipsed by bias. The absolute enemy of science. I hope that this dark age of science turns into a new re-invigoration of honesty, but while I hold my breathe I watch, with you, as the world fails around me.

    When do we move forward demanding honesty and integrity?

    When do we usher in a new era?

    1. Re:Hate me... by Anonymous Coward · · Score: 0

      There are a mass of peeps who loathe me from the bottom of their hearts, but how can you look at the failure of of modern "science" and not see the fact that science has been replaced by conjecture on its best day.

      Interesting conjecture. Have you any scientific proof?

      Your honesty has been eclipsed by bias. The absolute enemy of science. I hope that this dark age of science turns into a new re-invigoration of honesty, but while I hold my breathe I watch, with you, as the world fails around me.

      We all need something to lean on and something to hope for. Honestly. But don't hold your breath.

      When do we move forward demanding honesty and integrity?

      I'm counting on the next presidential election.

      When do we usher in a new era?

      Duh!...When this one ends...and you call yourself a scientist!

    2. Re: Hate me... by Anonymous Coward · · Score: 0

      There are a mass of peeps who loathe me from the bottom of their hearts, but how can you look at the failure of of modern "science" and not see the fact that science has been replaced by conjecture on its best day.

      Citation needed!

    3. Re:Hate me... by Anonymous Coward · · Score: 0

      There are a mass of peeps who loathe me from the bottom of their hearts...

      Hillary?

    4. Re:Hate me... by Opportunist · · Score: 1

      Nah. Loathing is way more emotional input than she warrants.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    5. Re:Hate me... by 110010001000 · · Score: 1

      Considering you don't know the difference between "breathe" and "breath" you should probably hold your breath a while longer.

  11. Most papers are just not very good by gweihir · · Score: 2

    An entirely predictable result from "publish or perish". People publish a lot of irrelevant, marginally incremental and generally boring and worthless papers.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  12. Today's science is random by blind+biker · · Score: 1

    My best article has only one citation. I have no idea why this is the case, except maybe because it's a very multidisciplinary work and all the disciplines tackle a complex scientific problem. It's an article difficult to read for one versed only in his/her narrow field of interest.

    --
    "The agriculture ministry is not in charge of Gundam" - Japanese ministry official.
    1. Re:Today's science is random by Anonymous Coward · · Score: 0

      Strange, a multidisciplinary article usually attracts more citations in my experience, since people from different fields will cite it. Of course if the different fields are quite niche and specialized, it can take much longer for the citations to appear, even for a very good work.

      Several seminal papers in telecommunications were not noticed for more than a decade, attracting zero to only a few citations before getting cited by thousands...

  13. Re: Citations are shit, Journals are shit by Anonymous Coward · · Score: 0

    Itâ(TM)s laughable you guys even consider these shit science.

    Most papers are just like someoneâ(TM)s shitty school project. 90% of it is written by people who make up stuff.

    Donâ(TM)t trust shitty papers unless itâ(TM)s been proven repeatedly. Citation of purely theoretical unproven papers should be made illegal.

    Most journals are just shit.

  14. required presentation by Anonymous Coward · · Score: 0

    This - in the frenzy to eliminate "boondoggles" and "junkets", many government agencies have put strict, strict limits on what conferences can be attended, particularly if foreign travel is involved. You have to be presenting a paper. Or multiple papers - the latest thing is to send one person, who presents multiple papers from others - the conferences fight this by requiring the author to commit to presenting for themself.

    And in the worst cases, the "shared presenter" is a manager who is sufficiently high up in the hierarchy that all of the work in the papers being presented is under their purview.

  15. Re: Citations are shit, Journals are shit by Anonymous Coward · · Score: 0

    When is it considered proven? How would you do research without plagiarism if you cannot cite anything not totally proven? Could you cite global warming related research?

  16. Sturgeon's Law? by Anonymous Coward · · Score: 0

    "90 percent of everything is crap." - Theodore Sturgeon

    Why would anyone expect scientific papers to be excluded from that?

  17. Can you say Eminem. by Anonymous Coward · · Score: 0

    Jul 19, 2011 Â Eminem continues: You just have to figure out the science to breaking down words. Eminem says that he thinks about word rhymes throughout the day ...

    http://www.game-changer.net/2011/07/19/how-to-be-creative-like-eminem/amp/

    What an idiot!

  18. Visa denial by tepples · · Score: 2

    the conferences fight this by requiring the author to commit to presenting for themself.

    Which breaks when nationalist governments get elected and enact travel policies making presentation in person impractical or impossible.

  19. could be a good thing by iggymanz · · Score: 1

    what percentage of articles contain fallacies or improper experimentation?

  20. Cite negative results just before methodology by tepples · · Score: 2

    No one is going to write about how a paper reporting a negative result spared them from hours of wasted time.

    I disagree with this. The right place to cite a negative result, as I see it, is at the end of the literature review, just before the methodology. This way, the cited negative result helps to justify the choice of one methodology over another seen not to work.

    1. Re:Cite negative results just before methodology by Anonymous Coward · · Score: 0

      How do you cite the negative study, when it doesn't get published in the first place?

    2. Re:Cite negative results just before methodology by tepples · · Score: 1

      Define "published". Is distribution to the public through non-peer-reviewed channels such as arXiv considered "publication"? 17 USC 101 says yes.

      In any case, a culture of citing negative results, even if said results are not peer-reviewed, would increase the measurable impact of negative results. This would in turn encourage authors to put more effort into "Don't Bother With This" articles showing significant negative results and journals to start accepting them more often to get their impact factors up.

    3. Re:Cite negative results just before methodology by gweihir · · Score: 1

      While I agree, this has the limit that you also need some positive results. How do you publish an important negative result when you have nothing else?

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    4. Re:Cite negative results just before methodology by tepples · · Score: 1

      Would multiple related negative results become a "publishable unit"? Pitch it as the scholarly counterpart to a listicle: "Three techniques for XYZ that failed".

    5. Re:Cite negative results just before methodology by gweihir · · Score: 1

      You may be able to sell that as a "survey" paper, but it would probably still be difficult to get it published.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    6. Re:Cite negative results just before methodology by tepples · · Score: 1

      It depends on how you define "published". It may take publication in less formal channels to bootstrap a culture of citing negative results. See my reply to Anonymous Coward.

  21. Re:could be a good thing or as the song says... by Anonymous Coward · · Score: 0
  22. Engineers are frustrated inventors by MangoCats · · Score: 1

    Not-Invented-Here is a major cultural component in engineering.

  23. Engineers don't cite. by SharpFang · · Score: 1

    Citations only mean given research was used in further scientific research. But researchers aren't the only people who read this stuff. Engineers do to - and they don't publish articles, they make projects - they directly utilize results to create useful real-world creations. Never-ending tables of material properties, new chemical processes, new methods of simulation and analysis for implementation in software, this all comes from white papers. Engineers do a lot of own research, and use a lot of methods that are long-established, but often they just look for "new&better" in the scientific publications. And the source may find its way into the project, but it's unlikely to show up in the final product.

    --
    45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2