this post was submitted on 05 Feb 2024
168 points (98.8% liked)

science

14445 readers
2 users here now

just science related topics. please contribute

note: clickbait sources/headlines aren't liked generally. I've posted crap sources and later deleted or edit to improve after complaints. whoops, sry

Rule 1) Be kind.

lemmy.world rules: https://mastodon.world/about

I don't screen everything, lrn2scroll

founded 1 year ago
MODERATORS
 

Last year the annual number of papers retracted by research journals topped 10,000 for the first time. Most analysts believe the figure is only the tip of an iceberg of scientific fraud.

“The situation has become appalling,” said Professor Dorothy Bishop of Oxford University. “The level of publishing of fraudulent papers is creating serious problems for science. In many fields it is becoming difficult to build up a cumulative approach to a subject, because we lack a solid foundation of trustworthy findings. And it’s getting worse and worse.”

The startling rise in the publication of sham science papers has its roots in China, where young doctors and scientists seeking promotion were required to have published scientific papers. Shadow organisations – known as “paper mills” – began to supply fabricated work for publication in journals there.

The practice has since spread to India, Iran, Russia, former Soviet Union states and eastern Europe, with paper mills supplying ­fabricated studies to more and more journals as increasing numbers of young ­scientists try to boost their careers by claiming false research experience. In some cases, journal editors have been bribed to accept articles, while paper mills have managed to establish their own agents as guest editors who then allow reams of ­falsified work to be published.

all 31 comments
sorted by: hot top controversial new old
[–] [email protected] 30 points 9 months ago (3 children)

In my experience, people don't pay much attention to anything from those countries unless there's some special reason to take it seriously.

[–] [email protected] 25 points 9 months ago

I had a near panic like shit, 10,000 retractions is a huge thing. Especially after all the incidents between 2010-2018 where we were hitting 1000 retractions a year

But then I read China and yeah, okay. They're probably going through their own shake up.

[–] [email protected] 14 points 9 months ago

Ya I generally avoid any paper that's from China unless I really need the information it provides and then I need to go down a super tedious rabbit hole to make sure I can actually trust that it's true.

[–] [email protected] 6 points 9 months ago (1 children)

Yeah, I've come across one or two papers of questionable origin presenting performance metrics nowhere near what I could replicate.

Needless to say, I could only replicate the results when I introduced a very mundane procedure error nobody reputable would make. So yeah, lots of garbage out there

[–] [email protected] 5 points 9 months ago

And that's not even fraudulent, just incompetent...

[–] [email protected] 10 points 9 months ago (1 children)
[–] [email protected] 7 points 9 months ago* (last edited 9 months ago) (2 children)

Freakonomics has a couple of interesting podcasts on academic fraud, where they discuss what motivates it and some suggestions for mitigating the problem:

https://freakonomics.com/podcast/why-is-there-so-much-fraud-in-academia/

https://freakonomics.com/podcast/can-academic-fraud-be-stopped/

[–] [email protected] 11 points 9 months ago (3 children)

Want to save us 79 minutes and summarize what the motivation is? I'm assuming it's agenda propaganda. Is that right?

[–] [email protected] 9 points 9 months ago* (last edited 9 months ago) (1 children)

What is "agenda propaganda"?

The motivation is mainly just the extreme pressure put on academics to publish relentlessly, combined with a publishing culture that favours "interesting" results. When you set out to test a hypothesis with an experiment, the results could turn out to be more or less remarkable. if the results are unremarkable it's still a valid result and useful data, but it's difficult to report that in a paper and get it published, because the journals favour "interesting" results. So a lot of perfectly valid and useful science can't get published. This creates a big temptation to massage results to create something that looks more striking and will get published. This may start with selectively omitting data or selectively analyzing the data, but it's a bit of a slippery slope towards changing data points that don't support the paper's thesis.

They mention one mitigation scheme in particular that is interesting: in this scheme scientists submit the question their experiment is supposed to answer to the journal before they do the experiment. The journal editors decide whether they want to publish it before they see the experimental results. If they commit to publish, they publish the paper no matter what the experimental results turn out to be. This removes an incentive to massage the data to get published.

There's also the way funding and jobs are allocated: you have to have a real stack of publications to your name and constantly be publishing to keep your job or get your research program funded. This creates an incentive for scientists to pay to be included in the author list of papers they didn't actually work on. And there's the phenomenon of professors putting their name to research by their students where they haven't examined the data in detail, and the fact that there are too many papers for anyone to thoroughly peer review, both of which make it easier to slip manipulated or faked data into publications.

[–] [email protected] 5 points 9 months ago

Agenda propaganda refers to the use of media and communication tools to promote a specific set of ideas, values, or a particular agenda, often by presenting selective facts or by manipulating emotions to influence public opinion and behavior.

Thanks for the summary!

[–] [email protected] 6 points 9 months ago (1 children)

Prestige, money, career. Plus a dash of something else.

[–] [email protected] 1 points 9 months ago

ketchup ? it has to be ketchup

[–] [email protected] 3 points 9 months ago

They talk about many things, but the one that stands out is incentives. There is a lot of competition in academia, publish or perish, with big prizes, so some people are taking shortcuts.

[–] [email protected] 3 points 9 months ago

These were great, really enjoyed them, especially the coverage of the Data Colada story

[–] [email protected] 5 points 9 months ago (1 children)

Isn't this just fraud and should be prosecuted?

[–] [email protected] 4 points 9 months ago (1 children)

Prosecuting scientists for publishing unheard of ideas in a manner that hasn't been sanctioned by an established scholarly/religious institutions....

The solution to bad science is science.

[–] [email protected] 1 points 9 months ago

Well if you put it like that :D

I'm not sure you're right now. Fight fire with water, but what if you only have a teacup full of water? Meaning there could be an immense potential of energy on one side, and a small on the other. On one side you have money for careers and whatnot, on the other you have... nerds who believe ~~love~~science conquers all :D

[–] [email protected] 3 points 9 months ago* (last edited 9 months ago)

Unfortunately Chinese papers in my field have a reputation for being less trustworthy than historical scientific powerhouses like Europe, the UK, the US and Canada. Countries like Iran aren't even on the map.