this post was submitted on 29 May 2024
1370 points (95.3% liked)

Science Memes

11217 readers
2688 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.



Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS
1370
submitted 6 months ago* (last edited 6 months ago) by [email protected] to c/[email protected]
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 34 points 6 months ago (1 children)

Some published papers are not reproducible. All unpublished papers are not reproducible. You’re creating a dangerously wrong equivalence.

[–] [email protected] 9 points 6 months ago (1 children)

I feel like I'm missing something here so I'll be the devil's advocate, why can't unpublished papers be reproducible? Multiple teams could independently be verifying hypotheses and results under the same organisation, adhere to the same standard but never publish, that would still be science no? Not doing humanity any favours, but science nonetheless.

[–] [email protected] 3 points 6 months ago* (last edited 6 months ago) (1 children)

Because science is about objective, provable fact following a known and public method. An organization can say their findings are reproducible, but reproducibility is more than just getting the same results every time the same lab runs the same PCR on the same machine. To be truly reproducible your results need to be able to be replicated by anyone with appropriate materials and equipment.

What you are describing is research, not science. It’s not that research is bad, but that science is a philosophical adherence to a method as much as it is that method itself.

The tobacco companies conducted research when they realized smoking caused cancer and hid those findings from others. That’s not science even if their internal researchers were consistent with each other.

[–] [email protected] 1 points 6 months ago (1 children)

Seems like the only difference is that if it's public or not ie published. I think it becomes a matter of opinion then, because independent teams within the same organisation can absolutely peer review eachother, use completely different methodology to prove the same hypothesis and publish papers internally so it can be reproduced internally.

Science should be made public, but just because it's not doesn't mean it's not science. When the organisation starts making public claims they should have to back that up along the official route, but they could just as well keep their findings a secret, use that secret to improve their working formula and make bank while doing that. Not calling their internal peer reviewed studies science just seems pretentious.

[–] [email protected] 1 points 6 months ago (1 children)

No, they can’t. Peer review is not the peers you determine - it’s the peers of your community. Science that is not public is not science, because it cannot be independently verified and reproduced. It is not a small point, it’s one of the foundations of the disciplines of science.

[–] [email protected] 2 points 6 months ago (1 children)

An organisation with fully independent teams tackling the same problems can absolutely be defined as peer review. Not in the traditional sense, but reviewing, confirming and replicating nonetheless. Following the scientific method is what makes something scientific, not the act of publishing.

You can argue of the merits of those papers, an organisation can never make public statements about private research. But saying that what their doing is not science, then you're just needlessly gatekeeping.

[–] [email protected] 1 points 6 months ago (1 children)

No it literally cannot be so defined. The last part of the scientific method is “report conclusions.” That means public scrutiny free of bias. Internal groups are not public.

This is akin to saying that a corporation doesn’t need to use the courts because it has internal judges. They might have trials, but by definition they are not doing justice.

[–] [email protected] 2 points 6 months ago (1 children)

Reporting your conclusions doesn't require being public. It means the larger group of people you release it to, the less bias you'll have. Meaning in a closed organisation you have added biases of companies and marginally less people to prove you wrong, decreasing the overal quality of the conducted science. But still science, which by definition isn't black and white.

[–] [email protected] 0 points 6 months ago (1 children)

I mean, Yann LeCunn disagrees with you but sure. Go on.

[–] [email protected] 2 points 6 months ago (1 children)

He's clearly taking the "but it's better for human kind" stand, which I support with all I can. But academics can be guilty of gatekeeping and being pretentious, which I've seen by many lmao

[–] [email protected] 0 points 6 months ago

Gatekeeping on following the scientific method is pretty good gatekeeping if you ask me. Again, what you are arguing is anathema to centuries of scientific endeavors. You’re applying your own interpretation to something that has literally hundreds of years of meaning already, in a way that is just not right. It’s not gatekeeping any more than “a court of law” gatekeeps the concept of justice.