Data Is Beautiful

6861 readers

1 users here now

A place to share and discuss data visualizations. #dataviz

(under new moderation as of 2024-01, please let me know if there are any changes you want to see!)

founded 3 years ago

MODERATORS

[email protected]

Twenty-nine research teams analyzed the same data, and they all reached different results. (fivethirtyeight.com)

submitted 6 months ago* (last edited 6 months ago) by [email protected] to c/[email protected]

16 comments fedilink hide all child comments

https://fivethirtyeight.com/features/science-isnt-broken/

Another study with the same goal of comparing the results from different research teams found similar disparities, though the graphs aren't quite as pretty.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 11 points 6 months ago (1 children)

Obligatory link to Statistics Done Wrong: The Woefully Complete Guide, a book on how statistics can and has been abused in subtle and insidious ways, sometimes recklessly. Specifically, the chapters on the consequences of underpowered statistics and comparing statistical significance between studies.

I'm no expert on statistics, but I know enough that repeated experiments should not yield wildly different results unless: 1) the phenomenon under observation is extremely subtle so results are getting lost in noise, 2) the experiments were performed incorrectly, or 3) the results aren't wildly divergent after all.

[–] [email protected] 4 points 6 months ago

the whole point of statistics is to extract subtle signals from noise, if you're getting wildly different results, the problem is you're under-powered.

Thanks for taking the time to post these links, just letting you know you're efforts have benefited at least one person who's gonna enjoy reading this.