Sage Journals: Discover world-class research Subscription and open access journals from Sage, the world's leading independent academic publisher.

#statstab #456 Bestiary of Questionable Research Practices in Psychology

Happy new year! ✨

Thoughts: Starting the year with a resource to make you more cynical in 2026.

#QRPs #phacking #metascience #research #ethics

journals.sagepub.com/doi/10.1177/...

P hacking — Five ways it could happen to you Some data practices can lead to statistically dubious findings. Here’s how to avoid them.

Explore five ways p-hacking can occur in research and strategies to uphold scientific integrity.

🔗 buff.ly/GVqUJZK

#DataAnalysis #PHacking #Research

As mentioned in the abstract, this is a preregistered study: osf.io/9z5qn

#openscience #reproducibility #phacking #preregistration #harking #replicability

☂️To bring clarity, we introduced "QRP umbrella terms" that group conceptually related QRPs. For example, #Phacking 🪓consists of 13 specific QRPs, and #CherryPicking 🍒covers 7. This disaggregation helps pinpoint specific behaviors.

P hacking — Five ways it could happen to you Some data practices can lead to statistically dubious findings. Here’s how to avoid them.

P-hacking: subtle practices that can distort research findings. Nature discusses five ways this can occur and how to prevent it. A must-read for data analysts and researchers.

🔗 buff.ly/GVqUJZK

#PHacking #DataScience #ResearchEthics #Reproducibility

#statstab #363 p-checker The one-for-all p-value analyzer

Thoughts: Easy way to check for publication bias using some current tools.

#shiny #pvalue #phacking #QRPs #zcurve #bias #pcurve #rindex

shinyapps.org/apps/p-check...

Stata | FAQ: Problems with stepwise regression What are some of the problems with stepwise regression?

#statstab #358 What are some of the problems with stepwise regression?

Thoughts: Model selection is not an easy task, but maybe don't naively try step wise reg.

#stepwise #regression #QRPs #issues #phacking #modelselection #bias

www.stata.com/support/faqs...

Positive study by arbitrary set non-inferority margins? Sounds like an industry-sponsored study! #phacking

P hacking — Five ways it could happen to you Some data practices can lead to statistically dubious findings. Here’s how to avoid them.

"Most researchers don’t set out to cheat, but they could unknowingly make choices that push them towards a significant result. Here are five ways P hacking can slip into your research."

buff.ly/ArtMGCu

#PHacking #PValue #ScientificRigor

P hacking — Five ways it could happen to you Some data practices can lead to statistically dubious findings. Here’s how to avoid them.

Most researchers don’t set out to cheat, but they could unknowingly make choices that push them towards a significant result. Here are five ways p-hacking can slip into your research. By Ben Tsang @nature.com 🧪 www.nature.com/articles/d41... #phacking #stats

Encourage Playing with Data and Discourage Questionable Reporting Practices - Psychometrika Psychometrika -

#statstab #330 Encourage Playing with Data and Discourage Questionable Reporting Practices

Thoughts: What are and aren't "Questionable Research Practices"? Where is the "grey area"? Interesting opinion piece.

#QRPs #exploratory #EDA #posthoc #phacking

link.springer.com/article/10.1...

Were astrologers the original p-hackers? Science writers rarely mention astrology, other than to moan when someone accidentally uses the word instead of astronomy. There is, of cour...

Thinking about the scientific sin of p-hacking, it's tempting to wonder if astrologers were the original p-hackers: brianclegg.blogspot.com/2025/04/were... #astrology #phacking #dubiouspractice

Me yapping about #phacking is very exciting bc y'all not slick and I unfortunately love when ppl get caught being messy 😂😭

The crisis of science from ChatGPT's perspective. #openscience #replication #metascience #academicpublishing #publishorperish #phacking #HARKing

#statstab #168 Large P-Values Cannot be Explained by Power Analysis

Thoughts: "Researchers cannot “aim” for p = .05, not even with a careful, perfectly accurate, power analysis."

#research #nhst #pvalues #power #QRPs #phacking

quentinandre.net/post/large-p...

in which i list a bunch of scientific reforms & call them all populist gimmicks. for an hour.

writing & producing this episode was a real slog, in my 30°C, noisy studio (attic). it's likely also going to be a slog for my ~100 listeners.

#blockbuster #epic #openscience #reform #phacking #QRP

#statstab #135 {p-checker} The one-for-all p-value analyzer

Thoughts: Why not try your hand at some tools for detecting publication bias (mileage may vary). Useful teaching demo tools.

#shinyapp #r #rstats #phacking #pvalues #NHST #education #edu

shinyapps.org/apps/p-check...

A Jest for the Best In the realm of statistics, where p-values reside Some folks act like it’s a magic guide Beware p-hacking, for significance is just a clue Regression and correlation have their say too! Amidst the alpha and beta, let’s not forget Stats are tools, don’t make them a bet In the land of means and chi-squares' dance Remember, real life’s not just by chance! Hari Srinivasan

#statistics #phacking

In my comment, I agree with virtually everything said but point to a blind spot in the discussion: sex research is dominated by single study papers that hinder both the detection of anomalies and scientific progress. #solidscience #sexology #pHACKING https://psyarxiv.com/cpjr7

From a respected colleague. Still a long way to go! #openscience #pHacking I suppose there's no data on how many still ignorant of this?

Classic advice for your Friday - from 2007 Handbook of Research Methods #phacking