Brendan Schuetze's Avatar

Brendan Schuetze

@schu.etze.co

Cognition, Learning Science, Quant Methods Assistant Professor, Educational Psychology at a “large university in the mountain west” Views are my own

846
Followers
399
Following
99
Posts
27.07.2023
Joined
Posts Following

Latest posts by Brendan Schuetze @schu.etze.co

I’m sure someone’s out there using winbugs too

02.03.2026 16:11 👍 4 🔁 0 💬 0 📌 0

I will only accept the term "bespoke" applied to Stan users, and Stan users only

02.03.2026 04:25 👍 4 🔁 0 💬 1 📌 0

Just a plea from a struggling stats instructor, could we possibly debate why Type I sums of squares is the default in the base R anova functions

26.02.2026 19:08 👍 2 🔁 1 💬 1 📌 0

on the plus side probably not straight copy and pasted LLM output?

24.02.2026 19:10 👍 0 🔁 0 💬 0 📌 0

Fantastic, surely what everyone wanted: student-out-of-the-loop learning

23.02.2026 16:34 👍 0 🔁 0 💬 0 📌 0

I propose to make universal the old policy of the Blackfriars conference at the American Shakespeare Center:

If you do not end your paper on time, you will be forced to exit, pursued by a bear. Literally, a bear will come take your paper from you.

16.02.2026 01:14 👍 1637 🔁 569 💬 34 📌 77
It must be very hard to publish null results
Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.

It must be very hard to publish null results Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.

I have a new paper. We look at ~all stats articles in political science post-2010 & show that 94% have abstracts that claim to reject a null. Only 2% present only null results. This is hard to explain unless the research process has a filter that only lets rejections through.

11.02.2026 17:00 👍 642 🔁 223 💬 30 📌 51

This is partly why I find @thenewstats.bsky.social’s emphasis on confidence intervals to be productive over an emphasis on p values

11.02.2026 23:59 👍 2 🔁 0 💬 0 📌 0

I’m not sure I agree that a “null“ isn’t generating new knowledge. A null 95% CI can all but rule out effects larger than a certain magnitude. This is useful information, particularly in applied fields like education

11.02.2026 23:59 👍 4 🔁 0 💬 1 📌 0

There's more than one way to do it: Perl, R, Stan
There's exactly one way to do it: Python, BUGS
There's at most one way to do it: SPSS, SAS

04.02.2026 05:21 👍 23 🔁 6 💬 0 📌 0
Pb concentration by decade in hair from Salt Lake City region residents. Value plotted for 1940 includes all samples from 1916 to 1959; value plotted at 2022 includes all samples from 2020 to 2024.

Pb concentration by decade in hair from Salt Lake City region residents. Value plotted for 1940 includes all samples from 1916 to 1959; value plotted at 2022 includes all samples from 2020 to 2024.

Lead (Pb) in archived hair in Salt Lake City.

"Lead (Pb) in archived hair documents a decline in lead exposure to humans since the establishment of the US Environmental Protection Agency "

www.pnas.org/doi/10.1073/...

02.02.2026 23:22 👍 95 🔁 43 💬 2 📌 7
Preview
UT-Austin Is Closing Its Teaching Center. Faculty Members Ask: Why? A series of shutdowns announced by the provost are short on detail. Professors say they make little sense.

So UT-Austin is committed to "undergraduate research, faculty support, advising," but it's closing the offices and centers that do that work? Um, what?

www.chronicle.com/article/ut-a...

23.01.2026 17:01 👍 10 🔁 4 💬 1 📌 0
Preview
Era Postbac Fellowship | CLAD Lab | University of Notre Dame

We invite apps for our postbac fellowship in educational research and action. Postbacs engage in research on learning & learning environments, receive close mentorship from scholars across disciplines, and gain hands-on experience through community-based programs. See cladlab.nd.edu/era-fellowsh...

18.01.2026 00:00 👍 10 🔁 9 💬 0 📌 0
16.01.2026 23:14 👍 0 🔁 0 💬 0 📌 0

Bummer 😭

16.01.2026 19:49 👍 0 🔁 0 💬 0 📌 0

Am I understanding this right that IES restricted use data is currently unavailable for any new projects?

Please tell me I'm missing something 😰

12.01.2026 21:02 👍 0 🔁 0 💬 1 📌 0
Preview
WARN-D machine learning competition is live » Eiko Fried If you share one single thing of our team in 2026—on social media or per email with your colleagues—please let it be this machine learning competition. It was half a decade of work to get here, especi...

After 5 years of data collection, our WARN-D machine learning competition to forecast depression onset is now LIVE! We hope many of you will participate—we have incredibly rich data.

If you share a single thing of my lab this year, please make it this competition.

eiko-fried.com/warn-d-machi...

07.01.2026 19:39 👍 187 🔁 159 💬 5 📌 5
Preview
Multiple text comprehension in contemporary contexts: Integrating broader understandings of affect, culture, and technology As notions of reading have expanded in terms of what is read (e.g., screens, varied modalities, multiple texts), considerations of what influences reading processes (e.g., digital platforms, cultur...

Here's the link to the paper: doi.org/10.1080/0046...

24.12.2025 12:01 👍 0 🔁 0 💬 0 📌 0

Highlights of this paper for me include (1) a vignette that describes my own voting behavior, and (2) a series of figures that leave everyone a little bit unhappy but not unhappy enough to reject the paper

All-in-all another great team effort from some of my favorite people to write with 😀

24.12.2025 12:01 👍 0 🔁 0 💬 1 📌 0
Preview
Multiple text comprehension in contemporary contexts: Integrating broader understandings of affect, culture, and technology As notions of reading have expanded in terms of what is read (e.g., screens, varied modalities, multiple texts), considerations of what influences reading processes (e.g., digital platforms, cultur...

In this article "Multiple text comprehension in contemporary contexts: Integrating broader understandings of affect, culture, and technology" we put discuss the complexities of multiple text comprehension in the contemporary digital world and how MTC research might be expanded to accommodate them!

24.12.2025 12:01 👍 0 🔁 0 💬 1 📌 0
Screenshot of article page from Educational Psychologis titled "Multiple text comprehension in contemporary contexts: Integrating broader understandings of affect, culture, and technology"

Screenshot of article page from Educational Psychologis titled "Multiple text comprehension in contemporary contexts: Integrating broader understandings of affect, culture, and technology"

A new Christmas present for all those who celebrate, an article on multiple text comprehension in @edpsychjournal.bsky.social from @nashb.bsky.social @allisonzengilowski.bsky.social, me, and Diane Schallert!

24.12.2025 12:01 👍 2 🔁 0 💬 1 📌 0
Post image

We're thrilled to open registration for our 1st 2026 Replication Games. The event will be at the University of Zurich on January 19th.

Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...

11.12.2025 13:28 👍 40 🔁 21 💬 0 📌 2

They. Said. It. Was. Fake.

11.12.2025 05:51 👍 0 🔁 0 💬 0 📌 0

Happy to be hosting incoming One-U Responsible AI Postdoctoral Fellow Mingjia Hu along with @anamarasovic.bsky.social (U of U School of Computing) and Chenglu Li (Ed Psy)!

11.12.2025 05:42 👍 2 🔁 0 💬 0 📌 0

Dan, almost 10 years ago your podcast got me interested in the Open Science movement, so it was a nice little full circle moment when I accepted this preprint earlier today!

01.12.2025 19:19 👍 1 🔁 0 💬 1 📌 0
How do emotions experienced in the moment shape what you learn, especially when confronted with misinformation?

How do emotions experienced in the moment shape what you learn, especially when confronted with misinformation?

How do emotions shape what you learn when facing misinformation? A new study reveals how curiosity, confusion, and other emotions drive knowledge revision. Read the full ‘Behind the Paper’: bit.ly/4r5dHyi. #EducationalResearch #PsychSciSky @yilunjheng.bsky.social @leencatrysse.bsky.social

28.11.2025 16:00 👍 2 🔁 2 💬 0 📌 0

It hurts my brain a little less to just visualize 95% CIs as the summary of a distribution of bootstrap values, so I just do that :)

#bootstrap-pilled

20.11.2025 06:29 👍 1 🔁 0 💬 0 📌 0
Preview
U.S. Congress considers sweeping ban on Chinese collaborations Researchers speak out against proposal that would bar funding for U.S. scientists working with Chinese partners or training Chinese students

“The prohibited activities would include joint research, co-authorship on papers, and advising a foreign graduate student or postdoctoral fellow. The language is retroactive, meaning any interactions during the previous 5 years could make a scientist ineligible for future federal funding.”

14.11.2025 01:03 👍 591 🔁 308 💬 57 📌 276
An old reel to reel magnetic tape. It has a label, in Jay Lepreau's handwriting, proclaiming it to be "UNIX Original from Bell Labs v4 (see manual for fmt)"

An old reel to reel magnetic tape. It has a label, in Jay Lepreau's handwriting, proclaiming it to be "UNIX Original from Bell Labs v4 (see manual for fmt)"

While cleaning a storage room, our staff found this tape containing #UNIX v4 from Bell Labs, circa 1973

Apparently no other complete copies are known to exist: https://gunkies.org/wiki/UNIX_Fourth_Edition

We have arranged to deliver it to the Computer History Museum

#retrocomputing

06.11.2025 20:49 👍 131 🔁 408 💬 27 📌 8
OSF

@briannosek.bsky.social I'm still seeing that one of my recent preprints accepted at PsyArXiv neither appears indexed in Google Scholar or the normal Google search results.

Not sure if it's just my preprint or a symptom of a broader issue with site indexing 🤷‍♂️

Preprint here: osf.io/preprints/ps...

07.11.2025 21:12 👍 0 🔁 0 💬 2 📌 0