Anne Scheel's Avatar

Anne Scheel

@annemscheel

Assistant prof at Utrecht University, trying to make science as reproducible as non-scientists think it is. Blogs at @the100ci.

3,385
Followers
790
Following
368
Posts
30.07.2023
Joined
Posts Following

Latest posts by Anne Scheel @annemscheel

Preview
Scientific datasets are riddled with copy-paste errors Initial results from scanning through Excel files belonging to 600 published scientific papers.

If you want to take your mind off awful politics and look at awful science stuff instead, this is a good read: www.sciencedetective.org/scientific-d...

06.03.2026 10:17 πŸ‘ 72 πŸ” 31 πŸ’¬ 0 πŸ“Œ 3

bro just one more future study bro, bro I swear just one more future study and it'll fix the inference bro

06.03.2026 11:00 πŸ‘ 20 πŸ” 5 πŸ’¬ 1 πŸ“Œ 0

One funny effect of pretending that methodological issues can just be ignored because of β€œfuture studies” is that it probably prevents those future studies from happening. Like why bother actually addressing hard issues when you can just get away with hand waving?

06.03.2026 10:54 πŸ‘ 18 πŸ” 2 πŸ’¬ 2 πŸ“Œ 0

No. I played Oxyd Magnum on an Atari for quite a while though…

05.03.2026 12:00 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Screenshot of the "Does that use a lot of energy?" online app

Screenshot of the "Does that use a lot of energy?" online app

Hannah Ritchie has built a fun little tool where you can compare energy usage of various products and activities.

This is super helpful imho, because it's so hard to develop intuitions even just about the scales involved here.

hannahritchie.substack.com/p/does-that-...

03.03.2026 09:27 πŸ‘ 149 πŸ” 65 πŸ’¬ 3 πŸ“Œ 5

You know I’m no measurement expert, but that does sound like a Rasch-scale situation to me

03.03.2026 06:56 πŸ‘ 4 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Preview
a woman is holding a cup of coffee and saying crisis averted . ALT: a woman is holding a cup of coffee and saying crisis averted .
03.03.2026 06:35 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Wow! In that case, thank god for her strong moral convictions.

03.03.2026 06:31 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

That’s interesting. I guess the fact that you either can or can’t climb a route might do a lot of heavy lifting (sorry) here?

03.03.2026 06:17 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Thank god fairies are so smol and weak

03.03.2026 06:15 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

"40% of papers about subarachnoid haemorrhage in animals contained manipulated images."

We have to face up to the fact that in some fields, over half of published science might be fake.

01.11.2025 21:11 πŸ‘ 54 πŸ” 23 πŸ’¬ 1 πŸ“Œ 3
Post image

Seeing that comments on this are getting a little more political, I want to highlight that my gripe is very much with *the headline* specifically. Neither Alan Milburn nor the author of the article seems to be so seriously confused about the situation.

Link to full article: archive.is/pA2lv

01.03.2026 11:55 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 1

β€œDonation after circulatory death donors rose from 118 in 2000 (2% of all donors) to 8129 in 2025 (49%).”

Figures are for the US.

01.03.2026 08:36 πŸ‘ 18 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0
Chart of trends in recovered organs from circulatory deaths

Chart of trends in recovered organs from circulatory deaths

The number of organs available for donation has risen massively in the past five years.

It seems to be the result of technological advances in preserving organs after circulatory death.
jamanetwork.com/journals/jam...

01.03.2026 08:30 πŸ‘ 204 πŸ” 43 πŸ’¬ 4 πŸ“Œ 4
An array of 9 purple discs on a blue background. Figure from Hinnerk Schulz-Hildebrandt.

An array of 9 purple discs on a blue background. Figure from Hinnerk Schulz-Hildebrandt.

A nice shift in perceived colour between central and peripheral vision. The fixated disc looks purple while the others look blue.

The effect presumably comes from the absence of S-cones in the fovea.

From Hinnerk Schulz-Hildebrandt:
arxiv.org/pdf/2509.115...

24.09.2025 10:16 πŸ‘ 770 πŸ” 296 πŸ’¬ 33 πŸ“Œ 53
GitHub - rubenarslan/signal_transcriber: Vibe coded Mac app to transcribe Signal voice message using sigtop, ffmpeg, whisper, swiftdialog Vibe coded Mac app to transcribe Signal voice message using sigtop, ffmpeg, whisper, swiftdialog - rubenarslan/signal_transcriber

The only feature I miss in Signal compared to WhatsApp was transcription of voice messages. So, I had Claude code a pipeline to do this locally on Mac using sigtop+ffmpeg+whisper at the click of a button. github.com/rubenarslan/...

27.02.2026 12:59 πŸ‘ 9 πŸ” 2 πŸ’¬ 2 πŸ“Œ 0
Post image

New newspaper headline for your Intro to Causal Inference lecture just dropped

27.02.2026 12:57 πŸ‘ 164 πŸ” 33 πŸ’¬ 4 πŸ“Œ 7
Online Studies
Psychological Science requires that authors who use samples from online data collection include a statement in the Method section explicitly addressing their approach to preventing and detecting automated or AI-generated responses.

Rationale

As large language models and other generative AI tools become more accessible, the risk of data contamination by non-human respondents has increased dramatically in research. Psychological science (and the social sciences generally) is particularly susceptible to this issue given its growing reliance on online data collection. Preventing automated responses during data collection and detecting them afterward often involve methodological trade-offs. For instance, technical barriers that aim to prevent LLM use (e.g., blocking copy-pasting functionalities) may eliminate behavioral indicators needed for detection (e.g., pasting rather than typing). This policy aims to enhance transparency and reproducibility of reported results by requiring authors to articulate their approach across both prevention and detection dimensions, enabling readers and reviewers to assess the likelihood of reported data being influenced by automated responses.

Scope

This policy applies to any submission with at least one study that includes data collected online without direct human supervision (e.g., via crowdsourcing platforms, student participants who complete the study online, online recruitment ads, or remote survey distribution tools).

Required Reporting

Authors must include in the Methods section either:

A statement confirming that procedures were in place to prevent and/or detect and exclude automated or AI-generated responses, including a description of those procedures (e.g., explicit participant instructions against LLM use, disabled copy–paste functionality, CAPTCHA use, IP filtering, consistency checks, attention checks, adversarial prompting) as well as the types of automated responses that these procedures are suitable …

Online Studies Psychological Science requires that authors who use samples from online data collection include a statement in the Method section explicitly addressing their approach to preventing and detecting automated or AI-generated responses. Rationale As large language models and other generative AI tools become more accessible, the risk of data contamination by non-human respondents has increased dramatically in research. Psychological science (and the social sciences generally) is particularly susceptible to this issue given its growing reliance on online data collection. Preventing automated responses during data collection and detecting them afterward often involve methodological trade-offs. For instance, technical barriers that aim to prevent LLM use (e.g., blocking copy-pasting functionalities) may eliminate behavioral indicators needed for detection (e.g., pasting rather than typing). This policy aims to enhance transparency and reproducibility of reported results by requiring authors to articulate their approach across both prevention and detection dimensions, enabling readers and reviewers to assess the likelihood of reported data being influenced by automated responses. Scope This policy applies to any submission with at least one study that includes data collected online without direct human supervision (e.g., via crowdsourcing platforms, student participants who complete the study online, online recruitment ads, or remote survey distribution tools). Required Reporting Authors must include in the Methods section either: A statement confirming that procedures were in place to prevent and/or detect and exclude automated or AI-generated responses, including a description of those procedures (e.g., explicit participant instructions against LLM use, disabled copy–paste functionality, CAPTCHA use, IP filtering, consistency checks, attention checks, adversarial prompting) as well as the types of automated responses that these procedures are suitable …

Maybe of interest: The submission guidelines of Psychological Science now demand an explicit statement on measures taken to reduce the risk of AI-generated responses for all online studies!

www.psychologicalscience.org/publications...

25.02.2026 12:08 πŸ‘ 124 πŸ” 53 πŸ’¬ 1 πŸ“Œ 0

Usually you can control whether the machine turns on though, not only your intentions to turn it on, right?
But yeah, the heuristic isn’t perfect. Machine failure is better captured by what Julia said: when you can assume that it’s unrelated to what you were going to measure, it’s probably fine.

26.02.2026 12:59 πŸ‘ 5 πŸ” 0 πŸ’¬ 2 πŸ“Œ 0

Exactly!

26.02.2026 11:02 πŸ‘ 5 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

It takes a lot of accepting scientific imperfection ;) For me it personally makes sense when simply thinking about β€œwhat you can control”. You can control what people are told, but not what they do. The manipulation is always a mediation path with some loss along the way.

26.02.2026 10:54 πŸ‘ 8 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0

not sure I understand your argument, can you explain some more? The homogeneity assumption itself would just be causally ignorant/naive, right?
My personal feeling is that ppl always knew it was bad to only test psych students, but convinced each other that it was fine in the same way as many QRPs.

26.02.2026 10:46 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

bsky.app/profile/anne...

26.02.2026 10:32 πŸ‘ 4 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

After learning about collider bias, reading this gave me the second-worst existential crisis about learning anything causal from data *even when you can run experiments*. Really a must-read if you’re not already familiar with this stuff.

26.02.2026 08:34 πŸ‘ 32 πŸ” 2 πŸ’¬ 3 πŸ“Œ 0

Per protocol analysis strikes again!

Folks, if you randomize but then donβ€˜t analyze some of the people who got randomized (maybe because they didn’t adhere to instructions, maybe because they dropped out), randomization will no longer do all the heavy causal inference lifting.

25.02.2026 17:28 πŸ‘ 190 πŸ” 56 πŸ’¬ 6 πŸ“Œ 3

Collider bias strikes again

25.02.2026 08:53 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Preview
Mis-allocated scrutiny In the current system of pre-publication peer review, which papers are scrutinized most thoroughly? In this blog post, I argue that scrutiny is mis-allocated: the average number of pre-publication rev...

Always different journals, I should add. Makes me think about @ruben.the100.ci's blog post about a major bug of peer review:

www.the100.ci/2020/06/24/m...

25.02.2026 08:25 πŸ‘ 5 πŸ” 2 πŸ’¬ 2 πŸ“Œ 0

Wonderful!

23.02.2026 15:47 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Video thumbnail

We regret to inform you that your paper cannot be considered for publication, but we encourage you to submit it to our GOLD Open Access sister journal

23.02.2026 10:41 πŸ‘ 50 πŸ” 15 πŸ’¬ 1 πŸ“Œ 0

Thanks! Would be great to receive it, but no pressure of course.

23.02.2026 06:48 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0