Ben Van Calster's Avatar

Ben Van Calster

@benvancalster

Medical Statistician at KU Leuven. My brain is like a snail but it gets there in the end (or not).

771
Followers
212
Following
39
Posts
24.11.2023
Joined
Posts Following

Latest posts by Ben Van Calster @benvancalster

Boinggg!

20.12.2025 23:13 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

Doug Altman was an internationally renowned statistician who served as The BMJ’s chief statistical adviser.

Read about life and work that made this statistician a "citation millionaire"
#BMJChristmas
www.bmj.com/content/391/...

17.12.2025 16:13 πŸ‘ 63 πŸ” 30 πŸ’¬ 0 πŸ“Œ 4

I can follow that. Therefore, we state that the paper does not talk about model comparison (including the addition of a predictor to an existing model).

13.12.2025 16:08 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

A STRATOS paper with Ewout Steyerberg, @gscollins.bsky.social @laurewynants.bsky.social @maartenvsmeden.bsky.social @vickersbiostats.bsky.social @kdpsingh.bsky.social @gaelvaroquaux.bsky.social @davemclernon.bsky.social @lasaibarrenada.bsky.social K. Kerr T. Hernandez-Boussard C. Moons D. Timmerman

13.12.2025 14:06 πŸ‘ 4 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Preview
Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance Numerous measures have been proposed to illustrate the performance of predictive artificial intelligence (AI) models. Selecting appropriate performance measures is essential for predictive AI models i...

Our guidance regarding performance measures for medical AI models is finally out!

- Stop bashing AUROC, although it does not settle things
- Calibration and clinical utility are key
- Show risk distributions
- Classification statistics (e.g. F1) are improper

www.thelancet.com/journals/lan...

13.12.2025 14:03 πŸ‘ 48 πŸ” 25 πŸ’¬ 2 πŸ“Œ 1

Expertise is having fucked up in enough different ways that you become able to anticipate it.

04.09.2025 03:33 πŸ‘ 29 πŸ” 8 πŸ’¬ 0 πŸ“Œ 3

We need to think more about communication in this context, that is for sure. Clinical staff should not say "your risk is 21%". Just giving an 95% CI in layman terms does not do the job. The uncertainty complicates things quite a lot imo, not sure how to best tackle that to be honest.

10.09.2025 07:11 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Preview
The fundamental problem of risk prediction for individuals: health AI, uncertainty, and personalized medicine Background: Clinical prediction models for a health condition are commonly evaluated regarding performance for a population, although decisions are made for individuals. The classic view relates uncer...

In our latest work, we show that risk estimates for patients are HUGELY uncertain due to model, data, and population uncertainty. Even for well performing models (c statistic, calibration, utility) based on large N.
@laure_wynants @ESteyerberg @lasaibarrenada.bsky.social

arxiv.org/abs/2506.17141

29.08.2025 08:27 πŸ‘ 8 πŸ” 3 πŸ’¬ 1 πŸ“Œ 0

Universities love open science
Small print: unless money is involved

26.08.2025 10:15 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Bar chart showing % of articles retracted, with expression of concern, or no action from different publishers. 100% no action from Elsevier and Wolters Kluwer; 100% retraction from Taylor and Francis.

Bar chart showing % of articles retracted, with expression of concern, or no action from different publishers. 100% no action from Elsevier and Wolters Kluwer; 100% retraction from Taylor and Francis.

Huge variability documented in how publishers respond when informed about a problematic body of work by a research group. www.jclinepi.com/article/S089...
#publishers #retractions

24.08.2025 15:35 πŸ‘ 106 πŸ” 49 πŸ’¬ 2 πŸ“Œ 12

We recently had 5 review reports for a submission. While the comments were reasonable, the 5 reports were all very similar in the issues they raised. Suspicious.

01.08.2025 08:56 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Preview
Multiple Imputation of Missing Covariates When Using the Fine–Gray Model The Fine–Gray model for the subdistribution hazard is commonly used for estimating associations between covariates and competing risks outcomes. When there are missing values in the covariates includ...

Multiple Imputation of Missing Covariates When Using the Fine–Gray Model. Edouard F. Bonneville, Jan Beyersmann, Ruth H. Keogh, Jonathan W. Bartlett, Tim P. Morris, Nicola Polverelli, Liesbeth C. de Wreede, Hein Putter. Statistics in Medicine. onlinelibrary.wiley.com/doi/10.1002/...

25.07.2025 07:49 πŸ‘ 5 πŸ” 2 πŸ’¬ 0 πŸ“Œ 0

You could park many of them in the Journal of Unplanned Interim Analyses.

24.07.2025 07:01 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Seconded.

Any time someone uses this term, make sure they explain exactly what they mean. If they can't, they are obviously trying to bullshit you.

14.07.2025 08:29 πŸ‘ 23 πŸ” 4 πŸ’¬ 2 πŸ“Œ 0
Preview
Quality of scientific papers questioned as academics β€˜overwhelmed’ by the millions published Widespread mockery of AI-generated rat with giant penis in one paper brings problem to public attention

β€œVolume is a bad driver,” [Sir Mark Walport] said. β€œThe incentive should be quality, not quantity. It’s about re-engineering the system in a way that encourages good research from beginning to end.”

www.theguardian.com/science/2025...

13.07.2025 15:31 πŸ‘ 30 πŸ” 12 πŸ’¬ 1 πŸ“Œ 4

Graeme is clearly on to something here!

20.06.2025 14:48 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

What is common knowledge in your field, but shocks outsiders?

Data isn't objective and researchers have innumerable ways to put their thumbs on the scale. Many don't understand statistics well enough to realize they're doing it.

17.06.2025 16:01 πŸ‘ 52 πŸ” 12 πŸ’¬ 3 πŸ“Œ 4

Yes! Some years ago, The Group of Biomedical Sciences at mu uni said in front of an auditorium with many young and local researchers that they wanted to invest more in superstar transfers and compared it with football transfers.

13.06.2025 12:04 πŸ‘ 1 πŸ” 0 πŸ’¬ 2 πŸ“Œ 0
Preview
Importance of sample size on the quality and utility of AI-based prediction models for healthcare Rigorous study design and analytical standards are required to generate reliable findings in healthcare from artificial intelligence (AI) research. On…

**New Lancet DH paper**

"Importance of sample size on the quality & utility of AI-based prediction models for healthcare"

- for broad audience
- explains why inadequate SS harms #AI model training, evaluation & performance
- pushback to claims SS irrelevant to AI research

πŸ‘‡
tinyurl.com/yrje52fn

02.06.2025 15:18 πŸ‘ 34 πŸ” 15 πŸ’¬ 2 πŸ“Œ 2

Yes.... somehow they always get it wrong. You cannot get to those levels in science and politics and get it right.

14.05.2025 14:01 πŸ‘ 4 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

yes, subscription model. Fee calculated based on character count of the main paper, including refs, tables, figs. Sounds a bit odd in this digital age.

12.05.2025 07:24 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

I recently had a paper in a journal where the fee for open access was lower than the fee for closed access. Is that common? @grahamkendall.bsky.social

11.05.2025 16:17 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

Why aren’t you wearing a suit?

Have you said β€œThank you” to Greenland and Denmark for allowing you to have a base on Greenland?

29.03.2025 10:58 πŸ‘ 34830 πŸ” 8182 πŸ’¬ 1146 πŸ“Œ 380

Great question! It seems that universities would (secretly?) say yes.

26.03.2025 11:24 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Oh, there's an English version as well! DW reports about misconduct at Max Planck Institutes: www.youtube.com/watch?v=n5nE...

13.03.2025 09:35 πŸ‘ 35 πŸ” 19 πŸ’¬ 6 πŸ“Œ 9
Preview
PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods The Prediction model Risk Of Bias ASsessment Tool (PROBAST) is used to assess the quality, risk of bias, and applicability of prediction models or algorithms and of prediction model/algorithm studies....

PROBAST+AI is out!

www.bmj.com/content/388/...

24.03.2025 10:54 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

I will be presenting our recent work on individual risk estimation uncertainty at ENAR in New Orleans. Come say hi!

Work with @benvancalster.bsky.social @laurewynants.bsky.social #DoranneThomassen #EwoutSteyerberg

23.03.2025 15:35 πŸ‘ 5 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

Academia says 'no novelty no glory no funding'

18.03.2025 12:58 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

Following the footsteps of Bink Marino!

17.03.2025 09:11 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Quousque tandem?
@kuleuvenuniversity.bsky.social @fwovlaanderen.bsky.social
A lot of publications in MDPI journals also in Flanders, despite it being listed on predatoryjournals.org.

16.03.2025 10:23 πŸ‘ 0 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0