The #LoveReplicationsWeek has concluded. Thank you to the 19 speakers and 162 participants! We hope that you could get a glimpse of the amount of love that there is for replications and reproductions.
Website: forrt.org/LoveReplicat...
Slides: zenodo.org/communities/...
To conclude the #LoveReplicationsWeek, Nina Ehmann and Alexandra Sarafoglou are running a workshop on doing a reproduction/reanalysis. There is no registration needed and if you have 90 minutes to spare, just join here: uva-live.zoom.us/j/67572089628
Now that is an informative and beautiful roadmap for a replication study with lots of beautiful @cos.io flowers along the way
@susanne-adler.bsky.social is discussing how replications and educations are the perfect fit. In an MBA seminar, students learn how to conduct a replication & extension and have the option to become a co-author on the eventual preprint/paper.
We have two more events for the last day of the #LoveReplicationsWeek!
- @susanne-adler.bsky.social will talk about how to do replications together with students
- Nina Ehmann will run a workshop on doing a reanalysis that can subsequently be submitted to the Journal of Robustness Reports
We occasionally discuss whether and where to publish FReD 2.0 and FLoRA. While I wish JOPD was Diamond OA, it still looks much better to me than Nature Scientific Data. Also, papers with >100 authors don't need expensive journals to gain visibility but they should support community-owned journals.
Also, anybody can contribute. We have lots of tasks for different types of expertise and different amounts of resources. Get in touch with us @lukaswallrich.bsky.social @forrt.bsky.social or me and join the FORRT Slack to keep up to date: join.slack.com/t/forrt/shar...
FReD and FLoRA are the product of 4 years of work by hundreds of people, most of which are/were students and ECRs. We are sharing our work for free with the world and have made sure it is well-documented & long-term archived.
R Package: forrt.org/FReD/index.h...
Citation: forrt.org/about/cite_us/
The FORRT Library of Reproduction and Replication Attempts (FLoRA) will be the basis of upcoming tools and projects that help replications and reproductions become a natural and difficult to ignore part of research. It is already implemented in our FLoRA Annotator: forrt.org/annotator/
In 2026, we have begun to scale up our ambitions: Now counting >250 contributors, our aim is to create a comprehensive and multidiscplinary library that links original studies with replications and reproductions. For this, we are dropping statistics but still use the replicators' outcome assessment.
In 2025, we teamed-up with @cos.io. We started with the crowdsourced version and turned it into a double-coded and validated FReD 2.0 with 1K pairs of replications and original studies - including effect sizes, sample sizes, test statistic, and everything that makes a meta-scientist's heart smile.
It's FReD Friday AND #LoveReplicationsWeek, so here is a recap of what has been going on with the FORRT Replication Database. In 2024, we published the paper on our dataset with 99 (!) authors. But this was only the beginning. doi.org/10.5334/jopd.101
One of my favourite parts: Simply cite R and all packages that you used with just a few lines of code.
@mklingelhoeferj.bsky.social from @igor-dgps.bsky.social is now presenting a tutorial on how to write reproducible manuscripts using RMarkdown.
@jorowags.bsky.social & @lililazarevic.bsky.social are now presenting the Collaborative Replication and Education Project (CREP). At CREP, students are supervised and conduct direct replications that are then published as data or reports: www.crep-psych.org
Big Team Science projects like ManyBabies work best if many people contribute, you can get involved here: manybabies.org/get_involved/ or reach out to @hbaum.bsky.social
Then they compared their results to a traditional meta-analysis and MetaLab's community-augmented meta-analysis (langcog.github.io/metalab/), finding that the replications had much more homogeneous effect sizes and different moderators. (sorry, all of these slides are really exciting)
For example, for ManyBabies 1 ("Do babies prefer infant-directed speech vs. adult-directed speech?"), they tested >2K babies with 149 authors from 16 countries. The hypothesis could be confirmed - but there was also a methods effect and lots of variability through age and language.
@chbergma.bsky.social is now discussing replications versus meta-analyses in the context of infant studies. For example, at @manybabies.org, researchers are teaming up to promote open science and replications.
I'll kick things off today with recommendations on what a reproduction/replication report should include. Slides are available already: doi.org/10.5281/zeno... I'll dive into special features of repetitions and share useful resources for writing reports and submitting them to @r2journal.bsky.social
Welcome to #LoveReplicationsWeek Day 4 - with 4 events!
- Getting your replication report ready by @r2journal.bsky.social
- Large scale replications vs. Meta-analyses by @chbergma.bsky.social
- CREP by @jorowags.bsky.social
- Writing Reproducible Manuscripts by @mklingelhoeferj.bsky.social
⏳ 2 weeks left to apply to the Making Replications Count Hackathon (Münster, 4–6 May 2026). Join us to build open tools that make replications impossible to ignore. Apply by 16 March: indico.uni-muenster.de/e/marco2
Finally, there is Replication Research (R2) @r2journal.bsky.social
- it was founded last fall and is part of the FORRT Replication Hub, a collection of projects that serve the aim to support replications
- R2 accepts reproductions, replications, and conceptual contributions from all fields
The Journal of Open Psychology Data has a special format
- JOPD has open reviews and focuses on psychology
- apart from data papers, they also accept 'verification reports': registered reports of reanalyses (robustness reproductions)
- they offer mentoring for ECRs
- openpsychologydata.metajnl.com
The Journal of Robustness Reports was launched last year and has its origin in many-analysts studies:
- they publish reanalysis snapshots from already-published findings
- at least 2 independent reports are required
- you can nominate target articles
- www.journalofrobustnessreports.org
The Journal of Comments and Replications in Economics @jcre.bsky.social is maintained by the @zbw-leibniz.bsky.social , the world's largest subject library in economics
- They accept reproductions, replications and comments and usually publish articles from empirical quantitative econ
- jcr-econ.org
Rescience X is Rescience C's sister journal for experimental research.
- they accept multiple article types such as replications of methods and have open peer-review (opt-out)
- They are using the Open Journal System, rescience.org
Rescience C is for reproduction studies in computational sciences
- Submissions can come from all domains
- It has open and non-anonymous review
- Since 2020, self-reproductions are allowed - provided they are at least 10 years old
- It lives on Github: rescience.github.io
There will be a short presentation from each journal plus room for questions. For an overview of the different scopes, see our handbook: forrt.org/replication_...
Next up is the Replication Journal Showcase featuring six journals that focus on replications:
- Rescience C
- Rescience X
- @jcre.bsky.social
- Journal of Robustness Reports
- Journal of Open Psychology Data (verification reports)
- and of course our own journal R2 @r2journal.bsky.social
