MetaROR's Avatar

MetaROR

@metaror

MetaROR is a community initiative led jointly by RoRI and AIMOS. It provides a platform that leverages the publish–review-curate model to improve the dissemination and evaluation of metaresearch.

402
Followers
83
Following
72
Posts
11.03.2025
Joined
Posts Following

Latest posts by MetaROR @metaror

👏 Aside from the author, we also extend thanks to reviewer Andrew Gelman and our editor Kathryn Zeiler.

04.03.2026 21:23 👍 0 🔁 0 💬 0 📌 0
Preview
Risk of Bias in Robustness Reports - MetaROR

Today, author @tomhardwicke.bsky.social argues "that without safeguards, Synchronous Robustness Reports could inadvertently create more confusion than clarity about robustness.

The reviewer, among other things, suggests distinguishing between different types of reports.

👇 Read it now on MetaROR

04.03.2026 21:20 👍 0 🔁 2 💬 1 📌 0

👏 Our thanks go out to the authors (Steffen Lemke, Isabella Peters), reviewers (including Emanuel Kulczycki) and editor (@ludowaltman.bsky.social)

02.03.2026 09:48 👍 0 🔁 0 💬 0 📌 0
Preview
The State of Bronze Open Access in Web of Science - MetaROR

🔓 Our latest article presents an analysis of bronze open access publications in the Web of Science database.

Reviewers did not identify major weaknesses, calling it solid, timely & sound, and suggested expanding the discussion on the concept of bronze OA.

👇 Read the full evaluation now on MetaROR

02.03.2026 09:45 👍 1 🔁 2 💬 1 📌 0
Preview
Partnership with journals - MetaROR About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...

🤝 We are happy to announce another new partner journal: @jcre.bsky.social

The Journal of Comments and Replications in Economics "aims for articles that comment on or replicate previously published articles in economics & closely related disciplines"

👇 See our full list of partners on our website

26.02.2026 09:32 👍 2 🔁 1 💬 0 📌 0

👏 A big thank you to our authors (@helenedraux.bsky.social, Briony Fane, @dwh.bsky.social, @jwastl.bsky.social, @pslewis.bsky.social, Molly Morgan Jones, Pablo Roblero, @jameswilsdon.bsky.social), reviewers, and editors ( @aidybarnett.bsky.social, Kathryn Zeiler) for their contributions

25.02.2026 10:18 👍 4 🔁 1 💬 0 📌 0
Preview
Understanding the importance of SHAPE to the UK research ecosystem - MetaROR

🇬🇧 Our latest paper "uses broad bibliometrics to compare the STEM and SHAPE sectors over time in the UK, with comparisons to other countries"

Reviewers find it timely & useful, yet suggest a different analytical approach as well as a tighter definition of SHAPE

👇 Find the full evaluation on MetaROR

25.02.2026 09:53 👍 2 🔁 3 💬 1 📌 0
Preview
Partnership with journals - MetaROR About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...

🤝 MetaROR is happy to announce Replication Research as its new partner journal!

@r2journal.bsky.social is an interdisciplinary journal for replication research focusing on reproductions, close replications and conceptual replications.

👇 See our full list of partners on our website

19.02.2026 09:49 👍 3 🔁 5 💬 0 📌 0

🙏 We are grateful to our authors (Susana Oliveira Henriques, Narmin Rzayeva, @stephenpinfield.bsky.social and @ludowaltman.bsky.social), our reviewers (Pen-Yuan Hsing and @rmounce.mastodon.social.ap.brid.gy) and our editor (Kathryn Zeiler) for their valuable contributions.

18.02.2026 14:29 👍 0 🔁 0 💬 0 📌 0
Preview
Preprint review services: Disrupting the scholarly communication landscape? - MetaROR

We published a 2nd round of reviews for a paper on preprint review services' "potential to turn peer review into a more transparent and rewarding experience and to improve publishing and peer review workflows"

Reviewers see improvements while still highlighting a potential issue.

👇 Read on MetaROR

18.02.2026 12:56 👍 5 🔁 1 💬 1 📌 1
Preview
Partnership with journals - MetaROR About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...

🤝 MetaROR is happy to announce Psychology, Public Policy, & Law as its partner. @pppl-journal.bsky.social "provides a forum to critically evaluate contributions of psychology & related disciplines to public policy & legal issues & vice versa."

👇 See our list of partners metaror.org/partner-jour...

16.02.2026 10:58 👍 3 🔁 1 💬 0 📌 0

This article was presented at @stienid2025.bsky.social and came to MetaROR as part of a collaboration between the conference and our platform. Stay tuned for more STI-ENID contributions to appear here!

11.02.2026 12:44 👍 0 🔁 0 💬 0 📌 0

👏 We want to thank our authors (@aurakivilaakso.bsky.social, Henna Moore, Johanna Kolhinen), reviewers (Isabella Peters, Marta Natalia Wróblewska) and editor (@ludowaltman.bsky.social) for their contributions

11.02.2026 12:42 👍 1 🔁 0 💬 0 📌 0
Preview
Exploring interdisciplinarity – raising self-awareness through a comprehensive research assessment - MetaROR

For the University of Helsinki's comprehensive research assessment, researchers designed a dedicated module to capture interdisciplinarity.

Reviewers called their approach "inspiring" and did not identify major weaknesses, but do provide recommendations.

👇 Read the assessment, reviews & full text

11.02.2026 12:40 👍 6 🔁 5 💬 2 📌 0
Post image

We are now a partner journal of @metaror.bsky.social, @jcre.bsky.social, and The Tromsø Repository of Language and Linguistics (TROLLing). Read the full announcement here: www.uni-muenster.de/Ejournals/in...

04.02.2026 13:04 👍 2 🔁 4 💬 0 📌 0
MetaROR’s approach to Crossref DOI registration

MetaROR’s approach to Crossref DOI registration

Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach

doi.org/10.64000/vfe...

Together with @andre-brasil.bsky.social I just published this blog post about @crossref.bsky.social DOI registration practices for @metaror.bsky.social.

05.02.2026 07:15 👍 16 🔁 13 💬 1 📌 1
Preview
Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach - Crossref A couple of months ago, Ludo Waltman and André Brasil raised some questions about good practices for Crossref DOI registration, asking for input from the scholarly communication community. In this pos...

@metaror.bsky.social has made some major decisions about its deployment of DOIs:We will mint separate DOIs for peer-reviewed preprints using the 'article' reference type. @ludowaltman.bsky.social and André Brasil lay out our reasoning here: www.crossref.org/blog/innovat...

04.02.2026 19:13 👍 2 🔁 2 💬 0 📌 0

Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach

https://metaror.org/innovation-in-scientific-publishing-and-its-implications-for-crossref-doi-registration-practices-metarors-approach/

04.02.2026 09:43 👍 0 🔁 0 💬 0 📌 0
Preview
Likelihood Ratio Test for Publication Bias – a proof of concept - MetaROR

Publication bias poses a serious challenge to clarity and precision in scientific research & meta-analyses. This article by Paweł Lenartowicz poses a way to deal with this: the Likelihood Ratio Test for Publication Bias.

👇 Read the editorial assessment, peer reviews, and full article on MetaROR now

03.02.2026 16:49 👍 8 🔁 3 💬 0 📌 0

🙏 We thank the authors (@lutzb.bsky.social, Christian Leibel), reviewers (Simon Wakeling, Paul Wouters) and editor (@ludowaltman.bsky.social) for their contributions

11.12.2025 15:08 👍 0 🔁 0 💬 0 📌 0
Preview
Citation accuracy, citation noise, and citation bias: A foundation of citation analysis - MetaROR

Our latest article argues that citation noise "represents an [...] underexplored challenge in citation analysis".

Reviewers appreciate the fresh/innovative approach but question its conceptual underpinning: can citation accuracy be determined objectively?

👇 Read the assessment, reviews & full text

11.12.2025 14:54 👍 5 🔁 5 💬 1 📌 0

Really great to see this paper get published with our partner #JDIS after being reviewed at MetaROR!

08.12.2025 10:52 👍 1 🔁 1 💬 0 📌 0
Post image Post image

@metaror.bsky.social is now 1 year old 🎉

In our first year: 28 articles evaluated, 59 expert reviewers, most reviews published ahead of target, 9 partner journals, and growing visibility across conferences & media.

A strong start for community-owned, open peer review: metaror.org/metaror-turn...

03.12.2025 10:39 👍 8 🔁 4 💬 0 📌 0

That's great news, Serhii! Congratulations on the JDIS acceptance 👏

21.11.2025 16:41 👍 1 🔁 0 💬 0 📌 0
Preview
Partnership with journals - MetaROR About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...

🤝 We have also launched partnerships with 9 journals, who are formally committed to base its publication decisions fully or partially on review reports published by MetaROR.

We'd like to thank these journals for their trust and look forward to continued collaboration together!

[2/3]

21.11.2025 13:43 👍 2 🔁 0 💬 1 📌 0

🙏 Of course, we're grateful to all contributing editors, authors & reviewers.

Special thanks to @aschniedermann.bsky.social, @serhiinazarovets.bsky.social, @csmarcum.sciences.social.ap.brid.gy, @hldejonge.bsky.social & @jeroenson.bsky.social whose valuable feedback we mentioned in the piece.

[3/3]

21.11.2025 13:42 👍 4 🔁 0 💬 0 📌 0
Preview
MetaROR Turns One - MetaROR An exciting year of open, community-driven evaluation of metaresearch One [...]

🎈 Time flies! Exactly one year ago today @rorinstitute.bsky.social and @aimosinc.bsky.social launched MetaROR, a platform to publish metaresearch through the publish-review-curate approach.

Over the course of the year, we published 28 articles reviewed by 59 different reviewers.

[1/3]

21.11.2025 13:39 👍 21 🔁 14 💬 3 📌 3
Post image

Discussion about next steps for MetaROR @metaror.bsky.social A partnership between @aimosinc.bsky.social and @rorinstitute.bsky.social

Led by @alexh.bsky.social and @aidybarnett.bsky.social

#AIMOS2025

20.11.2025 04:38 👍 8 🔁 4 💬 0 📌 0

More people need to know about MetaROR @metaror.bsky.social! If you are doing meta-research, then you get that the for-profit publishing system is a headache – you can help sideline journals by having your preprints handled by the MetaROR team for the peer review process. #AIMOS2025

20.11.2025 10:13 👍 14 🔁 6 💬 0 📌 0

🙏 A big thank you to our author (Bence Orkeny), reviewers (Olavo Amaral, Sven Ulpts) and editors (@jabyrnesci.bsky.social, Kathryn Zeiler)

19.11.2025 10:33 👍 1 🔁 0 💬 0 📌 0