Replication studies—critical to verifying the validity of scientific findings—often face challenges when it comes to publication and discoverability. Many journals don't link replication studies to the original works, and these studies are often underfunded. To address this, the Framework for Open and Reproducible Research Training (FORRT) has developed a crowdsourced database that tracks and organizes replication studies, making them easier to find and connect to their original research.
The database is an evolving resource. While it currently consists of more than 3,300 entries tied to nearly 1,100 original studies, it continues to expand, thanks to the efforts of hundreds of volunteers. By manually entering studies, the database records whether replications succeeded or failed, helping researchers determine the robustness of findings across disciplines like psychology, decision-making, marketing, and medicine. In fields like psychology—heavily impacted by the replication crisis—this database serves as a vital tool for transparency and accountability.
One of the main issues the database tackles is the difficulty of tracking replication efforts. If a researcher wants to build on previous studies, it’s often challenging to determine if and how those studies have been replicated. Journals rarely link replication attempts to the original work, leaving researchers in the dark. This new system solves that problem, making it easier for mentors, educators, and researchers to track the replicability of the studies they are building upon.
The FORRT team is exploring ways to improve and automate the process. They plan to develop a machine-readable manuscript template that could automatically update the database with new replication attempts. Additionally, they hope to establish a search engine that would allow users to quickly search for replication studies by entering DOIs, further simplifying the research process.
The importance of replication in science cannot be overstated—reproducing results is fundamental to the scientific method. By ensuring replication studies are easily accessible, this database reinforces scientific rigor and helps researchers, policymakers, and the public separate strong, reliable findings from weaker, unverified claims.
The database also features a “replication tracker,” which shows the percentage of studies that successfully replicated the original findings versus those that failed. The initiative is committed to improving the visibility of replication work and hopes to launch a peer-reviewed, open-access journal dedicated solely to replication studies, providing a formal platform for this critical area of research.
The crowdsourced effort is built on collaboration, with participants logging their studies manually into the database. This grassroots approach means the database reflects the latest replication efforts in the social sciences. Looking ahead, the database aims to expand to include studies from other fields, such as biology, economics, and political science.
Ultimately, this initiative marks a significant step forward in addressing the replication crisis that has affected various scientific disciplines. By making replication attempts more visible and easier to track, the FORRT database supports efforts to promote transparency, credibility, and trust in scientific research.
For more details, visit:
Website https://www.scholarlyoa.org
Twitter https://x.com/ScholarlyOA
SoundCloud https://soundcloud.com/scholarly-open-access
Comments