We are currently identifying initial pilot replication projects. Our planned procedure is as follows:
- Researchers volunteer to conduct replications (referred to as “replicators” hereafter).
• Replicators will be recruited from multiple institutions, to help deal with conflict of interest issues.
• Volunteers need to first establish feasibility in terms of their institution’s IRB policies. - Authors file a request in the online portal and upload their materials to their own OSF folder:
• Approved IRB application from own institution
• Pre-registration
• Stimuli, ideally a Qualtrics .qsf file
• Analysis plan or code, ideally in R
• Draft or template language for reporting results
The Authors can pre-specify contingencies such as criteria for the study to be a valid test, e.g., manipulation checks or minimal levels on outcome variables. - A non-conflicted Replicator will review the request for fit with criteria
• Only appropriate for confirmatory analyses where all conclusions can be pre-specified
• Low participant risk, no deception, online implementation - If approved, Replicator files IRB with their own institution.
- Authors pay for participant compensation fees and online platform costs.
• Authors can request funding for these costs based on having limited research resources. - After IRB approval, Replicator runs study, runs code and updates draft language with results. Replicator posts all files in our indeprep OSF folder and completes an online form documenting the conclusion of the project.
- Authors include study writeup in their own paper.
- At Authors’ request, read-only access link to a project-specific OSF folder is provided, to be included in paper or shared with reviewers.
- Three years after the date of the study, the OSF folder including the original request and author identity is automatically made public, and the project is listed on our web page.
Independent Replication 