Open Science

1. Citation Standards

All data, program code and other methods should be appropriately cited. Such materials should be recognized as original intellectual contributions and afforded recognition through citation. Articles will not be published until the citations conform to these standards.

1. All data sets and program code used in a publication should be cited in the text and listed in the reference section.
2. References for data sets and program code should include a persistent identifier, such as a Digital Object Identifier (DOI). Persistent identifiers ensure future access to unique published digital objects, such as a text or data set. Persistent identifiers are assigned to data sets by digital archives, such as institutional repositories and partners in the Data Preservation Alliance for the Social Sciences (Data-PASS).
3. Data set citation example: Campbell, Angus, and Robert L. Kahn. American National Election Study, 1948. ICPSR07218v3. Ann Arbor, MI: Interuniversity Consortium for Political and Social Research [distributor], 1999. http://doi.org/10.3886/ICPSR07218.v3

2. Data Transparency

The policy of the Social Psychological Bulletin is to publish papers only if the data are clearly and precisely documented and are maximally available to any researcher for purposes of reproducing the results or replicating the procedure.

1. Authors reusing data available from public repositories must provide program code, scripts for statistical packages, and other documentation sufficient to allow an informed researcher to precisely reproduce all published results.
2. Authors using original data must: 
   1. make the data available at a trusted digital repository (Note: If all data required to reproduce the reported analyses appears in the article text, tables, and figures then it does not also need to be posted to a repository.)
   2. include all variables, treatment conditions, and observations described in the manuscript
   3. provide a full account of the procedures used to collect, preprocess, clean, or generate the data
3. In rare cases, despite authors’ best efforts, some or all data cannot be shared for legal or ethical reasons. In such cases, authors must inform the editors at the time of submission. This will be taken into account during the review process. Authors are encouraged to anticipate data sharing at the beginning of their projects to provide for these circumstances. It is understood that in some cases access will be provided under restrictions to protect confidential or proprietary information. Editors may grant exceptions to data and material access requirements provided authors:
   1. explain the restrictions on the dataset and how they preclude public access.
   2. provide a public description of the steps others should follow to request access to the data.
   3. provide access to all data for which the constraints do not apply.
4. Data should be made available through PsychArchives (trusted digital repository). Trusted repositories adhere to policies that make data discoverable, accessible, usable, and preserved for the long term. Trusted repositories also assign unique and persistent identifiers. For example these services are offered by partners in the Data Preservation Alliance for the Social Sciences (Data-PASS) and most institutional repositories. Author maintained websites are not compliant with this requirement.
   1. Dissemination of these data may be delayed until publication. Under exceptional circumstances, editors may grant an embargo of the public release of data for at most one year after publication.
   2. Articles accepted for publication will not be assigned a publication date until the above conditions have been met. Authors are responsible for ensuring that their articles continue to meet these conditions. Failure to do so may lead to an editorial expression of concern or retraction of the article.

3. Code Transparency

The policy of the Social Psychological Bulletin is to publish papers where authors indicate whether the methods used in the analysis will be made available to any researcher for purposes of reproducing the results or replicating the procedure.

1. Authors must, in acknowledgments or the first footnote, indicate if they will or will not analytic methods (code) available to other researchers.
2. If an author agrees to make materials available, the author must specify where that material will be available.

4. Materials Transparency

The policy of the Social Psychological Bulletin is to publish papers where authors indicate whether the materials used to conduct the research will be made available to any researcher for purposes of reproducing the results or replicating the procedure.

1.  Authors must, in acknowledgments or the first footnote, indicate if they will or will not make their study materials available to other researchers.
2. If an author agrees to make materials available, the author must specify where that material will be available.

5. Design Transparency

The policy of the Social Psychological Bulletin is to publish papers where authors follow standards for disclosing key aspects of the research design and data analysis. Authors are encouraged to review the standards available for many research applications from http://www.equator-network.org/ and use those that are relevant for the reported research applications.

6./7. Study and Analysis Preregistration

The policy of the Social Psychological Bulletin is to publish papers where authors indicate whether or not the conducted research was preregistered with an analysis plan in an independent, institutional registry (e.g., https://www.psycharchives.org/, http://aspredicted.org/, http://clinicaltrials.gov/, http://socialscienceregistry.org/ , https://osf.io/ , http://egap.org/designregistration/ , http://ridie.3ieimpact.org/). Preregistration of studies involves registering the study design, variables, and treatment conditions. Including an analysis plan involves specification of sequence of analyses or the statistical model that will be reported. A link to the preregistration in an institutional registry must be made available to the journal prior to publication. The journal, or an entity acting on behalf of the journal, will verify that preregistration adheres to the specifications for preregistration and then provide certification of the preregistration in the article.

1. Authors must, in acknowledgments or the first footnote, indicate if they did or did not preregister the research with or without an analysis plan in an independent, institutional registry.
2. If an author did preregister the research with an analysis plan, the author must: 
   1. confirm in the text that the study was registered prior to conducting the research with links to the timestamped preregistrations at the institutional registry, and that the preregistration adheres to the disclosure requirements of the institutional registry or those required for the preregistered badge with analysis plans maintained by the Center for Open Science.
   2. Report all preregistered analyses in the text, or, if there were changes in the analysis plan following preregistration, those changes must be disclosed with explanation for the changes.
   3. Clearly distinguish in text analyses that were preregistered from those that were not, such as having separate sections in the results for confirmatory and exploratory analyses.

8. Replication

The policy of the Social Psychological Bulletin is to encourage submission of replication studies, particularly of research published in this journal. When possible, replication studies are reviewed in two stages following the Registered Reports format. In particular, the first stage of review is conducted prior to the data being collected or, for existing datasets, before the outcomes are observed.

1. On initial submission, authors should:
   1. Denote in the cover letter that the manuscript is Registered Report submission and confirm that the data do not exist, or that the outcomes have not been observed.
   2. Include a full manuscript for the abstract, introduction, and methods without the results and discussion sections.
   3. The methods must contain a complete analysis plan of what is to be included in the full article.
2. If the submission passes initial review, then the authors will receive an in-principle acceptance prior to data collection or analysis of the outcomes.
3. For the second stage of review, authors submit a complete manuscript. Reviewers assess the extent to which the authors followed the preregistered design and/or analysis plan, and evaluate non-outcome relevant criteria (e.g., manipulation checks) to confirm whether the research was an effective test of the research question.