Changing journal policies

Roadmap

• Announcements
  • Exercise 03: Alpha, Power, Effect Sizes, & Sample Size write-up due today.
• Discuss
  • B. A. Nosek et al. (2015)
  • Gilmore et al. (2020)
  • SRCD (2019)

B. A. Nosek et al. (2015)

Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., … Yarkoni, T. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374

Transparency and Openness Promotion (TOP) guidelines

Figure 87: Figure from B. A. Nosek et al. (2015)

• TOP Factor database

TOP factor for journals I’ve published in recently

Figure 88: TOP Factors for Journals Rick Gilmore has published in recently

• There are many factors that influence where an author publishes a paper.

Notes

• Article was behind a paywall.
• I was able to access the article via authenticated access to libraries.psu.edu.
• There were two files of supplementary materials
  • https://www-science-org.ezaccess.libraries.psu.edu/doi/suppl/10.1126/science.aab2374/suppl_file/aab2374-nosek-sm.pdf
  • https://www-science-org.ezaccess.libraries.psu.edu/doi/suppl/10.1126/science.aab2374/suppl_file/top_guidelines_summary-google_sheets_files.zip
• There was an Open Access (OA) version of the article available on OSF.

Changing society & journal policies

• Gilmore et al. (2020)
• SRCD (2019)

Do you think that explaining why data and materials sharing is important will help persuade researchers to do more?

N.B. – SRCD’s Child Development has a TOP Factor score of 7.

Notes

• The article abstract was publicly available, but the full article was behind a paywall.
• I was able to access the article via authenticated access to libraries.psu.edu.

Next time…

• Assignment distributed
  • Exercise 04: Replication
• Large-scale replication studies
  • Collaboration (2015)
  • (Optional) Camerer et al. (2018)
    • For 5 extra credit points, write a paragraph that summarizes the main findings of this paper. Due Tuesday, March 28.

References

Camerer, C. F., Dreber, A., Holzmeister, F., Ho, T.-H., Huber, J., Johannesson, M., … Wu, H. (2018). Evaluating the replicability of social science experiments in nature and science between 2010 and 2015. Nature Human Behaviour, 1. https://doi.org/10.1038/s41562-018-0399-z

Collaboration, O. S. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716

Gilmore, R. O., Cole, P. M., Verma, S., Aken, M. A. G., & Worthman, C. M. (2020). Advancing scientific integrity, transparency, and openness in child development research: Challenges and possible solutions. Child Development Perspectives, 14(1), 9–14. https://doi.org/10.1111/cdep.12360

Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., … Yarkoni, T. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374

SRCD. (2019). Policy on scientific integrity, transparency, and openness | society for research in child development SRCD. https://www.srcd.org/policy-scientific-integrity-transparency-and-openness. Retrieved from https://www.srcd.org/policy-scientific-integrity-transparency-and-openness