Changing journal policies

2024-10-30 Wed

Rick Gilmore

Overview

Announcements

• Due next Friday, November 8
  • Exercise 07: Replication

Last time…

Solutions

• Discussion of Munafò et al. (2017)
• Solutions notes

Today

Changing journal policies

• Discuss
  • Nosek et al. (2015)
  • Gilmore, Cole, Verma, Aken, & Worthman (2020) and SRCD (2019)

Nosek et al. (2015)

Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., … Yarkoni, T. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374

Transparency and Openness Promotion (TOP) guidelines

Figure from Nosek et al. (2015)

Notes

• Nosek et al. (2015) was behind a paywall.
• I was able to access the article via authenticated access to libraries.psu.edu.
• There were two files of supplementary materials
  • https://www-science-org.ezaccess.libraries.psu.edu/doi/suppl/10.1126/science.aab2374/suppl_file/aab2374-nosek-sm.pdf
  • https://www-science-org.ezaccess.libraries.psu.edu/doi/suppl/10.1126/science.aab2374/suppl_file/top_guidelines_summary-google_sheets_files.zip
• There was an Open Access (OA) version of the article available on OSF.

Changing society & journal policies

• Gilmore et al. (2020)
• SRCD (2019)

Note

Do you think that explaining why data and materials sharing is important will help persuade researchers to do more?

N.B. – SRCD’s Child Development has a TOP Factor score of 7.

Notes

• The article abstract was publicly available, but the full article was behind a paywall.
• I was able to access the article via authenticated access to libraries.psu.edu.

Next time

Large-scale replication studies

• Read
  • Collaboration (2015)
• Class notes

Resources

References

Collaboration, O. S. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716

Gilmore, R. O., Cole, P. M., Verma, S., Aken, M. A. G., & Worthman, C. M. (2020). Advancing scientific integrity, transparency, and openness in child development research: Challenges and possible solutions. Child Development Perspectives, 14(1), 9–14. https://doi.org/10.1111/cdep.12360

Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Sert, N. P. du, … Ioannidis, J. P. A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1, 0021. https://doi.org/10.1038/s41562-016-0021

Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., … Yarkoni, T. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374

SRCD. (2019). Policy on scientific integrity, transparency, and openness | society for research in child development SRCD. https://www.srcd.org/policy-scientific-integrity-transparency-and-openness. Retrieved from https://www.srcd.org/policy-scientific-integrity-transparency-and-openness