Changing journal policies

2023-10-25 Wed

Rick Gilmore

Overview

Announcements

• Due Friday
  • Exercise 06: Replication

Today

Solutions

• Finish discussion of (Munafò et al., 2017)

Changing journal policies

• Discuss
  • (Nosek et al., 2015)
  • (Gilmore, Cole, Verma, Aken, & Worthman, 2020) and (SRCD, 2019)

(Munafò et al., 2017)

Table 1

Link: https://www.nature.com/articles/s41562-016-0021/tables/1

Note

Which of the practices recommended in Table 1 from Munafò et al. (2017) recommended practices would be at the top of your to-do list if you were a journal editor/publisher, funder, institution (college or university), or regulator (e.g., government entity)? Why?

Which would be at the bottom of your list? Why?

What’s missing from the list?

What can students, who aren’t yet editors, funders, institutions, or regulators do?

(Nosek et al., 2015)

Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., … Yarkoni, T. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374

Transparency and Openness Promotion (TOP) guidelines

Figure from Nosek et al. (2015)

TOP Factor database

TOP Factors for journals Rick Gilmore has published in recently

• There are many factors that influence where an author publishes a paper.

Notes

• (Nosek et al., 2015) was behind a paywall.
• I was able to access the article via authenticated access to libraries.psu.edu.
• There were two files of supplementary materials
  • https://www-science-org.ezaccess.libraries.psu.edu/doi/suppl/10.1126/science.aab2374/suppl_file/aab2374-nosek-sm.pdf
  • https://www-science-org.ezaccess.libraries.psu.edu/doi/suppl/10.1126/science.aab2374/suppl_file/top_guidelines_summary-google_sheets_files.zip
• There was an Open Access (OA) version of the article available on OSF.

Changing society & journal policies

• Gilmore et al. (2020)
• SRCD (2019)

Note

Do you think that explaining why data and materials sharing is important will help persuade researchers to do more?

N.B. – SRCD’s Child Development has a TOP Factor score of 7.

Notes

• The article abstract was publicly available, but the full article was behind a paywall.
• I was able to access the article via authenticated access to libraries.psu.edu.

Next time

Final project work day

• Due
  • Exercise 06: Replication
• Optional Extra Credit Assignment - For 5 extra credit points, write a paragraph that summarizes the main findings of (Camerer et al., 2018). Due Friday, November 3.

Resources

References

Camerer, C. F., Dreber, A., Holzmeister, F., Ho, T.-H., Huber, J., Johannesson, M., … Wu, H. (2018). Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour, 1. https://doi.org/10.1038/s41562-018-0399-z

Gilmore, R. O., Cole, P. M., Verma, S., Aken, M. A. G., & Worthman, C. M. (2020). Advancing scientific integrity, transparency, and openness in child development research: Challenges and possible solutions. Child Development Perspectives, 14(1), 9–14. https://doi.org/10.1111/cdep.12360

Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Sert, N. P. du, … Ioannidis, J. P. A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1, 0021. https://doi.org/10.1038/s41562-016-0021

Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., … Yarkoni, T. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374

SRCD. (2019). Policy on scientific integrity, transparency, and openness | society for research in child development SRCD. https://www.srcd.org/policy-scientific-integrity-transparency-and-openness. Retrieved from https://www.srcd.org/policy-scientific-integrity-transparency-and-openness