Schedule

January 9 - 13

Tuesday, January 10

Thursday, January 12

January 16 - 20

Tuesday, January 17

January 23 - 27

Tuesday, January 24

Thursday, January 26

January 30 - February 3

Tuesday, January 31

Thursday, February 2

February 6 - 10

Thursday, February 9

February 13 - 17

Tuesday, February 14

Thursday, February 16

February 20 - 24

Tuesday, February 21

Thursday, February 23

February 27 - March 3

Tuesday, February 28

Thursday, March 2

March 6-10 (Spring Break)

NO CLASS

March 13 - 17

Tuesday, March 14

March 20 - 24

Tuesday, March 21

Thursday, March 23

March 27 - 31

Tuesday, March 28

  • Project work day

April 3 - 7

Tuesday, April 4

  • Project work day

  • Data sharing

  • Read

Thursday, April 6

April 10 - 14

Tuesday, April 11

April 17 - 21

Tuesday, April 18

  • In-class final project work day

Thursday, April 20

  • Project work day (on your own)

April 24 - 28

Tuesday, April 25

Thursday, April 27

May 1-5

Wednesday, May 3

References

Anderson, Melissa S, Emily A Ronning, Raymond Devries, and Brian C Martinson. 2010. “Extending the Mertonian Norms: Scientists’ Subscription to Norms of Research.” The Journal of Higher Education 81 (3): 366–93. https://doi.org/10.1353/jhe.0.0095.
Bargh, J A, M Chen, and L Burrows. 1996. “Automaticity of Social Behavior: Direct Effects of Trait Construct and Stereotype-Activation on Action.” Journal of Personality and Social Psychology 71 (2): 230–44. https://doi.org/10.1037//0022-3514.71.2.230.
Begley, C Glenn. 2013. “Six Red Flags for Suspect Work.” Nature 497 (7450): 433–34. https://doi.org/10.1038/497433a.
Begley, C Glenn, and Lee M Ellis. 2012. “Drug Development: Raise Standards for Preclinical Cancer Research.” Nature 483 (7391): 531–33. https://doi.org/10.1038/483531a.
Bhattacharjee, Yudhijit. 2013. “The Mind of a Con Man.” The New York Times, April. https://www.nytimes.com/2013/04/28/magazine/diederik-stapels-audacious-academic-fraud.html.
Brainerd, Jeffrey, and Jia You. 2018. “What a Massive Database of Retracted Papers Reveals about Science Publishing’s ‘Death Penalty’.” Science, October. https://doi.org/10.1126/science.aav8384.
Camerer, Colin F, Anna Dreber, Felix Holzmeister, Teck-Hua Ho, Jürgen Huber, Magnus Johannesson, Michael Kirchler, et al. 2018. “Evaluating the Replicability of Social Science Experiments in Nature and Science Between 2010 and 2015.” Nature Human Behaviour, August, 1. https://doi.org/10.1038/s41562-018-0399-z.
Carney, Dana R, Amy J C Cuddy, and Andy J Yap. 2010. “Power Posing: Brief Nonverbal Displays Affect Neuroendocrine Levels and Risk Tolerance.” Psychological Science 21 (10): 1363–68. https://doi.org/10.1177/0956797610383437.
Carpenter, Siri. 2012. “Harvard Psychology Researcher Committed Fraud, U.S. Investigation Concludes.” Science. https://doi.org/10.1126/article.26972.
Claesen, Aline, Sara Gomes, Francis Tuerlinckx, and Wolf Vanpaemel. 2021. “Comparing Dream to Reality: An Assessment of Adherence of the First Generation of Preregistered Studies.” Royal Society Open Science 8 (211037). https://doi.org/10.1098/rsos.211037.
Collaboration, Open Science. 2015. “Estimating the Reproducibility of Psychological.” Science 349 (6251): aac4716. https://doi.org/10.1126/science.aac4716.
Crüwell, Sophia, Johnny van Doorn, Alexander Etz, Matthew C Makel, Hannah Moshontz, Jesse C Niebaum, Amy Orben, Sam Parsons, and Michael Schulte-Mecklenbeck. 2019. “Seven Easy Steps to Open Science.” Zeitschrift für Psychologie 227 (4): 237–48. https://doi.org/10.1027/2151-2604/a000387.
Cuddy, Amy. 2012. “Your Body Language May Shape Who You Are.” https://www.ted.com/talks/amy_cuddy_your_body_language_may_shape_who_you_are.
Doyen, Stéphane, Olivier Klein, Cora-Lise Pichon, and Axel Cleeremans. 2012. “Behavioral Priming: It’s All in the Mind, but Whose Mind?” PloS One 7 (1): e29081. https://doi.org/10.1371/journal.pone.0029081.
Earp, Brian D, Jim A C Everett, Elizabeth N Madva, and J Kiley Hamlin. 2014. “Out, Damned Spot: Can the ‘Macbeth Effect’ Be Replicated?” Basic and Applied Social Psychology 36 (1): 91–98. https://doi.org/10.1080/01973533.2013.856792.
Errington, Timothy M, Alexandria Denis, Nicole Perfito, Elizabeth Iorns, and Brian A Nosek. 2021. “Challenges for Assessing Replicability in Preclinical Cancer Biology.” eLife 10 (December): e67995. https://doi.org/10.7554/eLife.67995.
Errington, Timothy M, Maya Mathur, Courtney K Soderberg, Alexandria Denis, Nicole Perfito, Elizabeth Iorns, and Brian A Nosek. 2021. “Investigating the Replicability of Preclinical Cancer Biology.” eLife 10 (December): e71601. https://doi.org/10.7554/eLife.71601.
Feynman, R P. 1974. “Cargo Cult Science.” https://calteches.library.caltech.edu/51/2/CargoCult.htm. https://calteches.library.caltech.edu/51/2/CargoCult.htm.
Fidler, Fiona, and John Wilcox. 2021. “Reproducibility of Scientific Results.” In The Stanford Encyclopedia of Philosophy, edited by Edward N Zalta, Summer 2021. Metaphysics Research Lab, Stanford University. https://plato.stanford.edu/archives/sum2021/entries/scientific-reproducibility/.
Franco, Annie, Neil Malhotra, and Gabor Simonovits. 2014. “Social Science. Publication Bias in the Social Sciences: Unlocking the File Drawer.” Science 345 (6203): 1502–5. https://doi.org/10.1126/science.1255484.
Gilmore, Rick O, and Karen E Adolph. 2017. “Video Can Make Behavioural Research More Reproducible.” Nature Human Behavior 1. https://doi.org/10.1038/s41562-017-0128.
Gilmore, Rick O, Pamela M Cole, Suman Verma, Marcel A G Aken, and Carol M Worthman. 2020. “Advancing Scientific Integrity, Transparency, and Openness in Child Development Research: Challenges and Possible Solutions.” Child Development Perspectives 14 (1): 9–14. https://doi.org/10.1111/cdep.12360.
Gilroy, Shawn P, and Brent A Kaplan. 2019. “Furthering Open Science in Behavior Analysis: An Introduction and Tutorial for Using GitHub in Research.” Perspectives on Behavior Science 42 (3): 565–81. https://doi.org/10.1007/s40614-019-00202-5.
Goldin-Meadow, S. 2016. “Why Preregistration Makes Me Nervous.” APS Observer 29 (7). https://www.psychologicalscience.org/observer/why-preregistration-makes-me-nervous.
Goodman, Steven N., Daniele Fanelli, and John P. A. Ioannidis. 2016. “What Does Research Reproducibility Mean?” Science Translational Medicine 8 (341): 341ps12–12. https://doi.org/10.1126/scitranslmed.aaf5027.
Harris, Richard. 2017. Rigor Mortis: How Sloppy Science Creates Worthless Cures, Crushes Hope, and Wastes Billions. 1 edition. Basic Books.
Houtkoop, Bobby Lee, Chris Chambers, Malcolm Macleod, Dorothy V M Bishop, Thomas E Nichols, and Eric-Jan Wagenmakers. 2018. “Data Sharing in Psychology: A Survey on Barriers and Preconditions.” Advances in Methods and Practices in Psychological Science, February, 2515245917751886. https://doi.org/10.1177/2515245917751886.
John, Leslie K, George Loewenstein, and Drazen Prelec. 2012. “Measuring the Prevalence of Questionable Research Practices with Incentives for Truth Telling.” Psychological Science 23 (5): 524–32. https://doi.org/10.1177/0956797611430953.
Kardash, Carolanne M, and Ordene V Edwards. 2012. “Thinking and Behaving Like Scientists: Perceptions of Undergraduate Science Interns and Their Faculty Mentors.” Instructional Science 40 (6): 875–99. https://doi.org/10.1007/s11251-011-9195-0.
Kathawalla, Ummul-Kiram, Priya Silverstein, and Moin Syed. 2021. “Easing into Open Science: A Guide for Graduate Students and Their Advisors.” Collabra. Psychology 7 (1). https://doi.org/10.1525/collabra.18684.
Kim, So Young, and Yoonhoo Kim. 2018. “The Ethos of Science and Its Correlates: An Empirical Analysis of Scientists’ Endorsement of Mertonian Norms.” Science, Technology and Society 23 (1): 1–24. https://doi.org/10.1177/0971721817744438.
Ledgerwood, Alison. 2018. “The Preregistration Revolution Needs to Distinguish Between Predictions and Analyses.” Proceedings of the National Academy of Sciences of the United States of America 115 (45): E10516–17. https://doi.org/10.1073/pnas.1812592115.
Levelt, W J M, P J D Drenth, and E Noort. 2012. “Flawed Science: The Fraudulent Research Practices of Social Psychologist Diederik Stapel.” https://pure.mpg.de/rest/items/item_1569964/component/file_1569966/content; pure.mpg.de. https://pure.mpg.de/rest/items/item_1569964/component/file_1569966/content.
Macfarlane, Bruce, and Ming Cheng. 2008. “Communism, Universalism and Disinterestedness: Re-Examining Contemporary Support Among Academics for Merton’s Scientific Norms.” Journal of Academic Ethics 6 (1): 67–78. https://doi.org/10.1007/s10805-008-9055-y.
Merton, Robert W. 1973. “The Normative Structure of Science.” In The Sociology of Science: Theoretical and Empirical Investigations, edited by Robert K Merton and Norman W Storer, 267–78. The University of Chicago Press.
Meyer, Michelle N. 2018. “Practical Tips for Ethical Data Sharing.” Advances in Methods and Practices in Psychological Science, February, 2515245917747656. https://doi.org/10.1177/2515245917747656.
Mitroff, Ian I. 1974. “Norms and Counter-Norms in a Select Group of the Apollo Moon Scientists: A Case Study of the Ambivalence of Scientists.” American Sociological Review 39 (4): 579–95. https://doi.org/10.2307/2094423.
Munafò, Marcus R., Brian A. Nosek, Dorothy V. M. Bishop, Katherine S. Button, Christopher D. Chambers, Nathalie Percie du Sert, Uri Simonsohn, Eric-Jan Wagenmakers, Jennifer J. Ware, and John P. A. Ioannidis. 2017. “A Manifesto for Reproducible Science.” Nature Human Behaviour 1 (January): 0021. https://doi.org/10.1038/s41562-016-0021.
National Institutes of Health. n.d. “NOT-OD-21-013: Final NIH Policy for Data Management and Sharing.” https://grants.nih.gov/grants/guide/notice-files/NOT-OD-21-013.html. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-21-013.html.
Ngiam, William. 2020. “ReproducibiliTea | Simmons, Nelson and Simonsohn (2011). False-Positive Psychology.” Youtube. https://www.youtube.com/watch?v=bf3GqyBRgzY.
Nosek, B. A., G. Alter, G. C. Banks, D. Borsboom, S. D. Bowman, S. J. Breckler, S. Buck, et al. 2015. “Promoting an Open Research Culture.” Science 348 (6242): 1422–25. https://doi.org/10.1126/science.aab2374.
Nosek, Brian A, and Yoav Bar-Anan. 2012. “Scientific Utopia i: Opening Scientific Communication.” Psychological Inquiry 23 (3): 217–43. https://doi.org/10.1080/1047840X.2012.692215.
Nosek, Brian A, Charles R Ebersole, Alexander C DeHaven, and David T Mellor. 2018. “The Preregistration Revolution.” Proceedings of the National Academy of Sciences of the United States of America 115 (11): 2600–2606. https://doi.org/10.1073/pnas.1708274114.
Nosek, Brian A, Tom Elis Hardwicke, Hannah Moshontz, Aurélien Allard, Katherine S Corker, Anna Dreber, Fiona Fidler, et al. 2022. “Replicability, Robustness, and Reproducibility in Psychological Science.” Annual Review of Psychology 73 (2022): 719–48. https://doi.org/10.1146/annurev-psych-020821-114157.
Nuijten, Michéle B, Chris H J Hartgerink, Marcel A L M van Assen, Sacha Epskamp, and Jelte M Wicherts. 2015. “The Prevalence of Statistical Reporting Errors in Psychology (1985–2013).” Behavior Research Methods, October, 1–22. https://doi.org/10.3758/s13428-015-0664-2.
Oreskes, Naomi. 2019. Why Trust Science. Princeton University Press.
Ranehill, Eva, Anna Dreber, Magnus Johannesson, Susanne Leiberg, Sunhae Sul, and Roberto A Weber. 2015. “Assessing the Robustness of Power Posing: No Effect on Hormones and Risk Tolerance in a Large Sample of Men and Women.” Psychological Science 26 (5): 653–56. https://doi.org/10.1177/0956797614553946.
Ritchie, Stuart. 2020. Science Fictions: Exposing Fraud, Bias, Negligence and Hype in Science. 1st ed. Penguin Random House. https://www.amazon.com/Science-Fictions/dp/1847925669.
Rosenthal, Robert. 1979. “The File Drawer Problem and Tolerance for Null Results.” Psychological Bulletin 86 (3): 638–41. https://doi.org/10.1037/0033-2909.86.3.638.
Sagan, Carl. 1996. The Demon-Haunted World: Science as a Candle in the Dark. Ballantine Books.
Silberzahn, R, E L Uhlmann, D P Martin, P Anselmi, F Aust, E Awtrey, Š Bahník, et al. 2018. “Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results.” Advances in Methods and Practices in Psychological Science 1 (3): 337–56. https://doi.org/10.1177/2515245917747646.
Simmons, Joseph P., Leif D. Nelson, and Uri Simonsohn. 2011. “False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant.” Psychological Science 22 (11): 1359–66. https://doi.org/10.1177/0956797611417632.
Soska, Kasey C, Melody Xu, Sandy L Gonzalez, Orit Herzberg, Catherine S Tamis-LeMonda, Rick O Gilmore, and Karen E Adolph. 2021. “(Hyper)active Data Curation: A Video Case Study from Behavioral Science.” Journal of Escience Librarianship 10 (3). https://doi.org/10.7191/jeslib.2021.1208.
SRCD. 2019. “Policy on Scientific Integrity, Transparency, and Openness | Society for Research in Child Development SRCD.” https://www.srcd.org/policy-scientific-integrity-transparency-and-openness. https://www.srcd.org/policy-scientific-integrity-transparency-and-openness.
Szucs, Denes, and John P A Ioannidis. 2017. “Empirical Assessment of Published Effect Sizes and Power in the Recent Cognitive Neuroscience and Psychology Literature.” PLoS Biology 15 (3): e2000797. https://doi.org/10.1371/journal.pbio.2000797.
Tenopir, Carol, Natalie M Rice, Suzie Allard, Lynn Baird, Josh Borycz, Lisa Christian, Bruce Grant, Robert Olendorf, and Robert J Sandusky. 2020. “Data Sharing, Management, Use, and Reuse: Practices and Perceptions of Scientists Worldwide.” PloS One 15 (3): e0229003. https://doi.org/10.1371/journal.pone.0229003.
Wilson, Laura C. 2014. “Introduction to Meta-Analysis: A Guide for the Novice.” https://www.psychologicalscience.org/observer/introduction-to-meta-analysis-a-guide-for-the-novice. https://www.psychologicalscience.org/observer/introduction-to-meta-analysis-a-guide-for-the-novice.
Zhong, Chen-Bo, and Katie Liljenquist. 2006. “Washing Away Your Sins: Threatened Morality and Physical Cleansing.” Science 313 (5792): 1451–52. https://doi.org/10.1126/science.1130726.