Improving your statistical inferences (Coursera)

Subsequently, you will learn how to interpret evidence in the scientific literature given widespread publication bias, for example by learning about p-curve analysis. Finally, we will talk about how to do philosophy of science, theory construction, and cumulative science, including how to perform replication studies, why and how to pre-register your experiment, and how to share your results following Open Science principles.
In practical, hands on assignments, you will learn how to simulate t-tests to learn which p-values you can expect, calculate likelihood ratio's and get an introduction the binomial Bayesian statistics, and learn about the positive predictive value which expresses the probability published research findings are true. We will experience the problems with optional stopping and learn how to prevent these problems by using sequential analyses. You will calculate effect sizes, see how confidence intervals work through simulations, and practice doing a-priori power analyses. Finally, you will learn how to examine whether the null hypothesis is true using equivalence testing and Bayesian statistics, and how to pre-register a study, and share your data on the Open Science Framework.

Syllabus

Week 1: Introduction + Frequentist Statistics
Week 2: Likelihoods & Bayesian Statistics
Week 3: Multiple Comparisons, Statistical Power, Pre-Registration
Week 4: Effect Sizes
Week 5: Confidence Intervals, Sample Size Justification, P-Curve analysis
Week 6: Philosophy of Science & Theory
Week 7: Open Science
Week 8: Final Exam