Bayesian Statistics

Bayesian Statistics

Course Syllabus

Instructor: Sewon Park

Email: swpark0413@sookmyung.ac.kr

Semester: Fall / 2025

Class Time & Location: Wednesdays, 13:00–15:50, Room 511, Social Education Building

Office Hours: Wednesdays, 16:00-17:00 or by appointment


Course Description

This course covers the fundamental theories and practical implementation methods of Bayesian statistics, introducing key concepts such as Bayes’ theorem, prior and posterior distributions, Markov chain Monte Carlo (MCMC), and Bayesian model selection. Along with theoretical understanding, students will develop the ability to apply Bayesian methods to real-world problems through data analysis exercises using Python.


Learning Objectives

By the end of the course, students will be able to:

  • Understand the principles of Bayes’ theorem and explain the roles of prior and posterior distributions.
  • Design Bayesian models, select appropriate prior distributions, and perform posterior inference.
  • Understand computational techniques such as MCMC and use them to estimate complex posterior distributions.
  • Implement Bayesian analysis using Python and apply it to real-world datasets.

Prerequisites

  • Mathematical Statistics I, II
  • Linear Regression

Course Materials

  • Textbook:
    이재용 & 이기재, 베이즈 데이터 분석, 한국방송통신대학교출판문화원.
  • Reference:
    • Peter D. Hoff, A first Course in Bayesian Statistical Methods, Springer.
    • Andrew Gelman, Bayesian Data Analysis, Chapman & Hall/CRC Texts in Statistical Science.

Grading Policy

ComponentPercentage
Attendance5%
Assignments35%
Midterm Exam40%
Final Report20%

Weekly Schedule

WeekTopicReadings / Notes
1Bayesian InferenceCh. 1
2Bayesian Hypothesis TestingCh. 3
3Prior DistributionCh. 4
4Monte Carlo MethodsCh. 5
5The Normal ModelCh. 6
6Markov Chain Monte Carlo (MCMC) Methods ICh. 9
7Markov Chain Monte Carlo (MCMC) Methods IICh. 9
8Midterm Exam
9Hamiltonian Monte Carlo (HMC), Probabilistic ProgrammingCh. 9
10Bayesian Optimization MethodsCh. 10
11Model Selection and DiagnosticsCh. 11
12Bayesian Linear ModelsCh. 12
13Bayesian High-Dimensional Linear Regression Models
14Bayesian Hierarchical ModelsCh. 13
15Final Project