NEU Logo
Đại học Kinh tế Quốc dânChương trình đào tạo
English
Tiếng Việt
NEU Logo
QR Code

Đại học Kinh tế Quốc dân

207 Giải Phóng,Bạch mai, Hà Nội, Việt Nam

(84)24.36.280.280

(84)24.38.695.992

facebook.com/ktqdNEU

QR Code
Bản quyền thuộc về: Đại học Kinh tế Quốc dân
Trang chủ
Hướng dẫn sử dụng
EP30.TOKT1160 — Stochastic Processes | Chương trình đào tạo NEU

EP30.TOKT1160 — Stochastic Processes

Credits
3
Self-study hours
90
Showing intake
K68-2026

Course description

This course introduces fundamental concepts and methods of stochastic processes with applications in economics, finance, and actuarial science. Students will learn how to model randomness evolving over time, focusing on discrete and continuous time processes. Topics include Markov chains, branching processes, Poisson processes, continuous-time Markov processes, martingales, Brownian motion, and stochastic differential equations. Emphasis is placed on both theoretical foundations and applications, equipping students with tools for probabilistic modeling, risk management, and decision-making in uncertain environments.

Course requirements

Requirements for Final Examination

Attendance score must be at least 5 (according to University regulations).

See Appendix 2, Rubric 1 for attendance evaluation.

Requirements for Class Attendance

Students are responsible for attending all scheduled classes.

In case of absence due to force majeure, students must actively acquire the knowledge through the materials provided by the lecturer and other assigned readings.

Requirements for In-class Behaviour

The course is conducted on the principle of mutual respect between lecturers and students.

Students are required to take full notes and participate in answering questions.

Students must read assigned materials in advance.

Homework assignments must be completed as required.

Students must not make noise and disturb others.

Laptops, tablets, and mobile phones may only be used for note-taking, calculations, or learning purposes, and must not be used for any other activities.

Detailed content

The course content includes

  • Introduction to stochastic processes
  • Markov Chains 
  • Branching Processes
  • Poisson Process 
  • Continuous Time Markov Process
  • Martingales
  • Brownian Motion

Lecturers

  • Vuong Van Yen
  • Nguyễn Quang Huy
  • Nguyen Duc Nam

Teaching plan

Week 1

Introduction + Intro to stochastic processes + Deterministic and probabilistic models + Probability review: Conditional Expectation, Conditional Independence
References
- Syllabus - [1] Chapter 1
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check

Week 2

Markov Chains I + Definition, examples + Basic computations + Chapman–Kolmogorov equation
References
[1] Chapter 2
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 3

Markov Chains II + Limiting distribution + Stationary distribution + Strong Markov property (optional)
References
[1] Chapter 2, 3
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 4

Markov Chains III + Classification of states + Irreducible Markov Chains + First step analysis

Learning resources

  • R. Dobrow. Introduction to Stochastic Processes with R. Wiley, 2016 — R. Dobrow. Introduction to Stochastic Processes with R. Wiley, 2016
  • G. Lawler. Introduction to Stochastic Processes. Chapman & Hall/CRC, 2006 — G. Lawler. Introduction to Stochastic Processes. Chapman & Hall/CRC, 2006
  • N. Privault. Understanding Markov chains. Examples and applications. Springer, 2018 — N. Privault. Understanding Markov chains. Examples and applications. Springer, 2018
References
[1] Chapter 3
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 5

Markov Chains IV + Ergodic Theorem + Markov Chain Monte Carlo
References
[1] Chapter 3
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 6

Branching Processes + Mean generation size + Extinction Probability
References
[1] Chapter 4
Assessment
Criteria: Calculation problems Tools: Rubric 1, 2 Method: Written Exam

Week 7

Poisson Process I + Definition, basic computations + Arrival, interarrival times + Conditional arrival times as uniform distributions + Thinning, Superposition
References
[1] Chapter 6
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 8

Poisson Process II + Compound Poisson process + Nonhomogeneous Poisson process + Conditional Poisson Process
References
[1] Chapter 6
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 9

Midterm Exam

Week 10

Continuous Time Markov Process + Transition rates + Infinitesimal generator + Long-term behavior
References
[1] Chapter 7
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 11

Martingales + Conditional Expectation + Discrete-time martingales + Stopping times + Optional stopping theorem + Maximal Inequalities + Applications in finance
References
[1] Chapter 8
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 13

Brownian Motion + Definition + Gaussian process + Transformations and Properties + Variations and Applications + Introduction to SDEs
References
[1] Chapter 8
Assessment
Criteria: Calculation problems Tools: Rubric 1 Method: Attendance Check & Work Assignment

Week 15

Summary
Assessment
Criteria: Attendance, Home exercise and Discussion Tools: Rubric 1 Method: Attendance Check & Work Assignment