Marlos C. Machado, Ph.D.

Assistant Professor, Faculty of Science - Computing Science
Directory

Winter Term 2026 (1940)

CMPUT 365 - Introduction to Reinforcement Learning

3 units (fi 6)(EITHER, 3-0-0)

This course provides an introduction to reinforcement learning, which focuses on the study and design of learning agents that interact with a complex, uncertain world to achieve a goal. The course will cover multi- armed bandits, Markov decision processes, reinforcement learning, planning, and function approximation (online supervised learning). The course will take an information-processing approach to the study of intelligence and briefly touch on perspectives from psychology, neuroscience, and philosophy. The course will use the University of Alberta MOOC on Reinforcement Learning. Any student who understands the material in this course will understand the foundations of much of modern probabilistic artificial intelligence (AI) and be prepared to take more advanced courses, or to apply AI tools and ideas to real-world problems. Prerequisites: CMPUT 175 or 275; one of CMPUT 267, 466, or STAT 265.

LECTURE B1 (84561)

2026-01-05 - 2026-04-10
MWF 13:00 - 13:50



CMPUT 499 - Topics in Computing Science

3 units (fi 6)(VAR, VARIABLE)

This topics course is designed for a one on one individual study course between a student and an instructor. Prerequisites are determined by the instructor in the course outline. See Note (3) above.

IND B02 (88800)

2026-01-05 - 2026-04-10
TR 11:00 - 12:20



CMPUT 628 - Topics in Machine Learning

3 units (fi 6)(EITHER, 3-0-0)

LECTURE B1 (87475)

2026-01-05 - 2026-04-10
TR 11:00 - 12:20