Marlos Cholodovskis Machado, Ph.D.

Senior Research Scientist at DeepMind

Pronouns: He, Him, His

Contact

Senior Research Scientist at DeepMind

Faculty of Science - Computing Science
Email
machado@ualberta.ca

Overview

Area of Study / Keywords

Artificial Intelligence Machine Learning Reinforcement Learning


About

Education

  • B.Sc., Computer Science, Universidade Federal de Minas Gerais (UFMG), 2010
  • M.Sc., Computer Science, Universidade Federal de Minas Gerais (UFMG), 2013
  • Ph.D., Computing Science, University of Alberta, 2019

Research

Summary

Marlos C. Machado is a senior research Scientist at DeepMind and he holds a Canada CIFAR AI Chair at the Alberta Machine Intelligence Institute (Amii). Marlos’s research mostly focuses on the problem of reinforcement learning. He received his B.Sc. and M.Sc. from UFMG, in Brazil, and his Ph.D. from the University of Alberta, where he introduced the idea of temporally-extended exploration through options. He was a research scientist at Google Brain from 2019 to 2021, during which time he made major contributions to reinforcement learning, in particular the introduction of an operator view of policy gradient methods and the application of deep reinforcement learning to control Loon’s stratospheric balloons. Marlos C. Machado is also an adjunct professor at the University of Alberta and an Amii Fellow.