Probability Theory, Joint Distributions, Represent the joint distribution more compactly, graphical representation of joint distribution, Different types of reasoning encoded in a Bayesian Network, Independencies encoded by a Bayesian Network .
Markov Networks: Motivation, Factors in Markov Network, Local Independencies in a Markov Network, Computing the gradient of the log likelihood, Sampling, Concept of a latent variable, Restricted Boltzmann Machines, RBMs as Stochastic Neural Networks, Unsupervised Learning with RBMs, Markov Chains, Setting up a Markov Chain for RBMs, Training RBMs Using Gibbs Sampling, Training RBMS Using Contrastive Divergence.
Autoencoders, VariationalAutoencoders, Graphical model perspective, Neural Autoregressive Density Estimator (NADE), Masked Autoencoder Density Estimator (MADE), Generative Adversarial Networks.
Introduction to Reinforcement Learning, Bandit algorithms, Policy gradient methods, Dynamic programming and Monte carlo method, Model free prediction and control, DNQ Learning, Actor critics, Case study in RL.