​​580.691/491 Learning, Estimation, and Control

Text book: Biological Learning and Control, Shadmehr and Mussa-Ivaldi

The course introduces modern techniques in mathematical analysis of biomedical data. Techniques include maximum likelihood, estimation theory via Kalman equation, application of Kalman to Brain-Machine Interfaces, state-space models, Bayesian estimation, classification of labeled data, dimensionality reduction, clustering, expectation maximization, and dynamic programming and reinforcement learning via the Bellman equation. 


  • Regression and maximum likelihood
  • Estimation theory
    • State estimation of dynamical systems (chapter 4.6 and 4.7). Optimal parameter estimation, parameter uncertainty, state noise and measurement noise, adjusting learning rates to minimize model uncertainty.  Derivation of the Kalman filter algorithm.
    • Kalman filter and signal dependent noise (chapter 4.9 and 4.10).

  • Bayesian estimation
    • Applying Kalman to Brain Machine Interface. Bayes estimation and its relationship to Kalman filters (chapter 5.1). Factorization of joint distribution of Gaussian variables. 
      • Homework: posterior distribution with two observed data points; maximizing the posterior directly.
    • Causal inference (chapter 5.2 and 5.3). The problem of deciding between two generative models.
    • Examples from biological learning: Kamin blocking, backward blocking, and comparisons between Kalman learning and LMS.
    • MAP estimation.

  • Classification with labeled data