TR2021-091

A Kalman Filter for Online Calibration of Optimal Controllers


    •  Menner, M., Berntorp, K., Di Cairano, S., "A Kalman Filter for Online Calibration of Optimal Controllers", IEEE Conference on Control Technology and Applications (CCTA), DOI: 10.1109/​CCTA48906.2021.9658684, August 2021, pp. 441-446.
      BibTeX TR2021-091 PDF
      • @inproceedings{Menner2021aug,
      • author = {Menner, Marcel and Berntorp, Karl and Di Cairano, Stefano},
      • title = {A Kalman Filter for Online Calibration of Optimal Controllers},
      • booktitle = {IEEE Conference on Control Technology and Applications (CCTA)},
      • year = 2021,
      • pages = {441--446},
      • month = aug,
      • doi = {10.1109/CCTA48906.2021.9658684},
      • url = {https://www.merl.com/publications/TR2021-091}
      • }
  • MERL Contacts:
  • Research Areas:

    Control, Dynamical Systems, Optimization

Abstract:

This paper proposes an approach for the calibration of the cost function of optimization-based controllers. The approach uses a Kalman filter that estimates the cost function parameters using data of closed-loop system operation. It adapts the parameters online and robustly, provides safety guarantees, is computationally efficient, has low data storage requirements, and is easy to implement making it appealing for many real-time applications. The approach provides a dataefficient alternative to Bayesian optimization and an automated alternative to learning from demonstrations. Simulation results show that the approach is able to learn cost function parameters quickly (approximately 95% faster than Bayesian optimization), is able to adapt the parameters to compensate for disturbances (approximately 25% improvement on tracking precision), and is robust to noise.