TR2025-166

Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization


    •  Xie, X., Mowlavi, S., Benosman, M., "Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization", Advances in Neural Information Processing Systems (NeurIPS) workshop on Machine Learning and the Physical Sciences (ML4PS), December 2025.
      BibTeX TR2025-166 PDF
      • @inproceedings{Xie2025dec,
      • author = {{{Xie, Xiaoyu and Mowlavi, Saviz and Benosman, Mouhacine}}},
      • title = {{{Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization}}},
      • booktitle = {Advances in Neural Information Processing Systems (NeurIPS) workshop on Machine Learning and the Physical Sciences (ML4PS)},
      • year = 2025,
      • month = dec,
      • url = {https://www.merl.com/publications/TR2025-166}
      • }
  • MERL Contact:
  • Research Areas:

    Computational Sensing, Dynamical Systems, Machine Learning

Abstract:

Data-driven latent dynamics models (LDMs) offer a promising approach for fast and accurate spatiotemporal forecasting by computing solutions in a compressed latent space. However, these models often neglect temporal correlations between consecutive snapshots when constructing the latent space, leading to suboptimal compression, jagged latent trajectories, and limited extrapolation ability over time. To address these issues, this paper introduces a continuous operator learning framework that incorporates a novel jerk regularization into the learning of the compressed latent space. This jerk regularization promotes smoothness and sparsity of latent space dynamics, which not only yields enhanced accuracy and convergence speed but also helps identify intrinsic latent space coordinates. The effectiveness of this framework is demonstrated through a two-dimensional unsteady flow problem governed by the Navier-Stokes equations, highlighting its potential to expedite high-fidelity simulations in various scientific and engineering applications

 

  • Related Publication

  •  Xie, X., Mowlavi, S., Benosman, M., "Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization", arXiv, February 2024.
    BibTeX arXiv
    • @article{Xie2024feb,
    • author = {Xie, Xiaoyu and Mowlavi, Saviz and Benosman, Mouhacine},
    • title = {{Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization}},
    • journal = {arXiv},
    • year = 2024,
    • month = feb,
    • url = {https://arxiv.org/abs/2402.15636}
    • }