TR2024-048

Safe multi-agent motion planning under uncertainty for drones using filtered reinforcement learning


    •  Safaoui, S., Vinod, A.P., Chakrabarty, A., Quirynen, R., Yoshikawa, N., Di Cairano, S., "Safe multi-agent motion planning under uncertainty for drones using filtered reinforcement learning", IEEE Transactions on Robotics, DOI: 10.1109/​TRO.2024.3387010, Vol. 40, pp. 2529-2542, July 2024.
      BibTeX TR2024-048 PDF
      • @article{Safaoui2024jul,
      • author = {Safaoui, Sleiman and Vinod, Abraham P. and Chakrabarty, Ankush and Quirynen, Rien and Yoshikawa, Nobuyuki and Di Cairano, Stefano},
      • title = {Safe multi-agent motion planning under uncertainty for drones using filtered reinforcement learning},
      • journal = {IEEE Transactions on Robotics},
      • year = 2024,
      • volume = 40,
      • pages = {2529--2542},
      • month = jul,
      • doi = {10.1109/TRO.2024.3387010},
      • url = {https://www.merl.com/publications/TR2024-048}
      • }
  • MERL Contacts:
  • Research Areas:

    Control, Dynamical Systems, Machine Learning, Optimization

Abstract:

We consider the problem of safe multi-agent motion planning for drones in uncertain, cluttered workspaces. For this problem, we present a tractable motion planner that builds upon the strengths of reinforcement learning and constrained- control-based trajectory planning. First, we use single-agent reinforcement learning to learn motion plans from data that reach the target but may not be collision-free. Next, we use a convex optimization, chance constraints, and set-based methods for constrained control to ensure safety, despite the uncertainty in the workspace, agent motion, and sensing. The proposed approach can handle state and control constraints on the agents, and enforce collision avoidance among themselves and with static obstacles in the workspace with high probability. The proposed approach yields a safe, real-time implementable, multi-agent motion planner that is simpler to train than methods based solely on learning. Numerical simulations and experiments show the efficacy of the approach.

 

  • Related Publication

  •  Safaoui, S., Vinod, A.P., Chakrabarty, A., Quirynen, R., Yoshikawa, N., Di Cairano, S., "Safe multi-agent motion planning under uncertainty for drones using filtered reinforcement learning", arXiv, October 2023.
    BibTeX arXiv
    • @article{Safaoui2023oct,
    • author = {Safaoui, Sleiman and Vinod, Abraham P. and Chakrabarty, Ankush and Quirynen, Rien and Yoshikawa, Nobuyuki and Di Cairano, Stefano},
    • title = {Safe multi-agent motion planning under uncertainty for drones using filtered reinforcement learning},
    • journal = {arXiv},
    • year = 2023,
    • month = oct,
    • url = {https://arxiv.org/abs/2311.00063}
    • }