Online tree-based planning for active spacecraft fault estimation and collision avoidance

J Ragan, B Riviere, FY Hadaegh, SJ Chung - Science Robotics, 2024 - science.org
Autonomous robots operating in uncertain or hazardous environments subject to state safety
constraints must be able to identify and isolate faulty components in a time-optimal manner …

Constrained hierarchical monte carlo belief-state planning

A Jamgochian, H Buurmeijer, KH Wray… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Optimal plans in Constrained Partially Observable Markov Decision Processes (CPOMDPs)
maximize reward objectives while satisfying hard cost constraints, generalizing safe …

ConstrainedZero: Chance-constrained POMDP planning using learned probabilistic failure surrogates and adaptive safety constraints

RJ Moss, A Jamgochian, J Fischer, A Corso… - arxiv preprint arxiv …, 2024 - arxiv.org
To plan safely in uncertain environments, agents must balance utility with safety constraints.
Safe planning problems can be modeled as a chance-constrained partially observable …

Recursively-Constrained partially observable Markov decision processes

QH Ho, T Becker, B Kraske, Z Laouar… - arxiv preprint arxiv …, 2023 - arxiv.org
Many sequential decision problems involve optimizing one objective function while
imposing constraints on other objectives. Constrained Partially Observable Markov Decision …

Rat-UAV Navigation: Cyborg Rat Autonomous Navigation With the Guidance of a UAV

N Zheng, H Zhang, L Han, C Liu, Q Li… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
Controlling the cyborg rat with the guidance of an unmanned aerial vehicle (UAV) is
important yet challenging. UAV can provide a mobile bird's eye view (BEV) with multiple …

Cooperative multi-agent constrained POMDPs: Strong duality and primal-dual reinforcement learning with approximate information states

N Khan, V Subramanian - arxiv preprint arxiv:2307.16536, 2023 - arxiv.org
We study the problem of decentralized constrained POMDPs in a team-setting where the
multiple non-strategic agents have asymmetric information. Strong duality is established for …

Addressing myopic constrained POMDP planning with recursive dual ascent

P Stocco, S Chundi, A Jamgochian… - Proceedings of the …, 2024 - ojs.aaai.org
Abstract Lagrangian-guided Monte Carlo tree search with global dual ascent has been
applied to solve large constrained partially observable Markov decision processes …

A strong duality result for constrained POMDPs with multiple cooperative agents

N Khan, V Subramanian - arxiv preprint arxiv:2303.14932, 2023 - arxiv.org
The work studies the problem of decentralized constrained POMDPs in a team-setting where
multiple nonstrategic agents have asymmetric information. Using an extension of Sion's …

Anytime Probabilistically Constrained Provably Convergent Online Belief Space Planning

A Zhitnikov, V Indelman - arxiv preprint arxiv:2411.06711, 2024 - arxiv.org
Taking into account future risk is essential for an autonomously operating robot to find online
not only the best but also a safe action to execute. In this paper, we build upon the recently …

A Strong Duality Result for Cooperative Decentralized Constrained POMDPs

N Khan, V Subramanian - 2023 62nd IEEE Conference on …, 2023 - ieeexplore.ieee.org
The work studies cooperative decentralized constrained POMDPs with asymmetric
information. Using an extension of Sion's Minimax theorem for functions with positive infinity …