A primer on partially observable Markov decision processes (POMDPs)

I Chadès, LV Pascal, S Nicol… - Methods in Ecology …, 2021 - Wiley Online Library
Partially observable Markov decision processes (POMDPs) are a convenient mathematical
model to solve sequential decision‐making problems under imperfect observations. Most …

Solving multi-objective optimization problems in conservation with the reference point method

Y Dujardin, I Chades - PloS one, 2018 - journals.plos.org
Managing the biodiversity extinction crisis requires wise decision-making processes able to
account for the limited resources available. In most decision problems in conservation …

Accelerated vector pruning for optimal POMDP solvers

E Walraven, M Spaan - Proceedings of the AAAI Conference on …, 2017 - ojs.aaai.org
Abstract Partially Observable Markov Decision Processes (POMDPs) are powerful models
for planning under uncertainty in partially observable domains. However, computing optimal …

Point-based value iteration for finite-horizon POMDPs

E Walraven, MTJ Spaan - Journal of Artificial Intelligence Research, 2019 - jair.org
Partially Observable Markov Decision Processes (POMDPs) are a popular formalism for
sequential decision making in partially observable environments. Since solving POMDPs to …

Solving k-mdps

J Ferrer-Mestres, TG Dietterich, O Buffet… - Proceedings of the …, 2020 - aaai.org
Abstract Markov Decision Processes (MDPs) are employed to model sequential decision-
making problems under uncertainty. Traditionally, algorithms to solve MDPs have focused …

A Shiny r app to solve the problem of when to stop managing or surveying species under imperfect detection

L Pascal, M Memarzadeh, C Boettiger… - Methods in Ecology …, 2020 - Wiley Online Library
In the last decade, artificial intelligence (AI) has increasingly been applied to help solve
applied ecology problems. Partially observable Markov decision processes (POMDPs) are …

KN-MOMDPs: Towards interpretable solutions for adaptive management

J Ferrer-Mestres, TG Dietterich, O Buffet… - Proceedings of the AAAI …, 2021 - ojs.aaai.org
In biodiversity conservation, adaptive management (AM) is the principal tool for decision
making under uncertainty. AM problems are planning problems that can be modelled using …

[HTML][HTML] Future memories are not needed for large classes of POMDPs

V Cohen, A Parmentier - Operations Research Letters, 2023 - Elsevier
Optimal policies for partially observed Markov decision processes (POMDPs) are history-
dependent: Decisions are made based on the entire history of observations. Memoryless …

Three new algorithms to solve N-POMDPs

Y Dujardin, T Dietterich, I Chades - … of the AAAI conference on artificial …, 2017 - ojs.aaai.org
In many fields in computational sustainability, applications of POMDPs are inhibited by the
complexity of the optimal solution. One way of delivering simple solutions is to represent the …

A review on the role of computational intelligence on sustainability development

O Castillo, P Melin - Computational intelligence methodologies applied to …, 2022 - Springer
This paper presents a review of the existing publications using computational intelligence
techniques in applications to sustainability development. Computational intelligence is the …