Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Verification of indefinite-horizon POMDPs

Jun 30, 2020
Alexander Bork, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

The verification problem in MDPs asks whether, for any policy resolving the nondeterminism, the probability that something bad happens is bounded by some given threshold. This verification problem is often overly pessimistic, as the policies it considers may depend on the complete system state. This paper considers the verification problem for partially observable MDPs, in which the policies make their decisions based on (the history of) the observations emitted by the system. We present an abstraction-refinement framework extending previous instantiations of the Lovejoy-approach. Our experiments show that this framework significantly improves the scalability of the approach.

* Technical report for ATVA 2020 paper with the same title 

Share this with someone who'll enjoy it:

   Access Paper Source

Share this with someone who'll enjoy it: