Skip to content

Repo for defining, solving and analyzing Information-gathering pomdps

Notifications You must be signed in to change notification settings

ancorso/InfoGatheringPOMDPs.jl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

35 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

InfoGatheringPOMDPs

Repo for defining, solving and analyzing information-gathering pomdps. We define an information gathering POMDP as one where the transition dynamics are trivial and the actions are primarily to gather information to better infer the state in order to make a final decisions which will be economic or non-economic. Examples of information gathering POMDPs are mineral exploration and geothermal reservoir assessment (example provided in code).

Installation

Clone the repo

git clone https://github.com/ancorso/InfoGatheringPOMDPs.git

Add (or dev) the package to julia. Start julia, then

]add YOUR/FULL/PATH/TO/InfoGatheringPOMDPs

The primary solver used is SARSOP. Install this fork of the NativeSARSOP.jl package as it implements an action-dependent discounting which is crucial for good performance of the SARSOP algorithm

Running an example

To run the example geothermal case, navigate to the InfoGatheringPOMDPs folder and call

julia examples/geothermal_example.jl

Future Work

  • Make a version of the SARSOP policy that targets a particular PES

Maintained by Anthony Corso ([email protected])

About

Repo for defining, solving and analyzing Information-gathering pomdps

Resources

Stars

Watchers

Forks

Packages

No packages published