code

libpomdp

libpomdp (or libPOMDP) is an implementation of different offline and online POMDP approximation algorithms. At an early stage of development, libpomdp is currently focused on online heuristic search and hybrid approaches. The code is a combination of Java and Matlab and is hosted on github. Here's a link to the project's repository. Features and current algorithms:

• Representations
  • Java parser of Cassandra's .POMDP file format built with ANTLR.
  • Sparse matrix computations with MTJ and UJMP.
  • Interface with the .SPUDD file format and ADD manipulation using Pascal Poupart's ADD Java library.
• Online approaches
  • General framework for heuristic tree search for POMDPs.
  • AEMS2.
• Offline approaches
  • MDP, QMDP, Blind policy.
• Hybrid approaches
  • Hybrid Value Iteration (HYVI).

other POMDP software

• pomdp-solve by Anthony Cassandra.
• Perseus by Matthijs Spaan.
  This package also contains a Matlab parser for the .POMDP format which I have found to be very useful.
• Symbolic Perseus by Pascal Poupart.
• ZMDP by Trey Smith.
• The MultiAgent decision process toolbox by Frans Oliehoek and Matthijs Spaan.