MDP                     Define an MDP Problem
Maze                    Steward Russell's 4x3 Maze MDP
POMDP                   Define a POMDP Problem
Tiger                   Tiger Problem POMDP Specification
optimal_action          Optimal action for a belief
plot_belief_space       Plot a 2D or 3D Projection of the Belief Space
plot_policy_graph       Visualize a POMDP Policy Graph
plot_value_function     Plot the Value Function of a POMDP Solution
policy                  Extract the Policy from a POMDP/MDP
pomdp-package           pomdp: Infrastructure for Partially Observable
                        Markov Decision Processes (POMDP)
reward                  Calculate the Reward for a POMDP Solution
round_stochastic        Round a stochastic vector or a row-stochastic
                        matrix
sample_belief_space     Sample from the Belief Space
simulate_POMDP          Simulate Trajectories in a POMDP
solve_MDP               Solve an MDP Problem
solve_POMDP             Solve a POMDP Problem using pomdp-solver
solve_SARSOP            Solve a POMDP Problem using SARSOP
transition_matrix       Extract the Transition, Observation or Reward
                        Information from a POMDP
update_belief           Belief Update
write_POMDP             Read and write a POMDP Model to a File in POMDP
                        Format
