Welcome to jMarkov’s documentation!

Contents:

• Usage
  • Installation
  • Markov chains
  • Continuous-time Markov chains
  • Discrete-time Markov chains
  • Infinite Continuous-time Birth-death Markov chains
  • Finite Continuous-time Birth-death Markov chains
  • Queueing systems
  • Discrete-time Markov Decision Processes (MDPs)
  • Discrete-time Stochastic Dynamic Programming (SDPs)

Indices and tables

• Index

• Module Index

• Search Page