Dt-Planner: An environment for managing dynamic decision problems

Paolo Magni, Riccardo Bellazzi

Research output: Contribution to journalArticlepeer-review

Abstract

The problem of formulating plans under uncertainty and coping with dynamic decision problems is a major task of both artificial intelligence and control theory applications in medicine. In this paper we will describe a software package, called DT-Planner, designed to represent and solve dynamic decision problems that can be modelled as Markov decision processes, by exploiting a novel graphical formalism, called influence view. An influence view is a directed acyclic graph that depicts the probabilistic relationships between the problem state variables in a generic time transition; additional variables, called event variables, may be added, in order to describe the conditional independencies between state variables. By using the specified conditional independence structure, an influence view may allow a parsimonious specification of a Markov decision process. DT-Planner lets the user specify and manage models through a user-friendly graphical interface, and implements efficient for policy determination algorithms. DT-Planner is written in C with Open Interface(TM) libraries and can be obtained, for non commercial use, via anonymous ftp without charge.

Original languageEnglish
Pages (from-to)183-200
Number of pages18
JournalComputer Methods and Programs in Biomedicine
Volume54
Issue number3
DOIs
Publication statusPublished - Nov 1997

Keywords

  • Decision Markov processes
  • Decision- theoretic planning
  • Dynamic programming
  • Graphical models

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Dt-Planner: An environment for managing dynamic decision problems'. Together they form a unique fingerprint.

Cite this