Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series) - Image 1

£165.96

Routledge Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Name: Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
Brand: Routledge
Price: 165.81 GBP
Availability: InStock

Operational Research

Price History & Forecast

Last 78 days • 78 data points (No recent data available)

Historical

Generating forecast...

Price Distribution

Price distribution over 78 days • 1 price levels

Days at Price

Price Analysis

Most common price: £166 (78 days, 100.0%)

Price range: £166 - £166

Price levels: 1 different prices over 78 days

Description

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other. The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques. In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework. The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given.

Product Specifications

Brand: Routledge
Format: hardcover
ASIN: 0849303826
Category: Books > Subjects > Business, Finance & Law > Management > Operational Research
Domain: Amazon UK
Release Date: 30 March 1999
Listed Since: 05 February 2007

Barcode

No barcode data available

Routledge Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Price History & Forecast

Price Distribution

Price Analysis

Description

Product Specifications

Barcode

Similar Products You Might Like

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Birkhauser Stochastic Networked Control Systems Book

Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality (Systems & Control: Foundations & Applications)

Optimal Control: Basics and Beyond: 7 (Wiley Interscience Series in Systems and Optimization)

An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)

Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Springer Linear Systems Control: Deterministic and Stochastic Methods

Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Handbook of Markov Decision Processes: Methods and Applications: 40 (International Series in Operations Research & Management Science, 40)

Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)

Semi-Markov Models: Control of Restorable Systems with Latent Failures

Stochastic Control Theory: Dynamic Programming Principle: 72 (Probability Theory and Stochastic Modelling, 72)

Markov Chains and Decision Processes for Engineers and Managers

Stochastic Processes, Estimation, and Control (Advances in Design and Control)

Competitive Markov Decision Processes

Markov Chains (Springer Series in Operations Research and Financial Engineering)

Controlled Markov Processes and Viscosity Solutions: Stochastic modelling and applied probability, vol 25

Optimal Control Theory: The Variational Method

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Academic Press - Introduction to Linear Control Systems Textbook

Adaptive Dynamic Programming for Control: Algorithms and Stability (Communications and Control Engineering)

Multiple Stopping Problems: Unilateral and Multilateral Approaches