£165.96

Routledge Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Price data last checked 12 day(s) ago - will refresh soon

View at Amazon

We'll watch every seller, every day. One email when your price arrives.

It has never been this cheap. We have no record of a lower price.

£166 today · cheaper than every other day in the last 3 months

NEW HERE?

Amazon shows you one price. We show you all of them.

Tosheroon watches Amazon prices so you don't have to. Every product on Amazon has a price history — we make it visible. Set the price you'd actually pay, and we'll email you the second it gets there. No app, no account, one email.

WHAT'S ON THIS PAGE

↓ Price chart
when this has been cheap or pricey
↓ Forecast
where the price is heading next
↓ Statistics
all-time high & low, recent range
↑ Price alert
name your number, we'll email you

Price History & Forecast

Grey patches = out of stock. Cheaper = lower on the chart. Hover for exact prices.

Last 79 days · 79 data points (no recent data)

Historical
Generating forecast…
£165.96 £157.66 £160.98 £164.30 £167.62 £170.94 £174.26 26 April 2026 15 May 2026 04 June 2026 23 June 2026 13 July 2026

Price Distribution

Price distribution over 79 days • 1 price levels

Days at Price
79 days 0 20 40 59 79 £166 Days at Price

Price Analysis

Most common price: £166 (79 days, 100.0%)

Price range: £166 - £166

Price levels: 1 different prices over 79 days

Description

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other. The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques. In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework. The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given.

Product Specifications

Format
hardcover
Domain
Amazon UK
Release Date
30 March 1999
Listed Since
05 February 2007

Barcode

No barcode data available

Similar Products You Might Like

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
97% match

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Springer

£41.42 08 Jul 2026
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
97% match

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Springer

£90.04 07 Jul 2026
Birkhauser Stochastic Networked Control Systems Book
97% match

Birkhauser Stochastic Networked Control Systems Book

Birkhauser

£129.99 15 Jul 2026
Singular Linear-Quadratic Zero-Sum Differential Games and H∞ Control Problems: Regularization Approach (Static & Dynamic Game Theory: Foundations & Applications)
96% match

Singular Linear-Quadratic Zero-Sum Differential Games and H∞ Control Problems: Regularization Approach (Static & Dynamic Game Theory: Foundations & Applications)

Birkhauser

£72.54 24 Jun 2026
Nonlinear System I: Proceedings of the 14th World Congress, International Federation of Automatic Control, Beijing, P.R. China, 5-9 July 1999 (IFAC ... Volumes) (IFAC Proceedings Volumes, Volume F)
96% match

Nonlinear System I: Proceedings of the 14th World Congress, International Federation of Automatic Control, Beijing, P.R. China, 5-9 July 1999 (IFAC ... Volumes) (IFAC Proceedings Volumes, Volume F)

Elsevier

£100.00 13 Jul 2026
Dynamic Optimization and Differential Games: 135 (International Series in Operations Research & Management Science, 135)
96% match

Dynamic Optimization and Differential Games: 135 (International Series in Operations Research & Management Science, 135)

Springer

£199.99 10 Jul 2026
Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)
96% match

Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)

CRC Press

£107.40 05 Jul 2026
Stability, Control and Differential Games: Proceedings of the International Conference “Stability, Control, Differential Games” (SCDG2019) (Lecture ... and Information Sciences - Proceedings)
96% match

Stability, Control and Differential Games: Proceedings of the International Conference “Stability, Control, Differential Games” (SCDG2019) (Lecture ... and Information Sciences - Proceedings)

Springer

£219.96 16 Jul 2026
Time Optimal Control of Evolution Equations: 92 (Progress in Nonlinear Differential Equations and Their Applications, 92)
96% match

Time Optimal Control of Evolution Equations: 92 (Progress in Nonlinear Differential Equations and Their Applications, 92)

Birkhauser

£37.00 10 Jul 2026
Optimal Control Theory: Applications to Management Science and Economics (Springer Texts in Business and Economics)
96% match

Optimal Control Theory: Applications to Management Science and Economics (Springer Texts in Business and Economics)

Springer

£81.23 08 Jul 2026
Nonlinear Model Predictive Control: Theory and Algorithms (Communications and Control Engineering)
96% match

Nonlinear Model Predictive Control: Theory and Algorithms (Communications and Control Engineering)

Springer

£93.29 14 Jul 2026
Developments in Model-Based Optimization and Control: Distributed Control and Industrial Applications: 464 (Lecture Notes in Control and Information Sciences, 464)
96% match

Developments in Model-Based Optimization and Control: Distributed Control and Industrial Applications: 464 (Lecture Notes in Control and Information Sciences, 464)

Springer

£76.38 04 Jul 2026
Optimal Control Theory and Static Optimization in Economics
96% match

Optimal Control Theory and Static Optimization in Economics

Cambridge University Press

£59.89 16 Jul 2026
Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems (SpringerBriefs in Mathematics)
96% match

Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems (SpringerBriefs in Mathematics)

Springer

£34.91 02 Jul 2026
Recent Advances in Model Predictive Control: Theory, Algorithms, and Applications: 485 (Lecture Notes in Control and Information Sciences, 485)
96% match

Recent Advances in Model Predictive Control: Theory, Algorithms, and Applications: 485 (Lecture Notes in Control and Information Sciences, 485)

Springer

£90.17 09 Jul 2026
Modern Control Theory: State Variable Analysis of Linear Systems and Analysis of Nonlinear Systems
96% match

Modern Control Theory: State Variable Analysis of Linear Systems and Analysis of Nonlinear Systems

£10.23 02 Jul 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
96% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£89.37 03 Jul 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
96% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£90.19 09 Jul 2026
Robust Control of Linear Systems Subject to Uncertain Time-Varying Parameters: 325 (Lecture Notes in Control and Information Sciences, 325)
96% match

Robust Control of Linear Systems Subject to Uncertain Time-Varying Parameters: 325 (Lecture Notes in Control and Information Sciences, 325)

Springer

£85.54 02 Jul 2026
Introduction to Diagnosis of Active Systems
96% match

Introduction to Diagnosis of Active Systems

Springer

£76.41 15 Jul 2026
Control of Complex Systems: Theory and Applications
96% match

Control of Complex Systems: Theory and Applications

Butterworth-Heinemann

£109.40 09 Jul 2026
Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)
96% match

Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Springer

£73.85 09 Jul 2026
Analysis and Synthesis of Positive Systems Under ℓ1 and L1 Performance (Springer Theses)
96% match

Analysis and Synthesis of Positive Systems Under ℓ1 and L1 Performance (Springer Theses)

Springer

£71.84 09 Jul 2026
Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)
96% match

Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)

Wiley

£122.41 16 Jul 2026