£165.96

Routledge Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Price data last checked 58 day(s) ago - refreshing...

View at Amazon

We'll watch every seller, every day. One email when your price arrives.

It has never been this cheap. We have no record of a lower price.

£166 today · cheaper than every other day in the last 3 months

NEW HERE?

Amazon shows you one price. We show you all of them.

Tosheroon watches Amazon prices so you don't have to. Every product on Amazon has a price history — we make it visible. Set the price you'd actually pay, and we'll email you the second it gets there. No app, no account, one email.

WHAT'S ON THIS PAGE

↓ Price chart
when this has been cheap or pricey
↓ Forecast
where the price is heading next
↓ Statistics
all-time high & low, recent range
↑ Price alert
name your number, we'll email you

Price History & Forecast

Grey patches = out of stock. Cheaper = lower on the chart. Hover for exact prices.

Last 33 days • 33 data points (No recent data available)

Historical
Generating forecast...
£165.96 £157.66 £160.98 £164.30 £167.62 £170.94 £174.26 11 March 2026 19 March 2026 27 March 2026 04 April 2026 12 April 2026

Price Distribution

Price distribution over 33 days • 1 price levels

Days at Price
33 days 0 8 17 25 33 £166 Days at Price

Price Analysis

Most common price: £166 (33 days, 100.0%)

Price range: £166 - £166

Price levels: 1 different prices over 33 days

Description

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other. The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques. In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework. The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given.

Product Specifications

Format
hardcover
Domain
Amazon UK
Release Date
30 March 1999
Listed Since
05 February 2007

Barcode

No barcode data available

Similar Products You Might Like

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
97% match

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Springer

£40.84 07 Mar 2026
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
97% match

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Springer

£104.13 04 Mar 2026
Birkhauser Stochastic Networked Control Systems Book
97% match

Birkhauser Stochastic Networked Control Systems Book

Birkhauser

£124.99 17 Apr 2026
An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)
97% match

An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)

£49.92 12 Dec 2025
Singular Linear-Quadratic Zero-Sum Differential Games and H∞ Control Problems: Regularization Approach (Static & Dynamic Game Theory: Foundations & Applications)
96% match

Singular Linear-Quadratic Zero-Sum Differential Games and H∞ Control Problems: Regularization Approach (Static & Dynamic Game Theory: Foundations & Applications)

£72.55 04 Feb 2026
Nonlinear System I: Proceedings of the 14th World Congress, International Federation of Automatic Control, Beijing, P.R. China, 5-9 July 1999 (IFAC ... Volumes) (IFAC Proceedings Volumes, Volume F)
96% match

Nonlinear System I: Proceedings of the 14th World Congress, International Federation of Automatic Control, Beijing, P.R. China, 5-9 July 1999 (IFAC ... Volumes) (IFAC Proceedings Volumes, Volume F)

Elsevier

£100.00 11 Apr 2026
Dynamic Optimization and Differential Games: 135 (International Series in Operations Research & Management Science, 135)
96% match

Dynamic Optimization and Differential Games: 135 (International Series in Operations Research & Management Science, 135)

Springer

£199.99 10 Mar 2026
Frontiers Of Intelligent Control And Information Processing
96% match

Frontiers Of Intelligent Control And Information Processing

World Scientific Publishing Company

£71.10 14 Jan 2026
Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)
96% match

Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)

CRC Press

£106.83 28 Feb 2026
Stability, Control and Differential Games: Proceedings of the International Conference “Stability, Control, Differential Games” (SCDG2019) (Lecture ... and Information Sciences - Proceedings)
96% match

Stability, Control and Differential Games: Proceedings of the International Conference “Stability, Control, Differential Games” (SCDG2019) (Lecture ... and Information Sciences - Proceedings)

Springer

£219.99 19 Apr 2026
Stochastic Control Theory: Dynamic Programming Principle: 72 (Probability Theory and Stochastic Modelling, 72)
96% match

Stochastic Control Theory: Dynamic Programming Principle: 72 (Probability Theory and Stochastic Modelling, 72)

Springer

£61.34 09 Jan 2026
Time Optimal Control of Evolution Equations: 92 (Progress in Nonlinear Differential Equations and Their Applications, 92)
96% match

Time Optimal Control of Evolution Equations: 92 (Progress in Nonlinear Differential Equations and Their Applications, 92)

Birkhauser

£37.00 12 Mar 2026
Optimal Control Theory: Applications to Management Science and Economics (Springer Texts in Business and Economics)
96% match

Optimal Control Theory: Applications to Management Science and Economics (Springer Texts in Business and Economics)

Springer

£56.99 08 Mar 2026
Nonlinear Model Predictive Control: Theory and Algorithms (Communications and Control Engineering)
96% match

Nonlinear Model Predictive Control: Theory and Algorithms (Communications and Control Engineering)

Springer

£93.29 12 Apr 2026
Developments in Model-Based Optimization and Control: Distributed Control and Industrial Applications: 464 (Lecture Notes in Control and Information Sciences, 464)
96% match

Developments in Model-Based Optimization and Control: Distributed Control and Industrial Applications: 464 (Lecture Notes in Control and Information Sciences, 464)

Springer

£79.00 27 Feb 2026
Adaptive Dynamic Programming for Control: Algorithms and Stability (Communications and Control Engineering)
96% match

Adaptive Dynamic Programming for Control: Algorithms and Stability (Communications and Control Engineering)

Springer

£108.45 06 Jan 2026
Optimal Control Theory and Static Optimization in Economics
96% match

Optimal Control Theory and Static Optimization in Economics

Cambridge University Press

£57.16 20 Apr 2026
Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems (SpringerBriefs in Mathematics)
96% match

Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems (SpringerBriefs in Mathematics)

Springer

£34.91 21 Feb 2026
Recent Advances in Model Predictive Control: Theory, Algorithms, and Applications: 485 (Lecture Notes in Control and Information Sciences, 485)
96% match

Recent Advances in Model Predictive Control: Theory, Algorithms, and Applications: 485 (Lecture Notes in Control and Information Sciences, 485)

Springer

£90.73 09 Mar 2026
Modern Control Theory: State Variable Analysis of Linear Systems and Analysis of Nonlinear Systems
96% match

Modern Control Theory: State Variable Analysis of Linear Systems and Analysis of Nonlinear Systems

£20.80 19 Feb 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
96% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£93.19 27 Feb 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
96% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£102.76 08 Mar 2026
Robust Control of Linear Systems Subject to Uncertain Time-Varying Parameters: 325 (Lecture Notes in Control and Information Sciences, 325)
96% match

Robust Control of Linear Systems Subject to Uncertain Time-Varying Parameters: 325 (Lecture Notes in Control and Information Sciences, 325)

Springer

£85.32 20 Feb 2026
Introduction to Diagnosis of Active Systems
96% match

Introduction to Diagnosis of Active Systems

Springer

£76.02 16 Apr 2026