£59.72

Imperial College Press SELECTED TOPICS ON CONTINUOUS-TIME CONTROLLED MARKOV CHAINS AND MARKOV GAMES: 5 (Icp Advanced Texts In Mathematics)

Price data last checked 49 day(s) ago - refreshing...

View at Amazon

We'll watch every seller, every day. One email when your price arrives.

This is the most expensive it has ever been. Walk away.

£60 today · previous high £60 · all-time low £57

NEW HERE?

Amazon shows you one price. We show you all of them.

Tosheroon watches Amazon prices so you don't have to. Every product on Amazon has a price history — we make it visible. Set the price you'd actually pay, and we'll email you the second it gets there. No app, no account, one email.

WHAT'S ON THIS PAGE

↓ Price chart
when this has been cheap or pricey
↓ Forecast
where the price is heading next
↓ Statistics
all-time high & low, recent range
↑ Price alert
name your number, we'll email you

Price History & Forecast

Grey patches = out of stock. Cheaper = lower on the chart. Hover for exact prices.

Last 42 days • 42 data points (No recent data available)

Historical
Generating forecast...
£59.72 £56.21 £56.98 £57.74 £58.51 £59.27 £60.04 14 March 2026 24 March 2026 03 April 2026 13 April 2026 24 April 2026

Price Distribution

Price distribution over 42 days • 3 price levels

Days at Price
Current Price
17 days 6 days 19 days · current 0 5 10 14 19 £57 £59 £60 Days at Price

Price Analysis

Most common price: £60 (19 days, 45.2%)

Price range: £57 - £60

Price levels: 3 different prices over 42 days

Description

From the Back Cover This book concerns continuous-time controlled Markov chains and Markov games. The former, which are also known as continuous-time Markov decision processes, form a class of stochastic control problems in which a single decision-maker has a wish to optimize a given objective function. In contrast, there are two or more decision-makers (or players, or controllers) trying to optimize its own objective function in a Markov game. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science among other areas. The main features of the control and game models studied in the book are the continuous time variable, the denumerable state space, and that the control (or action) sets are Borel spaces. Moreover, the transition and reward rates of the dynamical system may be unbounded. The authors are interested in some aspects of controlled Markov chains and Markov games such as characterizing the optimal reward functions, and determining optimal policies for each of the optimality criteria studied here. The main focus is on advanced optimality criteria (such as, bias, variance, sensitive discount, and Blackwell optimality), though they also deal with the basic optimality criteria (discounted and average reward). A particular emphasis is made on the application of the results presented in this book. One of the main concerns is to propose assumptions on the control and game models that are easily verifiable (and verified) in practice. Moreover, algorithmic and computational issues are also analyzed. In particular, the authors propose approximation results that allow precise numerical approximations of the solution to some problems of practical interest. Applications to population models and epidemic processes are also shown. Product Description This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control problems in which a single decision-maker wishes to optimize a given objective function. This book is also concerned with Markov games, where two decision-makers (or players) try to optimize their own objective function. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science, among other areas.An extensive, self-contained, up-to-date analysis of basic optimality criteria (such as discounted and average reward), and advanced optimality criteria (e.g., bias, overtaking, sensitive discount, and Blackwell optimality) is presented. A particular emphasis is made on the application of the results herein: algorithmic and computational issues are discussed, and applications to population models and epidemic processes are shown.This book is addressed to students and researchers in the fields of stochastic control and stochastic games. Moreover, it could be of interest also to undergraduate and beginning graduate students because the reader is not supposed to have a high mathematical background: a working knowledge of calculus, linear algebra, probability, and continuous-time Markov chains should suffice to understand the contents of the book.

Product Specifications

Format
hardcover
Domain
Amazon UK
Release Date
16 May 2012
Listed Since
05 July 2011

Barcode

No barcode data available

Similar Products You Might Like

Competitive Markov Decision Processes: With 57 Illustrations
97% match

Competitive Markov Decision Processes: With 57 Illustrations

Springer

£159.99 06 Feb 2026
Competitive Markov Decision Processes
97% match

Competitive Markov Decision Processes

Springer

£156.81 08 Mar 2026
Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality (Systems & Control: Foundations & Applications)
97% match

Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality (Systems & Control: Foundations & Applications)

Birkhauser

£59.86 27 Apr 2026
Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
97% match

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Springer

£40.84 07 Mar 2026
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
97% match

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Springer

£104.13 04 Mar 2026
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
97% match

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Springer

£92.17 01 May 2026
Counterexamples In Markov Decision Processes: 6 (Series on Optimization and its Applications)
97% match

Counterexamples In Markov Decision Processes: 6 (Series on Optimization and its Applications)

World Scientific Publishing Company

£110.36 23 Apr 2026
Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)
97% match

Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)

Routledge

£112.00 12 Jan 2026
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
97% match

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Springer

£92.98 14 Apr 2026
Markov Chains (Springer Series in Operations Research and Financial Engineering)
97% match

Markov Chains (Springer Series in Operations Research and Financial Engineering)

Springer

£60.15 11 Jan 2026
Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)
97% match

Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)

Springer

£70.15 04 Mar 2026
Birkhauser Stochastic Networked Control Systems Book
97% match

Birkhauser Stochastic Networked Control Systems Book

Birkhauser

£124.99 17 Apr 2026
Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)
97% match

Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Springer

£78.83 09 Mar 2026
Mathematical Methods in Robust Control of Linear Stochastic Systems: 50 (Mathematical Concepts and Methods in Science and Engineering, 50)
97% match

Mathematical Methods in Robust Control of Linear Stochastic Systems: 50 (Mathematical Concepts and Methods in Science and Engineering, 50)

Springer

£56.67 22 Feb 2026
Martingales and Markov Chains: Solved Exercises and Elements of Theory
97% match

Martingales and Markov Chains: Solved Exercises and Elements of Theory

Chapman and Hall/CRC

£69.37 23 Apr 2026
Markov Chains and Stochastic Stability (Communications and Control Engineering)
97% match

Markov Chains and Stochastic Stability (Communications and Control Engineering)

Springer

£130.42 24 Jan 2026
Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)
97% match

Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)

Wiley

£100.00 19 Apr 2026
Markov Processes for Stochastic Modeling: 6 (Stochastic Modeling Series)
96% match

Markov Processes for Stochastic Modeling: 6 (Stochastic Modeling Series)

Chapman and Hall/CRC

£43.60 07 Mar 2026
Modeling Uncertainty: An Examination of Stochastic Theory, Methods, and Applications: 46 (International Series in Operations Research & Management Science, 46)
96% match

Modeling Uncertainty: An Examination of Stochastic Theory, Methods, and Applications: 46 (International Series in Operations Research & Management Science, 46)

Springer

£171.97 12 Jan 2026
Stochastic Teams, Games, and Control under Information Constraints (Systems & Control: Foundations & Applications)
96% match

Stochastic Teams, Games, and Control under Information Constraints (Systems & Control: Foundations & Applications)

£124.31 24 Jan 2026
Stochastic Processes and Long Range Dependence (Springer Series in Operations Research and Financial Engineering)
96% match

Stochastic Processes and Long Range Dependence (Springer Series in Operations Research and Financial Engineering)

Springer

£90.53 28 Jan 2026
Positive Systems: Theory and Applications (POSTA 2018): 480 (Lecture Notes in Control and Information Sciences, 480)
96% match

Positive Systems: Theory and Applications (POSTA 2018): 480 (Lecture Notes in Control and Information Sciences, 480)

Springer

£76.01 13 May 2026
Elements of Applied Stochastic Processes: 378 (Wiley Series in Probability and Statistics)
96% match

Elements of Applied Stochastic Processes: 378 (Wiley Series in Probability and Statistics)

Wiley

£143.69 29 Mar 2026
Applied Semi-Markov Processes
96% match

Applied Semi-Markov Processes

Springer

£87.75 16 Feb 2026