£104.13

Springer Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Price data last checked 97 day(s) ago - refreshing...

View at Amazon

We'll watch every seller, every day. One email when your price arrives.

It has never been this cheap. We have no record of a lower price.

£104 today · cheaper than every other day in the last 4 months

NEW HERE?

Amazon shows you one price. We show you all of them.

Tosheroon watches Amazon prices so you don't have to. Every product on Amazon has a price history — we make it visible. Set the price you'd actually pay, and we'll email you the second it gets there. No app, no account, one email.

WHAT'S ON THIS PAGE

↓ Price chart
when this has been cheap or pricey
↓ Forecast
where the price is heading next
↓ Statistics
all-time high & low, recent range
↑ Price alert
name your number, we'll email you

Price History & Forecast

Grey patches = out of stock. Cheaper = lower on the chart. Hover for exact prices.

Last 32 days • 32 data points (No recent data available)

Historical
Generating forecast...
£106.45 £103.90 £104.45 £105.01 £105.57 £106.13 £106.68 01 February 2026 08 February 2026 16 February 2026 24 February 2026 04 March 2026

Price Distribution

Price distribution over 32 days • 3 price levels

Days at Price
Current Price
1 day · current 21 days 10 days 0 5 11 16 21 £104 £105 £106 Days at Price

Price Analysis

Most common price: £105 (21 days, 65.6%)

Price range: £104 - £106

Price levels: 3 different prices over 32 days

Description

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.

Product Specifications

Format
paperback
Domain
Amazon UK
Publication Date
30 September 2012
Listed Since
14 July 2013

Barcode

No barcode data available

Similar Products You Might Like

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
98% match

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Springer

£40.84 07 Mar 2026
Birkhauser Stochastic Networked Control Systems Book
98% match

Birkhauser Stochastic Networked Control Systems Book

Birkhauser

£124.99 17 Apr 2026
Mathematical Methods in Robust Control of Linear Stochastic Systems: 50 (Mathematical Concepts and Methods in Science and Engineering, 50)
97% match

Mathematical Methods in Robust Control of Linear Stochastic Systems: 50 (Mathematical Concepts and Methods in Science and Engineering, 50)

Springer

£56.67 22 Feb 2026
Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)
97% match

Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)

Routledge

£112.00 12 Jan 2026
Mathematical Control Theory and Finance
97% match

Mathematical Control Theory and Finance

Springer

£75.73 07 Jan 2026
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
97% match

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Springer

£92.98 14 Apr 2026
An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)
97% match

An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)

£49.92 12 Dec 2025
Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
97% match

Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Routledge

£165.96 12 Apr 2026
Mathematical Methods in Robust Control of Discrete-Time Linear Stochastic Systems
97% match

Mathematical Methods in Robust Control of Discrete-Time Linear Stochastic Systems

Springer

£83.74 27 Feb 2026
Stochastic Processes, Optimization, and Control Theory: Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems: A Volume ... Operations Research & Management Science, 94)
97% match

Stochastic Processes, Optimization, and Control Theory: Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems: A Volume ... Operations Research & Management Science, 94)

Springer

£83.68 02 Mar 2026
Stochastic Teams, Games, and Control under Information Constraints (Systems & Control: Foundations & Applications)
97% match

Stochastic Teams, Games, and Control under Information Constraints (Systems & Control: Foundations & Applications)

£124.31 24 Jan 2026
Numerical Methods for Stochastic Control Problems in Continuous Time: 24 (Stochastic Modelling and Applied Probability, 24)
97% match

Numerical Methods for Stochastic Control Problems in Continuous Time: 24 (Stochastic Modelling and Applied Probability, 24)

Springer

£100.61 07 Jan 2026
Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)
97% match

Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)

Wiley

£100.00 19 Apr 2026
Further Topics on Discrete-Time Markov Control Processes: 42 (Stochastic Modelling and Applied Probability, 42)
96% match

Further Topics on Discrete-Time Markov Control Processes: 42 (Stochastic Modelling and Applied Probability, 42)

Springer

£98.80 19 Apr 2026
Stochastic Differential Inclusions and Applications: 80 (Springer Optimization and Its Applications, 80)
96% match

Stochastic Differential Inclusions and Applications: 80 (Springer Optimization and Its Applications, 80)

Springer

£73.25 22 Feb 2026
Continuous-Time Markov Jump Linear Systems (Probability and Its Applications)
96% match

Continuous-Time Markov Jump Linear Systems (Probability and Its Applications)

Springer

£75.84 08 Mar 2026
Stochastic Control Theory: Dynamic Programming Principle: 72 (Probability Theory and Stochastic Modelling, 72)
96% match

Stochastic Control Theory: Dynamic Programming Principle: 72 (Probability Theory and Stochastic Modelling, 72)

Springer

£61.34 09 Jan 2026
Iterative Learning Control with Passive Incomplete Information: Algorithms Design and Convergence Analysis
96% match

Iterative Learning Control with Passive Incomplete Information: Algorithms Design and Convergence Analysis

Springer

£80.88 09 Mar 2026
Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems (Systems & Control: Foundations & Applications)
96% match

Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems (Systems & Control: Foundations & Applications)

Birkhauser

£40.29 14 Apr 2026
Competitive Markov Decision Processes: With 57 Illustrations
96% match

Competitive Markov Decision Processes: With 57 Illustrations

Springer

£159.99 06 Feb 2026
Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)
96% match

Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)

Springer

£70.15 04 Mar 2026
Competitive Markov Decision Processes
96% match

Competitive Markov Decision Processes

Springer

£156.81 08 Mar 2026
Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems (SpringerBriefs in Mathematics)
96% match

Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems (SpringerBriefs in Mathematics)

Springer

£34.91 21 Feb 2026
Nonlinear System I: Proceedings of the 14th World Congress, International Federation of Automatic Control, Beijing, P.R. China, 5-9 July 1999 (IFAC ... Volumes) (IFAC Proceedings Volumes, Volume F)
96% match

Nonlinear System I: Proceedings of the 14th World Congress, International Federation of Automatic Control, Beijing, P.R. China, 5-9 July 1999 (IFAC ... Volumes) (IFAC Proceedings Volumes, Volume F)

Elsevier

£100.00 11 Apr 2026