We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
£70.15
Springer Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)
Price data last checked 52 day(s) ago - refreshing...
Price History & Forecast
Last 39 days • 39 data points (No recent data available)
Price Distribution
Price distribution over 39 days • 2 price levels
Current Price
Price Analysis
Most common price: £62 (38 days, 97.4%)
Price range: £62 - £70
Price levels: 2 different prices over 39 days
Description
This book offers a systematic and rigorous treatment of continuous-time Markov decision processes, covering both theory and possible applications to queueing systems, epidemiology, finance, and other fields. Unlike most books on the subject, much attention is paid to problems with functional constraints and the realizability of strategies. Three major methods of investigations are presented, based on dynamic programming, linear programming, and reduction to discrete-time problems. Although the main focus is on models with total (discounted or undiscounted) cost criteria, models with average cost criteria and with impulsive controls are also discussed in depth. The book is self-contained. A separate chapter is devoted to Markov pure jump processes and the appendices collect the requisite background on real analysis and applied probability. All the statements in the main text are proved in detail. Researchers and graduate students in applied probability, operational research, statistics and engineering will find this monograph interesting, useful and valuable.
Product Specifications
- Brand
- Springer
- Format
- Hardcover
- ASIN
- 3030549860
- Domain
- Amazon UK
- Release Date
- 10 November 2020
- Listed Since
- 24 June 2020
Barcode
No barcode data available
Similar Products You Might Like
95% match
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
Springer
£91.63
01 Apr 2026
94% match
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
Springer
£104.13
04 Mar 2026
94% match
Continuous-Time Markov Jump Linear Systems (Probability and Its Applications)
Springer
£75.84
08 Mar 2026
94% match
Markov Decision Processes with Applications to Finance (Universitext)
Springer
£50.32
08 Mar 2026
94% match
Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
Springer
£40.84
07 Mar 2026
94% match
Competitive Markov Decision Processes
Springer
£156.81
08 Mar 2026
94% match
Continuous-Time Markov Chains: An Applications-Oriented Approach (Springer Series in Statistics)
Springer
£90.13
11 Jan 2026
94% match
Markov Chains (Springer Series in Operations Research and Financial Engineering)
Springer
£60.15
11 Jan 2026
93% match
Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)
Routledge
£112.00
12 Jan 2026
93% match
Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)
Springer
£73.85
08 Mar 2026
93% match
Mathematical Methods in Robust Control of Discrete-Time Linear Stochastic Systems
Springer
£83.74
27 Feb 2026
93% match
Competitive Markov Decision Processes: With 57 Illustrations
Springer
£159.99
06 Feb 2026
93% match
Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
Routledge
£165.96
12 Apr 2026
93% match
Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)
Springer
£91.63
05 Mar 2026
93% match
Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)
Springer
£90.33
05 Feb 2026
93% match
Markov Processes, Structure and Asymptotic Behavior: Structure and Asymptotic Behavior: 184 (Grundlehren der mathematischen Wissenschaften, 184)
Springer
£40.84
07 Mar 2026
93% match
Controlled Markov Processes and Viscosity Solutions: Stochastic modelling and applied probability, vol 25
Springer
£130.00
01 Feb 2026
93% match
Mathematical Methods in Robust Control of Linear Stochastic Systems: 50 (Mathematical Concepts and Methods in Science and Engineering, 50)
Springer
£56.67
22 Feb 2026
93% match
Discrete Probability Models and Methods: Probability on Graphs and Trees, Markov Chains and Random Fields, Entropy and Coding: 78 (Probability Theory and Stochastic Modelling, 78)
Springer
£76.10
07 Mar 2026
93% match
Discrete Probability Models and Methods: Probability on Graphs and Trees, Markov Chains and Random Fields, Entropy and Coding: 78 (Probability Theory and Stochastic Modelling, 78)
Springer
£58.94
24 Feb 2026
93% match
Point Process Calculus in Time and Space: An Introduction with Applications: 98 (Probability Theory and Stochastic Modelling, 98)
Springer
£100.25
09 Mar 2026
93% match
An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)
£49.92
12 Dec 2025
93% match
Springer Non-cooperative Stochastic Differential Game Theory
Springer
£109.11
03 Mar 2026
93% match
Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality (Systems & Control: Foundations & Applications)
Birkhauser
£64.94
02 Apr 2026