We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
Price loading...
Springer Handbook of Markov Decision Processes: Methods and Applications: 40 (International Series in Operations Research & Management Science, 40)
Price data last checked 108 day(s) ago - refreshing...
Price History & Forecast
No Price Data Available
Price history will appear here once data is collected from Amazon.
Price Distribution
No price data available for histogram
Description
Eugene A. Feinberg Adam Shwartz This volume deals with the theory of Markov Decision Processes (MDPs) and their applications. Each chapter was written by a leading expert in the re spective area. The papers cover major research areas and methodologies, and discuss open questions and future research directions. The papers can be read independently, with the basic notation and concepts ofSection 1.2. Most chap ters should be accessible by graduate or advanced undergraduate students in fields of operations research, electrical engineering, and computer science. 1.1 AN OVERVIEW OF MARKOV DECISION PROCESSES The theory of Markov Decision Processes-also known under several other names including sequential stochastic optimization, discrete-time stochastic control, and stochastic dynamic programming-studiessequential optimization ofdiscrete time stochastic systems. The basic object is a discrete-time stochas tic system whose transition mechanism can be controlled over time. Each control policy defines the stochastic process and values of objective functions associated with this process. The goal is to select a "good" control policy. In real life, decisions that humans and computers make on all levels usually have two types ofimpacts: (i) they cost orsavetime, money, or other resources, or they bring revenues, as well as (ii) they have an impact on the future, by influencing the dynamics. In many situations, decisions with the largest immediate profit may not be good in view offuture events. MDPs model this paradigm and provide results on the structure and existence of good policies and on methods for their calculation.
Product Specifications
- Brand
- Springer
- Format
- paperback
- ASIN
- 1461352487
- Domain
- Amazon UK
- Publication Date
- 29 October 2012
- Listed Since
- 03 March 2013
Barcode
No barcode data available
Similar Products You Might Like
95% match
Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)
Springer
£78.83
09 Mar 2026
94% match
Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)
Springer
£73.85
08 Mar 2026
94% match
Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)
Springer
£138.76
12 Jan 2026
94% match
Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)
Springer
£193.01
12 Jan 2026
94% match
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
Springer
£104.13
04 Mar 2026
94% match
Competitive Markov Decision Processes
Springer
£156.81
08 Mar 2026
93% match
Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
Routledge
£165.96
12 Apr 2026
93% match
Competitive Markov Decision Processes: With 57 Illustrations
Springer
£159.99
06 Feb 2026
93% match
Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)
Routledge
£112.00
12 Jan 2026
93% match
Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series in Probability and Statistics)
Wiley
£101.27
17 Mar 2026
93% match
Markov Chains and Decision Processes for Engineers and Managers
CRC Press
£60.99
12 Jan 2026
93% match
Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
Springer
£40.84
07 Mar 2026
93% match
Markov Decision Processes with Applications to Finance (Universitext)
Springer
£50.32
08 Mar 2026
93% match
Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)
Springer
£70.15
04 Mar 2026
93% match
Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)
Springer
£91.63
05 Mar 2026
93% match
Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)
Springer
£90.33
05 Feb 2026
93% match
Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality (Systems & Control: Foundations & Applications)
Birkhauser
£64.94
02 Apr 2026
93% match
Birkhauser Stochastic Networked Control Systems Book
Birkhauser
£124.99
17 Apr 2026
92% match
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
Springer
£91.63
01 Apr 2026
92% match
Markov Chains (Springer Series in Operations Research and Financial Engineering)
Springer
£60.15
11 Jan 2026
92% match
Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)
Out of Stock
04 Apr 2026
92% match
Wiley Sequential Stochastic Optimization - Mathematics Textbook
Wiley
£105.99
20 Apr 2026
92% match
An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)
£49.92
12 Dec 2025
92% match
Markov Processes (Advances in Applied Mathematics)
Chapman and Hall/CRC
£65.84
29 Jan 2026