Price loading...

Springer Handbook of Markov Decision Processes: Methods and Applications: 40 (International Series in Operations Research & Management Science, 40)

Price data last checked 108 day(s) ago - refreshing...

View at Amazon

Price History & Forecast

No Price Data Available

Price history will appear here once data is collected from Amazon.

Price Distribution

No price data available for histogram

Description

Eugene A. Feinberg Adam Shwartz This volume deals with the theory of Markov Decision Processes (MDPs) and their applications. Each chapter was written by a leading expert in the re spective area. The papers cover major research areas and methodologies, and discuss open questions and future research directions. The papers can be read independently, with the basic notation and concepts ofSection 1.2. Most chap ters should be accessible by graduate or advanced undergraduate students in fields of operations research, electrical engineering, and computer science. 1.1 AN OVERVIEW OF MARKOV DECISION PROCESSES The theory of Markov Decision Processes-also known under several other names including sequential stochastic optimization, discrete-time stochastic control, and stochastic dynamic programming-studiessequential optimization ofdiscrete time stochastic systems. The basic object is a discrete-time stochas tic system whose transition mechanism can be controlled over time. Each control policy defines the stochastic process and values of objective functions associated with this process. The goal is to select a "good" control policy. In real life, decisions that humans and computers make on all levels usually have two types ofimpacts: (i) they cost orsavetime, money, or other resources, or they bring revenues, as well as (ii) they have an impact on the future, by influencing the dynamics. In many situations, decisions with the largest immediate profit may not be good in view offuture events. MDPs model this paradigm and provide results on the structure and existence of good policies and on methods for their calculation.

Product Specifications

Format
paperback
Domain
Amazon UK
Publication Date
29 October 2012
Listed Since
03 March 2013

Barcode

No barcode data available

Similar Products You Might Like

Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)
95% match

Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Springer

£78.83 09 Mar 2026
Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)
94% match

Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Springer

£73.85 08 Mar 2026
Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)
94% match

Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)

Springer

£138.76 12 Jan 2026
Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)
94% match

Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)

Springer

£193.01 12 Jan 2026
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
94% match

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Springer

£104.13 04 Mar 2026
Competitive Markov Decision Processes
94% match

Competitive Markov Decision Processes

Springer

£156.81 08 Mar 2026
Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
93% match

Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Routledge

£165.96 12 Apr 2026
Competitive Markov Decision Processes: With 57 Illustrations
93% match

Competitive Markov Decision Processes: With 57 Illustrations

Springer

£159.99 06 Feb 2026
Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)
93% match

Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)

Routledge

£112.00 12 Jan 2026
Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series in Probability and Statistics)
93% match

Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series in Probability and Statistics)

Wiley

£101.27 17 Mar 2026
Markov Chains and Decision Processes for Engineers and Managers
93% match

Markov Chains and Decision Processes for Engineers and Managers

CRC Press

£60.99 12 Jan 2026
Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
93% match

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Springer

£40.84 07 Mar 2026
Markov Decision Processes with Applications to Finance (Universitext)
93% match

Markov Decision Processes with Applications to Finance (Universitext)

Springer

£50.32 08 Mar 2026
Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)
93% match

Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)

Springer

£70.15 04 Mar 2026
Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)
93% match

Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)

Springer

£91.63 05 Mar 2026
Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)
93% match

Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)

Springer

£90.33 05 Feb 2026
Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality (Systems & Control: Foundations & Applications)
93% match

Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality (Systems & Control: Foundations & Applications)

Birkhauser

£64.94 02 Apr 2026
Birkhauser Stochastic Networked Control Systems Book
93% match

Birkhauser Stochastic Networked Control Systems Book

Birkhauser

£124.99 17 Apr 2026
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
92% match

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Springer

£91.63 01 Apr 2026
Markov Chains (Springer Series in Operations Research and Financial Engineering)
92% match

Markov Chains (Springer Series in Operations Research and Financial Engineering)

Springer

£60.15 11 Jan 2026
Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)
92% match

Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)

Out of Stock 04 Apr 2026
Wiley Sequential Stochastic Optimization - Mathematics Textbook
92% match

Wiley Sequential Stochastic Optimization - Mathematics Textbook

Wiley

£105.99 20 Apr 2026
An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)
92% match

An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)

£49.92 12 Dec 2025
Markov Processes (Advances in Applied Mathematics)
92% match

Markov Processes (Advances in Applied Mathematics)

Chapman and Hall/CRC

£65.84 29 Jan 2026