£73.85

Springer Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Price data last checked 14 day(s) ago - will refresh soon

View at Amazon

We'll watch every seller, every day. One email when your price arrives.

It has never been this cheap. We have no record of a lower price.

£74 today · cheaper than every other day in the last 3 months

NEW HERE?

Amazon shows you one price. We show you all of them.

Tosheroon watches Amazon prices so you don't have to. Every product on Amazon has a price history — we make it visible. Set the price you'd actually pay, and we'll email you the second it gets there. No app, no account, one email.

WHAT'S ON THIS PAGE

↓ Price chart
when this has been cheap or pricey
↓ Forecast
where the price is heading next
↓ Statistics
all-time high & low, recent range
↑ Price alert
name your number, we'll email you

Price History & Forecast

Grey patches = out of stock. Cheaper = lower on the chart. Hover for exact prices.

Last 77 days · 77 data points (no recent data)

Historical
Generating forecast…
£73.85 £70.16 £71.63 £73.11 £74.59 £76.07 £77.54 09 July 2026 28 July 2026 16 August 2026 04 September 2026 23 September 2026

Price Distribution

Price distribution over 77 days • 1 price levels

Days at Price
77 days 0 19 39 58 77 £74 Days at Price

Price Analysis

Most common price: £74 (77 days, 100.0%)

Price range: £74 - £74

Price levels: 1 different prices over 77 days

Description

Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dimensionality and so making practical solution of the resulting models intractable. In other cases, the system of interest is too complex to allow explicit specification of some of the MDP model parameters, but simulation samples are readily available (e.g., for random transitions and costs). For these settings, various sampling and population-based algorithms have been developed to overcome the difficulties of computing an optimal solution in terms of a policy and/or value function. Specific approaches include adaptive sampling, evolutionary policy iteration, evolutionary random policy search, and model reference adaptive search. This substantially enlarged new edition reflects the latest developments in novel algorithms and their underpinning theories, and presents an updated account of the topics that have emerged since the publication of the first edition. Includes: innovative material on MDPs, both in constrained settings and with uncertain transition properties; game-theoretic method for solving MDPs; theories for developing roll-out based algorithms; and details of approximation stochastic annealing, a population-based on-line simulation-based algorithm. The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling, and control, and simulation but will be a valuable source of tuition and reference for students of control and operations research.

Product Specifications

Format
hardcover
Domain
Amazon UK
Release Date
20 March 2013
Listed Since
02 March 2013

Barcode

No barcode data available

Similar Products You Might Like

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
96% match

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Springer

£41.43 23 Sep 2026
Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
96% match

Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Routledge

£166.53 01 Oct 2026
Stochastic Networked Control Systems: Stabilization & Optimization
96% match

Stochastic Networked Control Systems: Stabilization & Optimization

Birkhauser

£124.99 02 Oct 2026
Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)
96% match

Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)

Wiley

£131.88 03 Oct 2026
Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)
96% match

Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)

CRC Press

£117.12 18 Sep 2026
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
96% match

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Springer

£88.60 19 Sep 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
96% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£89.28 12 Sep 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
95% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£83.87 23 Sep 2026
Stochastic Processes, Optimization, and Control Theory: Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems: A Volume ... Operations Research & Management Science, 94)
95% match

Stochastic Processes, Optimization, and Control Theory: Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems: A Volume ... Operations Research & Management Science, 94)

Springer

£80.67 19 Sep 2026
Competitive Markov Decision Processes
95% match

Competitive Markov Decision Processes

Springer

£157.39 23 Sep 2026
Introduction to Diagnosis of Active Systems
95% match

Introduction to Diagnosis of Active Systems

Springer

£76.42 02 Oct 2026
Applied Mathematics with Open-Source Software - Python & R
95% match

Applied Mathematics with Open-Source Software - Python & R

CRC Press

£101.02 03 Oct 2026
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
95% match

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Springer

£93.29 01 Oct 2026
Applied Mathematics with Open-Source Software: Operational Research Problems with Python and R (Chapman & Hall/CRC Series in Operations Research)
95% match

Applied Mathematics with Open-Source Software: Operational Research Problems with Python and R (Chapman & Hall/CRC Series in Operations Research)

CRC Press

£43.00 12 Sep 2026
Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)
95% match

Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)

£124.51 30 Sep 2026
Modeling, Stochastic Control, Optimization, and Applications: 164 (The IMA Volumes in Mathematics and its Applications, 164)
95% match

Modeling, Stochastic Control, Optimization, and Applications: 164 (The IMA Volumes in Mathematics and its Applications, 164)

Springer

£120.84 24 Sep 2026
Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)
95% match

Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)

Springer

£81.03 20 Sep 2026
Stochastic Differential Inclusions and Applications: 80 (Springer Optimization and Its Applications, 80)
95% match

Stochastic Differential Inclusions and Applications: 80 (Springer Optimization and Its Applications, 80)

Springer

£75.34 11 Sep 2026
Multiple Stopping Problems: Unilateral and Multilateral Approaches
95% match

Multiple Stopping Problems: Unilateral and Multilateral Approaches

Chapman and Hall/CRC

£93.79 02 Oct 2026