£73.85

Springer Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Price data last checked 42 day(s) ago - refreshing...

View at Amazon

We'll watch every seller, every day. One email when your price arrives.

It has never been this cheap. We have no record of a lower price.

£74 today · cheaper than every other day in the last 3 months

NEW HERE?

Amazon shows you one price. We show you all of them.

Tosheroon watches Amazon prices so you don't have to. Every product on Amazon has a price history — we make it visible. Set the price you'd actually pay, and we'll email you the second it gets there. No app, no account, one email.

WHAT'S ON THIS PAGE

↓ Price chart
when this has been cheap or pricey
↓ Forecast
where the price is heading next
↓ Statistics
all-time high & low, recent range
↑ Price alert
name your number, we'll email you

Price History & Forecast

Grey patches = out of stock. Cheaper = lower on the chart. Hover for exact prices.

Last 49 days · 49 data points (no recent data)

Historical
Generating forecast…
£73.85 £70.16 £71.63 £73.11 £74.59 £76.07 £77.54 22 May 2026 03 June 2026 15 June 2026 27 June 2026 09 July 2026

Price Distribution

Price distribution over 49 days • 1 price levels

Days at Price
49 days 0 12 25 37 49 £74 Days at Price

Price Analysis

Most common price: £74 (49 days, 100.0%)

Price range: £74 - £74

Price levels: 1 different prices over 49 days

Description

Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dimensionality and so making practical solution of the resulting models intractable. In other cases, the system of interest is too complex to allow explicit specification of some of the MDP model parameters, but simulation samples are readily available (e.g., for random transitions and costs). For these settings, various sampling and population-based algorithms have been developed to overcome the difficulties of computing an optimal solution in terms of a policy and/or value function. Specific approaches include adaptive sampling, evolutionary policy iteration, evolutionary random policy search, and model reference adaptive search. This substantially enlarged new edition reflects the latest developments in novel algorithms and their underpinning theories, and presents an updated account of the topics that have emerged since the publication of the first edition. Includes: innovative material on MDPs, both in constrained settings and with uncertain transition properties; game-theoretic method for solving MDPs; theories for developing roll-out based algorithms; and details of approximation stochastic annealing, a population-based on-line simulation-based algorithm. The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling, and control, and simulation but will be a valuable source of tuition and reference for students of control and operations research.

Product Specifications

Format
hardcover
Domain
Amazon UK
Release Date
20 March 2013
Listed Since
02 March 2013

Barcode

No barcode data available

Similar Products You Might Like

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
96% match

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Springer

£41.42 08 Jul 2026
Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
96% match

Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Routledge

£165.96 13 Jul 2026
Birkhauser Stochastic Networked Control Systems Book
96% match

Birkhauser Stochastic Networked Control Systems Book

Birkhauser

£129.99 15 Jul 2026
Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)
96% match

Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)

Wiley

£122.41 16 Jul 2026
Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)
96% match

Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)

CRC Press

£107.40 05 Jul 2026
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
96% match

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Springer

£90.04 07 Jul 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
96% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£89.37 03 Jul 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
95% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£90.19 09 Jul 2026
Stochastic Processes, Optimization, and Control Theory: Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems: A Volume ... Operations Research & Management Science, 94)
95% match

Stochastic Processes, Optimization, and Control Theory: Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems: A Volume ... Operations Research & Management Science, 94)

Springer

£80.64 06 Jul 2026
Competitive Markov Decision Processes
95% match

Competitive Markov Decision Processes

Springer

£157.38 09 Jul 2026
Introduction to Diagnosis of Active Systems
95% match

Introduction to Diagnosis of Active Systems

Springer

£76.41 15 Jul 2026
Applied Mathematics with Open-Source Software - CRC Press
95% match

Applied Mathematics with Open-Source Software - CRC Press

CRC Press

£92.00 16 Jul 2026
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
95% match

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Springer

£93.38 14 Jul 2026
Applied Mathematics with Open-Source Software: Operational Research Problems with Python and R (Chapman & Hall/CRC Series in Operations Research)
95% match

Applied Mathematics with Open-Source Software: Operational Research Problems with Python and R (Chapman & Hall/CRC Series in Operations Research)

CRC Press

£43.00 03 Jul 2026
Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)
95% match

Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)

Price unavailable
Modeling, Stochastic Control, Optimization, and Applications: 164 (The IMA Volumes in Mathematics and its Applications, 164)
95% match

Modeling, Stochastic Control, Optimization, and Applications: 164 (The IMA Volumes in Mathematics and its Applications, 164)

Springer

£120.64 09 Jul 2026
Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)
95% match

Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)

Springer

£72.15 07 Jul 2026
Stochastic Differential Inclusions and Applications: 80 (Springer Optimization and Its Applications, 80)
95% match

Stochastic Differential Inclusions and Applications: 80 (Springer Optimization and Its Applications, 80)

Springer

£75.34 02 Jul 2026
Multiple Stopping Problems: Unilateral and Multilateral Approaches
95% match

Multiple Stopping Problems: Unilateral and Multilateral Approaches

Chapman and Hall/CRC

£81.99 15 Jul 2026