£73.85

Springer Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Price data last checked 94 day(s) ago - refreshing...

View at Amazon

We'll watch every seller, every day. One email when your price arrives.

This is the usual price. Wait for it to drop, or tell us your number.

£74 today · usual range £0–£0 · best ever £69

NEW HERE?

Amazon shows you one price. We show you all of them.

Tosheroon watches Amazon prices so you don't have to. Every product on Amazon has a price history — we make it visible. Set the price you'd actually pay, and we'll email you the second it gets there. No app, no account, one email.

WHAT'S ON THIS PAGE

↓ Price chart
when this has been cheap or pricey
↓ Forecast
where the price is heading next
↓ Statistics
all-time high & low, recent range
↑ Price alert
name your number, we'll email you

Price History & Forecast

Grey patches = out of stock. Cheaper = lower on the chart. Hover for exact prices.

Last 637 days • 637 data points (No recent data available)

Historical
Generating forecast...
£75.68 £68.32 £69.93 £71.53 £73.14 £74.74 £76.35 10 June 2024 16 November 2024 24 April 2025 30 September 2025 08 March 2026

Price Distribution

Price distribution over 637 days • 7 price levels

Days at Price
Current Price
52 days 218 days 196 days 22 days 95 days 43 days · current 11 days 0 55 109 164 218 £69 £70 £71 £72 £73 £74 £76 Days at Price

Price Analysis

Most common price: £70 (218 days, 34.2%)

Price range: £69 - £76

Price levels: 7 different prices over 637 days

Description

Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dimensionality and so making practical solution of the resulting models intractable. In other cases, the system of interest is too complex to allow explicit specification of some of the MDP model parameters, but simulation samples are readily available (e.g., for random transitions and costs). For these settings, various sampling and population-based algorithms have been developed to overcome the difficulties of computing an optimal solution in terms of a policy and/or value function. Specific approaches include adaptive sampling, evolutionary policy iteration, evolutionary random policy search, and model reference adaptive search. This substantially enlarged new edition reflects the latest developments in novel algorithms and their underpinning theories, and presents an updated account of the topics that have emerged since the publication of the first edition. Includes: innovative material on MDPs, both in constrained settings and with uncertain transition properties; game-theoretic method for solving MDPs; theories for developing roll-out based algorithms; and details of approximation stochastic annealing, a population-based on-line simulation-based algorithm. The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling, and control, and simulation but will be a valuable source of tuition and reference for students of control and operations research.

Product Specifications

Format
hardcover
Domain
Amazon UK
Release Date
20 March 2013
Listed Since
02 March 2013

Barcode

No barcode data available

Similar Products You Might Like

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)
96% match

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Springer

£40.84 07 Mar 2026
Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
96% match

Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Routledge

£165.96 12 Apr 2026
Birkhauser Stochastic Networked Control Systems Book
96% match

Birkhauser Stochastic Networked Control Systems Book

Birkhauser

£124.99 17 Apr 2026
Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)
96% match

Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)

Wiley

£100.00 19 Apr 2026
Stochastic Teams, Games, and Control under Information Constraints (Systems & Control: Foundations & Applications)
96% match

Stochastic Teams, Games, and Control under Information Constraints (Systems & Control: Foundations & Applications)

£124.31 24 Jan 2026
Handbook of Markov Decision Processes: Methods and Applications: 40 (International Series in Operations Research & Management Science, 40)
96% match

Handbook of Markov Decision Processes: Methods and Applications: 40 (International Series in Operations Research & Management Science, 40)

Springer

£180.00 07 Jan 2026
Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)
96% match

Reinforcement Learning and Dynamic Programming Using Function Approximators: 39 (Automation and Control Engineering)

CRC Press

£106.83 28 Feb 2026
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
96% match

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Springer

£104.13 04 Mar 2026
Frontiers Of Intelligent Control And Information Processing
96% match

Frontiers Of Intelligent Control And Information Processing

World Scientific Publishing Company

£71.10 14 Jan 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
96% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£93.19 27 Feb 2026
Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)
96% match

Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)

Routledge

£112.00 12 Jan 2026
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)
95% match

Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning: 55 (Operations Research/Computer Science Interfaces Series, 55)

Springer

£102.76 08 Mar 2026
Stochastic Processes, Optimization, and Control Theory: Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems: A Volume ... Operations Research & Management Science, 94)
95% match

Stochastic Processes, Optimization, and Control Theory: Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems: A Volume ... Operations Research & Management Science, 94)

Springer

£83.68 02 Mar 2026
Competitive Markov Decision Processes: With 57 Illustrations
95% match

Competitive Markov Decision Processes: With 57 Illustrations

Springer

£159.99 06 Feb 2026
Competitive Markov Decision Processes
95% match

Competitive Markov Decision Processes

Springer

£156.81 08 Mar 2026
Introduction to Diagnosis of Active Systems
95% match

Introduction to Diagnosis of Active Systems

Springer

£76.02 16 Apr 2026
Applied Mathematics with Open-Source Software - CRC Press
95% match

Applied Mathematics with Open-Source Software - CRC Press

CRC Press

£92.00 19 Apr 2026
Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
95% match

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Springer

£92.98 14 Apr 2026
Applied Mathematics with Open-Source Software: Operational Research Problems with Python and R (Chapman & Hall/CRC Series in Operations Research)
95% match

Applied Mathematics with Open-Source Software: Operational Research Problems with Python and R (Chapman & Hall/CRC Series in Operations Research)

CRC Press

£46.62 25 Feb 2026
Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)
95% match

Model-based Reinforcement Learning: A Survey (Foundations and Trends® in Machine Learning)

Out of Stock 04 Apr 2026
Reinforcement Learning for Decision & Optimal Control - Springer
95% match

Reinforcement Learning for Decision & Optimal Control - Springer

£61.49 13 Jan 2026
Modeling, Stochastic Control, Optimization, and Applications: 164 (The IMA Volumes in Mathematics and its Applications, 164)
95% match

Modeling, Stochastic Control, Optimization, and Applications: 164 (The IMA Volumes in Mathematics and its Applications, 164)

Springer

£120.84 09 Mar 2026
Reinforcement Learning for Sequential Decision and Optimal Control
95% match

Reinforcement Learning for Sequential Decision and Optimal Control

£76.78 13 Jan 2026
Adaptive Dynamic Programming for Control: Algorithms and Stability (Communications and Control Engineering)
95% match

Adaptive Dynamic Programming for Control: Algorithms and Stability (Communications and Control Engineering)

Springer

£108.45 06 Jan 2026