Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30) - Image 1

£104.13

Springer Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Name: Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
Brand: Springer
Price: 106.45 GBP
Availability: InStock

Gardening

Price History & Forecast

Last 32 days • 32 data points (No recent data available)

Historical

Generating forecast...

Price Distribution

Price distribution over 32 days • 4 price levels

Days at Price

Current Price

Price Analysis

Most common price: £105 (21 days, 65.6%)

Price range: £104 - £106

Price levels: 4 different prices over 32 days

Description

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.

Product Specifications

Brand: Springer
Format: paperback
ASIN: 1461268842
Category: Books > Subjects > Crafts, Hobbies & Home > Gardening
Domain: Amazon UK
Publication Date: 30 September 2012
Listed Since: 14 July 2013

Barcode

No barcode data available

Springer Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Price History & Forecast

Price Distribution

Price Analysis

Description

Product Specifications

Barcode

Similar Products You Might Like

Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Controlled Markov Processes: 235 (Grundlehren der mathematischen Wissenschaften, 235)

Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)

An Introduction to Optimal Control Theory: The Dynamic Programming Approach: 76 (Texts in Applied Mathematics, 76)

Birkhauser Stochastic Networked Control Systems Book

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Handbook of Markov Decision Processes: Methods and Applications: 40 (International Series in Operations Research & Management Science, 40)

Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality (Systems & Control: Foundations & Applications)

Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Competitive Markov Decision Processes

Markov Chains (Springer Series in Operations Research and Financial Engineering)

Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Continuous-Time Markov Jump Linear Systems (Probability and Its Applications)

Stochastic Modelling and Control (Monographs on Statistics and Applied Probability)

Springer Linear Systems Control: Deterministic and Stochastic Methods

Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)

Mathematical Methods in Robust Control of Discrete-Time Linear Stochastic Systems

Optimal Control: Basics and Beyond: 7 (Wiley Interscience Series in Systems and Optimization)

Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems (SpringerBriefs in Mathematics)

Competitive Markov Decision Processes: With 57 Illustrations

Markov Chains and Stochastic Stability (Communications and Control Engineering)

Model Predictive Control: Theory, Computation, and Design

Controlled Markov Processes and Viscosity Solutions: Stochastic modelling and applied probability, vol 25

Introduction to Process Control: Analysis, Mathematical Modeling, Control and Optimization (Springer Texts in Business and Economics)