SELECTED TOPICS ON CONTINUOUS-TIME CONTROLLED MARKOV CHAINS AND MARKOV GAMES: 5 (Icp Advanced Texts In Mathematics) - Image 1

£59.72

Imperial College Press SELECTED TOPICS ON CONTINUOUS-TIME CONTROLLED MARKOV CHAINS AND MARKOV GAMES: 5 (Icp Advanced Texts In Mathematics)

Name: SELECTED TOPICS ON CONTINUOUS-TIME CONTROLLED MARKOV CHAINS AND MARKOV GAMES: 5 (Icp Advanced Texts In Mathematics)
Brand: Imperial College Press
Price: 58.36 GBP
Availability: InStock

Applied Mathematics

Price History & Forecast

Last 83 days • 83 data points (No recent data available)

Historical

Generating forecast...

Price Distribution

Price distribution over 83 days • 6 price levels

Days at Price

Current Price

Price Analysis

Most common price: £57 (33 days, 39.8%)

Price range: £52 - £60

Price levels: 6 different prices over 83 days

Description

From the Back Cover This book concerns continuous-time controlled Markov chains and Markov games. The former, which are also known as continuous-time Markov decision processes, form a class of stochastic control problems in which a single decision-maker has a wish to optimize a given objective function. In contrast, there are two or more decision-makers (or players, or controllers) trying to optimize its own objective function in a Markov game. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science among other areas. The main features of the control and game models studied in the book are the continuous time variable, the denumerable state space, and that the control (or action) sets are Borel spaces. Moreover, the transition and reward rates of the dynamical system may be unbounded. The authors are interested in some aspects of controlled Markov chains and Markov games such as characterizing the optimal reward functions, and determining optimal policies for each of the optimality criteria studied here. The main focus is on advanced optimality criteria (such as, bias, variance, sensitive discount, and Blackwell optimality), though they also deal with the basic optimality criteria (discounted and average reward). A particular emphasis is made on the application of the results presented in this book. One of the main concerns is to propose assumptions on the control and game models that are easily verifiable (and verified) in practice. Moreover, algorithmic and computational issues are also analyzed. In particular, the authors propose approximation results that allow precise numerical approximations of the solution to some problems of practical interest. Applications to population models and epidemic processes are also shown. Product Description This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control problems in which a single decision-maker wishes to optimize a given objective function. This book is also concerned with Markov games, where two decision-makers (or players) try to optimize their own objective function. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science, among other areas.An extensive, self-contained, up-to-date analysis of basic optimality criteria (such as discounted and average reward), and advanced optimality criteria (e.g., bias, overtaking, sensitive discount, and Blackwell optimality) is presented. A particular emphasis is made on the application of the results herein: algorithmic and computational issues are discussed, and applications to population models and epidemic processes are shown.This book is addressed to students and researchers in the fields of stochastic control and stochastic games. Moreover, it could be of interest also to undergraduate and beginning graduate students because the reader is not supposed to have a high mathematical background: a working knowledge of calculus, linear algebra, probability, and continuous-time Markov chains should suffice to understand the contents of the book.

Product Specifications

Brand: Imperial College Press
Format: hardcover
ASIN: 1848168489
Category: Books > Subjects > Science, Nature & Maths > Mathematics > Applied Mathematics
Domain: Amazon UK
Release Date: 16 May 2012
Listed Since: 05 July 2011

Barcode

No barcode data available

Imperial College Press SELECTED TOPICS ON CONTINUOUS-TIME CONTROLLED MARKOV CHAINS AND MARKOV GAMES: 5 (Icp Advanced Texts In Mathematics)

Price History & Forecast

Price Distribution

Price Analysis

Description

Product Specifications

Barcode

Similar Products You Might Like

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Stochastic Dynamic Programming and the Control of Queueing Systems: 505 (Wiley Series in Probability and Statistics)

Further Topics on Discrete-Time Markov Control Processes: 42 (Stochastic Modelling and Applied Probability, 42)

Continuous-Time Markov Decision Processes: Theory and Applications: 62 (Stochastic Modelling and Applied Probability, 62)

Topics in the Constructive Theory of Countable Markov Chains

Rabi N. Bhattacharya: Selected Papers (Contemporary Mathematicians)

Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems (Systems & Control: Foundations & Applications)

Linear Stochastic Systems: A Geometric Approach to Modeling, Estimation and Identification: 1 (Series in Contemporary Mathematics, 1)

Zur Güte linearer Entscheidungsregeln in Produktions-Lagerhaltungs-Modellen: 47 (Beiträge zur betriebswirtschaftlichen Forschung, 47)

Non-cooperative Stochastic Differential Game Theory of Generalized Markov Jump Linear Systems: 67 (Studies in Systems, Decision and Control, 67)

Stochastic Processes and their Applications: Proceedings of the Symposium held in honour of Professor S.K. Srinivasan at the Indian Institute of ... in Economics and Mathematical Systems, 370)

Markov Chains on Metric Spaces: A Short Course (Universitext)

Nonlinear System I: Proceedings of the 14th World Congress, International Federation of Automatic Control, Beijing, P.R. China, 5-9 July 1999 (IFAC ... Volumes) (IFAC Proceedings Volumes, Volume F)

Formal Methods for Discrete-Time Dynamical Systems: 89 (Studies in Systems, Decision and Control, 89)

Dynamics of Information Systems: Algorithmic Approaches: 51 (Springer Proceedings in Mathematics & Statistics, 51)

Introduction to Diagnosis of Active Systems

Continuous Time Markov Processes: An Introduction (Graduate Studies in Mathematics)

General Pontryagin-Type Stochastic Maximum Principle and Backward Stochastic Evolution Equations in Infinite Dimensions (SpringerBriefs in Mathematics)

Matrix-Analytic Methods in Stochastic Models: 27 (Springer Proceedings in Mathematics & Statistics, 27)

Recent Advances in System Reliability: Signatures, Multi-state Systems and Statistical Inference (Springer Series in Reliability Engineering)

Ergodic Behavior of Markov Processes: With Applications to Limit Theorems (de Gruyter Studies in Mathematics): 67

Large Deviations for Stochastic Processes (Mathematical Surveys & Monographs)

Generators of Markov Chains: From a Walk in the Interior to a Dance on the Boundary: 190 (Cambridge Studies in Advanced Mathematics, Series Number 190)

Linear Time Varying Systems and Sampled-data Systems: 265 (Lecture Notes in Control and Information Sciences, 265)