Price loading...

Routledge Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)

Price data last checked 103 day(s) ago - refreshing...

View at Amazon

Price History & Forecast

No Price Data Available

Price history will appear here once data is collected from Amazon.

Price Distribution

No price data available for histogram

Description

This book presents a radically new approach to problems of evaluating and optimizing the performance of continuous-time stochastic systems. This approach is based on the use of a family of Markov processes called Piecewise-Deterministic Processes (PDPs) as a general class of stochastic system models. A PDP is a Markov process that follows deterministic trajectories between random jumps, the latter occurring either spontaneously, in a Poisson-like fashion, or when the process hits the boundary of its state space. This formulation includes an enormous variety of applied problems in engineering, operations research, management science and economics as special cases; examples include queueing systems, stochastic scheduling, inventory control, resource allocation problems, optimal planning of production or exploitation of renewable or non-renewable resources, insurance analysis, fault detection in process systems, and tracking of maneuvering targets, among many others. The first part of the book shows how these applications lead to the PDP as a system model, and the main properties of PDPs are derived. There is particular emphasis on the so-called extended generator of the process, which gives a general method for calculating expectations and distributions of system performance functions. The second half of the book is devoted to control theory for PDPs, with a view to controlling PDP models for optimal performance: characterizations are obtained of optimal strategies both for continuously-acting controllers and for control by intervention (impulse control). Throughout the book, modern methods of stochastic analysis are used, but all the necessary theory is developed from scratch and presented in a self-contained way. The book will be useful to engineers and scientists in the application areas as well as to mathematicians interested in applications of stochastic analysis.

Key Features

Markov Models and Optimization: 49 (Chapman & Hall/CRC Monographs on Statistics and Applied Probability)

Product type: ABIS BOOK

Chapman and Hall/CRC

Product Specifications

Format
hardcover
Domain
Amazon UK
Publication Date
01 January 1993
Listed Since
05 February 2007

Barcode

No barcode data available

Similar Products You Might Like

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)
94% match

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach: 37 (Stochastic Modelling and Applied Probability, 37)

Springer

£91.63 01 Apr 2026
Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)
94% match

Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)

Springer

£91.63 05 Mar 2026
Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)
94% match

Markov Chains: Models, Algorithms and Applications: 189 (International Series in Operations Research & Management Science, 189)

Springer

£90.33 05 Feb 2026
Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)
94% match

Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)

Springer

£138.76 12 Jan 2026
Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)
94% match

Markov Decision Processes in Practice: 248 (International Series in Operations Research & Management Science, 248)

Springer

£193.01 12 Jan 2026
Markov Chains and Decision Processes for Engineers and Managers
94% match

Markov Chains and Decision Processes for Engineers and Managers

CRC Press

£60.99 12 Jan 2026
Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)
94% match

Discrete-Time Markov Control Processes: Basic Optimality Criteria: 30 (Stochastic Modelling and Applied Probability, 30)

Springer

£104.13 04 Mar 2026
Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)
93% match

Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Springer

£78.83 09 Mar 2026
Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)
93% match

Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

Springer

£73.85 08 Mar 2026
Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)
93% match

Constrained Markov Decision Processes: Stochastic Modeling: 7 (Stochastic Modeling Series)

Routledge

£165.96 12 Apr 2026
Birkhauser Stochastic Networked Control Systems Book
93% match

Birkhauser Stochastic Networked Control Systems Book

Birkhauser

£124.99 17 Apr 2026
Markov Processes (Advances in Applied Mathematics)
93% match

Markov Processes (Advances in Applied Mathematics)

Chapman and Hall/CRC

£65.84 29 Jan 2026
Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)
93% match

Continuous-Time Markov Decision Processes: Borel Space Models and General Control Strategies: 97 (Probability Theory and Stochastic Modelling, 97)

Springer

£70.15 04 Mar 2026
Markov Renewal and Piecewise Deterministic Processes: 100 (Probability Theory and Stochastic Modelling, 100)
93% match

Markov Renewal and Piecewise Deterministic Processes: 100 (Probability Theory and Stochastic Modelling, 100)

£85.47 06 Jan 2026
Markov Renewal and Piecewise Deterministic Processes: 100 (Probability Theory and Stochastic Modelling, 100)
93% match

Markov Renewal and Piecewise Deterministic Processes: 100 (Probability Theory and Stochastic Modelling, 100)

Springer

£91.94 11 Apr 2026
Computational Probability: 24 (International Series in Operations Research & Management Science, 24)
93% match

Computational Probability: 24 (International Series in Operations Research & Management Science, 24)

Springer

£176.14 10 Apr 2026
Computational Probability: 24 (International Series in Operations Research & Management Science, 24)
93% match

Computational Probability: 24 (International Series in Operations Research & Management Science, 24)

Springer

£160.25 07 Jan 2026
Fundamentals of Queueing Networks: Performance, Asymptotics, and Optimization: 46 (Stochastic Modelling and Applied Probability, 46)
93% match

Fundamentals of Queueing Networks: Performance, Asymptotics, and Optimization: 46 (Stochastic Modelling and Applied Probability, 46)

Springer

£74.30 05 Mar 2026
Handbook of Markov Decision Processes: Methods and Applications: 40 (International Series in Operations Research & Management Science, 40)
93% match

Handbook of Markov Decision Processes: Methods and Applications: 40 (International Series in Operations Research & Management Science, 40)

Springer

£180.00 07 Jan 2026
Elements of Applied Stochastic Processes: 378 (Wiley Series in Probability and Statistics)
93% match

Elements of Applied Stochastic Processes: 378 (Wiley Series in Probability and Statistics)

Wiley

£143.69 29 Mar 2026
Modeling and Analysis of Stochastic Systems (Chapman & Hall/CRC Texts in Statistical Science)
93% match

Modeling and Analysis of Stochastic Systems (Chapman & Hall/CRC Texts in Statistical Science)

CRC Press

£95.52 19 Apr 2026
Portfolio Optimization and Performance Analysis (Chapman and Hall/CRC Financial Mathematics Series)
93% match

Portfolio Optimization and Performance Analysis (Chapman and Hall/CRC Financial Mathematics Series)

CRC Press

£166.98 13 Jan 2026
Probability, Markov Chains, Queues, and Simulation: The Mathematical Basis of Performance Modeling
93% match

Probability, Markov Chains, Queues, and Simulation: The Mathematical Basis of Performance Modeling

Princeton University Press

£74.77 30 Jan 2026
Springer Applied Stochastic Models and Control for Finance
93% match

Springer Applied Stochastic Models and Control for Finance

Springer

£110.49 01 Mar 2026