| Abstract: | Algorithms are described for determining optimal policies for finite state, finite action, infinite discrete time horizon Markov decision processes. Both value-improvement and policy-improvement techniques are used in the algorithms. Computing procedures are also described. The algorithms are appropriate for processes that are either finite or infinite, deterministic or stochastic, discounted or undiscounted, in any meaningful combination of these features. Computing procedures are described in terms of initial data processing, bound improvements, process reduction, and testing and solution. Application of the methodology is illustrated with an example involving natural resource management. Management implications of certain hypothesized relationships between mallard survival and harvest rates are addressed by applying the optimality procedures to mallard population models. |
| Genre: | Article |
| ProdID: | 5221948 |
| Citation Author: | Williams, B.K. |
| Citation Contributing Office: | Patuxent Wildlife Research Center |
| Citation Datum: | |
| Citation Day: | |
| Citation Edition: | |
| Citation Editor: | |
| Citation End Page: | 271 |
| Citation Issue: | 4 |
| Citation Keywords: | |
| Citation Language: | English |
| Citation Larger Work Title: | Applied Stochastic Models and Data Analysis |
| Citation LatN: | |
| Citation LatS: | |
| Citation LonE: | |
| Citation LonW: | |
| Citation Month: | |
| Citation No Pagination: | |
| Citation Number Of Pages: | 19 |
| Citation Online Only Flag: | |
| Citation Phsyical Description: | 253-271 |
| Citation Projection: | |
| Citation Public Comments: | |
| Citation Publisher: | |
| Citation Series: | |
| Citation Series Code: | |
| Citation Series Number: | |
| Citation Search Results Text: | MARKOV: A methodology for the solution of infinite time horizon MARKOV decision processes; 1988; Article; Journal; Applied Stochastic Models and Data Analysis; Williams, B.K. |
| Citation Start Page: | 253 |
| Citation Volume: | 4 |
| Citation Year: | 1988 |
| Type: | citation/reference |
| Text: | MARKOV: A methodology for the solution of infinite time horizon MARKOV decision processes; 1988; Article; Journal; Applied Stochastic Models and Data Analysis; Williams, B.K. |
| URL (THUMBNAIL): | http://pubs.er.usgs.gov/thumbnails/outside_thumb.jpg |
| URL (DOCUMENT): | http://dx.doi.org/10.1002/asm.3150040405 |
| Date Other: | Wed, 16 Jun 2010 12:19 -0500 |
| Publisher: | |
