| dc.contributor.author | Tsitsiklis, John N. | |
| dc.date.accessioned | 2012-04-12T17:57:40Z | |
| dc.date.available | 2012-04-12T17:57:40Z | |
| dc.date.issued | 2006-08 | |
| dc.date.submitted | 2006-05 | |
| dc.identifier.issn | 0167-6377 | |
| dc.identifier.uri | http://hdl.handle.net/1721.1/69999 | |
| dc.description.abstract | The unichain condition requires that every policy in an MDP result in a single ergodic class, and guarantees that the optimal average cost is independent of the initial state. We show that checking whether the unichain condition fails to hold is an NP-complete problem. We conclude with a brief discussion of the merits of the more general weak accessibility condition. | en_US |
| dc.description.sponsorship | National Science Foundation (U.S.) (contract ECS-0312921) | en_US |
| dc.language.iso | en_US | |
| dc.publisher | Elsevier | en_US |
| dc.relation.isversionof | http://dx.doi.org/10.1016/j.orl.2006.06.005 | en_US |
| dc.rights | Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. | en_US |
| dc.source | Elsevier Ltd. | en_US |
| dc.title | NP-Hardness of checking the unichain condition in average cost MDPs | en_US |
| dc.type | Article | en_US |
| dc.identifier.citation | Tsitsiklis, John N. “NP-Hardness of Checking the Unichain Condition in Average Cost MDPs.” Operations Research Letters 35.3 (2007): 319–323. Web. 12 Apr. 2012. © 2006 Elsevier B.V. | en_US |
| dc.contributor.department | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science | en_US |
| dc.contributor.approver | Tsitsiklis, John N. | |
| dc.contributor.mitauthor | Tsitsiklis, John N. | |
| dc.relation.journal | Operations Research Letters | en_US |
| dc.eprint.version | Final published version | en_US |
| dc.type.uri | http://purl.org/eprint/type/JournalArticle | en_US |
| eprint.status | http://purl.org/eprint/status/PeerReviewed | en_US |
| dspace.orderedauthors | Tsitsiklis, John N. | en |
| dc.identifier.orcid | https://orcid.org/0000-0003-2658-8239 | |
| mit.license | MIT_AMENDMENT | en_US |
| mit.metadata.status | Complete | |