Show simple item record

dc.contributor.authorTsitsiklis, John N.
dc.date.accessioned2012-04-12T17:57:40Z
dc.date.available2012-04-12T17:57:40Z
dc.date.issued2006-08
dc.date.submitted2006-05
dc.identifier.issn0167-6377
dc.identifier.urihttp://hdl.handle.net/1721.1/69999
dc.description.abstractThe unichain condition requires that every policy in an MDP result in a single ergodic class, and guarantees that the optimal average cost is independent of the initial state. We show that checking whether the unichain condition fails to hold is an NP-complete problem. We conclude with a brief discussion of the merits of the more general weak accessibility condition.en_US
dc.description.sponsorshipNational Science Foundation (U.S.) (contract ECS-0312921)en_US
dc.language.isoen_US
dc.publisherElsevieren_US
dc.relation.isversionofhttp://dx.doi.org/10.1016/j.orl.2006.06.005en_US
dc.rightsArticle is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.en_US
dc.sourceElsevier Ltd.en_US
dc.titleNP-Hardness of checking the unichain condition in average cost MDPsen_US
dc.typeArticleen_US
dc.identifier.citationTsitsiklis, John N. “NP-Hardness of Checking the Unichain Condition in Average Cost MDPs.” Operations Research Letters 35.3 (2007): 319–323. Web. 12 Apr. 2012. © 2006 Elsevier B.V.en_US
dc.contributor.departmentMassachusetts Institute of Technology. Department of Electrical Engineering and Computer Scienceen_US
dc.contributor.approverTsitsiklis, John N.
dc.contributor.mitauthorTsitsiklis, John N.
dc.relation.journalOperations Research Lettersen_US
dc.eprint.versionFinal published versionen_US
dc.type.urihttp://purl.org/eprint/type/JournalArticleen_US
eprint.statushttp://purl.org/eprint/status/PeerRevieweden_US
dspace.orderedauthorsTsitsiklis, John N.en
dc.identifier.orcidhttps://orcid.org/0000-0003-2658-8239
mit.licenseMIT_AMENDMENTen_US
mit.metadata.statusComplete


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record