dc.contributor.author | Fisher, John W., III | |
dc.contributor.author | Siracusa, Michael | |
dc.contributor.author | Tieu, Kinh | |
dc.date.accessioned | 2010-10-13T20:46:40Z | |
dc.date.available | 2010-10-13T20:46:40Z | |
dc.date.issued | 2009-02 | |
dc.date.submitted | 2009-01 | |
dc.identifier.isbn | 978-1-4244-3677-4 | |
dc.identifier.other | INSPEC Accession Number: 10476090 | |
dc.identifier.uri | http://hdl.handle.net/1721.1/59304 | |
dc.description.abstract | Information measures have long been studied in the context of hypothesis testing leading to variety of bounds on performance based on the information content of a signal or the divergence between distributions. Here we consider the problem of estimation of information content for high-dimensional signals for purposes of classification. Direct estimation of information for high-dimensional signals is generally not tractable therefore we consider an extension to a method first suggested in (J.W. Fisher III and J.C. Principle, 1998) in which high dimensional signals are mapped to lower dimensional feature spaces yielding lower bounds on information content. We develop an affine-invariant gradient method and examine the utility of the resulting estimates for predicting classification performance empirically. | en_US |
dc.description.sponsorship | United States. Air Force Office of Scientific Research (Grant FA9550-06-1-0324) | en_US |
dc.description.sponsorship | United States. Army Research Office (grant W911NF-06-1-0076) | en_US |
dc.language.iso | en_US | |
dc.publisher | Institute of Electrical and Electronics Engineers | en_US |
dc.relation.isversionof | http://dx.doi.org/10.1109/DSP.2009.4785948 | en_US |
dc.rights | Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. | en_US |
dc.source | IEEE | en_US |
dc.subject | feature extraction | en_US |
dc.subject | information measures | en_US |
dc.subject | invariance | en_US |
dc.subject | mutual information | en_US |
dc.title | Estimation of signal information content for classification | en_US |
dc.type | Article | en_US |
dc.identifier.citation | Fisher, J.W., M. Siracusa, and Kinh Tieu. “Estimation of Signal Information Content for Classification.” Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop, 2009. DSP/SPE 2009. IEEE 13th. 2009. 353-358.© 2009 Institute of Electrical and Electronics Engineers. | en_US |
dc.contributor.department | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory | en_US |
dc.contributor.approver | Fisher, John W., III | |
dc.contributor.mitauthor | Fisher, John W., III | |
dc.contributor.mitauthor | Siracusa, Michael | |
dc.relation.journal | IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop, 2009. DSP/SPE 2009 | en_US |
dc.eprint.version | Final published version | en_US |
dc.type.uri | http://purl.org/eprint/type/JournalArticle | en_US |
eprint.status | http://purl.org/eprint/status/PeerReviewed | en_US |
dspace.orderedauthors | Fisher, John W.; Siracusa, Michael; Tieu, Kinh | en |
dc.identifier.orcid | https://orcid.org/0000-0003-4844-3495 | |
mit.license | PUBLISHER_POLICY | en_US |
mit.metadata.status | Complete | |