Login

A Note on Support Vector Machines Degeneracy

Show simple item record

dc.contributor.author Rifkin, Ryan en_US
dc.contributor.author Pontil, Massimiliano en_US
dc.contributor.author Verri, Alessandro en_US
dc.date.accessioned 2004-10-22T20:17:55Z
dc.date.available 2004-10-22T20:17:55Z
dc.date.issued 1999-08-11 en_US
dc.identifier.other AIM-1661 en_US
dc.identifier.other CBCL-177 en_US
dc.identifier.uri http://hdl.handle.net/1721.1/7291
dc.description.abstract When training Support Vector Machines (SVMs) over non-separable data sets, one sets the threshold $b$ using any dual cost coefficient that is strictly between the bounds of $0$ and $C$. We show that there exist SVM training problems with dual optimal solutions with all coefficients at bounds, but that all such problems are degenerate in the sense that the "optimal separating hyperplane" is given by ${f w} = {f 0}$, and the resulting (degenerate) SVM will classify all future points identically (to the class that supplies more training data). We also derive necessary and sufficient conditions on the input data for this to occur. Finally, we show that an SVM training problem can always be made degenerate by the addition of a single data point belonging to a certain unboundedspolyhedron, which we characterize in terms of its extreme points and rays. en_US
dc.description.provenance Made available in DSpace on 2004-10-22T20:17:55Z (GMT). No. of bitstreams: 2 AIM-1661.ps: 1117769 bytes, checksum: 2f2f4b721f23119fd8bf659d424058b5 (MD5) AIM-1661.pdf: 262084 bytes, checksum: 778e6a5a4c131c2275abf6d82aca0b9b (MD5) Previous issue date: 1999-08-11 en
dc.format.extent 10 p. en_US
dc.format.extent 1117769 bytes
dc.format.extent 262084 bytes
dc.format.mimetype application/postscript
dc.format.mimetype application/pdf
dc.language.iso en_US
dc.relation.ispartofseries AIM-1661 en_US
dc.relation.ispartofseries CBCL-177 en_US
dc.subject AI en_US
dc.subject MIT en_US
dc.subject Artificial Intelligence en_US
dc.subject Support Vector Machines en_US
dc.subject Scale Sensitive Loss Function en_US
dc.subject Statistical Learning Theory. en_US
dc.title A Note on Support Vector Machines Degeneracy en_US

Files in this item

Files Size Format
AIM-1661.pdf 262.0Kb application/pdf
AIM-1661.ps 1.117Mb application/postscript

This item appears in the following Collection(s)

Show simple item record

Search DSpace@MIT


Advanced Search

Browse

My Account

Links