Learning and Invariance in a Family of Hierarchical Kernels
Name
MIT-CSAIL-TR-2010-035.pdf
Size
672.57 KB
Format
Adobe PDF
Checksum (MD5)
913334fad04a3675b39560396303101d
Author(s)
Wibisono, Andre
Bouvrie, Jake
Rosasco, Lorenzo
Poggio, Tomaso
Advisor(s)
Tomaso Poggio
Date Issued
July 30, 2010
Series/Report no.
CBCL-290
MIT-CSAIL-TR-2010-035
Abstract
Understanding invariance and discrimination properties of hierarchical models is arguably the key to understanding how and why such models, of which the the mammalian visual system is one instance, can lead to good generalization properties and reduce the sample complexity of a given learning task. In this paper we explore invariance to transformation and the role of layer-wise embeddings within an abstract framework of hierarchical kernels motivated by the visual cortex. Here a novel form of invariance is induced by propagating the effect of locally defined, invariant kernels throughout a hierarchy. We study this notion of invariance empirically. We then present an extension of the abstract hierarchical modeling framework to incorporate layer-wise embeddings, which we demonstrate can lead to improved generalization and scalable algorithms. Finally we analyze experimentally sample complexity properties as a function of architectural parameters.
Subjects
artificial intelligence
Persistent DSpace Link
