Repository logo
Log in(current)
Repository logoMIT Open ScholarshipDSpace@MIT
  1. Home
  2. MIT Open Access Articles
  3. MIT Open Access Articles
  4. Neural representation of action sequences: how far can a simple snippet-matching model take us?

Neural representation of action sequences: how far can a simple snippet-matching model take us?

Thumbnail Image
Download
Name

NIPS2013.pdf

Size

629.45 KB

Format

Adobe PDF

Checksum (MD5)

34b601ba49218d13d3fcef83f9534e2b

Author(s)
Tan, Cheston
•
Singer, Jedediah M.
•
Serre, Thomas
•
Sheinberg, David
•
Poggio, Tomaso A.
Date Issued
December 2013
Journal
Advances in Neural Information Processing Systems 26 (NIPS 2013)
Publisher
Neural Information Processing Systems Foundation, Inc.
Citation
Tan, Cheston, Jedediah M. Singer, Thomas Serre, David Sheinberg and Tomaso Poggio. "Neural representation of action sequences: how far can a simple snippet-matching model take us?" Advances in neural information processing systems 26 (NIPS 2013), Lake Tahoe, Nevada, United States, December 5-10, 2013.
Version
Author's final manuscript
Abstract
The macaque Superior Temporal Sulcus (STS) is a brain area that receives and integrates inputs from both the ventral and dorsal visual processing streams (thought to specialize in form and motion processing respectively). For the processing of articulated actions, prior work has shown that even a small population of STS neurons contains sufficient information for the decoding of actor invariant to action, action invariant to actor, as well as the specific conjunction of actor and action. This paper addresses two questions. First, what are the invariance properties of individual neural representations (rather than the population representation) in STS? Second, what are the neural encoding mechanisms that can produce such individual neural representations from streams of pixel images? We find that a baseline model, one that simply computes a linear weighted sum of ventral and dorsal responses to short action “snippets”, produces surprisingly good fits to the neural data. Interestingly, even using inputs from a single stream, both actor-invariance and action-invariance can be produced simply by having different linear weights.
MIT Department
Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
http://creativecommons.org/licenses/by-nc-sa/4.0/
Persistent DSpace Link
http://hdl.handle.net/1721.1/94612
DOI of Published Version
http://papers.nips.cc/paper/5052-neural-representation-of-action-sequences-how-far-can-a-simple-snippet-matching-model-take-us
Repository logo
PrivacyPermissionsAccessibilityContact us
Repository logo
Notify us about copyright concerns.