Connecting symbols to primitive percepts using expectation as feedback
Name
1227787166-MIT.pdf
Size
1.28 MB
Format
Adobe PDF
Checksum (MD5)
81f2302b7ecdc319874e06cab1e04022
Author(s)
Muco, Manushaqe.
Advisor(s)
Gerald Jay Sussman.
Date Issued
2020
Publisher
Massachusetts Institute of Technology
Abstract
This thesis is a step towards understanding and building mechanisms that connect symbols to primitive percepts. Symbols, such as those used in symbolic reasoning and language, are more intuitive to us humans since our languages and artifacts are highly symbolic. On the other hand, primitive percepts are results of processes that combine large amounts of evidence numerically, and are thus opaque to our human understanding. Inspired by an optical illusion known as Kanizsa's Triangle, I propose that expectation is essential to perception at every layer, including the very lowest levels. My proposal is that expectations generate hallucinations, that when mutually constrained with the sense data, produce a reasonable interpretation of that data. Furthermore, the mechanisms that project expectations may just be what connects, at an appropriate level, symbols to percepts. To engineer such mechanisms in an artificial machine, I start with feedback at every layer as a simple mechanism for projecting expectations. I then present a multi-layered distributed structure that incorporates such feedback expectations, and that recognizes and hallucinates images of digits using a bidirectional mutual constraining process. In this process the higher layers work as critics on lower layers, filling in details and removing noise to improve the data at that level.
Description
Thesis: S.M., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, September, 2020
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 61-62).
Subjects
Program in Media Arts and Sciences
MIT Department
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Terms of Use
MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided.
Persistent DSpace Link
