A Neurosymbolic Approach to Abstraction and Reasoning
Name
Alford-salford-meng-eecs-2021-thesis.pdf
Description
Thesis PDF
Size
4.26 MB
Format
Adobe PDF
Checksum (MD5)
b061d10f1e0807656628509de1c72a22
Author(s)
Alford, Simon
Advisor(s)
Poggio, Tomaso
Date Issued
June 2021
Publisher
Massachusetts Institute of Technology
Abstract
Current deep learning systems are highly specialized to whatever task they are designed to solve. Their application to more general domains is limited by their inability to form explicit, systematic knowledge and reason over it. Such an ability would be required for a machine to, for instance, rediscover the scientific method, and use this method to learn new things. This thesis attempts to make progress on this front by developing an approach for the Abstraction and Reasoning Corpus (ARC), an artificial intelligence benchmark consisting of a set of few-shot visual reasoning tasks which measures the ability for an agent to solve tasks beyond those specified by the developer. We present two approaches that address that challenges posed by ARC. First, we give an approach for learning abstractions on ARC. We apply a program synthesis system called DreamCoder to create symbolic abstractions out of the solutions of tasks solved so far. These abstractions enable the solving of progressively more difficult ARC tasks. Second, we design a reasoning algorithm for ARC motivated by the way humans approach solving ARC tasks. Our algorithm combines execution-guided program synthesis with deductive reasoning based on inverse semantics, enabling a bidirectional, execution-guided program synthesis algorithm for solving ARC tasks. Despite difficulty ultimately achieving high performance on ARC, we believe the approach is a firm basis for a learning-based search algorithm for ARC, especially compared to existing brute-force approaches. We additionally evaluate the bidirectional algorithm on a set of “24 Game” style math puzzles. We conclude by discussing how these two approaches can be combined as well as future research directions relevant to ARC and AI in general.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright MIT
Persistent DSpace Link
