Enabling Compositional Generalization of AI Systems

Abstract

A vital aspect of human intelligence is the ability to compose increasingly complex concepts out of simpler ideas, enabling both rapid learning and adaptation of knowledge. Despite their impressive performance, current AI systems fall short in this area and are often unable to solve tasks that fall outside of their training distribution. The work contained in this thesis aims to bridge this gap by incorporating compositionality into deep neural networks, thereby enhancing their ability to generalize and solve novel and complex tasks, such as generating 2D images and 3D assets based on complicated specifications, or enabling humanoid agents to perform a diverse range of household activities. The implications of this thesis are far-reaching, as compositionality has numerous applications across fields such as biology, robotics, and art production. By significantly improving the compositionality ability of AI systems, this research will pave the way for more data-efficient and powerful models in different research areas.