Center for Brains, Minds & Machines: Recent submissions
Now showing items 7-9 of 151
-
Norm-Based Generalization Bounds for Compositionally Sparse Neural Network
(Center for Brains, Minds and Machines (CBMM), 2023-02-14)In this paper, we investigate the Rademacher complexity of deep sparse neural networks, where each neuron receives a small number of inputs. We prove generalization bounds for multilayered sparse ReLU neural networks, ... -
Compositional Sparsity: a framework for ML
(Center for Brains, Minds and Machines (CBMM), 2022-10-10)The main claim of this perspective is that compositional sparsity of the target function, which corre- sponds to the task to be learned, is the key principle underlying machine learning. I prove that under restrictions of ... -
Understanding the Role of Recurrent Connections in Assembly Calculus
(Center for Brains, Minds and Machines (CBMM), 2022-07-06)In this note, we explore the role of recurrent connections in Assembly Calculus through a number of experiments conducted on models with and without recurrent connections. We observe that as- semblies can be formed even ...