Now showing items 7-9 of 151

    • Norm-Based Generalization Bounds for Compositionally Sparse Neural Network 

      Galanti, Tomer; Xu, Mengjia; Galanti, Liane; Poggio, Tomaso (Center for Brains, Minds and Machines (CBMM), 2023-02-14)
      In this paper, we investigate the Rademacher complexity of deep sparse neural networks, where each neuron receives a small number of inputs. We prove generalization bounds for multilayered sparse ReLU neural networks, ...
    • Compositional Sparsity: a framework for ML 

      Poggio, Tomaso (Center for Brains, Minds and Machines (CBMM), 2022-10-10)
      The main claim of this perspective is that compositional sparsity of the target function, which corre- sponds to the task to be learned, is the key principle underlying machine learning. I prove that under restrictions of ...
    • Understanding the Role of Recurrent Connections in Assembly Calculus 

      Rangamani, Akshay; Xie, Yi (Center for Brains, Minds and Machines (CBMM), 2022-07-06)
      In this note, we explore the role of recurrent connections in Assembly Calculus through a number of experiments conducted on models with and without recurrent connections. We observe that as- semblies can be formed even ...