Recent Submissions

  • On Generalization Bounds for Neural Networks with Low Rank Layers 

    Pinto, Andrea; Rangamani, Akshay; Poggio, Tomaso (Center for Brains, Minds and Machines (CBMM), 2024-10-11)
    While previous optimization results have suggested that deep neural networks tend to favour low-rank weight matrices, the implications of this inductive bias on generalization bounds remain under-explored. In this paper, ...
  • Formation of Representations in Neural Networks 

    Ziyin, Liu; Chuang, Isaac; Galanti, Tomer; Poggio, Tomaso (Center for Brains, Minds and Machines (CBMM), 2024-10-07)
    Understanding neural representations will help open the black box of neural networks and advance our scientific understanding of modern AI systems. However, how complex, structured, and transferable representations emerge ...
  • On the Power of Decision Trees in Auto-Regressive Language Modeling 

    Gan, Yulu; Galanti, Tomer; Poggio, Tomaso; Malach, Eran (Center for Brains, Minds and Machines (CBMM), 2024-09-27)
    Originally proposed for handling time series data, Auto-regressive Decision Trees (ARDTs) have not yet been explored for language modeling. This paper delves into both the theoretical and practical applications of ARDTs ...

View more