Implicit dynamic regularization in deep networks
Author(s) •
Poggio, Tomaso
Liao, Qianli
Date Issued
August 17, 2020
Publisher
Center for Brains, Minds and Machines (CBMM)
Series/Report no.
CBMM Memo;112
Abstract
Square loss has been observed to perform well in classification tasks, at least as well as crossentropy. However, a theoretical justification is lacking. Here we develop a theoretical analysis for the square loss that also complements the existing asymptotic analysis for the exponential loss.
Persistent DSpace Link