A method to estimate the energy consumption of deep neural networks
Name
_2017__Asilomar__A_Method_to_Estimate_the_Energy_Consumption_of_Deep_Neural_Networks.pdf
Size
1.25 MB
Format
Adobe PDF
Checksum (MD5)
a9d987a47c18f3ab789f40510df68a5b
Author(s)
Yang, Tien-Ju
Chen, Yu-Hsin
Emer, Joel S
Sze, Vivienne
Date Issued
April 2018
Journal
51st Asilomar Conference on Signals, Systems, and Computers
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Yang, Tien-Ju et al. "A method to estimate the energy consumption of deep neural networks." 51st Asilomar Conference on Signals, Systems, and Computers, October-November 2017, Pacific Grove, California, Institute of Electrical and Electronics Engineers, April 2018. © 2017 IEEE
Version
Author's final manuscript
Abstract
Deep Neural Networks (DNNs) have enabled state-of-the-art accuracy on many challenging artificial intelligence tasks. While most of the computation currently resides in the cloud, it is desirable to embed DNN processing locally near the sensor due to privacy, security, and latency concerns or limitations in communication bandwidth. Accordingly, there has been increasing interest in the research community to design energy-efficient DNNs. However, estimating energy consumption from the DNN model is much more difficult than other metrics such as storage cost (model size) and throughput (number of operations). This is due to the fact that a significant portion of the energy is consumed by data movement, which is difficult to extract directly from the DNN model. This work proposes an energy estimation methodology that can estimate the energy consumption of a DNN based on its architecture, sparsity, and bitwidth. This methodology can be used to evaluate the various DNN architectures and energy-efficient techniques that are currently being proposed in the field and guide the design of energy-efficient DNNs. We have released an online version of the energy estimation tool at energyestimation.mit.edu. We believe that this method will play a critical role in bridging the gap between algorithm and hardware design and provide useful insights for the development of energy-efficient DNNs.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Massachusetts Institute of Technology. Microsystems Technology Laboratories
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/acssc.2017.8335698
