SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
Name
2012.09852.pdf
Description
Accepted version
Size
2.53 MB
Format
Adobe PDF
Checksum (MD5)
aae14a2980e92b7dee1a7a7d83cc711c
Author(s)
Wang, Hanrui
Zhang, Zhekai
Han, Song
Date Issued
2021
Journal
2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA)
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Wang, Hanrui, Zhang, Zhekai and Han, Song. 2021. "SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning." 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA).
Version
Author's final manuscript
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/HPCA51647.2021.00018
