Bridging Theory and Practice in Cache Replacement
Name
MIT-CSAIL-TR-2015-034.pdf
Size
883.45 KB
Format
Adobe PDF
Checksum (MD5)
1804f386da9b73c775fc1899a257b433
Download all files submitted through automated deposit
Author(s) •
Beckmann, Nathan
Sanchez, Daniel
Advisor(s)
Daniel Sanchez
Date Issued
December 19, 2015
Series/Report no.
MIT-CSAIL-TR-2015-034
Abstract
Much prior work has studied processor cache replacement policies, but a large gap remains between theory and practice. The optimal policy (MIN) requires unobtainable knowledge of the future, and prior theoretically-grounded policies use reference models that do not match real programs. Meanwhile, practical policies are designed empirically. Lacking a strong theoretical foundation, they do not make the best use of the information available to them. This paper bridges theory and practice. We propose that practical policies should replace lines based on their economic value added (EVA), the difference of their expected hits from the average. We use Markov decision processes to show that EVA is optimal under some reasonable simplifications. We present an inexpensive, practical implementation of EVA and evaluate it exhaustively over many cache sizes. EVA outperforms prior practical policies and saves area at iso-performance. These results show that formalizing cache replacement yields practical benefits.
Terms of Use
Creative Commons Attribution 4.0 International
Persistent DSpace Link