FAST: A Framework to Accelerate Super-Resolution Processing on Compressed Videos
Name
1603.08968.pdf
Description
Accepted version
Size
4.23 MB
Format
Adobe PDF
Checksum (MD5)
25f1860119f28f632c00025349055395
Author(s) •
Zhang, Zhengdong
Sze, Vivienne
Date Issued
July 2017
Publisher
IEEE
Citation
Zhang, Zhengdong and Sze, Vivienne. 2017. "FAST: A Framework to Accelerate Super-Resolution Processing on Compressed Videos."
Version
Author's final manuscript
Abstract
© 2017 IEEE. State-of-the-art super-resolution (SR) algorithms require significant computational resources to achieve real-time throughput (e.g., 60Mpixels/s for HD video). This paper introduces FAST (Free Adaptive Super-resolution via Transfer), a framework to accelerate any SR algorithm applied to compressed videos. FAST exploits the temporal correlation between adjacent frames such that SR is only applied to a subset of frames; SR pixels are then transferred to the other frames. The transferring process has negligible computation cost as it uses information already embedded in the compressed video (e.g., motion vectors and residual). Adaptive processing is used to retain accuracy when the temporal correlation is not present (e.g., occlusions). FAST accelerates state-of-the-art SR algorithms by up to 15× with a visual quality loss of 0.2dB. FAST is an important step towards real-time SR algorithms for ultra- HD displays and energy constrained devices (e.g., phones and tablets).
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/cvprw.2017.138