Implementing a Persistent Offline Cache Improving Time to
First Execution (TTFX) of GPU Code in Julia
Name
warner-collinw-meng-eecs-2023-thesis.pdf
Description
Thesis PDF
Size
600.12 KB
Format
Adobe PDF
Checksum (MD5)
5d2a167eb76fec5645fcde8f8e84200a
Author(s)
Warner, Collin
Advisor(s)
Edelman, Alan
Date Issued
June 2023
Publisher
Massachusetts Institute of Technology
Abstract
GPU’s allow users the ability to run code with high data parallelism efficiently on specialized hardware. GPUCompiler.jl provides a GPU compilation process to Julia allowing users to write highly efficient vector operations common in scientific computing. GPUCompiler.jl does not support the same level of persistent offline caching that is available in the core Julia compiler. This increases the time to first execution (TTFX) as programs need to recompile GPU code on every package reload regardless of if any code was changed. In this thesis we implement a persistent offline cache that is capable of storing both type inferred and native code drastically reducing the TTFX on precompiled GPU code. We demonstrate that by caching native code, execution can be sped up 2-3x while reducing compilation storage costs by 3-40x when compared to the current GPU compilation process.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright retained by author(s)
Persistent DSpace Link
