We propose ApproxHPVM, a compiler IR and system designed to enable accuracy-aware performance and energy tuning on heterogeneous systems with multiple compute units and approximation methods. ApproxHPVM automatically translates end-to-end application-level quality metrics into accuracy requirements for individual operations. ApproxHPVM uses a hardware-agnostic accuracy-tuning phase to do this translation that provides greater portability across heterogeneous hardware platforms and enables future capabilities like accuracy-aware dynamic scheduling and design space exploration.
ApproxHPVM incorporates three main components: (a) a compiler IR with hardware-agnostic approximation metrics, (b) a hardware-agnostic accuracy-tuning phase to identify error-tolerant computations, and (c) an accuracy-aware hardware scheduler that maps error-tolerant computations to approximate hardware components. As ApproxHPVM does not incorporate any hardware-specific knowledge as part of the IR, it can serve as a portable virtual ISA that can be shipped to all kinds of hardware platforms.
We evaluate our framework on nine benchmarks from the deep learning domain and five image processing benchmarks. Our results show that our framework can offload chunks of approximable computations to special-purpose accelerators that provide significant gains in performance and energy, while staying within user-specified application-level quality metrics with high probability. Across the 14 benchmarks, we observe from 1-9x performance speedups and 1.1-11.3x energy reduction for very small reductions in accuracy.
Thu 24 OctDisplayed time zone: Beirut change
16:00 - 17:30
|Ryū Revisited: Printf Floating Point Conversion|
Ulf Adams GoogleLink to publication DOI
|Optimization of Swift Protocols|
Raj Barik Uber Technologies Inc., Manu Sridharan University of California Riverside, Murali Krishna Ramanathan Uber Technologies Inc., Milind Chabbi Uber Technologies Inc.DOI
|ApproxHPVM: A Portable Compiler IR for Accuracy-Aware Optimizations|
Hashim Sharif University of Illinois at Urbana-Champaign, Prakalp Srivastava University of Illinois at Urbana-Champaign, Muhammad Huzaifa University of Illinois at Urbana-Champaign, Maria Kotsifakou University of Illinois at Urbana-Champaign, Keyur Joshi University of Illinois at Urbana-Champaign, Yasmin Sarita Cornell University, Nathan Zhao University of Illinois at Urbana-Champaign, Vikram S. Adve University of Illinois at Urbana-Champaign, Sasa Misailovic University of Illinois at Urbana-Champaign, Sarita Adve University of Illinois at Urbana-ChampaignDOI
|IVT: An Efficient Method for Sharing Subtype Polymorphic Objects|
Yu-Ping Wang Tsinghua University, China, Xu-Qiang Hu Tsinghua Univeraity, China, Zi-Xin Zou Tsinghua Univeraity, China, Wende Tan Tsinghua University, China, Gang Tan The Pennsylvania State University, University Park, USADOI