Write a Blog >>
PPoPP 2021
Sat 27 February - Wed 3 March 2021
Wed 3 Mar 2021 10:45 - 11:00 - Session 8. Scientific Computing & Optimizations Chair(s): Tim Harris

Sparse tensor contractions appear commonly in many applications. Efficiently computing a two sparse tensor product is challenging: It not only inherits the challenges from common sparse matrix-matrix multiplication (SpGEMM), i.e., indirect memory access and unknown output size before computation, but also raises new challenges because of high dimensionality of tensors, expensive multi-dimensional index search, and massive intermediate and output data. To address the above challenges, we introduce three optimization techniques by using multi-dimensional, efficient hash table representation for the accumulator and larger input tensor, and all-stage parallelization. Evaluating with 15 datasets, we show that Sparta brings 28 − 576 x speedup over traditional sparse tensor contraction with SPA. With our proposed algorithm- and memory heterogeneity-aware data management, Sparta brings extra performance improvement on the heterogeneous memory with DRAM and Intel Optane DC Persistent Memory Module (PMM) over a state-of-the-art software-based data management solution, a hardware-based data management solution, and PMM-only by 30.7% (up to 98.5%), 10.7% (up to 28.3%) and 17% (up to 65.1%) respectively.

Conference Day
Wed 3 Mar

Displayed time zone: Eastern Time (US & Canada) change

10:00 - 11:00
Session 8. Scientific Computing & OptimizationsMain Conference
Chair(s): Tim HarrisMicrosoft, UK
10:00
15m
Talk
EGEMM-TC: Accelerating Scientific Computing on Tensor Cores with Extended Precision
Main Conference
Boyuan FengUC Santa Barbara, Yuke WangUC Santa Barbara, Guoyang ChenAlibaba Group US Inc., Weifeng ZhangAlibaba Group US Inc., Yuan XieUCSB, Yufei DingUC Santa Barbara
Link to publication
10:15
15m
Talk
Efficiently Running SpMV on Long Vector Architectures
Main Conference
Constantino GómezBarcelona Supercomputing Center, Filippo MantovaniBarcelona Supercomputing Center, Erich FochtNEC, Marc CasasBarcelona Supercomputing Center
Link to publication
10:30
15m
Talk
Improving Communication by Optimizing On-Node Data Movement with Data Layout
Main Conference
Tuowen ZhaoUniversity of Utah, Mary HallUniversity of Utah, Hans JohansenLawrence Berkeley National Laboratory, Samuel WilliamsLawrence Berkeley National Laboratory
Link to publication
10:45
15m
Talk
Sparta: High-Performance, Element-Wise Sparse Tensor Contraction on Heterogeneous Memory
Main Conference
Jiawen LiuUniversity of California, Merced, Jie RenUniversity of California, Merced, Roberto GioiosaPacific Northwest National Laboratory, Dong LiUniversity of California, Merced, Jiajia LiPacific Northwest National Laboratory
Link to publication