Book

Graph Learning at Scale: Characterizing and Optimizing Pre-Propagation GNNs Zichao Yue, Chenhui Deng, Zhiru Zhang

Conference

SwiftVI: Time-Efficient Planning and Learning with MDPs Kasper Overgaard Mortensen, Konstantinos Skitsas, Emil Morre Christensen, Mohammad Sadegh Talebi, Andreas Pavlogiannis, Davide Mottin, Panagiotis Karras

Conference

Balancing Pipeline Parallelism with Vocabulary Parallelism Yeung Man Tsung, Penghui Qi, Min Lin, Xinyi Wan

Conference

Youmu: Efficient Columnar Data Pipeline for LLM Training Tianle Zhong, Jiechen Zhao, Qiang Su, Geoffrey Fox

Conference

LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers Rya Sanovar, Srikant Bharadwaj, Renée St. Amant, Victor Rühle, Saravan Rajmohan

Conference

Photon: Federated LLM Pre-Training Lorenzo Sani, Alex Iacob, Zeyu Cao, Royson Lee, Bill Marino, Yan Gao, Wanru Zhao, Dongqi Cai, Zexi Li, Xinchi Qiu, Nicholas D. Lane

Conference

MEADOW: Memory-efficient Dataflow and Data Packing for Low Power Edge LLMs Abhishek Moitra, Arkapravo Ghosh, Shrey Agrawal, Aporva Amarnath, Karthik Swaminathan, Priyadarshini Panda

Conference

Rethinking Key-Value Cache Compression Techniques for Large Language Model Serving GAO WEI, Xinyu Zhou, Peng Sun, Tianwei Zhang, Yonggang Wen

Conference

Rubick: Exploiting Job Reconfigurability for Deep Learning Cluster Scheduling Xinyi Zhang, Hanyu Zhao, Wencong Xiao, Xianyan Jia, Fei Xu, Yong Li, Wei Lin, Fangming Liu

Conference

SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention Qianchao Zhu, Jiangfei Duan, Chang Chen, Siran Liu, Xiuhong Li, Guanyu Feng, Xin Lv, Xiao Chuanfu, Dahua Lin, Chao Yang

Conference

SPA: SCALING GRAPH NEURAL NETWORK TRAINING ON LARGE GRAPHS VIA PROBABILISTIC SPLITTING Sandeep Polisetty, Juelin Liu, Yi Fung, Seung-Hwan Lim, Hui Guan, Marco Serafini

Conference

SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations Md Saidul Hoque Anik, Ariful Azad

Conference

ReaL: Efficient RLHF Training of Large Language Models with Parameter Reallocation Zhiyu Mei, Wei Fu, Kaiwei Li, Guangju Wang, Huanchen Zhang, Yi Wu

Conference

Interference-aware Edge Runtime Prediction with Conformal Matrix Completion Tianshu Huang, Arjun Ramesh, Emily Ruppel, Nuno Pereira, Anthony Rowe, Carlee Joe-Wong

Conference

DiffServe: Efficiently Serving Text-to-Image Diffusion Models with Query-Aware Model Scaling Sohaib Ahmad, Qizheng Yang, Haoliang Wang, Ramesh K. Sitaraman, Hui Guan

Conference

ProtoRAIL: A Risk-cognizant Imitation Agent for Adaptive vCPU Oversubscription In the Cloud Lu Wang, Mayukh Das, Fangkai Yang, Bo Qiao, Hang Dong, Si Qin, Victor Rühle, Chetan Bansal, Eli Cortez, Íñigo Goiri, Saravan Rajmohan, Qingwei Lin, Dongmei Zhang

Conference

APOLLO: SGD-like Memory, AdamW-level Performance Hanqing Zhu, Zhenyu Zhang, Wenyan Cong, Xi Liu, Sem Park, Vikas Chandra, Bo Long, David Z. Pan, Zhangyang Wang, Jinwon Lee

Conference

AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution Zhiqiang Xie, Hao Kang, Ying Sheng, Tushar Krishna, Kayvon Fatahalian, Christos Kozyrakis

Conference

The Hidden Bloat in Machine Learning Systems Huaifeng Zhang, Ahmed Ali-Eldin

Conference

PipeFill: Using GPUs During Bubbles in Pipeline-parallel LLM Training Daiyaan Arfeen, Zhen Zhang, Xinwei Fu, Gregory Ganger, Yida Wang

Conference

HyC-LoRA: Memory Efficient LoRA Fine-tuning with Hybrid Activation Compression Yujin Wang, Shunan Dong, Zongle Huang, Yichen You, Liu He, Huazhong Yang, Yongpan Liu, Hongyang Jia

Conference

Radius: Range-based Gradient Sparsity for Large Foundation Model Pre-training Mingkai Zheng, Zhao Zhang

Conference

XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models Yixin Dong, Charlie F. Ruan, Yaxing Cai, Ziyi Xu, Yilong Zhao, Ruihang Lai, Tianqi Chen

Conference

FlexAttention: A Programming Model for Generating Fused Attention Variants. Juechu Dong, BOYUAN FENG, Driss Guessous, Yanbo Liang, Horace He

Conference

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference Xuanlin Jiang, Yang Zhou, Shiyi Cao, Ion Stoica, Minlan Yu

Conference

AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine Carlo Siebenschuh, Kyle Hippe, Ozan Gokdemir, Alexander Brace, Arham Mushtaq Khan, Khalid Hossain, Yadu Babuji, Nicholas Chia, Venkatram Vishwanath, Arvind Ramanathan, Rick L. Stevens, Ian Foster, Robert Underwood

Conference

FlexInfer: Flexible LLM Inference with CPU Computations Seonjin Na, Geonhwa Jeong, Byung Hoon Ahn, Aaron Jezghani, Jeffrey Young, Christopher J. Hughes, Tushar Krishna, Hyesoon Kim

Conference

Know Where You’re Uncertain When Planning with Multimodal Foundation Models: A Formal Framework Neel P. Bhatt, Yunhao Yang, Rohan Siva, Daniel Milan, Ufuk Topcu, Zhangyang Wang

Conference

Supply-Chain Attacks in Machine Learning Frameworks Yue Gao, Ilia Shumailov, Kassem Fawaz

Conference

Context Parallelism for Scalable Million-Token Inference Amy Yang, Jingyi Yang, Aya Ibrahim, Xinfeng Xie, Bangsheng Tang, Grigory Sizov, Jongsoo Park, Jianyu Huang

Conference

Marconi: Prefix Caching for the Era of Hybrid LLMs Rui Pan, Zhuang Wang, Zhen Jia, Can Karakus, Luca Zancato, Tri Dao, Yida Wang, Ravi Netravali

Conference

Venn: Resource Management For Collaborative Learning Jobs Jiachen Liu, Fan Lai, Eric Ding, Yiwen Zhang, Mosharaf Chowdhury

Conference

On Distributed Larger-Than-Memory Subset Selection With Pairwise Submodular Functions Maximilian Böther, Abraham Sebastian, Pranjal Awasthi, Ana Klimovic, Srikumar Ramalingam

Conference

Lightweight Software Kernels and Hardware Extensions for Efficient Sparse Deep Neural Networks on Microcontrollers Francesco Daghero, Daniele Jahier Pagliari, Francesco Conti, Luca Benini, Massimo Poncino, Alessio Burrello

Conference

MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators Beichen Huang, Yueming Yuan, ZELEI SHAO, Minjia Zhang

Conference

FastTree: Optimizing Attention Kernel and Runtime for Tree-Structured LLM Inference Zaifeng Pan, Yitong Ding, Yue Guan, Zheng Wang, Zhongkai Yu, Xulong Tang, Yida Wang, Yufei Ding

Conference

FedProphet: Memory-Efficient Federated Adversarial Training via Robust and Consistent Cascade Learning Minxue Tang, Yitu Wang, Jingyang Zhang, Louis DiValentin, Aolin Ding, Amin Hass, Yiran Chen, Hai Helen Li

Conference

LAVA: Lifetime-Aware VM Allocation with Learned Distributions and Adaptation to Mispredictions Jianheng Ling, Pratik Worah, Yawen Wang, Yunchuan Kong, Chunlei Wang, Clifford Stein, Diwakar Gupta, Jason Behmer, Logan A. Bush, Prakash Ramanan, Rajesh Kumar, Thomas Chestna, Yajing Liu, YING LIU, Ye Zhao, Kathryn S. McKinley, Meeyoung Park, Martin Maas

Conference

Scaling Deep Learning Training with MPMD Pipeline Parallelism Anxhelo Xhebraj, Sean Lee, Hanfeng Chen, Vinod Grover

Conference

ScaleFusion: Scalable Inference of Spatial-Temporal Diffusion Transformers for High-Resolution Long Video Generation Jiacheng Yang, Jun Wu, Zhen Zhang, Xinwei Fu, Zhiying Xu, Zhen Jia, Yida Wang, Gennady Pekhimenko

Conference

Lumos: Efficient Performance Modeling and Estimation for Large-scale LLM Training Mingyu Liang, Hiwot Tadese Kassa, Wenyin Fu, Brian Coutinho, Louis Feng, Christina Delimitrou

Conference

Self-Data Distillation for Recovering Quality in Pruned Large Language Models Vithursan Thangarasa, Ganesh Venkatesh, Mike Lasby, Nish Sinnadurai, Sean Lie

Conference

Efficient LLM Inference using Dynamic Input Pruning and Cache-Aware Masking Marco Federici, Davide Belli, Mart Van Baalen, Amir Jalalirad, Andrii Skliar, Bence Major, Markus Nagel, Paul Whatmough

Conference

Efficient On-Device Machine Learning with a Biologically-Plausible Forward-Only Algorithm Baichuan Huang, Amir Aminifar

Conference

Optimizing LLM Queries in Relational Data Analytics Workloads Shu Liu, Asim Biswal, Amog Kamsetty, Audrey Cheng, Luis Gaspar Schroeder, Liana Patel, Shiyi Cao, Xiangxi Mo, Ion Stoica, Joseph E. Gonzalez, Matei Zaharia

Conference

SOLA: Optimizing SLO Attainment for Large Language Model Serving with State-Aware Scheduling Ke Hong, Xiuhong Li, Lufang Chen, Qiuli Mao, Guohao Dai, Xuefei Ning, Shengen Yan, Yun Liang, Yu Wang

Conference

ThunderServe: High-performance and Cost-efficient LLM Serving in Cloud Environments YOUHE JIANG, Fangcheng Fu, Xiaozhe Yao, Taiyi Wang, Bin CUI, Ana Klimovic, Eiko Yoneki

Conference

TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives Size Zheng, Jin Fang, Xuegui Zheng, Qi Hou, Wenlei Bao, Ningxin Zheng, Ziheng Jiang, Dongyang Wang, Jianxi Ye, Haibin Lin, Li-Wen Chang, Xin Liu

Conference

Seesaw: High-throughput LLM Inference via Model Re-sharding Qidong Su, Wei Zhao, Xin Li, Muralidhar Andoorveedu, Chenhao Jiang, Zhanda Zhu, Kevin Song, Christina Giannoula, Gennady Pekhimenko

Conference

LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention Shang Yang, Junxian Guo, Haotian Tang, Qinghao Hu, Guangxuan Xiao, Jiaming Tang, Yujun Lin, Zhijian Liu, Yao Lu, Song Han

Conference

AIOpsLab: A Holistic Framework to Evaluate AI Agents for Enabling Autonomous Clouds Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan

Conference

MAS-ATTENTION: MEMORY-AWARE STREAM PROCESSING FOR ATTENTION ACCELERATION ON RESOURCE-CONSTRAINED EDGE DEVICES Mohammadali Shakerdargah, Shan Lu, Chao Gao, Di Niu

Conference

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer Jinghan Yao, Sam Ade Jacobs, Masahiro Tanaka, Olatunji Ruwase, Hari Subramoni, Dhabaleswar Panda

Conference

FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving Zihao Ye, Lequn Chen, Ruihang Lai, Wuwei Lin, Yineng Zhang, Stephanie Wang, Tianqi Chen, Baris Kasikci, Vinod Grover, Arvind Krishnamurthy, Luis Ceze

Conference

A Bring-Your-Own-Model Approach for ML-Driven Storage Placement in Warehouse-Scale Computers Chenxi Yang, Yan Li, Martin Maas, Mustafa Uysal, Ubaid Ullah Hafeez, Arif Merchant, Richard McDougall

Conference

COMET: Fine-grained Computation-communication Overlapping for Mixture-of-Experts Shulai Zhang, Ningxin Zheng, Haibin Lin, Ziheng Jiang, Wenlei Bao, Chengquan Jiang, Qi Hou, Weihao Cui, Size Zheng, Li-Wen Chang, Quan Chen, Xin Liu

Conference

Enabling Unstructured Sparse Acceleration on Structured Sparse Accelerators Geonhwa Jeong, Po-An Tsai, Abhimanyu Rajeshkumar Bambhaniya, Stephen W. Keckler, Tushar Krishna

Conference

VoLUT: Efficient Volumetric streaming enhanced by LUT-based super-resolution Chendong Wang, Anlan Zhang, Yifan Yang, Lili Qiu, Yuqing Yang, XINYANG JIANG, Feng Qian, Suman Banerjee

Conference

FLStore: Efficient Federated Learning Storage for non-training workloads Ahmad Faraz Khan, Samuel Fountain, Ahmed M. Abdelmoniem, Ali R. Butt, Ali Anwar

Conference

TurboAttention: Efficient attention approximation for high throughputs llm Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Rühle, Saravan Rajmohan

Conference

QServe:W4A8KV4 Quantization and System Co-design for Efficient LLM Serving Yujun Lin, Haotian Tang, Shang Yang, Zhekai Zhang, Guangxuan Xiao, Chuang Gan, Song Han

Conference

Name Change Policy