共计 105 篇文章
2026
QLoRA: Efficient Finetuning of Quantized LLMs
LoRA: Low-Rank Adaptation of Large Language Models
SGLang: Efficient Execution of Structured Language Model Programs
PagedAttention: Efficient Memory Management for Large Language Model Serving with PagedAttention
ORCA: A Distributed Serving System for Transformer-Based Generative Models
OnlineSoftmax: Online normalizer calculation for softmax
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
LLM Systems 24: Efficient LLM Inference with PagedAttention and vLLM
LLM Systems 23: Design of Efficient LLM Inference Server
LLM Systems 22: Flash Attention: Optimizing Attention for Modern Hardware