September 11, 2026 Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads 用多个轻量预测头并行提出未来 token, 通过树状验证减少解码轮数 Paper LLM Autoregressive Empirical ICML 2024
September 4, 2026 SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification 用 token tree 并行验证多条推测路径以加速 LLM 服务 Paper Speculative Decoding LLM Autoregressive Empirical ASPLOS 2024
September 4, 2026 SpecTr: Fast Speculative Decoding via Optimal Transport 从最优传输理解投机解码及其多候选扩展 Paper Speculative Decoding LLM Optimal Transportation Theoretical NeurIPS 2023
September 3, 2026 Fast Inference from Transformers via Speculative Decoding 用小模型猜测, 大模型并行验证, 且保持精确采样 Paper Speculative Decoding LLM Autoregressive Empirical Seminal ICML 2023
September 3, 2026 SEQUOIA: Scalable and Robust Speculative Decoding 用动态规划优化 token tree, 以无放回采样提高验证鲁棒性 Paper LLM Autoregressive Optimization Empirical NeurIPS 2024
July 22, 2026 Rethinking Generative Recommender Tokenizer: Recsys-Native Encoding and Semantic Quantization Beyond LLMs 从信息论角度剖析 SID 的设计理念 Paper Sequential Recommendation Generative Vector Quantization Empirical arXiv 2026