SpaceByte: Towards Deleting Tokenization from Large Language Modeling
探究非 Subword Tokenizer 的可能性
Empirical
Temporal Cross-Effects in Knowledge Tracing
借鉴 Hawkes Process 思想建模知识掌握的交叉影响和衰减
EARN: Efficient Inference Acceleration for LLM-based Generative Recommendation by Register Tokens
通过减小 KV cache size 加速 LLMRec 的推理
Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representations
COBRA, 链接离散编码和稠密表示的尝试
Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation
LC-Rec, LLM + RQ-VAE + 丰富的多任务训练
OneRec: Unifying Retrieve and Rank with Generative Recommender and Preference Alignment
OneRec, 端到端的推荐模型
Addressing Representation Collapse in Vector Quantized Models with One Linear Layer
SimVQ, 坐标变换替代可学习 Codebook
Restructuring Vector Quantization with The Rotation Trick
一种利用 Rotation Trick 来替代 STE 的方案
Let’s Verify Step by Step
来自 OpenAI 的 process supervision
Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations
来自 DeepSeek 的 process supervision