Trust Region Policy Optimization
PPO 的前身
Theoretical
Fine-Tuning Language Models with Just Forward Passes
零阶优化 & 收敛理论
Limitations of Dense Retrieval and Beyond
向量检索的瓶颈以及生成式检索的未来
Understanding Embedding Scaling in Collaborative Filtering
理解 Scaling up Embedding Size 过程中会出现的 double-peak/logarithmic 现象
GRAND: Graph Neural Diffusion
Pareto Multi-Task Learning
通过限定子区域实现 Pareto MTL
Multiple-Gradient Descent Algorithm (MGDA) for Multiobjective Optimization
从梯度融合角度理解多任务/多目标优化
Universal Prompt Tuning for Graph Neural Networks
图上特征 prompt 等价各异 graph prompt
Base of RoPE Bounds Context Length
讨论 RoPE base 对于相似 Tokens 感知能力的影响
Round and Round We Go! What makes Rotary Positional Encodings useful?
理解 RoPE 的高低频