Let’s Verify Step by Step
来自 OpenAI 的 process supervision
Note
Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations
来自 DeepSeek 的 process supervision
Universal Prompt Tuning for Graph Neural Networks
图上特征 prompt 等价各异 graph prompt
All in One: Multi-Task Prompting for Graph Neural Networks
统一 graph/edge/node-level 的 graph prompt
Base of RoPE Bounds Context Length
讨论 RoPE base 对于相似 Tokens 感知能力的影响
Round and Round We Go! What makes Rotary Positional Encodings useful?
理解 RoPE 的高低频
Transformers need glasses! Information Over-Squashing in Language Tasks
LLM Representational Collapse
Data Augmentation as Free Lunch: Exploring the Test-Time Augmentation for Sequential Recommendation
TTA, Test-Time Augmentation
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed
Adam 预训练的 1-bit SGD 优化方法
CPT: Efficient Deep Neural Network Training via Cyclic Precision
CPT, 类似 CosineAnnealingWarmRestarts 的 Precision 循环机制