Simba: 符号梯度的可行性
在 Lion 优化器之上的一些探索
Blogs
环境配置
个人的环境配置
Universal Prompt Tuning for Graph Neural Networks
图上特征 prompt 等价各异 graph prompt
All in One: Multi-Task Prompting for Graph Neural Networks
统一 graph/edge/node-level 的 graph prompt
Laplace Transform
Laplace 变换的基本概念
Base of RoPE Bounds Context Length
讨论 RoPE base 对于相似 Tokens 感知能力的影响
Round and Round We Go! What makes Rotary Positional Encodings useful?
理解 RoPE 的高低频
Transformers need glasses! Information Over-Squashing in Language Tasks
LLM Representational Collapse
Data Augmentation as Free Lunch: Exploring the Test-Time Augmentation for Sequential Recommendation
TTA, Test-Time Augmentation
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed
Adam 预训练的 1-bit SGD 优化方法