RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graph
通过 Repository-level 的 Code Graph 实现更为高效的工程代码生成
ICLR
Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
在知识图谱上实现 LLM, KG 的交替推理
BEiT: BERT Pre-Training of Image Transformers
Visual Tokens & Masked Image Modeling
Restructuring Vector Quantization with The Rotation Trick
一种利用 Rotation Trick 来替代 STE 的方案
Let’s Verify Step by Step
来自 OpenAI 的 process supervision
Round and Round We Go! What makes Rotary Positional Encodings useful?
理解 RoPE 的高低频
CPT: Efficient Deep Neural Network Training via Cyclic Precision
CPT, 类似 CosineAnnealingWarmRestarts 的 Precision 循环机制
Language Representations Can be What Recommenders Need: Findings and Potentials
Next-token embedding 之于协同过滤