SWE-smith: Scaling Data for Software Engineering Agents
自动化 Repository-level 实例任务生成
NeurIPS
SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
定制化 Agent-Computer Interface
Code Graph Model (CGM): A Graph-Integrated Large Language Model for Repository-Level Software Engineering Tasks
Code Graph & Graph Attention Mask
Pareto Multi-Task Learning
通过限定子区域实现 Pareto MTL
An Image is Worth 32 Tokens for Reconstruction and Generation
非结构化的一维离散 Visual Tokens 生成策略
Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction
自回归图像生成: Multi-scale Quantization & Next-scale Prediction
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
多尺度 Transformer, 探究非 Subword Tokenizer 的可能性
SpaceByte: Towards Deleting Tokenization from Large Language Modeling
探究非 Subword Tokenizer 的可能性
Universal Prompt Tuning for Graph Neural Networks
图上特征 prompt 等价各异 graph prompt
Base of RoPE Bounds Context Length
讨论 RoPE base 对于相似 Tokens 感知能力的影响