Fine-Tuning Language Models with Just Forward Passes
零阶优化 & 收敛理论
2023
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
多尺度 Transformer, 探究非 Subword Tokenizer 的可能性
Universal Prompt Tuning for Graph Neural Networks
图上特征 prompt 等价各异 graph prompt
All in One: Multi-Task Prompting for Graph Neural Networks
统一 graph/edge/node-level 的 graph prompt
Recommender Systems with Generative Retrieval
TIGER, 向量量化生成式检索
Finite Scalar Quantization: VQ-VAE Made Simple
FSQ, 标量量化