Product Quantization for Nearest Neighbor Search
将 Product Quantization 用于搜索以降低存储占用
Seminal
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
多尺度 Transformer, 探究非 Subword Tokenizer 的可能性
Restructuring Vector Quantization with The Rotation Trick
一种利用 Rotation Trick 来替代 STE 的方案
Physics of Language Models: Part 3.1, Knowledge Storage and Extraction
探究 LLM 如何记忆和提取知识的实验性文章
Dynamic Key-Value Memory Networks for Knowledge Tracing
DKVMN, 带记忆结构的知识追踪
Meta-Learning with Memory-Augmented Neural Networks
MANN, 外置记忆模块
Deep Knowledge Tracing
DKT, 知识追踪
Recommender Systems with Generative Retrieval
TIGER, 向量量化生成式检索
Taming Transformers for High-Resolution Image Synthesis
VQGAN, 自回归式的图片生成
Neural Discrete Representation Learning
VQ-VAE, 向量量化的开山之作