Physics of Language Models: Part 3.1, Knowledge Storage and Extraction
探究 LLM 如何记忆和提取知识的实验性文章
Seminal
Dynamic Key-Value Memory Networks for Knowledge Tracing
DKVMN, 带记忆结构的知识追踪
Meta-Learning with Memory-Augmented Neural Networks
MANN, 外置记忆模块
Deep Knowledge Tracing
DKT, 知识追踪
Recommender Systems with Generative Retrieval
TIGER, 向量量化生成式检索
Taming Transformers for High-Resolution Image Synthesis
VQGAN, 自回归式的图片生成
Neural Discrete Representation Learning
VQ-VAE, 向量量化的开山之作