Quantization

RecBase: Generative Foundation Model Pretraining for Zero-Shot Recommendation

在多个开源数据集上训练的生成式推荐模型, 利用课程学习训练 Tokenizer

R2MR: Review and Rewrite Modality for Recommendation

修正低质量模态特征以改善多模态协同过滤

1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed

Adam 预训练的 1-bit SGD 优化方法

CPT: Efficient Deep Neural Network Training via Cyclic Precision

CPT, 类似 CosineAnnealingWarmRestarts 的 Precision 循环机制

MICROADAM: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence

MicroAdam, 通过梯度稀疏化以及 error compensation 实现轻量的优化器

Network Quantization