Drift-Adapter: A Practical Approach to Near Zero-Downtime Embedding Model Upgrades in Vector Databases
Harshil Vejendla
摘要
Upgrading embedding models in production vector databases typically necessitates reencoding the entire corpus and rebuilding the Approximate Nearest Neighbor (ANN) index, leading to significant operational disruption and computational cost. This paper presents Drift-Adapter, a lightweight, learnable transformation layer designed to bridge embedding spaces between model versions. By mapping new queries into the legacy embedding space, Drift-Adapter enables the continued use of the existing ANN index, effectively deferring full re-computation. We systematically evaluate three adapter parameterizations: Orthogonal Procrustes, Low-Rank Affine, and a compact Residual MLP, trained on a small sample of paired old/new embeddings. Experiments on MTEB text corpora and a CLIP image model upgrade (1M items) show that Drift-Adapter recovers 95-99% of the retrieval recall (Recall@10, MRR) of a full re-embedding, adding less than 10 µs query latency. Compared to operational strategies like full re-indexing or dual-index serving, Drift-Adapter dramatically reduces recompute costs (by over 100×) and facilitates upgrades with near-zero operational interruption. We analyze robustness to varied model drift, training data size, scalability to billion-item systems, and the impact of design choices like diagonal scaling, demonstrating Drift-Adapter's viability as a pragmatic solution for agile model deployment.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper2
相关 Paper
- Embedding-Converter: A Unified Framework for Cross-Model Embedding TransformationJinsung Yoon, Sercan Ö. ArikACL 2025 · 被引用 2 次
- DeDrift: Robust Similarity Search under Content DriftDmitry Baranchuk, Matthijs Douze, Yash Upadhyay, I. Zeki YalnizICCV 2023 · 被引用 15 次
- Towards Cross-Modal Backward-Compatible Representation Learning for Vision-Language ModelsYoung Kyun Jang, Ser-Nam LimICCV 2025 · 被引用 3 次
- Darwinian Model Upgrades: Model Evolving with Selective CompatibilityBinjie Zhang, Shupeng Su, Yixiao Ge, Xuyuan Xu 等AAAI 2023 · 被引用 4 次
- Boundary-aware Backward-Compatible Representation via Adversarial Learning in Image RetrievalTan Pan, Furong Xu, Xudong Yang, Sifeng He 等CVPR 2023
