Official announcement · Hugging Face ·
Token Pooling-Aware Training for Multi-Vector Embedding Models
Multi-vector embedding models give each query token its own opportunity to find a match in a document. This makes them wonderfully expressive for search, but those document vectors add up quickly. A corpus with millions of documents can contain hundreds of millions of vectors!