Announcing Native BM25 Ranking in AlloyDB and Cloud SQL
cloud.google.com·1d ago
AI Research
arXiv CS.AI·Jun 9·5 min read
Projection and Quantisation: A Unifying View of Learning to Hash, from Random Projections to the RAG Era
✦ Why It Matters
Engineers can leverage the PQO framework to enhance the efficiency of ANN search in their applications.
Key Takeaways
- Explore the PQO lens for a unified view of hashing methods.
- Utilize one-bit codes to significantly reduce memory usage.
- Leverage BitBudget for benchmarking your retrieval systems.
- Consider supervision to enhance code quality in retrieval tasks.
How It Works
The PQO lens categorizes hashing methods based on three design choices: where to project data, how to quantize it, and how to organize the resulting codes. This framework allows for a systematic comparison of techniques, revealing that the organization of codes is as critical as the projection and quantisation stages.