Vectors are not enough: hybrid search and reranking
· 7 min read
Most RAG tutorials have the same retrieval step: embed the question, ask a vector store for the nearest chunks, put them in the prompt. It works well on the demo questions, which tend to be phrased like the documents. Then someone pastes an error code into the box and gets five chunks about errors in general, none of them about that code.
That isn't a bad embedding model. It is what embedding search is for. This post is about the two pieces I would add before tuning anything else: keyword search next to the vectors, fused by rank, and a reranker over the result.
