Comment by JacobiX
4 hours ago
>> Apply diversity logic so your Agent/User doesn’t see 10 nearly identical results
On Instagram this is a good thing, but here the example is hotel and flight search, where a more deterministic result is preferable.
In the retrieve → filter stage, using predicate pushdown may be more performant: first filter using hard constraints, then apply hybrid search ?
Makes sense! Agreed on the diversity for agents being a bit contrived here.
All of the retrievers do support pre-filtering, you just add the where clause within the retriever function. We're working on more query optimization to make this automatic also.