← Back to context

Comment by marginalia_nu

10 days ago

Could plausibly fit in RAM, is only like ~100 GB in total. We'll see, will probably keep it mmap:ed at first to see what happens. It isn't the target of very many queries (relatively speaking) at any rate so either way is probably fine.

>It isn't the target of very many queries (relatively speaking)

Wow why is that? Do you use a vector index primarily?

  • No I mean for every query there is mapping up keywords to trees of documents, there is dozens if not hundreds of queries in the latter in order to intersect document lists.

    • Ah I see. I thought by query you meant "user search query". I'm guessing by query here you mean "read".