Comment by muzani

Many people using pgvector have about 200 rows of data.

Yesterday, I had a conversation with someone whether it's better to squeeze it all into the system prompt. Someone else argued that even with large context, it's difficult to fit 10k questions into a system prompt.

So I think there's just this mismatch in usage.