Doing inference locally is significant improvement, but that still leaves issues like prompt injection and data exfiltration... Especially if the whole point is to have it searched through a giant pile of arbitrary unvetted stuff, like all the emails you ever received from anybody.
Doing inference locally is significant improvement, but that still leaves issues like prompt injection and data exfiltration... Especially if the whole point is to have it searched through a giant pile of arbitrary unvetted stuff, like all the emails you ever received from anybody.