Comment by bdcp

1 year ago

yea but i think the point is they can still filter it server side before streaming it

They have already streamed the first part of the response before the filtered phrase has even been generated.

  • Could you stream the raw tokens into a server side filter which then streams censored tokens at near real time?