Comment by etaioinshrdlu
4 months ago
I can suggest our service (previously here https://ch.at/v1/chat/completions (supports streamed responses)
Also accessible via HTTP/SSH/DNS for quick tests: curl ch.at/?q=… , ssh ch.at Privacy note: we don’t log anything, but upstream LLM providers might...
That would be pretty cool for testing the waters, will give it a thought!
How do you guys pay for this? I guess the potential for abuse is huge.
Cool! Right now it's just IP address rate limiting and the costs have not mattered too much, but yes long term I am not sure what we'll do...