Comment by LiamPrevelige
1 year ago
Yes, some code is sent to Anthropic. We're hoping to: find initial users that are comfortable with software copilots (github copilot, cursor, etc) -> iterate on their feedback to make diagram generation require less sophisticated LLMs -> move everything locally
This will be a no go for more and more large companies.
We just had a major incident because someone accidentally uploaded our codebase via a VS code extension, lawyers, everything involved. I expect that non local AI tools will be banned soon.
Think about it, what 3rd party tool would you let scrape your whole codebase and send it to their server?
Makes total sense, and sorry to hear about the incident. At the moment, closed source models are the only viable way to generate high quality diagrams. Once that changes, we'd prefer to switch to open source too for many of the reasons you mentioned.
Sent via your servers, I assume, since you are providing the Anthropic api key.
So we must trust both Anthropic's and your infrastructure with our code.
I agree that a local LLM is the way to go.
That's correct, our server just routes calls directly to Anthropic. Some users requested an option to input their own API key and talk to Anthropic directly. I'll add this by the end of the week, maybe today if time.
Local LLM is still the end goal
Ok. I think you should be more transparent about this, until everything is local.
I mean, more than stating "We don't store any of your code."
5 replies →