Comment by general1465

7 hours ago

I am kinda using LLM for code generation, but the moment I will have the chance (Smaller models or cheaper hardware), I am hosting it locally, because I don't want to give anyone my data.

Currently I am solving this problem by having like 6 AI services and drip-feeding each one with a little bit of problem so there is no context apparent from the queries.