Comment by jacquesm
4 days ago
By pulling the plug. This box simply has no pathway to the internet. I do pretend I have one and it's interesting to see what it tries to do. For instance, Qwen tends to try to hit ali related URLs for websearch and is very disappointed when the mothership is not responding. I've yet to catch a model on an exfiltration attempt, either they are so good at this that it escapes my scrutiny (possible but unlikely) or they are simply not doing it. I would bet on the last one. Just don't say you're working for the Tibet Liberation Frontier or the Keep Taiwan Independent movement.
> Just don't say you're working for the Tibet Liberation Frontier or the Keep Taiwan Independent movement.
Has abliteration/decensoring been at all useful or relevant in your setup?
I have downloaded a number of abliterated models and done very brief tests on them (just to check for basic functionality) but on local models I have yet to run into refusals or output where I thought it might make sense to retry with an abliterated model. It was more out of a precaution that NV might drop those models from HF.