← Back to context Comment by 3eb7988a1663 5 hours ago Who is offering the refusal vectors or instructions on how to generate them? 2 comments 3eb7988a1663 Reply wren6991 5 hours ago Here's a widely used toolkit: https://github.com/p-e-w/hereticDistributing the vectors themselves isn't (yet) common practice, because people have gotten used to just putting the full modified weights up on HuggingFace's huge free storage. p-e-w 5 hours ago I am, in fact, I’m offering something much better, a compact format that exactly restores an abliterated model from a tiny JSON file:https://www.reddit.com/r/LocalLLaMA/s/iksvmXBzuC
wren6991 5 hours ago Here's a widely used toolkit: https://github.com/p-e-w/hereticDistributing the vectors themselves isn't (yet) common practice, because people have gotten used to just putting the full modified weights up on HuggingFace's huge free storage.
p-e-w 5 hours ago I am, in fact, I’m offering something much better, a compact format that exactly restores an abliterated model from a tiny JSON file:https://www.reddit.com/r/LocalLLaMA/s/iksvmXBzuC
Here's a widely used toolkit: https://github.com/p-e-w/heretic
Distributing the vectors themselves isn't (yet) common practice, because people have gotten used to just putting the full modified weights up on HuggingFace's huge free storage.
I am, in fact, I’m offering something much better, a compact format that exactly restores an abliterated model from a tiny JSON file:
https://www.reddit.com/r/LocalLLaMA/s/iksvmXBzuC