Comment by larodi
2 months ago
The name for it is ablation - precise removal of parts of the model. Not abliteration as it is not obliteration.
Even as I write this the ‘abliterated’ word is denoted a typo. Does it not at your end?
2 months ago
The name for it is ablation - precise removal of parts of the model. Not abliteration as it is not obliteration.
Even as I write this the ‘abliterated’ word is denoted a typo. Does it not at your end?
The name for it _is_ abliterate. It's a portmanteau of ablate and obliterate.
No tis not. The terminology has medical origins, and it is very much this
https://en.wikipedia.org/wiki/Ablation
"Ablation (Latin: ablatio – removal) is the removal or destruction of something from an object by vaporization, chipping, erosive processes, or by other means."
which is what one does to the model during... well, ablation.
Except we're talking about a _different_ word, a word that was _coined_ as a portmanteau of the word you're referring to and another word.
3 replies →
The name is abliterate. It's a specific method of ablation.
https://github.com/NousResearch/llm-abliteration
well see my other comment. with all due respect to Teknium, perhaps he misspelled it.
8 replies →
Tell these guys they’re wrong
https://arxiv.org/abs/1901.08644
I miss the days of 4changpt.