Comment by larodi
2 months ago
No tis not. The terminology has medical origins, and it is very much this
https://en.wikipedia.org/wiki/Ablation
"Ablation (Latin: ablatio – removal) is the removal or destruction of something from an object by vaporization, chipping, erosive processes, or by other means."
which is what one does to the model during... well, ablation.
Except we're talking about a _different_ word, a word that was _coined_ as a portmanteau of the word you're referring to and another word.
Rillii ease eat? R U sure
https://en.wikipedia.org/wiki/Ablation_(artificial_intellige...
Have you read some (any) actual papers from the word this all and LLMs are?
Well here some:
https://arxiv.org/abs/1901.08644
Tis ablation ablation and ablation everywhere save for some kid’s fav. model names and their X pals.
The very wikipedia page you're linking says:
> The term abliteration has been coined for the process of using ablation to uncensor large language models by modifying internal functions to completely eliminate refusal behaviors while preserving the remaining functions of the model. The word is a portmanteau that combines the words ablation and obliteration.
So are you dropping this now?
Papers using the term in their title or abstract: https://arxiv.org/search/cs?query=abliteration&searchtype=al...
Note that they're all talking about the same technique, namely applying ablation specifically to the refusal vector as described in https://arxiv.org/abs/2406.11717.
I really recommend letting this one go.