Comment by jacquesm
8 days ago
I don't have the answer to that, my simple solution to this problem is not to trust anything a model ever writes and so far that strategy has worked very well.
8 days ago
I don't have the answer to that, my simple solution to this problem is not to trust anything a model ever writes and so far that strategy has worked very well.
Why write that comment in the first place when you know that inspection of model weights is not a thing though?
Inspection of model weights is a thing. But that thing is out of my wheelhouse so I do the next best which is to judge the output.
It is absolutely not a thing in any practical sense that relates to detecting post-trained backdoors, no.
Or provide a source showing how to do this (and not just a circuit paper showing which activations light up with the word dog)
4 replies →