Comment by StevenWaterman
15 hours ago
Yes, it submits lots of varied prompts that get refused, and then lots of varied prompts that don't get refused, then iteratively edits weights so those two groups end up in roughly the same latent space.
15 hours ago
Yes, it submits lots of varied prompts that get refused, and then lots of varied prompts that don't get refused, then iteratively edits weights so those two groups end up in roughly the same latent space.
I wonder, if we could accurately resolve discrete neural signals in the human brain, if a similar process would work.
We have no theory as to how the brain works at a granular enough level. Remember that matrix multiplication can simulate almost any group structure.