Comment by skygazer
12 hours ago
My worry is that what we recognize is the unstylized default, but it might be very easy to emulate any particular human easily enough with some examples and a prompt and n-gram/style template biasing token selection, or iterative generation-scoring loops.
Yeah. The big LLMs have fairly idiosyncratic writing styles. Smaller finetuned LLMs can be quite different (and you can also tune them on a particular person's writing). I think some of the confidence in this is because there's plenty of cases which just don't get noticed.
This is probably possible now. Back when machine learning was all the rage people were using it to identify authors of various anonymous works. It became an introductory project to identify the Federalist Papers authors. Just read in some works, identify patterns, set up tests, and set the LLM into a loop testing whether the output would be predicted to be the author you are trying to impersonate.
https://towardsdatascience.com/hamilton-a-text-analysis-of-t...