Comment by llmmadness
13 days ago
We started with a Polymarket project: train a Karoline Leavitt LoRA on an uncensored model, simulate future briefings, trade the word markets, profit. We couldn't get it to work. No amount of fine-tuning let the model actually say what Karoline said on camera. It kept softening the charged word.
What is "the charged word"? I don't know who Karoline Leavitt is, do they mean a specific word ("deportation"?) or just different words when they gave it sentences?
Not even the most unleashed models can utter the words of today’s politicians, I don’t know if this says more about the current technology or the people in charge.
I would suggest it says primarily that mimicking people's voices in meaningful ways is still far beyond LLMs and particularly small LLMs, but also more insurmountably that the prompt for Leavitt herself contains many tokens that the LLM prompt absolutely doesn't
Such as the values of the bets her own entourage has placed
Or if it says more about the training data being too PC, "inclusive", effeminate, etc.
Why are you trying this comment again? https://news.ycombinator.com/item?id=47851993
1 reply →
[dead]
[flagged]
"too effeminate"? I'm trying to understand what you're meaning by it and what the example of the excluded data would be.
Mind you, I didn't go through The Pile yet, need ot make some disk space first, so I can't even say if your "accusation" is correct.
1 reply →
Trumps are advising the board of both of those gambling houses
My favorite Hacker News comment in a while!
Could you break it down for someone who isnt in the know?
“We used LLM technology, which is great at parroting content, to attempt to predict what the US president’s spokesperson would say at their next conference.
We used that as input for ~gambling~ purchasing a position on a prediction market, which has been popularized recently in part due to its ability to circumvent gambling regulations.
However, even the LLM couldn’t parrot the words of the spokesperson. The implication is that the spokesperson speaks so outrageously that even an uncensored LLM couldn’t parrot their words.”
It's a direct quote from TFA