Comment by scruple
16 hours ago
Of course, and I'm really not trying to move the goal posts here, but I agree that that's what (most) humans are going to do. But we're rapidly moving in a direction of agent-to-agent flow and "they" seem to lack the degree of discernment the average human does. They certainly don't have the same incentive structure we do to detect fraud. They happily regurgitate and build off of lies because, to them, the lies are not lies, and they can't be. They're just a pile of geometrically close labels from the perspective of the model.
> "they" seem to lack the degree of discernment the average human does
I don't think the average human has a particularly great sense of discernment either
And what’s more, the average human’s counterparties are exquisitely tuned to exploit the gaps in that natural endowment. But the tools to improve discernment are the same as they’ve always been, just as pushups and crunches lead to physical fitness.
I’m not sure how exactly that generalizes to LLM behavior, but to you as a human cultivating discernment, I imagine it implies that anything Internet-mediated (and unvetted by you) is less reliable than it used to be.
Obviously, we don't move in a direction of agent-to-agent flow because it's fundamentally flawed and worse than the status quo
Seems like the next push, then, will be to get agents and LLMs to start doing that discernment?
[dead]