Comment by CrimsonCape
10 days ago
> his contributions included investigating why generative AI systems suck up to users
Why does it take research to figure this out? Possibly the greatest unspoken problem with big-coporate-AI is that we can't run prompts without the input already pre-poisoned by the house-prompt.
We can't lead the LLM into emergent territory when the chatbot is pre-engineered to be the human equivalent of a McDonalds order menu.
I find your belief that what is needed for emergence is better prompting … amusing.
The ai would still be sycophantic even without the pre-prompt. It’s been reinforced to do so, it’s baked in the weights.