Comment by PheonixPharts
2 years ago
I don't find this any different than seeing an exposed jinja template: "{{product_name}} is perfect people who work in {{customer_industry}}" or the typical recruiter "Dear {{candidate}} I read your profile carefully and think you'd be perfect for {{job_title}} because of your experience at {{random_co_from_resume}}"
If anything, I think it's kind of cool that we're seeing LLMs actually used for something very practical, even if it is spammy (I mean I don't think template engines are evil just because they make spam easier).
I don't think LLMs are evil either, but I think the real risks are extremely underplayed. This is a mostly innocuous example, but there are a lot of people trying to get LLMs into more places where the just aren't ready for yet.
The difference between a template is that the behavior is generally deterministic. Even if someone fucks it up, it means it's (usually) trivial to fix.
Those emails from recruiters is also spam.