Comment by xpct
2 days ago
Lately, I've been having less and less success using the models for work. Simple things like:
'write this in a separate file' (writes it in the same file)
'format this aiming for 5 LoC' (emits newline after every comma, resulting in 17 LoC)
'include 5 warmup steps before you measure runtime' (omits it completely and apologizes after I point it out)
I wouldn't be as opposed to using the models if they weren't as unreliable. I still use them a lot, but it's a very frustrating experience.
It doesn’t even follow simple directives in my Claude.md:
NEVER write comments unless explicitly directed to.
Still overly comments every gd helper function.
Let’s go for CEO from Germana now to ursula and get another chip from darkweb