Comment by xpct

2 days ago

Lately, I've been having less and less success using the models for work. Simple things like:

'write this in a separate file' (writes it in the same file)

'format this aiming for 5 LoC' (emits newline after every comma, resulting in 17 LoC)

'include 5 warmup steps before you measure runtime' (omits it completely and apologizes after I point it out)

I wouldn't be as opposed to using the models if they weren't as unreliable. I still use them a lot, but it's a very frustrating experience.

It doesn’t even follow simple directives in my Claude.md:

NEVER write comments unless explicitly directed to.

Still overly comments every gd helper function.