Comment by Eji1700
20 hours ago
It's interesting because i'm kicking the tires on the top tier stuff for a month (because it's expensive as fuck but I need to know where the ceiling is).
I have actually gotten "hey i don't think this is a good idea, here's why" as feedback from at least Opus. It WILL still do it if I just demand stupidity (and hell i've been right, which is another topic entirely) but it has given me more confidence this can be a useful tool in the right spots.
That said I probably don't need the top tiers (metrics at least confirm that) and I'm guessing that's specifically because I was working in coding. Most were worded in a "is this a good idea" framing which probably helped, but at least once I said 'lets use this library/method" and it gave a decent argument on why that was basically redundant without prompting.
I still struggle to see the price point panning out.
Exactly, I have the luxury to be able to use all top tier models without limitation. Fable and OPUS most definitely say that you are wrong and try to proove it most of the time with links to sources or math. I even had an argument with Fable where I was 100% sure it was wrong and tried to explain the issue. Turns out I was wrong. Fable did NOT give an inch. Always said, you are wrong, let me try to explain it like this. It even made a graphic when I did not get it. The times of LLMs only saying yes is over since 3-6 months. Where it still lags are decisions for infrastructure. It makes a plan. I say "Why not this?" and it responds with "that is much better" in 90% of the cases. However, I am not sure how to solve this. I also do not want an LLM to say: "I wont implement this."