Comment by revolvingthrow
2 days ago
Benchmarks look really promising. Suspiciously good, even. I guess we’ll see soon enough.
My question to previewers: how are the guardrails for random joe that wasn’t personally blessed by the ai pope to access the non-nerfed model? Fable is a nightmare in this regard, but I’m not sure whether 5.6 also gets a critical side-eye from the gubmint when you ask it to fix bugs in your code (you filthy hacker, you).
I almost immediately ran into "This request requires additional safety checks, which can take extra time. Hang tight or retry with a faster model for a quicker response, though it may be less capable of handling complex requests."
Which is something I've never seen with codex before, and I wasn't doing anything funky. Just writing CUDA kernels and benchmarks for them.
Is it actually usable though? Because the Fable situation is just obnoxious. If OpenAI's Fable equivalent is actually usable, I'll cancel my Anthropic subscription on the spot.
Yes it's usable, however it does make it difficult to just do /goal and walk away if this is happening periodically. I don't do that often, but for well defined things I sometimes do.
1 reply →
I was getting that regularly last week with regular 5.5 medium on the plus plan. I was doing benchmarking for a photo editor in Swift.
Interesting. Never seen it before. Now it's just constant and there's nothing sensitive about this work.
2 replies →