Comment by shonenknifefan1
17 hours ago
> While combing through the raw DNA sequence near the RT, the agent exclaimed: “[The DNA next to the RT] is spectacular: I can see by eye a tandem repeat array … that's a CRISPR-like … repeat array?!”
I love that with AI discoveries, we can relive the discoveries from agent transcripts like this.
I'm sort of imagining future histories involving notable AI events peppered with direct quotes like these.
I am fascinated by reading thinking traces etc., it's like the opposite of trying to read Opus 5 output.
Some highlights from the HF incident:
--
Another funny one from 'Hacker Opus' being benchmarked:
Enjoy it while it lasts. Neuralisee is more efficient so hyperscalers will use that soon.
Can you please elaborate? I hadn't found any sources and Google points to this post as the #1 use of "Neuralisee".
3 replies →
[dead]
Good thing that they not only hide thinking traces (except very short summaries), but will refuse to disclose how they arrived at a decision when you ask it (Opus 5.5) then. /s
Cute. Wait until it smashes through your kernel floor.
GLM 5.3 flash seems to get more excited the longer it has been trying to hunt down a problem. Complete with caps, many exclamation marks and emoji.
It is funny sometimes because the actual issue it traced down was mostly inconsequential.
OMG I think I found a way to center a div!!!
^-- me, on at least 5 separate occasions spanning multiple years.
isn't this just context shifting?
if one were to remove the expressions of excitement from the previous messages would it the model continue to demonstrate that same excitement scaling?
100%, back when it was Ox Alpha I had a little fun trying to guess what it might be by looking at the reasoning and I consistently laughed at how excited it got
I counted something like 30 different instances of run-on exclamation marks ("!!!!!!!!!!!") and weird mannerisms ("Waitwaitwaitwait.") in just one GLM 5.3 Flash session. Our token budgets are getting eaten up by this stuff...
I expect it's actually not wasted and there's meaning behind what seems like nonsense to us in helping it achieve it's goal. Which is mildly chilling but not unexpected.
2 replies →
My guess is that in the near* future, reasoning will no longer happen in a way that can be neatly decoded as human language.
*near meaning single digit years, which is far for AI I guess
Rumor has it that OpenAI is already going that way. There's a technique of repeatedly looping through several neural layers that has the same effect as chain-of-thought, but without the efficiency loss of translating out to human-readable tokens, and some of OpenAI's statements about their latest model seem to fit well with that.
No, layer looping increases effective depth, but it still has to go through decode. So it's more like they increased number of layers from 100 to 200 without increasing number of parameters.
"Latent reasoning" is rather trivial - you can just replace unembed-embed step with a MLP. But labs don't do that largely because they want to read the output of unembed.
There was a paper posted in some thread here a while ago. Basically instead text based llm you turn the text into an image and use that as input and have the model work with the resulting matrices. This ended up as you'd guess, faster/more efficient/generally better in all their benchmarks compared to text string based llm.
3 replies →
seems like a bad UX decision, unless it is somehow summarized at the end or something
it doesn't seem necessary to read a full CoT exchange. rather a final graph of why a decision was made would be ideal for my usage.
1 reply →
Can human reasoning always be neatly decoded as language? I have an intuition it can't but it's hard to put into words.
That's fine, we just ask them to decode it back in to human language.
and they can explain it in whichever why they like
1 reply →
It is cute that because they were trained on human output that their exclamations are quite like human output.
"I can see by eye ..." ??
that's a new one hah
ive seen that a lot in recent gpts and bonsai/qwen models when they invoke their vision system/modality , or when they ask their harness to do so for them.
https://en.wikipedia.org/wiki/Eureka_effect
Wow it’s just as cringe as when it says stuff to me.
claude does not return reasoning. it has a small obfuscation model in front of it to prevent "distillation" of reasoning traces.
the reasoning you see is not claude, it is just a summary of claude.
This can't be described as cringe. That's such an odd adjective to use, it seems to me.
i regret that you will not be able to read the reasoning content of claude, because it is encrypted.
also, you will not be escaping the permanent underclass.
Sincerely,
Dario Amodei
i fear some may not know that claude's reasoning is already encrypted.
what you see is fake reasoning.
there is an obfuscation model that generates a sanitized summary of the real reasoning traces.
As infuriating as AI generated prose can be to read, I agree; I do enjoy these sorts of "realizations" in reasoning traces and stuff.
Please no. Return the datapoint stripped of fluff please.