Comment by murkt
7 hours ago
I find all current LLMs to have pretty poor spatial awareness. It is becoming better, but still very poor. How are you dealing with that? Got any special tricks, any advice?
7 hours ago
I find all current LLMs to have pretty poor spatial awareness. It is becoming better, but still very poor. How are you dealing with that? Got any special tricks, any advice?
I write about this in detail here: https://adam.new/blog/bitter-lesson-ai-cad
This is improving greatly in recent model releases
Opus 4.5-4.7 was pretty bad at it, 4.8 was a bit better, and I have not tried Fable much.
So basically you have a good enough code that’s “intuitive” for a model, screenshots, and that’s it?
fable is a fair bit better, but to an extent its that it tried more things to get an understanding of whats happening than opus does
1 reply →
My favorite spatial reasoning benchmark: https://minebench.ai/
no tricks, I'd definitely be curious to know how much screenshots help