Comment by xiphias2
14 hours ago
I have quite the opposite experience: I can do any concrete coding change with any model, but the intelligence limit just doesn't go through more complex debugging examples.
And then when I try a smart model, like Astra medium and it solves it (I had a firmware bug in my new laptop where I couldn't charge through USB-C) on the first try (altough with a repo already having lots of information about the hardware/firmware/debugging programs/traces), I realize how much time I'm losing on the few examples that the less intelligent models are just not able to debug and solve.
Also they can work in completely new domains, like Astra and Opus 5.5 starting to be able to use something like Blender. Currently they still often do horrible topology and basic UV mistakes, and the animations are really bad, but who knows where they’ll be in 5 years.
I’ve heard about this through vfx artists
I was really hoping this would be solved since openai said that gpt-6 could paint brushstroke by brushstroke but it’s still shit
I don’t think these are completely new domains in training. Like I’ve taken up offers to help code up AI training material just to see what they’re up to and get a sneak peek at how the sausage is made, no idea who these front companies are working for of course, but they pay for all kinds of fringe cases and Blender wouldn’t even be considered fringe in what I saw at the beginning of the year. (I was only there to observe, never submitted anything, so I didn’t betray you guys by helping train your replacements.)
5 years? Look at the leaps since last November. Since the Spring, even.
Very cool!
Is your laptop something like framework which has open source firmware?
I(and many other people) have a similar issue with usb-c charging not working consistently. I've been meaning to try one of these new smart models to help me debug the issue.
ASUS Zephyrus, but it was able to reverse engineer the ports and I was able to download the firware from the controller itself, write an emulator that emulates running the firmware on multiple controllers with different instruction sets (the USB Power Delivery controller is RISC-V) and the communication between them. Also it found out how to read the communication buffer that was on the devices for debugging, which helped it understand the USB data packets that were doing the handshaking and voltage/current negotiation.
I had to reboot my laptop a few times though until I got to this, but it was a fun experience anyways.
At this point open source isn't as much advantage as long as the firmware is not encrypted :)
Wow, that is impressive. I've been meaning to do this by hand to fix the issue on my Lenovo IdeaPad for a while but haven't gotten around to it.
I'll try handing it off to one of these new frontier models.