Comment by jjcm
15 days ago
Image->html test for Argon. I'd put it at B tier, just under gpt 6.1 sol. It isn't A tier like Opus 5.5 or Astra.
Argon build: https://html.non.io/lcars-argon/
GPT 6.1 sol: https://html.non.io/lcars-gpt-6.1-sol/
Opus 5.5 (currently SOTA for this): https://html.non.io/lcars-opus-5.5/
Original designs: https://diffui.ai/app/canvas/5093e689-1e74-4f26-b632-2a4500f...
I don't know how you rate, but the Opus 5.5 is literally stuttering and lagging when scrolling on a Macbook Air M3 (for me).
(Chrome, also incognito)
More info on this - I ran a few tests on my mac and linux systems with chrome/firefox. I highly suspect this is due to gpu acceleration being disabled. https://image.non.io/e7165331-432b-45c3-986e-c2973f12d377.we...
As soon as gpu acceleration is disabled, the webpage goes from 60fps across the three systems I tried to ~7-20fps when software rendering is forced.
I suspect if you go to chrome://gpu you'll find something different from what I have here: https://image.non.io/a47a1b03-1b87-4fd5-92a2-b39e62b1cfd9.we...
Nice research, you are right! Seems that low power mode was on. I have been using the web, Netflix, Apple TV app, and anything else just fine without ever noticing a thing though.
So that all being said, a normal website should work totally fine on low power mode, and this should definitely be a negative on the Opus implementation.
1 reply →
Even after ensuring GPU acceleration is enabled on Firefox on Linux, it's still sluggish.
The Opus 5.5 implementation is noticeably slow on my machine as well (Firefox, Fedora, Gnome Wayland, AMD 6800U).
Interesting! Do you have webgl disabled for incognito or for chrome in general? I wonder if it's trying to do software rendering.
FWIW, I have literally the exact same configuration (M3 air, google chrome). Here's a recording on mine where I'm seeing 60fps: https://non.io/video/video-3587018401.mp4
Mine doesn't stutter on on Firefox on M1 Max, but it pins 7 cores the entire time the page is open, not just while loading. It also uses 50% of GPU in addition to that.
Edit: The argon built site pins 1.3 cpu cores. The Sol 6.1 site uses 0.18 cores.
Unless it is something with the playback on my end, your animations and scrolling are a bit jerky too.
[dead]
Mac Air M1 in Safari here, buttery smooth.
Also stuttery on Edge (Chromium), so there might be a pattern here
Fine on arc search (which I think is just WebKit) on iOS.
Maybe a Chrome bug? It's fine in Safari on an M1.
Also horrifically sluggish on Firefox on Linux.
1 reply →
One interesting observation - it's the only one I've seen make an ASCII representation of the layout of each of the pages before building: https://image.non.io/46e0cce3-34d9-4fcb-8775-bfc2c70bc4bb.we...
That's really interesting I think- literally putting the layout into ascii language to reason about.
Damn opus 5.5 is just such a good model - what kind of moloch sacrifices are they doing in there
Truly S-tier. It's sharp, creative, intuitive. Can't believe how much better it is than Opus 5, then they went ahead and made it cheaper and faster too.
I'm constantly blown away by it. I do think Astra is slightly more intelligent (although worse at this particular benchmark), but Opus 5.5 has become my default model for 99% of what I do. It's so good.
Argon's build is pretty much unusable on mobile, the header takes up half the screen
Yea its attention to detail was much less.
Here's a vid of both opus and argon side by side, which might be more viewable on mobile: https://x.com/pwnies/status/2110058987462988152
Very subjective, but I'd say the Argon one is the best here. The other two don't quite do LCARS correctly, there are a bunch of lines/curves that are the wrong angle, don't line up, etc. The Argon one looks to me the most like a designer would have done it. Of course this is up to personal taste to some extent.
Are you checking on desktop? On phone Argon one is completely broken
Opus one has by far the worst performance, the only one that's stuttering and making my laptop fans very noisy.
Opus is way slower in firefox on my machine than the other two.
Off topic, but I want to customize a starship now
Oh, fuck, I just realized those are actual apps?! Holy cow.
B tier? For me the argon one is really quite bad on mobile; the nav is messed up enough to make the page kinda unusable.
On firefox on linux, argon looks great and the other two have graphical issues.
That Argon build is really bad on mobile fyi
Jesus Christ, so much "stuff" crammed into so little space. What a nightmare of a website.
How on earth can you say one is better than the other? It is subjective.
For an implementation test, there are a bunch of very objective things you can measure.
IE for Argon, the third section doesn't have a top view of the ship with labels going to each section like what's in the design. Opus has it, and animated it as well. One failed to do as instructed, the other went an extra mile.