Comment by cpursley
10 hours ago
I still don’t understand why with all their cash these companies dont redo their apps in Rust or native. They are all so heavy and dog slow. There are already some very fast cross platform (wasm too!) libraries that can do what poppler does as well as parse and produce various office file formats. Because 2gb is crazy town, these things could be around 100mb, just throw some tokens at the problem.
Not that easy. Also, they have "priorities." Although their priorities are different than the users'.
Just throw some tokens at the problem. I’ve vibed up a Rust Crux hybrid app that runs well on macOS, iPad and wasm and does some pretty complex xml manipulation and other document work. Absolutely smokes electron and you get native UI.
Ref: https://redbadger.github.io/crux/
On top of everyone else’s great points, if you make your own “fork” of something, then you have to consistently maintain it. Which can be done with tokens, but an extra cost with something that’s not as user tested.
2 replies →
one does not just "throw tokens" at a problem, Ai is not that capable, and we are talking about MS Office file format, likely a NP hard problem
9 replies →
You should go actually try to make any basic automation work around these systems.
They purposely obscured, google doc is another example they completly hide the dom!
I spent months fighting word processing systems and ended up shipping libre. There's almost zero alternatives without that becoming your entire company.
What % of time, for a an average session, do you think is app overhead vs waiting for tokens? And there's your answer for why it's not a priority.
Jon Blow's response to this take was, "yes, which is why you have to work even harder to hide latency", instead of adding more on top.
From OpenAIs perspective, resources on your computer are free and wasting them is inconsequential
Kind of. Eventually it gets too slow even for the OpenAI engineers using it, and then they need to fix it.
[dead]
What makes you think Rust is automatically better?
(Also, "Rust or native" is a strange dichotomy. What's not native about Rust?)
I think “or native” is a gesture at swift/objc for mac and C# or whatever people write windows apps in.
Rust or native is objectively more performant and have smaller binaries than these web apps in Halloween costumes…