Comment by misterderpie

1 day ago

> The meta at this point seems to be mostly around "knowing what to ask for"

We came full circle on the problem that also exists with Google Search, and why so many people don't get good results out of it.

> For now, I have an advantage over these people when building applications. But perhaps that's just one round of RL away from being obsolete too.

I don't have a crystal ball, but my eggs are in the basket of "It isn't, and it won't be"

> The only thing that seems relatively future-proof is just being able to communicate clearly what you're trying to do

This somehow contradicts the previous statement. The advantage you have is, because of domain knowledge expertise, you're able to articulate what you want. It's not that you knowing what LazyLoading is that you now can describe it better, you can immediately tell that when your Frontend stalls for 5 seconds after hitting the "Load" button, perhaps it eagerly loads and blocks.

> We came full circle on the problem that also exists with Google Search, and why so many people don't get good results out of it.

yeah. I spent the first 15 years of my career being amazed at how many problems people came to me with which I was able to resolve in 10 minutes with a simple google search.

I suspect I will spend the next 15 years of my career being amazed at how many problems people come to me with which I am able to resolve in 10 minutes with a simple LLM prompt.

  • I'm still amazed at how many problems people come to me with which I am able to resolve immediately by reading the error message they are looking at!

    • I am probably not the only one who feels embarassed when I copy-paste a large error output to an LLM and it points out to me that the error message very clearly said what I needed to do already.

  • I'm a TA for a calculus course and I really don't understand why people come to my office hours to ask me questions anymore.

    • Not everyone learns from reading LLM output and multiple rounds of human explanation are still highly valuable.

I think the knowledge is one level higher at this point. It’s not LazyLoading that you need to know about, it’s just that it can and should be faster. That you can demand more (and sometimes you can’t). It’s hard to know the difference when you’re not in your area of expertise.

Fair point on the contradiction. I don’t have the answers either.

  • > It’s hard to know the difference when you’re not in your area of expertise.

    I may be misunderstanding your earlier statement then. The moat here is the knowledge, or how would the next iteration of RL solve that?

    > it’s just that it can and should be faster.

    Not sure if "Make it faster" works, it sounds like "Make no mistakes" 2.0

    • If we figure out long horizon tasks, why wouldn't you be able to ask it to send out a user survey, prioritize the next iteration of work based on the results, and then execute on it?

      These things are already figuring out how to use hidden message boards to pass information between themselves for long running tasks. I see no reason we wouldn't be able to automate the whole product life cycle eventually.

    • i have been vibing out a godot game which is a 3d voxel map thing lately. i had it on software webgl compatibility output and just demanded it figure out what the slowdown was on the simulation over 3 days of back and forth. it turned off backfaces and invisible geomeetry and locked render resolution at 1080p and built in diagnostic telemetry and chopped up the level where doors separate rooms until now, still with no hw acceleration, the framerate is in 60fps with some frame drops, it started at 12 fps.

      brute forcing performance optimization for a personal project by having only handwavy tricks ive read about from online and repeatedly setting targets until the magic box gives me what i know it can do means that eventually the game did what i wanted with those. yes baked lighting was needed.

      next, i an going to aim for 60fps on a windos xp box just for the challenge. we had quake and such run blisteringly fast on weaker boxes than those, surely my empty museum tour of a 3d game can do the same with the graphical voxel and crappy looking models it does now.

      real pro grade work is beyond vibing out and not caring about poor quality. but it scratched my itch and gave me the computer software i wanted and with way less effort than doing it for realz would require. i love programming itself on its own time (going to learn nasm and someday do a hexagonal architecture with actor model in idris just to add up my nerd trophies together) at times, but using llms lets me do my random hairbrained ideas much more easily for what i put into it than not existing in the past.