← Back to context

Comment by jeswin

2 days ago

> novel and complex things

a) What's an example?

b) Is 90% (or more) of programming mundane, and not really novel?

If you'd like a creative waste of time, make it implement any novel algorithm that mixes the idea of X with Y. It will fail miserably, double down on the failure and hard troll you, run out of context and leave you questioning why you even pay for this thing. And it is not something that can be fixed with more specific training.

  • Can you give an example? Have you tried it recently with the higher-end models?

    • I have asked chatgpt reasoning model to solve chess endgames where white had king and a queen vs king and a rook on a 7x8 chessboards. So to compute value for all positions and find the position which is the longest win for white.

      Not creative, not novel and not difficult algorithmic task. But it requires some reasoning, planning and precision.

      It failed miserably.

      2 replies →

    • My favorite example is implementing NEAT with keras dense layers instead of graphs. Last time I tried with claude 3.7, it wrote code to mutate the output layer (??). I tried to prevent that a few times and gave up.

      3 replies →