Comment by scruple

I asked it to write a function that could calculate the grade adjusted pace between 2 latitude, longitude coordinate pairs. What it spit was naive but correct enough, given the prompt. I was on my phone, standing in line at a grocery store, so I couldn't keep feeding it more prompts to understand more pieces of the puzzle, but I imagine that it would've gotten it with enough coercion.

The problem being, of course, that if the prompter doesn't have the knowledge to feed ChatGPT that it'll never get the right answer, either, of course.

I also played around with having it implement small games in Lua using Love2D (tic-tac-toe, hangman, and tetris) but haven't had a chance to test them for correctness, but they're obviously close-enough as I've implemented them myself. Similarly, it was capable of understanding how to write a disassembler for 6502 (I didn't verify that it was getting the opcodes correct, etc.), ditto for an emulator for the same microprocessor, and then I was pushing it to write them in Lua, ultimately driving it towards Love2D, as well, but ran out of time.

It's not perfect but it's really intriguing. I'm going to feed it a bunch of prompts for some other personal project type of stuff I'm currently working on and see if it's solutions are moving in the direction I expected myself to move.