Comment by barking_biscuit

2 years ago

That's awesome!

I've been using it learn Python and produced Conway's Game of Life with pygame and I had never touched Python before that!

Now I'm working on another python project to try and split the audio of songs into individual lines to learn the lyrics and one approach has been downloading lyrics videos of youtube and munging them with ffmpeg to detect frame changes which should give me the timestamps to then split the audio on etc. It gave me all sorts of wrong enough to be slightly annoying advice about ffmpeg, but in the end what it did give me was _ideas_ and a starting point! I've had to wind up hashing the images and comparing the hashes, but I've since learned that that produces false positives and it was able to give me advice on using ensemble methods to up the accuracy etc which have panned out and helped me solve the problem.

I think for me, this is stuff I could have accomplished using Google if I had been sufficiently motivated, but it's lowered the level of frustration quite significantly being able to ask it follow up questions in context.

In the end, I don't think I mind the random bullshit it makes up from time to time. If I try it and it doesn't work, then fine. It's the stuff I try and it does work that matters!

Thanks for sharing. Your audio work sounds really interesting! Is any of it sharable, or still in-flight?

  • Still very much in-flight, but progressing pretty quickly. Just tonight I decided I wanted to try using OCR to extract the text of the lyrics out of the frames of the video so that I can match up the clips with the lines eventually, and so far I've been through a series of iterations of different techniques with increasing accuracy. All of this has just been driven by asking ChatGPT and working through its suggestions, asking probing questions, and even using it to debug. It's just mind blowing. This is a project I wanted to years and years ago and just didn't know where to start, or the effort simply would have been more than I was willing to put in, but I actually think I'm going to succeed at it and I don't think it'll take me too long. It's making programming fun again.