← Back to context

Comment by philips

1 day ago

I just reverse engineered the Supernote note file format with an agent a few weeks ago. For years the community had been asking for a document on the format. And in a few hours the agent, with 20 something file format example fixtures and 30 something prompts, was able to reverse out the format.

It would have been completely not worth the effort to do this by hand for a niche device. Now, in a few hours of effort there is working code and a doc.

https://github.com/philips/supernote-typescript/blob/main/pl...

https://philips.github.io/supernote-typescript/

14 comments

philips

Reply
frio  1 day ago

While it’s impressive work from the LLM and a TS implementation is novel, there’s at least a couple of pre-existing Python REs eg. https://github.com/jya-dev/supernote-tool :)

  • philips  19 hours ago

    I know of the project but it doesn’t actually extract the stroke information. It converts the raster into vector.

    My reverse engineering extracts each pen stroke directly into a svg vector.

  • fwip  21 hours ago

    It seems like most of these "an LLM solved this in only X hours! " could have been "I found an open source solution that did what I needed with X minutes of web search."

    Which doesn't mean that the LLM definitely couldn't have accomplished it without the prior art (in either the training set or explicitly in a a web search). But it does seem to be a trend.

    • analog_daddy  17 hours ago

      Ohh, sadly I relate with this feeling too much.

      For all the agentic loops people seem to have come up with, the research loop or as I call it the “Desperate 10th page on Github’s crappy search results” is still not up to the mark.

      Either it might be genuine rate limiting these LLM’s face or just that, they are trained to focus on implementing a solution which would be faster and user acceptable solution. (which seems to be a true looking at people pushing LLM generated code as is).

      At least in my personal experience with niche projects and heck even with well documented and famous libraries, along with fancy mcp’s, llms.txt and skills; RTFM has been more relevant than usual for code that I have asked an agent to generate, since it is too eager to reimplement functionality which already exists, only if it RTFM!!

    • Klonoar  7 hours ago

      Per the author, that open source project is not doing the same things as what they cobbled together.

    • ShinyLeftPad  19 hours ago

      > Which doesn't mean that the LLM definitely couldn't have accomplished it without the prior art

      It is definitely the case that people know less and less how to do research themselves though...

    • fragmede  19 hours ago

      If give an AI the full set of files it needs to RE a file format, and it's running xxd in tool calls in order to document the file format, I don't think it's cheating by copying it off the Internet.

      1 reply →