Comment by carlsverre

14 days ago

Hey, author here! Good question. The prompt was to use the Antithesis skills[1] to write a workload that exercises SQLite's insertion and checkpoint machinery across multiple processes using a specific version of SQLite (3.51.2). The agent who did the work was aware of the bug and knew I wanted to see if Antithesis could reproduce it. However, I specifically designed the workload the same way we approach testing other WAL checkpoint-style systems: by putting them under stress. The workload itself does not know about the bug.

My goal, which I believe I accomplished, was to determine if Antithesis would have found this bug if we had put the SQLite WAL under test.

[1]: https://github.com/antithesishq/antithesis-skills

4 comments

carlsverre

minimaltom 14 days ago

Thanks for clarifying! It would be really interesting if Antithesis finds the bug when:

1. The specific bug isnt mentioned 2. (If youre game) a model with a knowledge-cutoff date before the report is used

carlsverre 14 days ago
This is a solid idea. However, something that is maybe similar to this idea is this: https://antithesis.com/blog/2026/finding-bugs-in-raft-implem...
Which is: "Given the knowledge of a kind of bug that can happen in one Raft implementation, can a similar workload find similar bugs in other Raft implementations?" Turns out it can.
- minimaltom 14 days ago
  
  Yeah 100%! And I'm sorry if I sound a little more critical and less eager, its just thats theres a world of difference between a priori finding the bug, and reproducing it, and the impression of the article (from my read) was the former.
  But please keep writing, I know its super hard to put yourself out there and make content!
  
  1 reply →