Comment by DiabloD3

Shame this is written in Python, looks very interesting, but I'm no expert in this field.

If there is anything here worth using, it's entirely possible that the llama.cpp crew can save it from vanishing into obscurity.