Comment by eckr

There was a startup that did this for Llama 3, I forgot their name. Etched is also doing some similar things I believe.