Comment by fsjayess

There is a big pie in the market around LLM serving. It make sense for a serving framework to extend into the space