← Back to context

Comment by bfeynman

4 months ago

I would not define ChatGPT as a wrapper, anything where you are doing actual training/learning and updating weights is by most persons definition, not a wrapper. Just injecting stuff into the context or using RAG is a wrapper because there are no weight updates anywhere.

My view is that the model is not the value. GPT-4o is not at the top of most LLM leaderboards, but ChatGPT is at the top of the AI product list.

So far, there is at most a few months' gap between state-of-the-art and commodity, if for no other reason than that other companies train on the output of the SOTA.

If I were a VC, I would invest in a wrapper (Cursor, Harvey, this idea, etc.) over a foundation model every day of the week.