Comment by makeitdouble

1 month ago

> effectiveness of LLMs

Is doing dozens of back and forth to explain what we actually want, while the model burns down inordinate amount of processing power at each turn, a model of efficiency or effectiveness ?

It might be convenient and allow for exploration, the cost might be worth it in some cases, but I wouldn't call it "effective".

Regarding effectiveness, LLMs are in a class of their own wrt. their capabilities for general language processing and basic few-shot reasoning.

This also invalidates the "efficiency" question, since the cost of doing those tasks without LLMs is infinity (i.e. you can pay as much as you want, a dolphin is never going to replace the LLM).