Comment by famouswaffles

>should you just cut out the middle-model and be using ChatGPT as your classifier?

Oh you certainly could.

See here: GPT-3.5 outperforming elite crowdworkers on MTurk for Text annotation https://arxiv.org/abs/2303.15056

GPT-4 going toe to toe with expertrs (and significantly outperforming crowdworkers) on NLP tasks

https://www.artisana.ai/articles/gpt-4-outperforms-elite-cro...

I guess it will tke some time before the reality really sinks but the days of the artificial sota being obviously behind human efforts for NLP has come and gone.