Comment by babyent

For me the issue has been that local models seem to be pretty bad (and it’s entirely possible it’s a user error on my end) compared to calling gpt-4o.

And even gpt-4o needs constant attention to ensure it doesn’t analyze input in a haphazard way.

I made a simple AI app for myself where I ran a bunch of recipes I’ve saved over the years through batch analysis. It tagged recipes with “kosher salt” as kosher lol. I had to baby sit the prompt for this simple pet project analysis for like 4 hours until I felt confident enough. And even then I was at maybe 60%.

Now imagine for a business application. This kind of incorrect analysis would be detrimental.