Comment by sosodev

It’s all subjective. Personally I think it would border on useless for local inference but maybe some people are happy with low quality models at slow speeds.