Comment by namegulf
18 hours ago
This is Amazing and a game changer. Millions were spent during NLP era to achieve even <50% what this model offers.
Now this on a CPU is next level. When algorithms perform well on commodity hardware, the scale tips.
This gives hope that CPULLM's are not far off that'll be just fine for majority of use cases.
Just ran on Podman on a older hardware with intel CPU processor and ubuntu linux.
When given a large text, it nicely chunked them up (debug statements showed), generated the audio and played back nicely.
Well done!