Comment by fooker
5 hours ago
Running a local llm at 10 t/s overnight to extract data from a few PDFs will burn more in electricity than paying cents for the hosted kimi models.
You can (sometimes) break even if you have a workstation GPU.
5 hours ago
Running a local llm at 10 t/s overnight to extract data from a few PDFs will burn more in electricity than paying cents for the hosted kimi models.
You can (sometimes) break even if you have a workstation GPU.
Sometimes data privacy is paramount.