Comment by beltsazar
9 hours ago
> I’ve run 3.6-27B and 3.6-35B on 32GB locally for a lot of bulk non-code tasks.
Do you mind sharing your use cases?
9 hours ago
> I’ve run 3.6-27B and 3.6-35B on 32GB locally for a lot of bulk non-code tasks.
Do you mind sharing your use cases?
Not OP, but I use it for a ton of smaller things. I have it hooked into Hermes and have been using it to help bulk rename my media folders so they all follow a common format, add titles that sort of thing which wouldn't be easy to 'script'. Another thing I use it for is comparing data sets, looking at my exported Spotify artists and compare to what I have locally, and letting me know where there are missing artists, or albums, and recommendations based on similar artists that I may not have locally.
Sure a lot of this could be done without AI, but it's certainly quicker and easier, and since my AI box is on solar, it's just the power of the sun to keep it going.
Not OP, but driving knowledge bases is the poster child use case for me https://github.com/aka-rider/llm-wiki
I started with Karpathy's LLM wiki, and did everything he said not to do - downgraded the model to mere tool usage and summarization, and it works great.
I am a data hoarder, and finally I can just dump all the content I remotely like, and get something interesting to browse for the price of electricity.
Agentic long-running tasks, as others have mentioned:
- Groom and triage tickets for agentic SWE workflows
- bug hunt — the probability of Qwen fixing a complex bug is 50/50 but often it is capable of identifying the root cause or at least laying the ground work for a more capable model to pick it up.
Love the workflow. Is there an existing way to do this inside Obsidian -- where I have all my knowledge?
SmartConnections but heads up, Connections Pro asks $300/year, or, more for the plugin than for an LLM subscription, more than Microsoft Office for that matter.
https://smartconnections.app
Keep in mind Obsidian is open standard JS plugins... You know what can write open standard JS plugins?
Classic which comes first, LLM or the plugin, though. :-)
Not OP, but I use it for personal tasks that are just not worth the claude tokens -- rooting through historical medical records to unify prescription history, super-OCR'ing thousands of PDF pages (i.e. beyond PDF dumping -- vision means it can look at tables, understand tricky things like a continuation of a block quote or aside on the next page, etc.), and when power is cheap I'll just let it noodle on little projects on my data. During my agent's "free time" I give it with a tremendously open ended prompt last week, it did a linguistic analysis of how my texting changes in the lead up to, initiation, maintenance, and ending of romantic relationships.