Comment by thorum
4 days ago
If you’re a power user of these LLMs and have coding experience, I actually recommend just whipping together your own bespoke chat UI that you can customize however you like. Grab any OpenAI compatible endpoint for inference and a frontend component framework (many of which have added standard Chat components) - the rest is almost trivial. I threw one together in a week with Gemini’s assistance and now I use it every day. Is it production ready? Hell no but it works exactly how I want it to and whenever I find myself saying “I wish it could do XYZ…” I just add it.
This is the most "just build your own Linux" comment I read this year.
Just download some tool and be productive within seconds, I'd say.
Kinda odd to be so dismissive of this mindset given this websites title. Whipping up your own chatui really is not that hard and is a pretty fun exercise. Knowing how your tools work and being able to tweak them to your specific usecases kinda rules!
There is a big difference between fun exercise and actually creating something that competes with the apps you can download. Building something on par with Claude Desktop, ChatGPT Desktop, etc. would be a lot of work. And I don't think the payoff would be there for most people.
7 replies →
I only did it once some 15 years back (in a happy memory) using LFS. It took about a week to get to a functional system with basic necessities. A code finetuned model can write a functional chat UI with all common features and a decent UX in under a minute.
I have been exploring AI and LLMs. I built my own AI chat bot using Python [1], and then [2] AI SDK from Vercel and OpenAI compatible API endpoints. And eventually build a product around it.
1. VT.ai https://github.com/vinhnx/VT.ai Python
2. VT Chat https://vtchat.io.vn: my own product
Yes I do that too. The important bit is the model. Rest is almost trivial. I had posted a Show HN here about the script I've been using which is open source now ( https://news.ycombinator.com/item?id=44674856 ).
With a bit of help from ChatGPT etc., it was trivial to make, and I use it everyday now. I may add DDG and github search to it soon too.
this is not coder this help typing instructions. Coding is different. For example look at my repository and tell me how refactorizing it, write a new function etc. In my opinion You must change name.
Could you plz link to your repo? would love to look at it.
> this is not coder this help typing instructions.
'Coding' technically is just that. If you mean engineering, yes sure, I agree. Nothing right now automates engineering. Maybe some day.
Or you could use: https://github.com/open-webui/open-webui
Either directly or use it as a base for your own bespoke experience.
Yeah, I have one which lets me read a pdf and chat side by side, one which is integrated into my rss feed, one with insanely aggressive memory features (experimental) etc etc :)
[flagged]
> Tell me you're not in charge of young kids without telling me you're not in charge of young kids
Please avoid internet tropes on HN.
https://news.ycombinator.com/newsguidelines.html
> I don't know if parenting hits the "developer-tinkerer class" harder than others, but damn.
I sort of suspect so? Devs of parenting age trend towards being neurospicy, and dev work requires sustained attention with huge penalties for interruptions.
I have a 1yo too, and I could do it. I used the other tools to make one which I liked.
> Tell me you're not in charge of young kids
Yeah, my wife would murder me as our kids yelled at me for various things