Comment by matheusmoreira

6 days ago

Please don't imply every "AI defender" is a bot.

LLMs are clearly world changing technology. I'm no fan of the big corporations but I'm very excited to see the models themselves develop. I'm looking forward to the day I can self host these things.

14 comments

matheusmoreira

Reply
reilly3000  6 days ago

You can? It’s pretty remarkable what you can do with Qwen 3.6 on decent hardware, and Gemma 12b on nearly anything. If you can’t own it, take something for a spin on vast.ai where you can get all kinds of machines on tap for ~$0.20/hour+

llama.cpp has gotten so good that you can really get optimized performance with a few flags or none at all, and serve any model on-demand. Spend $45 to have your own GLM 5.2 machine for an hour. If you can’t manage full utilization you’d get 33.2M tokens, retailing for $128.

It takes some smarts to use dumb models, but renting time for frontier tokens is easy math. Vast also lets you run on spot which is great for training or agents with harnesses that can accommodate uncertain model availability.

emsign  6 days ago

It's the metrics though. I've noticed that AI topics get hundreds of votes, that means either someone is trying to beat the algorithm to stay in the top news, or suddenly this place is filled with thousands of AI enthusiasts who ignore all the rest, non-AI topics. (Thousands because not everyone will upvote, so if only a fraction upvotes hundreds of upvotes should translate to thousands.)

The imbalance is what is off.

  • simianwords  6 days ago

    This kind of conspiratorial thinking is ridiculous.

    My life is affected for better or worse because of AI - I’m forced to use it at my day job as an R&D. It is perfectly rational and expected and preferable for AI to be the front news in a technology forum.

    You probably don’t like AI but that is completely different from being affected by it.

    • emsign  6 days ago

      I was talking about the metrics on HN you are talking about how AI improved you life (or didn't). Two different things in my opinion. I'm using AI myself btw. This isn't the point.

      7 replies →