I'm not sure if that's what you were going for, but I read it as if it were written by The Board in the game Control, and found myself with the appropriate level of existential dread.
Because there's been nothing to discuss since their announcement. Their API access immediately closed due to overwhelming demand and they didn't fab newer models than Llama3 yet.
Probably they will make bank selling to HFT for a while.
Funnily enough, pasting your comment straight into Jimmy leads to a... Funnily suboptimal answer that does not answer the question.
As someone else already contributed, this is driven by a Canadian startup taalas that basically makes chips that are llms, so everything is very fast but also, baked into the chip. Once this kind of stuff is a commodity in like 10 years, our world will be very, very different.
Sometimes I visualize a setup like this [0], based on 2D art by Simon Stålenhag. Someone has their home robot sitting on a desk connected to their old PC with thick cabling, dumping endless lines of each subsystem's <think> logs to diagnosis why it did something weird earlier in the day. Systems pushing 750+ tokens per second per subsystem might even be considered on the slow side for realtime tasks by then.
Hopefully like this (but smarter): https://chatjimmy.ai/
This is genuinely confusing to my senses. The future is going to be so strange/neat/me unemployed.
> strange/neat/me unemployed
I'm not sure if that's what you were going for, but I read it as if it were written by The Board in the game Control, and found myself with the appropriate level of existential dread.
2 replies →
The future is totally illegible to me. I love these AI models, but I feel like I'm going to be jobless within 10 years.
Anomie is at an all time high right now.
1 reply →
Yeah. It keeps catching me off guard that it answered me already.
Why is the insane speed of 13KTPS of this site is not more on the the top of the AI conversations?
Because there's been nothing to discuss since their announcement. Their API access immediately closed due to overwhelming demand and they didn't fab newer models than Llama3 yet.
Probably they will make bank selling to HFT for a while.
Because I just tested it and it took 3-4 clarifications before it actually gave a correct response vs gemini/google search. It's not great, but good.
I'd rather wait 3x as long.
It's pretty well known by now.
I asked it for a block of C++ code and it hit 14,189 tok/s. I assume it cached someone else's session?
1 reply →
Wow.. what?! How is this so fast?! Where can I read more?
Funnily enough, pasting your comment straight into Jimmy leads to a... Funnily suboptimal answer that does not answer the question.
As someone else already contributed, this is driven by a Canadian startup taalas that basically makes chips that are llms, so everything is very fast but also, baked into the chip. Once this kind of stuff is a commodity in like 10 years, our world will be very, very different.
10 replies →
https://taalas.com/
Taalas https://news.ycombinator.com/item?id=47103661
This caused me to have some sense what blistering fast AI actually is. What it means for the future is a question that remains.
Damn that is crazy.
This is the reaction every time it's posted, and deservedly so.
Not opening here... HN killed?
What
How?
Which model is behind it?
It’s pure silicon. Llama3.
1 reply →
hugged to death?
[dead]
I started with a 2400baud modem, I've seen how this goes
Sometimes I visualize a setup like this [0], based on 2D art by Simon Stålenhag. Someone has their home robot sitting on a desk connected to their old PC with thick cabling, dumping endless lines of each subsystem's <think> logs to diagnosis why it did something weird earlier in the day. Systems pushing 750+ tokens per second per subsystem might even be considered on the slow side for realtime tasks by then.
[0] https://www.therookies.co/entries/39513
Probably not. Everyone will still need a lot of reasoning tokens and tool calls. Running the tests for every round is tiring but must be done.
Imagine a Beowulf cluster of these…
That's a name I haven't heard in a while.
First post?
3 replies →
I always think of Furbies because of that geocities (memories!) site.
Probably will not be looking at text like this in a few years.
probably something like this https://sb0xw.csb.app/