← Back to context

Comment by martianvoid

10 hours ago

I just tried to play around with it on my RTX pro 6000 setup, it spends way too many tokens on overthinking stuff even if it’s able to catch the correct approach

Its speed is pretty good on the other hand with only 3B active parameters I am getting around 170 tkn/s on fp8

12 comments

martianvoid

Reply
gizajob  10 hours ago

> it spends way too many tokens on overthinking stuff

Yeah. It’s a German model.

  • sajithdilshan  9 hours ago

    This joke is either gonna get over analyzed by the Germans or gonna fly past straight over their heads

    • jijijijij  7 hours ago

      Nothing flies anywhere, we use superior high speed trains. I faxed a Humorgenehmigungsantragantrag to our Bundesunterhaltungsministerium analyst, immediately. Laugh now, but you are merely lucky the reply got delayed. As soon as the leaves on the rails are dealt with, you will get a formal response that has washed itself! Let us see who is laughing then. It is nobody!

      2 replies →

    • dudefeliciano  9 hours ago

      petition to make this thread the official german jokes thread for this post, it's kind of annoying how everyone feels the need to make a top level comment for their oh-so-great "germans suck" joke.