← Back to context

Comment by ApolloFortyNine

9 hours ago

The model being tested is 18k as configured.

I didn't expect this to make the 5090 to look like a good deal.

5090 has 32GB VRAM.

It'd be silly to buy the 18k model to run a tiny model like Qwen 27B. You use models like GLM Flash and Qwen Next which won't fit on a single 5090.

  • Is it that silly? You could run multiple 27B models in parallel.

    • You actually don't need more RAM to batch multiple inference tasks of the same model.

      (Each task needs its own context, but the (e.g.) 27B of constant parameters isn't duplicated).

      1 reply →

  • can run multiple subagents of Qwen 27B though, right? Unless I am fundamentally misunderstanding how VRAM constraints work

    • You might be. Running another agent doesn't load a set of new weights. It creates a new KV cache for the agent and adds the prompts to the queue. Its just another inference turn.

      1 reply →