Comment by Melatonic

The new Nvidia developer workstations (believe they are much cheaper than full DGX systems) are definitely interesting.

I have a desktop with a Titan XP (somewhat similar to your Titan X). If you look up LLM performance however these older GPUs (even with enough VRAM) do quite poorly. They still hold up great for gaming and many other GPU hungry tasks though.

Personally I think a really cool setup would be something like a modern MacBook Pro with a ton of RAM and high core CPU that could be plugged into an external GPU enclosure when needed. Depending on LLM needs you could be upgrading the external GPU and still use the power efficient laptop on the go.