Comment by rcoveson

No, the worst part of a KVM switch is the video signal switching. You want as few switches in the video signal path as possible and the higher bandwidth you need them to be the more expensive they're going to be. You're already paying for the one in your monitor, so taking advantage of that is the right solution.

IME even high-end KVM switches experience occasional signal interruption or, more often, failure to synchronize at all on output switch.

Do what OP did.