Comment by ghostpepper

This might not fit your use case but what I do is:

ssh -L 5901:localhost:5901 username@hypervisor

on the hypervisor, start Qemu with -vnc :1

Then open a local VNC client like RealVNC and connect to localhost:1