Comment by embedding-shape

Be courteous, kind, don't accept invites, tell them you're not interested if they're making unwanted advances, and treat them as humans. If they seem receptive and able to handle constructive feedback, tell them what sticks out to you, otherwise just ignore it and move on.

Basically the same way you handle the exact same situation outside of organizing meetups, but maybe a bit extra on the friendly-and-try-to-not-traumatize-people-who-might-be-trying side of things.