Comment by detaro

You can only vouch once something has become flagged, but then it works against the flags. (and if only a few users have flagged a post, it is likely to become unflagged by that)