Comment by driftnet

Did you have to get agreements from the employers or their platforms to permit crawling these? Many companies forbid this in legal terms on their sites, or through robots.txt or Cloudflare challenges, etc.