Comment by TeMPOraL
2 days ago
I think all the em-dashes came from scraping Wordpress blogs. Wordpress editor does "typography", then thus introduced em-dashes survive HTML to Markdown process used to scrap them, and end up in datasets.
EDIT: Also PDFs authored in MS Word.
No comments yet
Contribute on Hacker News ↗