Comment by warpech

> Can we do better?

I hope yes! Some people are interested in this field. I think, we would need more mor flexible, adaptive scrapers based on content not the HTML structure. This week alone, I had interactions about "AI assisted web scraping" with two people:

- https://news.ycombinator.com/item?id=33555426