Comment by primax
1 day ago
I'm building a scraper in Golang based on Colly to do two things:
* Automatically train the scraper on the structure of the page to acquire the data you want, and
* Clean and structure the data into a format suitable to go into a relational database
I got sick of doing all that manually for some pricing data I wanted to monitor on some suppliers sites, and I've always wanted to contribute more to open source and give back.
No comments yet
Contribute on Hacker News ↗