Comment by primax

1 day ago

I'm building a scraper in Golang based on Colly to do two things:

* Automatically train the scraper on the structure of the page to acquire the data you want, and

* Clean and structure the data into a format suitable to go into a relational database

I got sick of doing all that manually for some pricing data I wanted to monitor on some suppliers sites, and I've always wanted to contribute more to open source and give back.