Comment by NicoJuicy

4 years ago

I made a very similar product, but you're layout is much more polished.

Using it as personal kb too, i also crawl the top HN pages instead of mirroring it separately. I consider it another source of interesting links.

https://handlr.sapico.me/ Here is HN: http://handlr.sapico.me/Home/ByTag?Name=hn

Good luck, it's a difficult market for this type of product. I still think it's the perfect use-case, but people outside of HN/reddit? don't really "get it".

How old/big is you're dataset and how is your db handling it? I've got lots of data+tags and it tends to get a bit slower ( I've optimized it a bit already, but it still needs some work)

Note : dogfooding it

Ps. I think Gpt 2 for the tags would be decent enough + much cheaper.

Your app looks great! Re data: we just get the front page every few minutes from https://github.com/HackerNews/API The table is almost 10MB right now, so pretty small

  • What Algo are you using for tags? I'm using nested sets on ms sql fyi

    For data, there's a Cron endpoint. So it's just a matter of hitting it to import from external sources.

    In the case of hacker news, I'm importing an RSS endpoint. Which is probably only 1 of the 100? Feeds I'm importing over the last 4 years.

    • Cool, thanks for sharing.

      I'm not using any hierarchy in the tags. It is just a many-to-many relationship between stories and tags.