← Back to context

Comment by leandot

10 years ago

Hacker News Books is a service that aggregates all links to books on Amazon, Safaribooks and O’Reilly found in comments on Hacker News. It does that on a weekly basis, calculates a rank based on how often each book is mentioned and the karma of the users. So books mentioned several times by different people, having high karma will make it to the top. I’ve processed about two years worth of comments (you can also see the whole yearly list, which is pretty long - up to 1000 books). I was expecting to see way more tech books but in fact the topics are really diverse like startup, management, parenting, mindfulness, etc. especially when the links don’t come from a long discussion about functional programming for example.

I’ve added a newsletter in case people want to keep up-to-date and I plan to maintain the service as I’ve found some unique books while I was coding the website. There is also search that searches only the submitted books, so this is another good way to browse the collections. Currently there is a newsletter popup, which may be annoying to some users, please click away if that is the case. I will rework it to be less intrusive.

Any recommendations and feedback are welcome. Disclaimer: For amazon links there are referrals, the other links don't have those.

Here are the first few things that came to my mind:

- I want this & will use it, it's a great idea!

- I didn't understand the rankings based on visiting the site, I assumed it was number of mentions, but so far after some browsing, I've only seen a single comment listed under any book. Is karma used only as a tie breaker, or can a high karma with low mentions rise above a book with high mentions?

- I'd love to see a top 10 monthly or yearly. Weekly is just so much volume. And it looks like weekly lists usually top out with a single mention? I want to see which books get many mentions, whatever time window that takes. Also I can't read a book a week, so I don't shop for books weekly. This means I'm afraid with a weekly list I'd probably miss all the good stuff.

- The signup popup came up too quickly. I see other people complaining about it and saying remove it. But I would probably have signed up if I understood what I was getting. Seeing it before I even have a chance to see the value or understand who and what this is made me dismiss it immediately. But I'd gladly give my email address to get a monthly email with a top 10 list, and speaking personally it'd help me to have a sense for whether this is strictly a side project, or you'll be doing some marketing. The aggressive popup w/ little info just makes it feel like I'm getting trapped into something and I try to escape, when your intent may have been 100% to generously give people a no-nag opt-in reminder.

  • Thanks for the heads up!

    - The rankings use karma and number of mentions, which for a week basically bring books by top karma users to the top. The actual formula is:

      book_entry['rank'] = (avg_karma_count * avg_karma + book_entry['karma'] * book_entry['karma_count']) / (book_entry['karma_count'] + avg_karma_count)
    

    - I plan to make Top 10 monthly or yearly, just wanted to see if people would like the idea at all. Seems like people like it. As a side remark I also did http://hnbuzz.com/ where you can filter, segment HN posts daily, weekly, monthly etc. It is not about books though.

    - Yep the signup seems too aggressive, it will get changed :) After I clicked it away the first time it didn't bother me anymore while coding the website so I got carried away and left it as is. But it is also a learning experience to see what people think about those.

    The project is totally side project, I actually do that often - build something I like to have and use a new tech to do it to learn. Drop me a mail if you want to know more.

    • The tech that actually made my life much easier was Docker. Using docker-compose to manage the tech stack (redis, elastic, apache, flask), docker-machine to abstract away where docker is running, docker-haproxy to be able to run multiple services on the same instance with virtual hosts, sane deployment with docker versioning, etc. etc.

  • > - I'd love to see a top 10 monthly or yearly. Weekly is just so much volume. And it looks like weekly lists usually top out with a single mention? I want to see which books get many mentions, whatever time window that takes. Also I can't read a book a week, so I don't shop for books weekly. This means I'm afraid with a weekly list I'd probably miss all the good stuff.

    Second this. Additionally, an "all time" list would be nice. Seems to be a great way to pick out the "timeless" books.

  • I really agree with your third point and I too would love to see different ranking options. A week to week basis is too much volume to weed out books I'm not interested in.

Nice project.

The modal dialog to subscribe to the mailing list is annoying; why is every site doing this now.

I too usually don't put a link to Amazon when mentioning a book, but maybe I should.

  • Because it works. General e-commerce practice. The value of an email address is incredibly high. It's a very strong signal of interest and allows a business to reach out to you with new product offerings, receive feedback etc. Without it, you're just a session on the site and not much else and doesn't lead to much actionable data.

    • I understand the value of an email address; I dispute the fact that it "works". Maybe it helps collect more email addresses than before, but the cost is bugging the hell out of every single visitor: is it worth it?

      1 reply →

I was considering learning Swift and getting into iOS development, but it appears I was mistaken as to the current fashionable trends in technology and startup culture.

I'll be picking up that Palm OS guide as soon as I can find a copy in print somewhere, thanks!

  • Clearly Palm OS is making a comeback!

    I think the idea of this is great, but I suspect it'll become far more useful given larger aggregate ranges. Last week, last month, last six months - etc. As it stands, many books (like the Palm OS one) may only get mentioned once by someone with a lot of karma - which leads to another issue, since the algorithm is known it's now open to abuse by the HN karma-rich.

I guess it's time for tptacek or some other high-karma user to write a book and start mentioning their book in the HN comments a lot. They would quickly rise to the top of your list and hopefully rake in some money ;)

Playing with the site search, I thought the site was broken because it did not return results for a book that I know I mentioned. That is, until I read this comment.

I will often mention books without posting an Amazon/etc. link figuring that anyone interested can bing with Duck Duck Google to find it. Other times, I will link to the author/publisher page.

Anyway, there's a natural language processing cum machine learning project in their somewhere. One interesting possibility it would open up is surfacing books in electronic form that pass across Hacker News as links to PDF's, eBooks, and HTML.

Good luck.

  • Yes, I think my tendency to always provide links has skewed the lists.

    At least 12 of the books in the top 100 for 2015 are from my posts.

    • Hmm...my tendencies to use my local public library and buy books used might be why I don't often link to Amazon.

  • Maybe that's why I didn't immediately recognize any of the books on the list as being mentioned regularly on Hacker News. There were some (but not many) that I recognized, but I don't remember them being mentioned.

Very cool! It seems that you weight karma a lot. In 2016 3rd book is about fractals (I'm sure its great) but probably only because its recommended by user with 110k karma ;) On the other-hand its a great idea to find less popular gems. Perhaps you can consider both options?

Not sure if this was already mentioned but IMO it would be really helpful if a taxonomy could be added to it, so it would be easier to find related books with a certain subject. (e.g. 'economy', 'data science' or 'distributed physics'). It would also open up the possibility of faceted search (e.g. all books on 'data science' with the 'python' programming language).

Other than that this already looks pretty useful :)

I closed the page as soon as the popup happened and reset my scroll index back to the top of the page. Bad UX there.

  • The page isn't that long so scrolling down again isn't that much of a hassle anyway. Have some tolerance for these projects instead of going into pitchfork mode.

    • I don't care about the scrolling, but showing a popup like that is pretty user-hostile, and it's hard not to want to return the favor.

Nice site! Personally, I'd like to have the option to view by category. Maybe you could just pull this from Amazon or manually curate your own topics.

  • Yes, on the todo list. Still have a day job to do, but it will come soon. Thanks for the feedback!

Can you elaborate on the ranking methodology eg is it:

    sum([u.karma for u in users_who_mentioned])

Or something more complicated?

  •   book_entry['rank'] = (avg_karma_count * avg_karma + book_entry['karma'] * book_entry['karma_count']) / (book_entry['karma_count'] + avg_karma_count)
    

    Where avg_karma_count and avg_karma are the weekly values.

> aggregates all links to books on Amazon, Safaribooks and O’Reilly found in comments on Hacker News.

So just commercial books then? Plenty of excellent books are linked directly from HN, books with their entire contents online.

would love (a) different filtering (not only week), (b) see some tags, (c) maybe pull amazon ratings, and (d) the count of mentions on HN

some (mostly technical) books are commonly mentioned in shorthand (eg. k&r and gof).

how are those accounted for?

Be up front here and add that the site is monetized with affiliate links.

Edit: you don't have to mention that in the site, but mention it in your description above.

  • Maybe you should the same in your HN profile.

    • As I mentioned elsewhere, I think it's fair. The title ought to be a ShowHN title and should include a mention that his site is monetized via affiliate links.

      This posting, as it was (before he added the disclaimer in his description of the site in this thread), was basically the same as posts to blogs that are not much more than thinly veiled sales pages.

      I don't post/advertise my profile page link, people visit it on their own without me asking them to [check it out] (just like I don't expect him to tell people on his site that they are affiliate links).

      Edit: It appears the mods updated the title to be a ShowHN. Thank you Mods.

  • Just did, thx.

    • Now in a month, do blog post on how much the affiliate links made for you, like patio11 user to do with bcc. I'm sure lots of folks would like to know.

      In fact track the monthly revenue for a year and do monthly updates.

      8 replies →

  • I don't have a problem with the affiliate links. If I buy one of these books, should all the money I spend go to Bezos & Co., or should a small portion go toward the person who took the time and effort to compile the weekly list of books?