And it's running as a single process on a single server without a database storing everything on the file system. That it's doing the traffic it is I find quite impressive.
You know I'd love to see a writeup of the issues and challenges you've faced with this persistence strategy as the site grew. You know, more details of what you decided to lazy load, why, and how, and the impact it had.
Technically speaking, I find hacker news persistent strategy one of the most interesting things about the implementation.
I use a similar strategy for my blog and just playing with larger datasets I've certainly run into hard limits on what seems to be acceptable.
PLT Scheme is not "interpreting" code. More than that, Arc
adds a bunch of huge overheads that could make things
substantially faster. I had some patches lying around that
made things around 4-5 times faster (including the news
server).
And it's running as a single process on a single server without a database storing everything on the file system. That it's doing the traffic it is I find quite impressive.
In 2 GB of memory.
You know I'd love to see a writeup of the issues and challenges you've faced with this persistence strategy as the site grew. You know, more details of what you decided to lazy load, why, and how, and the impact it had.
Technically speaking, I find hacker news persistent strategy one of the most interesting things about the implementation.
I use a similar strategy for my blog and just playing with larger datasets I've certainly run into hard limits on what seems to be acceptable.
Upstream. Both ways. In the snow.
Extrapolating from the memory-growth graph, how much time would a 16GB ram machine buy you?
2 replies →
Are there any articles on the "HN storing everything on the file system"?
I am quite interested in the architecture, because I found this approach nice for some sites I was building. They were not very large though.
If you're keen, you can get the source code and take a look: http://www.arclanguage.com/install
File system stores aren't that uncommon (aside from the VSAM days, even in RDBMS times+) - it's a common approach for Wiki implementations too.
1 reply →
> without a database
Why?
I can understand not using a database if this was improving the performance.
PLT Scheme is not "interpreting" code. More than that, Arc adds a bunch of huge overheads that could make things substantially faster. I had some patches lying around that made things around 4-5 times faster (including the news server).
but it's calling all those ar_funcall2 or whatever ... not that much indirection really.