Comment by rob_c

Last time I sat down with one of the groups modelling national food availability their model _needed_ a scratch fs capable of dealing with >1M 4kB files per folder. When asked why not to use a db they replied databases don't work well with objects larger than 1kB in size and this would introduce network latencies into their code. Needless to say I walked away from that glad that I couldn't help.