[elephant-devel] QDBM Support

[Jason Anderson]

I don't claim to be an expert and I don't exactly remember the details
but historically the linux/*bsd filesystems didn't like it when you
had tens of thousands or more files in a single directory... using a
deep directory structure such as /c/d/f/cdf383d3.dat helped alleviate
the problem somewhat but I think there was still an issue with the
amount of memory used just caching all the inodes and such and extreme
slowness trying to delete many small files

the newer filesystems may fare better but they didn't exist back in
those days that I was exploring this sort of thing


On Feb 13, 2008 2:41 PM, Henrik Hjelte <henrik at evahjelte.com> wrote:
> On using the filesystem for storage. I once made an experimental
> backend for rucksack that used files (one per object). I tried several
> filesystems including ReiserFS  (which uses B+trees), but the
> performance was not good. So, I think it is no accident that the
> dirstorage page does not mention performance anywhere on the features,
> except fast startup and shutdown.
>
> /Henrik
>
> _______________________________________________
> elephant-devel site list
> elephant-devel at common-lisp.net
> http://common-lisp.net/mailman/listinfo/elephant-devel
>