[rucksack-devel] rucksack performance

[Cyrus Harmon]

Following up on my post from yesterday, even when I can coerce the  
"lots of transactions" into working, at some point performance breaks  
down rather severely. Initially, creating a persistent object looks  
something like this:

("1" "1" "no rank" "" "8" "0" "1" "0" "0" "0" "0" "0" "	|")
Evaluation took:
   0.04 seconds of real time
   0.029151 seconds of user run time
   0.010584 seconds of system run time
   0 calls to %EVAL
   0 page faults and
   417,512 bytes consed.

after creating a couple objects, they start to look like this:

("1931" "1883" "species" "SS" "0" "1" "11" "1" "0" "1" "1" "0" "	|")
Evaluation took:
   0.466 seconds of real time
   0.313506 seconds of user run time
   0.138609 seconds of system run time
   0 calls to %EVAL
   0 page faults and
   3,126,640 bytes consed.

yes, along the way there is some fluctuation, as, I imagine, the  
indices and caches grow, etc... but we reach a threshold where it  
takes roughly .5 sec and 3M of consing for every object. Needless to  
say, this just kills performance and makes rucksack rather unusable  
for large numbers of persistent objects. I'm sure there's probably a  
better way to do this, but I'm not sure what it is. And it would be  
nice if this approach worked as well.

Thanks,

Cyrus