From phil at dataxware.co.za Mon May 30 09:32:20 2011 From: phil at dataxware.co.za (Phil) Date: Mon, 30 May 2011 11:32:20 +0200 Subject: [rucksack-devel] Enhancements - Code? Message-ID: <1306747942.13921.5.camel@mohadib> Hi Has any of the code discussed in the February thread "Enhancements to Rucksack" been posted some where yet? I would seriously like to use rucksack in a commercial project and have some resources to throw at enhancements. Regards Phil -- This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. From alemmens at xs4all.nl Mon May 30 10:44:33 2011 From: alemmens at xs4all.nl (Arthur Lemmens) Date: Mon, 30 May 2011 12:44:33 +0200 Subject: [rucksack-devel] Enhancements - Code? In-Reply-To: <1306747942.13921.5.camel@mohadib> References: <1306747942.13921.5.camel@mohadib> Message-ID: Phil wrote: > Has any of the code discussed in the February thread "Enhancements to > Rucksack" been posted some where yet? I don't think so. > I would seriously like to use rucksack in a commercial project and have > some resources to throw at enhancements. In principle I'm available for consulting work. Do you have a list of enhancements that you're thinking of for your project? If you're mostly interested in the enhancements that Jochen described, maybe you should talk with him first. Arthur From js at crispylogics.com Mon May 30 11:19:06 2011 From: js at crispylogics.com (Jochen Schmidt) Date: Mon, 30 May 2011 13:19:06 +0200 Subject: [rucksack-devel] Enhancements - Code? In-Reply-To: References: <1306747942.13921.5.camel@mohadib> Message-ID: <7C57C0CA-685F-4543-BD59-AB27A9F08F29@crispylogics.com> Am 30.05.2011 um 12:44 schrieb Arthur Lemmens: > Phil wrote: > >> Has any of the code discussed in the February thread "Enhancements to >> Rucksack" been posted some where yet? > > I don't think so. I remember that I promised to polish up my enhancements and publish them, but didn't do so yet. This is actually only a matter of time, or just the lack of it. > >> I would seriously like to use rucksack in a commercial project and have >> some resources to throw at enhancements. > > In principle I'm available for consulting work. Do you have a list of > enhancements that you're thinking of for your project? If you're mostly > interested in the enhancements that Jochen described, maybe you should > talk with him first. I've taken a quick glance on it and there are mainly 4 parts to it: 1) Some little fixes 2) An implementation of "shared reader transactions" This needs an implementation of shared reader locks. I've one which wraps the LW ones and uses bordeaux thread condition variables for others. I can provide it too. Since ClozureCL also supports read/write-locks there could be a special version for it. 3) Initialization of transient slots In my use case I wanted objects which get loaded from a rucksack to automatically reinitialize their transient slots. This is done by calling shared-initialize on the subset of transient slots after loading the object. This fills the transient slots from their init-forms or allows to do arbitrary "reinitialization" by overriding shared-initialize. 4) "register-rucksack-class": a mean to fixup the schema of a rucksack to support a particular rucksack class. I've to strip out some code from it which is from some of my projects or tests and which would not be useful to others. The changes are not big - just a few lines of codes here and there. As I already said, I'm still quite busy on customer projects, but really hope to get to it asap (hopefully "this week"). ciao, Jochen > > Arthur > > _______________________________________________ > rucksack-devel mailing list > rucksack-devel at common-lisp.net > http://lists.common-lisp.net/cgi-bin/mailman/listinfo/rucksack-devel -- Jochen Schmidt CRISPYLOGICS Cross Media Solutions Uhlandstr. 9, 90408 N?rnberg Telefon +49 (0)911 517 999 82 Telefax +49 (0)911 517 999 83 mailto:info at crispylogics.com http://www.crispylogics.com From haragx at gmail.com Mon May 30 14:13:07 2011 From: haragx at gmail.com (Phil Marneweck) Date: Mon, 30 May 2011 16:13:07 +0200 Subject: [rucksack-devel] Enhancements - Code? In-Reply-To: <7C57C0CA-685F-4543-BD59-AB27A9F08F29@crispylogics.com> References: <1306747942.13921.5.camel@mohadib> <7C57C0CA-685F-4543-BD59-AB27A9F08F29@crispylogics.com> Message-ID: <1306764792.15399.12.camel@mohadib> Ok here is a suggested way forward: - We need to decide on a repository to base all new development on. - Into this repository Jochen can dump his cleaned up code - Once we have this code to work from we need to have a discussion in this forum to see where we need to go. - Once we have a set of agreed goals I can allocate work to some of my devs and talk to Athur about consulting. >From my point of view I need to get moving on this ASAP so Jochen if you need help cleaning up the code, please let me know and I can see what we can do to assist. Any comments? From alemmens at xs4all.nl Tue May 31 17:05:49 2011 From: alemmens at xs4all.nl (Arthur Lemmens) Date: Tue, 31 May 2011 19:05:49 +0200 Subject: [rucksack-devel] Enhancements - Code? In-Reply-To: <1306764792.15399.12.camel@mohadib> References: <1306747942.13921.5.camel@mohadib> <7C57C0CA-685F-4543-BD59-AB27A9F08F29@crispylogics.com> <1306764792.15399.12.camel@mohadib> Message-ID: Phil Marneweck wrote: > - We need to decide on a repository to base all new development on. I don't have strong opinions about this. I'm fine with using the current CVS repository on c.l.net and giving you and Jochen admin rights to it. But if you want to set up another repository somewhere, that's fine with me too. You decide. > - Once we have this code to work from we need to have a discussion in > this forum to see where we need to go. If I would base a commercial project on Rucksack, here are some of the things I would take a good look at: - the working of the cache Make sure that it functions well with a limited amount of memory even if there's much data. - the heap system I now think it would be much more efficient and reliable to use a simple bump-the-allocation-pointer scheme and to not even try to reclaim unused disk space. A year or two ago I have done some experiments in that direction that look promising. - a heap-indepent data file format I would want to have a way of saving/loading all data to/from a simple file format (probably based on s-expressions) that's independent of the exact structure of the heap. This is useful for backup purposes and for migrating data between different versions of Rucksack. - live backups Make sure that it's possible to make a working copy of all data without halting the system. - multiple transactions in parallel Something along the lines of Jochen's description sounds like a good start. - extensible slot and class options In real-world database applications (based on a simple precursor of Rucksack that always keeps everything in memory and simply logs all changes), I've found that I often want to extend the slot and class options that are provided by Rucksack. > - Once we have a set of agreed goals I can allocate work to some of my > devs and talk to Athur about consulting. > > From my point of view I need to get moving on this ASAP so Jochen if you > need help cleaning up the code, please let me know and I can see what we > can do to assist. > > Any comments? > > > > > _______________________________________________ > rucksack-devel mailing list > rucksack-devel at common-lisp.net > http://lists.common-lisp.net/cgi-bin/mailman/listinfo/rucksack-devel From alemmens at xs4all.nl Tue May 31 17:09:58 2011 From: alemmens at xs4all.nl (Arthur Lemmens) Date: Tue, 31 May 2011 19:09:58 +0200 Subject: [rucksack-devel] Enhancements - Code? In-Reply-To: References: <1306747942.13921.5.camel@mohadib> <7C57C0CA-685F-4543-BD59-AB27A9F08F29@crispylogics.com> <1306764792.15399.12.camel@mohadib> Message-ID: On Tue, 31 May 2011 19:05:49 +0200, Arthur Lemmens wrote: [lots of stuff] Sorry, I accidentally clicked on Send without cleaning up my reply. I was going to add a bit more about class and slot options, but that will have to wait until tomorrow or so. Arthur