Login | Register
My pages Projects Community openCollabNet

Discussions > dev [DISABLED] > Re: [patch] revprop packing for fsfs

subversion
Discussion topic

Back to topic list

Re: [patch] revprop packing for fsfs

Author Daniel Shahaf <d dot s at daniel dot shahaf dot name>
Full name Daniel Shahaf <d dot s at daniel dot shahaf dot name>
Date 2009-05-01 03:14:44 PDT
Message Haven't looked at the patches, but this is to remind people of the option
to test packing features by building with

    -DPACK_AFTER_EVERY_COMMIT -DSVN_FS_FS_DEFAULT_​MAX_FILES_PER_DIR=%d​

or by passing

    FSFS_PACKING=yes FSFS_SHARDING=%d

to 'make check'. (I recommend the former.) Normally I set %d to a small
number, e.g., 1-4.

Daniel
    

Paul Querna wrote on Thu, 30 Apr 2009 at 23:55 -0700:
> On Wed, Apr 29, 2009 at 4:33 PM, Hyrum K. Wright
> <hyrum_wright@mai​l.utexas.edu> wrote:
> > On Apr 29, 2009, at 5:19 PM, Paul Querna wrote:
> >> I'm hacking up a patch using SQLite for storing the revprops right
> >> now, hopefully be able to post it in a few days when I get some more
> >> hacking time in on it.
> >
> > How about the attached?  I'm testing now, but it looks to give a ~90% space
> > improvement in revprop storage.  Still a few kinks, but if you've got some
> > time to test it, I'd appreciate it.
> >
> > -Hyrum
>
>
> Thanks Hyrum!
>
> Based off your patch, new patch is attached.
>
> Revprops use the normal sharded format, until a pack is run, at which
> point they are combined into a single sqlite database.
>
> Thoughts?
>
> Thanks,
>
> Paul
>

« Previous message in topic | 7 of 12 | Next message in topic »

Messages

Show all messages in topic

revprop packing for fsfs chipig Paul Querna 2009-04-27 18:12:52 PDT
     Re: revprop packing for fsfs peters Peter Samuelson 2009-04-28 14:49:41 PDT
         Re: revprop packing for fsfs Daniel Shahaf <d dot s at daniel dot shahaf dot name> Daniel Shahaf <d dot s at daniel dot shahaf dot name> 2009-04-28 23:58:45 PDT
             Re: revprop packing for fsfs chipig Paul Querna 2009-04-29 15:19:04 PDT
                 Re: revprop packing for fsfs hwright Hyrum K. Wright 2009-04-29 16:33:42 PDT
                     [patch] revprop packing for fsfs chipig Paul Querna 2009-04-30 23:55:32 PDT
                         Re: [patch] revprop packing for fsfs Daniel Shahaf <d dot s at daniel dot shahaf dot name> Daniel Shahaf <d dot s at daniel dot shahaf dot name> 2009-05-01 03:14:44 PDT
                         Re: [patch] revprop packing for fsfs chipig Paul Querna 2009-05-07 10:02:10 PDT
                             Re: [patch] revprop packing for fsfs cmpilato C. Michael Pilato 2009-05-07 10:09:02 PDT
                                 RE: Re: [patch] revprop packing for fsfs webpost at tigris dot org webpost at tigris dot org 2009-05-20 02:40:34 PDT
                                     Re: [patch] revprop packing for fsfs hwright Hyrum K. Wright 2009-05-21 12:05:55 PDT
                                         RE: Re: [patch] revprop packing for fsfs gbjbaanb Andy Bolstridge 2009-05-22 00:18:33 PDT
Messages per page: