• Levin Zimmermann's avatar
    bigfile/zodb: Add ZBlk format option 'auto' (heuristic) · d6628427
    Levin Zimmermann authored and Kirill Smelkov's avatar Kirill Smelkov committed
    There are two formats to save data with a ZBigFile: ZBlk0 and ZBlk1.
    They differ by adjusting the ratio between access-time and growing
    disk-space, where ZBlk1 is better regarding to disk space, while ZBlk0
    has a better access-time. Wendelin.core users may not always know yet or
    care which format fits better for their data. In this case it may be
    easier for users to just let the program automatically select the ZBlk
    format. With this patch and the new 'auto' (for heuristic) option of the
    'ZBlk' argument of ZBigFile, this is now possible. The 'auto' option isn't
    really a new ZBlk format in itself, but it just tries to automatically
    select the best ZBlk format option according to the characteristics
    of the changes that the user applies to the ZBigFile.
    
    In its current implementation, the heuristic tackles the use-case of
    large arrays with many small append-only changes. In this case 'auto' is
    smaller in space than ZBlk0, but faster to read than ZBlk1. ...
    d6628427