Skip to content

N
neoppod
Switch branch/tag
  1. 06 Jan, 2012 1 commit
  3. 20 Dec, 2011 1 commit
  5. 26 Oct, 2011 2 commits
  7. 25 Oct, 2011 1 commit
  9. 17 Oct, 2011 1 commit
  11. 13 Oct, 2011 1 commit
  13. 11 Oct, 2011 3 commits
    • Julien Muchembled's avatar
      Fix protocol and DB schema so that storages can handle transactions of any size · d5c469be
      Julien Muchembled authored 
      - Change protocol to use SHA1 for all checksums:
  - Use SHA1 instead of CRC32 for data checksums.
  - Use SHA1 instead of MD5 for replication.

- Change DatabaseManager API so that backends can store raw data separately from
  object metadata:
  - When processing AskStoreObject, call the backend to store the data
    immediately, instead of keeping it in RAM or in the temporary object table.
    Data is then referenced only by its checksum.
    Without such change, the storage could fail to store the transaction due to
    lack of RAM, or it could make tpc_finish step very slow.
  - Backends have to store data in a separate space, and remove entries as soon
    as they get unreferenced. So they must have an index of checksums in object
    metadata space. A new '_uncommitted_data' backend attribute keeps references
    of uncommitted data.
  - New methods: _pruneData, _storeData, storeData, unlockData
  - MySQL: change vertical partitioning of 'obj' by having data in a separate
    'data' table instead of using a shortened 'obj_short' table.
  - BTree: data is moved from '_obj' to a new '_data' btree.

- Undo is optimized so that backpointers are not required anymore to fetch data:
  - The checksum of an object is None only when creation is undone.
  - Removed DatabaseManager methods: _getObjectData, _getDataTIDFromData
  - DatabaseManager: move some code from _getDataTID to findUndoTID so that
    _getDataTID only has what's specific to backend.

- Removed because already covered by ZODB tests:
  - neo.tests.storage.testStorageDBTests.StorageDBTests.test__getDataTID
  - neo.tests.storage.testStorageDBTests.StorageDBTests.test__getDataTIDFromData
      d5c469be
    • Julien Muchembled's avatar
      Allow NEO to store empty values · d90c5b83
      Julien Muchembled authored 
      This changes how NEO stores undo information
and how it is transmitted on the network.
      d90c5b83
    • Julien Muchembled's avatar
      btree: fix missing u64 oid conversion in deleteTransaction · 03bf302a
      Julien Muchembled authored 
      Also clean up deleteObject.
      03bf302a
  15. 06 Oct, 2011 1 commit
  17. 03 Oct, 2011 1 commit
  19. 30 Sep, 2011 1 commit
  21. 29 Sep, 2011 4 commits
  23. 24 Sep, 2011 1 commit
    • Julien Muchembled's avatar
      tests: fix occasional deadlock when a threaded unit test ends · e96e8f0b
      Julien Muchembled authored 
      During 'NEOCluster.stop', there's often 1 'Serialized.background()' call too
many, and when it removed the last lock of the queue, another thread would hang
if was sleeping between 'q.put(lock)' and 'q.get().release()'.

An easy way to reproduce the bug was to add:
    if cls.pending is None:
        time.sleep(.01)
just before 'q.get().release()'
      e96e8f0b
  25. 16 Sep, 2011 2 commits
  27. 15 Sep, 2011 3 commits
  29. 14 Sep, 2011 2 commits
  31. 13 Sep, 2011 1 commit
  33. 09 Sep, 2011 1 commit
  35. 08 Sep, 2011 6 commits
  37. 07 Sep, 2011 4 commits
  39. 06 Sep, 2011 2 commits
  41. 05 Sep, 2011 1 commit
GitLab Nexedi Edition | About GitLab | About Nexedi | 沪ICP备2021021310号-2 | 沪ICP备2021021310号-7