Commits · 14d25043284467fd1bf6cc592e5d8d77dfabd475 · nexedi / neoppod

29 Apr, 2011 2 commits
- tests: fix file descriptor leak · 14d25043
  Julien Muchembled authored Apr 29, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2745 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  14d25043
- tests: fix boolean evaluation of Mock objects · 517fc5e6
  Julien Muchembled authored Apr 29, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2744 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  517fc5e6
28 Apr, 2011 8 commits

Split testRestartWithMissingStorage into 1 passing and 1 failing tests · c21ad524

Julien Muchembled authored Apr 28, 2011

testRestartWithMissingStorage was failing randomly depending on whether the
cluster was started before or after the storage initializing connection
with the master.
Change to NEOCluster.start allows to test both scenarios explicitely.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2743 71dcc9de-d417-0410-9af5-da40c76e7ee4

c21ad524

tests: slightly speed up cluster startup & expectXxx methods · dcace4ee
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2742 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
dcace4ee
tests: log started & killed processes · 3db30547
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2741 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
3db30547
Slightly reduce width of logs generated by packet logger · 8270d116
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2740 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
8270d116

tests: minor fixup to r2736 & r2738 · 4a50b1c3

Julien Muchembled authored Apr 28, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2739 71dcc9de-d417-0410-9af5-da40c76e7ee4

4a50b1c3

tests: output logs of parent process in temporary directory of current run · 5e9af25c
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2738 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
5e9af25c
Exceptions are not new-style classes in Python < 2.5 · 8a49145c
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2737 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
8a49145c
Fix storage exiting with non-zero status in testDropNodeThenRestartCluster · bb69f48b
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2736 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
bb69f48b

27 Apr, 2011 6 commits

storage: teach shutdown to close all connections · 15308c68
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2735 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
15308c68
storage: fix forward of parameter to DM in shutdown · d9bf64e1
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2734 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
d9bf64e1
replication: fix AttributeError when storage switches to another storage · bb146239
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2733 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
bb146239

connection: make close always call handler (connectionClosed or connectionFailed) · 4b6c1387

Julien Muchembled authored Apr 27, 2011

Main reason is that it's difficult to know in advance which side really closes
the connection. Network events can be chaotic and this could lead to many race
conditions.
Thus, handler can be used to update any database that is somewhat redundant
to the connection status, i.e. node status usually. Safely and less duplicated
code.

This change is motivated by recurrent random failures during election.
An example of race condition was that 2 fully connected master could close the
extra connection (the primary -> secondary one) at the same time.

In order to stabilize lower-level code and start with reliable election process,
code has also been simplified to not care about node states. All connections
without exception are closed at the end of the election and states are then
updated 1 by 1 by identification handler.
Note that during election, there may be 2 connection per node, which makes
difficult to update node states by connectionFailed/connectionClosed events.

timeoutExpired & peerBroken are dropped as they are unused for the moment.
A new API should be designed so that connectionClosed know the reason of the
close.
BROKEN state becomes unused.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2732 71dcc9de-d417-0410-9af5-da40c76e7ee4

4b6c1387

storage: do not log all store event during normal run · 35f0a5bf
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2731 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
35f0a5bf
tests: enable packet logger only when a NEO test is run · ab6e1806
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2730 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
ab6e1806

21 Apr, 2011 4 commits

Update tests against r2728 (added assertion in Connection.abort) · b265df3e
Julien Muchembled authored Apr 21, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2729 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
b265df3e

Do not try to send notifications on closed connections · f9b5cea4

Julien Muchembled authored Apr 21, 2011

Now we can assert that abort is not called when it shouldn't be.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2728 71dcc9de-d417-0410-9af5-da40c76e7ee4

f9b5cea4

Do not answer pings on aborted connections · 81cbbeeb
Julien Muchembled authored Apr 21, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2727 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
81cbbeeb

logs: fix packet names of responses · 25ca11ce

Julien Muchembled authored Apr 21, 2011

The contained the request name twice. Example:
  #0x00000000 AnswerPrimaryMasterPrimaryMaster  to  None (127.0.0.1:34804)

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2726 71dcc9de-d417-0410-9af5-da40c76e7ee4

25ca11ce

20 Apr, 2011 8 commits

tests: extend bdb/rpdb2 debuggers to help debugging a set of processes · 49962b18

Julien Muchembled authored Apr 20, 2011

This adds a dependency to 'psutil', which is required anyway to fix
NEOProcess.isAlive

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2725 71dcc9de-d417-0410-9af5-da40c76e7ee4

49962b18

debug: extract winpdb code from pdbHandler to a reusable function for tests · 11a323bd
Julien Muchembled authored Apr 20, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2724 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
11a323bd

tests: ignore NEO_TESTS_ADAPTER in tests requiring a SQL database · 7b54a6b3

Julien Muchembled authored Apr 20, 2011

Although some tests of testStorage and testPack don't need a SQL database,
this patch applies to the whole class for simplicity's sake.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2723 71dcc9de-d417-0410-9af5-da40c76e7ee4

7b54a6b3

election: fix a case where the primary has wrong state information about another master · e41dbfef
Julien Muchembled authored Apr 20, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2722 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
e41dbfef

tests: make sure NEOCluster.stop kills all children, even if one failed · 4836a4b4

Julien Muchembled authored Apr 20, 2011

This fixes possible suite freeze due to unreleased locks.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2721 71dcc9de-d417-0410-9af5-da40c76e7ee4

4836a4b4

master: make setNodeState return appropriate message when state is unchanged · 829f9b4c
Julien Muchembled authored Apr 20, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2720 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
829f9b4c
tests: implement default __str__ & __repr__ for Mock objects · 27c0b505
Julien Muchembled authored Apr 20, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2719 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
27c0b505
tests: prevent child from killing other children at exit · 13e86665
Julien Muchembled authored Apr 20, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2718 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
13e86665

13 Apr, 2011 2 commits
- tests: new environment variable to specify default adapter · d0c8b63b
  Julien Muchembled authored Apr 13, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2717 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  d0c8b63b
- Add URL of paper about Multi-Queue algorithm · e9477a54
  Julien Muchembled authored Apr 13, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2716 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  e9477a54
12 Apr, 2011 7 commits

client: give an example to adjust level of cached items according to their size · 44aa0d6d
Julien Muchembled authored Apr 12, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2715 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
44aa0d6d
client: fix _cache attribute of Storage · 4f2d91c4
Julien Muchembled authored Apr 12, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2714 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
4f2d91c4
Update tests against previous changes to client cache · c0b9f5b4
Julien Muchembled authored Apr 12, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2713 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
c0b9f5b4
client: remove duplicate 'snapshot_tid' parameter of Application.load · 2c17284f
Julien Muchembled authored Apr 12, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2712 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
2c17284f

Rewrite storage cache of client · edde1fe3

Julien Muchembled authored Apr 12, 2011

- Stop using a list of (in)validated tid (hence removal of RevisionIndex),
  because it can't work in all cases and would even cause memory leaks.
  For example, this bug could lead to ConflictError with a single client.
  Fixit it also requires that database backends always return the next serial.
- Several performance improvements. The most important one is when the latest
  version of an object is cached: it inherits the access counter of the
  previous one (for the same oid), which gets in turn its counter reset.
- Do not waste CPU evaluating the real size taken by an entry in memory.
  Just use 'len' on the value (which is always a pickle data, i.e. a string).

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2711 71dcc9de-d417-0410-9af5-da40c76e7ee4

edde1fe3

client: rename mq.py to cache.py before rewriting it · 240c94b3
Julien Muchembled authored Apr 12, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2710 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
240c94b3

Fix unit tests broken by r2703 · d5be36a3

Julien Muchembled authored Apr 12, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2709 71dcc9de-d417-0410-9af5-da40c76e7ee4

d5be36a3

07 Apr, 2011 3 commits
- tests: new ClusterPdb.sync method to place sync points · 41c4ce1f
  Julien Muchembled authored Apr 07, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2708 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  41c4ce1f
- master: simplify connectionLost code in ClientElectionHandler · 4621d1b8
  Julien Muchembled authored Apr 07, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2707 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  4621d1b8
- Small optimizations · 0be7e00c
  Julien Muchembled authored Apr 07, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2706 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  0be7e00c