Commits · 48ecbe515a88c85e80b7e0caa1b197d04903112c · Kirill Smelkov / neo

10 Aug, 2009 19 commits

Avoid partition table log crash the application if node manager and · 48ecbe51

Grégory Wisniewski authored Aug 10, 2009

partition table contents are not consistent.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1268 71dcc9de-d417-0410-9af5-da40c76e7ee4

48ecbe51

More checks on functionals tests for storage and cluster part. Cluster tests · 88fd3dd4

Grégory Wisniewski authored Aug 10, 2009

reuse methods defined in NEOFunctionalTest class.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1267 71dcc9de-d417-0410-9af5-da40c76e7ee4

88fd3dd4

Add a timeout on NEOCluster.start(). · aa8c2628

Grégory Wisniewski authored Aug 10, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1266 71dcc9de-d417-0410-9af5-da40c76e7ee4

aa8c2628

(Re-) disable by default SQL queries logging. · 6e7ce189

Grégory Wisniewski authored Aug 10, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1265 71dcc9de-d417-0410-9af5-da40c76e7ee4

6e7ce189

Fix partition table log method, don't include unused nodes. · 8793367b
Grégory Wisniewski authored Aug 10, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1264 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
8793367b
Fix test named 'testDropNodeThenRestartCluster', the bug itself is fixed with · fc813543
Grégory Wisniewski authored Aug 10, 2009
```
commit #1261.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1263 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
fc813543

dump() and bin() handle None values. · e5a9eaa3

Grégory Wisniewski authored Aug 10, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1262 71dcc9de-d417-0410-9af5-da40c76e7ee4

e5a9eaa3

Erase database content when the node is asked to switch in DOWN_STATE. · c225ee37
Grégory Wisniewski authored Aug 10, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1261 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
c225ee37
Increase column size and change it's type to store UUIDs in hex format. · 7921bd2f
Grégory Wisniewski authored Aug 10, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1260 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
7921bd2f

Storage IDs (UUID, LOID, LPTID) in hex format to help read values stored in · 7fc94582

Grégory Wisniewski authored Aug 10, 2009

database, copy/paste from sql to command line and so on.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1259 71dcc9de-d417-0410-9af5-da40c76e7ee4

7fc94582

When adding pending nodes, notify them the last OID so they can write it in · 40f18533
Grégory Wisniewski authored Aug 10, 2009
```
their database.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1258 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
40f18533

Add a test to check that a dropped node is weel removed from the storage nodes partition · 01c63c90

Grégory Wisniewski authored Aug 10, 2009

table. This test fail for now, I'm working on a fix.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1257 71dcc9de-d417-0410-9af5-da40c76e7ee4

01c63c90

Document neo.conf. · 523e0a0a

Vincent Pelletier authored Aug 10, 2009

Extend README to cover installation process more.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1256 71dcc9de-d417-0410-9af5-da40c76e7ee4

523e0a0a

Make connector.getConnectorHandler accept None values (returns the default connector). · 0474ba5b

Vincent Pelletier authored Aug 10, 2009

Make "connector" parameter of client's Sotrage and Application classes optional.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1255 71dcc9de-d417-0410-9af5-da40c76e7ee4

0474ba5b

Add a default value for --address parameter. · bd9aaa8f

Vincent Pelletier authored Aug 10, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1254 71dcc9de-d417-0410-9af5-da40c76e7ee4

bd9aaa8f

Remove a duplicate import. · 8920b917

Vincent Pelletier authored Aug 10, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1253 71dcc9de-d417-0410-9af5-da40c76e7ee4

8920b917

Replace neoctl --ip & --port parameters with a single --address. · 6d29da49
Vincent Pelletier authored Aug 10, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1252 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
6d29da49

Fix mime type on mail body. · 92786b97

Grégory Wisniewski authored Aug 10, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1251 71dcc9de-d417-0410-9af5-da40c76e7ee4

92786b97

Test runner generate the global temporary directory and report import errors. · 724a9948
Grégory Wisniewski authored Aug 10, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1250 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
724a9948

07 Aug, 2009 13 commits

Add a debug_lock parameter to custom locking class, allowing to turn locks... · 3410bd1b

Vincent Pelletier authored Aug 07, 2009

Add a debug_lock parameter to custom locking class, allowing to turn locks into debugging locks. Thos locks will complain (in a way similar to deadlocks) when acquired twice without being released. This makes it easier to assert execution flow when tracking down a bug.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1249 71dcc9de-d417-0410-9af5-da40c76e7ee4

3410bd1b

Importation test need the temp directory, use the good one. · e4b8fd4b
Grégory Wisniewski authored Aug 07, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1248 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
e4b8fd4b

ZODB test instanciate a neo cluster for each test to use a different temporary · 1887c5d7

Grégory Wisniewski authored Aug 07, 2009

directory. Do the same for the testStartWithManyPartitions and fix an unused
parameter on StorageTests.__setup().

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1247 71dcc9de-d417-0410-9af5-da40c76e7ee4

1887c5d7

Only one temporary directory is used for the test runner, each test method have · 775fcbb1

Grégory Wisniewski authored Aug 07, 2009

it's own directory to easily find related log files. The NeoFunctionalTest class
is added to provide the getTempDirectory() that return the path for the current
test method. Master functional test case now have the neo attribute, all test
cases inherit from NeoFunctionalTest.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1246 71dcc9de-d417-0410-9af5-da40c76e7ee4

775fcbb1

Add a test which just starts a cluster with more than 1000 partition (to test... · 258b8410

Vincent Pelletier authored Aug 07, 2009

Add a test which just starts a cluster with more than 1000 partition (to test partition packet splitting).


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1245 71dcc9de-d417-0410-9af5-da40c76e7ee4

258b8410

Another test for storage, check a node after it replicates data from another that · cb6c4be4
Grégory Wisniewski authored Aug 07, 2009
```
will shutdown.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1244 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
cb6c4be4
Never use a mutable type as named parameters default value. · 0204589b
Vincent Pelletier authored Aug 07, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1243 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
0204589b
Suffix cluster state definitions with '_CLUSTER_STATE' · 87b0405e
Grégory Wisniewski authored Aug 07, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1242 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
87b0405e

Fix implementation of setNodeState in master administration handler, it's now · a6d13d0e

Grégory Wisniewski authored Aug 07, 2009

allowed to set a disconnected node to DOWN state and drop it from the partition
table. A global review of node state alteration by the admin node is required to
ensure all and no less-or-more is allowed here. Add a TODO entry about that.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1240 71dcc9de-d417-0410-9af5-da40c76e7ee4

a6d13d0e

Grégory Wisniewski authored Aug 07, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1239 71dcc9de-d417-0410-9af5-da40c76e7ee4

8971228c

Add two test for storage side about partition table changes. The second fails · a4e31427

Grégory Wisniewski authored Aug 07, 2009

due to a master's administration handler bug.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1238 71dcc9de-d417-0410-9af5-da40c76e7ee4

a4e31427

The protocolError packet is an answer, not a notification, fix this and use an · 366e228a

Grégory Wisniewski authored Aug 07, 2009

exception to let the base handler send the packet.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1237 71dcc9de-d417-0410-9af5-da40c76e7ee4

366e228a

Node state suffix is '_STATE', not '_NODE_STATE', yes this is not consistent · 2208c05b
Grégory Wisniewski authored Aug 07, 2009
```
with other enums... 


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1236 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
2208c05b

06 Aug, 2009 8 commits

- expectCondition define default values for timeout and delay · baf9c7fd

Grégory Wisniewski authored Aug 06, 2009

- replication check first if all storage are up
- add a test to check that nodes with conflicting UUIDs are rejected.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1235 71dcc9de-d417-0410-9af5-da40c76e7ee4

baf9c7fd

Master keep the UUID supplied by storage nodes considered as pending. This is no · 47265fb3

Grégory Wisniewski authored Aug 06, 2009

more an issue with non-empty nodes since commit #1228.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1234 71dcc9de-d417-0410-9af5-da40c76e7ee4

47265fb3

Move sql connection establishment to NEOCluster class, as it requires the... · a6cde7db

Vincent Pelletier authored Aug 06, 2009

Move sql connection establishment to NEOCluster class, as it requires the knowledge of SQL login & password.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1233 71dcc9de-d417-0410-9af5-da40c76e7ee4

a6cde7db

Fix a typo. · d1e69aa9

Vincent Pelletier authored Aug 06, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1232 71dcc9de-d417-0410-9af5-da40c76e7ee4

d1e69aa9

Don't be nice to test: it's beter to make them fail early rather than adapt to bogus parameters. · 8b6cad8c
Vincent Pelletier authored Aug 06, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1231 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
8b6cad8c

Do not overwrite partition_number with a list. · cdf18773

Vincent Pelletier authored Aug 06, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1230 71dcc9de-d417-0410-9af5-da40c76e7ee4

cdf18773

When changing a node state, broadcast those changes after the partition table · 31d25515

Grégory Wisniewski authored Aug 06, 2009

changes because if the node have to be dropped (set in DOWN state), the
partition table update will contains it's UUID after it was removed from the
storages partition table and they will fails to find the related node.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1229 71dcc9de-d417-0410-9af5-da40c76e7ee4

31d25515

Implement dropPartition() on database manager to remove objects and transactions · 34ab5ea6

Grégory Wisniewski authored Aug 06, 2009

not related to partitions currently assigned to a storage node. This is required
because an old node can come back, get a new UUID, start replication and a
conflict on (oid, serial) with the cluster it is joining. As there is now check
on the object integrity, the object will not be replicated and a bad object will
be kept. So during storage initialization, after getting the full partition
table, a storage look if there is partitions unassigned to it and drop data for
those partitions.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@1228 71dcc9de-d417-0410-9af5-da40c76e7ee4

34ab5ea6