Commits · 5203461fba31647a4f2830b6c68e9344c3085120 · nexedi / neoppod

20 Jul, 2009 5 commits

Fix address format in neoctl and admin node. · 5203461f

Grégory Wisniewski authored Jul 20, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@883 71dcc9de-d417-0410-9af5-da40c76e7ee4

5203461f

Store the partition table in the database when receiving answerPartitionTable · d5f7fb10

Grégory Wisniewski authored Jul 20, 2009

packet instead of checking its state.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@882 71dcc9de-d417-0410-9af5-da40c76e7ee4

d5f7fb10

Set the UUID on the connection to ensure good log message because UUID was · 92138046

Grégory Wisniewski authored Jul 20, 2009

missing on tracked packets.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@881 71dcc9de-d417-0410-9af5-da40c76e7ee4

92138046

Broadcast information about a node lost before do specific actions to ensure · c84b66ca

Grégory Wisniewski authored Jul 20, 2009

messages are sent, even if _nodeLost() method raise an exception (like an
OperationException).

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@880 71dcc9de-d417-0410-9af5-da40c76e7ee4

c84b66ca

Group test cases by python module in test runner. Add a column with the number · 11b77fc7
Grégory Wisniewski authored Jul 20, 2009
```
of successful tests.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@879 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
11b77fc7

17 Jul, 2009 8 commits

Fix some tests. · 9d430427

Grégory Wisniewski authored Jul 17, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@878 71dcc9de-d417-0410-9af5-da40c76e7ee4

9d430427

Fix super class name. · 625e319f

Grégory Wisniewski authored Jul 17, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@877 71dcc9de-d417-0410-9af5-da40c76e7ee4

625e319f

Disable the commit #723 with comment because this cause many non-critical errors · 4ac7e1f4
Grégory Wisniewski authored Jul 17, 2009
```
from the database adapter.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@876 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
4ac7e1f4

Outdate partition table after drop a storage node to set associated cell in · 4766e070

Grégory Wisniewski authored Jul 17, 2009

outdated state and so, trigger the replication process when the node come back.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@875 71dcc9de-d417-0410-9af5-da40c76e7ee4

4766e070

Replace the ip_address and port bu a tuple and set it to None instead of · 982abf85

Grégory Wisniewski authored Jul 17, 2009

('0.0.0.0', 0) default value. This fix a client reject since they are no more
referenced by the default address in the node manager.
This affect protocol message *NodeIdentification, *PrimaryMaster, *NodeList 
and notifyNodeInformation 


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@874 71dcc9de-d417-0410-9af5-da40c76e7ee4

982abf85

When starting the cluster from scratch, reset IDs generators, was implicitly · 93c89093

Grégory Wisniewski authored Jul 17, 2009

done with INVALID_*ID values, but fails with None.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@873 71dcc9de-d417-0410-9af5-da40c76e7ee4

93c89093

Do not use INVALID_OID/INVALID_TID/INVALID_PTID out of protocol.py module, · 6df1aa10

Grégory Wisniewski authored Jul 17, 2009

handle special cases with None values, protocol handle the few cases where a TID
can be invalid to indicate there is no value.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@872 71dcc9de-d417-0410-9af5-da40c76e7ee4

6df1aa10

Replace INVALID_UUID values with None out of protocol.py module to unify · ad0d2ccf

Grégory Wisniewski authored Jul 17, 2009

condition. Packet encoding and decoding handle None/INVALID_UUID mapping.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@871 71dcc9de-d417-0410-9af5-da40c76e7ee4

ad0d2ccf

15 Jul, 2009 2 commits

Remove the file descriptor accessor in Connection class because it must be used · 00705a8c

Grégory Wisniewski authored Jul 15, 2009

only in the event manager, at the lowest level of the network system.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@870 71dcc9de-d417-0410-9af5-da40c76e7ee4

00705a8c

Revert commit #864 after a discussion about isolation between the connection and · ee3f9a1d
Grégory Wisniewski authored Jul 15, 2009
```
thread context.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@869 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
ee3f9a1d

14 Jul, 2009 8 commits

Some changes in the tests runner, handle import errors to avoid a global crach · 88980cbb

Grégory Wisniewski authored Jul 14, 2009

Add comments to improve this tool later


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@868 71dcc9de-d417-0410-9af5-da40c76e7ee4

88980cbb

Reuse tests for old storage bootstrap handler for the new bootstrap manager. · a1f55c5d
Grégory Wisniewski authored Jul 14, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@867 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
a1f55c5d
Change some log message level, especially info to debug. · 078c7786
Grégory Wisniewski authored Jul 14, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@866 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
078c7786

Add application name (configuration section) in log messages to help debugging · 9a7e39d9

Grégory Wisniewski authored Jul 14, 2009

when mixing all application logs: 'cat *.log | sort | less' is helpfull.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@865 71dcc9de-d417-0410-9af5-da40c76e7ee4

9a7e39d9

Remove the 'queue' parameter in MTClientConnection.ask by giving the thread safe · 669eb3ac

Grégory Wisniewski authored Jul 14, 2009

data manager at MTClientConnection's constructor. This allows keep the same
method signature for ask() and to not crash when the client try to send a ping.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@864 71dcc9de-d417-0410-9af5-da40c76e7ee4

669eb3ac

Close the connection before calling the handler method, as it's name implies, · 21c09ad8

Grégory Wisniewski authored Jul 14, 2009

the connection is already closed when the method is triggered. This is fix a bug
where a readable poll event was always available in the event manager (when
doing a poll()) if the close method was never invoked, eg. when a exception is
raised in the connectionClosed method (like VerificationFailure).

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@862 71dcc9de-d417-0410-9af5-da40c76e7ee4

21c09ad8

The admin node ask the partition table itself, so don't send it anymore. · d8db8d56

Grégory Wisniewski authored Jul 14, 2009

When a storage node died, leaving the pt in a non-operational state, this now
nicely handled at the connection closure (see previous commit), so it is no more
usefull to check the pt status at temporarily state expiration.
Add an comment to fix a bug just found.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@861 71dcc9de-d417-0410-9af5-da40c76e7ee4

d8db8d56

Call the specialized method after change the node state because the can affect · 378873f2

Grégory Wisniewski authored Jul 14, 2009

the logic in _nodeLost(), especially when dealing with pt and its operational
state.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@860 71dcc9de-d417-0410-9af5-da40c76e7ee4

378873f2

13 Jul, 2009 12 commits

Import the right base handler class. · 14843277

Vincent Pelletier authored Jul 13, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@859 71dcc9de-d417-0410-9af5-da40c76e7ee4

14843277

Client nodes are not advertised via node state broadcast, so they must be... · 7df940fd

Vincent Pelletier authored Jul 13, 2009

Client nodes are not advertised via node state broadcast, so they must be created upon identification if they don't already exist.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@858 71dcc9de-d417-0410-9af5-da40c76e7ee4

7df940fd

(at least) dm.getPartitions doesn't exist any longer, so don't warn about it,... · 7f11c557

Vincent Pelletier authored Jul 13, 2009

(at least) dm.getPartitions doesn't exist any longer, so don't warn about it, just switch to the working one.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@857 71dcc9de-d417-0410-9af5-da40c76e7ee4

7f11c557

primary_master_node is not given a value any longer. Stop testing it. · 10e69ebd
Vincent Pelletier authored Jul 13, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@856 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
10e69ebd
Remove num_partitions/num_replicas on app, ask node informations and partition. · 65f40be6
Grégory Wisniewski authored Jul 13, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@855 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
65f40be6

Those decorators are useless because the admin node is connected and identified · 5d6c88b3

Grégory Wisniewski authored Jul 13, 2009

to the primary before the related handlers are applied.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@854 71dcc9de-d417-0410-9af5-da40c76e7ee4

5d6c88b3

Admin node use bootstrap manager to connect to the primary master. · 573ebb44

Grégory Wisniewski authored Jul 13, 2009

Fix primary master reconnection on lost.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@853 71dcc9de-d417-0410-9af5-da40c76e7ee4

573ebb44

Don't are code node type in generic bootstrap manager. · ed6e83e2
Grégory Wisniewski authored Jul 13, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@852 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
ed6e83e2

Delete num_partitions and num_replicas attributes on storage application object · 8c4fc6ad

Grégory Wisniewski authored Jul 13, 2009

and use those of PartitionTable (or DatabaseManager if required).


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@851 71dcc9de-d417-0410-9af5-da40c76e7ee4

8c4fc6ad

Remove an unused method (and implemented into PartitionTable) · 1643a9bd
Grégory Wisniewski authored Jul 13, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@850 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
1643a9bd

Add a bootstrap manager that manage the primary master lookup, connection and · a3b0d7a8

Grégory Wisniewski authored Jul 13, 2009

identifycation. It implement a bootstrap handler, taken from the storage
aoplication. The connection process has changed to avoid any dead-time during
connection, except when no master at all are available, this allows a quicker
connection from storage to master.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@849 71dcc9de-d417-0410-9af5-da40c76e7ee4

a3b0d7a8

Replicator don't have to search through the connection list to find the master · b6d8438d
Grégory Wisniewski authored Jul 13, 2009
```
connection.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@847 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
b6d8438d

10 Jul, 2009 2 commits
- The primary master answer can be handled in the secondary state, so ignore it. · 05c3a724
  Grégory Wisniewski authored Jul 10, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@846 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  05c3a724
- Restore monkey patches to avoid crash next tests. · 3ae83381
  Grégory Wisniewski authored Jul 10, 2009
```
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@845 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  3ae83381
09 Jul, 2009 2 commits

Fix some client handlers tests. · 3e2b820a

Grégory Wisniewski authored Jul 09, 2009


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@844 71dcc9de-d417-0410-9af5-da40c76e7ee4

3e2b820a

The connectionCompleted event is only triggered in bootstrap handler, which will · 116a1f3f
Grégory Wisniewski authored Jul 09, 2009
```
then ask the primary master.


git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@843 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
116a1f3f

08 Jul, 2009 1 commit

- Move master handlers in the handlers module. · e966eee6

Grégory Wisniewski authored Jul 08, 2009

- Split service.py file in two, one for the client sercice handler and the
  second for the storage.
- Base class for those two handlers as moved in the module python file (as done
  in client and storage applications).
- Remove moved storages from previous commit.
- Update application code to use new module location
- Fix a part of master tests.

git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@841 71dcc9de-d417-0410-9af5-da40c76e7ee4
git-svn-id: https://svn.erp5.org/repos/neo/branches/prototype3@842 71dcc9de-d417-0410-9af5-da40c76e7ee4

e966eee6