Jupyter: Version up eggs and update erp5_kernel accordingly

Pin versions required for ipython==4.0.0 with ipykernel separated
from ipython eggs.
The split was in accordance to : https://blog.jupyter.org/2015/04/15/the-big-split/

software/ipython_notebook/software.cfg

@@ -44,7 +44,7 @@ md5sum = d7d4a7e19d55bf14007819258bf42100
 [erp5-kernel]
 <= download-file-base
 filename = ERP5kernel.py.jinja
-md5sum = a6a0ad790d100167c42c354fe5744e11
+md5sum = da2f592075c414d4bb26cf7a7dfd147b
 
 [kernel-json]
 <= download-file-base
@@ -84,9 +84,13 @@ context =
 PyRSS2Gen = 1.1
 Pygments = 2.0.2
 cns.recipe.symlink = 0.2.3
-ipython = 3.2.0
+ipython = 4.0.0
 matplotlib = 1.4.3
-mistune = 0.6
+
+# Required by:
+# ipython==4.0.0
+mistune = 0.7.1
+
 nose = 1.3.7
 numpy = 1.9.2
 pandas = 0.16.2
@@ -99,6 +103,9 @@ terminado = 0.5
 tornado = 4.2
 requests = 2.7.0
 
+# Required for erp5_kernel
+ipykernel = 4.2.1
+
 # Required by:
 # tornado==4.2
 backports.ssl-match-hostname = 3.4.0.2
@@ -123,3 +130,52 @@ ptyprocess = 0.5
 # matplotlib==1.4.3
 # pandas==0.16.2
 python-dateutil = 2.4.2
+
+# Required by:
+# ipython==4.0.0
+notebook = 4.0.6
+simplegeneric = 0.8.1
+
+# Required by:
+# nbformat==4.0.1
+# notebook==4.0.6
+# traitlets==4.1.0b1
+ipython-genutils = 0.1.0
+
+# Required by:
+# ipykernel==4.2.1
+# notebook==4.0.6
+jupyter-client = 4.1.1
+
+# Required by:
+# nbformat==4.0.1
+# notebook==4.0.6
+# jupyter-client==4.1.1
+# nbconvert==4.1.0
+jupyter-core = 4.0.6
+
+# Required by:
+# notebook==4.0.6
+nbconvert = 4.1.0
+
+# Required by:
+# notebook==4.0.6
+# nbconvert==4.1.0
+nbformat = 4.0.1
+
+# Required by:
+# pickleshare==0.5
+path.py = 8.1.2
+
+# Required by:
+# ipython==4.0.0
+pexpect = 4.0.1
+
+# Required by:
+# ipython==4.0.0
+pickleshare = 0.5
+
+# Required by:
+# ipython==4.0.0
+# notebook==4.0.6
+traitlets = 4.1.0b1

software/ipython_notebook/template/ERP5kernel.py.jinja

 #!{{ python_executable }}
 
-from IPython.kernel.zmq.kernelbase import Kernel
-from IPython.kernel.zmq.kernelapp import IPKernelApp
+from ipykernel.kernelbase import Kernel
+from ipykernel.kernelapp import IPKernelApp
 
 from IPython.core.display import HTML
 

[Ayush Tiwari]

@kirr : This commit with pinned eggs works fine with the buildout for version upgrade. Please add this one. Thanks

[Kirill Smelkov]

@tiwariayush - thanks, applied in d88878e6.

Btw, I still get

[W 21:54:30.006 NotebookApp] Unrecognized alias: '--logfile=/srv/slapgrid/slappart8/srv/runner/instance/slappart0
/var/log/ipython_notebook.log', it will probably have no effect.

in .slappart0_ipython_notebook.log

[Ayush Tiwari]

@kirr : The reason for this behavior is the separation of ipython to jupyter and other components. No where is past logfile was option for NotebookApp. It was always for InteractiveShell which is basically ipython terminal itself (not notebook).

So, when we start ipython notebook from the wrapper :

sys.exit(slapos.recipe.librecipe.execute.generic_exec((['/srv/slapgrid/slappart18/srv/runner/software/267794350b193d64deb1c3425aab51a5/bin/ipython', 'notebook', '--no-browser', '--ip=2001:67c:1254:e:c1::5968', '--port=8888', '--port-retries=0', '--certfile=/srv/slapgrid/slappart18/srv/runner/instance/slappart0/etc/ipython_notebook_cert.crt', '--keyfile=/srv/slapgrid/slappart18/srv/runner/instance/slappart0/etc/ipython_notebook_cert.key', '--notebook-dir=/srv/slapgrid/slappart18/srv/runner/instance/slappart0/var/notebooks', '--config=/srv/slapgrid/slappart18/srv/runner/instance/slappart0/etc/ipython_notebook_config.py', '--log-level=DEBUG'],

it started ipython notebook application, which is a part of ipython. Now if we see for the options for ipython using ipython --help-all command, we can see

--logfile=<Unicode> (InteractiveShell.logfile)
    Default: ''
    The name of the logfile to use.

which is an option for ipython not notebook. There is nothing which can be used to log NotebookApp which is what we are running(from what I have found till now, looking in more depth).

[D 06:35:37.523 NotebookApp] Config changed:
[D 06:35:37.523 NotebookApp] {'FileContentsManager': {'root_dir': u'/srv/slapgrid/slappart18/srv/runner/instance/slappart0/var/notebooks'}, 'NotebookApp': {'open_browser': False, 'log_level': u'DEBUG', 'ip': u'2001:67c:1254:e:c1::5968', 'config_file': u'/srv/slapgrid/slappart18/srv/runner/instance/slappart0/etc/ipython_notebo

Look for the NotebookApp in start of every line.

I am pretty sure there must be some way to add logs for notebook. But in the search, I found out its better to be dependent on jupyter than on ipython 4.x series from our usage after the big split.

So, I am going this way:

1. Keeping jupyter as the base for starting notebook, not ipython
2. Then we'll see what notebook inside jupyter has to offer for us regarding logging.

[Kirill Smelkov]

@tiwariayush ok, let's try to switch to jupyter.