Fix a bunch of refleaks in the init of the module.  This would only be found
when running python -v.