Revert "Raise soft limit of N(ofile) so we can use > 1024 fds"

This change unexpectedly break tests which uses supervisord running supervisord. @gabriel is confirming.