Prior to this change, this RPC had a fast_timeout. This timeout doesn't
set no timeout on Sidekiq. Deleting many refs can take over a couple of
seconds, so a default timeout would be neccesairy.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/49862