Commit 05aae0f1 authored by Ivan Tyagov's avatar Ivan Tyagov

Revert r43510 (we need to raise).

git-svn-id: https://svn.erp5.org/repos/public/erp5/trunk@43512 20353a03-c40f-0410-a6d1-a30d3c3de9de
parent 15379c62
No related merge requests found
......@@ -606,11 +606,11 @@ class ContributionTool(BaseTool):
# If this is an index document, stop crawling if crawling_depth is 0
document.activate().crawlContent()
except urllib2.HTTPError, error:
if (repeat == 0 or not batch_mode) and (error.getcode() == 404):
if repeat == 0 or not batch_mode:
# here we must call the extendBadURLList method,--NOT Implemented--
# which had to add this url to bad URL list, so next time we avoid
# crawling bad URL
return None
raise
if repeat > 0:
# Catch any HTTP error
self.activate(at_date=DateTime() + repeat_interval,
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment