Commit f3f06817 authored by Terry Jan Reedy's avatar Terry Jan Reedy

Issue #17398: document url argument of RobotFileParser

parent 4b3975b9
......@@ -19,10 +19,10 @@ Web site that published the :file:`robots.txt` file. For more details on the
structure of :file:`robots.txt` files, see http://www.robotstxt.org/orig.html.
.. class:: RobotFileParser()
.. class:: RobotFileParser(url='')
This class provides a set of methods to read, parse and answer questions
about a single :file:`robots.txt` file.
This class provides methods to read, parse and answer questions about the
:file:`robots.txt` file at *url*.
.. method:: set_url(url)
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment