Skip to content

C
cpython
Commit 72331179 authored by Skip Montanaro's avatar Skip Montanaro
Browse files
Options

update norobots link

parent 6d06815b
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
Doc/lib/librobotparser.tex
View file @ 72331179
...@@ -15,7 +15,7 @@ This module provides a single class, \class{RobotFileParser}, which answers ...@@ -15,7 +15,7 @@ This module provides a single class, \class{RobotFileParser}, which answers
questions about whether or not a particular user agent can fetch a URL on questions about whether or not a particular user agent can fetch a URL on
the Web site that published the \file{robots.txt} file. For more details on the Web site that published the \file{robots.txt} file. For more details on
the structure of \file{robots.txt} files, see the structure of \file{robots.txt} files, see
\url{http://info.webcrawler.com/mak/projects/robots/norobots.html}. \url{http://www.robotstxt.org/wc/norobots.html}.
\begin{classdesc}{RobotFileParser}{} \begin{classdesc}{RobotFileParser}{}
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment
GitLab Nexedi Edition | About GitLab | About Nexedi | 沪ICP备2021021310号-2 | 沪ICP备2021021310号-7