Update comment about surrogates.

9bf2b3ae · Ezio Melotti · 2f194b90 · 9bf2b3ae
Commit 9bf2b3ae authored Jul 03, 2010 by Ezio Melotti
Hide whitespace changes
Inline Side-by-side

Showing with 5 additions and 5 deletions

Objects/unicodeobject.c Objects/unicodeobject.c +5 -5

No files found.
--- a/Objects/unicodeobject.c
+++ b/Objects/unicodeobject.c
@@ -2450,11 +2450,11 @@ PyObject *PyUnicode_DecodeUTF8Stateful(const char *s,
            break;
        case 3:
-            /* XXX: surrogates shouldn't be valid UTF-8!
+            /* Decoding UTF-8 sequences in range \xed\xa0\x80-\xed\xbf\xbf
-               see http://www.unicode.org/versions/Unicode5.2.0/ch03.pdf
+               will result in surrogates in range d800-dfff. Surrogates are
-               (table 3-7) and http://www.rfc-editor.org/rfc/rfc3629.txt
+               not valid UTF-8 so they are rejected.
-               Uncomment the 2 lines below to make them invalid,
+               See http://www.unicode.org/versions/Unicode5.2.0/ch03.pdf
-               codepoints: d800-dfff; UTF-8: \xed\xa0\x80-\xed\xbf\xbf. */
+               (table 3-7) and http://www.rfc-editor.org/rfc/rfc3629.txt */
            if ((s[1] & 0xc0) != 0x80 ||
                (s[2] & 0xc0) != 0x80 ||
                ((unsigned char)s[0] == 0xE0 &&