NEWS 199 KB
Newer Older
Georg Brandl's avatar
Georg Brandl committed
1
+++++++++++
2
Python News
3 4
+++++++++++

5
What's New in Python 3.3.2?
Georg Brandl's avatar
Georg Brandl committed
6 7
===========================

Georg Brandl's avatar
Georg Brandl committed
8
.. *Release date: XXXX-XX-XX*
9

Georg Brandl's avatar
Georg Brandl committed
10
*Not yet released, see sections below for changes released in 3.3.1*
11

12 13 14
Core and Builtins
-----------------

15 16 17
- Issue #17715: Fix segmentation fault from raising an exception in a __trunc__
  method.

18 19 20
- Issue #16447: Fixed potential segmentation fault when setting __name__ on a
  class.

21 22
- Issue #17669: Fix crash involving finalization of generators using yield from.

23 24
- Issue #17619: Make input() check for Ctrl-C correctly on Windows.

25 26
- Issue #17610: Don't rely on non-standard behavior of the C qsort() function.

27 28
- Issue #17357: Add missing verbosity output when using -v/-vv.

29 30 31
Library
-------

32 33 34
- Issue #17016: Get rid of possible pointer wraparounds and integer overflows
  in the re module.  Patch by Nickolai Zeldovich.

35 36 37
- Issue #16658: add missing return to HTTPConnection.send()
  Patch by Jeff Knupp.

38 39 40
- Issue #14971: unittest test discovery no longer gets confused when a function
  has a different __name__ than its name in the TestCase class dictionary.

41 42 43
- Issue #17678: Fix DeprecationWarning in the http/cookiejar.py by changing the
  usage of get_origin_req_host() to origin_req_host.

44 45
- Issue #17666: Fix reading gzip files with an extra field.

46 47 48
- Issue #17502: Process DEFAULT values in mock side_effect that returns iterator.
  Patch by Michael Foord.

49 50 51
- Issue #17572: Avoid chained exceptions while passing bad directives to
  time.strptime().  Initial patch by Claudiu Popa.

52 53 54 55 56 57 58 59 60
- Issue #17435: threading.Timer's __init__ method no longer uses mutable
  default values for the args and kwargs parameters.

- Issue #17526: fix an IndexError raised while passing code without filename to
  inspect.findsource().  Initial patch by Tyler Doyle.

IDLE
----

61 62
- Issue #17585: Fixed IDLE regression. Now closes when using exit() or quit().

63 64 65
- Issue #17657: Show full Tk version in IDLE's about dialog.
  Patch by Todd Rovito.

66 67
- Issue #17613: Prevent traceback when removing syntax colorizer in IDLE.

68 69
- Issue #1207589: Backwards-compatibility patch for right-click menu in IDLE.

70 71
- Issue #16887: IDLE now accepts Cancel in tabify/untabify dialog box.

72 73
- Issue #17625: In IDLE, close the replace dialog after it is used.

74 75
- Issue #14254: IDLE now handles readline correctly across shell restarts.

76 77
- Issue #17614: IDLE no longer raises exception when quickly closing a file.

78 79
- Issue #6698: IDLE now opens just an editor window when configured to do so.

80 81 82
- Issue #8900: Using keyboard shortcuts in IDLE to open a file no longer
  raises an exception.

83 84
- Issue #6649: Fixed missing exit status in IDLE. Patch by Guilherme Polo.

85 86 87 88 89 90
Tests
-----

- Issue #12820: add tests for the xml.dom.minicompat module.
  Patch by John Chandler and Phil Connell.

91 92 93
- Issue #17690: test_time now works with unittest test discovery.
  Patch by Zachary Ware.

94 95 96
- Issue #17692: test_sqlite now works with unittest test discovery.
  Patch by Zachary Ware.

Terry Jan Reedy's avatar
Terry Jan Reedy committed
97 98 99 100 101
Documentation
-------------

- Issue #15940: Specify effect of locale on time functions.

102 103 104
- Issue #6696: add documentation for the Profile objects, and improve
  profile/cProfile docs.  Patch by Tom Pinckney.

105 106 107 108 109

What's New in Python 3.3.1?
===========================

*Release date: 07-Apr-2013*
Georg Brandl's avatar
Georg Brandl committed
110

111 112 113 114 115
Build
-----

- Issue #17550: Fix the --enable-profiling configure switch.

116 117 118 119 120
Library
-------

- Issue #17625: In IDLE, close the replace dialog after it is used.

121

Georg Brandl's avatar
Georg Brandl committed
122 123
What's New in Python 3.3.1 release candidate 1?
===============================================
Georg Brandl's avatar
Georg Brandl committed
124

Georg Brandl's avatar
Georg Brandl committed
125
*Release date: 24-Mar-2013*
Georg Brandl's avatar
Georg Brandl committed
126 127 128 129

Core and Builtins
-----------------

130 131
- Issue #17328: Fix possible refleak in dict.setdefault.

132 133 134 135
- Issue #17223: array module: Fix a crasher when converting an array containing
  invalid characters (outside range [U+0000; U+10ffff]) to Unicode:
  repr(array), str(array) and array.tounicode(). Patch written by Manuel Jacob.

136 137 138
- Issue #17223: Fix PyUnicode_FromUnicode() for string of 1 character outside
  the range U+0000-U+10ffff.

139 140 141
- Issue #1692335: Move initial args assignment to
  BaseException.__new__ to help pickling of naive subclasses.

142 143 144
- Issue #17275: Corrected class name in init error messages of the C version of
  BufferedWriter and BufferedRandom.

145 146 147
- Issue #7963: Fixed misleading error message that issued when object is
  called without arguments.

148 149 150
- Issue #5308: Raise ValueError when marshalling too large object (a sequence
  with size >= 2**31), instead of producing illegal marshal data.

151 152 153
- Issue #12983: Bytes literals with invalid \x escape now raise a SyntaxError
  and a full traceback including line number.

154 155 156
- Issue #17173: Remove uses of locale-dependent C functions (isalpha() etc.)
  in the interpreter.

157 158 159
- Issue #17137: When an Unicode string is resized, the internal wide character
  string (wstr) format is now cleared.

160 161
- Issue #17043: The unicode-internal decoder no longer read past the end of
  input buffer.
162

163 164 165
- Issue #17098: All modules now have __loader__ set even if they pre-exist the
  bootstrapping of importlib.

166 167
- Issue #16979: Fix error handling bugs in the unicode-escape-decode decoder.

168 169 170
- Issue #10156: In the interpreter's initialization phase, unicode globals
  are now initialized dynamically as needed.

171 172 173
- Issue #16980: Fix processing of escaped non-ascii bytes in the
  unicode-escape-decode decoder.

174 175
- Issue #16975: Fix error handling bug in the escape-decode bytes decoder.

Ezio Melotti's avatar
Ezio Melotti committed
176
- Issue #14850: Now a charmap decoder treats U+FFFE as "undefined mapping"
177 178
  in any mapping, not only in a string.

179 180 181 182 183
- Issue #16730: importlib.machinery.FileFinder now no longers raises an
  exception when trying to populate its cache and it finds out the directory is
  unreadable or has turned into a file. Reported and diagnosed by
  David Pritchard.

184 185 186
- Issue #16906: Fix a logic error that prevented most static strings from being
  cleared.

187 188 189
- Issue #11461: Fix the incremental UTF-16 decoder. Original patch by
  Amaury Forgeot d'Arc.

190 191
- Issue #16881: Fix Py_ARRAY_LENGTH macro for GCC < 3.1.

192 193 194
- Issue #16856: Fix a segmentation fault from calling repr() on a dict with
  a key whose repr raise an exception.

195 196
- Issue #16367: Fix FileIO.readall() on Windows for files larger than 2 GB.

197 198 199 200 201 202
- Issue #16455: On FreeBSD and Solaris, if the locale is C, the
  ASCII/surrogateescape codec is now used, instead of the locale encoding, to
  decode the command line arguments. This change fixes inconsistencies with
  os.fsencode() and os.fsdecode() because these operating systems announces an
  ASCII locale encoding, whereas the ISO-8859-1 encoding is used in practice.

203
- Issue #16761: Calling int() with base argument only now raises TypeError.
204

205
- Issue #16759: Support the full DWORD (unsigned long) range in Reg2Py
Ezio Melotti's avatar
Ezio Melotti committed
206
  when retrieving a REG_DWORD value. This corrects functions like
207 208
  winreg.QueryValueEx that may have been returning truncated values.

209 210 211
- Issue #14420: Support the full DWORD (unsigned long) range in Py2Reg
  when passed a REG_DWORD value. Fixes OverflowError in winreg.SetValueEx.

Benjamin Peterson's avatar
Benjamin Peterson committed
212 213
- Issue #16597: In buffered and text IO, call close() on the underlying stream
  if invoking flush() fails.
214

215 216 217
- Issue #16722: In the bytes() constructor, try to call __bytes__ on the
  argument before __index__.

218 219 220 221
- Issue #16602: When a weakref's target was part of a long deallocation
  chain, the object could remain reachable through its weakref even though
  its refcount had dropped to zero.

222 223 224 225 226 227
- Issue #16416: On Mac OS X, operating system data are now always
  encoded/decoded to/from UTF-8/surrogateescape, instead of the locale encoding
  (which may be ASCII if no locale environment variable is set), to avoid
  inconsistencies with os.fsencode() and os.fsdecode() functions which are
  already using UTF-8/surrogateescape.

228 229
- Issue #16588: Silence unused-but-set warnings in Python/thread_pthread

230 231
- Issue #16546: Fix: ast.YieldFrom argument is now mandatory.

232 233 234
- Issue #16514: Fix regression causing a traceback when sys.path[0] is None
  (actually, any non-string or non-bytes type).

235 236 237
- Issue #16306: Fix multiple error messages when unknown command line
  parameters where passed to the interpreter.  Patch by Hieu Nguyen.

238 239 240
- Issue #16215: Fix potential double memory free in str.replace().  Patch
  by Serhiy Storchaka.

241 242
- Issue #16453: Fix equality testing of dead weakref objects.

243 244 245
- Issue #9535: Fix pending signals that have been received but not yet
  handled by Python to not persist after os.fork() in the child process.

246
- Issue #15001: fix segfault on "del sys.modules['__main__']". Patch by Victor
247 248
  Stinner.

249 250 251 252
- Issue #8271: the utf-8 decoder now outputs the correct number of U+FFFD
  characters when used with the 'replace' error handler on invalid utf-8
  sequences.  Patch by Serhiy Storchaka, tests by Ezio Melotti.

253
- Issue #5765: Apply a hard recursion limit in the compiler instead of
Nick Coghlan's avatar
Nick Coghlan committed
254
  blowing the stack and segfaulting. Initial patch by Andrea Griffini.
255

256 257 258
- Issue #16402: When slicing a range, fix shadowing of exceptions from
  __index__.

259 260 261
- Issue #16336: fix input checking in the surrogatepass error handler.
  Patch by Serhiy Storchaka.

262 263 264
- Issue #8401: assigning an int to a bytearray slice (e.g. b[3:4] = 5) now
  raises an error.

265 266 267
- Fix segfaults on setting __qualname__ on builtin types and attempting to
  delete it on any type.

268
- Issue #16345: Fix an infinite loop when ``fromkeys`` on a dict subclass
Benjamin Peterson's avatar
Benjamin Peterson committed
269
  received a nonempty dict from the constructor.
270

271 272 273
- Issue #16271: Fix strange bugs that resulted from __qualname__ appearing in a
  class's __dict__ and on type.

274
- Issue #16197: Update winreg docstrings and documentation to match code.
275 276
  Patch by Zachary Ware.

Andrew Svetlov's avatar
Andrew Svetlov committed
277 278 279
- Issue #16241: Document -X faulthandler command line option.
  Patch by Marek Šuppa.

280 281 282
- Issue #6074: Ensure cached bytecode files can always be updated by the
  user that created them, even when the source file is read-only.

283 284 285
- Issue #14783: Improve int() docstring and switch docstrings for str(),
  range(), and slice() to use multi-line signatures.

286 287
- Issue #16160: Subclass support now works for types.SimpleNamespace.

288 289 290
- Issue #15379: Fix passing of non-BMP characters as integers for the charmap
  decoder (already working as unicode strings).  Patch by Serhiy Storchaka.

291 292 293
- Issue #15144: Fix possible integer overflow when handling pointers as integer
  values, by using `Py_uintptr_t` instead of `size_t`.  Patch by Serhiy
  Storchaka.
294

295 296
- Issue #15965: Explicitly cast `AT_FDCWD` as (int).  Required on Solaris 10
  (which defines `AT_FDCWD` as ``0xffd19553``), harmless on other platforms.
297

298
- Issue #15839: Convert SystemErrors in `super()` to RuntimeErrors.
299

300
- Issue #15846: Fix SystemError which happened when using `ast.parse()` in an
301 302 303 304 305
  exception handler on code with syntax errors.

- Issue #15801: Make sure mappings passed to '%' formatting are actually
  subscriptable.

306 307 308 309
- Issue #15111: __import__ should let ImportError propagate when a module that
  is imported as a side-effect of using fromlist tries to import a module
  that cannot be found.

310

Georg Brandl's avatar
Georg Brandl committed
311 312 313
Library
-------

314 315
- Issue #17540: Added style to formatter configuration by dict.

316 317 318
- Issue #17536: Add to webbrowser's browser list: www-browser, x-www-browser,
  iceweasel, iceape.

319 320 321 322 323
- Issue #17488: Change the subprocess.Popen bufsize parameter default value
  from unbuffered (0) to buffering (-1) to match the behavior existing code
  expects and match the behavior of the subprocess module in Python 2 to avoid
  introducing hard to track down bugs.

324 325 326
- Issue #17521: Corrected non-enabling of logger following two calls to
  fileConfig().

Vinay Sajip's avatar
Vinay Sajip committed
327 328 329
- Issue #17508: Corrected MemoryHandler configuration in dictConfig() where
  the target handler wasn't configured first.

330 331 332
- Issue #17209: curses.window.get_wch() now handles correctly KeyboardInterrupt
  (CTRL+c).

333 334 335 336
- Issue #5713: smtplib now handles 421 (closing connection) error codes when
  sending mail by closing the socket and reporting the 421 error code via the
  exception appropriate to the command that received the error response.

337 338 339 340
- Issue #17192: Update the ctypes module's libffi to v3.0.13.  This
  specifically addresses a stack misalignment issue on x86 and issues on
  some more recent platforms.

341 342
- Issue #8862: Fixed curses cleanup when getkey is interrputed by a signal.

Gregory P. Smith's avatar
Gregory P. Smith committed
343
- Issue #17443: imaplib.IMAP4_stream was using the default unbuffered IO
344 345 346
  in subprocess, but the imap code assumes buffered IO.  In Python2 this
  worked by accident.  IMAP4_stream now explicitly uses buffered IO.

347 348 349
- Issue #17476: Fixed regression relative to Python2 in undocumented pydoc
  'allmethods'; it was missing unbound methods on the class.

350
- Issue #16880: Do not assume _imp.load_dynamic() is defined in the imp module.
351

352
- Issue #16389: Fixed a performance regression relative to Python 3.1 in the
353 354
  caching of compiled regular expressions.

355 356
- Issue #17431: Fix missing import of BytesFeedParser in email.parser.

357 358 359
- Issue #1285086: Get rid of the refcounting hack and speed up
  urllib.parse.unquote() and urllib.parse.unquote_to_bytes().

360 361 362 363
- Issue #17368: Fix an off-by-one error in the Python JSON decoder that caused
  a failure while decoding empty object literals when object_pairs_hook was
  specified.

364 365 366 367 368
- Issue #14645: The email generator classes now produce output using the
  specified linesep throughout.  Previously if the prolog, epilog, or
  body were stored with a different linesep, that linesep was used.  This
  fix corrects an RFC non-compliance issue with smtplib.send_message.

369 370 371
- Issue #17278: Fix a crash in heapq.heappush() and heapq.heappop() when
  the list is being resized concurrently.

372 373 374
- Issue #16962: Use getdents64 instead of the obsolete getdents syscall
  in the subprocess module on Linux.

375 376
- Issue #17018: Make Process.join() retry if os.waitpid() fails with EINTR.

377 378 379
- Issue #14720: sqlite3: Convert datetime microseconds correctly.
  Patch by Lowe Thiderman.

380 381 382
- Issue #17225: JSON decoder now counts columns in the first line starting
  with 1, as in other lines.

383 384 385
- Issue #13700: Fix byte/string handling in imaplib authentication when an
  authobject is specified.

386 387 388
- Issue #13153: Tkinter functions now raise TclError instead of ValueError when
  a string argument contains non-BMP character.

389 390 391
- Issue #9669: Protect re against infinite loops on zero-width matching in
  non-greedy repeat.  Patch by Matthew Barnett.

392 393 394 395
- Issue #13169: The maximal repetition number in a regular expression has been
  increased from 65534 to 2147483647 (on 32-bit platform) or 4294967294 (on
  64-bit).

396 397 398
- Issue #17143: Fix a missing import in the trace module.  Initial patch by
  Berker Peksag.

399 400
- Issue #16743: Fix mmap overflow check on 32 bit Windows.

401 402 403
- Issue #16800: tempfile.gettempdir() no longer left temporary files when
  the disk is full.  Original patch by Amir Szekely.

404 405 406
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_7or8bit when used with binary data.

Michael Foord's avatar
Michael Foord committed
407
- Issue #17052: unittest discovery should use self.testLoader.
408

409 410
- Issue #4591: Uid and gid values larger than 2**31 are supported now.

411 412
- Issue #17141: random.vonmisesvariate() no more hangs for large kappas.

413 414 415
- Issue #17149: Fix random.vonmisesvariate to always return results in
  [0, 2*math.pi].

416 417
- Issue #1470548: XMLGenerator now works with binary output streams.

418 419 420
- Issue #6975: os.path.realpath() now correctly resolves multiple nested
  symlinks on POSIX platforms.

421 422 423
- Issue #17156: pygettext.py now uses an encoding of source file and correctly
  writes and escapes non-ascii characters.

424 425 426
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_noop when used with binary data.

427 428 429 430
- Issue #10355: In SpooledTemporaryFile class mode, name, encoding and
  newlines properties now work for unrolled files.  Obsoleted and never
  working on Python 3 xreadline method now removed.

431 432 433 434 435 436
- Issue #16686: Fixed a lot of bugs in audioop module.  Fixed crashes in
  avgpp(), maxpp() and ratecv().  Fixed an integer overflow in add(), bias(),
  and ratecv().  reverse(), lin2lin() and ratecv() no more lose precision for
  32-bit samples.  max() and rms() no more returns a negative result and
  various other functions now work correctly with 32-bit sample -0x80000000.

437 438
- Issue #17073: Fix some integer overflows in sqlite3 module.

439
- Issue #17114: IDLE now uses non-strict config parser.
440

441 442
- Issue #16723: httplib.HTTPResponse no longer marked closed when the connection
  is automatically closed.
443 444 445 446

- Issue #16948: Fix quoted printable body encoding for non-latin1 character
  sets in the email package.

447 448 449
- Issue #16811: Fix folding of headers with no value in the provisional email
  policies.

450 451
- Issue #17132: Update symbol for "yield from" grammar changes.

452 453 454
- Issue #17076: Make copying of xattrs more permissive of missing FS support.
  Patch by Thomas Wouters.

455 456 457 458
- Issue #17089: Expat parser now correctly works with string input not only when
  an internal XML encoding is UTF-8 or US-ASCII.  It now accepts bytes and
  strings larger than 2 GiB.

459 460 461
- Issue #6083: Fix multiple segmentation faults occured when PyArg_ParseTuple
  parses nested mutating sequence.

462 463
- Issue #5289: Fix ctypes.util.find_library on Solaris.

464 465 466 467
- Issue #17106: Fix a segmentation fault in io.TextIOWrapper when an underlying
  stream or a decoder produces data of an unexpected type (i.e. when
  io.TextIOWrapper initialized with text stream or use bytes-to-bytes codec).

468 469 470
- Issue #15633: httplib.HTTPResponse is now mark closed when the server
  sends less than the advertised Content-Length.

471 472 473
- Issue #6972: The zipfile module no longer overwrites files outside of
  its destination path when extracting malicious zip files.

474 475 476 477
- Issue #4844: ZipFile now raises BadZipFile when opens a ZIP file with an
  incomplete "End of Central Directory" record.  Original patch by Guilherme
  Polo and Alan McIntyre.

478 479 480
- Issue #17071: Signature.bind() now works when one of the keyword arguments
  is named ``self``.

481 482 483
- Issue #12004: Fix an internal error in PyZipFile when writing an invalid
  Python file.  Patch by Ben Morgan.

484 485 486
- Issue #1602133: on Mac OS X a shared library build (``--enable-shared``)
  now fills the ``os.environ`` variable correctly.

487 488 489
- Issue #15505: `unittest.installHandler` no longer assumes SIGINT handler is
  set to a callable object.

490 491 492
- Issue #9290: In IDLE the sys.std* streams now implement io.TextIOBase
  interface and support all mandatory methods and properties.

493 494 495
- Issue #13454: Fix a crash when deleting an iterator created by itertools.tee()
  if all other iterators were very advanced before.

496 497 498
- Issue #12411: Fix to cgi.parse_multipart to correctly use bytes boundaries
  and bytes data. Patch by Jonas Wagner.

499 500 501 502
- Issue #16957: shutil.which() no longer searches a bare file name in the
  current directory on Unix and no longer searches a relative file path with
  a directory part in PATH directories.  Patch by Thomas Kluyver.

503 504 505
- Issue #1159051: GzipFile now raises EOFError when reading a corrupted file
  with truncated header or footer.

506 507 508
- Issue #16993: shutil.which() now preserves the case of the path and extension
  on Windows.

509 510 511
- Issue #16992: On Windows in signal.set_wakeup_fd, validate the file
  descriptor argument.

512 513
- Issue #16422: For compatibility with the Python version, the C version of
  decimal now uses strings instead of integers for rounding mode constants.
514

515 516 517
- Issue #15861: tkinter now correctly works with lists and tuples containing
  strings with whitespaces, backslashes or unbalanced braces.

518 519
- Issue #10527: Use poll() instead of select() for multiprocessing pipes.

520 521 522
- Issue #9720: zipfile now writes correct local headers for files larger than
  4 GiB.

523 524 525
- Issue #16955: Fix the poll() method for multiprocessing's socket
  connections on Windows.

526 527
- SSLContext.load_dh_params() now properly closes the input file.

528 529 530
- Issue #16829: IDLE printing no longer fails if there are spaces or other
  special characters in the file path.

531 532
- Issue #16900: Issue a ResourceWarning when an ssl socket is left unclosed.

533 534 535
- Issue #13899: \A, \Z, and \B now correctly match the A, Z, and B literals
  when used inside character classes (e.g. '[\A]').  Patch by Matthew Barnett.

536 537 538 539
- Issue #15545: Fix regression in sqlite3's iterdump method where it was
  failing if the connection used a row factory (such as sqlite3.Row) that
  produced unsortable objects. (Regression was introduced by fix for 9750).

540 541
- Issue #16491: IDLE now prints chained exception tracebacks.

542 543 544
- Issue #15972: Fix error messages when os functions expecting a file name or
  file descriptor receive the incorrect type.

545 546
- Issue #16828: Fix error incorrectly raised by bz2.compress(b'') and
  bz2.BZ2Compressor.compress(b''). Initial patch by Martin Packman.
547

548 549
- Issue #16541: tk_setPalette() now works with keyword arguments.

550 551 552 553 554 555 556 557 558 559 560
- Issue #16820: In configparser, `parser.popitem()` no longer raises ValueError.
  This makes `parser.clean()` work correctly.

- Issue #16820: In configparser, ``parser['section'] = {}`` now preserves
  section order within the parser. This makes `parser.update()` preserve section
  order as well.

- Issue #16820: In configparser, ``parser['DEFAULT'] = {}`` now correctly
  clears previous values stored in the default section. Same goes for
  ``parser.update({'DEFAULT': {}})``.

561 562
- Issue #16819: IDLE method completion now correctly works for bytes literals.

563 564
- Issue #9586: Redefine SEM_FAILED on MacOSX to keep compiler happy.

Ezio Melotti's avatar
Ezio Melotti committed
565
- Issue #10527: make multiprocessing use poll() instead of select() if available.
566

567 568
- Issue #16688: Now regexes contained backreferences correctly work with
  non-ASCII strings.  Patch by Matthew Barnett.
569

570 571
- Issue #16485: Now file descriptors are closed if file header patching failed
  on closing an aifc file.
572

573 574
- Issue #16165: sched.scheduler.run() no longer blocks a scheduler for other
  threads.
575

576
- Issue #16641: Default values of sched.scheduler.enter() are no longer
577 578
  modifiable.

579 580 581
- Issue #16504: IDLE now catches SyntaxErrors raised by tokenizer. Patch by
  Roger Serwy.

582 583 584
- Issue #16618: Make glob.glob match consistently across strings and bytes
  regarding leading dots.  Patch by Serhiy Storchaka.

585 586 587
- Issue #16702: test_urllib2_localnet tests now correctly ignores proxies for
  localhost tests.

588 589 590
- Issue #16511: Use default IDLE width and height if config param is not valid.
  Patch Serhiy Storchaka.

591 592 593
- Issue #16713: Parsing of 'tel' urls using urlparse separates params from
  path.

594 595 596
- Issue #16443: Add docstrings to regular expression match objects.
  Patch by Anton Kasyanov.

597 598
- Issue #15701: Fix HTTPError info method call to return the headers information.

599 600
- Issue #16752: Add a missing import to modulefinder. Patch by Berker Peksag.

601 602 603
- Issue #16646: ftplib.FTP.makeport() might lose socket error details.
  (patch by Serhiy Storchaka)

604 605 606 607
- Issue #16626: Fix infinite recursion in glob.glob() on Windows when the
  pattern contains a wildcard in the drive or UNC path.  Patch by Serhiy
  Storchaka.

608 609 610 611
- Issue #15783: Except for the number methods, the C version of decimal now
  supports all None default values present in decimal.py. These values were
  largely undocumented.

612 613 614 615
- Issue #16298: In HTTPResponse.read(), close the socket when there is no
  Content-Length and the incoming stream is finished.  Patch by Eran
  Rundstein.

616 617 618 619
- Issue #15872: Fix 3.3 regression introduced by the new fd-based shutil.rmtree
  that caused it to not ignore certain errors when ignore_errors was set.
  Patch by Alessandro Moura and Serhiy Storchaka.

620 621 622
- Issue #16248: Disable code execution from the user's home directory by
  tkinter when the -E flag is passed to Python.  Patch by Zachary Ware.

623 624
- Issue #16628: Fix a memory leak in ctypes.resize().

625 626 627
- Issue #13614: Fix setup.py register failure with invalid rst in description.
  Patch by Julien Courteau and Pierre Paul Lefebvre.

628 629 630
- Issue #13512: Create ~/.pypirc securely (CVE-2011-4944).  Initial patch by
  Philip Jenvey, tested by Mageia and Debian.

631 632 633
- Issue #7719: Make distutils ignore ``.nfs*`` files instead of choking later
  on.  Initial patch by SilentGhost and Jeff Ramnani.

634 635 636
- Issue #13120: Allow to call pdb.set_trace() from thread.
  Patch by Ilya Sandler.

637 638 639
- Issue #16585: Make CJK encoders support error handlers that return bytes per
  PEP 383.

640 641 642
- Issue #10182: The re module doesn't truncate indices to 32 bits anymore.
  Patch by Serhiy Storchaka.

Benjamin Peterson's avatar
Benjamin Peterson committed
643 644 645 646
- Issue #16573: In 2to3, treat enumerate() like a consuming call, so superfluous
  list() calls aren't added to filter(), map(), and zip() which are directly
  passed enumerate().

647 648
- Issue #16476: Fix json.tool to avoid including trailing whitespace.

649 650 651
- Issue #16549: Make json.tool work again on Python 3 and add tests.
  Initial patch by Berker Peksag and Serhiy Storchaka.

652 653 654 655
- Issue #12848: The pure Python pickle implementation now treats object
  lengths as unsigned 32-bit integers, like the C implementation does.
  Patch by Serhiy Storchaka.

656 657 658
- Issue #16408: Fix file descriptors not being closed in error conditions
  in the zipfile module.  Patch by Serhiy Storchaka.

659 660
- Issue #16481: multiprocessing no longer leaks process handles on Windows.

661 662 663
- Issue #16140: The subprocess module no longer double closes its child
  subprocess.PIPE parent file descriptors on child error prior to exec().

664 665 666
- Remove a bare print to stdout from the subprocess module that could have
  happened if the child process wrote garbage to its pre-exec error pipe.

667 668 669
- Issue #16327: The subprocess module no longer leaks file descriptors
  used for stdin/stdout/stderr pipes to the child when fork() fails.

670 671 672
- Issue #14396: Handle the odd rare case of waitpid returning 0 when not
  expected in subprocess.Popen.wait().

673 674 675
- Issue #16411: Fix a bug where zlib.decompressobj().flush() might try to access
  previously-freed memory. Patch by Serhiy Storchaka.

676 677 678
- Issue #16357: fix calling accept() on a SSLSocket created through
  SSLContext.wrap_socket().  Original patch by Jeff McNeil.

679 680 681 682 683
- Issue #16409: The reporthook callback made by the legacy
  urllib.request.urlretrieve API now properly supplies a constant non-zero
  block_size as it did in Python 3.2 and 2.7.  This matches the behavior of
  urllib.request.URLopener.retrieve.

684 685 686
- Issue #16431: Use the type information when constructing a Decimal subtype
  from a Decimal argument.

687
- Issue #16350: zlib.decompressobj().decompress() now accumulates data from
688
  successive calls after EOF in unused_data, instead of only saving the argument
689 690 691
  to the last call. decompressobj().flush() now correctly sets unused_data and
  unconsumed_tail. A bug in the handling of MemoryError when setting the
  unconsumed_tail attribute has also been fixed. Patch by Serhiy Storchaka.
692

693 694 695
- Issue #12759: sre_parse now raises a proper error when the name of the group
  is missing.  Initial patch by Serhiy Storchaka.

696 697 698
- Issue #16152: fix tokenize to ignore whitespace at the end of the code when
  no newline is found.  Patch by Ned Batchelder.

699 700 701
- Issue #1207589: Add Cut/Copy/Paste items to IDLE right click Context Menu
  Patch by Todd Rovito.

702 703 704
- Issue #16230: Fix a crash in select.select() when one the lists changes
  size while iterated on.  Patch by Serhiy Storchaka.

705 706 707
- Issue #16228: Fix a crash in the json module where a list changes size
  while it is being encoded.  Patch by Serhiy Storchaka.

708 709 710
- Issue #14897: Enhance error messages of struct.pack and
  struct.pack_into. Patch by Matti Mäki.

711 712 713
- Issue #12890: cgitb no longer prints spurious <p> tags in text
  mode when the logdir option is specified.

714 715 716
- Issue #16307: Fix multiprocessing.Pool.map_async not calling its callbacks.
  Patch by Janne Karila.

717 718
- Issue #16250: Fix URLError invocation with proper args.

719
- Issue #16116: Fix include and library paths to be correct when building C
720 721
  extensions in venvs.

722 723
- Issue #16245: Fix the value of a few entities in html.entities.html5.

724 725
- Issue #14398: Fix size truncation and overflow bugs in the bz2 module.

726 727 728
- Issue #16220: wsgiref now always calls close() on an iterable response.
  Patch by Brent Tubbs.

729 730 731
- Issue #16270: urllib may hang when used for retrieving files via FTP by using
  a context manager.  Patch by Giampaolo Rodola'.

732 733 734
- Issue #16461: Wave library should be able to deal with 4GB wav files,
  and sample rate of 44100 Hz.

735 736
- Issue #16176: Properly identify Windows 8 via platform.platform()

737 738 739
- Issue #16114: The subprocess module no longer provides a misleading error
  message stating that args[0] did not exist when either the cwd or executable
  keyword arguments specified a path that did not exist.
740

741 742
- Issue #16169: Fix ctypes.WinError()'s confusion between errno and winerror.

743 744 745 746 747
- Issue #16076: Made _elementtree.Element pickleable in a way that is compatible
  with the Python Element. Pickling/unpickling of xml.etree.ElementTree.Element
  works again - this was a temporary regression from 3.2 where the by-default
  imported _elementtree had no pickling capability.

748 749 750
- Issue #16089: Allow ElementTree.TreeBuilder to work again with a non-Element
  element_factory (fixes a regression in SimpleTAL).

751
- Issue #16913: Fix Element.itertext()'s handling of text with XML entities.,
752

753 754
- Issue #16034: Fix performance regressions in the new `bz2.BZ2File`
  implementation.  Initial patch by Serhiy Storchaka.
755

756 757 758
- Issue #16112: platform.architecture does not correctly escape argument to
  /usr/bin/file.  Patch by David Benjamin.

759 760 761
- Issue #15756: `subprocess.poll()` now properly handles `errno.ECHILD` to
  return a returncode of 0 when the child has already exited or cannot be waited
  on.
762

763
- Issue #15323: Improve failure message of `Mock.assert_called_once_with()`.
764

765
- Issue #16064: ``unittest -m`` claims executable is "python", not "python3".
766

767
- Issue #12376: Pass on parameters in `TextTestResult.__init__()` super call.
768

769
- Issue #15222: Insert blank line after each message in mbox mailboxes.
770

771
- Issue #16013: Fix `csv.Reader` parsing issue with ending quote characters.
772 773
  Patch by Serhiy Storchaka.

774 775
- Issue #15421: Fix an OverflowError in `Calendar.itermonthdates()` after
  `datetime.MAXYEAR`.  Patch by Cédric Krier.
776

777
- Issue #15970: `xml.etree.ElementTree` now serializes correctly the empty HTML
778 779
  elements 'meta' and 'param'.

780 781
- Issue #15842: The `SocketIO.{readable,writable,seekable}` methods now raise
  ValueError when the file-like object is closed.  Patch by Alessandro Moura.
782

783
- Issue #15876: Fix a refleak in the `curses` module: window.encoding.
784

785 786
- Issue #15881: Fix `atexit` hook in `multiprocessing`.  Original patch by Chris
  McDonough.
787

788 789 790
- Issue #15841: The readable(), writable() and seekable() methods of
  `io.BytesIO` and `io.StringIO` objects now raise ValueError when the object
  has been closed.  Patch by Alessandro Moura.
791

792 793 794
- Issue #16126: PyErr_Format format mismatch in _testcapimodule.c.
  Patch by Serhiy Storchaka.

795 796
- Issue #15447: Use `subprocess.DEVNULL` in webbrowser, instead of opening
  `os.devnull` explicitly and leaving it open.
797

798 799
- Issue #15509: `webbrowser.UnixBrowser` no longer passes empty arguments to
  Popen when ``%action`` substitutions produce empty strings.
800

801 802 803 804 805
- Issue #12776, issue #11839: Call `argparse` type function (specified by
  add_argument) only once.  Before, the type function was called twice in the
  case where the default was specified and the argument was given as well.  This
  was especially problematic for the FileType type, as a default file would
  always be opened, even if a file argument was specified on the command line.
806

807 808
- Issue #15906: Fix a regression in `argparse` caused by the preceding change,
  when ``action='append'``, ``type='str'`` and ``default=[]``.
809

810 811
- Issue #12268: The io module file object write methods no longer abort early
  when one of its write system calls is interrupted (EINTR).
812

813 814 815
Tests
-----

816 817
- Issue #17448: test_sax now skips if there are no xml parsers available
  instead of raising an ImportError.
818

Ezio Melotti's avatar
Ezio Melotti committed
819 820
- Issue #11420: make test suite pass with -B/DONTWRITEBYTECODE set.
  Initial patch by Thomas Wouters.
821

822 823
- Issue #10652: make tcl/tk tests run after __all__ test, patch by
  Zachary Ware.
824

Ezio Melotti's avatar
Ezio Melotti committed
825
- Issue #11963: remove human verification from test_parser and test_subprocess.
826

827 828
- Issue #11732: add a new suppress_crash_popup() context manager to test.support
  that disables crash popups on Windows and use it in test_faulthandler and
829
  test_capi.
830

831
- Issue #13898: test_ssl no longer prints a spurious stack trace on Ubuntu.
832

Ezio Melotti's avatar
Ezio Melotti committed
833
- Issue #17249: convert a test in test_capi to use unittest and reap threads.
834

835 836
- Issue #17041: Fix testing when Python is configured with the
  --without-doc-strings.
837

838 839
- Issue #16923: Fix ResourceWarnings in test_ssl.

840
- Issue #15539: Added regression tests for Tools/scripts/pindent.py.
841

842 843 844
- Issue #17479: test_io now works with unittest test discovery.
  Patch by Zachary Ware.

845 846 847
- Issue #17066: test_robotparser now works with unittest test discovery.
  Patch by Zachary Ware.

848 849
- Issue #17334: test_index now works with unittest test discovery.
  Patch by Zachary Ware.
850

851 852 853
- Issue #17333: test_imaplib now works with unittest test discovery.
  Patch by Zachary Ware.

854 855 856
- Issue #17082: test_dbm* now work with unittest test discovery.
  Patch by Zachary Ware.

857 858 859
- Issue #17079: test_ctypes now works with unittest test discovery.
  Patch by Zachary Ware.

860 861 862
- Issue #17304: test_hash now works with unittest test discovery.
  Patch by Zachary Ware.

863 864 865
- Issue #17303: test_future* now work with unittest test discovery.
  Patch by Zachary Ware.

866 867 868
- Issue #17163: test_file now works with unittest test discovery.
  Patch by Zachary Ware.

869 870 871
- Issue #16925: test_configparser now works with unittest test discovery.
  Patch by Zachary Ware.

872 873 874
- Issue #16918: test_codecs now works with unittest test discovery.
  Patch by Zachary Ware.

875 876 877
- Issue #16919: test_crypt now works with unittest test discovery.
  Patch by Zachary Ware.

878 879 880
- Issue #16910: test_bytes, test_unicode, and test_userstring now work with
  unittest test discovery.  Patch by Zachary Ware.

881 882 883
- Issue #16905: test_warnings now works with unittest test discovery.
  Initial patch by Berker Peksag.

884 885 886
- Issue #16898: test_bufio now works with unittest test discovery.
  Patch by Zachary Ware.

887 888 889
- Issue #16888: test_array now works with unittest test discovery.
  Patch by Zachary Ware.

890 891 892
- Issue #16896: test_asyncore now works with unittest test discovery.
  Patch by Zachary Ware.

893 894 895
- Issue #16897: test_bisect now works with unittest test discovery.
  Initial patch by Zachary Ware.

896 897 898
- Issue #16852: test_genericpath, test_posixpath, test_ntpath, and test_macpath
  now work with unittest test discovery.  Patch by Zachary Ware.

899 900
- Issue #16748: test_heapq now works with unittest test discovery.

901 902
- Issue #15324: Fix regrtest parsing of --fromfile, --match, and --randomize
  options.
903

904 905
- Issue #16664: Add regression tests for glob's behaviour concerning entries
  starting with a ".".  Patch by Sebastian Kreft.
906

Ezio Melotti's avatar
Ezio Melotti committed
907 908
- Issue #16559: Add more tests for the json module, including some from the
  official test suite at json.org.  Patch by Serhiy Storchaka.
909

910 911 912
- Issue #16661: Fix the `os.getgrouplist()` test by not assuming that it gives
  the same output as :command:`id -G`.

913 914 915
- Issue #16115: Add some tests for the executable argument to
  subprocess.Popen().  Initial patch by Kushal Das.

916 917
- Issue #15304: Fix warning message when `os.chdir()` fails inside
  `test.support.temp_cwd()`.  Patch by Chris Jerdonek.
918

919 920
- Issue #15802: Fix test logic in `TestMaildir.test_create_tmp()`. Patch by
  Serhiy Storchaka.
921

922 923
- Issue #15557: Add a test suite for the `webbrowser` module, thanks to Anton
  Barkovsky.
924

Ned Deily's avatar
Ned Deily committed
925 926
- Issue #16698: Skip posix test_getgroups when built with OS X
  deployment target prior to 10.6.
927

928 929 930
Build
-----

Benjamin Peterson's avatar
Benjamin Peterson committed
931 932
- Issue #17550: Fix the --enable-profiling configure switch.

933 934
- Issue #17425: Build with openssl 1.0.1d on Windows.

935 936 937
- Issue #16754: Fix the incorrect shared library extension on linux. Introduce
  two makefile macros SHLIB_SUFFIX and EXT_SUFFIX. SO now has the value of
  SHLIB_SUFFIX again (as in 2.x and 3.1). The SO macro is removed in 3.4.
938

939 940
- Issue #5033: Fix building of the sqlite3 extension module when the
  SQLite library version has "beta" in it. Patch by Andreas Pelme.
941

942 943
- Issue #17228: Fix building without pymalloc.

944 945
- Issue #3718: Use AC_ARG_VAR to set MACHDEP in configure.ac.

946 947
- Issue #17031: Fix running regen in cross builds.

948
- Issue #3754: fix typo in pthread AC_CACHE_VAL.
949

950 951 952
- Issue #15484: Fix _PYTHON_PROJECT_BASE for srcdir != builddir builds;
  use _PYTHON_PROJECT_BASE in distutils/sysconfig.py.

953
- Issue #17029: Let h2py search the multiarch system include directory.
954

955 956
- Issue #16953: Fix socket module compilation on platforms with
  HAVE_BROKEN_POLL. Patch by Jeffrey Armstrong.
957

958
- Issue #16836: Enable IPv6 support even if IPv6 is disabled on the build host.
959

960 961 962
- Cross compiling needs host and build settings. configure no longer
  creates a broken PYTHON_FOR_BUILD variable when --build is missing.

963 964 965
- Fix cross compiling issue in setup.py, ensure that lib_dirs and inc_dirs are
  defined in cross compiling mode, too.

966
- Issue #16593: Have BSD 'make -s' do the right thing, thanks to Daniel Shahaf
967

968
- Issue #16262: fix out-of-src-tree builds, if mercurial is not installed.
969

970 971 972
- Issue #15298: ensure _sysconfigdata is generated in build directory, not
  source directory.

973 974 975 976
- Issue #15833: Fix a regression in 3.3 that resulted in exceptions being
  raised if importlib failed to write byte-compiled files.  This affected
  attempts to build Python out-of-tree from a read-only source directory.

977 978
- Issue #15923: Fix a mistake in ``asdl_c.py`` that resulted in a TypeError
  after 2801bf875a24 (see #15801).
979

980 981
- Issue #15819: Make sure we can build Python out-of-tree from a read-only
  source directory.  (Somewhat related to issue #9860.)
982

Ned Deily's avatar
Ned Deily committed
983 984 985
- Issue #15587: Enable Tk high-resolution text rendering on Macs with
  Retina displays.  Applies to Tkinter apps, such as IDLE, on OS X
  framework builds linked with Cocoa Tk 8.5.
986

987
- Issue #17161: make install now also installs a python3 man page.
988

Ezio Melotti's avatar
Ezio Melotti committed
989 990
Tools/Demos
-----------
991

Ezio Melotti's avatar
Ezio Melotti committed
992 993
- Issue #13301: use ast.literal_eval() instead of eval() in Tools/i18n/msgfmt.py
  Patch by Serhiy Storchaka.
994

995 996 997
Documentation
-------------

998
- Issue 17538: Document XML vulnerabilties
Barry Warsaw's avatar
Barry Warsaw committed
999

1000 1001 1002
- Issue #16642: sched.scheduler timefunc initial default is time.monotonic.
  Patch by Ramchandra Apte

1003 1004
- Issue #17047: remove doubled words in docs and docstrings
  reported by Serhiy Storchaka and Matthew Barnett.
1005

1006 1007 1008
- Issue #15465: Document the versioning macros in the C API docs rather than
  the standard library docs. Patch by Kushal Das.

1009
- Issue #16406: Combine the pages for uploading and registering to PyPI.
1010

1011 1012
- Issue #16403: Document how distutils uses the maintainer field in
  PKG-INFO. Patch by Jyrki Pulliainen.
1013

1014 1015
- Issue #16695: Document how glob handles filenames starting with a
  dot. Initial patch by Jyrki Pulliainen.
1016

1017 1018 1019
- Issue #8890: Stop advertising an insecure practice by replacing uses
  of the /tmp directory with better alternatives in the documentation.
  Patch by Geoff Wilson.
1020

1021
- Issue #17203: add long option names to unittest discovery docs.
1022

Ezio Melotti's avatar
Ezio Melotti committed
1023 1024
- Issue #13094: add "Why do lambdas defined in a loop with different values
  all return the same result?" programming FAQ.
1025

Brian Curtin's avatar
Brian Curtin committed
1026 1027
- Issue #14901: Update portions of the Windows FAQ.
  Patch by Ashish Nitin Patil.
1028

1029 1030 1031
- Issue #16267: Better document the 3.3+ approach to combining
  @abstractmethod with @staticmethod, @classmethod and @property

1032 1033 1034
- Issue #15209: Clarify exception chaining description in exceptions module
  documentation

1035
- Issue #15990: Improve argument/parameter documentation.
1036

1037 1038 1039
- Issue #16209: Move the documentation for the str built-in function to a new
  str class entry in the "Text Sequence Type" section.

1040 1041
- Issue #13538: Improve str() and object.__str__() documentation.

1042 1043 1044
- Issue #16489: Make it clearer that importlib.find_loader() requires any and
  all packages to be separately imported.

1045 1046
- Issue #16400: Update the description of which versions of a given package
  PyPI displays.
1047

1048 1049
- Issue #15677: Document that zlib and gzip accept a compression level of 0 to
  mean 'no compression'. Patch by Brian Brazil.
1050

Ezio Melotti's avatar
Ezio Melotti committed
1051 1052
- Issue #8040: added a version switcher to the documentation.  Patch by
  Yury Selivanov.
1053

1054 1055 1056
- Additional comments and some style changes in the concurrent.futures URL
  retrieval example

1057 1058 1059
- Issue #16115: Improve subprocess.Popen() documentation around args, shell,
  and executable arguments.

1060
- Issue #15533: Clarify docs and add tests for `subprocess.Popen()`'s cwd
1061
  argument.
1062

Ezio Melotti's avatar
Ezio Melotti committed
1063 1064
- Issue #15979: Improve timeit documentation.

1065
- Issue #16036: Improve documentation of built-in `int()`'s signature and
1066 1067
  arguments.

1068
- Issue #15935: Clarification of `argparse` docs, re: add_argument() type and
1069 1070 1071 1072 1073
  default arguments.  Patch contributed by Chris Jerdonek.

- Issue #11964: Document a change in v3.2 to the behavior of the indent
  parameter of json encoding operations.

Ned Deily's avatar
Ned Deily committed
1074 1075
- Issue #15116: Remove references to appscript as it is no longer being
  supported.
1076

Serhiy Storchaka's avatar
Serhiy Storchaka committed
1077 1078
- Issue #15116: Remove references to appscript as it is no longer being
  supported.
1079

1080 1081 1082
Tools/Demos
-----------

1083 1084 1085 1086
- Issue #15539: Fix a number of bugs in Tools/scripts/pindent.py.  Now
  pindent.py works with a "with" statement.  pindent.py no longer produces
  improper indentation.  pindent.py now works with continued lines broken after
  "class" or "def" keywords and with continuations at the start of line.
1087

1088
- Issue #15378: Fix Tools/unicode/comparecodecs.py.  Patch by Serhiy Storchaka.
Ronald Oussoren's avatar
Ronald Oussoren committed
1089

1090

Georg Brandl's avatar
Georg Brandl committed
1091 1092 1093
What's New in Python 3.3.0?
===========================

Georg Brandl's avatar
Georg Brandl committed
1094
*Release date: 29-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
1095 1096 1097 1098

Core and Builtins
-----------------

1099 1100
- Issue #16046: Fix loading sourceless legacy .pyo files.

1101 1102
- Issue #16060: Fix refcounting bug when `__trunc__()` returns an object whose
  `__int__()` gives a non-integer.  Patch by Serhiy Storchaka.
1103

1104 1105 1106
Extension Modules
-----------------

1107
- Issue #16012: Fix a regression in pyexpat. The parser's `UseForeignDTD()`
1108 1109
  method doesn't require an argument again.

Georg Brandl's avatar
Georg Brandl committed
1110

1111
What's New in Python 3.3.0 Release Candidate 3?
Georg Brandl's avatar
Georg Brandl committed
1112
===============================================
1113

Georg Brandl's avatar
Georg Brandl committed
1114
*Release date: 23-Sep-2012*
1115 1116 1117 1118

Core and Builtins
-----------------

1119
- Issue #15900: Fix reference leak in `PyUnicode_TranslateCharmap()`.
1120

1121 1122
- Issue #15926: Fix crash after multiple reinitializations of the interpreter.

1123
- Issue #15895: Fix FILE pointer leak in one error branch of
1124 1125
  `PyRun_SimpleFileExFlags()` when filename points to a pyc/pyo file, closeit is
  false an and set_main_loader() fails.
1126

1127 1128
- Fixes for a few crash and memory leak regressions found by Coverity.

1129 1130 1131
Library
-------

1132 1133 1134 1135
- Issue #15882: Change `_decimal` to accept any coefficient tuple when
  constructing infinities. This is done for backwards compatibility with
  decimal.py: Infinity coefficients are undefined in _decimal (in accordance
  with the specification).
1136

1137 1138
- Issue #15925: Fix a regression in `email.util` where the `parsedate()` and
  `parsedate_tz()` functions did not return None anymore when the argument could
1139 1140
  not be parsed.

Georg Brandl's avatar
Georg Brandl committed
1141 1142 1143
Extension Modules
-----------------

1144 1145 1146
- Issue #15973: Fix a segmentation fault when comparing datetime timezone
  objects.

Georg Brandl's avatar
Georg Brandl committed
1147 1148 1149
- Issue #15977: Fix memory leak in Modules/_ssl.c when the function
  _set_npn_protocols() is called multiple times, thanks to Daniel Sommermann.

1150
- Issue #15969: `faulthandler` module: rename dump_tracebacks_later() to
1151 1152 1153
  dump_traceback_later() and cancel_dump_tracebacks_later() to
  cancel_dump_traceback_later().

1154
- _decimal module: use only C 89 style comments.
Georg Brandl's avatar
Georg Brandl committed
1155

1156

Georg Brandl's avatar
Georg Brandl committed
1157 1158 1159
What's New in Python 3.3.0 Release Candidate 2?
===============================================

Georg Brandl's avatar
Georg Brandl committed
1160
*Release date: 09-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
1161 1162 1163 1164

Core and Builtins
-----------------

1165
- Issue #13992: The trashcan mechanism is now thread-safe.  This eliminates
1166 1167
  sporadic crashes in multi-thread programs when several long deallocator chains
  ran concurrently and involved subclasses of built-in container types.
1168

1169 1170
- Issue #15784: Modify `OSError`.__str__() to better distinguish between errno
  error numbers and Windows error numbers.
1171

1172 1173
- Issue #15781: Fix two small race conditions in import's module locking.

Georg Brandl's avatar
Georg Brandl committed
1174 1175 1176
Library
-------

1177 1178
- Issue #15847: Fix a regression in argparse, which did not accept tuples as
  argument lists anymore.
1179

1180
- Issue #15828: Restore support for C extensions in `imp.load_module()`.
1181

1182 1183
- Issue #15340: Fix importing the random module when ``/dev/urandom`` cannot be
  opened.  This was a regression caused by the hash randomization patch.
1184

1185
- Issue #10650: Deprecate the watchexp parameter of the `Decimal.quantize()`
1186 1187
  method.

1188 1189 1190 1191
- Issue #15785: Modify `window.get_wch()` API of the curses module: return a
  character for most keys, and an integer for special keys, instead of always
  returning an integer. So it is now possible to distinguish special keys like
  keypad keys.
1192

1193
- Issue #14223: Fix `window.addch()` of the curses module for special characters
1194 1195 1196 1197 1198 1199
  like curses.ACS_HLINE: the Python function addch(int) and addch(bytes) is now
  calling the C function waddch()/mvwaddch() (as it was done in Python 3.2),
  instead of wadd_wch()/mvwadd_wch(). The Python function addch(str) is still
  calling the C function wadd_wch()/mvwadd_wch() if the Python curses is linked
  to libncursesw.

Georg Brandl's avatar
Georg Brandl committed
1200 1201 1202 1203 1204 1205
Build
-----

- Issue #15822: Really ensure 2to3 grammar pickles are properly installed
  (replaces fixes for Issue #15645).

1206 1207 1208
Documentation
-------------

1209 1210 1211 1212
- Issue #15814: The memoryview enhancements in 3.3.0 accidentally permitted the
  hashing of multi-dimensional memorviews and memoryviews with multi-byte item
  formats. The intended restrictions have now been documented - they will be
  correctly enforced in 3.3.1.
1213

Georg Brandl's avatar
Georg Brandl committed
1214

Georg Brandl's avatar
Georg Brandl committed
1215 1216 1217
What's New in Python 3.3.0 Release Candidate 1?
===============================================

Georg Brandl's avatar
Georg Brandl committed
1218
*Release date: 25-Aug-2012*
Georg Brandl's avatar
Georg Brandl committed
1219 1220 1221 1222

Core and Builtins
-----------------

1223
- Issue #15573: memoryview comparisons are now performed by value with full
1224
  support for any valid struct module format definition.
1225

1226
- Issue #15316: When an item in the fromlist for `__import__()` doesn't exist,
1227 1228 1229
  don't raise an error, but if an exception is raised as part of an import do
  let that propagate.

1230 1231
- Issue #15778: Ensure that ``str(ImportError(msg))`` returns a str even when
  msg isn't a str.
1232

1233 1234 1235 1236
- Issue #2051: Source file permission bits are once again correctly copied to
  the cached bytecode file. (The migration to importlib reintroduced this
  problem because these was no regression test. A test has been added as part of
  this patch)
1237

1238
- Issue #15761: Fix crash when ``PYTHONEXECUTABLE`` is set on Mac OS X.
1239

1240 1241
- Issue #15726: Fix incorrect bounds checking in PyState_FindModule.  Patch by
  Robin Schreiber.
1242

1243
- Issue #15604: Update uses of `PyObject_IsTrue()` to check for and handle
1244 1245
  errors correctly.  Patch by Serhiy Storchaka.

1246 1247
- Issue #14846: `importlib.FileFinder` now handles the case where the directory
  being searched is removed after a previous import attempt.
1248

Georg Brandl's avatar
Georg Brandl committed
1249 1250 1251
Library
-------

1252 1253
- Issue #13370: Ensure that ctypes works on Mac OS X when Python is compiled
  using the clang compiler.
1254

1255 1256
- Issue #13072: The array module's 'u' format code is now deprecated and will be
  removed in Python 4.0.
1257

1258 1259
- Issue #15544: Fix Decimal.__float__ to work with payload-carrying NaNs.

1260 1261
- Issue #15776: Allow pyvenv to work in existing directory with --clean.

1262
- Issue #15249: email's BytesGenerator now correctly mangles From lines (when
1263
  requested) even if the body contains undecodable bytes.
1264

Ross Lagerwall's avatar
Ross Lagerwall committed
1265
- Issue #15777: Fix a refleak in _posixsubprocess.
1266

1267
- Issue ##665194: Update `email.utils.localtime` to use datetime.astimezone and
1268 1269
  correctly handle historic changes in UTC offsets.

1270 1271
- Issue #15199: Fix JavaScript's default MIME type to application/javascript.
  Patch by Bohuslav Kabrda.
1272

1273 1274
- Issue #12643: `code.InteractiveConsole` now respects `sys.excepthook` when
  displaying exceptions.  Patch by Aaron Iles.
1275

1276
- Issue #13579: `string.Formatter` now understands the 'a' conversion specifier.
1277

1278 1279
- Issue #15595: Fix ``subprocess.Popen(universal_newlines=True)`` for certain
  locales (utf-16 and utf-32 family). Patch by Chris Jerdonek.
1280

1281 1282
- Issue #15477: In cmath and math modules, add workaround for platforms whose
  system-supplied log1p function doesn't respect signs of zeros.
1283

1284 1285
- Issue #15715: `importlib.__import__()` will silence an ImportError when the
  use of fromlist leads to a failed import.
1286

1287 1288 1289
- Issue #14669: Fix pickling of connections and sockets on Mac OS X by
  sending/receiving an acknowledgment after file descriptor transfer.
  TestPicklingConnection has been reenabled for Mac OS X.
1290

1291
- Issue #11062: Fix adding a message from file to Babyl mailbox.
1292

1293 1294
- Issue #15646: Prevent equivalent of a fork bomb when using `multiprocessing`
  on Windows without the ``if __name__ == '__main__'`` idiom.
1295

1296 1297
- Issue #15678: Fix IDLE menus when started from OS X command line (3.3.0b2
  regression).
1298

Senthil Kumaran's avatar
Senthil Kumaran committed
1299 1300
C API
-----
1301

Senthil Kumaran's avatar
Senthil Kumaran committed
1302 1303
Extension Modules
-----------------
1304

Senthil Kumaran's avatar
Senthil Kumaran committed
1305 1306
Tools/Demos
-----------
1307

Senthil Kumaran's avatar
Senthil Kumaran committed
1308 1309
Documentation
-------------
1310

1311 1312
- Touched up the Python 2 to 3 porting guide.

1313
- Issue #14674: Add a discussion of the `json` module's standard compliance.
1314
  Patch by Chris Rebert.
1315

1316 1317
- Create a 'Concurrent Execution' section in the docs, and split up the
  'Optional Operating System Services' section to use a more user-centric
1318
  classification scheme (splitting them across the new CE section, IPC and text
1319
  processing). Operating system limitations can be reflected with the Sphinx
1320
  ``:platform:`` tag, it doesn't make sense as part of the Table of Contents.
1321

1322 1323
- Issue #4966: Bring the sequence docs up to date for the Py3k transition and
  the many language enhancements since they were original written.
1324

1325
- The "path importer" misnomer has been replaced with Eric Snow's
1326 1327
  more-awkward-but-at-least-not-wrong suggestion of "path based finder" in the
  import system reference docs.
1328

1329
- Issue #15640: Document `importlib.abc.Finder` as deprecated.
1330

1331
- Issue #15630: Add an example for "continue" stmt in the tutorial.  Patch by
Senthil Kumaran's avatar
Senthil Kumaran committed
1332
  Daniel Ellis.
1333

1334 1335
Tests
-----
1336

1337
- Issue #15747: ZFS always returns EOPNOTSUPP when attempting to set the
1338 1339
  UF_IMMUTABLE flag (via either chflags or lchflags); refactor affected tests in
  test_posix.py to account for this.
1340

1341 1342
- Issue #15285: Refactor the approach for testing connect timeouts using two
  external hosts that have been configured specifically for this type of test.
1343

1344
- Issue #15743: Remove the deprecated method usage in `urllib` tests. Patch by
1345 1346
  Jeff Knupp.

1347 1348
- Issue #15615: Add some tests for the `json` module's handling of invalid input
  data.  Patch by Kushal Das.
1349

1350 1351 1352
Build
-----

1353 1354
- Output lib files for PGO build into PGO directory.

1355 1356
- Pick up 32-bit launcher from PGO directory on 64-bit PGO build.

1357
- Drop ``PC\python_nt.h`` as it's not used.  Add input dependency on custom
1358 1359
  build step.

1360 1361
- Issue #15511: Drop explicit dependency on pythonxy.lib from _decimal amd64
  configuration.
1362

1363 1364
- Add missing PGI/PGO configurations for pywlauncher.

1365 1366
- Issue #15645: Ensure 2to3 grammar pickles are properly installed.

Georg Brandl's avatar
Georg Brandl committed
1367

1368 1369 1370
What's New in Python 3.3.0 Beta 2?
==================================

Georg Brandl's avatar
Georg Brandl committed
1371
*Release date: 12-Aug-2012*
1372

1373 1374 1375
Core and Builtins
-----------------

1376
- Issue #15568: Fix the return value of ``yield from`` when StopIteration is
1377 1378
  raised by a custom iterator.

1379
- Issue #13119: `sys.stdout` and `sys.stderr` are now using "\r\n" newline on
1380 1381
  Windows, as Python 2.

1382 1383
- Issue #15534: Fix the fast-search function for non-ASCII Unicode strings.

1384
- Issue #15508: Fix the docstring for `__import__()` to have the proper default
Georg Brandl's avatar
Georg Brandl committed
1385 1386
  value of 0 for 'level' and to not mention negative levels since they are not
  supported.
1387

1388
- Issue #15425: Eliminated traceback noise from more situations involving
Georg Brandl's avatar
Georg Brandl committed
1389
  importlib.
1390

1391 1392
- Issue #14578: Support modules registered in the Windows registry again.

Georg Brandl's avatar
Georg Brandl committed
1393 1394
- Issue #15466: Stop using TYPE_INT64 in marshal, to make importlib.h (and other
  byte code files) equal between 32-bit and 64-bit systems.
1395

Georg Brandl's avatar
Georg Brandl committed
1396
- Issue #1692335: Move initial exception args assignment to
1397
  `BaseException.__new__()` to help pickling of naive subclasses.
1398

1399
- Issue #12834: Fix `PyBuffer_ToContiguous()` for non-contiguous arrays.
1400

1401
- Issue #15456: Fix code `__sizeof__()` after #12399 change.  Patch by Serhiy
Georg Brandl's avatar
Georg Brandl committed
1402
  Storchaka.
1403

1404 1405
- Issue #15404: Refleak in PyMethodObject repr.

1406 1407
- Issue #15394: An issue in `PyModule_Create()` that caused references to be
  leaked on some error paths has been fixed.  Patch by Julia Lawall.
1408

Georg Brandl's avatar
Georg Brandl committed
1409 1410
- Issue #15368: An issue that caused bytecode generation to be non-deterministic
  has been fixed.
1411

Georg Brandl's avatar
Georg Brandl committed
1412 1413
- Issue #15202: Consistently use the name "follow_symlinks" for new parameters
  in os and shutil functions.
1414

1415
- Issue #15314: ``__main__.__loader__`` is now set correctly during interpreter
Georg Brandl's avatar
Georg Brandl committed
1416
  startup.
1417

1418 1419 1420 1421
- Issue #15111: When a module imported using 'from import' has an ImportError
  inside itself, don't mask that fact behind a generic ImportError for the
  module itself.

1422 1423
- Issue #15293: Add GC support to the AST base node type.

1424 1425 1426
- Issue #15291: Fix a memory leak where AST nodes where not properly
  deallocated.

Georg Brandl's avatar
Georg Brandl committed
1427 1428
- Issue #15110: Fix the tracebacks generated by "import xxx" to not show the
  importlib stack frames.
1429

1430
- Issue #16369: Global PyTypeObjects not initialized with PyType_Ready(...).
Ronald Oussoren's avatar
Ronald Oussoren committed
1431

1432 1433 1434
- Issue #15020: The program name used to search for Python's path is now
  "python3" under Unix, not "python".

1435 1436
- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.
1437

Ezio Melotti's avatar
Ezio Melotti committed
1438
- Issue #15033: Fix the exit status bug when modules invoked using -m switch,
1439 1440
  return the proper failure return value (1). Patch contributed by Jeff Knupp.

1441
- Issue #15229: An `OSError` subclass whose __init__ doesn't call back
Georg Brandl's avatar
Georg Brandl committed
1442 1443
  OSError.__init__ could produce incomplete instances, leading to crashes when
  calling str() on them.
1444

Ezio Melotti's avatar
Ezio Melotti committed
1445
- Issue #15307: Virtual environments now use symlinks with framework builds on
Georg Brandl's avatar
Georg Brandl committed
1446
  Mac OS X, like other POSIX builds.
1447

1448 1449 1450
Library
-------

1451 1452 1453
- Issue #14590: configparser now correctly strips inline comments when delimiter
  occurs earlier without preceding space.

1454
- Issue #15424: Add a `__sizeof__()` implementation for array objects.  Patch by
Georg Brandl's avatar
Georg Brandl committed
1455
  Ludwig Hähne.
1456

1457 1458
- Issue #15576: Allow extension modules to act as a package's __init__ module.

1459 1460
- Issue #15502: Have `importlib.invalidate_caches()` work on `sys.meta_path`
  instead of `sys.path_importer_cache`.
1461

1462 1463
- Issue #15163: Pydoc shouldn't list __loader__ as module data.

1464
- Issue #15471: Do not use mutable objects as defaults for
1465
  `importlib.__import__()`.
1466

1467
- Issue #15559: To avoid a problematic failure mode when passed to the bytes
1468 1469
  constructor, objects in the ipaddress module no longer implement `__index__()`
  (they still implement `__int__()` as appropriate).
1470

1471 1472
- Issue #15546: Fix handling of pathological input data in the peek() and
  read1() methods of the BZ2File, GzipFile and LZMAFile classes.
1473

1474
- Issue #13052: Fix IDLE crashing when replace string in Search/Replace dialog
1475
  ended with ``\``.  Patch by Roger Serwy.
1476

1477 1478 1479
- Issue #12655: Instead of requiring a custom type, `os.sched_getaffinity()` and
  `os.sched_setaffinity()` now use regular sets of integers to represent the
  CPUs a process is restricted to.
1480

1481 1482
- Issue #15538: Fix compilation of the `socket.getnameinfo()` /
  `socket.getaddrinfo()` emulation code.  Patch by Philipp Hagemeister.
1483

Georg Brandl's avatar
Georg Brandl committed
1484
- Issue #15519: Properly expose WindowsRegistryFinder in importlib (and use the
1485
  correct term for it).  Original patch by Eric Snow.
1486

Georg Brandl's avatar
Georg Brandl committed
1487
- Issue #15502: Bring the importlib ABCs into line with the current state of the
1488
  import protocols given PEP 420.  Original patch by Eric Snow.
1489

Georg Brandl's avatar
Georg Brandl committed
1490 1491
- Issue #15499: Launching a webbrowser in Unix used to sleep for a few seconds.
  Original patch by Anton Barkovsky.
1492

Georg Brandl's avatar
Georg Brandl committed
1493 1494
- Issue #15463: The faulthandler module truncates strings to 500 characters,
  instead of 100, to be able to display long file paths.
1495

1496
- Issue #6056: Make `multiprocessing` use setblocking(True) on the sockets it
Georg Brandl's avatar
Georg Brandl committed
1497
  uses.  Original patch by J Derek Wilson.
1498

Georg Brandl's avatar
Georg Brandl committed
1499
- Issue #15364: Fix sysconfig.get_config_var('srcdir') to be an absolute path.
1500

Georg Brandl's avatar
Georg Brandl committed
1501
- Issue #15041: Update "see also" list in tkinter documentation.
1502

1503
- Issue #15413: `os.times()` had disappeared under Windows.
1504

1505
- Issue #15402: An issue in the struct module that caused `sys.getsizeof()` to
Georg Brandl's avatar
Georg Brandl committed
1506 1507
  return incorrect results for struct.Struct instances has been fixed.  Initial
  patch by Serhiy Storchaka.
1508

1509 1510 1511
- Issue #15232: When mangle_from is True, `email.Generator` now correctly
  mangles lines that start with 'From ' that occur in a MIME preamble or
  epilogue.
1512

Georg Brandl's avatar
Georg Brandl committed
1513 1514
- Issue #15094: Incorrectly placed #endif in _tkinter.c.  Patch by Serhiy
  Storchaka.
1515

1516
- Issue #13922: `argparse` no longer incorrectly strips '--'s that appear after
Georg Brandl's avatar
Georg Brandl committed
1517
  the first one.
1518

1519
- Issue #12353: `argparse` now correctly handles null argument values.
1520

Georg Brandl's avatar
Georg Brandl committed
1521
- Issue #10017, issue #14998: Fix TypeError using pprint on dictionaries with
1522
  user-defined types as keys or other unorderable keys.
1523

1524 1525
- Issue #15397: `inspect.getmodulename()` is now based directly on importlib via
  a new `importlib.machinery.all_suffixes()` API.
1526

1527
- Issue #14635: `telnetlib` will use poll() rather than select() when possible to
Georg Brandl's avatar
Georg Brandl committed
1528
  avoid failing due to the select() file descriptor limit.
1529

Georg Brandl's avatar
Georg Brandl committed
1530
- Issue #15180: Clarify posixpath.join() error message when mixing str & bytes.
1531

Georg Brandl's avatar
Georg Brandl committed
1532 1533 1534
- Issue #15343: pkgutil now includes an iter_importer_modules implementation for
  importlib.machinery.FileFinder (similar to the way it already handled
  zipimport.zipimporter).
1535

Georg Brandl's avatar
Georg Brandl committed
1536
- Issue #15314: runpy now sets __main__.__loader__ correctly.
1537

Georg Brandl's avatar
Georg Brandl committed
1538 1539
- Issue #15357: The import emulation in pkgutil is now deprecated. pkgutil uses
  importlib internally rather than the emulation.
1540

Georg Brandl's avatar
Georg Brandl committed
1541 1542
- Issue #15233: Python now guarantees that callables registered with the atexit
  module will be called in a deterministic order.
1543

1544
- Issue #15238: `shutil.copystat()` now copies Linux "extended attributes".
1545

Georg Brandl's avatar
Georg Brandl committed
1546 1547
- Issue #15230: runpy.run_path now correctly sets __package__ as described in
  the documentation.
Nick Coghlan's avatar
Nick Coghlan committed
1548

1549 1550
- Issue #15315: Support VS 2010 in distutils cygwincompiler.

Georg Brandl's avatar
Georg Brandl committed
1551 1552
- Issue #15294: Fix a regression in pkgutil.extend_path()'s handling of nested
  namespace packages.
1553

1554 1555
- Issue #15056: `imp.cache_from_source()` and `imp.source_from_cache()` raise
  NotImplementedError when `sys.implementation.cache_tag` is set to None.
1556

1557
- Issue #15256: Grammatical mistake in exception raised by `imp.find_module()`.
1558

1559
- Issue #5931: `wsgiref` environ variable SERVER_SOFTWARE will specify an
Georg Brandl's avatar
Georg Brandl committed
1560
  implementation specific term like CPython, Jython instead of generic "Python".
1561

Georg Brandl's avatar
Georg Brandl committed
1562 1563
- Issue #13248: Remove obsolete argument "max_buffer_size" of BufferedWriter and
  BufferedRWPair, from the io module.
1564

1565
- Issue #13248: Remove obsolete argument "version" of `argparse.ArgumentParser`.
1566

Georg Brandl's avatar
Georg Brandl committed
1567 1568
- Issue #14814: Implement more consistent ordering and sorting behaviour for
  ipaddress objects.
1569

1570
- Issue #14814: `ipaddress` network objects correctly return NotImplemented when
Georg Brandl's avatar
Georg Brandl committed
1571
  compared to arbitrary objects instead of raising TypeError.
1572

Georg Brandl's avatar
Georg Brandl committed
1573
- Issue #14990: Correctly fail with SyntaxError on invalid encoding declaration.
Florent Xicluna's avatar
Florent Xicluna committed
1574

1575
- Issue #14814: `ipaddress` now provides more informative error messages when
1576
  constructing instances directly (changes permitted during beta due to
Georg Brandl's avatar
Georg Brandl committed
1577
  provisional API status).
1578

1579 1580
- Issue #15247: `io.FileIO` now raises an error when given a file descriptor
  pointing to a directory.
1581

1582 1583
- Issue #15261: Stop os.stat(fd) crashing on Windows when fd not open.

1584
- Issue #15166: Implement `imp.get_tag()` using `sys.implementation.cache_tag`.
1585

1586
- Issue #15210: Catch KeyError when `importlib.__init__()` can't find
1587 1588
  _frozen_importlib in sys.modules, not ImportError.

1589
- Issue #15030: `importlib.abc.PyPycLoader` now supports the new source size
1590 1591
  header field in .pyc files.

Georg Brandl's avatar
Georg Brandl committed
1592 1593
- Issue #5346: Preserve permissions of mbox, MMDF and Babyl mailbox files on
  flush().
1594

Georg Brandl's avatar
Georg Brandl committed
1595 1596
- Issue #10571: Fix the "--sign" option of distutils' upload command.  Patch by
  Jakub Wilk.
1597

Georg Brandl's avatar
Georg Brandl committed
1598 1599 1600
- Issue #9559: If messages were only added, a new file is no longer created and
  renamed over the old file when flush() is called on an mbox, MMDF or Babyl
  mailbox.
1601

Ezio Melotti's avatar
Ezio Melotti committed
1602
- Issue #10924: Fixed `crypt.mksalt()` to use a RNG that is suitable for
Georg Brandl's avatar
Georg Brandl committed
1603
  cryptographic purpose.
1604

Georg Brandl's avatar
Georg Brandl committed
1605 1606 1607 1608
- Issue #15184: Ensure consistent results of OS X configuration tailoring for
  universal builds by factoring out common OS X-specific customizations from
  sysconfig, distutils.sysconfig, distutils.util, and distutils.unixccompiler
  into a new module _osx_support.
1609

1610 1611 1612
C API
-----

1613
- Issue #15610: `PyImport_ImportModuleEx()` now uses a 'level' of 0 instead of -1.
1614

1615 1616
- Issue #15169, issue #14599: Strip out the C implementation of
  `imp.source_from_cache()` used by PyImport_ExecCodeModuleWithPathnames() and
1617 1618 1619 1620
  used the Python code instead. Leads to PyImport_ExecCodeModuleObject() to not
  try to infer the source path from the bytecode path as
  PyImport_ExecCodeModuleWithPathnames() does.

1621 1622 1623
Extension Modules
-----------------

1624 1625
- Issue #6493: An issue in ctypes on Windows that caused structure bitfields of
  type `ctypes.c_uint32` and width 32 to incorrectly be set has been fixed.
1626

1627 1628
- Issue #15194: Update libffi to the 3.0.11 release.

1629 1630 1631
Tools/Demos
-----------

Georg Brandl's avatar
Georg Brandl committed
1632 1633
- Issue #15458: python-config gets a new option --configdir to print the $LIBPL
  value.
1634

1635 1636
- Move importlib.test.benchmark to Tools/importbench.

Georg Brandl's avatar
Georg Brandl committed
1637 1638 1639
- Issue #12605: The gdb hooks for debugging CPython (within Tools/gdb) have been
  enhanced to show information on more C frames relevant to CPython within the
  "py-bt" and "py-bt-full" commands:
Georg Brandl's avatar
Georg Brandl committed
1640 1641 1642 1643

  * C frames that are waiting on the GIL
  * C frames that are garbage-collecting
  * C frames that are due to the invocation of a PyCFunction
1644

Terry Jan Reedy's avatar
Terry Jan Reedy committed
1645 1646 1647
Documentation
-------------

1648 1649
- Issue #15444: Use proper spelling for non-ASCII contributor names.  Patch by
  Serhiy Storchaka.
1650

1651
- Issue #15295: Reorganize and rewrite the documentation on the import system.
Barry Warsaw's avatar
Barry Warsaw committed
1652

Georg Brandl's avatar
Georg Brandl committed
1653 1654
- Issue #15230: Clearly document some of the limitations of the runpy module and
  nudge readers towards importlib when appropriate.
1655

1656 1657 1658
- Issue #15053: Copy Python 3.3 import lock change notice to all relevant
  functions in imp instead of just at the top of the relevant section.

1659 1660 1661 1662 1663
- Issue #15288: Link to the term "loader" in notes in pkgutil about how things
  won't work as expected in Python 3.3 and mark the requisite functions as
  "changed" since they will no longer work with modules directly imported by
  import itself.

1664 1665
- Issue #13557: Clarify effect of giving two different namespaces to `exec()` or
  `execfile()`.
Terry Jan Reedy's avatar
Terry Jan Reedy committed
1666

1667
- Issue #15250: Document that `filecmp.dircmp()` compares files shallowly. Patch
1668
  contributed by Chris Jerdonek.
1669

1670 1671 1672
Tests
-----

1673 1674
- Issue #15467: Move helpers for `__sizeof__()` tests into test_support.  Patch
  by Serhiy Storchaka.
1675

Georg Brandl's avatar
Georg Brandl committed
1676 1677
- Issue #15320: Make iterating the list of tests thread-safe when running tests
  in multiprocess mode. Patch by Chris Jerdonek.
1678

1679
- Issue #15168: Move `importlib.test` to `test.test_importlib`.
1680

1681
- Issue #15091: Reactivate a test on UNIX which was failing thanks to a
1682
  forgotten `importlib.invalidate_caches()` call.
1683 1684

- Issue #15230: Adopted a more systematic approach in the runpy tests.
Nick Coghlan's avatar
Nick Coghlan committed
1685

1686 1687 1688 1689
- Issue #15300: Ensure the temporary test working directories are in the same
  parent folder when running tests in multiprocess mode from a Python build.
  Patch by Chris Jerdonek.

1690 1691 1692
- Issue #15284: Skip {send,recv}msg tests in test_socket when IPv6 is not
  enabled. Patch by Brian Brazil.

Georg Brandl's avatar
Georg Brandl committed
1693 1694
- Issue #15277: Fix a resource leak in support.py when IPv6 is disabled.  Patch
  by Brian Brazil.
1695

1696 1697 1698
Build
-----

Georg Brandl's avatar
Georg Brandl committed
1699 1700
- Issue #11715: Fix multiarch detection without having Debian development tools
  (dpkg-dev) installed.
1701

1702 1703 1704 1705
- Issue #15037: Build OS X installers with local copy of ncurses 5.9 libraries
  to avoid curses.unget_wch bug present in older versions of ncurses such as
  those shipped with OS X.

Georg Brandl's avatar
Georg Brandl committed
1706 1707 1708 1709
- Issue #15560: Fix building _sqlite3 extension on OS X with an SDK.  Also, for
  OS X installers, ensure consistent sqlite3 behavior and feature availability
  by building a local copy of libsqlite3 rather than depending on the wide range
  of versions supplied with various OS X releases.
1710

Martin v. Löwis's avatar
Martin v. Löwis committed
1711
- Issue #8847: Disable COMDAT folding in Windows PGO builds.
1712

1713 1714
- Issue #14018: Fix OS X Tcl/Tk framework checking when using OS X SDKs.

Ned Deily's avatar
Ned Deily committed
1715
- Issue #16256: OS X installer now sets correct permissions for doc directory.
1716

Georg Brandl's avatar
Georg Brandl committed
1717 1718
- Issue #15431: Add _freeze_importlib project to regenerate importlib.h on
  Windows. Patch by Kristján Valur Jónsson.
1719

Georg Brandl's avatar
Georg Brandl committed
1720 1721
- Issue #14197: For OS X framework builds, ensure links to the shared library
  are created with the proper ABI suffix.
1722

1723 1724 1725
- Issue #14330: For cross builds, don't use host python, use host search paths
  for host compiler.

1726 1727
- Issue #15235: Allow Berkley DB versions up to 5.3 to build the dbm module.

1728 1729
- Issue #15268: Search curses.h in /usr/include/ncursesw.

1730

1731
What's New in Python 3.3.0 Beta 1?
Georg Brandl's avatar
Georg Brandl committed
1732
==================================
1733

Georg Brandl's avatar
Georg Brandl committed
1734
*Release date: 27-Jun-2012*
1735

Barry Warsaw's avatar
Barry Warsaw committed
1736 1737 1738
Core and Builtins
-----------------

1739 1740 1741
- Fix a (most likely) very rare memory leak when calling main() and not being
  able to decode a command-line argument.

1742 1743 1744
- Issue #14815: Use Py_ssize_t instead of long for the object hash, to
  preserve all 64 bits of hash on Win64.

1745 1746 1747 1748 1749
- Issue #12268: File readline, readlines and read() or readall() methods
  no longer lose data when an underlying read system call is interrupted.
  IOError is no longer raised due to a read system call returning EINTR
  from within these methods.

1750 1751
- Issue #11626: Add _SizeT functions to stable ABI.

1752 1753
- Issue #15146: Add PyType_FromSpecWithBases. Patch by Robin Schreiber.

1754 1755 1756
- Issue #15142: Fix reference leak when deallocating instances of types
  created using PyType_FromSpec().

1757 1758 1759
- Issue #15042: Add PyState_AddModule and PyState_RemoveModule. Add version
  guard for Py_LIMITED_API additions. Patch by Robin Schreiber.

1760 1761 1762
- Issue #10053: Don't close FDs when FileIO.__init__ fails. Loosely based on
  the work by Hirokazu Yamamoto.

1763 1764 1765
- Issue #15096: Removed support for ur'' as the raw notation isn't
  compatible with Python 2.x's raw unicode strings.

1766 1767
- Issue #13783: Generator objects now use the identifier APIs internally

1768 1769 1770
- Issue #14874: Restore charmap decoding speed to pre-PEP 393 levels.
  Patch by Serhiy Storchaka.

1771 1772 1773
- Issue #15026: utf-16 encoding is now significantly faster (up to 10x).
  Patch by Serhiy Storchaka.

1774 1775 1776 1777 1778 1779
- Issue #11022: open() and io.TextIOWrapper are now calling
  locale.getpreferredencoding(False) instead of locale.getpreferredencoding()
  in text mode if the encoding is not specified. Don't change temporary the
  locale encoding using locale.setlocale(), use the current locale encoding
  instead of the user preferred encoding.

Barry Warsaw's avatar
Barry Warsaw committed
1780 1781
- Issue #14673: Add Eric Snow's sys.implementation implementation.

1782 1783
- Issue #15038: Optimize python Locks on Windows.

1784 1785 1786
Library
-------

1787 1788
- Issue #16305: Fix a segmentation fault occurring when interrupting
  math.factorial.
1789

1790 1791
- Issue #9803: Don't close IDLE on saving if breakpoint is open.
  Patch by Roger Serwy.
1792

1793 1794
- Issue #12288: Consider '0' and '0.0' as valid initialvalue
  for tkinter SimpleDialog.
1795

1796 1797
- Issue #15512: Add a __sizeof__ implementation for parser.
  Patch by Serhiy Storchaka.
1798

1799 1800
- Issue #15469: Add a __sizeof__ implementation for deque objects.
  Patch by Serhiy Storchaka.
R David Murray's avatar
R David Murray committed
1801

1802 1803
- Issue #15489: Add a __sizeof__ implementation for BytesIO objects.
  Patch by Serhiy Storchaka.
1804

1805 1806
- Issue #15487: Add a __sizeof__ implementation for buffered I/O objects.
  Patch by Serhiy Storchaka.
1807

1808 1809 1810
- Issue #15514: Correct __sizeof__ support for cpu_set.
  Patch by Serhiy Storchaka.

1811
- Issue #15187: Bugfix: remove temporary directories test_shutil was leaving
1812 1813
  behind.

1814 1815
- Issue #15177: Added dir_fd parameter to os.fwalk().

1816 1817
- Issue #15176: Clarified behavior, documentation, and implementation
  of os.listdir().
1818

1819 1820 1821 1822
- Issue #15061: Re-implemented hmac.compare_digest() in C to prevent further
  timing analysis and to support all buffer protocol aware objects as well as
  ASCII only str instances safely.

1823 1824
- Issue #15164: Change return value of platform.uname() from a
  plain tuple to a collections.namedtuple.
1825

1826 1827 1828 1829
- Support Mageia Linux in the platform module.

- Issue #11678: Support Arch linux in the platform module.

1830 1831 1832 1833
- Issue #15118: Change return value of os.uname() and os.times() from
  plain tuples to immutable iterable objects with named attributes
  (structseq objects).

1834 1835 1836 1837
- Speed up _decimal by another 10-15% by caching the thread local context
  that was last accessed. In the pi benchmark (64-bit platform, prec=9),
  _decimal is now only 1.5x slower than float.

1838 1839
- Remove the packaging module, which is not ready for prime time.

1840 1841 1842
- Issue #15154: Add "dir_fd" parameter to os.rmdir, remove "rmdir"
  parameter from os.remove / os.unlink.

Hynek Schlawack's avatar
Hynek Schlawack committed
1843
- Issue #4489: Add a shutil.rmtree that isn't susceptible to symlink attacks.
1844 1845 1846
  It is used automatically on platforms supporting the necessary os.openat()
  and os.unlinkat() functions. Main code by Martin von Löwis.

1847 1848
- Issue #15156: HTMLParser now uses the new "html.entities.html5" dictionary.

1849 1850 1851 1852
- Issue #11113: add a new "html5" dictionary containing the named character
  references defined by the HTML5 standard and the equivalent Unicode
  character(s) to the html.entities module.

1853 1854 1855
- Issue #15114: the strict mode of HTMLParser and the HTMLParseError exception
  are deprecated now that the parser is able to parse invalid markup.

1856 1857 1858
- Issue #3665: \u and \U escapes are now supported in unicode regular
  expressions.  Patch by Serhiy Storchaka.

1859 1860 1861
- Issue #15153: Added inspect.getgeneratorlocals to simplify white box
  testing of generator state updates

1862 1863 1864 1865
- Issue #13062: Added inspect.getclosurevars to simplify testing stateful
  closures

- Issue #11024: Fixes and additional tests for Time2Internaldate.
1866

1867 1868
- Issue #14626: Large refactoring of functions / parameters in the os module.
  Many functions now support "dir_fd" and "follow_symlinks" parameters;
Ezio Melotti's avatar
Ezio Melotti committed
1869
  some also support accepting an open file descriptor in place of a path
1870 1871 1872 1873 1874
  string.  Added os.support_* collections as LBYL helpers.  Removed many
  functions only previously seen in 3.3 alpha releases (often starting with
  "f" or "l", or ending with "at").  Originally suggested by Serhiy Storchaka;
  implemented by Larry Hastings.

1875 1876 1877
- Issue #15008: Implement PEP 362 "Signature Objects".
  Patch by Yury Selivanov.

1878 1879
- Issue: #15138: base64.urlsafe_{en,de}code() are now 3-4x faster.

1880 1881 1882 1883
- Issue #444582: Add shutil.which, for finding programs on the system path.
  Original patch by Erik Demaine, with later iterations by Jan Killian
  and Brian Curtin.

1884 1885 1886 1887
- Issue #14837: SSL errors now have ``library`` and ``reason`` attributes
  describing precisely what happened and in which OpenSSL submodule.  The
  str() of a SSLError is also enhanced accordingly.

1888 1889 1890
- Issue #9527: datetime.astimezone() method will now supply a class
  timezone instance corresponding to the system local timezone when
  called with no arguments.
1891

1892 1893
- Issue #14653: email.utils.mktime_tz() no longer relies on system
  mktime() when timezone offest is supplied.
1894

1895 1896 1897
- Issue #14684: zlib.compressobj() and zlib.decompressobj() now support the use
  of predefined compression dictionaries. Original patch by Sam Rushing.

1898
- Fix GzipFile's handling of filenames given as bytes objects.
1899

1900 1901
- Issue #14772: Return destination values from some shutil functions.

1902 1903
- Issue #15064: Implement context manager protocol for multiprocessing types

1904
- Issue #15101: Make pool finalizer avoid joining current thread.
1905

1906 1907 1908
- Issue #14657: The frozen instance of importlib used for bootstrap is now
  also the module imported as importlib._bootstrap.

1909 1910
- Issue #14055: Add __sizeof__ support to _elementtree.

1911 1912 1913 1914
- Issue #15054: A bug in tokenize.tokenize that caused string literals
  with 'b' prefixes to be incorrectly tokenized has been fixed.
  Patch by Serhiy Storchaka.

1915 1916
- Issue #15006: Allow equality comparison between naive and aware
  time or datetime objects.
1917

1918 1919 1920 1921
- Issue #14982: Document that pkgutil's iteration functions require the
  non-standard iter_modules() method to be defined by an importer (something
  the importlib importers do not define).

Petri Lehtinen's avatar
Petri Lehtinen committed
1922 1923 1924
- Issue #15036: Mailbox no longer throws an error if a flush is done
  between operations when removing or changing multiple items in mbox,
  MMDF, or Babyl mailboxes.
1925

1926 1927
- Issue #14059: Implement multiprocessing.Barrier.

1928
- Issue #15061: The inappropriately named hmac.secure_compare has been
Nick Coghlan's avatar
Nick Coghlan committed
1929 1930
  renamed to hmac.compare_digest, restricted to operating on bytes inputs
  only and had its documentation updated to more accurately reflect both its
1931 1932
  intent and its limitations

1933 1934
- Issue #13841: Make child processes exit using sys.exit() on Windows.

1935
- Issue #14936: curses_panel was converted to PEP 3121 and PEP 384 API.
1936 1937
  Patch by Robin Schreiber.

1938 1939 1940 1941 1942
- Issue #1667546: On platforms supporting tm_zone and tm_gmtoff fields
  in struct tm, time.struct_time objects returned by time.gmtime(),
  time.localtime() and time.strptime() functions now have tm_zone and
  tm_gmtoff attributes.  Original patch by Paul Boddie.

1943 1944
- Rename adjusted attribute to adjustable in time.get_clock_info() result.

1945 1946 1947
- Issue #3518: Remove references to non-existent BaseManager.from_address()
  method.

1948 1949 1950
- Issue #13857: Added textwrap.indent() function (initial patch by Ezra
  Berch)

1951 1952
- Issue #2736: Added datetime.timestamp() method.

1953 1954
- Issue #13854: Make multiprocessing properly handle non-integer
  non-string argument to SystemExit.
1955

1956 1957
- Issue #12157: Make pool.map() empty iterables correctly.  Initial
  patch by mouad.
1958

1959 1960
- Issue #11823: disassembly now shows argument counts on calls with keyword args.

1961 1962
- Issue #14711: os.stat_float_times() has been deprecated.

1963 1964
- LZMAFile now accepts the modes "rb"/"wb"/"ab" as synonyms of "r"/"w"/"a".

1965 1966
- The bz2 and lzma modules now each contain an open() function, allowing
  compressed files to readily be opened in text mode as well as binary mode.
1967

1968 1969
- BZ2File.__init__() and LZMAFile.__init__() now accept a file object as their
  first argument, rather than requiring a separate "fileobj" argument.
1970

1971 1972
- gzip.open() now accepts file objects as well as filenames.

1973 1974 1975 1976 1977
- Issue #14992: os.makedirs(path, exist_ok=True) would raise an OSError
  when the path existed and had the S_ISGID mode bit set when it was
  not explicitly asked for.  This is no longer an exception as mkdir
  cannot control if the OS sets that bit for it or not.

1978 1979 1980
- Issue #14989: Make the CGI enable option to http.server available via command
  line.

1981 1982
- Issue #14987: Add a missing import statement to inspect.

1983 1984 1985 1986
- Issue #1079: email.header.decode_header now correctly parses all the examples
  in RFC2047.  There is a necessary visible behavior change: the leading and/or
  trailing whitespace on ASCII parts is now preserved.

1987 1988
- Issue #14969: Better handling of exception chaining in contextlib.ExitStack

Ned Deily's avatar
Ned Deily committed
1989 1990
- Issue #14962: Update text coloring in IDLE shell window after changing
  options.  Patch by Roger Serwy.
1991

1992 1993 1994
- Issue #14963: Convert contextlib.ExitStack.__exit__ to use an iterative
  algorithm (Patch by Alon Horev)

1995 1996 1997
- Issue #14785: Add sys._debugmallocstats() to help debug low-level memory
  allocation issues

1998 1999 2000
- Issue #14443: Ensure that .py files are byte-compiled with the correct Python
  executable within bdist_rpm even on older versions of RPM

2001 2002 2003 2004 2005 2006
C-API
-----

- Issue #13783: Inadvertent additions to the public C API in the PEP 380
  implementation have either been removed or marked as private interfaces.

2007 2008
Extension Modules
-----------------
2009

2010
- Issue #15000: Support the "unique" x32 architecture in _posixsubprocess.c.
2011

2012 2013 2014
Documentation
-------------

2015 2016 2017
- Issue #15081: Document PyState_FindModule.
  Patch by Robin Schreiber.

2018 2019
- Issue #14814: Added first draft of ipaddress module API reference

2020 2021 2022
Tests
-----

2023 2024 2025 2026
- Issue #14769: test_capi now has SkipitemTest, which cleverly checks
  for "parity" between PyArg_ParseTuple() and the Python/getargs.c static
  function skipitem() for all possible "format units".

2027 2028 2029
- test_nntplib now tolerates being run from behind NNTP gateways that add
  "X-Antivirus" headers to articles

2030 2031 2032 2033
- Issue #15043: test_gdb is now skipped entirely if gdb security settings
  block loading of the gdb hooks

- Issue #14963: Add test cases for exception handling behaviour
2034
  in contextlib.ExitStack (Initial patch by Alon Horev)
2035

2036 2037 2038
Build
-----

2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053
- Issue #13590: Improve support for OS X Xcode 4:
    * Try to avoid building Python or extension modules with problematic
      llvm-gcc compiler.
    * Since Xcode 4 removes ppc support, extension module builds now
      check for ppc compiler support and automatically remove ppc and
      ppc64 archs when not available.
    * Since Xcode 4 no longer install SDKs in default locations,
      extension module builds now revert to using installed headers
      and libs if the SDK used to build the interpreter is not
      available.
    * Update ./configure to use better defaults for universal builds;
      in particular, --enable-universalsdk=yes uses the Xcode default
      SDK and --with-universal-archs now defaults to "intel" if ppc
      not available.

2054 2055
- Issue #14225: Fix Unicode support for curses (#12567) on OS X

2056 2057 2058
- Issue #14928: Fix importlib bootstrap issues by using a custom executable
  (Modules/_freeze_importlib) to build Python/importlib.h.

Georg Brandl's avatar
Georg Brandl committed
2059

2060 2061 2062
What's New in Python 3.3.0 Alpha 4?
===================================

Georg Brandl's avatar
Georg Brandl committed
2063
*Release date: 31-May-2012*
2064 2065 2066 2067

Core and Builtins
-----------------

2068 2069 2070
- Issue #14835: Make plistlib output empty arrays & dicts like OS X.
  Patch by Sidney San Martín.

2071 2072 2073
- Issue #14744: Use the new _PyUnicodeWriter internal API to speed up
  str%args and str.format(args).

2074 2075
- Issue #14930: Make memoryview objects weakrefable.

2076 2077 2078
- Issue #14775: Fix a potential quadratic dict build-up due to the garbage
  collector repeatedly trying to untrack dicts.

2079 2080 2081
- Issue #14857: fix regression in references to PEP 3135 implicit __class__
  closure variable (Reopens issue #12370)

Vinay Sajip's avatar
Vinay Sajip committed
2082 2083
- Issue #14712 (PEP 405): Virtual environments. Implemented by Vinay Sajip.

2084 2085
- Issue #14660 (PEP 420): Namespace packages. Implemented by Eric Smith.

2086 2087 2088 2089
- Issue #14494: Fix __future__.py and its documentation to note that
  absolute imports are the default behavior in 3.0 instead of 2.7.
  Patch by Sven Marnach.

2090 2091 2092 2093
- Issue #9260: A finer-grained import lock.  Most of the import sequence
  now uses per-module locks rather than the global import lock, eliminating
  well-known issues with threads and imports.

2094 2095 2096
- Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs.
  Patch by Serhiy Storchaka.

Martin v. Löwis's avatar
Martin v. Löwis committed
2097 2098
- asdl_seq and asdl_int_seq are now Py_ssize_t sized.

2099 2100 2101
- Issue #14133 (PEP 415): Implement suppression of __context__ display with an
  attribute on BaseException. This replaces the original mechanism of PEP 409.

2102 2103 2104
- Issue #14417: Mutating a dict during lookup now restarts the lookup instead
  of raising a RuntimeError (undoes issue #14205).

2105 2106 2107
- Issue #14738: Speed-up UTF-8 decoding on non-ASCII data.  Patch by Serhiy
  Storchaka.

2108 2109 2110
- Issue #14700: Fix two broken and undefined-behaviour-inducing overflow checks
  in old-style string formatting.

Georg Brandl's avatar
Georg Brandl committed
2111 2112 2113
- Issue #14705: The PyArg_Parse() family of functions now support the 'p' format
  unit, which accepts a "boolean predicate" argument.  It converts any Python
  value into an integer--0 if it is "false", and 1 otherwise.
2114 2115 2116 2117

Library
-------

2118 2119 2120
- Issue #14690: Use monotonic clock instead of system clock in the sched,
  subprocess and trace modules.

2121 2122 2123
- Issue #14958: Change IDLE systax highlighting to recognize all string and
  byte literals supported in Python 3.3.

2124 2125
- Issue #10997: Prevent a duplicate entry in IDLE's "Recent Files" menu.

2126 2127 2128
- Issue #14443: Tell rpmbuild to use the correct version of Python in
  bdist_rpm. Initial patch by Ross Lagerwall.

2129 2130
- Issue #14929: Stop Idle 3.x from closing on Unicode decode errors when
  grepping. Patch by Roger Serwy.
2131

2132 2133 2134
- Issue #12515: email now registers a defect if it gets to EOF while parsing
  a MIME part without seeing the closing MIME boundary.

Brian Curtin's avatar
Brian Curtin committed
2135
- Issue #12510: Attempting to get invalid tooltip no longer closes Idle.
2136 2137
  Other tooltipss have been corrected or improved and the number of tests
  has been tripled. Original patch by Roger Serwy.
2138

2139 2140 2141 2142
- Issue #1672568: email now always decodes base64 payloads, adding padding and
  ignoring non-base64-alphabet characters if needed, and registering defects
  for any such problems.

2143 2144 2145 2146
- Issue #14925: email now registers a defect when the parser decides that there
  is a missing header/body separator line.  MalformedHeaderDefect, which the
  existing code would never actually generate, is deprecated.

2147 2148
- Issue #10365: File open dialog now works instead of crashing even when
  the parent window is closed before the dialog. Patch by Roger Serwy.
2149

2150 2151 2152
- Issue #8739: Updated smtpd to support RFC 5321, and added support for the
  RFC 1870 SIZE extension.

2153 2154 2155
- Issue #665194: Added a localtime function to email.utils to provide an
  aware local datetime for use in setting Date headers.

2156 2157 2158 2159 2160 2161 2162 2163
- Issue #12586: Added new provisional policies that implement convenient
  unicode support for email headers.  See What's New for details.

- Issue #14731: Refactored email Policy framework to support full backward
  compatibility with Python 3.2 by default yet allow for the introduction of
  new features through new policies.  Note that Policy.must_be_7bit is renamed
  to cte_type.

2164 2165
- Issue #14876: Use user-selected font for highlight configuration.

2166 2167 2168
- Issue #14920: Fix the help(urllib.parse) failure on locale C on terminals.
  Have ascii characters in help.

2169 2170 2171
- Issue #14548: Make multiprocessing finalizers check pid before
  running to cope with possibility of gc running just after fork.

2172 2173 2174
- Issue #14863: Update the documentation of os.fdopen() to reflect the
  fact that it's only a thin wrapper around open() anymore.

2175 2176 2177
- Issue #14036: Add an additional check to validate that port in urlparse does
  not go in illegal range and returns None.

2178 2179
- Issue #14862: Add missing names to os.__all__

2180 2181
- Issue #14875: Use float('inf') instead of float('1e66666') in the json module.

2182 2183
- Issue #13585: Added contextlib.ExitStack

2184 2185
- PEP 3144, Issue #14814: Added the ipaddress module

Senthil Kumaran's avatar
Senthil Kumaran committed
2186 2187 2188
- Issue #14426: Correct the Date format in Expires attribute of Set-Cookie
  Header in Cookie.py.

2189 2190 2191 2192
- Issue #14588: The types module now provide new_class() and prepare_class()
  functions to support PEP 3115 compliant dynamic class creation. Patch by
  Daniel Urban and Nick Coghlan.

2193 2194 2195
- Issue #13152: Allow to specify a custom tabsize for expanding tabs in
  textwrap. Patch by John Feuerstein.

2196 2197 2198
- Issue #14721: Send the correct 'Content-length: 0' header when the body is an
  empty string ''. Initial Patch contributed by Arve Knudsen.

2199 2200 2201
- Issue #14072: Fix parsing of 'tel' URIs in urlparse by making the check for
  ports stricter.

2202 2203 2204
- Issue #9374: Generic parsing of query and fragment portions of url for any
  scheme. Supported both by RFC3986 and RFC2396.

2205 2206 2207 2208
- Issue #14798: Fix the functions in pyclbr to raise an ImportError
  when the first part of a dotted name is not a package. Patch by
  Xavier de Gaye.

2209 2210 2211 2212
- Issue #12098: multiprocessing on Windows now starts child processes
  using the same sys.flags as the current process.  Initial patch by
  Sergey Mezentsev.

2213 2214 2215
- Issue #13031: Small speed-up for tarfile when unzipping tarfiles.
  Patch by Justin Peel.

2216 2217 2218
- Issue #14780: urllib.request.urlopen() now has a ``cadefault`` argument
  to use the default certificate store.  Initial patch by James Oakley.

2219 2220 2221
- Issue #14829: Fix bisect and range() indexing with large indices
  (>= 2 ** 32) under 64-bit Windows.

2222 2223 2224
- Issue #14732: The _csv module now uses PEP 3121 module initialization.
  Patch by Robin Schreiber.

2225 2226 2227
- Issue #14809: Add HTTP status codes introduced by RFC 6585 to http.server
  and http.client. Patch by EungJun Yi.

Ned Deily's avatar
Ned Deily committed
2228 2229 2230 2231 2232
- Issue #14777: tkinter may return undecoded UTF-8 bytes as a string when
  accessing the Tk clipboard.  Modify clipboad_get() to first request type
  UTF8_STRING when no specific type is requested in an X11 windowing
  environment, falling back to the current default type STRING if that fails.
  Original patch by Thomas Kluyver.
2233

2234
- Issue #14773: Fix os.fwalk() failing on dangling symlinks.
2235

2236 2237 2238
- Issue #12541: Be lenient with quotes around Realm field of HTTP Basic
  Authentation in urllib2.

2239
- Issue #14807: move undocumented tarfile.filemode() to stat.filemode() and add
2240 2241
  doc entry. Add tarfile.filemode alias with deprecation warning.

2242 2243
- Issue #13815: TarFile.extractfile() now returns io.BufferedReader objects.

2244
- Issue #14532: Add a secure_compare() helper to the hmac module, to mitigate
2245
  timing attacks. Patch by Jon Oberheide.
2246

2247 2248
- Add importlib.util.resolve_name().

2249 2250 2251
- Issue #14366: Support lzma compression in zip files.
  Patch by Serhiy Storchaka.

2252 2253
- Issue #13959: Introduce importlib.find_loader() and document
  imp.find_module/load_module as deprecated.
2254

2255 2256 2257
- Issue #14082: shutil.copy2() now copies extended attributes, if possible.
  Patch by Hynek Schlawack.

Brett Cannon's avatar
Brett Cannon committed
2258 2259 2260 2261 2262
- Issue #13959: Make importlib.abc.FileLoader.load_module()/get_filename() and
  importlib.machinery.ExtensionFileLoader.load_module() have their single
  argument be optional. Allows for the replacement (and thus deprecation) of
  imp.load_source()/load_package()/load_compiled().

2263 2264 2265 2266 2267
- Issue #13959: imp.get_suffixes() has been deprecated in favour of the new
  attributes on importlib.machinery: SOURCE_SUFFIXES, DEBUG_BYTECODE_SUFFIXES,
  OPTIMIZED_BYTECODE_SUFFIXES, BYTECODE_SUFFIXES, and EXTENSION_SUFFIXES. This
  led to an indirect deprecation of inspect.getmoduleinfo().

2268 2269 2270
- Issue #14662: Prevent shutil failures on OS X when destination does not
  support chflag operations.  Patch by Hynek Schlawack.

2271 2272 2273
- Issue #14157: Fix time.strptime failing without a year on February 29th.
  Patch by Hynek Schlawack.

2274 2275 2276
- Issue #14753: Make multiprocessing's handling of negative timeouts
  the same as it was in Python 3.2.

2277 2278 2279
- Issue #14583: Fix importlib bug when a package's __init__.py would first
  import one of its modules then raise an error.

2280 2281
- Issue #14741: Fix missing support for Ellipsis ('...') in parser module.

2282 2283 2284
- Issue #14697: Fix missing support for set displays and set comprehensions in
  parser module.

2285 2286
- Issue #14701: Fix missing support for 'raise ... from' in parser module.

2287 2288 2289
- Add support for timeouts to the acquire() methods of
  multiprocessing's lock/semaphore/condition proxies.

2290 2291
- Issue #13989: Add support for text mode to gzip.open().

2292
- Issue #14127: The os.stat() result object now provides three additional
Georg Brandl's avatar
Georg Brandl committed
2293 2294 2295 2296
  fields: st_ctime_ns, st_mtime_ns, and st_atime_ns, providing those times as an
  integer with nanosecond resolution.  The functions os.utime(), os.lutimes(),
  and os.futimes() now accept a new parameter, ns, which accepts mtime and atime
  as integers with nanosecond resolution.
2297

Georg Brandl's avatar
Georg Brandl committed
2298 2299
- Issue #14127 and #10148: shutil.copystat now preserves exact mtime and atime
  on filesystems providing nanosecond resolution.
2300

2301 2302 2303
Tools/Demos
-----------

2304
- Issue #14695: Bring Tools/parser/unparse.py support up to date with
2305 2306
  the Python 3.3 Grammar.

2307 2308 2309
Build
-----

Petri Lehtinen's avatar
Petri Lehtinen committed
2310 2311
- Issue #14472: Update .gitignore. Patch by Matej Cepl.

Martin v. Löwis's avatar
Martin v. Löwis committed
2312 2313
- Upgrade Windows library versions: bzip 1.0.6, OpenSSL 1.0.1c.

2314 2315 2316
- Issue #14693: Under non-Windows platforms, hashlib's fallback modules are
  always compiled, even if OpenSSL is present at build time.

2317 2318
- Issue #13210: Windows build now uses VS2010, ported from VS2008.

2319 2320 2321 2322 2323 2324
Documentation
-------------

- Issue #14588: The language reference now accurately documents the Python 3
  class definition process. Patch by Nick Coghlan.

Brian Curtin's avatar
Brian Curtin committed
2325 2326
- Issue #14943: Correct a default argument value for winreg.OpenKey
  and correctly list the argument names in the function's explanation.
2327

Georg Brandl's avatar
Georg Brandl committed
2328

Georg Brandl's avatar
Georg Brandl committed
2329 2330 2331
What's New in Python 3.3.0 Alpha 3?
===================================

Georg Brandl's avatar
Georg Brandl committed
2332
*Release date: 01-May-2012*
Georg Brandl's avatar
Georg Brandl committed
2333 2334 2335 2336

Core and Builtins
-----------------

2337 2338
- Issue #14699: Fix calling the classmethod descriptor directly.

Georg Brandl's avatar
Georg Brandl committed
2339
- Issue #14433: Prevent msvcrt crash in interactive prompt when stdin is closed.
Georg Brandl's avatar
Georg Brandl committed
2340

Georg Brandl's avatar
Georg Brandl committed
2341 2342
- Issue #14521: Make result of float('nan') and float('-nan') more consistent
  across platforms.
2343

2344 2345
- Issue #14646: __import__() sets __loader__ if the loader did not.

2346 2347 2348
- Issue #14605: No longer have implicit entries in sys.meta_path. If
  sys.meta_path is found to be empty, raise ImportWarning.

2349
- Issue #14605: No longer have implicit entries in sys.path_hooks. If
2350 2351 2352
  sys.path_hooks is found to be empty, a warning will be raised. None is now
  inserted into sys.path_importer_cache if no finder was discovered. This also
  means imp.NullImporter is no longer implicitly used.
2353

2354 2355 2356 2357
- Issue #13903: Implement PEP 412. Individual dictionary instances can now share
  their keys with other dictionaries. Classes take advantage of this to share
  their instance dictionary keys for improved memory and performance.

2358 2359 2360 2361 2362 2363
- Issue #11603 (again): Setting __repr__ to __str__ now raises a RuntimeError
  when repr() or str() is called on such an object.

- Issue #14658: Fix binding a special method to a builtin implementation of a
  special method with a different name.

2364 2365 2366
- Issue #14630: Fix a memory access bug for instances of a subclass of int
  with value 0.

2367 2368 2369
- Issue #14339: Speed improvements to bin, oct and hex functions.  Patch by
  Serhiy Storchaka.

2370 2371 2372
- Issue #14098: New functions PyErr_GetExcInfo and PyErr_SetExcInfo.
  Patch by Stefan Behnel.

2373 2374 2375 2376 2377
- Issue #14385: It is now possible to use a custom type for the __builtins__
  namespace, instead of a dict. It can be used for sandboxing for example.
  Raise also a NameError instead of ImportError if __build_class__ name if not
  found in __builtins__.

2378 2379 2380 2381
- Issue #12599: Be more strict in accepting None compared to a false-like
  object for importlib.util.module_for_loader and
  importlib.machinery.PathFinder.

2382 2383
- Issue #14612: Fix jumping around with blocks by setting f_lineno.

2384 2385 2386
- Issue #14592: Attempting a relative import w/o __package__ or __name__ set in
  globals raises a KeyError.

Benjamin Peterson's avatar
improve  
Benjamin Peterson committed
2387
- Issue #14607: Fix keyword-only arguments which started with ``__``.
2388

2389 2390 2391 2392
- Issue #10854: The ImportError raised when an extension module on Windows
  fails to import now uses the new path and name attributes from
  Issue #1559549.

2393 2394 2395 2396
- Issue #13889: Check and (if necessary) set FPU control word before calling
  any of the dtoa.c string <-> float conversion functions, on MSVC builds of
  Python.  This fixes issues when embedding Python in a Delphi app.

2397 2398 2399
- __import__() now matches PEP 328 and documentation by defaulting 'index' to 0
  instead of -1 and removing support for negative values.

2400 2401
- Issue #2377: Make importlib the implementation of __import__().

2402 2403 2404 2405
- Issue #1559549: ImportError now has 'name' and 'path' attributes that are set
  using keyword arguments to its constructor. They are currently not set by
  import as they are meant for use by importlib.

2406 2407 2408
- Issue #14474: Save and restore exception state in thread.start_new_thread()
  while writing error message if the thread leaves a unhandled exception.

2409 2410 2411
- Issue #13019: Fix potential reference leaks in bytearray.extend().  Patch
  by Suman Saha.

Georg Brandl's avatar
Georg Brandl committed
2412 2413 2414
Library
-------

2415
- Issue #14768: os.path.expanduser('~/a') doesn't works correctly when HOME is '/'.
2416

Georg Brandl's avatar
Georg Brandl committed
2417
- Issue #14371: Support bzip2 in zipfile module.  Patch by Serhiy Storchaka.
2418

2419 2420 2421
- Issue #13183: Fix pdb skipping frames after hitting a breakpoint and running
  step.  Patch by Xavier de Gaye.

2422 2423
- Issue #14696: Fix parser module to understand 'nonlocal' declarations.

2424 2425 2426
- Issue #10941: Fix imaplib.Internaldate2tuple to produce correct result near
  the DST transition.  Patch by Joe Peterson.

2427
- Issue #9154: Fix parser module to understand function annotations.
2428

2429 2430 2431
- Issue #6085: In http.server.py SimpleHTTPServer.address_string returns the
  client ip address instead client hostname. Patch by Charles-François Natali.

2432 2433 2434
- Issue #14309: Deprecate time.clock(), use time.perf_counter() or
  time.process_time() instead.

2435 2436 2437 2438
- Issue #14428: Implement the PEP 418. Add time.get_clock_info(),
  time.perf_counter() and time.process_time() functions, and rename
  time.steady() to time.monotonic().

2439 2440 2441
- Issue #14646: importlib.util.module_for_loader() now sets __loader__ and
  __package__ (when possible).

2442 2443 2444
- Issue #14664: It is now possible to use @unittest.skip{If,Unless} on a
  test class that doesn't inherit from TestCase (i.e. a mixin).

2445 2446 2447
- Issue #4892: multiprocessing Connections can now be transferred over
  multiprocessing Connections.  Patch by Richard Oudkerk (sbt).

2448 2449 2450
- Issue #14160: TarFile.extractfile() failed to resolve symbolic links when
  the links were not located in an archive subdirectory.

2451 2452 2453
- Issue #14638: pydoc now treats non-string __name__ values as if they
  were missing, instead of raising an error.

Senthil Kumaran's avatar
Senthil Kumaran committed
2454 2455 2456
- Issue #13684: Fix httplib tunnel issue of infinite loops for certain sites
  which send EOF without trailing \r\n.

2457
- Issue #14605: Add importlib.abc.FileLoader, importlib.machinery.(FileFinder,
2458
  SourceFileLoader, SourcelessFileLoader, ExtensionFileLoader).
2459

2460 2461 2462 2463 2464
- Issue #13959: imp.cache_from_source()/source_from_cache() now follow
  os.path.join()/split() semantics for path manipulation instead of its prior,
  custom semantics of caring the right-most path separator forward in path
  joining.

2465 2466
- Issue #2193: Allow ":" character in Cookie NAME values.

2467 2468 2469
- Issue #14629: tokenizer.detect_encoding will specify the filename in the
  SyntaxError exception if found at readline.__self__.name.

2470 2471 2472
- Issue #14629: Raise SyntaxError in tokenizer.detect_encoding if the
  first two lines have non-UTF-8 characters without an encoding declaration.

2473 2474 2475
- Issue #14308: Fix an exception when a "dummy" thread is in the threading
  module's active list after a fork().

2476 2477 2478 2479
- Issue #11750: The Windows API functions scattered in the _subprocess and
  _multiprocessing.win32 modules now live in a single module "_winapi".
  Patch by sbt.

2480 2481
- Issue #14087: multiprocessing: add Condition.wait_for(). Patch by sbt.

2482 2483 2484
- Issue #14538: HTMLParser can now parse correctly start tags that contain
  a bare '/'.

2485 2486
- Issue #14452: SysLogHandler no longer inserts a UTF-8 BOM into the message.

2487 2488
- Issue #14386: Expose the dict_proxy internal type as types.MappingProxyType.

2489 2490 2491
- Issue #13959: Make imp.reload() always use a module's __loader__ to perform
  the reload.

2492 2493 2494
- Issue #13959: Add imp.py and rename the built-in module to _imp, allowing for
  re-implementing parts of the module in pure Python.

2495 2496 2497
- Issue #13496: Fix potential overflow in bisect.bisect algorithm when applied
  to a collection of size > sys.maxsize / 2.

2498 2499 2500
- Have importlib take advantage of ImportError's new 'name' and 'path'
  attributes.

R David Murray's avatar
R David Murray committed
2501 2502
- Issue #14399: zipfile now recognizes that the archive has been modified even
  if only the comment is changed.  In addition, the TypeError that results from
Ezio Melotti's avatar
Ezio Melotti committed
2503
  trying to set a non-binary value as a comment is now raised at the time
R David Murray's avatar
R David Murray committed
2504
  the comment is set rather than at the time the zipfile is written.
2505

2506 2507 2508 2509
- trace.CoverageResults.is_ignored_filename() now ignores any name that starts
  with "<" and ends with ">" instead of special-casing "<string>" and
  "<doctest ".

2510 2511 2512
- Issue #12537: The mailbox module no longer depends on knowledge of internal
  implementation details of the email package Message object.

2513 2514 2515 2516
- Issue #7978: socketserver now restarts the select() call when EINTR is
  returned.  This avoids crashing the server loop when a signal is received.
  Patch by Jerzy Kozera.

2517 2518 2519
- Issue #14522: Avoid duplicating socket handles in multiprocessing.connection.
  Patch by sbt.

2520 2521
- Don't Py_DECREF NULL variable in io.IncrementalNewlineDecoder.

2522 2523 2524
- Issue #8515: Set __file__ when run file in IDLE.
  Initial patch by Bruce Frederiksen.

Andrew Svetlov's avatar
Andrew Svetlov committed
2525 2526 2527
- Issue #14496: Fix wrong name in idlelib/tabbedpages.py.
  Patch by Popa Claudiu.

2528 2529
- Issue #3033: Add displayof parameter to tkinter font. Patch by Guilherme Polo.

2530 2531 2532 2533
- Issue #14482: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_UNIX type address under
  Windows.  Patch by Popa Claudiu.

2534 2535
- Issue #802310: Generate always unique tkinter font names if not directly passed.

Georg Brandl's avatar
Merge.  
Georg Brandl committed
2536 2537 2538 2539
- Issue #14151: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_PIPE type address under
  non-Windows platforms.  Patch by Popa Claudiu.

2540
- Issue #14493: Use gvfs-open or xdg-open in webbrowser.
2541

2542 2543 2544 2545 2546 2547
Build
-----

- "make touch" will now touch generated files that are checked into Mercurial,
  after a "hg update" which failed to bring the timestamps into the right order.

2548 2549 2550
Tests
-----

Nick Coghlan's avatar
Nick Coghlan committed
2551 2552 2553
- Issue #14026: In test_cmd_line_script, check that sys.argv is populated
  correctly for the various invocation approaches (Patch by Jason Yeo)

Nick Coghlan's avatar
Nick Coghlan committed
2554 2555 2556
- Issue #14032: Fix incorrect variable name in test_cmd_line_script debugging
  message (Patch by Jason Yeo)

2557 2558 2559
- Issue #14589: Update certificate chain for sha256.tbs-internet.com, fixing
  a test failure in test_ssl.

2560 2561 2562
- Issue #14355: Regrtest now supports the standard unittest test loading, and
  will use it if a test file contains no `test_main` method.

2563 2564 2565
Tools / Demos
-------------

2566 2567 2568
- Issue #3561: The Windows installer now has an option, off by default, for
  placing the Python installation into the system "Path" environment variable.

2569 2570 2571
- Issue #13165: stringbench is now available in the Tools/stringbench folder.
  It used to live in its own SVN project.

Georg Brandl's avatar
Georg Brandl committed
2572

Georg Brandl's avatar
Georg Brandl committed
2573 2574 2575
What's New in Python 3.3.0 Alpha 2?
===================================

Georg Brandl's avatar
Georg Brandl committed
2576
*Release date: 01-Apr-2012*
Georg Brandl's avatar
Georg Brandl committed
2577 2578 2579 2580

Core and Builtins
-----------------

2581 2582 2583
- Issue #1683368: object.__new__ and object.__init__ raise a TypeError if they
  are passed arguments and their complementary method is not overridden.

2584 2585 2586
- Issue #14378: Fix compiling ast.ImportFrom nodes with a "__future__" string as
  the module name that was not interned.

2587 2588
- Issue #14331: Use significantly less stack space when importing modules by
  allocating path buffers on the heap instead of the stack.
2589

2590 2591 2592
- Issue #14334: Prevent in a segfault in type.__getattribute__ when it was not
  passed strings.

2593 2594 2595
- Issue #1469629: Allow cycles through an object's __dict__ slot to be
  collected. (For example if ``x.__dict__ is x``).

2596 2597 2598
- Issue #14205: dict lookup raises a RuntimeError if the dict is modified
  during a lookup.

2599 2600 2601
- Issue #14220: When a generator is delegating to another iterator with the
  yield from syntax, it needs to have its ``gi_running`` flag set to True.

2602 2603 2604
- Issue #14435: Remove dedicated block allocator from floatobject.c and rely
  on the PyObject_Malloc() api like all other objects.

2605 2606
- Issue #14471: Fix a possible buffer overrun in the winreg module.

2607 2608
- Issue #14288: Allow the serialization of builtin iterators

Georg Brandl's avatar
Georg Brandl committed
2609 2610 2611
Library
-------

2612 2613 2614
- Issue #14300: Under Windows, sockets created using socket.dup() now allow
  overlapped I/O.  Patch by sbt.

2615 2616 2617
- Issue #13872: socket.detach() now marks the socket closed (as mirrored
  in the socket repr()).  Patch by Matt Joiner.

2618 2619 2620
- Issue #14406: Fix a race condition when using ``concurrent.futures.wait(
  return_when=ALL_COMPLETED)``.  Patch by Matt Joiner.

Andrew Svetlov's avatar
Andrew Svetlov committed
2621
- Issue #5136: deprecate old, unused functions from tkinter.
2622

2623 2624 2625 2626
- Issue #14409: IDLE now properly executes commands in the Shell window
  when it cannot read the normal config files on startup and
  has to use the built-in default key bindings.
  There was previously a bug in one of the defaults.
2627

2628 2629 2630
- Issue #14416: syslog now defines the LOG_ODELAY and LOG_AUTHPRIV constants
  if they are defined in <syslog.h>.

Éric Araujo's avatar
Éric Araujo committed
2631
- IDLE can be launched as python -m idlelib
2632

2633 2634
- Issue #14295: Add unittest.mock

2635 2636 2637
- Issue #7652: Add --with-system-libmpdec option to configure for linking
  the _decimal module against an installed libmpdec.

2638 2639 2640
- Issue #14380: MIMEText now defaults to utf-8 when passed non-ASCII unicode
  with no charset specified.

2641 2642 2643 2644
- Issue #10340: asyncore - properly handle EINVAL in dispatcher constructor on
  OSX; avoid to call handle_connect in case of a disconnected socket which
  was not meant to connect.

2645 2646 2647 2648
- Issue #14204: The ssl module now has support for the Next Protocol
  Negotiation extension, if available in the underlying OpenSSL library.
  Patch by Colin Marc.

Georg Brandl's avatar
Georg Brandl committed
2649
- Issue #3035: Unused functions from tkinter are marked as pending deprecated.
2650

2651 2652 2653
- Issue #12757: Fix the skipping of doctests when python is run with -OO so
  that it works in unittest's verbose mode as well as non-verbose mode.

2654 2655
- Issue #7652: Integrate the decimal floating point libmpdec library to speed
  up the decimal module. Performance gains of the new C implementation are
2656
  between 10x and 100x, depending on the application.
2657

2658 2659 2660
- Issue #3573: IDLE hangs when passing invalid command line args
  (directory(ies) instead of file(s)) (Patch by Guilherme Polo)

2661 2662 2663
- Issue #14269: SMTPD now conforms to the RFC and requires a HELO command
  before MAIL, RCPT, or DATA.

2664 2665 2666
- Issue #13694: asynchronous connect in asyncore.dispatcher does not set addr
  attribute.

2667 2668
- Issue #14344: fixed the repr of email.policy objects.

R David Murray's avatar
R David Murray committed
2669 2670 2671
- Issue #11686: Added missing entries to email package __all__ lists
  (mostly the new Bytes classes).

2672 2673 2674
- Issue #14335: multiprocessing's custom Pickler subclass now inherits from
  the C-accelerated implementation.  Patch by sbt.

2675 2676
- Issue #10484: Fix the CGIHTTPServer's PATH_INFO handling problem.

2677 2678
- Issue #11199: Fix the with urllib which hangs on particular ftp urls.

2679 2680
- Improve the memory utilization and speed of functools.lru_cache.

2681 2682 2683 2684
- Issue #14222: Use the new time.steady() function instead of time.time() for
  timeout in queue and threading modules to not be affected of system time
  update.

2685 2686
- Issue #13248: Remove lib2to3.pytree.Base.get_prefix/set_prefix.

2687 2688 2689 2690 2691
- Issue #14234: CVE-2012-0876: Randomize hashes of xml attributes in the hash
  table internal to the pyexpat module's copy of the expat library to avoid a
  denial of service due to hash collisions.  Patch by David Malcolm with some
  modifications by the expat project.

2692 2693
- Issue #14200: Idle shell crash on printing non-BMP unicode character.

2694 2695 2696
- Issue #12818: format address no longer needlessly \ escapes ()s in names when
  the name ends up being quoted.

2697 2698 2699
- Issue #14062: BytesGenerator now correctly folds Header objects,
  including using linesep when folding.

2700 2701 2702 2703
- Issue #13839: When invoked on the command-line, the pstats module now
  accepts several filenames of profile stat files and merges them all.
  Patch by Matt Joiner.

2704 2705 2706
- Issue #14291: Email now defaults to utf-8 for non-ASCII unicode headers
  instead of raising an error.  This fixes a regression relative to 2.7.

2707 2708
- Issue #989712: Support using Tk without a mainloop.

2709 2710
- Issue #5219: Prevent event handler cascade in IDLE.

2711 2712
- Issue #3835: Refuse to use unthreaded Tcl in threaded Python.

2713 2714
- Issue #2843: Add new Tk API to Tkinter.

2715 2716 2717
- Issue #14184: Increase the default stack size for secondary threads on
  Mac OS X to avoid interpreter crashes when using threads on 10.7.

2718 2719 2720 2721
- Issue #14180: datetime.date.fromtimestamp(),
  datetime.datetime.fromtimestamp() and datetime.datetime.utcfromtimestamp()
  now raise an OSError instead of ValueError if localtime() or gmtime() failed.

2722 2723 2724 2725 2726 2727 2728 2729 2730
- Issue #14180: time.ctime(), gmtime(), time.localtime(),
  datetime.date.fromtimestamp(), datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now raises an OverflowError, instead of
  a ValueError, if the timestamp does not fit in time_t.

- Issue #14180: datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now round microseconds towards zero
  instead of rounding to nearest with ties going away from zero.

2731 2732
- Issue #10543: Fix unittest test discovery with Jython bytecode files.

2733 2734 2735 2736
- Issue #1178863: Separate initialisation from setting when initializing
  Tkinter.Variables; harmonize exceptions to ValueError; only delete variables
  that have not been deleted; assert that variable names are strings.

2737 2738 2739
- Issue #14104: Implement time.monotonic() on Mac OS X, patch written by
  Nicholas Riley.

2740 2741
- Issue #13394: the aifc module now uses warnings.warn() to signal warnings.

2742 2743 2744
- Issue #14252: Fix subprocess.Popen.terminate() to not raise an error under
  Windows when the child process has already exited.

2745 2746 2747 2748
- Issue #14223: curses.addch() is no more limited to the range 0-255 when the
  Python curses is not linked to libncursesw. It was a regression introduced
  in Python 3.3a1.

2749
- Issue #14168: Check for presence of Element._attrs in minidom before
2750 2751
  accessing it.

2752 2753 2754 2755
- Issue #12328: Fix multiprocessing's use of overlapped I/O on Windows.
  Also, add a multiprocessing.connection.wait(rlist, timeout=None) function
  for polling multiple objects at once.  Patch by sbt.

2756 2757 2758 2759
- Issue #14007: Accept incomplete TreeBuilder objects (missing start, end,
  data or close method) for the Python implementation as well.
  Drop the no-op TreeBuilder().xml() method from the C implementation.

2760 2761 2762
- Issue #14210: pdb now has tab-completion not only for command names, but
  also for their arguments, wherever possible.

2763 2764 2765
- Issue #14310: Sockets can now be with other processes on Windows using
  the api socket.socket.share() and socket.fromshare().

2766 2767 2768
- Issue #10576: The gc module now has a 'callbacks' member that will get
  called when garbage collection takes place.

2769 2770 2771
Build
-----

2772 2773
- Issue #14557: Fix extensions build on HP-UX. Patch by Adi Roiban.

2774 2775
- Issue #14387: Do not include accu.h from Python.h.

2776 2777 2778
- Issue #14359: Only use O_CLOEXEC in _posixmodule.c if it is defined.
  Based on patch from Hervé Coatanhay.

2779
- Issue #14321: Do not run pgen during the build if files are up to date.
2780

2781 2782 2783 2784 2785
Documentation
-------------

- Issue #14034: added the argparse tutorial.

2786 2787
- Issue #14324: Fix configure tests for cross builds.

2788
- Issue #14327: Call AC_CANONICAL_HOST in configure.ac and check in
2789
  config.{guess,sub}. Don't use uname calls for cross builds.
2790

Benjamin Peterson's avatar
Benjamin Peterson committed
2791 2792 2793
Extension Modules
-----------------

2794 2795 2796
- Issue #9041: An issue in ctypes.c_longdouble, ctypes.c_double, and
  ctypes.c_float that caused an incorrect exception to be returned in the
  case of overflow has been fixed.
2797

Benjamin Peterson's avatar
Benjamin Peterson committed
2798 2799 2800
- Issue #14212: The re module didn't retain a reference to buffers it was
  scanning, resulting in segfaults.

2801 2802 2803
- Issue #14259: The finditer() method of re objects did not take any
  keyword arguments, contrary to the documentation.

2804 2805
- Issue #10142: Support for SEEK_HOLE/SEEK_DATA (for example, under ZFS).

2806 2807 2808
Tests
-----

2809 2810
- Issue #14442: Add missing errno import in test_smtplib.

2811 2812
- Issue #8315: (partial fix) python -m unittest test.test_email now works.

Georg Brandl's avatar
Georg Brandl committed
2813

Georg Brandl's avatar
Georg Brandl committed
2814 2815
What's New in Python 3.3.0 Alpha 1?
===================================
Georg Brandl's avatar
Georg Brandl committed
2816

Georg Brandl's avatar
Georg Brandl committed
2817
*Release date: 05-Mar-2012*
Georg Brandl's avatar
Georg Brandl committed
2818

2819 2820 2821
Core and Builtins
-----------------

2822 2823 2824
- Issue #14172: Fix reference leak when marshalling a buffer-like object
  (other than a bytes object).

2825 2826 2827
- Issue #13521: dict.setdefault() now does only one lookup for the given key,
  making it "atomic" for many purposes.  Patch by Filip Gruszczyński.

2828 2829 2830 2831
- PEP 409, Issue #6210: "raise X from None" is now supported as a means of
  suppressing the display of the chained exception context. The chained
  context still remains available as the __context__ attribute.

2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848
- Issue #10181: New memoryview implementation fixes multiple ownership
  and lifetime issues of dynamically allocated Py_buffer members (#9990)
  as well as crashes (#8305, #7433). Many new features have been added
  (See whatsnew/3.3), and the documentation has been updated extensively.
  The ndarray test object from _testbuffer.c implements all aspects of
  PEP-3118, so further development towards the complete implementation
  of the PEP can proceed in a test-driven manner.

  Thanks to Nick Coghlan, Antoine Pitrou and Pauli Virtanen for review
  and many ideas.

- Issue #12834: Fix incorrect results of memoryview.tobytes() for
  non-contiguous arrays.

- Issue #5231: Introduce memoryview.cast() method that allows changing
  format and shape without making a copy of the underlying memory.

2849 2850 2851
- Issue #14084: Fix a file descriptor leak when importing a module with a
  bad encoding.

Benjamin Peterson's avatar
Benjamin Peterson committed
2852 2853
- Upgrade Unicode data to Unicode 6.1.

2854 2855 2856
- Issue #14040: Remove rarely used file name suffixes for C extensions
  (under POSIX mainly).

2857 2858 2859
- Issue #14051: Allow arbitrary attributes to be set of classmethod and
  staticmethod.

2860 2861 2862
- Issue #13703: oCERT-2011-003: Randomize hashes of str and bytes to protect
  against denial of service attacks due to hash collisions within the dict and
  set types.  Patch by David Malcolm, based on work by Victor Stinner.
2863

2864 2865 2866
- Issue #13020: Fix a reference leak when allocating a structsequence object
  fails.  Patch by Suman Saha.

2867 2868
- Issue #13908: Ready types returned from PyType_FromSpec.

2869 2870 2871
- Issue #11235: Fix OverflowError when trying to import a source file whose
  modification time doesn't fit in a 32-bit timestamp.

2872 2873 2874
- Issue #12705: A SyntaxError exception is now raised when attempting to
  compile multiple statements as a single interactive statement.

2875 2876 2877
- Fix the builtin module initialization code to store the init function for
  future reinitialization.

2878 2879 2880 2881 2882
- Issue #8052: The posix subprocess module would take a long time closing
  all possible file descriptors in the child process rather than just open
  file descriptors.  It now closes only the open fds if possible for the
  default close_fds=True behavior.

2883 2884 2885
- Issue #13629: Renumber the tokens in token.h so that they match the indexes
  into _PyParser_TokenNames.

2886 2887
- Issue #13752: Add a casefold() method to str.

2888 2889 2890
- Issue #13761: Add a "flush" keyword argument to the print() function,
  used to ensure flushing the output stream.

2891 2892 2893 2894
- Issue #13645: pyc files now contain the size of the corresponding source
  code, to avoid timestamp collisions (especially on filesystems with a low
  timestamp resolution) when checking for freshness of the bytecode.

2895 2896 2897 2898
- PEP 380, Issue #11682: Add "yield from <x>" to support easy delegation to
  subgenerators (initial patch by Greg Ewing, integration into 3.3 by
  Renaud Blanch, Ryan Kelly, Zbigniew Jędrzejewski-Szmek and Nick Coghlan)

2899 2900 2901
- Issue #13748: Raw bytes literals can now be written with the ``rb`` prefix
  as well as ``br``.

2902 2903
- Issue #12736: Use full unicode case mappings for upper, lower, and title case.

2904 2905
- Issue #12760: Add a create mode to open(). Patch by David Townshend.

2906 2907
- Issue #13738: Simplify implementation of bytes.lower() and bytes.upper().

2908 2909 2910
- Issue #13577: Built-in methods and functions now have a __qualname__.
  Patch by sbt.

2911 2912 2913
- Issue #6695: Full garbage collection runs now clear the freelist of set
  objects.  Initial patch by Matthias Troffaes.

2914 2915 2916
- Fix OSError.__init__ and OSError.__new__ so that each of them can be
  overriden and take additional arguments (followup to issue #12555).

2917 2918 2919 2920
- Fix the fix for issue #12149: it was incorrect, although it had the side
  effect of appearing to resolve the issue.  Thanks to Mark Shannon for
  noticing.

2921 2922 2923
- Issue #13505: Pickle bytes objects in a way that is compatible with
  Python 2 when using protocols <= 2.

2924 2925 2926
- Issue #11147: Fix an unused argument in _Py_ANNOTATE_MEMORY_ORDER.  (Fix
  given by Campbell Barton).

2927 2928 2929 2930
- Issue #13503: Use a more efficient reduction format for bytearrays with
  pickle protocol >= 3.  The old reduction format is kept with older protocols
  in order to allow unpickling under Python 2.  Patch by Irmen de Jong.

2931 2932 2933 2934
- Issue #7111: Python can now be run without a stdin, stdout or stderr
  stream.  It was already the case with Python 2.  However, the corresponding
  sys module entries are now set to None (instead of an unusable file object).

2935 2936 2937 2938
- Issue #11849: Ensure that free()d memory arenas are really released
  on POSIX systems supporting anonymous memory mappings.  Patch by
  Charles-François Natali.

2939
- Issue #13452: PyUnicode_EncodeDecimal() doesn't support error handlers
2940 2941 2942
  different than "strict" anymore. The caller was unable to compute the
  size of the output buffer: it depends on the error handler.

2943 2944
- PEP 3155 / issue #13448: Qualified name for classes and functions.

2945 2946 2947
- Issue #13436: Fix a bogus error message when an AST object was passed
  an invalid integer value.

2948 2949 2950
- Issue #13411: memoryview objects are now hashable when the underlying
  object is hashable.

2951 2952 2953 2954
- Issue #13338: Handle all enumerations in _Py_ANNOTATE_MEMORY_ORDER
  to allow compiling extension modules with -Wswitch-enum on gcc.
  Initial patch by Floris Bruynooghe.

2955 2956 2957
- Issue #10227: Add an allocation cache for a single slice object.  Patch by
  Stefan Behnel.

2958 2959 2960
- Issue #13393: BufferedReader.read1() now asks the full requested size to
  the raw stream instead of limiting itself to the buffer size.

2961 2962
- Issue #13392: Writing a pyc file should now be atomic under Windows as well.

2963 2964 2965
- Issue #13333: The UTF-7 decoder now accepts lone surrogates (the encoder
  already accepts them).

2966 2967 2968 2969
- Issue #13389: Full garbage collection passes now clear the freelists for
  list and dict objects.  They already cleared other freelists in the
  interpreter.

2970
- Issue #13327: Remove the need for an explicit None as the second argument
Brian Curtin's avatar
Brian Curtin committed
2971 2972 2973
  to os.utime, os.lutimes, os.futimes, os.futimens, os.futimesat, in
  order to update to the current time. Also added keyword argument
  handling to os.utimensat in order to remove the need for explicit None.
2974

2975 2976 2977
- Issue #13350: Simplify some C code by replacing most usages of
  PyUnicode_Format by PyUnicode_FromFormat.

2978 2979 2980
- Issue #13342: input() used to ignore sys.stdin's and sys.stdout's unicode
  error handler in interactive mode (when calling into PyOS_Readline()).

2981 2982
- Issue #9896: Add start, stop, and step attributes to range objects.

2983
- Issue #13343: Fix a SystemError when a lambda expression uses a global
Georg Brandl's avatar
Georg Brandl committed
2984 2985
  variable in the default value of a keyword-only argument: ``lambda *,
  arg=GLOBAL_NAME: None``
2986

2987 2988 2989
- Issue #12797: Added custom opener parameter to builtin open() and
  FileIO.open().

2990 2991 2992
- Issue #10519: Avoid unnecessary recursive function calls in
  setobject.c.

2993 2994
- Issue #10363: Deallocate global locks in Py_Finalize().

2995 2996 2997
- Issue #13018: Fix reference leaks in error paths in dictobject.c.
  Patch by Suman Saha.

2998 2999 3000 3001
- Issue #13201: Define '==' and '!=' to compare range objects based on
  the sequence of values they define (instead of comparing based on
  object identity).

3002 3003 3004 3005
- Issue #1294232: In a few cases involving metaclass inheritance, the
  interpreter would sometimes invoke the wrong metaclass when building a new
  class object. These cases now behave correctly. Patch by Daniel Urban.

3006
- Issue #12753: Add support for Unicode name aliases and named sequences.
Georg Brandl's avatar
Georg Brandl committed
3007 3008
  Both ``unicodedata.lookup()`` and '\N{...}' now resolve aliases,
  and ``unicodedata.lookup()`` resolves named sequences too.
3009

3010 3011 3012 3013
- Issue #12170: The count(), find(), rfind(), index() and rindex() methods
  of bytes and bytearray objects now accept an integer between 0 and 255
  as their first argument.  Patch by Petri Lehtinen.

3014 3015 3016
- Issue #12604: VTRACE macro expanded to no-op in _sre.c to avoid compiler
  warnings. Patch by Josh Triplett and Petri Lehtinen.

3017 3018 3019 3020
- Issue #12281: Rewrite the MBCS codec to handle correctly replace and ignore
  error handlers on all Windows versions. The MBCS codec is now supporting all
  error handlers, instead of only replace to encode and ignore to decode.

3021 3022 3023 3024
- Issue #13188: When called without an explicit traceback argument,
  generator.throw() now gets the traceback from the passed exception's
  ``__traceback__`` attribute.  Patch by Petri Lehtinen.

3025 3026
- Issue #13146: Writing a pyc file is now atomic under POSIX.

3027 3028 3029 3030
- Issue #7833: Extension modules built using distutils on Windows will no
  longer include a "manifest" to prevent them failing at import time in some
  embedded situations.

3031 3032
- PEP 3151 / issue #12555: reworking the OS and IO exception hierarchy.

3033 3034 3035 3036
- Issue #13560: Add PyUnicode_DecodeLocale(), PyUnicode_DecodeLocaleAndSize()
  and PyUnicode_EncodeLocale() functions to the C API to decode/encode from/to
  the current locale encoding.

3037
- Add internal API for static strings (_Py_identifier et al.).
3038

3039 3040 3041 3042
- Issue #13063: the Windows error ERROR_NO_DATA (numbered 232 and described
  as "The pipe is being closed") is now mapped to POSIX errno EPIPE
  (previously EINVAL).

3043 3044 3045
- Issue #12911: Fix memory consumption when calculating the repr() of huge
  tuples or lists.

Martin v. Löwis's avatar
Martin v. Löwis committed
3046 3047
- PEP 393: flexible string representation. Thanks to Torsten Becker for the
  initial implementation, and Victor Stinner for various bug fixes.
Martin v. Löwis's avatar
Martin v. Löwis committed
3048

3049 3050 3051
- Issue #14081: The 'sep' and 'maxsplit' parameter to str.split, bytes.split,
  and bytearray.split may now be passed as keyword arguments.

3052 3053 3054 3055
- Issue #13012: The 'keepends' parameter to str.splitlines may now be passed
  as a keyword argument:  "my_string.splitlines(keepends=True)".  The same
  change also applies to bytes.splitlines and bytearray.splitlines.

3056 3057 3058 3059
- Issue #7732: Don't open a directory as a file anymore while importing a
  module. Ignore the direcotry if its name matchs the module name (e.g.
  "__init__.py") and raise a ImportError instead.

3060 3061 3062
- Issue #13021: Missing decref on an error path.  Thanks to Suman Saha for
  finding the bug and providing a patch.

3063 3064 3065
- Issue #12973: Fix overflow checks that relied on undefined behaviour in
  list_repeat (listobject.c) and islice_next (itertoolsmodule.c).  These bugs
  caused test failures with recent versions of Clang.
3066

3067 3068 3069
- Issue #12904: os.utime, os.futimes, os.lutimes, and os.futimesat now write
  atime and mtime with nanosecond precision on modern POSIX platforms.

3070 3071 3072
- Issue #12802: the Windows error ERROR_DIRECTORY (numbered 267) is now
  mapped to POSIX errno ENOTDIR (previously EINVAL).

3073 3074 3075
- Issue #9200: The str.is* methods now work with strings that contain non-BMP
  characters even in narrow Unicode builds.

3076 3077 3078
- Issue #12791: Break reference cycles early when a generator exits with
  an exception.

3079 3080
- Issue #12773: Make __doc__ mutable on user-defined classes.

3081
- Issue #12766: Raise a ValueError when creating a class with a class variable
3082 3083
  that conflicts with a name in __slots__.

3084 3085 3086
- Issue #12266: Fix str.capitalize() to correctly uppercase/lowercase
  titlecased and cased non-letter characters.

3087 3088 3089
- Issue #12732: In narrow unicode builds, allow Unicode identifiers which fall
  outside the BMP.

3090 3091
- Issue #12575: Validate user-generated AST before it is compiled.

3092 3093
- Make type(None), type(Ellipsis), and type(NotImplemented) callable. They
  return the respective singleton instances.
3094

Benjamin Peterson's avatar
Benjamin Peterson committed
3095
- Forbid summing bytes with sum().
3096

3097 3098 3099
- Verify the types of AST strings and identifiers provided by the user before
  compiling them.

3100 3101 3102 3103
- Issue #12647: The None object now has a __bool__() method that returns False.
  Formerly, bool(None) returned False only because of special case logic
  in PyObject_IsTrue().

3104 3105 3106 3107
- Issue #12579: str.format_map() now raises a ValueError if used on a
  format string that contains positional fields. Initial patch by
  Julian Berman.

3108 3109
- Issue #10271: Allow warnings.showwarning() be any callable.

3110 3111
- Issue #11627: Fix segfault when __new__ on a exception returns a
  non-exception class.
3112

Georg Brandl's avatar
Georg Brandl committed
3113
- Issue #12149: Update the method cache after a type's dictionary gets
3114 3115 3116 3117 3118
  cleared by the garbage collector.  This fixes a segfault when an instance
  and its type get caught in a reference cycle, and the instance's
  deallocator calls one of the methods on the type (e.g. when subclassing
  IOBase).  Diagnosis and patch by Davide Rizzo.

3119 3120
- Issue #9611, #9015: FileIO.read() clamps the length to INT_MAX on Windows.

3121 3122 3123
- Issue #9642: Uniformize the tests on the availability of the mbcs codec, add
  a new HAVE_MBCS define.

3124 3125 3126 3127 3128
- Issue #9642: Fix filesystem encoding initialization: use the ANSI code page
  on Windows if the mbcs codec is not available, and fail with a fatal error if
  we cannot get the locale encoding (if nl_langinfo(CODESET) is not available)
  instead of using UTF-8.

3129 3130 3131
- When a generator yields, do not retain the caller's exception state on the
  generator.

3132
- Issue #12475: Prevent generators from leaking their exception state into the
Benjamin Peterson's avatar
add '  
Benjamin Peterson committed
3133
  caller's frame as they return for the last time.
3134

3135 3136 3137
- Issue #12291: You can now load multiple marshalled objects from a stream,
  with other data interleaved between marshalled objects.

3138 3139 3140 3141
- Issue #12356: When required positional or keyword-only arguments are not
  given, produce a informative error message which includes the name(s) of the
  missing arguments.

3142
- Issue #12370: Fix super with no arguments when __class__ is overriden in the
3143 3144
  class body.

3145 3146 3147
- Issue #12084: os.stat on Windows now works properly with relative symbolic
  links when called from any directory.

3148 3149 3150
- Loosen type restrictions on the __dir__ method. __dir__ can now return any
  sequence, which will be converted to a list and sorted by dir().

3151 3152 3153
- Issue #12265: Make error messages produced by passing an invalid set of
  arguments to a function more informative.

Benjamin Peterson's avatar
Benjamin Peterson committed
3154 3155 3156
- Issue #12225: Still allow Python to build if Python is not in its hg repo or
  mercurial is not installed.

3157
- Issue #1195: my_fgets() now always clears errors before calling fgets(). Fix
3158 3159 3160
  the following case: sys.stdin.read() stopped with CTRL+d (end of file),
  raw_input() interrupted by CTRL+c.

3161 3162
- Issue #12216: Allow unexpected EOF errors to happen on any line of the file.

3163 3164 3165
- Issue #12199: The TryExcept and TryFinally and AST nodes have been unified
  into a Try node.

3166 3167 3168 3169 3170
- Issue #9670: Increase the default stack size for secondary threads on
  Mac OS X and FreeBSD to reduce the chances of a crash instead of a
  "maximum recursion depth" RuntimeError exception.
  (patch by Ronald Oussoren)

3171 3172 3173
- Issue #12106: The use of the multiple-with shorthand syntax is now reflected
  in the AST.

3174 3175 3176
- Issue #12190: Try to use the same filename object when compiling unmarshalling
  a code objects in the same file.

3177 3178 3179
- Issue #12166: Move implementations of dir() specialized for various types into
  the __dir__() methods of those types.

3180
- Issue #5715: In socketserver, close the server socket in the child process.
3181

Benjamin Peterson's avatar
Benjamin Peterson committed
3182 3183 3184
- Correct lookup of __dir__ on objects. Among other things, this causes errors
  besides AttributeError found on lookup to be propagated.

3185 3186 3187
- Issue #12060: Use sig_atomic_t type and volatile keyword in the signal
  module. Patch written by Charles-François Natali.

3188 3189
- Issue #1746656: Added the if_nameindex, if_indextoname, if_nametoindex
  methods to the socket module.
3190

3191 3192 3193 3194
- Issue #12044: Fixed subprocess.Popen when used as a context manager to
  wait for the process to end when exiting the context to avoid unintentionally
  leaving zombie processes around.

3195 3196 3197
- Issue #1195: Fix input() if it is interrupted by CTRL+d and then CTRL+c,
  clear the end-of-file indicator after CTRL+d.

3198 3199 3200 3201
- Issue #1856: Avoid crashes and lockups when daemon threads run while the
  interpreter is shutting down; instead, these threads are now killed when
  they try to take the GIL.

3202 3203 3204
- Issue #9756: When calling a method descriptor or a slot wrapper descriptor,
  the check of the object type doesn't read the __class__ attribute anymore.
  Fix a crash if a class override its __class__ attribute (e.g. a proxy of the
3205
  str type). Patch written by Andreas Stührk.
3206

3207 3208 3209 3210
- Issue #10517: After fork(), reinitialize the TLS used by the PyGILState_*
  APIs, to avoid a crash with the pthread implementation in RHEL 5.  Patch
  by Charles-François Natali.

3211 3212 3213 3214
- Issue #10914: Initialize correctly the filesystem codec when creating a new
  subinterpreter to fix a bootstrap issue with codecs implemented in Python, as
  the ISO-8859-15 codec.

3215 3216 3217
- Issue #11918: OS/2 and VMS are no more supported because of the lack of
  maintainer.

3218 3219 3220
- Issue #6780: fix starts/endswith error message to mention that tuples are
  accepted too.

3221 3222 3223 3224
- Issue #5057: fix a bug in the peepholer that led to non-portable pyc files
  between narrow and wide builds while optimizing BINARY_SUBSCR on non-BMP
  chars (e.g. "\U00012345"[0]).

3225 3226 3227
- Issue #11845: Fix typo in rangeobject.c that caused a crash in
  compute_slice_indices.  Patch by Daniel Urban.

3228 3229 3230 3231 3232
- Issue #5673: Added a `timeout` keyword argument to subprocess.Popen.wait,
  subprocess.Popen.communicated, subprocess.call, subprocess.check_call, and
  subprocess.check_output.  If the blocking operation takes more than `timeout`
  seconds, the `subprocess.TimeoutExpired` exception is raised.

3233 3234 3235 3236
- Issue #11650: PyOS_StdioReadline() retries fgets() if it was interrupted
  (EINTR), for example if the program is stopped with CTRL+z on Mac OS X. Patch
  written by Charles-Francois Natali.

3237 3238
- Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.

3239 3240
- Issue #10785: Store the filename as Unicode in the Python parser.

3241 3242 3243
- Issue #11619: _PyImport_LoadDynamicModule() doesn't encode the path to bytes
  on Windows.

3244 3245 3246
- Issue #10998: Remove mentions of -Q, sys.flags.division_warning and
  Py_DivisionWarningFlag left over from Python 2.

3247 3248 3249
- Issue #11244: Remove an unnecessary peepholer check that was preventing
  negative zeros from being constant-folded properly.

3250 3251 3252 3253 3254 3255
- Issue #11395: io.FileIO().write() clamps the data length to 32,767 bytes on
  Windows if the file is a TTY to workaround a Windows bug. The Windows console
  returns an error (12: not enough space error) on writing into stdout if
  stdout mode is binary and the length is greater than 66,000 bytes (or less,
  depending on heap usage).

3256
- Issue #11320: fix bogus memory management in Modules/getpath.c, leading to
3257 3258
  a possible crash when calling Py_SetPath().

Gregory P. Smith's avatar
Gregory P. Smith committed
3259 3260 3261 3262
- Issue #11432: A bug was introduced in subprocess.Popen on posix systems with
  3.2.0 where the stdout or stderr file descriptor being the same as the stdin
  file descriptor would raise an exception. webbrowser.open would fail. fixed.

3263 3264 3265 3266
- Issue #9856: Change object.__format__ with a non-empty format string
  to be a DeprecationWarning. In 3.2 it was a PendingDeprecationWarning.
  In 3.4 it will be a TypeError.

3267 3268 3269 3270
- Issue #11244: The peephole optimizer is now able to constant-fold
  arbitrarily complex expressions.  This also fixes a 3.2 regression where
  operations involving negative numbers were not constant-folded.

3271 3272 3273
- Issue #11450: Don't truncate hg version info in Py_GetBuildInfo() when
  there are many tags (e.g. when using mq).  Patch by Nadeem Vawda.

3274 3275 3276
- Issue #11335: Fixed a memory leak in list.sort when the key function
  throws an exception.

3277 3278 3279 3280 3281
- Issue #8923: When a string is encoded to UTF-8 in strict mode, the result is
  cached into the object. Examples: str.encode(), str.encode('utf-8'),
  PyUnicode_AsUTF8String() and PyUnicode_AsEncodedString(unicode, "utf-8",
  NULL).

3282 3283
- Issue #10831: PyUnicode_FromFormat() supports %li, %lli and %zi formats.

3284 3285 3286
- Issue #10829: Refactor PyUnicode_FromFormat(), use the same function to parse
  the format string in the 3 steps, fix crashs on invalid format strings.

3287 3288
- Issue #13007: whichdb should recognize gdbm 1.9 magic numbers.

3289 3290 3291 3292
- Issue #11246: Fix PyUnicode_FromFormat("%V") to decode the byte string from
  UTF-8 (with replace error handler) instead of ISO-8859-1 (in strict mode).
  Patch written by Ray Allen.

3293 3294 3295
- Issue #11286: Raise a ValueError from calling PyMemoryView_FromBuffer with
  a buffer struct having a NULL data pointer.

3296 3297 3298
- Issue #11272: On Windows, input() strips '\r' (and not only '\n'), and
  sys.stdin uses universal newline (replace '\r\n' by '\n').

3299
- Issue #11828: startswith and endswith now accept None as slice index.
3300 3301
  Patch by Torsten Becker.

3302 3303 3304
- Issue #10830: Fix PyUnicode_FromFormatV("%c") for non-BMP characters on
  narrow build.

3305 3306 3307 3308
- Issue #11168: Remove filename debug variable from PyEval_EvalFrameEx().
  It encoded the Unicode filename to UTF-8, but the encoding fails on
  undecodable filename (on surrogate characters) which raises an unexpected
  UnicodeEncodeError on recursion limit.
3309

3310 3311 3312 3313
- Issue #11187: Remove bootstrap code (use ASCII) of
  PyUnicode_AsEncodedString(), it was replaced by a better fallback (use the
  locale encoding) in PyUnicode_EncodeFSDefault().

3314 3315
- Check for NULL result in PyType_FromSpec.

3316
- Issue #10516: New copy() and clear() methods for lists and bytearrays.
3317

3318 3319 3320
- Issue #11386: bytearray.pop() now throws IndexError when the bytearray is
  empty, instead of OverflowError.

3321 3322 3323
- Issue #12380: The rjust, ljust and center methods of bytes and bytearray
  now accept a bytearray argument.

3324 3325
Library
-------
3326

3327 3328 3329 3330
- Issue #14195: An issue that caused weakref.WeakSet instances to incorrectly
  return True for a WeakSet instance 'a' in both 'a < a' and 'a > a' has been
  fixed.

3331 3332 3333 3334
- Issue #14166: Pickler objects now have an optional ``dispatch_table``
  attribute which allows to set custom per-pickler reduction functions.
  Patch by sbt.

3335 3336 3337
- Issue #14177: marshal.loads() now raises TypeError when given an unicode
  string.  Patch by Guilherme Gonçalves.

3338 3339 3340
- Issue #13550: Remove the debug machinery from the threading module: remove
  verbose arguments from all threading classes and functions.

3341 3342 3343 3344 3345
- Issue #14159: Fix the len() of weak containers (WeakSet, WeakKeyDictionary,
  WeakValueDictionary) to return a better approximation when some objects
  are dead or dying.  Moreover, the implementation is now O(1) rather than
  O(n).

3346 3347 3348
- Issue #13125: Silence spurious test_lib2to3 output when in non-verbose mode.
  Patch by Mikhail Novikov.

3349 3350 3351
- Issue #11841: Fix comparison bug with 'rc' versions in packaging.version.
  Patch by Filip Gruszczyński.

3352 3353 3354
- Issue #13447: Add a test file to host regression tests for bugs in the
  scripts found in the Tools directory.

3355
- Issue #6884: Fix long-standing bugs with MANIFEST.in parsing in distutils
Éric Araujo's avatar
Éric Araujo committed
3356
  on Windows.  Also fixed in packaging.
3357

3358 3359 3360
- Issue #8033: sqlite3: Fix 64-bit integer handling in user functions
  on 32-bit architectures. Initial patch by Philippe Devalkeneer.

3361 3362
- HTMLParser is now able to handle slashes in the start tag.

3363 3364 3365
- Issue #13641: Decoding functions in the base64 module now accept ASCII-only
  unicode strings.  Patch by Catalin Iacob.

3366 3367 3368
- Issue #14043: Speed up importlib's _FileFinder by at least 8x, and add a
  new importlib.invalidate_caches() function.

3369 3370 3371
- Issue #14001: CVE-2012-0845: xmlrpc: Fix an endless loop in
  SimpleXMLRPCServer upon malformed POST request.

3372 3373
- Issue #13961: Move importlib over to using os.replace() for atomic renaming.

3374 3375 3376
- Do away with ambiguous level values (as suggested by PEP 328) in
  importlib.__import__() by raising ValueError when level < 0.

3377 3378
- Issue #2489: pty.spawn could consume 100% cpu when it encountered an EOF.

3379 3380
- Issue #13014: Fix a possible reference leak in SSLSocket.getpeercert().

3381 3382 3383
- Issue #13777: Add PF_SYSTEM sockets on OS X.
  Patch by Michael Goderbauer.

3384 3385 3386
- Issue #13015: Fix a possible reference leak in defaultdict.__repr__.
  Patch by Suman Saha.

3387 3388 3389
- Issue #1326113: distutils' and packaging's build_ext commands option now
  correctly parses multiple values (separated by whitespace or commas) given
  to their --libraries option.
3390

3391 3392 3393 3394
- Issue #10287: nntplib now queries the server's CAPABILITIES first before
  sending MODE READER, and only sends it if not already in READER mode.
  Patch by Hynek Schlawack.

3395 3396 3397
- Issue #13993: HTMLParser is now able to handle broken end tags when
  strict=False.

3398 3399 3400 3401
- Issue #13930: lib2to3 now supports writing converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.

3402 3403 3404 3405
- Issue #9750: Fix sqlite3.Connection.iterdump on tables and fields
  with a name that is a keyword or contains quotes. Patch by Marko
  Kohtala.

3406 3407 3408 3409
- Issue #10287: nntplib now queries the server's CAPABILITIES again after
  authenticating (since the result may change, according to RFC 4643).
  Patch by Hynek Schlawack.

3410 3411 3412
- Issue #13989: Document that GzipFile does not support text mode, and give a
  more helpful error message when opened with an invalid mode string.

3413 3414 3415 3416 3417 3418 3419 3420 3421 3422 3423 3424 3425
- Issue #13590: On OS X 10.7 and 10.6 with Xcode 4.2, building
  Distutils-based packages with C extension modules may fail because
  Apple has removed gcc-4.2, the version used to build python.org
  64-bit/32-bit Pythons.  If the user does not explicitly override
  the default C compiler by setting the CC environment variable,
  Distutils will now attempt to compile extension modules with clang
  if gcc-4.2 is required but not found. Also as a convenience, if
  the user does explicitly set CC, substitute its value as the default
  compiler in the Distutils LDSHARED configuration variable for OS X.
  (Note, the python.org 32-bit-only Pythons use gcc-4.0 and the 10.4u
  SDK, neither of which are available in Xcode 4.  This change does not
  attempt to override settings to support their use with Xcode 4.)

3426 3427 3428
- Issue #13960: HTMLParser is now able to handle broken comments when
  strict=False.

3429 3430 3431 3432
- Issue #13921: Undocument and clean up sqlite3.OptimizedUnicode,
  which is obsolete in Python 3.x. It's now aliased to str for
  backwards compatibility.

3433
- When '' is a path (e.g. in sys.path), make sure __file__ uses the current
Brett Cannon's avatar
Brett Cannon committed
3434
  working directory instead of '' in importlib.
3435

3436 3437 3438 3439
- Issue #13609: Add two functions to query the terminal size:
  os.get_terminal_size (low level) and shutil.get_terminal_size (high level).
  Patch by Zbigniew Jędrzejewski-Szmek.

3440 3441 3442
- Issue #13845: On Windows, time.time() now uses GetSystemTimeAsFileTime()
  instead of ftime() to have a resolution of 100 ns instead of 1 ms (the clock
  accuracy is between 0.5 ms and 15 ms).
3443

3444 3445
- Issue #13846: Add time.monotonic(), monotonic clock.

3446 3447 3448 3449 3450
- Issue #8184: multiprocessing: On Windows, don't set SO_REUSEADDR on
  Connection sockets, and set FILE_FLAG_FIRST_PIPE_INSTANCE on named pipes, to
  make sure two listeners can't bind to the same socket/pipe (or any existing
  socket/pipe).

3451 3452 3453
- Issue #10811: Fix recursive usage of cursors. Instead of crashing,
  raise a ProgrammingError now.

3454 3455
- Issue #10881: Fix test_site failure with OS X framework builds.

3456
- Issue #964437: Make IDLE help window non-modal.
3457 3458
  Patch by Guilherme Polo and Roger Serwy.

3459 3460 3461
- Issue #13734: Add os.fwalk(), a directory walking function yielding file
  descriptors.

3462 3463
- Issue #2945: Make the distutils upload command aware of bdist_rpm products.

3464 3465
- Issue #13712: pysetup create should not convert package_data to extra_files.

3466 3467
- Issue #11805: package_data in setup.cfg should allow more than one value.

3468 3469 3470
- Issue #13933: IDLE auto-complete did not work with some imported
  module, like hashlib.  (Patch by Roger Serwy)

3471 3472
- Issue #13901: Prevent test_distutils failures on OS X with --enable-shared.

3473 3474
- Issue #13676: Handle strings with embedded zeros correctly in sqlite3.

3475 3476 3477
- Issue #13506: Add '' to path for IDLE Shell when started and restarted with Restart Shell.
  Original patches by Marco Scataglini and Roger Serwy.

3478 3479 3480
- Issue #8828: Add new function os.replace(), for cross-platform renaming
  with overwriting.

3481 3482 3483
- Issue #13848: open() and the FileIO constructor now check for NUL
  characters in the file name.  Patch by Hynek Schlawack.

3484 3485 3486
- Issue #13806: The size check in audioop decompression functions was too
  strict and could reject valid compressed data.  Patch by Oleg Plakhotnyuk.

3487 3488 3489
- Issue #13812: When a multiprocessing Process child raises an exception,
  flush stderr after printing the exception traceback.

3490 3491 3492
- Issue #13885: CVE-2011-3389: the _ssl module would always disable the CBC
  IV attack countermeasure.

3493 3494
- Issue #13847: time.localtime() and time.gmtime() now raise an OSError instead
  of ValueError on failure. time.ctime() and time.asctime() now raises an
3495 3496
  OSError if localtime() failed. time.clock() now raises a RuntimeError if the
  processor time used is not available or its value cannot be represented
3497

3498 3499 3500
- Issue #13862: Fix spurious failure in test_zlib due to runtime/compile time
  minor versions not matching.

3501 3502 3503
- Issue #12804: Fix test_socket and test_urllib2net failures when running tests
  on a system without internet access.

3504 3505 3506 3507
- Issue #13772: In os.symlink() under Windows, do not try to guess the link
  target's type (file or directory).  The detection was buggy and made the
  call non-atomic (therefore prone to race conditions).

3508
- Issue #6631: Disallow relative file paths in urllib urlopen methods.
3509

3510 3511 3512
- Issue #13722: Avoid silencing ImportErrors when initializing the codecs
  registry.

3513 3514 3515
- Issue #13781: Fix GzipFile bug that caused an exception to be raised when
  opening for writing using a fileobj returned by os.fdopen().

3516 3517 3518
- Issue #13803: Under Solaris, distutils doesn't include bitness
  in the directory name.

3519 3520
- Issue #10278: Add time.wallclock() function, monotonic clock.

3521 3522 3523
- Issue #13809: Fix regression where bz2 module wouldn't work when threads are
  disabled. Original patch by Amaury Forgeot d'Arc.

3524 3525 3526
- Issue #13589: Fix some serialization primitives in the aifc module.
  Patch by Oleg Plakhotnyuk.

3527
- Issue #13642: Unquote before b64encoding ``user:password`` during Basic
3528 3529
  Authentication. Patch contributed by Joonas Kuorilehto.

3530 3531 3532
- Issue #13726: Fix the ambiguous -S flag in regrtest. It is -o/--slow for slow
  tests.

3533 3534 3535 3536
- Issue #12364: Fix a hang in concurrent.futures.ProcessPoolExecutor.
  The hang would occur when retrieving the result of a scheduled future after
  the executor had been shut down.

3537 3538 3539
- Issue #13502: threading: Fix a race condition in Event.wait() that made it
  return False when the event was set and cleared right after.

3540 3541 3542 3543 3544
- Issue #9993: When the source and destination are on different filesystems,
  and the source is a symlink, shutil.move() now recreates a symlink on the
  destination instead of copying the file contents.  Patch by Jonathan Niehof
  and Hynek Schlawack.

3545 3546
- Issue #12926: Fix a bug in tarfile's link extraction.

3547 3548
- Issue #13696: Fix the 302 Relative URL Redirection problem.

3549 3550 3551
- Issue #13636: Weak ciphers are now disabled by default in the ssl module
  (except when SSLv2 is explicitly asked for).

3552 3553 3554 3555 3556
- Issue #12715: Add an optional symlinks argument to shutil functions
  (copyfile, copymode, copystat, copy, copy2).  When that parameter is
  true, symlinks aren't dereferenced and the operation instead acts on the
  symlink itself (or creates one, if relevant).  Patch by Hynek Schlawack.

3557 3558
- Add a flags parameter to select.epoll.

3559 3560 3561
- Issue #13626: Add support for SSL Diffie-Hellman key exchange, through the
  SSLContext.load_dh_params() method and the ssl.OP_SINGLE_DH_USE option.

3562 3563
- Issue #11006: Don't issue low level warning in subprocess when pipe2() fails.

3564
- Issue #13620: Support for Chrome browser in webbrowser.  Patch contributed
3565 3566
  by Arnaud Calmettes.

3567 3568 3569
- Issue #11829: Fix code execution holes in inspect.getattr_static for
  metaclasses with metaclasses. Patch by Andreas Stührk.

3570 3571 3572
- Issue #12708: Add starmap() and starmap_async() methods (similar to
  itertools.starmap()) to multiprocessing.Pool.  Patch by Hynek Schlawack.

3573 3574
- Issue #1785: Fix inspect and pydoc with misbehaving descriptors.

3575 3576 3577
- Issue #13637: "a2b" functions in the binascii module now accept ASCII-only
  unicode strings.

3578 3579
- Issue #13634: Add support for querying and disabling SSL compression.

3580 3581 3582 3583
- Issue #13627: Add support for SSL Elliptic Curve-based Diffie-Hellman
  key exchange, through the SSLContext.set_ecdh_curve() method and the
  ssl.OP_SINGLE_ECDH_USE option.

3584 3585 3586 3587
- Issue #13635: Add ssl.OP_CIPHER_SERVER_PREFERENCE, so that SSL servers
  choose the cipher based on their own preferences, rather than on the
  client's.

3588
- Issue #11813: Fix inspect.getattr_static for modules. Patch by Andreas
3589 3590
  Stührk.

3591 3592 3593
- Issue #7502: Fix equality comparison for DocTestCase instances.  Patch by
  Cédric Krier.

3594 3595 3596
- Issue #11870: threading: Properly reinitialize threads internal locks and
  condition variables to avoid deadlocks in child processes.

3597 3598 3599
- Issue #8035: urllib: Fix a bug where the client could remain stuck after a
  redirection or an error.

3600 3601 3602
- Issue #13560: os.strerror() now uses the current locale encoding instead of
  UTF-8.

3603 3604 3605 3606
- Issue #8373: The filesystem path of AF_UNIX sockets now uses the filesystem
  encoding and the surrogateescape error handler, rather than UTF-8.  Patch
  by David Watson.

3607 3608 3609
- Issue #10350: Read and save errno before calling a function which might
  overwrite it.  Original patch by Hallvard B Furuseth.

3610 3611
- Issue #11610: Introduce a more general way to declare abstract properties.

3612 3613 3614
- Issue #13591: A bug in importlib has been fixed that caused import_module
  to load a module twice.

Georg Brandl's avatar
Georg Brandl committed
3615 3616 3617
- Issue #4625: If IDLE cannot write to its recent file or breakpoint files,
  display a message popup and continue rather than crash.  Original patch by
  Roger Serwy.
Ned Deily's avatar
Ned Deily committed
3618

3619 3620 3621 3622
- Issue #13449 sched.scheduler.run() method has a new "blocking" parameter which
  when set to False makes run() execute the scheduled events due to expire
  soonest (if any) and then return.  Patch by Giampaolo Rodolà.

3623
- Issue #8684 sched.scheduler class can be safely used in multi-threaded
3624
  environments.  Patch by Josiah Carlson and Giampaolo Rodolà.
3625

3626 3627
- Alias resource.error to OSError ala PEP 3151.

3628 3629
- Issue #5689: Add support for lzma compression to the tarfile module.

3630 3631 3632 3633 3634
- Issue #13248: Turn 3.2's PendingDeprecationWarning into 3.3's
  DeprecationWarning.  It covers 'cgi.escape', 'importlib.abc.PyLoader',
  'importlib.abc.PyPycLoader', 'nntplib.NNTP.xgtitle', 'nntplib.NNTP.xpath',
  and private attributes of 'smtpd.SMTPChannel'.

3635 3636
- Issue #5905, #13560: time.strftime() is now using the current locale
  encoding, instead of UTF-8, if the wcsftime() function is not available.
3637

3638 3639 3640
- Issue #8641: Update IDLE 3 syntax coloring to recognize b".." and not u"..".
  Patch by Tal Einat.

3641 3642 3643
- Issue #13464: Add a readinto() method to http.client.HTTPResponse.  Patch
  by Jon Kuhn.

3644 3645 3646
- tarfile.py: Correctly detect bzip2 compressed streams with blocksizes
  other than 900k.

3647 3648
- Issue #13439: Fix many errors in turtle docstrings.

3649
- Issue #6715: Add a module 'lzma' for compression using the LZMA algorithm.
3650
  Thanks to Per Øyvind Karlsen for the initial implementation.
3651

3652 3653 3654
- Issue #13487: Make inspect.getmodule robust against changes done to
  sys.modules while it is iterating over it.

3655 3656 3657
- Issue #12618: Fix a bug that prevented py_compile from creating byte
  compiled files in the current directory.  Initial patch by Sjoerd de Vries.

3658 3659 3660
- Issue #13444: When stdout has been closed explicitly, we should not attempt
  to flush it at shutdown and print an error.

3661 3662 3663 3664
- Issue #12567: The curses module uses Unicode functions for Unicode arguments
  when it is linked to the ncurses library. It encodes also Unicode strings to
  the locale encoding instead of UTF-8.

3665 3666 3667 3668
- Issue #12856: Ensure child processes do not inherit the parent's random
  seed for filename generation in the tempfile module.  Patch by Brian
  Harring.

3669 3670 3671
- Issue #9957: SpooledTemporaryFile.truncate() now accepts an optional size
  parameter, as other file-like objects.  Patch by Ryan Kelly.

3672 3673 3674
- Issue #13458: Fix a memory leak in the ssl module when decoding a
  certificate with a subjectAltName.  Patch by Robert Xiao.

3675 3676
- Issue #13415: os.unsetenv() doesn't ignore errors anymore.

Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
3677 3678 3679
- Issue #13245: sched.scheduler class constructor's timefunc and
  delayfunct parameters are now optional.
  scheduler.enter and scheduler.enterabs methods gained a new kwargs parameter.
3680
  Patch contributed by Chris Clark.
Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
3681

3682 3683 3684 3685
- Issue #12328: Under Windows, refactor handling of Ctrl-C events and
  make _multiprocessing.win32.WaitForMultipleObjects interruptible when
  the wait_flag parameter is false.  Patch by sbt.

3686 3687 3688 3689 3690 3691
- Issue #13322: Fix BufferedWriter.write() to ensure that BlockingIOError is
  raised when the wrapped raw file is non-blocking and the write would block.
  Previous code assumed that the raw write() would raise BlockingIOError, but
  RawIOBase.write() is defined to returned None when the call would block.
  Patch by sbt.

3692 3693
- Issue #13358: HTMLParser now calls handle_data only once for each CDATA.

3694 3695 3696 3697
- Issue #4147: minidom's toprettyxml no longer adds whitespace around a text
  node when it is the only child of an element.  Initial patch by Dan
  Kenigsberg.

3698 3699 3700 3701
- Issue #13374: The Windows bytes API has been deprecated in the os module. Use
  Unicode filenames instead of bytes filenames to not depend on the ANSI code
  page anymore and to support any filename.

3702 3703
- Issue #13297: Use bytes type to send and receive binary data through XMLRPC.

3704 3705 3706
- Issue #6397: Support "/dev/poll" polling objects in select module,
  under Solaris & derivatives.

3707 3708 3709
- Issues #1745761, #755670, #13357, #12629, #1200313: HTMLParser now correctly
  handles non-valid attributes, including adjacent and unquoted attributes.

3710 3711
- Issue #13193: Fix distutils.filelist.FileList and packaging.manifest.Manifest
  under Windows.
Antoine Pitrou's avatar
Antoine Pitrou committed
3712

3713 3714
- Issue #13384: Remove unnecessary __future__ import in Lib/random.py

3715 3716
- Issue #13149: Speed up append-only StringIO objects.

3717 3718 3719
- Issue #13373: multiprocessing.Queue.get() could sometimes block indefinitely
  when called with a timeout.  Patch by Arnaud Ysmal.

3720 3721 3722
- Issue #13254: Fix Maildir initialization so that maildir contents
  are read correctly.

3723
- Issue #3067: locale.setlocale() now raises TypeError if the second
3724 3725
  argument is an invalid iterable. Its documentation and docstring
  were also updated. Initial patch by Jyrki Pulliainen.
3726

3727 3728
- Issue #13140: Fix the daemon_threads attribute of ThreadingMixIn.

3729 3730 3731
- Issue #13339: Fix compile error in posixmodule.c due to missing semicolon.
  Thanks to Robert Xiao.

3732 3733 3734
- Byte compilation in packaging is now isolated from the calling Python -B or
  -O options, instead of being disallowed under -B or buggy under -O.

3735
- Issue #10570: curses.putp() and curses.tparm() are now expecting a byte
3736
  string, instead of a Unicode string.
3737

3738 3739
- Issue #13295: http.server now produces valid HTML 4.01 strict.

3740 3741
- Issue #2892: preserve iterparse events in case of SyntaxError.

3742
- Issue #13287: urllib.request and urllib.error now contains an __all__
Éric Araujo's avatar
Éric Araujo committed
3743
  attribute to expose only relevant classes and functions.  Patch by Florent
3744
  Xicluna.
3745

3746 3747 3748 3749
- Issue #670664: Fix HTMLParser to correctly handle the content of
  ``<script>...</script>`` and ``<style>...</style>``.

- Issue #10817: Fix urlretrieve function to raise ContentTooShortError even
3750 3751
  when reporthook is None. Patch by Jyrki Pulliainen.

3752
- Issue #13296: Fix IDLE to clear compile __future__ flags on shell restart.
3753 3754
  (Patch by Roger Serwy)

3755 3756 3757
- Fix the xmlrpc.client user agent to return something similar to
  urllib.request user agent: "Python-xmlrpc/3.3".

3758 3759 3760
- Issue #13293: Better error message when trying to marshal bytes using
  xmlrpc.client.

3761 3762
- Issue #13291: NameError in xmlrpc package.

3763 3764
- Issue #13258: Use callable() built-in in the standard library.

3765 3766 3767
- Issue #13273: fix a bug that prevented HTMLParser to properly detect some
  tags when strict=False.

3768 3769 3770
- Issue #11183: Add finer-grained exceptions to the ssl module, so that
  you don't have to inspect the exception's attributes in the common case.

3771
- Issue #13216: Add cp65001 codec, the Windows UTF-8 (CP_UTF8).
3772

Victor Stinner's avatar
Victor Stinner committed
3773
- Issue #13226: Add RTLD_xxx constants to the os module. These constants can be
3774 3775
  used with sys.setdlopenflags().

3776 3777 3778 3779
- Issue #10278: Add clock_getres(), clock_gettime() and CLOCK_xxx constants to
  the time module. time.clock_gettime(time.CLOCK_MONOTONIC) provides a
  monotonic clock

3780 3781 3782
- Issue #10332: multiprocessing: fix a race condition when a Pool is closed
  before all tasks have completed.

3783 3784
- Issue #13255: wrong docstrings in array module.

3785 3786
- Issue #8540: Remove deprecated Context._clamp attribute in Decimal module.

R David Murray's avatar
R David Murray committed
3787
- Issue #13235: Added DeprecationWarning to logging.warn() method and function.
3788

3789 3790
- Issue #9168: now smtpd is able to bind privileged port.

3791 3792 3793
- Issue #12529: fix cgi.parse_header issue on strings with double-quotes and
  semicolons together. Patch by Ben Darnell and Petri Lehtinen.

3794 3795 3796
- Issue #13227: functools.lru_cache() now has a option to distinguish
  calls with different argument types.

3797 3798
- Issue #6090: zipfile raises a ValueError when a document with a timestamp
  earlier than 1980 is provided. Patch contributed by Petri Lehtinen.
3799

3800 3801 3802 3803
- Issue #13150: sysconfig no longer parses the Makefile and config.h files
  when imported, instead doing it at build time.  This makes importing
  sysconfig faster and reduces Python startup time by 20%.

Ezio Melotti's avatar
Ezio Melotti committed
3804 3805
- Issue #12448: smtplib now flushes stdout while running ``python -m smtplib``
  in order to display the prompt correctly.
3806

3807
- Issue #12454: The mailbox module is now using ASCII, instead of the locale
R David Murray's avatar
R David Murray committed
3808
  encoding, to read and write .mh_sequences files.
3809

3810 3811
- Issue #13194: zlib.compressobj().copy() and zlib.decompressobj().copy() are
  now available on Windows.
3812

R David Murray's avatar
R David Murray committed
3813
- Issue #1673007: urllib.request now supports HEAD request via new method argument.
3814 3815
  Patch contributions by David Stanek, Patrick Westerhoff and Ezio Melotti.

3816 3817
- Issue #12386: packaging does not fail anymore when writing the RESOURCES
  file.
3818

3819 3820
- Issue #13158: Fix decoding and encoding of GNU tar specific base-256 number
  fields in tarfile.
3821

3822 3823
- Issue #13025: mimetypes is now reading MIME types using the UTF-8 encoding,
  instead of the locale encoding.
3824

3825 3826
- Issue #10653: On Windows, use strftime() instead of wcsftime() because
  wcsftime() doesn't format time zone correctly.
3827

3828 3829 3830
- Issue #13150: The tokenize module doesn't compile large regular expressions
  at startup anymore.

Éric Araujo's avatar
Éric Araujo committed
3831 3832
- Issue #11171: Fix distutils.sysconfig.get_makefile_filename when Python was
  configured with different prefix and exec-prefix.
3833

3834
- Issue #11254: Teach distutils and packaging to compile .pyc and .pyo files in
3835
  PEP 3147-compliant __pycache__ directories.
3836

Ned Deily's avatar
Ned Deily committed
3837 3838
- Issue #7367: Fix pkgutil.walk_paths to skip directories whose
  contents cannot be read.
3839

3840 3841 3842
- Issue #3163: The struct module gets new format characters 'n' and 'N'
  supporting C integer types ``ssize_t`` and ``size_t``, respectively.

3843 3844
- Issue #13099: Fix sqlite3.Cursor.lastrowid under a Turkish locale.
  Reported and diagnosed by Thomas Kluyver.
3845

3846 3847 3848
- Issue #13087: BufferedReader.seek() now always raises UnsupportedOperation
  if the underlying raw stream is unseekable, even if the seek could be
  satisfied using the internal buffer.  Patch by John O'Connor.
3849

3850 3851 3852
- Issue #7689: Allow pickling of dynamically created classes when their
  metaclass is registered with copyreg.  Patch by Nicolas M. Thiéry and Craig
  Citro.
3853

3854 3855 3856
- Issue #13034: When decoding some SSL certificates, the subjectAltName
  extension could be unreported.

3857 3858 3859 3860
- Issue #9871: Prevent IDLE 3 crash when given byte stings
  with invalid hex escape sequences, like b'\x0'.
  (Original patch by Claudiu Popa.)

3861 3862 3863
- Issue #12306: Expose the runtime version of the zlib C library as a constant,
  ZLIB_RUNTIME_VERSION, in the zlib module. Patch by Torsten Landschoff.

3864
- Issue #12959: Add collections.ChainMap to collections.__all__.
3865

3866 3867 3868
- Issue #8933: distutils' PKG-INFO files and packaging's METADATA files will
  now correctly report Metadata-Version: 1.1 instead of 1.0 if a Classifier or
  Download-URL field is present.
3869

3870 3871 3872
- Issue #12567: Add curses.unget_wch() function. Push a character so the next
  get_wch() will return it.

3873
- Issue #9561: distutils and packaging now writes egg-info files using UTF-8,
3874 3875
  instead of the locale encoding.

3876 3877 3878
- Issue #8286: The distutils command sdist will print a warning message instead
  of crashing when an invalid path is given in the manifest template.

3879 3880 3881 3882 3883
- Issue #12841: tarfile unnecessarily checked the existence of numerical user
  and group ids on extraction. If one of them did not exist the respective id
  of the current user (i.e. root) was used for the file and ownership
  information was lost.

Ezio Melotti's avatar
Ezio Melotti committed
3884 3885 3886
- Issue #12888: Fix a bug in HTMLParser.unescape that prevented it to escape
  more than 128 entities.  Patch by Peter Otten.

3887 3888
- Issue #12878: Expose a __dict__ attribute on io.IOBase and its subclasses.

3889 3890
- Issue #12636: IDLE reads the coding cookie when executing a Python script.

3891 3892 3893 3894
- Issue #12494: On error, call(), check_call(), check_output() and
  getstatusoutput() functions of the subprocess module now kill the process,
  read its status (to avoid zombis) and close pipes.

Benjamin Peterson's avatar
Benjamin Peterson committed
3895 3896
- Issue #12720: Expose low-level Linux extended file attribute functions in os.

Éric Araujo's avatar
Éric Araujo committed
3897
- Issue #10946: The distutils commands bdist_dumb, bdist_wininst and bdist_msi
3898 3899
  now respect a --skip-build option given to bdist.  The packaging commands
  were fixed too.
Éric Araujo's avatar
Éric Araujo committed
3900

3901 3902 3903
- Issue #12847: Fix a crash with negative PUT and LONG_BINPUT arguments in
  the C pickle implementation.

3904 3905 3906
- Issue #11564: Avoid crashes when trying to pickle huge objects or containers
  (more than 2**31 items).  Instead, in most cases, an OverflowError is raised.

3907 3908 3909
- Issue #12287: Fix a stack corruption in ossaudiodev module when the FD is
  greater than FD_SETSIZE.

3910 3911 3912
- Issue #12839: Fix crash in zlib module due to version mismatch.
  Fix by Richard M. Tew.

3913 3914 3915
- Issue #9923: The mailcap module now correctly uses the platform path
  separator for the MAILCAP environment variable on non-POSIX platforms.

3916 3917 3918 3919
- Issue #12835: Follow up to #6560 that unconditionally prevents use of the
  unencrypted sendmsg/recvmsg APIs on SSL wrapped sockets. Patch by David
  Watson.

3920 3921 3922
- Issue #12803: SSLContext.load_cert_chain() now accepts a password argument
  to be used if the private key is encrypted.  Patch by Adam Simpkins.

3923 3924 3925
- Issue #11657: Fix sending file descriptors over 255 over a multiprocessing
  Pipe.

3926 3927 3928
- Issue #12811: tabnanny.check() now promptly closes checked files. Patch by
  Anthony Briggs.

3929 3930
- Issue #6560: The sendmsg/recvmsg API is now exposed by the socket module
  when provided by the underlying platform, supporting processing of
3931
  ancillary data in pure Python code. Patch by David Watson and Heiko Wundram.
3932

3933 3934 3935 3936
- Issue #12326: On Linux, sys.platform doesn't contain the major version
  anymore. It is now always 'linux', instead of 'linux2' or 'linux3' depending
  on the Linux version used to build Python.

3937 3938 3939
- Issue #12213: Fix a buffering bug with interleaved reads and writes that
  could appear on BufferedRandom streams.

3940 3941 3942
- Issue #12778: Reduce memory consumption when JSON-encoding a large
  container of many small objects.

3943 3944 3945
- Issue #12650: Fix a race condition where a subprocess.Popen could leak
  resources (FD/zombie) when killed at the wrong time.

3946 3947 3948
- Issue #12744: Fix inefficient representation of integers between 2**31 and
  2**63 on systems with a 64-bit C "long".

3949 3950 3951
- Issue #12646: Add an 'eof' attribute to zlib.Decompress, to make it easier to
  detect truncated input streams.

3952 3953 3954
- Issue #11513: Fix exception handling ``tarfile.TarFile.gzopen()`` when
  the file cannot be opened.

3955 3956 3957
- Issue #12687: Fix a possible buffering bug when unpickling text mode
  (protocol 0, mostly) pickles.

Senthil Kumaran's avatar
Senthil Kumaran committed
3958 3959
- Issue #10087: Fix the html output format of the calendar module.

3960 3961 3962
- Issue #12540: Prevent zombie IDLE processes on Windows due to changes
  in os.kill().

3963 3964 3965
- Issue #13121: add support for inplace math operators to collections.Counter.

- Add support for unary plus and unary minus to collections.Counter.
3966

3967 3968
- Issue #12683: urlparse updated to include svn as schemes that uses relative
  paths. (svn from 1.5 onwards support relative path).
3969

3970 3971 3972 3973 3974
- Issue #12655: Expose functions from sched.h in the os module: sched_yield(),
  sched_setscheduler(), sched_getscheduler(), sched_setparam(),
  sched_get_min_priority(), sched_get_max_priority(), sched_rr_get_interval(),
  sched_getaffinity(), sched_setaffinity().

3975 3976
- Add ThreadError to threading.__all__.

3977 3978
- Issues #11104, #8688: Fix the behavior of distutils' sdist command with
  manually-maintained MANIFEST files.
3979

3980 3981 3982 3983
- Issue #11281: smtplib.STMP gets source_address parameter, which adds the
  ability to bind to specific source address on a machine with multiple
  interfaces. Patch by Paulo Scardine.

3984 3985
- Issue #12464: tempfile.TemporaryDirectory.cleanup() should not follow
  symlinks: fix it. Patch by Petri Lehtinen.
3986

Éric Araujo's avatar
Éric Araujo committed
3987 3988
- Issue #8887: "pydoc somebuiltin.somemethod" (or help('somebuiltin.somemethod')
  in Python code) now finds the doc of the method.
3989

3990
- Issue #10968: Remove indirection in threading.  The public names (Event,
3991
  Condition, etc.) used to be factory functions returning instances of hidden
3992 3993 3994
  classes (_Event, _Condition, etc.), because (if Guido recalls correctly) this
  code pre-dates the ability to subclass extension types.  It is now possible
  to inherit from these classes, without having to import the private
3995 3996
  underscored names like multiprocessing did.

3997 3998 3999
- Issue #9723: Add shlex.quote functions, to escape filenames and command
  lines.

4000 4001
- Issue #12603: Fix pydoc.synopsis() on files with non-negative st_mtime.

4002 4003 4004
- Issue #12514: Use try/finally to assure the timeit module restores garbage
  collections when it is done.

4005 4006 4007
- Issue #12607: In subprocess, fix issue where if stdin, stdout or stderr is
  given as a low fd, it gets overwritten.

4008 4009 4010
- Issue #12590: IDLE editor window now always displays the first line
  when opening a long file.  With Tk 8.5, the first line was hidden.

4011 4012
- Issue #12576: Fix urlopen behavior on sites which do not send (or obfuscate)
  a ``Connection: close`` header.
4013

4014 4015 4016
- Issue #12102: Document that buffered files must be flushed before being used
  with mmap. Patch by Steffen Daode Nurpmeso.

4017 4018
- Issue #12560: Build libpython.so on OpenBSD. Patch by Stefan Sperling.

4019 4020
- Issue #1813: Fix codec lookup under Turkish locales.

4021 4022 4023
- Issue #12591: Improve support of "universal newlines" in the subprocess
  module: the piped streams can now be properly read from or written to.

4024 4025 4026 4027
- Issue #12591: Allow io.TextIOWrapper to work with raw IO objects (without
  a read1() method), and add a *write_through* parameter to mandate
  unbuffered writes.

4028 4029
- Issue #10883: Fix socket leaks in urllib.request when using FTP.

4030 4031
- Issue #12592: Make Python build on OpenBSD 5 (and future major releases).

4032 4033
- Issue #12372: POSIX semaphores are broken on AIX: don't use them.

4034 4035 4036 4037 4038 4039
- Issue #12551: Provide a get_channel_binding() method on SSL sockets so as
  to get channel binding data for the current SSL session (only the
  "tls-unique" channel binding is implemented).  This allows the implementation
  of certain authentication mechanisms such as SCRAM-SHA-1-PLUS.  Patch by
  Jacek Konieczny.

4040 4041 4042
- Issue #665194: email.utils now has format_datetime and parsedate_to_datetime
  functions, allowing for round tripping of RFC2822 format dates.

4043 4044 4045 4046
- Issue #12571: Add a plat-linux3 directory mirroring the plat-linux2
  directory, so that "import DLFCN" and other similar imports work on
  Linux 3.0.

4047 4048 4049
- Issue #7484: smtplib no longer puts <> around addresses in VRFY and EXPN
  commands; they aren't required and in fact postfix doesn't support that form.

Benjamin Peterson's avatar
Benjamin Peterson committed
4050 4051 4052
- Issue #12273: Remove ast.__version__. AST changes can be accounted for by
  checking sys.version_info or sys._mercurial.

4053 4054 4055
- Silence spurious "broken pipe" tracebacks when shutting down a
  ProcessPoolExecutor.

4056 4057 4058
- Fix potential resource leaks in concurrent.futures.ProcessPoolExecutor
  by joining all queues and processes when shutdown() is called.

4059 4060 4061
- Issue #11603: Fix a crash when __str__ is rebound as __repr__.  Patch by
  Andreas Stührk.

4062 4063 4064
- Issue #11321: Fix a crash with multiple imports of the _pickle module when
  embedding Python.  Patch by Andreas Stührk.

4065 4066 4067
- Issue #6755: Add get_wch() method to curses.window class. Patch by Iñigo
  Serna.

4068 4069
- Add cgi.closelog() function to close the log file.

4070 4071
- Issue #12502: asyncore: fix polling loop with AF_UNIX sockets.

4072 4073 4074
- Issue #4376: ctypes now supports nested structures in a endian different than
  the parent structure. Patch by Vlad Riscutia.

4075 4076 4077
- Raise ValueError when attempting to set the _CHUNK_SIZE attribute of a
  TextIOWrapper to a huge value, not TypeError.

4078 4079 4080
- Issue #12504: Close file handles in a timely manner in packaging.database.
  This fixes a bug with the remove (uninstall) feature on Windows.

4081 4082 4083
- Issues #12169 and #10510: Factor out code used by various packaging commands
  to make HTTP POST requests, and make sure it uses CRLF.

4084 4085 4086 4087
- Issue #12016: Multibyte CJK decoders now resynchronize faster. They only
  ignore the first byte of an invalid byte sequence. For example,
  b'\xff\n'.decode('gb2312', 'replace') gives '\ufffd\n' instead of '\ufffd'.

4088 4089 4090 4091
- Issue #12459: time.sleep() now raises a ValueError if the sleep length is
  negative, instead of an infinite sleep on Windows or raising an IOError on
  Linux for example, to have the same behaviour on all platforms.

4092 4093 4094 4095
- Issue #12451: pydoc: html_getfile() now uses tokenize.open() to support
  Python scripts using a encoding different than UTF-8 (read the coding cookie
  of the script).

4096 4097 4098
- Issue #12493: subprocess: Popen.communicate() now also handles EINTR errors
  if the process has only one pipe.

4099 4100 4101
- Issue #12467: warnings: fix a race condition if a warning is emitted at
  shutdown, if globals()['__file__'] is None.

4102 4103 4104
- Issue #12451: pydoc: importfile() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to avoid encoding issues.

4105 4106 4107 4108
- Issue #12451: runpy: run_path() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to support other encodings
  than UTF-8 (scripts using the coding cookie).

4109 4110 4111
- Issue #12451: xml.dom.pulldom: parse() now opens files in binary mode instead
  of the text mode (using the locale encoding) to avoid encoding issues.

4112 4113 4114
- Issue #12147: Adjust the new-in-3.2 smtplib.send_message method for better
  conformance to the RFCs:  correctly handle Sender and Resent- headers.

4115 4116
- Issue #12352: Fix a deadlock in multiprocessing.Heap when a block is freed by
  the garbage collector while the Heap lock is held.
4117

R David Murray's avatar
R David Murray committed
4118
- Issue #12462: time.sleep() now immediately calls the (Python) signal handler
4119 4120 4121
  if it is interrupted by a signal, instead of having to wait until the next
  instruction.

4122 4123 4124
- Issue #12442: new shutil.disk_usage function, providing total, used and free
  disk space statistics.

4125 4126 4127 4128 4129
- Issue #12451: The XInclude default loader of xml.etree now decodes files from
  UTF-8 instead of the locale encoding if the encoding is not specified. It now
  also opens XML files for the parser in binary mode instead of the text mode
  to avoid encoding issues.

4130 4131 4132
- Issue #12451: doctest.debug_script() doesn't create a temporary file
  anymore to avoid encoding issues.

4133 4134 4135
- Issue #12451: pydoc.synopsis() now reads the encoding cookie if available,
  to read the Python script from the right encoding.

4136 4137 4138
- Issue #12451: distutils now opens the setup script in binary mode to read the
  encoding cookie, instead of opening it in UTF-8.

Ned Deily's avatar
Ned Deily committed
4139 4140 4141 4142
- Issue #9516: On Mac OS X, change Distutils to no longer globally attempt to
  check or set the MACOSX_DEPLOYMENT_TARGET environment variable for the
  interpreter process.  This could cause failures in non-Distutils subprocesses
  and was unreliable since tests or user programs could modify the interpreter
Ezio Melotti's avatar
Ezio Melotti committed
4143
  environment after Distutils set it.  Instead, have Distutils set the
Ned Deily's avatar
Ned Deily committed
4144 4145 4146 4147
  deployment target only in the environment of each build subprocess.  It is
  still possible to globally override the default by setting
  MACOSX_DEPLOYMENT_TARGET before launching the interpreter; its value must be
  greater or equal to the default value, the value with which the interpreter
4148
  was built.  Also, implement the same handling in packaging.
Ned Deily's avatar
Ned Deily committed
4149

4150 4151 4152
- Issue #12422: In the copy module, don't store objects that are their own copy
  in the memo dict.

4153 4154
- Issue #12303: Add sigwaitinfo() and sigtimedwait() to the signal module.

4155 4156 4157
- Issue #12404: Remove C89 incompatible code from mmap module. Patch by Akira
  Kitada.

4158 4159 4160
- Issue #1874: email now detects and reports as a defect the presence of
  any CTE other than 7bit, 8bit, or binary on a multipart.

4161 4162 4163
- Issue #12383: Fix subprocess module with env={}: don't copy the environment
  variables, start with an empty environment.

4164 4165 4166 4167
- Issue #11637: Fix support for importing packaging setup hooks from the
  project directory.

- Issue #6771: Moved the curses.wrapper function from the single-function
4168 4169 4170
  wrapper module into __init__, eliminating the module.  Since __init__ was
  already importing the function to curses.wrapper, there is no API change.

4171
- Issue #11584: email.header.decode_header no longer fails if the header
4172 4173
  passed to it is a Header object, and Header/make_header no longer fail
  if given binary unknown-8bit input.
4174

4175 4176 4177
- Issue #11700: mailbox proxy object close methods can now be called multiple
  times without error.

4178 4179
- Issue #11767: Correct file descriptor leak in mailbox's __getitem__ method.

4180 4181 4182 4183
- Issue #12133: AbstractHTTPHandler.do_open() of urllib.request closes the HTTP
  connection if its getresponse() method fails with a socket error. Patch
  written by Ezio Melotti.

4184 4185 4186
- Issue #12240: Allow multiple setup hooks in packaging's setup.cfg files.
  Original patch by Erik Bray.

4187 4188 4189
- Issue #9284: Allow inspect.findsource() to find the source of doctest
  functions.

4190 4191 4192 4193
- Issue #11595: Fix assorted bugs in packaging.util.cfg_to_args, a
  compatibility helper for the distutils-packaging transition.  Original patch
  by Erik Bray.

4194 4195 4196
- Issue #12287: In ossaudiodev, check that the device isn't closed in several
  methods.

Benjamin Peterson's avatar
Benjamin Peterson committed
4197
- Issue #12009: Fixed regression in netrc file comment handling.
4198

4199 4200 4201 4202
- Issue #12246: Warn and fail when trying to install a third-party project from
  an uninstalled Python (built in a source checkout).  Original patch by
  Tshepang Lekhonkhobe.

4203 4204
- Issue #10694: zipfile now ignores garbage at the end of a zipfile.

4205 4206
- Issue #12283: Fixed regression in smtplib quoting of leading dots in DATA.

4207 4208 4209
- Issue #10424: Argparse now includes the names of the missing required
  arguments in the missing arguments error message.

4210 4211 4212
- Issue #12168: SysLogHandler now allows NUL termination to be controlled using
  a new 'append_nul' attribute on the handler.

4213 4214 4215
- Issue #11583: Speed up os.path.isdir on Windows by using GetFileAttributes
  instead of os.stat.

4216 4217 4218
- Issue #12021: Make mmap's read() method argument optional. Patch by Petri
  Lehtinen.

4219 4220 4221 4222
- Issue #9205: concurrent.futures.ProcessPoolExecutor now detects killed
  children and raises BrokenProcessPool in such a situation.  Previously it
  would reliably freeze/deadlock.

4223
- Issue #12040: Expose a new attribute ``sentinel`` on instances of
Georg Brandl's avatar
Georg Brandl committed
4224 4225
  ``multiprocessing.Process``.  Also, fix Process.join() to not use polling
  anymore, when given a timeout.
4226

4227 4228 4229
- Issue #11893: Remove obsolete internal wrapper class ``SSLFakeFile`` in the
  smtplib module.  Patch by Catalin Iacob.

4230 4231 4232
- Issue #12080: Fix a Decimal.power() case that took an unreasonably long time
  to compute.

4233 4234 4235 4236
- Issue #12221: Remove __version__ attributes from pyexpat, pickle, tarfile,
  pydoc, tkinter, and xml.parsers.expat. This were useless version constants
  left over from the Mercurial transition

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
4237
- Named tuples now work correctly with vars().
4238

4239 4240 4241 4242
- Issue #12085: Fix an attribute error in subprocess.Popen destructor if the
  constructor has failed, e.g. because of an undeclared keyword argument. Patch
  written by Oleg Oshmyan.

4243
- Issue #12028: Make threading._get_ident() public, rename it to
Victor Stinner's avatar
Victor Stinner committed
4244
  threading.get_ident() and document it. This function was already used using
4245 4246
  _thread.get_ident().

4247 4248 4249
- Issue #12171: IncrementalEncoder.reset() of CJK codecs (multibytecodec) calls
  encreset() instead of decreset().

4250 4251
- Issue #12218: Removed wsgiref.egg-info.

4252
- Issue #12196: Add pipe2() to the os module.
4253

4254 4255 4256
- Issue #985064: Make plistlib more resilient to faulty input plists.
  Patch by Mher Movsisyan.

4257 4258 4259
- Issue #1625: BZ2File and bz2.decompress() now support multi-stream files.
  Initial patch by Nir Aides.

4260 4261
- Issue #12175: BufferedReader.read(-1) now calls raw.readall() if available.

4262 4263 4264
- Issue #12175: FileIO.readall() now only reads the file position and size
  once.

4265 4266 4267 4268 4269 4270
- Issue #12175: RawIOBase.readall() now returns None if read() returns None.

- Issue #12175: FileIO.readall() now raises a ValueError instead of an IOError
  if the file is closed.

- Issue #11109: New service_action method for BaseServer, used by ForkingMixin
4271
  class for cleanup. Initial Patch by Justin Warkentin.
4272 4273 4274

- Issue #12045: Avoid duplicate execution of command in
  ctypes.util._get_soname().  Patch by Sijin Joseph.
Senthil Kumaran's avatar
Senthil Kumaran committed
4275

4276 4277 4278
- Issue #10818: Remove the Tk GUI and the serve() function of the pydoc module,
  pydoc -g has been deprecated in Python 3.2 and it has a new enhanced web
  server.
4279

4280 4281 4282
- Issue #1441530: In imaplib, read the data in one chunk to speed up large
  reads and simplify code.

4283 4284 4285
- Issue #12070: Fix the Makefile parser of the sysconfig module to handle
  correctly references to "bogus variable" (e.g. "prefix=$/opt/python").

4286 4287 4288 4289
- Issue #12100: Don't reset incremental encoders of CJK codecs at each call to
  their encode() method anymore, but continue to call the reset() method if the
  final argument is True.

4290 4291 4292
- Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl
  module.

4293 4294 4295
- Issue #6501: os.device_encoding() returns None on Windows if the application
  has no console.

4296 4297
- Issue #12105: Add O_CLOEXEC to the os module.

4298 4299 4300 4301
- Issue #12079: Decimal('Infinity').fma(Decimal('0'), (3.91224318126786e+19+0j))
  now raises TypeError (reflecting the invalid type of the 3rd argument) rather
  than Decimal.InvalidOperation.

4302 4303 4304
- Issue #12124: zipimport doesn't keep a reference to zlib.decompress() anymore
  to be able to unload the module.

4305 4306
- Add the packaging module, an improved fork of distutils (also known as
  distutils2).
4307

4308 4309 4310
- Issue #12065: connect_ex() on an SSL socket now returns the original errno
  when the socket's timeout expires (it used to return None).

4311 4312 4313 4314
- Issue #8809: The SMTP_SSL constructor and SMTP.starttls() now support
  passing a ``context`` argument pointing to an ssl.SSLContext instance.
  Patch by Kasun Herath.

4315 4316 4317
- Issue #11088: don't crash when using F5 to run a script in IDLE on MacOSX
  with Tk 8.5.

4318 4319 4320
- Issue #9516: Issue #9516: avoid errors in sysconfig when MACOSX_DEPLOYMENT_TARGET
  is set in shell.

4321 4322 4323 4324 4325
- Issue #8650: Make zlib module 64-bit clean. compress(), decompress() and
  their incremental counterparts now raise OverflowError if given an input
  larger than 4GB, instead of silently truncating the input and returning
  an incorrect result.

4326 4327 4328
- Issue #12050: zlib.decompressobj().decompress() now clears the unconsumed_tail
  attribute when called without a max_length argument.

4329 4330 4331 4332 4333
- Issue #12062: Fix a flushing bug when doing a certain type of I/O sequence
  on a file opened in read+write mode (namely: reading, seeking a bit forward,
  writing, then seeking before the previous write but still within buffered
  data, and writing again).

4334 4335 4336
- Issue #9971: Write an optimized implementation of BufferedReader.readinto().
  Patch by John O'Connor.

4337
- Issue #1028: Tk returns invalid Unicode null in %A: UnicodeDecodeError.
4338
  With Tk < 8.5, PythonCmd() in _tkinter.c raised UnicodeDecodeError, caused
4339
  IDLE to exit.  Converted to valid Unicode null in PythonCmd().
4340

4341 4342 4343 4344
- Issue #11799: urllib.request Authentication Handlers will raise a ValueError
  when presented with an unsupported Authentication Scheme. Patch contributed
  by Yuval Greenfield.

4345 4346 4347 4348 4349
- Issue #10419, #6011: build_scripts command of distutils handles correctly
  non-ASCII path (path to the Python executable). Open and write the script in
  binary mode, but ensure that the shebang is decodable from UTF-8 and from the
  encoding of the script.

4350 4351 4352
- Issue #8498: In socket.accept(), allow to specify 0 as a backlog value in
  order to accept exactly one connection.  Patch by Daniel Evers.

4353 4354 4355
- Issue #12011: signal.signal() and signal.siginterrupt() raise an OSError,
  instead of a RuntimeError: OSError has an errno attribute.

R David Murray's avatar
R David Murray committed
4356 4357 4358
- Issue #3709: add a flush_headers method to BaseHTTPRequestHandler, which
  manages the sending of headers to output stream and flushing the internal
  headers buffer. Patch contribution by Andrew Schaaf
4359

4360 4361
- Issue #11743: Rewrite multiprocessing connection classes in pure Python.

4362 4363
- Issue #11164: Stop trying to use _xmlplus in the xml module.

4364 4365 4366
- Issue #11888: Add log2 function to math module. Patch written by Mark
  Dickinson.

4367 4368
- Issue #12012: ssl.PROTOCOL_SSLv2 becomes optional.

4369 4370 4371 4372
- Issue #8407: The signal handler writes the signal number as a single byte
  instead of a nul byte into the wakeup file descriptor. So it is possible to
  wait more than one signal and know which signals were raised.

4373 4374 4375
- Issue #8407: Add pthread_kill(), sigpending() and sigwait() functions to the
  signal module.

4376 4377 4378
- Issue #11927: SMTP_SSL now uses port 465 by default as documented.  Patch
  by Kasun Herath.

Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
4379
- Issue #12002: ftplib's abort() method raises TypeError.
4380

Ezio Melotti's avatar
Ezio Melotti committed
4381
- Issue #11916: Add a number of MacOSX specific definitions to the errno module.
4382 4383
  Patch by Pierre Carrier.

4384
- Issue #11999: fixed sporadic sync failure mailbox.Maildir due to its trying to
4385 4386 4387
  detect mtime changes by comparing to the system clock instead of to the
  previous value of the mtime.

4388 4389
- Issue #11072: added MLSD command (RFC-3659) support to ftplib.

4390 4391 4392 4393
- Issue #8808: The IMAP4_SSL constructor now allows passing an SSLContext
  parameter to control parameters of the secure channel.  Patch by Sijin
  Joseph.

4394 4395 4396
- ntpath.samefile failed to notice that "a.txt" and "A.TXT" refer to the same
  file on Windows XP. As noticed in issue #10684.

4397 4398 4399 4400
- Issue #12000: When a SSL certificate has a subjectAltName without any
  dNSName entry, ssl.match_hostname() should use the subject's commonName.
  Patch by Nicolas Bareil.

4401 4402 4403 4404
- Issue #10775: assertRaises, assertRaisesRegex, assertWarns, and
  assertWarnsRegex now accept a keyword argument 'msg' when used as context
  managers.  Initial patch by Winston Ewert.

Ronald Oussoren's avatar
Ronald Oussoren committed
4405 4406 4407 4408
- Issue #10684: shutil.move used to delete a folder on case insensitive
  filesystems when the source and destination name where the same except
  for the case.

4409 4410 4411 4412
- Issue #11647: objects created using contextlib.contextmanager now support
  more than one call to the function when used as a decorator. Initial patch
  by Ysj Ray.

4413 4414 4415
- Issue #11930: Removed deprecated time.accept2dyear variable.
  Removed year >= 1000 restriction from datetime.strftime.

4416 4417
- logging: don't define QueueListener if Python has no thread support.

4418 4419
- functools.cmp_to_key() now works with collections.Hashable().

4420 4421 4422
- Issue #11277: mmap.mmap() calls fcntl(fd, F_FULLFSYNC) on Mac OS X to get
  around a mmap bug with sparse files. Patch written by Steffen Daode Nurpmeso.

4423 4424 4425
- Issue #8407: Add signal.pthread_sigmask() function to fetch and/or change the
  signal mask of the calling thread.

4426 4427 4428 4429 4430
- Issue #11858: configparser.ExtendedInterpolation expected lower-case section
  names.

- Issue #11324: ConfigParser(interpolation=None) now works correctly.

4431 4432 4433
- Issue #11811: ssl.get_server_certificate() is now IPv6-compatible.  Patch
  by Charles-François Natali.

4434 4435 4436
- Issue #11763: don't use difflib in TestCase.assertMultiLineEqual if the
  strings are too long.

4437 4438
- Issue #11236: getpass.getpass responds to ctrl-c or ctrl-z on terminal.

4439 4440
- Issue #11856: Speed up parsing of JSON numbers.

4441
- Issue #11005: threading.RLock()._release_save() raises a RuntimeError if the
4442 4443
  lock was not acquired.

4444 4445 4446
- Issue #11258: Speed up ctypes.util.find_library() under Linux by a factor
  of 5 to 10.  Initial patch by Jonas H.

4447 4448 4449
- Issue #11382: Trivial system calls, such as dup() or pipe(), needn't
  release the GIL.  Patch by Charles-François Natali.

4450 4451 4452
- Issue #11223: Add threading._info() function providing informations about
  the thread implementation.

4453 4454 4455
- Issue #11731: simplify/enhance email parser/generator API by introducing
  policy objects.

4456 4457 4458 4459
- Issue #11768: The signal handler of the signal module only calls
  Py_AddPendingCall() for the first signal to fix a deadlock on reentrant or
  parallel calls. PyErr_SetInterrupt() writes also into the wake up file.

4460 4461
- Issue #11492: fix several issues with header folding in the email package.

4462 4463
- Issue #11852: Add missing imports and update tests.

4464 4465 4466
- Issue #11875: collections.OrderedDict's __reduce__ was temporarily
  mutating the object instead of just working on a copy.

4467
- Issue #11467: Fix urlparse behavior when handling urls which contains scheme
4468 4469
  specific part only digits. Patch by Santoso Wijaya.

4470 4471
- collections.Counter().copy() now works correctly for subclasses.

4472 4473 4474
- Issue #11474: Fix the bug with url2pathname() handling of '/C|/' on Windows.
  Patch by Santoso Wijaya.

4475 4476
- Issue #11684: complete email.parser bytes API by adding BytesHeaderParser.

4477 4478
- The bz2 module now handles 4GiB+ input buffers correctly.

Ezio Melotti's avatar
Ezio Melotti committed
4479 4480
- Issue #9233: Fix json.loads('{}') to return a dict (instead of a list), when
  _json is not available.
4481

Ezio Melotti's avatar
Ezio Melotti committed
4482
- Issue #11830: Remove unnecessary introspection code in the decimal module.
4483 4484

- Issue #11703: urllib2.geturl() does not return correct url when the original
4485
  url contains #fragment.
4486

4487 4488 4489
- Issue #10019: Fixed regression in json module where an indent of 0 stopped
  adding newlines and acted instead like 'None'.

4490 4491 4492
- Issue #11186: pydoc ignores a module if its name contains a surrogate
  character in the index of modules.

4493 4494 4495
- Issue #11815: Use a light-weight SimpleQueue for the result queue in
  concurrent.futures.ProcessPoolExecutor.

brian.curtin's avatar
brian.curtin committed
4496 4497 4498
- Issue #5162: Treat services like frozen executables to allow child spawning
  from multiprocessing.forking on Windows.

4499 4500 4501 4502
- logging.basicConfig now supports an optional 'handlers' argument taking an
  iterable of handlers to be added to the root logger. Additional parameter
  checks were also added to basicConfig.

4503 4504
- Issue #11814: Fix likely typo in multiprocessing.Pool._terminate().

4505 4506 4507
- Issue #11747: Fix range formatting in difflib.context_diff() and
  difflib.unified_diff().

4508 4509 4510 4511
- Issue #8428: Fix a race condition in multiprocessing.Pool when terminating
  worker processes: new processes would be spawned while the pool is being
  shut down.  Patch by Charles-François Natali.

4512 4513
- Issue #2650: re.escape() no longer escapes the '_'.

4514 4515 4516 4517
- Issue #11757: select.select() now raises ValueError when a negative timeout
  is passed (previously, a select.error with EINVAL would be raised).  Patch
  by Charles-François Natali.

4518 4519
- Issue #7311: fix html.parser to accept non-ASCII attribute values.

Georg Brandl's avatar
Georg Brandl committed
4520
- Issue #11605: email.parser.BytesFeedParser was incorrectly converting
Éric Araujo's avatar
Éric Araujo committed
4521
  multipart subparts with an 8-bit CTE into unicode instead of preserving the
Georg Brandl's avatar
Georg Brandl committed
4522
  bytes.
4523

Éric Araujo's avatar
Éric Araujo committed
4524 4525
- Issue #1690608: email.util.formataddr is now RFC 2047 aware:  it now has a
  charset parameter that defaults to utf-8 and is used as the charset for RFC
4526 4527
  2047 encoding when the realname contains non-ASCII characters.

4528 4529
- Issue #10963: Ensure that subprocess.communicate() never raises EPIPE.

4530 4531 4532
- Issue #10791: Implement missing method GzipFile.read1(), allowing GzipFile
  to be wrapped in a TextIOWrapper.  Patch by Nadeem Vawda.

4533 4534 4535
- Issue #11707: Added a fast C version of functools.cmp_to_key().
  Patch by Filip Gruszczyński.

4536 4537 4538
- Issue #11688: Add sqlite3.Connection.set_trace_callback().  Patch by
  Torsten Landschoff.

4539 4540 4541
- Issue #11746: Fix SSLContext.load_cert_chain() to accept elliptic curve
  private keys.

4542 4543 4544 4545
- Issue #5863: Rewrite BZ2File in pure Python, and allow it to accept
  file-like objects using a new ``fileobj`` constructor argument.  Patch by
  Nadeem Vawda.

4546 4547
- unittest.TestCase.assertSameElements has been removed.

4548 4549 4550
- sys.getfilesystemencoding() raises a RuntimeError if initfsencoding() was not
  called yet: detect bootstrap (startup) issues earlier.

4551 4552
- Issue #11393: Add the new faulthandler module.

4553 4554
- Issue #11618: Fix the timeout logic in threading.Lock.acquire() under Windows.

4555 4556 4557
- Removed the 'strict' argument to email.parser.Parser, which has been
  deprecated since Python 2.4.

4558 4559 4560
- Issue #11256: Fix inspect.getcallargs on functions that take only keyword
  arguments.

4561 4562
- Issue #11696: Fix ID generation in msilib.

4563 4564 4565
- itertools.accumulate now supports an optional *func* argument for
  a user-supplied binary function.

4566 4567
- Issue #11692: Remove unnecessary demo functions in subprocess module.

4568 4569 4570
- Issue #9696: Fix exception incorrectly raised by xdrlib.Packer.pack_int when
  trying to pack a negative (in-range) integer.

4571 4572 4573 4574
- Issue #11675: multiprocessing.[Raw]Array objects created from an integer size
  are now zeroed on creation.  This matches the behaviour specified by the
  documentation.

Martin v. Löwis's avatar
Martin v. Löwis committed
4575
- Issue #7639: Fix short file name generation in bdist_msi
4576

4577 4578 4579
- Issue #11659: Fix ResourceWarning in test_subprocess introduced by #11459.
  Patch by Ben Hayden.

4580 4581 4582
- Issue #11635: Don't use polling in worker threads and processes launched by
  concurrent.futures.

4583 4584 4585 4586
- Issue #6811: Allow importlib to change a code object's co_filename attribute
  to match the path to where the source code currently is, not where the code
  object originally came from.

4587 4588
- Issue #8754: Have importlib use the repr of a module name in error messages.

4589 4590 4591
- Issue #11591: Prevent "import site" from modifying sys.path when python
  was started with -S.

4592 4593 4594 4595 4596
- collections.namedtuple() now adds a _source attribute to the generated
  class.  This make the source more accessible than the outdated
  "verbose" option which prints to stdout but doesn't make the source
  string available.

4597 4598 4599
- Issue #11371: Mark getopt error messages as localizable.  Patch by Filip
  Gruszczyński.

4600 4601
- Issue #11333: Add __slots__ to collections ABCs.

4602
- Issue #11628: cmp_to_key generated class should use __slots__.
4603

4604 4605 4606
- Issue #11666: let help() display named tuple attributes and methods
  that start with a leading underscore.

Guido van Rossum's avatar
Guido van Rossum committed
4607 4608 4609
- Issue #11662: Make urllib and urllib2 ignore redirections if the
  scheme is not HTTP, HTTPS or FTP (CVE-2011-1521).

4610 4611 4612
- Issue #5537: Fix time2isoz() and time2netscape() functions of
  httplib.cookiejar for expiration year greater than 2038 on 32-bit systems.

4613 4614
- Issue #4391: Use proper gettext plural forms in optparse.

4615 4616
- Issue #11127: Raise a TypeError when trying to pickle a socket object.

4617
- Issue #11563: ``Connection: close`` header is sent by requests using URLOpener
Senthil Kumaran's avatar
Senthil Kumaran committed
4618 4619 4620
  class which helps in closing of sockets after connection is over. Patch
  contributions by Jeff McNeil and Nadeem Vawda.

4621 4622 4623
- Issue #11459: A ``bufsize`` value of 0 in subprocess.Popen() really creates
  unbuffered pipes, such that select() works properly on them.

4624 4625
- Issue #5421: Fix misleading error message when one of socket.sendto()'s
  arguments has the wrong type.  Patch by Nikita Vetoshkin.
4626

4627
- Issue #10812: Add some extra posix functions to the os module.
4628 4629 4630 4631

- Issue #10979: unittest stdout buffering now works with class and module
  setup and teardown.

4632 4633
- Issue #11577: fix ResourceWarning triggered by improved binhex test coverage

4634 4635 4636
- Issue #11243: fix the parameter querying methods of Message to work if
  the headers contain un-encoded non-ASCII data.

4637 4638 4639
- Issue #11401: fix handling of headers with no value; this fixes a regression
  relative to Python2 and the result is now the same as it was in Python2.

4640 4641 4642 4643
- Issue #9298: base64 bodies weren't being folded to line lengths less than 78,
  which was a regression relative to Python2.  Unlike Python2, the last line
  of the folded body now ends with a carriage return.

Nick Coghlan's avatar
Nick Coghlan committed
4644
- Issue #11560: shutil.unpack_archive now correctly handles the format
Nick Coghlan's avatar
Nick Coghlan committed
4645 4646
  parameter. Patch by Evan Dandrea.

4647 4648
- Issue #5870: Add `subprocess.DEVNULL` constant.

4649
- Issue #11133: fix two cases where inspect.getattr_static can trigger code
Benjamin Peterson's avatar
Benjamin Peterson committed
4650
  execution. Patch by Andreas Stührk.
4651

4652 4653 4654 4655
- Issue #11569: use absolute path to the sysctl command in multiprocessing to
  ensure that it will be found regardless of the shell PATH. This ensures
  that multiprocessing.cpu_count works on default installs of MacOSX.

4656 4657 4658 4659
- Issue #11501: disutils.archive_utils.make_zipfile no longer fails if zlib is
  not installed. Instead, the zipfile.ZIP_STORED compression is used to create
  the ZipFile. Patch by Natalia B. Bidart.

4660
- Issue #11289: `smtp.SMTP` class is now a context manager so it can be used
4661 4662
  in a `with` statement.  Contributed by Giampaolo Rodola.

4663 4664 4665
- Issue #11554: Fixed support for Japanese codecs; previously the body output
  encoding was not done if euc-jp or shift-jis was specified as the charset.

briancurtin's avatar
briancurtin committed
4666 4667 4668
- Issue #11509: Significantly increase test coverage of fileinput.
  Patch by Denver Coneybeare at PyCon 2011 Sprints.

4669 4670 4671
- Issue #11407: `TestCase.run` returns the result object used or created.
  Contributed by Janathan Hartley.

4672
- Issue #11500: Fixed a bug in the OS X proxy bypass code for fully qualified
Antoine Pitrou's avatar
Antoine Pitrou committed
4673
  IP addresses in the proxy exception list.
4674

4675 4676 4677 4678
- Issue #11491: dbm.error is no longer raised when dbm.open is called with
  the "n" as the flag argument and the file exists. The behavior matches
  the documentation and general logic.

Éric Araujo's avatar
Éric Araujo committed
4679
- Issue #1162477: Postel Principle adjustment to email date parsing: handle the
4680 4681
  fact that some non-compliant MUAs use '.' instead of ':' in time specs.

4682 4683 4684
- Issue #11131: Fix sign of zero in decimal.Decimal plus and minus
  operations when the rounding mode is ROUND_FLOOR.

4685 4686
- Issue #9935: Speed up pickling of instances of user-defined classes.

4687 4688 4689
- Issue #5622: Fix curses.wrapper to raise correct exception if curses
  initialization fails.

4690 4691 4692
- Issue #11408: In threading.Lock.acquire(), only call gettimeofday() when
  really necessary.  Patch by Charles-François Natali.

4693 4694 4695 4696
- Issue #11391: Writing to a mmap object created with
  ``mmap.PROT_READ|mmap.PROT_EXEC`` would segfault instead of raising a
  TypeError.  Patch by Charles-François Natali.

4697 4698
- Issue #9795: add context manager protocol support for nntplib.NNTP class.

4699 4700 4701 4702
- Issue #11306: mailbox in certain cases adapts to an inability to open
  certain files in read-write mode.  Previously it detected this by
  checking for EACCES, now it also checks for EROFS.

4703 4704 4705
- Issue #11265: asyncore now correctly handles EPIPE, EBADF and EAGAIN errors
  on accept(), send() and recv().

4706 4707
- Issue #11377: Deprecate platform.popen() and reimplement it with os.popen().

4708 4709
- Issue #8513: On UNIX, subprocess supports bytes command string.

4710 4711
- Issue #10866: Add socket.sethostname().  Initial patch by Ross Lagerwall.

4712 4713
- Issue #11140: Lock.release() now raises a RuntimeError when attempting
  to release an unacquired lock, as claimed in the threading documentation.
Antoine Pitrou's avatar
Antoine Pitrou committed
4714
  The _thread.error exception is now an alias of RuntimeError.  Patch by
4715
  Filip Gruszczyński.  Patch for _dummy_thread by Aymeric Augustin.
4716

4717
- Issue #8594: ftplib now provides a source_address parameter to specify which
4718 4719
  (address, port) to bind to before connecting.

4720 4721 4722
- Issue #11326: Add the missing connect_ex() implementation for SSL sockets,
  and make it work for non-blocking connects.

4723 4724
- Issue #11297: Add collections.ChainMap().

4725
- Issue #10755: Add the posix.flistdir() function.  Patch by Ross Lagerwall.
4726

Georg Brandl's avatar
Georg Brandl committed
4727 4728
- Issue #4761: Add the ``*at()`` family of functions (openat(), etc.) to the
  posix module.  Patch by Ross Lagerwall.
4729

4730 4731 4732
- Issue #7322: Trying to read from a socket's file-like object after a timeout
  occurred now raises an error instead of silently losing data.

4733
- Issue #11291: poplib.POP no longer suppresses errors on quit().
4734

4735
- Issue #11177: asyncore's create_socket() arguments can now be omitted.
4736

4737 4738 4739 4740 4741
- Issue #6064: Add a ``daemon`` keyword argument to the threading.Thread
  and multiprocessing.Process constructors in order to override the
  default behaviour of inheriting the daemonic property from the current
  thread/process.

4742 4743 4744
- Issue #10956: Buffered I/O classes retry reading or writing after a signal
  has arrived and the handler returned successfully.

4745 4746
- Issue #10784: New os.getpriority() and os.setpriority() functions.

4747 4748 4749 4750
- Issue #11114: Fix catastrophic performance of tell() on text files (up
  to 1000x faster in some cases).  It is still one to two order of magnitudes
  slower than binary tell().

4751
- Issue #10882: Add os.sendfile function.
4752

4753 4754 4755
- Issue #10868: Allow usage of the register method of an ABC as a class
  decorator.

4756 4757 4758 4759
- Issue #11224: Fixed a regression in tarfile that affected the file-like
  objects returned by TarFile.extractfile() regarding performance, memory
  consumption and failures with the stream interface.

4760 4761 4762 4763
- Issue #10924: Adding salt and Modular Crypt Format to crypt library.
  Moved old C wrapper to _crypt, and added a Python wrapper with
  enhanced salt generation and simpler API for password generation.

4764 4765
- Issue #11074: Make 'tokenize' so it can be reloaded.

4766 4767 4768 4769 4770
- Issue #11085: Moved collections abstract base classes into a separate
  module called collections.abc, following the pattern used by importlib.abc.
  For backwards compatibility, the names are imported into the collections
  module.

4771 4772 4773 4774
- Issue #4681: Allow mmap() to work on file sizes and offsets larger than
  4GB, even on 32-bit builds.  Initial patch by Ross Lagerwall, adapted for
  32-bit Windows.

4775 4776 4777
- Issue #11169: compileall module uses repr() to format filenames and paths to
  escape surrogate characters and show spaces.

4778
- Issue #11089: Fix performance issue limiting the use of ConfigParser()
4779
  with large config files.
4780

4781 4782 4783
- Issue #10276: Fix the results of zlib.crc32() and zlib.adler32() on buffers
  larger than 4GB.  Patch by Nadeem Vawda.

4784 4785
- Issue #11388: Added a clear() method to MutableSequence

4786 4787 4788
- Issue #11174: Add argparse.MetavarTypeHelpFormatter, which uses type names
  for the names of optional and positional arguments in help messages.

4789 4790
- Issue #9348: Raise an early error if argparse nargs and metavar don't match.

4791 4792
- Issue #8982: Improve the documentation for the argparse Namespace object.

4793 4794 4795
- Issue #9343: Document that argparse parent parsers must be configured before
  their children.

4796 4797
- Issue #9026: Fix order of argparse sub-commands in help messages.

4798 4799
- Issue #9347: Fix formatting for tuples in argparse type= error messages.

4800 4801 4802
- Issue #12191: Added shutil.chown() to change user and/or group owner of a
  given path also specifying their names.

4803 4804 4805
- Issue #13988: The _elementtree accelerator is used whenever available.
  Now xml.etree.cElementTree becomes a deprecated alias to ElementTree.

4806 4807 4808
Build
-----

Martin v. Löwis's avatar
Martin v. Löwis committed
4809 4810
- Issue #6807: Run msisupport.mak earlier.

Martin v. Löwis's avatar
Martin v. Löwis committed
4811 4812
- Issue #10580: Minor grammar change in Windows installer.

4813 4814
- Issue #13326: Clean __pycache__ directories correctly on OpenBSD.

4815 4816
- PEP 393: the configure option --with-wide-unicode is removed.

4817 4818 4819
- Issue #12852: Set _XOPEN_SOURCE to 700, instead of 600, to get POSIX 2008
  functions on OpenBSD (e.g. fdopendir).

4820 4821 4822 4823
- Issue #11863: Remove support for legacy systems deprecated in Python 3.2
  (following PEP 11).  These systems are systems using Mach C Threads,
  SunOS lightweight processes, GNU pth threads and IRIX threads.

4824 4825
- Issue #8746: Correct faulty configure checks so that os.chflags() and
  os.lchflags() are once again built on systems that support these
Georg Brandl's avatar
Georg Brandl committed
4826
  functions (BSD and OS X).  Also add new stat file flags for OS X
4827 4828
  (UF_HIDDEN and UF_COMPRESSED).

4829
- Issue #10645: Installing Python no longer creates a
4830 4831
  Python-X.Y.Z-pyX.Y.egg-info file in the lib-dynload directory.

4832 4833 4834
- Do not accidentally include the directory containing sqlite.h twice when
  building sqlite3.

4835 4836 4837 4838
- Issue #11217: For 64-bit/32-bit Mac OS X universal framework builds,
  ensure "make install" creates symlinks in --prefix bin for the "-32"
  files in the framework bin directory like the installer does.

4839
- Issue #11347: Use --no-as-needed when linking libpython3.so.
4840

Thomas Wouters's avatar
Thomas Wouters committed
4841
- Issue #11411: Fix 'make DESTDIR=' with a relative destination.
Georg Brandl's avatar
Georg Brandl committed
4842

4843 4844
- Issue #11268: Prevent Mac OS X Installer failure if Documentation
  package had previously been installed.
4845

4846
- Issue #11495: OSF support is eliminated. It was deprecated in Python 3.2.
4847

4848

4849 4850 4851 4852 4853
IDLE
----

- Issue #11718: IDLE's open module dialog couldn't find the __init__.py
  file in a package.
4854

4855 4856 4857
Tools/Demos
-----------

4858 4859 4860
- Issue #14053: patchcheck.py ("make patchcheck") now works with MQ patches.
  Patch by Francisco Martín Brugué.

4861 4862 4863 4864 4865
- Issue #13930: 2to3 is now able to write its converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.  See its new -o, -W and --add-suffix options.  This makes it more
  useful in many automated code translation workflows.

4866 4867 4868
- Issue #13628: python-gdb.py is now able to retrieve more frames in the Python
  traceback if Python is optimized.

4869 4870 4871
- Issue #11996: libpython (gdb), replace "py-bt" command by "py-bt-full" and
  add a smarter "py-bt" command printing a classic Python traceback.

4872 4873
- Issue #11179: Make ccbench work under Python 3.1 and 2.7 again.

4874 4875
- Issue #10639: reindent.py no longer converts newlines and will raise
  an error if attempting to convert a file with mixed newlines.
4876
  "--newline" option added to specify new line character.
4877

Ezio Melotti's avatar
Ezio Melotti committed
4878 4879
Extension Modules
-----------------
4880

4881 4882 4883 4884
- Issue #16847: Fixed improper use of _PyUnicode_CheckConsistency() in
  non-pydebug builds. Several extension modules now compile cleanly when
  assert()s are enabled in standard builds (-DDEBUG flag).

4885 4886 4887
- Issue #13840: The error message produced by ctypes.create_string_buffer
  when given a Unicode string has been fixed.

4888 4889 4890
- Issue #9975: socket: Fix incorrect use of flowinfo and scope_id. Patch by
  Vilmos Nebehaj.

4891 4892
- Issue #7777: socket: Add Reliable Datagram Sockets (PF_RDS) support.

4893 4894 4895
- Issue #13159: FileIO and BZ2Compressor/BZ2Decompressor now use a linear-time
  buffer growth strategy instead of a quadratic-time one.

4896 4897 4898
- Issue #10141: socket: Add SocketCAN (PF_CAN) support. Initial patch by
  Matthias Fuchs, updated by Tiago Gonçalves.

4899 4900 4901 4902
- Issue #13070: Fix a crash when a TextIOWrapper caught in a reference cycle
  would be finalized after the reference to its underlying BufferedRWPair's
  writer got cleared by the GC.

4903 4904
- Issue #12881: ctypes: Fix segfault with large structure field names.

4905 4906 4907
- Issue #13058: ossaudiodev: fix a file descriptor leak on error. Patch by
  Thomas Jarosch.

4908 4909 4910
- Issue #13013: ctypes: Fix a reference leak in PyCArrayType_from_ctype.
  Thanks to Suman Saha for finding the bug and providing a patch.

4911 4912 4913
- Issue #13022: Fix: _multiprocessing.recvfd() doesn't check that
  file descriptor was actually received.

4914 4915 4916
- Issue #1172711: Add 'long long' support to the array module.
  Initial patch by Oren Tirosh and Hirokazu Yamamoto.

4917 4918 4919
- Issue #12483: ctypes: Fix a crash when the destruction of a callback
  object triggers the garbage collector.

Jesus Cea's avatar
NEWS  
Jesus Cea committed
4920 4921 4922
- Issue #12950: Fix passing file descriptors in multiprocessing, under
  OpenIndiana/Illumos.

4923 4924 4925
- Issue #12764: Fix a crash in ctypes when the name of a Structure field is not
  a string.

Amaury Forgeot d'Arc's avatar
Amaury Forgeot d'Arc committed
4926 4927 4928 4929 4930
- Issue #11241: subclasses of ctypes.Array can now be subclassed.

- Issue #9651: Fix a crash when ctypes.create_string_buffer(0) was passed to
  some functions like file.write().

4931 4932 4933 4934
- Issue #10309: Define _GNU_SOURCE so that mremap() gets the proper
  signature.  Without this, architectures where sizeof void* != sizeof int are
  broken.  Patch given by Hallvard B Furuseth.

Ezio Melotti's avatar
Ezio Melotti committed
4935 4936
- Issue #12051: Fix segfault in json.dumps() while encoding highly-nested
  objects using the C accelerations.
4937

Ezio Melotti's avatar
Ezio Melotti committed
4938 4939
- Issue #12017: Fix segfault in json.loads() while decoding highly-nested
  objects using the C accelerations.
4940

Benjamin Peterson's avatar
Benjamin Peterson committed
4941 4942
- Issue #1838: Prevent segfault in ctypes, when _as_parameter_ on a class is set
  to an instance of the class.
4943

4944
Tests
4945
-----
4946

Petri Lehtinen's avatar
Petri Lehtinen committed
4947 4948
- Issue #11689: Fix a variable scoping error in an sqlite3 test

4949 4950
- Issue #13786: Remove unimplemented 'trace' long option from regrtest.py.

Meador Inge's avatar
Meador Inge committed
4951 4952 4953
- Issue #13725: Fix regrtest to recognize the documented -d flag.
  Patch by Erno Tukia.

4954 4955 4956
- Issue #13304: Skip test case if user site-packages disabled (-s or
  PYTHONNOUSERSITE).  (Patch by Carl Meyer)

4957 4958 4959
- Issue #5661: Add a test for ECONNRESET/EPIPE handling to test_asyncore. Patch
  by Xavier de Gaye.

4960 4961
- Issue #13218: Fix test_ssl failures on Debian/Ubuntu.

4962 4963 4964
- Re-enable lib2to3's test_parser.py tests, though with an expected failure
  (see issue 13125).

4965 4966
- Issue #12656: Add tests for IPv6 and Unix sockets to test_asyncore.

4967 4968
- Issue #6484: Add unit tests for mailcap module (patch by Gregory Nofi)

4969 4970 4971 4972 4973
- Issue #11651: Improve the Makefile test targets to run more of the test suite
  more quickly. The --multiprocess option is now enabled by default, reducing
  the amount of time needed to run the tests. "make test" and "make quicktest"
  now include some resource-intensive tests, but no longer run the test suite
  twice to check for bugs in .pyc generation. Tools/scripts/run_test.py provides
Éric Araujo's avatar
Éric Araujo committed
4974
  an easy platform-independent way to run test suite with sensible defaults.
4975

4976 4977 4978
- Issue #12331: The test suite for the packaging module can now run from an
  installed Python.

4979 4980 4981
- Issue #12331: The test suite for lib2to3 can now run from an installed
  Python.

4982 4983 4984 4985 4986
- Issue #12626: In regrtest, allow to filter tests using a glob filter
  with the ``-m`` (or ``--match``) option.  This works with all test cases
  using the unittest module.  This is useful with long test suites
  such as test_io or test_subprocess.

4987 4988 4989 4990 4991
- Issue #12624: It is now possible to fail after the first failure when
  running in verbose mode (``-v`` or ``-W``), by using the ``--failfast``
  (or ``-G``) option to regrtest.  This is useful with long test suites
  such as test_io or test_subprocess.

4992 4993 4994
- Issue #12587: Correct faulty test file and reference in test_tokenize.
  (Patch by Robert Xiao)

4995 4996
- Issue #12573: Add resource checks for dangling Thread and Process objects.

4997 4998 4999
- Issue #12549: Correct test_platform to not fail when OS X returns 'x86_64'
  as the processor type on some Mac systems.

5000 5001 5002
- Skip network tests when getaddrinfo() returns EAI_AGAIN, meaning a temporary
  failure in name resolution.

5003 5004 5005
- Issue #11812: Solve transient socket failure to connect to 'localhost'
  in test_telnetlib.py.

5006 5007
- Solved a potential deadlock in test_telnetlib.py. Related to issue #11812.

5008 5009 5010 5011
- Avoid failing in test_robotparser when mueblesmoraleda.com is flaky and
  an overzealous DNS service (e.g. OpenDNS) redirects to a placeholder
  Web site.

5012 5013 5014 5015
- Avoid failing in test_urllibnet.test_bad_address when some overzealous
  DNS service (e.g. OpenDNS) resolves a non-existent domain name.  The test
  is now skipped instead.

5016 5017 5018 5019
- Issue #12440: When testing whether some bits in SSLContext.options can be
  reset, check the version of the OpenSSL headers Python was compiled against,
  rather than the runtime version of the OpenSSL library.

5020 5021
- Issue #11512: Add a test suite for the cgitb module. Patch by Robbie Clemons.

5022 5023 5024 5025
- Issue #12497: Install test/data to prevent failures of the various codecmaps
  tests.

- Issue #12496: Install test/capath directory to prevent test_connect_capath
5026 5027
  testcase failure in test_ssl.

5028 5029 5030 5031
- Issue #12469: Run wakeup and pending signal tests in a subprocess to run the
  test in a fresh process with only one thread and to not change signal
  handling of the parent process.

5032 5033 5034 5035
- Issue #8716: Avoid crashes caused by Aqua Tk on OSX when attempting to run
  test_tk or test_ttk_guionly under a username that is not currently logged
  in to the console windowserver (as may be the case under buildbot or ssh).

5036 5037
- Issue #12407: Explicitly skip test_capi.EmbeddingTest under Windows.

5038 5039 5040 5041
- Issue #12400: regrtest -W doesn't rerun the tests twice anymore, but captures
  the output and displays it on failure instead. regrtest -v doesn't print the
  error twice anymore if there is only one error.

5042 5043 5044 5045 5046
- Issue #12141: Install copies of template C module file so that
  test_build_ext of test_distutils and test_command_build_ext of
  test_packaging are no longer silently skipped when
  run outside of a build directory.

5047 5048 5049
- Issue #8746: Add additional tests for os.chflags() and os.lchflags().
  Patch by Garrett Cooper.

5050 5051 5052
- Issue #10736: Fix test_ttk test_widgets failures with Cocoa Tk 8.5.9
  2.8 +  on Mac OS X.  (Patch by Ronald Oussoren)

5053 5054 5055
- Issue #12057: Add tests for ISO 2022 codecs (iso2022_jp, iso2022_jp_2,
  iso2022_kr).

5056 5057 5058
- Issue #12096: Fix a race condition in test_threading.test_waitfor(). Patch
  written by Charles-François Natali.

5059 5060 5061
- Issue #11614: import __hello__ prints "Hello World!". Patch written by
  Andreas Stührk.

Ezio Melotti's avatar
Ezio Melotti committed
5062 5063
- Issue #5723: Improve json tests to be executed with and without accelerations.

5064 5065
- Issue #12041: Make test_wait3 more robust.

5066 5067 5068
- Issue #11873: Change regex in test_compileall to fix occasional failures when
  when the randomly generated temporary path happened to match the regex.

5069 5070 5071
- Issue #11958: Fix FTP tests for IPv6, bind to "::1" instead of "localhost".
  Patch written by Charles-Francois Natali.

5072 5073 5074 5075
- Issue #8407, #11859: Fix tests of test_io using threads and an alarm: use
  pthread_sigmask() to ensure that the SIGALRM signal is received by the main
  thread.

5076 5077 5078 5079
- Issue #11811: Factor out detection of IPv6 support on the current host
  and make it available as ``test.support.IPV6_ENABLED``.  Patch by
  Charles-François Natali.

Antoine Pitrou's avatar
Antoine Pitrou committed
5080 5081
- Issue #10914: Add a minimal embedding test to test_capi.

5082 5083 5084 5085 5086 5087
- Issue #11223: Skip test_lock_acquire_interruption() and
  test_rlock_acquire_interruption() of test_threadsignals if a thread lock is
  implemented using a POSIX mutex and a POSIX condition variable. A POSIX
  condition variable cannot be interrupted by a signal (e.g. on Linux, the
  futex system call is restarted).

5088 5089
- Issue #11790: Fix sporadic failures in test_multiprocessing.WithProcessesTestCondition.

5090 5091
- Fix possible "file already exists" error when running the tests in parallel.

Ross Lagerwall's avatar
Ross Lagerwall committed
5092 5093
- Issue #11719: Fix message about unexpected test_msilib skip on non-Windows
  platforms. Patch by Nadeem Vawda.
5094

5095 5096
- Issue #11727: Add a --timeout option to regrtest: if a test takes more than
  TIMEOUT seconds, dumps the traceback of all threads and exits.
5097

5098 5099
- Issue #11653: fix -W with -j in regrtest.

5100 5101 5102 5103 5104
- The email test suite now lives in the Lib/test/test_email package.  The test
  harness code has also been modernized to allow use of new unittest features.

- regrtest now discovers test packages as well as test modules.

5105
- Issue #11577: improve test coverage of binhex.py. Patch by Arkady Koplyarov.
5106

5107 5108 5109
- New test_crashers added to exercise the scripts in the Lib/test/crashers
  directory and confirm they fail as expected

Éric Araujo's avatar
Éric Araujo committed
5110
- Issue #11578: added test for the timeit module.  Patch by Michael Henry.
5111

5112 5113
- Issue #11503: improve test coverage of posixpath.py. Patch by Evan Dandrea.

5114 5115
- Issue #11505: improves test coverage of string.py, increases granularity of
  string.Formatter tests. Initial patch by Alicia Arlen.
5116

Nick Coghlan's avatar
Nick Coghlan committed
5117 5118 5119
- Issue #11548: Improve test coverage of the shutil module. Patch by
  Evan Dandrea.

5120 5121
- Issue #11554: Reactivated test_email_codecs.

5122 5123
- Issue #11505: improves test coverage of string.py. Patch by Alicia
  Arlen
5124

5125
- Issue #11490: test_subprocess.test_leaking_fds_on_error no longer gives a
5126 5127
  false positive if the last directory in the path is inaccessible.

5128 5129 5130
- Issue #11223: Fix test_threadsignals to fail, not hang, when the
  non-semaphore implementation of locks is used under POSIX.

5131 5132 5133
- Issue #10911: Add tests on CGI with non-ASCII characters. Patch written by
  Pierre Quentel.

5134 5135 5136
- Issue #9931: Fix hangs in GUI tests under Windows in certain conditions.
  Patch by Hirokazu Yamamoto.

5137 5138
- Issue #10512: Properly close sockets under test.test_cgi.

5139 5140
- Issue #10992: Make tests pass under coverage.

5141 5142 5143
- Issue #10826: Prevent sporadic failure in test_subprocess on Solaris due
  to open door files.

5144 5145
- Issue #10990: Prevent tests from clobbering a set trace function.

5146 5147 5148
C-API
-----

5149 5150 5151 5152
- Add PyObject_GenericGetDict and PyObject_GeneriSetDict. They are generic
  implementations for the getter and setter of a ``__dict__`` descriptor of C
  types.

5153 5154 5155 5156
- Issue #13727: Add 3 macros to access PyDateTime_Delta members:
  PyDateTime_DELTA_GET_DAYS, PyDateTime_DELTA_GET_SECONDS,
  PyDateTime_DELTA_GET_MICROSECONDS.

5157 5158 5159 5160
- Issue #10542: Add 4 macros to work with surrogates: Py_UNICODE_IS_SURROGATE,
  Py_UNICODE_IS_HIGH_SURROGATE, Py_UNICODE_IS_LOW_SURROGATE,
  Py_UNICODE_JOIN_SURROGATES.

Brian Curtin's avatar
Brian Curtin committed
5161 5162
- Issue #12724: Add Py_RETURN_NOTIMPLEMENTED macro for returning NotImplemented.

Benjamin Peterson's avatar
Benjamin Peterson committed
5163 5164
- PY_PATCHLEVEL_REVISION has been removed, since it's meaningless with
  Mercurial.
5165

5166
- Issue #12173: The first argument of PyImport_ImportModuleLevel is now `const
Benjamin Peterson's avatar
Benjamin Peterson committed
5167
  char *` instead of `char *`.
5168

5169 5170
- Issue #12380: PyArg_ParseTuple now accepts a bytearray for the 'c' format.

5171 5172 5173
Documentation
-------------

Hynek Schlawack's avatar
Hynek Schlawack committed
5174 5175
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.
5176

Petri Lehtinen's avatar
Petri Lehtinen committed
5177 5178
- Issues #13491 and #13995: Fix many errors in sqlite3 documentation.
  Initial patch for #13491 by Johannes Vogel.
Petri Lehtinen's avatar
Petri Lehtinen committed
5179

Petri Lehtinen's avatar
Petri Lehtinen committed
5180 5181
- Issue #13402: Document absoluteness of sys.executable.

5182 5183
- Issue #13883: PYTHONCASEOK also works on OS X.

5184 5185 5186 5187 5188 5189 5190
- Issue #9021: Add an introduction to the copy module documentation.

- Issue #6005: Examples in the socket library documentation use sendall, where
  relevant, instead send method.

- Issue #12798: Updated the mimetypes documentation.

5191 5192 5193
- Issue #12949: Document the kwonlyargcount argument for the PyCode_New
  C API function.

5194 5195 5196
- Issue #13513: Fix io.IOBase documentation to correctly link to the
  io.IOBase.readline method instead of the readline module.

5197 5198 5199
- Issue #13237: Reorganise subprocess documentation to emphasise convenience
  functions and the most commonly needed arguments to Popen.

Florent Xicluna's avatar
Florent Xicluna committed
5200 5201
- Issue #13141: Demonstrate recommended style for socketserver examples.

5202 5203
- Issue #11818: Fix tempfile examples for Python 3.

Georg Brandl's avatar
Georg Brandl committed
5204

5205
**(For information about older versions, consult the HISTORY file.)**