NEWS 339 KB
Newer Older
Georg Brandl's avatar
Georg Brandl committed
1
+++++++++++
2
Python News
3 4
+++++++++++

5 6 7 8 9 10 11 12
What's New in Python 3.4.2?
===========================

Release date: XXXX-XX-XX

Core and Builtins
-----------------

13 14 15 16 17
- Issue #21669: With the aid of heuristics in SyntaxError.__init__, the
  parser now attempts to generate more meaningful (or at least more search
  engine friendly) error messages when "exec" and "print" are used as
  statements.

18 19 20 21
- Issue #21642: If the conditional if-else expression, allow an integer written
  with no space between itself and the ``else`` keyword (e.g. ``True if 42else
  False``) to be valid syntax.

22 23 24 25 26
- Issue #21523: Fix over-pessimistic computation of the stack effect of
  some opcodes in the compiler.  This also fixes a quadratic compilation
  time issue noticeable when compiling code with a large number of "and"
  and "or" operators.

27 28
Library
-------
29

30 31
- Issue #21858: Better handling of Python exceptions in the sqlite3 module.

32 33 34
- Issue #21476: Make sure the email.parser.BytesParser TextIOWrapper is
  discarded after parsing, so the input file isn't unexpectedly closed.

35 36 37
- Issue #21729: Used the "with" statement in the dbm.dumb module to ensure
  files closing.  Patch by Claudiu Popa.

38 39
- Issue #21491: socketserver: Fix a race condition in child processes reaping.

40 41
- Issue #21832:  Require named tuple inputs to be exact strings.

42 43 44 45
- Issue #19145:  The times argument for itertools.repeat now handles
  negative values the same way for keyword arguments as it does for
  positional arguments.

46 47 48
- Issue #21812: turtle.shapetransform did not tranform the turtle on the
  first call.  (Issue identified and fixed by Lita Cho.)

49 50 51 52
- Issue #21635:  The difflib SequenceMatcher.get_matching_blocks() method
  cache didn't match the actual result.  The former was a list of tuples
  and the latter was a list of named tuples.

53 54 55
- Issue #21722: The distutils "upload" command now exits with a non-zero
  return code when uploading fails.  Patch by Martin Dengler.

56 57 58
- Issue #21723: asyncio.Queue: support any type of number (ex: float) for the
  maximum size. Patch written by Vajrasky Kok.

59 60 61 62
- Issue #21326: Add a new is_closed() method to asyncio.BaseEventLoop.
  run_forever() and run_until_complete() methods of asyncio.BaseEventLoop now
  raise an exception if the event loop was closed.

63 64 65 66
- Issue #21774: Fixed NameError for an incorrect variable reference in the
  XML Minidom code for creating processing instructions.
  (Found and fixed by Claudiu Popa.)

67 68 69
- Issue #21766: Prevent a security hole in CGIHTTPServer by URL unquoting paths
  before checking for a CGI script at that path.

70 71
- Issue #21310: Fixed possible resource leak in failed open().

72 73
- Issue #21677: Fixed chaining nonnormalized exceptions in io close() methods.

74 75 76
- Issue #11709: Fix the pydoc.help function to not fail when sys.stdin is not a
  valid file.

77 78 79
- Issue #13223: Fix pydoc.writedoc so that the HTML documentation for methods
  that use 'self' in the example code is generated correctly.

80 81
- Issue #21463: In urllib.request, fix pruning of the FTP cache.

82 83 84 85 86
- Issue #21618: The subprocess module could fail to close open fds that were
  inherited by the calling process and already higher than POSIX resource
  limits would otherwise allow.  On systems with a functioning /proc/self/fd
  or /dev/fd interface the max is now ignored and all fds are closed.

87 88 89
- Issue #21552: Fixed possible integer overflow of too long string lengths in
  the tkinter module on 64-bit platforms.

90 91 92 93 94
- Issue #14315: The zipfile module now ignores extra fields in the central
  directory that are too short to be parsed instead of letting a struct.unpack
  error bubble up as this "bad data" appears in many real world zip files in
  the wild and is ignored by other zip tools.

95
- Issue #21402: tkinter.ttk now works when default root window is not set.
96

97 98 99
- Issue #10203: sqlite3.Row now truly supports sequence protocol.  In particulr
  it supports reverse() and negative indices.  Original patch by Claudiu Popa.

100 101 102 103
- Issue #18807: If copying (no symlinks) specified for a venv, then the python
  interpreter aliases (python, python3) are now created by copying rather than
  symlinking.

104 105 106 107 108 109
- Issue #14710: pkgutil.get_loader() no longer raises an exception when None is
  found in sys.modules.

- Issue #14710: pkgutil.find_loader() no longer raises an exception when a
  module doesn't exist.

110
- Issue #21481:  Argparse equality and inequality tests now return
111 112
  NotImplemented when comparing to an unknown type.

113 114 115
- Issue #8743: Fix interoperability between set objects and the
  collections.Set() abstract base class.

116 117 118
- Issue #13355: random.triangular() no longer fails with a ZeroDivisionError
  when low equals high.

119 120 121
- Issue #21538: The plistlib module now supports loading of binary plist files
  when reference or offset size is not a power of two.

122 123
- Issue #21801: Validate that __signature__ is None or an instance of Signature.

124 125 126 127 128
Build
-----

- Issue #17095: Fix Modules/Setup *shared* support.

129 130 131
IDLE
----

Terry Jan Reedy's avatar
Terry Jan Reedy committed
132 133 134 135 136 137 138 139 140
- Issue #21686: add unittest for HyperParser. Original patch by Saimadhav
  Heblikar.

- Issue #12387: Add missing upper(lower)case versions of default Windows key
  bindings for Idle so Caps Lock does not disable them. Patch by Roger Serwy.

- Issue #21695: Closing a Find-in-files output window while the search is
  still in progress no longer closes Idle.

141 142
- Issue #18910: Add unittest for textView. Patch by Phil Webster.

143 144
- Issue #18292: Add unittest for AutoExpand. Patch by Saihadhav Heblikar.

145 146
- Issue #18409: Add unittest for AutoComplete. Patch by Phil Webster.

147 148 149
Tests
-----

150 151 152 153
- Issue #20155: Changed HTTP method names in failing tests in test_httpservers
  so that packet filtering software (specifically Windows Base Filtering Engine)
  does not interfere with the transaction semantics expected by the tests.

154 155 156
- Issue #19493: Refactored the ctypes test package to skip tests explicitly
  rather than silently.

157 158 159
- Issue #18492: All resources are now allowed when tests are not run by
  regrtest.py.

160 161 162 163
- Issue #21634: Fix pystone micro-benchmark: use floor division instead of true
  division to benchmark integers instead of floating point numbers. Set pystone
  version to 1.2. Patch written by Lennart Regebro.

164 165
- Issue #21605: Added tests for Tkinter images.

166 167 168
- Issue #21493: Added test for ntpath.expanduser().  Original patch by
  Claudiu Popa.

169 170
- Issue #19925: Added tests for the spwd module. Original patch by Vajrasky Kok.

171 172 173
- Issue #21522: Added Tkinter tests for Listbox.itemconfigure(),
  PanedWindow.paneconfigure(), and Menu.entryconfigure().

174 175 176 177 178 179
Windows
-------

- Issue #21671, CVE-2014-0224: The bundled version of OpenSSL has been
  updated to 1.0.1h.

180 181 182
- Issue #10747: Use versioned labels in the Windows start menu.
  Patch by Olive Kilburn.

183 184 185 186 187
Tools/Demos
-----------

- Issue #21629: Fix Argument Clinic's "--converters" feature.

188

189 190 191 192 193 194 195 196
What's New in Python 3.4.1?
===========================

Release date: 2014-05-18

Core and Builtins
-----------------

197 198 199
- Issue #21418: Fix a crash in the builtin function super() when called without
  argument and without current frame (ex: embedded Python).

200 201 202
- Issue #21425: Fix flushing of standard streams in the interactive
  interpreter.

203 204 205 206
- Issue #21435: In rare cases, when running finalizers on objects in cyclic
  trash a bad pointer dereference could occur due to a subtle flaw in
  internal iteration logic.

207 208 209
Library
-------

210 211 212
- Issue #10744: Fix PEP 3118 format strings on ctypes objects with a nontrivial
  shape.

213 214 215
- Issue #20998: Fixed re.fullmatch() of repeated single character pattern
  with ignore case.  Original patch by Matthew Barnett.

216 217 218
- Issue #21075: fileinput.FileInput now reads bytes from standard stream if
  binary mode is specified.  Patch by Sam Kimbrel.

219 220 221
- Issue #21396: Fix TextIOWrapper(..., write_through=True) to not force a
  flush() on the underlying binary stream.  Patch by akira.

222 223 224
- Issue #21470: Do a better job seeding the random number generator by
  using enough bytes to span the full state space of the Mersenne Twister.

225 226 227
- Issue #21398: Fix an unicode error in the pydoc pager when the documentation
  contains characters not encodable to the stdout encoding.

228 229 230
Tests
-----

231 232
- Issue #17756: Fix test_code test when run from the installed location.

233 234
- Issue #17752: Fix distutils tests when run from the installed location.

235 236 237 238 239 240 241
IDLE
----

- Issue #18104: Add idlelib/idle_test/htest.py with a few sample tests to begin
  consolidating and improving human-validated tests of Idle. Change other files
  as needed to work with htest.  Running the module as __main__ runs all tests.

242

243 244 245
What's New in Python 3.4.1rc1?
==============================

246
Release date: 2014-05-05
247 248 249 250

Core and Builtins
-----------------

251 252
- Issue #21274: Define PATH_MAX for GNU/Hurd in Python/pythonrun.c.

253 254 255
- Issue #21209: Fix sending tuples to custom generator objects with the yield
  from syntax.

256 257 258
- Issue #21134: Fix segfault when str is called on an uninitialized
  UnicodeEncodeError, UnicodeDecodeError, or UnicodeTranslateError object.

259 260 261
- Issue #19537: Fix PyUnicode_DATA() alignment under m68k.  Patch by
  Andreas Schwab.

262 263
- Issue #20929: Add a type cast to avoid shifting a negative number.

264 265 266
- Issue #20731: Properly position in source code files even if they
  are opened in text mode. Patch by Serhiy Storchaka.

267 268 269
- Issue #20637: Key-sharing now also works for instance dictionaries of
  subclasses.  Patch by Peter Ingebretson.

270 271 272
- Issue #12546: Allow \x00 to be used as a fill character when using str, int,
  float, and complex __format__ methods.

273
- Issue #13598: Modify string.Formatter to support auto-numbering of
274
  replacement fields. It now matches the behavior of str.format() in
275
  this regard. Patches by Phil Elson and Ramchandra Apte.
276

277 278 279
Library
-------

280 281 282
- Issue #21088: Bugfix for curses.window.addch() regression in 3.4.0.
  In porting to Argument Clinic, the first two arguments were reversed.

283 284 285 286
- Issue #21469:  Reduced the risk of false positives in robotparser by
  checking to make sure that robots.txt has been read or does not exist
  prior to returning True in can_fetch().

287 288 289
- Issue #21321: itertools.islice() now releases the reference to the source
  iterator when the slice is exhausted.  Patch by Anton Afanasyev.

290 291 292
- Issue #9815: assertRaises now tries to clear references to local variables
  in the exception's traceback.

293 294 295
- Issue #13204: Calling sys.flags.__new__ would crash the interpreter,
  now it raises a TypeError.

296 297 298
- Issue #19385: Make operations on a closed dbm.dumb database always raise the
  same exception.

299 300 301
- Issue #21207: Detect when the os.urandom cached fd has been closed or
  replaced, and open it anew.

302 303 304 305
- Issue #21291: subprocess's Popen.wait() is now thread safe so that
  multiple threads may be calling wait() or poll() on a Popen instance
  at the same time without losing the Popen.returncode value.

306
- Issue #21127: Path objects can now be instantiated from str subclass
307
  instances (such as ``numpy.str_``).
308

Senthil Kumaran's avatar
Senthil Kumaran committed
309 310 311 312
- Issue #15002: urllib.response object to use _TemporaryFileWrapper (and
  _TemporaryFileCloser) facility. Provides a better way to handle file
  descriptor close. Patch contributed by Christian Theune.

313 314 315
- Issue #12220: mindom now raises a custom ValueError indicating it doesn't
  support spaces in URIs instead of letting a 'split' ValueError bubble up.

316 317 318
- Issue #21239: patch.stopall() didn't work deterministically when the same
  name was patched more than once.

Kushal Das's avatar
Kushal Das committed
319 320 321
- Issue #21222: Passing name keyword argument to mock.create_autospec now
  works.

322 323
- Issue #21197: Add lib64 -> lib symlink in venvs on 64-bit non-OS X POSIX.

324 325 326 327 328
- Issue #17498: Some SMTP servers disconnect after certain errors, violating
  strict RFC conformance.  Instead of losing the error code when we issue the
  subsequent RSET, smtplib now returns the error code and defers raising the
  SMTPServerDisconnected error until the next command is issued.

329 330 331
- Issue #17826: setting an iterable side_effect on a mock function created by
  create_autospec now works. Patch by Kushal Das.

332
- Issue #7776: Fix ``Host:`` header and reconnection when using
333 334
  http.client.HTTPConnection.set_tunnel(). Patch by Nikolaus Rath.

335 336 337
- Issue #20968: unittest.mock.MagicMock now supports division.
  Patch by Johannes Baiter.

338 339 340
- Fix arbitrary memory access in JSONDecoder.raw_decode with a negative second
  parameter. Bug reported by Guido Vranken.

341 342 343 344
- Issue #21169: getpass now handles non-ascii characters that the
  input stream encoding cannot encode by re-encoding using the
  replace error handler.

345 346 347
- Issue #21171: Fixed undocumented filter API of the rot13 codec.
  Patch by Berker Peksag.

348 349
- Issue #21172: isinstance check relaxed from dict to collections.Mapping.

350 351 352
- Issue #21155: asyncio.EventLoop.create_unix_server() now raises a ValueError
  if path and sock are specified at the same time.

353 354 355
- Issue #21149: Improved thread-safety in logging cleanup during interpreter
  shutdown. Thanks to Devin Jeanpierre for the patch.

356 357 358
- Issue #20145: `assertRaisesRegex` and `assertWarnsRegex` now raise a
  TypeError if the second argument is not a string or compiled regex.

359 360 361 362
- Issue #21058: Fix a leak of file descriptor in
  :func:`tempfile.NamedTemporaryFile`, close the file descriptor if
  :func:`io.open` fails

363 364
- Issue #21200: Return None from pkgutil.get_loader() when __spec__ is missing.

365 366 367
- Issue #21013: Enhance ssl.create_default_context() when used for server side
  sockets to provide better security by default.

368 369
- Issue #20633: Replace relative import by absolute import.

370 371
- Issue #20980: Stop wrapping exception when using ThreadPool.

372 373 374
- Issue #21082: In os.makedirs, do not set the process-wide umask. Note this
  changes behavior of makedirs when exist_ok=True.

375 376
- Issue #20990: Fix issues found by pyflakes for multiprocessing.

377 378 379 380
- Issue #21015: SSL contexts will now automatically select an elliptic
  curve for ECDH key exchange on OpenSSL 1.0.2 and later, and otherwise
  default to "prime256v1".

381 382 383
- Issue #20995: Enhance default ciphers used by the ssl module to enable
  better security an prioritize perfect forward secrecy.

384 385
- Issue #20884: Don't assume that __file__ is defined on importlib.__init__.

386 387
- Issue #21499: Ignore __builtins__ in several test_importlib.test_api tests.

388 389 390 391 392
- Issue #20879: Delay the initialization of encoding and decoding tables for
  base32, ascii85 and base85 codecs in the base64 module, and delay the
  initialization of the unquote_to_bytes() table of the urllib.parse module, to
  not waste memory if these modules are not used.

393 394 395
- Issue #19157: Include the broadcast address in the usuable hosts for IPv6
  in ipaddress.

396 397 398 399
- Issue #11599: When an external command (e.g. compiler) fails, distutils now
  prints out the whole command line (instead of just the command name) if the
  environment variable DISTUTILS_DEBUG is set.

400 401 402
- Issue #4931: distutils should not produce unhelpful "error: None" messages
  anymore.  distutils.util.grok_environment_error is kept but doc-deprecated.

403 404 405
- Issue #20875: Prevent possible gzip "'read' is not defined" NameError.
  Patch by Claudiu Popa.

406 407 408 409
- Issue #11558: ``email.message.Message.attach`` now returns a more
  useful error message if ``attach`` is called on a message for which
  ``is_multipart`` is False.

410 411 412 413
- Issue #20283: RE pattern methods now accept the string keyword parameters
  as documented.  The pattern and source keyword parameters are left as
  deprecated aliases.

414 415
- Issue #20778: Fix modulefinder to work with bytecode-only modules.

416 417 418
- Issue #20791: copy.copy() now doesn't make a copy when the input is
  a bytes object.  Initial patch by Peter Otten.

419 420 421
- Issue #19748: On AIX, time.mktime() now raises an OverflowError for year
  outsize range [1902; 2037].

422 423 424
- Issue #20816: Fix inspect.getcallargs() to raise correct TypeError for
  missing keyword-only arguments. Patch by Jeremiah Lowin.

425 426 427
- Issue #20817: Fix inspect.getcallargs() to fail correctly if more
  than 3 arguments are missing. Patch by Jeremiah Lowin.

428 429 430 431 432
- Issue #6676: Ensure a meaningful exception is raised when attempting
  to parse more than one XML document per pyexpat xmlparser instance.
  (Original patches by Hirokazu Yamamoto and Amaury Forgeot d'Arc, with
  suggested wording by David Gutteridge)

433 434 435 436 437
- Issue #21117: Fix inspect.signature to better support functools.partial.
  Due to the specifics of functools.partial implementation,
  positional-or-keyword arguments passed as keyword arguments become
  keyword-only.

438 439 440
- Issue #21209: Fix asyncio.tasks.CoroWrapper to workaround a bug
  in yield-from implementation in CPythons prior to 3.4.1.

441 442 443
- asyncio: Add gi_{frame,running,code} properties to CoroWrapper
  (upstream issue #163).

444 445 446
- Issue #21311: Avoid exception in _osx_support with non-standard compiler
  configurations.  Patch by John Szakmeister.

447 448 449
- Issue #11571: Ensure that the turtle window becomes the topmost window
  when launched on OS X.

450 451 452 453
Extension Modules
-----------------

- Issue #21276: posixmodule: Don't define USE_XATTRS on KFreeBSD and the Hurd.
454 455
- Issue #21226: Set up modules properly in PyImport_ExecCodeModuleObject
  (and friends).
456

457 458 459
IDLE
----

460 461 462
- Issue #21139: Change default paragraph width to 72, the PEP 8 recommendation.

- Issue #21284: Paragraph reformat test passes after user changes reformat width.
463

464 465 466
- Issue #17654: Ensure IDLE menus are customized properly on OS X for
  non-framework builds and for all variants of Tk.

467 468 469
Build
-----

Martin v. Löwis's avatar
Martin v. Löwis committed
470 471
- The Windows build now includes OpenSSL 1.0.1g

472 473 474
- Issue #21285: Refactor and fix curses configure check to always search
  in a ncursesw directory.

475 476 477 478
- Issue #15234: For BerkelyDB and Sqlite, only add the found library and
  include directories if they aren't already being searched. This avoids
  an explicit runtime library dependency.

479 480 481
- Issue #20644: OS X installer build support for documentation build changes
  in 3.4.1: assume externally supplied sphinx-build is available in /usr/bin.

482 483 484 485 486 487
C API
-----
- Issue #20942: PyImport_ImportFrozenModuleObject() no longer sets __file__ to
  match what importlib does; this affects _frozen_importlib as well as any
  module loaded using imp.init_frozen().

488 489 490
Documentation
-------------

491 492 493
- Issue #17386: Expanded functionality of the ``Doc/make.bat`` script to make
  it much more comparable to ``Doc/Makefile``.

494 495 496
- Issue #21043: Remove the recommendation for specific CA organizations and to
  mention the ability to load the OS certificates.

497 498 499
- Issue #20765: Add missing documentation for PurePath.with_name() and
  PurePath.with_suffix().

500 501 502 503 504 505
- Issue #19407: New package installation and distribution guides based on
  the Python Packaging Authority tools. Existing guides have been retained
  as legacy links from the distutils docs, as they still contain some
  required reference material for tool developers that isn't recorded
  anywhere else.

506 507
- Issue #19697: Document cases where __main__.__spec__ is None.

508 509 510
Tests
-----

511 512 513 514
- Issue #18604: Consolidated checks for GUI availability.  All platforms now
  at least check whether Tk can be instantiated when the GUI resource is
  requested.

515 516
- Issue #21275: Fix a socket test on KFreeBSD.

517 518 519
- Issue #21223: Pass test_site/test_startup_imports when some of the extensions
  are built as builtins.

520 521
- Issue #20635: Added tests for Tk geometry managers.

Martin v. Löwis's avatar
Martin v. Löwis committed
522 523
- Add test case for freeze.

524 525
- Issue #20743: Fix a reference leak in test_tcl.

526 527
- Issue #21097: Move test_namespace_pkgs into test_importlib.

528 529 530 531
- Issue #20939: Avoid various network test failures due to new
  redirect of http://www.python.org/ to https://www.python.org:
  use http://www.example.com instead.

532 533 534
- Issue #20668: asyncio tests no longer rely on tests.txt file.
  (Patch by Vajrasky Kok)

535 536 537
- Issue #21093: Prevent failures of ctypes test_macholib on OS X if a
  copy of libz exists in $HOME/lib or /usr/local/lib.

538 539 540
Tools/Demos
-----------

541 542
- Add support for ``yield from`` to 2to3.

543 544
- Add support for the PEP 465 matrix multiplication operator to 2to3.

545 546 547
- Issue #16047: Fix module exception list and __file__ handling in freeze.
  Patch by Meador Inge.

548 549
- Issue #11824: Consider ABI tags in freeze. Patch by Meador Inge.

550 551 552
- Issue #20535: PYTHONWARNING no longer affects the run_tests.py script.
  Patch by Arfrever Frehtes Taifersar Arahesis.

553

554 555 556 557 558 559 560 561
What's New in Python 3.4.0?
===========================

Release date: 2014-03-16

Library
-------

Ned Deily's avatar
Ned Deily committed
562 563 564
- Issue #20939: Fix test_geturl failure in test_urllibnet due to
  new redirect of http://www.python.org/ to https://www.python.org.

565 566 567 568 569
Documentation
-------------

- Merge in all documentation changes since branching 3.4.0rc1.

570

571 572
What's New in Python 3.4.0 release candidate 3?
===============================================
573

574 575
Release date: 2014-03-09

576 577 578 579 580 581
Core and Builtins
-----------------

- Issue #20786: Fix signatures for dict.__delitem__ and
  property.__delete__ builtins.

582 583 584 585 586 587 588
Library
-------

- Issue #20839: Don't trigger a DeprecationWarning in the still supported
  pkgutil.get_loader() API when __loader__ isn't set on a module (nor
  when pkgutil.find_loader() is called directly).

589 590 591
Build
-----

592 593
- Issue #14512: Launch pydoc -b instead of pydocgui.pyw on Windows.

594 595 596
- Issue #20748: Uninstalling pip does not leave behind the pyc of
  the uninstaller anymore.

597 598 599
- Issue #20568: The Windows installer now installs the unversioned ``pip``
  command in addition to the versioned ``pip3`` and ``pip3.4`` commands.

600 601 602 603
- Issue #20757: The ensurepip helper for the Windows uninstaller now skips
  uninstalling pip (rather than failing) if the user has updated pip to a
  different version from the one bundled with ensurepip.

604
- Issue #20465: Update OS X and Windows installer builds to use
605
  SQLite 3.8.3.1.
606 607


608 609 610 611 612 613 614 615
What's New in Python 3.4.0 release candidate 2?
===============================================

Release date: 2014-02-23

Core and Builtins
-----------------

616 617 618
- Issue #20625: Parameter names in __annotations__ were not mangled properly.
  Discovered by Jonas Wielicki, patch by Yury Selivanov.

619 620 621
- Issue #20261: In pickle, lookup __getnewargs__ and __getnewargs_ex__ on the
  type of the object.

622 623 624
- Issue #20619: Give the AST nodes of keyword-only arguments a column and line
  number.

625 626 627 628
- Issue #20526: Revert changes of issue #19466 which introduces a regression:
  don't clear anymore the state of Python threads early during the Python
  shutdown.

629 630 631
Library
-------

632 633 634
- Issue #20710: The pydoc summary line no longer displays the "self" parameter
  for bound methods.

635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653
- Issue #20566: Change asyncio.as_completed() to use a Queue, to
  avoid O(N**2) behavior.

- Issue #20704: Implement new debug API in asyncio. Add new methods
  BaseEventLoop.set_debug() and BaseEventLoop.get_debug().
  Add support for setting 'asyncio.tasks._DEBUG' variable with
  'PYTHONASYNCIODEBUG' environment variable.

- asyncio: Refactoring and fixes: BaseEventLoop.sock_connect() raises an
  error if the address is not resolved; use __slots__ in Handle and
  TimerHandle; as_completed() and wait() raise TypeError if the passed
  list of Futures is a single Future; call_soon() and other 'call_*()'
  functions raise TypeError if the passed callback is a coroutine
  function; _ProactorBasePipeTransport uses _FlowControlMixin;
  WriteTransport.set_write_buffer_size() calls _maybe_pause_protocol()
  to consider pausing receiving if the watermark limits have changed;
  fix _check_resolved_address() for IPv6 address; and other minor
  improvements, along with multiple documentation updates.

654 655 656 657
- Issue #20684: Fix inspect.getfullargspec() to not to follow __wrapped__
  chains. Make its behaviour consistent with bound methods first argument.
  Patch by Nick Coghlan and Yury Selivanov.

658 659 660 661
- Issue #20681: Add new error handling API in asyncio. New APIs:
  loop.set_exception_handler(), loop.default_exception_handler(), and
  loop.call_exception_handler().

662 663 664 665
- Issue #20673: Implement support for UNIX Domain Sockets in asyncio.
  New APIs: loop.create_unix_connection(), loop.create_unix_server(),
  streams.open_unix_connection(), and streams.start_unix_server().

666 667
- Issue #20616: Add a format() method to tracemalloc.Traceback.

668 669 670 671
- Issue #19744: the ensurepip installation step now just prints a warning to
  stderr rather than failing outright if SSL/TLS is unavailable. This allows
  local installation of POSIX builds without SSL/TLS support.

Benjamin Peterson's avatar
Benjamin Peterson committed
672 673
- Issue #20594: Avoid name clash with the libc function posix_close.

Zachary Ware's avatar
Zachary Ware committed
674 675 676
Build
-----

677 678 679
- Issue #20641: Run MSI custom actions (pip installation, pyc compilation)
  with the NoImpersonate flag, to support elevated execution (UAC).

680 681 682
- Issue #20221: Removed conflicting (or circular) hypot definition when
  compiled with VS 2010 or above.  Initial patch by Tabrez Mohammed.

Zachary Ware's avatar
Zachary Ware committed
683 684 685
- Issue #20609: Restored the ability to build 64-bit Windows binaries on
  32-bit Windows, which was broken by the change in issue #19788.

686

687 688 689
What's New in Python 3.4.0 release candidate 1?
===============================================

690
Release date: 2014-02-10
691 692 693 694

Core and Builtins
-----------------

695 696 697
- Issue #19255: The builtins module is restored to initial value before
  cleaning other modules.  The sys and builtins modules are cleaned last.

698 699
- Issue #20588: Make Python-ast.c C89 compliant.

700
- Issue #20437: Fixed 22 potential bugs when deleting objects references.
701

702 703 704 705
- Issue #20500: Displaying an exception at interpreter shutdown no longer
  risks triggering an assertion failure in PyObject_Str.

- Issue #20538: UTF-7 incremental decoder produced inconsistent string when
706 707
  input was truncated in BASE64 section.

708 709 710 711 712 713
- Issue #20404: io.TextIOWrapper (and hence the open() builtin) now uses the
  internal codec marking system added for issue #19619 to throw LookupError
  for known non-text encodings at stream construction time. The existing
  output type checks remain in place to deal with unmarked third party
  codecs.

714 715
- Issue #17162: Add PyType_GetSlot.

716 717 718
- Issue #20162: Fix an alignment issue in the siphash24() hash function which
  caused a crash on PowerPC 64-bit (ppc64).

719 720 721
Library
-------

722 723 724
- Issue #20530: The signatures for slot builtins have been updated
  to reflect the fact that they only accept positional-only arguments.

725 726 727
- Issue #20517: Functions in the os module that accept two filenames
  now register both filenames in the exception on failure.

728 729
- Issue #20563: The ipaddress module API is now considered stable.

730 731 732 733
- Issue #14983: email.generator now always adds a line end after each MIME
  boundary marker, instead of doing so only when there is an epilogue.  This
  fixes an RFC compliance bug and solves an issue with signed MIME parts.

734 735 736 737 738
- Issue #20540: Fix a performance regression (vs. Python 3.2) when layering
  a multiprocessing Connection over a TCP socket.  For small payloads, Nagle's
  algorithm would introduce idle delays before the entire transmission of a
  message.

739 740 741
- Issue #16983: the new email header parsing code will now decode encoded words
  that are (incorrectly) surrounded by quotes, and register a defect.

742 743 744
- Issue #19772: email.generator no longer mutates the message object when
  doing a down-transform from 8bit to 7bit CTEs.

745 746 747
- Issue #20536: the statistics module now correctly handle Decimal instances
  with positive exponents

748
- Issue #18805: the netmask/hostmask parsing in ipaddress now more reliably
Nick Coghlan's avatar
Nick Coghlan committed
749
  filters out illegal values and correctly allows any valid prefix length.
750

751 752 753 754 755 756
- Issue #20481: For at least Python 3.4, the statistics module will require
  that all inputs for a single operation be of a single consistent type, or
  else a mixed of ints and a single other consistent type. This avoids
  some interoperability issues that arose with the previous approach of
  coercing to a suitable common type.

757 758 759
- Issue #20478: the statistics module now treats collections.Counter inputs
  like any other iterable.

760 761 762 763
- Issue #17369: get_filename was raising an exception if the filename
  parameter's RFC2231 encoding was broken in certain ways.  This was
  a regression relative to python2.

764 765 766 767
- Issue #20013: Some imap servers disconnect if the current mailbox is
  deleted, and imaplib did not handle that case gracefully.  Now it
  handles the 'bye' correctly.

768 769 770 771
- Issue #20531: Revert 3.4 version of fix for #19063, and apply the 3.3
  version.  That is, do *not* raise an error if unicode is passed to
  email.message.Message.set_payload.

772 773 774 775
- Issue #20476: If a non-compat32 policy is used with any of the email parsers,
  EmailMessage is now used as the factory class.  The factory class should
  really come from the policy; that will get fixed in 3.5.

776 777 778
- Issue #19920: TarFile.list() no longer fails when outputs a listing
  containing non-encodable characters.  Based on patch by Vajrasky Kok.

779 780
- Issue #20515: Fix NULL pointer dereference introduced by issue #20368.

781 782
- Issue #19186: Restore namespacing of expat symbols inside the pyexpat module.

783 784 785
- Issue #20053: ensurepip (and hence venv) are no longer affected by the
  settings in the default pip configuration file.

786 787 788
- Issue #20426: When passing the re.DEBUG flag, re.compile() displays the
  debug output every time it is called, regardless of the compilation cache.

789 790
- Issue #20368: The null character now correctly passed from Tcl to Python.
  Improved error handling in variables-related commands.
791

792 793
- Issue #20435: Fix _pyio.StringIO.getvalue() to take into account newline
  translation settings.
794

795 796
- tracemalloc: Fix slicing traces and fix slicing a traceback.

797 798 799
- Issue #20354: Fix an alignment issue in the tracemalloc module on 64-bit
  platforms. Bug seen on 64-bit Linux when using "make profile-opt".

800 801 802
- Issue #17159: inspect.signature now accepts duck types of functions,
  which adds support for Cython functions. Initial patch by Stefan Behnel.

803 804 805
- Issue #18801: Fix inspect.classify_class_attrs to correctly classify
  object.__new__ and object.__init__.

806 807
- Fixed cmath.isinf's name in its argument parsing code.

808 809 810 811 812
- Issue #20311, #20452: poll and epoll now round the timeout away from zero,
  instead of rounding towards zero, in select and selectors modules:
  select.epoll.poll(), selectors.PollSelector.poll() and
  selectors.EpollSelector.poll(). For example, a timeout of one microsecond
  (1e-6) is now rounded to one millisecondi (1e-3), instead of being rounded to
Guido van Rossum's avatar
Guido van Rossum committed
813 814
  zero.  However, the granularity property and asyncio's resolution feature
  were removed again.
815

Guido van Rossum's avatar
Guido van Rossum committed
816 817 818 819
- asyncio: Some refactoring; various fixes; add write flow control to
  unix pipes; Future.set_exception() instantiates the exception
  argument if it is a class; improved proactor pipe transport; support
  wait_for(f, None); don't log broken/disconnected pipes; use
Guido van Rossum's avatar
Guido van Rossum committed
820
  ValueError instead of assert for forbidden subprocess_{shell,exec}
Guido van Rossum's avatar
Guido van Rossum committed
821 822 823 824
  arguments; added a convenience API for subprocess management; added
  StreamReader.at_eof(); properly handle duplicate coroutines/futures
  in gather(), wait(), as_completed(); use a bytearray for buffering
  in StreamReader; and more.
Guido van Rossum's avatar
Guido van Rossum committed
825

826 827
- Issue #20288: fix handling of invalid numeric charrefs in HTMLParser.

828 829
- Issue #20424: Python implementation of io.StringIO now supports lone surrogates.

830 831 832
- Issue #20308: inspect.signature now works on classes without user-defined
  __init__ or __new__ methods.

833 834 835 836 837 838 839 840 841 842
- Issue #20372: inspect.getfile (and a bunch of other inspect functions that
  use it) doesn't crash with unexpected AttributeError on classes defined in C
  without __module__.

- Issue #20356: inspect.signature formatting uses '/' to separate
  positional-only parameters from others.

- Issue #20223: inspect.signature now supports methods defined with
  functools.partialmethods.

843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861
- Issue #19456: ntpath.join() now joins relative paths correctly when a drive
  is present.

- Issue #19077: tempfile.TemporaryDirectory cleanup no longer fails when
  called during shutdown.  Emitting resource warning in __del__ no longer fails.
  Original patch by Antoine Pitrou.

- Issue #20394: Silence Coverity warning in audioop module.

- Issue #20367: Fix behavior of concurrent.futures.as_completed() for
  duplicate arguments.  Patch by Glenn Langford.

- Issue #8260: The read(), readline() and readlines() methods of
  codecs.StreamReader returned incomplete data when were called after
  readline() or read(size).  Based on patch by Amaury Forgeot d'Arc.

- Issue #20105: the codec exception chaining now correctly sets the
  traceback of the original exception as its __traceback__ attribute.

862 863
- Issue #17481: inspect.getfullargspec() now uses inspect.signature() API.

864 865 866
- Issue #15304: concurrent.futures.wait() can block forever even if
  Futures have completed. Patch by Glenn Langford.

867 868 869 870
- Issue #14455: plistlib: fix serializing integers integers in the range
  of an unsigned long long but outside of the range of signed long long for
  binary plist files.

871 872 873
IDLE
----

874 875 876
- Issue #20406: Use Python application icons for Idle window title bars.
  Patch mostly by Serhiy Storchaka.

877 878 879
- Update the python.gif icon for the Idle classbrowser and pathbowser
  from the old green snake to the new new blue and yellow snakes.

880 881 882 883 884 885
- Issue #17721: Remove non-functional configuration dialog help button until we
  make it actually gives some help when clicked. Patch by Guilherme Simões.

Tests
-----

886 887
- Issue #20532: Tests which use _testcapi now are marked as CPython only.

888 889
- Issue #19920: Added tests for TarFile.list().  Based on patch by Vajrasky Kok.

890 891 892
- Issue #19990: Added tests for the imghdr module.  Based on patch by
  Claudiu Popa.

893 894
- Issue #20474: Fix test_socket "unexpected success" failures on OS X 10.7+.

895 896 897
Tools/Demos
-----------

898 899 900 901 902 903 904
- Issue #20530: Argument Clinic's signature format has been revised again.
  The new syntax is highly human readable while still preventing false
  positives.  The syntax also extends Python syntax to denote "self" and
  positional-only parameters, allowing inspect.Signature objects to be
  totally accurate for all supported builtins in Python 3.4.

- Issue #20456: Argument Clinic now observes the C preprocessor conditional
905 906 907 908
  compilation statements of the C files it parses.  When a Clinic block is
  inside a conditional code, it adjusts its output to match, including
  automatically generating an empty methoddef macro.

909
- Issue #20456: Cloned functions in Argument Clinic now use the correct
910 911 912
  name, not the name of the function they were cloned from, for text
  strings inside generated code.

913
- Issue #20456: Fixed Argument Clinic's test suite and "--converters" feature.
914

915
- Issue #20456: Argument Clinic now allows specifying different names
916 917
  for a parameter in Python and C, using "as" on the parameter line.

918 919 920 921 922 923 924 925 926
- Issue #20326: Argument Clinic now uses a simple, unique signature to
  annotate text signatures in docstrings, resulting in fewer false
  positives.  "self" parameters are also explicitly marked, allowing
  inspect.Signature() to authoritatively detect (and skip) said parameters.

- Issue #20326: Argument Clinic now generates separate checksums for the
  input and output sections of the block, allowing external tools to verify
  that the input has not changed (and thus the output is not out-of-date).

927 928 929 930 931
Build
-----

- Issue #20465: Update SQLite shipped with OS X installer to 3.8.3.

932 933 934 935
C-API
-----

- Issue #20517: Added new functions allowing OSError exceptions to reference
936 937
  two filenames instead of one: PyErr_SetFromErrnoWithFilenameObjects() and
  PyErr_SetExcFromWindowsErrWithFilenameObjects().
938

939 940 941
Documentation
-------------

Brett Cannon's avatar
Brett Cannon committed
942 943 944
- Issue #20488: Change wording to say importlib is *the* implementation of
  import instead of just *an* implementation.

945 946 947 948
- Issue #6386: Clarify in the tutorial that specifying a symlink to execute
  means the directory containing the executed script and not the symlink is
  added to sys.path.

949

950 951
What's New in Python 3.4.0 Beta 3?
==================================
952

Larry Hastings's avatar
Larry Hastings committed
953
Release date: 2014-01-26
954 955 956 957

Core and Builtins
-----------------

958 959 960 961
- Issue #20189: Four additional builtin types (PyTypeObject,
  PyMethodDescr_Type, _PyMethodWrapper_Type, and PyWrapperDescr_Type)
  have been modified to provide introspection information for builtins.

962 963 964
- Issue #17825: Cursor "^" is correctly positioned for SyntaxError and
  IndentationError.

965 966 967 968
- Issue #2382: SyntaxError cursor "^" is now written at correct position in most
  cases when multibyte characters are in line (before "^").  This still not
  works correctly with wide East Asian characters.

969 970 971 972 973 974 975
- Issue #18960: The first line of Python script could be executed twice when
  the source encoding was specified on the second line.  Now the source encoding
  declaration on the second line isn't effective if the first line contains
  anything except a comment.  'python -x' works now again with files with the
  source encoding declarations, and can be used to make Python batch files
  on Windows.

976 977 978
Library
-------

Guido van Rossum's avatar
Guido van Rossum committed
979 980 981 982 983 984 985
- asyncio: Various improvements and small changes not all covered by
  issues listed below.  E.g. wait_for() now cancels the inner task if
  the timeout occcurs; tweaked the set of exported symbols; renamed
  Empty/Full to QueueEmpty/QueueFull; "with (yield from lock)" now
  uses a separate context manager; readexactly() raises if not enough
  data was read; PTY support tweaks.

986 987 988 989 990
- Issue #20311: asyncio: Add a granularity attribute to BaseEventLoop: maximum
  between the resolution of the BaseEventLoop.time() method and the resolution
  of the selector. The granuarility is used in the scheduler to round time and
  deadline.

991 992
- Issue #20311: selectors: Add a resolution attribute to BaseSelector.

993 994 995 996
- Issue #20189: unittest.mock now no longer assumes that any object for
  which it could get an inspect.Signature is a callable written in Python.
  Fix courtesy of Michael Foord.

997 998 999 1000 1001 1002
- Issue #20317: ExitStack.__exit__ could create a self-referential loop if an
  exception raised by a cleanup operation already had its context set
  correctly (for example, by the @contextmanager decorator). The infinite
  loop this caused is now avoided by checking if the expected context is
  already set before trying to fix it.

1003 1004
- Issue #20374: Fix build with GNU readline >= 6.3.

1005 1006 1007
- Issue #20262: Warnings are raised now when duplicate names are added in the
  ZIP file or too long ZIP file comment is truncated.

1008 1009 1010
- Issue #20165: The unittest module no longer considers tests marked with
  @expectedFailure successful if they pass.

1011 1012
- Issue #18574: Added missing newline in 100-Continue reply from
  http.server.BaseHTTPRequestHandler. Patch by Nikolaus Rath.
1013

1014 1015
- Issue #20270: urllib.urlparse now supports empty ports.

1016 1017
- Issue #20243: TarFile no longer raise ReadError when opened in write mode.

1018 1019 1020
- Issue #20238: TarFile opened with external fileobj and "w:gz" mode didn't
  write complete output on close.

1021 1022 1023
- Issue #20245: The open functions in the tarfile module now correctly handle
  empty mode.

1024 1025 1026
- Issue #20242: Fixed basicConfig() format strings for the alternative
  formatting styles. Thanks to kespindler for the bug report and patch.

Benjamin Peterson's avatar
Benjamin Peterson committed
1027 1028
- Issue #20246: Fix buffer overflow in socket.recvfrom_into.

1029 1030 1031 1032
- Issues #20206 and #5803: Fix edge case in email.quoprimime.encode where it
  truncated lines ending in a character needing encoding but no newline by
  using a more efficient algorithm that doesn't have the bug.

1033 1034 1035
- Issue #19082: Working xmlrpc.server and xmlrpc.client examples. Both in
  modules and in documentation. Initial patch contributed by Vajrasky Kok.

1036 1037 1038
- Issue #20138: The wsgiref.application_uri() and wsgiref.request_uri()
  functions now conform to PEP 3333 when handle non-ASCII URLs.

1039
- Issue #19097: Raise the correct Exception when cgi.FieldStorage is given an
1040
  invalid fileobj.
1041

1042
- Issue #20152: Ported Python/import.c over to Argument Clinic.
1043

1044 1045 1046 1047
- Issue #13107: argparse and optparse no longer raises an exception when output
  a help on environment with too small COLUMNS.  Based on patch by
  Elazar Gershuni.

1048 1049 1050
- Issue #20207: Always disable SSLv2 except when PROTOCOL_SSLv2 is explicitly
  asked for.

1051 1052 1053
- Issue #18960: The tokenize module now ignore the source encoding declaration
  on the second line if the first line contains anything except a comment.

1054 1055 1056
- Issue #20078: Reading malformed zipfiles no longer hangs with 100% CPU
  consumption.

1057 1058 1059
- Issue #20113: os.readv() and os.writev() now raise an OSError exception on
  error instead of returning -1.

1060 1061 1062 1063
- Issue #19719: Make importlib.abc.MetaPathFinder.find_module(),
  PathEntryFinder.find_loader(), and Loader.load_module() use PEP 451 APIs to
  help with backwards-compatibility.

1064 1065 1066
- Issue #20144: inspect.Signature now supports parsing simple symbolic
  constants as parameter default values in __text_signature__.

1067 1068
- Issue #20072: Fixed multiple errors in tkinter with wantobjects is False.

1069 1070
- Issue #20229: Avoid plistlib deprecation warning in platform.mac_ver().

1071 1072
- Issue #14455: Fix some problems with the new binary plist support in plistlib.

1073 1074 1075
IDLE
----

1076
- Issue #17390: Add Python version to Idle editor window title bar.
Terry Jan Reedy's avatar
Terry Jan Reedy committed
1077
  Original patches by Edmond Burnett and Kent Johnson.
1078

1079 1080 1081
- Issue #18960: IDLE now ignores the source encoding declaration on the second
  line if the first line contains anything except a comment.

1082 1083 1084
Tests
-----

1085 1086 1087
- Issue #20358: Tests for curses.window.overlay and curses.window.overwrite
  no longer specify min{row,col} > max{row,col}.

1088 1089 1090
- Issue #19804: The test_find_mac test in test_uuid is now skipped if the
  ifconfig executable is not available.

1091 1092
- Issue #19886: Use better estimated memory requirements for bigmem tests.

1093 1094
Tools/Demos
-----------
1095

1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112
- Issue #20390: Argument Clinic's "file" output preset now defaults to
  "{dirname}/clinic/{basename}.h".

- Issue #20390: Argument Clinic's "class" directive syntax has been extended
  with two new required  arguments: "typedef" and "type_object".

- Issue #20390: Argument Clinic: If __new__ or __init__ functions didn't use
  kwargs (or args), the PyArg_NoKeywords (or PyArg_NoPositional) calls
  generated are only run when the type object is an exact match.

- Issue #20390: Argument Clinic now fails if you have required parameters after
  optional parameters.

- Issue #20390: Argument Clinic converters now have a new template they can
  inject code into: "modifiers".  Code put there is run in the parsing
  function after argument parsing but before the call to the impl.

1113 1114
- Issue #20376: Argument Clinic now escapes backslashes in docstrings.

1115 1116 1117 1118
- Issue #20381: Argument Clinic now sanity checks the default argument when
  c_default is also specified, providing a nice failure message for
  disallowed values.

1119 1120 1121 1122 1123 1124 1125 1126 1127 1128
- Issue #20189: Argument Clinic now ensures that parser functions for
  __new__ are always of type newfunc, the type of the tp_new slot.
  Similarly, parser functions for __init__ are now always of type initproc,
  the type of tp_init.

- Issue #20189: Argument Clinic now suppresses the docstring for __new__
  and __init__ functions if no docstring is provided in the input.

- Issue #20189: Argument Clinic now suppresses the "self" parameter in the
  impl for @staticmethod functions.
1129

1130 1131 1132
- Issue #20294: Argument Clinic now supports argument parsing for __new__ and
  __init__ functions.

1133 1134 1135
- Issue #20299: Argument Clinic custom converters may now change the default
  value of c_default and py_default with a class member.

1136 1137 1138
- Issue #20287: Argument Clinic's output is now configurable, allowing
  delaying its output or even redirecting it to a separate file.

1139 1140 1141
- Issue #20226: Argument Clinic now permits simple expressions
  (e.g. "sys.maxsize - 1") as default values for parameters.

1142 1143 1144 1145 1146 1147
- Issue #19936: Added executable bits or shebang lines to Python scripts which
  requires them.  Disable executable bits and shebang lines in test and
  benchmark files in order to prevent using a random system python, and in
  source files of modules which don't provide command line interface.  Fixed
  shebang lines in the unittestgui and checkpip scripts.

1148 1149 1150
- Issue #20268: Argument Clinic now supports cloning the parameters and
  return converter of existing functions.

1151 1152 1153
- Issue #20228: Argument Clinic now has special support for class special
  methods.

1154 1155 1156
- Issue #20214: Fixed a number of small issues and documentation errors in
  Argument Clinic (see issue for details).

1157 1158 1159 1160
- Issue #20196: Fixed a bug where Argument Clinic did not generate correct
  parsing code for functions with positional-only parameters where all arguments
  are optional.

1161 1162 1163 1164
- Issue #18960: 2to3 and the findnocoding.py script now ignore the source
  encoding declaration on the second line if the first line contains anything
  except a comment.

1165
- Issue #19723: The marker comments Argument Clinic uses have been changed
1166 1167
  to improve readability.

1168 1169 1170
- Issue #20157: When Argument Clinic renames a parameter because its name
  collides with a C keyword, it no longer exposes that rename to PyArg_Parse.

1171 1172 1173
- Issue #20141: Improved Argument Clinic's support for the PyArg_Parse "O!"
  format unit.

1174 1175 1176
- Issue #20144: Argument Clinic now supports simple symbolic constants
  as parameter default values.

1177 1178 1179
- Issue #20143: The line numbers reported in Argument Clinic errors are
  now more accurate.

1180 1181
- Issue #20142: Py_buffer variables generated by Argument Clinic are now
  initialized with a default value.
1182

1183 1184 1185 1186 1187 1188
Build
-----

- Issue #12837: Silence a tautological comparison warning on OS X under Clang in
  socketmodule.c.

1189 1190 1191 1192 1193 1194 1195 1196
What's New in Python 3.4.0 Beta 2?
==================================

Release date: 2014-01-05

Core and Builtins
-----------------

1197 1198
- Issue #17432: Drop UCS2 from names of Unicode functions in python3.def.

1199 1200 1201
- Issue #19526: Exclude all new API from the stable ABI. Exceptions can be
  made if a need is demonstrated.

1202 1203 1204
- Issue #19969: PyBytes_FromFormatV() now raises an OverflowError if "%c"
  argument is not in range [0; 255].

1205 1206
- Issue #19995: %c, %o, %x, and %X now issue a DeprecationWarning on non-integer
  input; reworded docs to clarify that an integer type should define both __int__
1207 1208
  and __index__.

1209 1210 1211 1212
- Issue #19787: PyThread_set_key_value() now always set the value. In Python
  3.3, the function did nothing if the key already exists (if the current value
  is a non-NULL pointer).

1213 1214 1215 1216 1217 1218
- Issue #14432: Remove the thread state field from the frame structure. Fix a
  crash when a generator is created in a C thread that is destroyed while the
  generator is still used. The issue was that a generator contains a frame, and
  the frame kept a reference to the Python state of the destroyed C thread. The
  crash occurs when a trace function is setup.

1219 1220 1221 1222 1223
- Issue #19576: PyGILState_Ensure() now initializes threads. At startup, Python
  has no concrete GIL. If PyGILState_Ensure() is called from a new thread for
  the first time and PyEval_InitThreads() was not called yet, a GIL needs to be
  created.

1224 1225 1226
- Issue #17576: Deprecation warning emitted now when __int__() or __index__()
  return not int instance.

1227 1228
- Issue #19932: Fix typo in import.h, missing whitespaces in function prototypes.

1229 1230 1231
- Issue #19736: Add module-level statvfs constants defined for GNU/glibc
  based systems.

1232 1233
- Issue #20097: Fix bad use of "self" in importlib's WindowsRegistryFinder.

1234 1235
- Issue #19729: In str.format(), fix recursive expansion in format spec.

1236 1237 1238
- Issue #19638: Fix possible crash / undefined behaviour from huge (more than 2
  billion characters) input strings in _Py_dg_strtod.

1239 1240 1241
Library
-------

1242 1243
- Issue #20154: Deadlock in asyncio.StreamReader.readexactly().

1244 1245
- Issue #16113: Remove sha3 module again.

1246 1247
- Issue #20111: pathlib.Path.with_suffix() now sanity checks the given suffix.

1248 1249
- Fix breakage in TestSuite.countTestCases() introduced by issue #11798.

1250 1251
- Issue #20108: Avoid parameter name clash in inspect.getcallargs().

1252 1253
- Issue #19918: Fix PurePath.relative_to() under Windows.

1254 1255 1256
- Issue #19422: Explicitly disallow non-SOCK_STREAM sockets in the ssl
  module, rather than silently let them emit clear text data.

1257 1258 1259
- Issue #20046: Locale alias table no longer contains entities which can be
  calculated.  Generalized support of the euro modifier.

1260 1261
- Issue #20027: Fixed locale aliases for devanagari locales.

1262 1263
- Issue #20067: Tkinter variables now work when wantobjects is false.

1264 1265 1266
- Issue #19020: Tkinter now uses splitlist() instead of split() in configure
  methods.

1267 1268 1269 1270
- Issue #19744: ensurepip now provides a better error message when Python is
  built without SSL/TLS support (pip currently requires that support to run,
  even if only operating with local wheel files)

1271 1272 1273
- Issue #19734: ensurepip now ignores all pip environment variables to avoid
  odd behaviour based on user configuration settings

1274 1275
- Fix TypeError on "setup.py upload --show-response".

1276 1277
- Issue #20045: Fix "setup.py register --list-classifiers".

1278 1279 1280
- Issue #18879: When a method is looked up on a temporary file, avoid closing
  the file before the method is possibly called.

1281 1282 1283
- Issue #20037: Avoid crashes when opening a text file late at interpreter
  shutdown.

1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297
- Issue #19967: Thanks to the PEP 442, asyncio.Future now uses a
  destructor to log uncaught exceptions, instead of the dedicated
  _TracebackLogger class.

- Added a Task.current_task() class method to asyncio.

- Issue #19850: Set SA_RESTART in asyncio when registering a signal
  handler to limit EINTR occurrences.

- Implemented write flow control in asyncio for proactor event loop (Windows).

- Change write buffer in asyncio use to avoid O(N**2) behavior.  Make
  write()/sendto() accept bytearray/memoryview.

1298 1299 1300
- Issue #20034: Updated alias mapping to most recent locale.alias file
  from X.org distribution using makelocalealias.py.

1301 1302 1303
- Issue #5815: Fixed support for locales with modifiers.  Fixed support for
  locale encodings with hyphens.

1304 1305 1306
- Issue #20026: Fix the sqlite module to handle correctly invalid isolation
  level (wrong type).

1307 1308 1309
- Issue #18829: csv.Dialect() now checks type for delimiter, escapechar and
  quotechar fields.  Original patch by Vajrasky Kok.

1310 1311 1312 1313
- Issue #19855: uuid.getnode() on Unix now looks on the PATH for the
  executables used to find the mac address, with /sbin and /usr/sbin as
  fallbacks.

1314 1315 1316
- Issue #20007: HTTPResponse.read(0) no more prematurely closes connection.
  Original patch by Simon Sapin.

1317 1318 1319 1320 1321 1322
- Issue #19946: multiprocessing now uses runpy to initialize __main__ in
  child processes when necessary, allowing it to correctly handle scripts
  without suffixes and submodules that use explicit relative imports or
  otherwise rely on parent modules being correctly imported prior to
  execution.

1323 1324 1325 1326
- Issue #19921: When Path.mkdir() is called with parents=True, any missing
  parent is created with the default permissions, ignoring the mode argument
  (mimicking the POSIX "mkdir -p" command).

1327 1328 1329
- Issue #19887: Improve the Path.resolve() algorithm to support certain
  symlink chains.

1330 1331
- Issue #19912: Fixed numerous bugs in ntpath.splitunc().

1332 1333 1334
- Issue #19911: ntpath.splitdrive() now correctly processes the 'İ' character
  (U+0130, LATIN CAPITAL LETTER I WITH DOT ABOVE).

1335 1336 1337
- Issue #19532: python -m compileall with no filename/directory arguments now
  respects the -f and -q flags instead of ignoring them.

1338 1339
- Issue #19623: Fixed writing to unseekable files in the aifc module.

1340 1341 1342
- Issue #19946: multiprocessing.spawn now raises ImportError when the module to
  be used as the main module cannot be imported.

1343 1344
- Issue #17919: select.poll.register() again works with poll.POLLNVAL on AIX.
  Fixed integer overflow in the eventmask parameter.
1345

1346 1347 1348 1349 1350 1351 1352
- Issue #19063: if a Charset's body_encoding was set to None, the email
  package would generate a message claiming the Content-Transfer-Encoding
  was 7bit, and produce garbage output for the content.  This now works.
  A couple of other set_payload mishandlings of non-ASCII are also fixed.
  In addition, calling set_payload with a string argument without
  specifying a charset now raises an error (this is a new error in 3.4).

1353 1354
- Issue #15475: Add __sizeof__ implementations for itertools objects.

1355 1356 1357
- Issue #19944: Fix importlib.find_spec() so it imports parents as needed
  and move the function to importlib.util.

1358 1359 1360
- Issue #19880: Fix a reference leak in unittest.TestCase. Explicitly break
  reference cycles between frames and the _Outcome instance.

1361 1362 1363 1364 1365 1366
- Issue #17429: platform.linux_distribution() now decodes files from the UTF-8
  encoding with the surrogateescape error handler, instead of decoding from the
  locale encoding in strict mode. It fixes the function on Fedora 19 which is
  probably the first major distribution release with a non-ASCII name. Patch
  written by Toshio Kuratomi.

1367 1368 1369
- Issue #19343: Expose FreeBSD-specific APIs in resource module.  Original
  patch by Koobs.

1370 1371 1372 1373
- Issue #19929: Call os.read with 32768 within subprocess.Popen.communicate
  rather than 4096 for efficiency.  A microbenchmark shows Linux and OS X
  both using ~50% less cpu time this way.

1374 1375 1376
- Issue #19506: Use a memoryview to avoid a data copy when piping data
  to stdin within subprocess.Popen.communicate.  5-10% less cpu usage.

1377 1378 1379
- Issue #19876: selectors unregister() no longer raises ValueError or OSError
  if the FD is closed (as long as it was registered).

1380 1381
- Issue #19908: pathlib now joins relative Windows paths correctly when a drive
  is present.  Original patch by Antoine Pitrou.
1382

1383 1384
- Issue #19296: Silence compiler warning in dbm_open

1385 1386 1387 1388
- Issue #6784: Strings from Python 2 can now be unpickled as bytes
  objects by setting the encoding argument of Unpickler to be 'bytes'.
  Initial patch by Merlijn van Deen.

1389
- Issue #19839: Fix regression in bz2 module's handling of non-bzip2 data at
1390
  EOF, and analogous bug in lzma module.
1391

1392 1393 1394
- Issue #19881: Fix pickling bug where cpickle would emit bad pickle data for
  large bytes string (i.e., with size greater than 2**32-1).

1395 1396 1397 1398
- Issue #19138: doctest's IGNORE_EXCEPTION_DETAIL now allows a match when
  no exception detail exists (no colon following the exception's name, or
  a colon does follow but no text follows the colon).

1399 1400
- Issue #19927: Add __eq__ to path-based loaders in importlib.

1401 1402 1403 1404
- Issue #19827: On UNIX, setblocking() and settimeout() methods of
  socket.socket can now avoid a second syscall if the ioctl() function can be
  used, or if the non-blocking flag of the socket is unchanged.

1405 1406 1407
- Issue #19785: smtplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1408 1409 1410
- Issue #19784: poplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1411 1412 1413
- Issue #19783: nntplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1414 1415 1416
- Issue #19782: imaplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1417 1418
- Issue 20123: Fix pydoc.synopsis() for "binary" modules.

1419 1420
- Issue #19834: Support unpickling of exceptions pickled by Python 2.

1421 1422 1423
- Issue #19781: ftplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1424 1425 1426
- Issue #19509: Add SSLContext.check_hostname to match the peer's certificate
  with server_hostname on handshake.

1427 1428 1429
- Issue #15798: Fixed subprocess.Popen() to no longer fail if file
  descriptor 0, 1 or 2 is closed.

1430 1431
- Issue #17897: Optimized unpickle prefetching.

1432 1433 1434 1435
- Issue #3693: Make the error message more helpful when the array.array()
  constructor is given a str. Move the array module typecode documentation to
  the docstring of the constructor.

1436 1437 1438
- Issue #19088: Fixed incorrect caching of the copyreg module in
  object.__reduce__() and object.__reduce_ex__().

1439 1440 1441
- Issue #19698: Removed exec_module() methods from
  importlib.machinery.BuiltinImporter and ExtensionFileLoader.

1442 1443
- Issue #18864: Added a setter for ModuleSpec.has_location.

1444 1445 1446
- Fixed _pickle.Unpickler to not fail when loading empty strings as
  persistent IDs.

1447 1448 1449
- Issue #11480: Fixed copy.copy to work with classes with custom metaclasses.
  Patch by Daniel Urban.

1450 1451 1452
- Issue #6477: Added support for pickling the types of built-in singletons
  (i.e., Ellipsis, NotImplemented, None).

1453 1454
- Issue #19713: Add remaining PEP 451-related deprecations and move away
  from using find_module/find_loaer/load_module.
1455

1456 1457
- Issue #19708: Update pkgutil to use the new importer APIs.

1458 1459
- Issue #19703: Update pydoc to use the new importer APIs.

1460 1461
- Issue #19851: Fixed a regression in reloading sub-modules.

1462 1463
- ssl.create_default_context() sets OP_NO_COMPRESSION to prevent CRIME.

1464 1465
- Issue #19802: Add socket.SO_PRIORITY.

1466 1467 1468
- Issue #11508: Fixed uuid.getnode() and uuid.uuid1() on environment with
  virtual interface.  Original patch by Kent Frazier.

1469 1470
- Issue #11489: JSON decoder now accepts lone surrogates.

1471 1472 1473
- Issue #19545: Avoid chained exceptions while passing stray % to
  time.strptime().  Initial patch by Claudiu Popa.

1474 1475 1476
IDLE
----

1477 1478
- Issue #20058: sys.stdin.readline() in IDLE now always returns only one line.

1479 1480 1481 1482
- Issue #19481: print() of string subclass instance in IDLE no longer hangs.

- Issue #18270: Prevent possible IDLE AttributeError on OS X when no initial
  shell window is present.
1483

Zachary Ware's avatar
Zachary Ware committed
1484 1485
Tests
-----
1486

1487 1488 1489
- Issue #20055: Fix test_shutil under Windows with symlink privileges held.
  Patch by Vajrasky Kok.

1490 1491 1492
- Issue #20070: Don't run test_urllib2net when network resources are not
  enabled.

1493 1494 1495
- Issue #19938: Re-enabled test_bug_1333982 in test_dis, which had been
  disabled since 3.0 due to the changes in listcomp handling.

1496 1497
- Issue #19320: test_tcl no longer fails when wantobjects is false.

1498
- Issue #19919: Fix flaky SSL test. connect_ex() sometimes returns
1499 1500
  EWOULDBLOCK on Windows or VMs hosted on Windows.

1501 1502
- Issue #19912: Added tests for ntpath.splitunc().

1503 1504
- Issue #19828: Fixed test_site when the whole suite is run with -S.

1505 1506
- Issue #19928: Implemented a test for repr() of cell objects.

1507 1508
- Issue #19535: Fixed test_docxmlrpc, test_functools, test_inspect, and
  test_statistics when python is run with -OO.
1509

1510 1511 1512
- Issue #19926: Removed unneeded test_main from test_abstract_numbers.
  Patch by Vajrasky Kok.

1513
- Issue #19572: More skipped tests explicitly marked as skipped.
1514

1515
- Issue #19595, #19987: Re-enabled a long-disabled test in test_winsound.
1516

Zachary Ware's avatar
Zachary Ware committed
1517 1518
- Issue #19588: Fixed tests in test_random that were silently skipped most
  of the time.  Patch by Julian Gindi.
1519

1520 1521
Build
-----
1522

1523 1524
- Issue #19728: Enable pip installation by default on Windows.

1525 1526
- Issue #16136: Remove VMS support

1527 1528 1529
- Issue #18215: Add script Tools/ssl/test_multiple_versions.py to compile and
  run Python's unit tests with multiple versions of OpenSSL.

1530 1531 1532
- Issue #19922: define _INCLUDE__STDC_A1_SOURCE in HP-UX to include mbstate_t
  for mbrtowc().

1533 1534 1535
- Issue #19788: kill_python(_d).exe is now run as a PreBuildEvent on the
  pythoncore sub-project.  This should prevent build errors due a previous
  build's python(_d).exe still running.
1536

1537 1538
Documentation
-------------
Tim Golden's avatar
Tim Golden committed
1539

1540 1541
- Issue #20265: Updated some parts of the Using Windows document.

1542 1543 1544
- Issue #20266: Updated some parts of the Windows FAQ.

- Issue #20255: Updated the about and bugs pages.
1545

1546 1547 1548
- Issue #20253: Fixed a typo in the ipaddress docs that advertised an
  illegal attribute name.  Found by INADA Naoki.

1549
- Issue #18840: Introduce the json module in the tutorial, and de-emphasize
1550
  the pickle module.
1551

1552
- Issue #19845: Updated the Compiling Python on Windows section.
1553

1554
- Issue #19795: Improved markup of True/False constants.
1555

1556 1557 1558
Tools/Demos
-----------

1559 1560
- Issue #19659: Added documentation for Argument Clinic.

1561 1562
- Issue #19976: Argument Clinic METH_NOARGS functions now always
  take two parameters.
1563

1564
What's New in Python 3.4.0 Beta 1?
1565
==================================
1566

1567
Release date: 2013-11-24
1568 1569 1570

Core and Builtins
-----------------
1571

1572 1573
- Use the repr of a module name in more places in import, especially
  exceptions.
1574

1575 1576 1577 1578 1579 1580
- Issue #19619: str.encode, bytes.decode and bytearray.decode now use an
  internal API to throw LookupError for known non-text encodings, rather
  than attempting the encoding or decoding operation and then throwing a
  TypeError for an unexpected output type. (The latter mechanism remains
  in place for third party non-text encodings)

1581 1582 1583
- Issue #19183: Implement PEP 456 'secure and interchangeable hash algorithm'.
  Python now uses SipHash24 on all major platforms.

1584 1585 1586 1587 1588 1589
- Issue #12892: The utf-16* and utf-32* encoders no longer allow surrogate code
  points (U+D800-U+DFFF) to be encoded.  The utf-32* decoders no longer decode
  byte sequences that correspond to surrogate code points.  The surrogatepass
  error handler now works with the utf-16* and utf-32* codecs.  Based on
  patches by Victor Stinner and Kang-Hao (Kenny) Lu.

1590 1591 1592
- Issue #17806: Added keyword-argument support for "tabsize" to
  str/bytes.expandtabs().

1593 1594 1595 1596 1597 1598 1599 1600 1601
- Issue #17828: Output type errors in str.encode(), bytes.decode() and
  bytearray.decode() now direct users to codecs.encode() or codecs.decode()
  as appropriate.

- Issue #17828: The interpreter now attempts to chain errors that occur in
  codec processing with a replacement exception of the same type that
  includes the codec name in the error message. It ensures it only does this
  when the creation of the replacement exception won't lose any information.

1602 1603 1604 1605
- Issue #19466: Clear the frames of daemon threads earlier during the
  Python shutdown to call objects destructors. So "unclosed file" resource
  warnings are now corretly emitted for daemon threads.

1606
- Issue #19514: Deduplicate some _Py_IDENTIFIER declarations.
1607 1608
  Patch by Andrei Dorian Duma.

1609 1610 1611
- Issue #17936: Fix O(n**2) behaviour when adding or removing many subclasses
  of a given type.

1612 1613 1614
- Issue #19428: zipimport now handles errors when reading truncated or invalid
  ZIP archive.

1615 1616 1617 1618
- Issue #18408: Add a new PyFrame_FastToLocalsWithError() function to handle
  exceptions when merging fast locals into f_locals of a frame.
  PyEval_GetLocals() now raises an exception and return NULL on failure.

1619 1620
- Issue #19369: Optimized the usage of __length_hint__().

1621 1622 1623
- Issue #18603: Ensure that PyOS_mystricmp and PyOS_mystrnicmp are in the
  Python executable and not removed by the linker's optimizer.

1624
- Issue #19306: Add extra hints to the faulthandler module's stack
1625 1626
  dumps that these are "upside down".

1627 1628
Library
-------
1629

1630 1631 1632
- Issue #3158: doctest can now find doctests in functions and methods
  written in C.

1633 1634 1635
- Issue #13477: Added command line interface to the tarfile module.
  Original patch by Berker Peksag.

1636 1637 1638
- Issue #19674: inspect.signature() now produces a correct signature
  for some builtins.

1639 1640
- Issue #19722: Added opcode.stack_effect(), which
  computes the stack effect of bytecode instructions.
1641

1642 1643 1644 1645
- Issue #19735: Implement private function ssl._create_stdlib_context() to
  create SSLContext objects in Python's stdlib module. It provides a single
  configuration point and makes use of SSLContext.load_default_certs().

1646 1647 1648 1649
- Issue #16203: Add re.fullmatch() function and regex.fullmatch() method,
  which anchor the pattern at both ends of the string to match.
  Original patch by Matthew Barnett.

1650 1651 1652
- Issue #13592: Improved the repr for regular expression pattern objects.
  Based on patch by Hugo Lopes Tavares.

1653 1654 1655
- Issue #19641: Added the audioop.byteswap() function to convert big-endian
  samples to little-endian and vice versa.

1656 1657
- Issue #15204: Deprecated the 'U' mode in file-like objects.

1658 1659
- Issue #17810: Implement PEP 3154, pickle protocol 4.

1660 1661
- Issue #19668: Added support for the cp1125 encoding.

1662 1663 1664
- Issue #19689: Add ssl.create_default_context() factory function. It creates
  a new SSLContext object with secure default settings.

1665 1666 1667
- Issue #19727: os.utime(..., None) is now potentially more precise
  under Windows.

1668 1669 1670
- Issue #17201: ZIP64 extensions now are enabled by default.  Patch by
  William Mallard.

1671 1672 1673 1674
- Issue #19292: Add SSLContext.load_default_certs() to load default root CA
  certificates from default stores or system stores. By default the method
  loads CA certs for authentication of server certs.

1675 1676
- Issue #19673: Add pathlib to the stdlib as a provisional module (PEP 428).

1677 1678 1679 1680
- Issue #16596: pdb in a generator now properly skips over yield and
  yield from rather than stepping out of the generator into its
  caller.  (This is essential for stepping through asyncio coroutines.)

1681 1682 1683 1684
- Issue #17916: Added dis.Bytecode.from_traceback() and
  dis.Bytecode.current_offset to easily display "current instruction"
  markers in the new disassembly API (Patch by Claudiu Popa).

1685 1686
- Issue #19552: venv now supports bootstrapping pip into virtual environments

1687 1688 1689 1690
- Issue #17134: Finalize interface to Windows' certificate store. Cert and
  CRL enumeration are now two functions. enum_certificates() also returns
  purpose flags as set of OIDs.

1691 1692
- Issue #19555: Restore sysconfig.get_config_var('SO'), (and the distutils
  equivalent) with a DeprecationWarning pointing people at $EXT_SUFFIX.
1693

1694 1695 1696 1697
- Issue #8813: Add SSLContext.verify_flags to change the verification flags
  of the context in order to enable certification revocation list (CRL)
  checks or strict X509 rules.

1698 1699
- Issue #18294: Fix the zlib module to make it 64-bit safe.

1700 1701 1702
- Issue #19682: Fix compatibility issue with old version of OpenSSL that
  was introduced by Issue #18379.

1703 1704
- Issue #14455: plistlib now supports binary plists and has an updated API.

1705 1706
- Issue #19633: Fixed writing not compressed 16- and 32-bit wave files on
  big-endian platforms.
1707

1708 1709 1710
- Issue #18379: SSLSocket.getpeercert() returns CA issuer AIA fields, OCSP
  and CRL distribution points.

1711 1712 1713 1714
- Issue #18138: Implement cadata argument of SSLContext.load_verify_location()
  to load CA certificates and CRL from memory. It supports PEM and DER
  encoded strings.

1715 1716 1717
- Issue #18775: Add name and block_size attribute to HMAC object. They now
  provide the same API elements as non-keyed cryptographic hash functions.

1718 1719 1720
- Issue #17276: MD5 as default digestmod for HMAC is deprecated. The HMAC
  module supports digestmod names, e.g. hmac.HMAC('sha1').

1721 1722
- Issue #19449: in csv's writerow, handle non-string keys when generating the
  error message that certain keys are not in the 'fieldnames' list.
1723

1724 1725 1726
- Issue #13633: Added a new convert_charrefs keyword arg to HTMLParser that,
  when True, automatically converts all character references.

1727 1728
- Issue #2927: Added the unescape() function to the html module.

1729 1730
- Issue #8402: Added the escape() function to the glob module.

1731 1732
- Issue #17618: Add Base85 and Ascii85 encoding/decoding to the base64 module.

1733 1734 1735
- Issue #19634: time.strftime("%y") now raises a ValueError on AIX when given a
  year before 1900.

1736 1737 1738
- Fix test.support.bind_port() to not cause an error when Python was compiled
  on a system with SO_REUSEPORT defined in the headers but run on a system
  with an OS kernel that does not support that reasonably new socket option.
1739

1740
- Fix compilation error under gcc of the ctypes module bundled libffi for arm.
1741

1742 1743 1744
- Issue #19448: Add private API to SSL module to lookup ASN.1 objects by OID,
  NID, short name and long name.

1745 1746 1747
- Issue #19282: dbm.open now supports the context manager protocol. (Inital
  patch by Claudiu Popa)

1748
- Issue #8311: Added support for writing any bytes-like objects in the aifc,
1749 1750
  sunau, and wave modules.

1751 1752
- Issue #5202: Added support for unseekable files in the wave module.

1753 1754 1755 1756
- Issue #19544 and Issue #1180: Restore global option to ignore
  ~/.pydistutils.cfg in Distutils, accidentally removed in backout of
  distutils2 changes.

1757
- Issue #19523: Closed FileHandler leak which occurred when delay was set.
1758

1759 1760 1761
- Issue #19544 and Issue #6516: Restore support for --user and --group
  parameters to sdist command accidentally rolled back as part of the
  distutils2 rollback.
1762

Tim Golden's avatar
Tim Golden committed
1763 1764 1765
- Issue #13674: Prevented time.strftime from crashing on Windows when given
  a year before 1900 and a format of %y.

1766 1767 1768
- Issue #19406: implementation of the ensurepip module (part of PEP 453).
  Patch by Donald Stufft and Nick Coghlan.

1769 1770 1771
- Issue #19544 and Issue #6286: Restore use of urllib over http allowing use
  of http_proxy for Distutils upload command, a feature accidentally lost
  in the rollback of distutils2.
1772

1773 1774 1775
- Issue #19544 and Issue #7457: Restore the read_pkg_file method to
  distutils.dist.DistributionMetadata accidentally removed in the undo of
  distutils2.
1776

1777 1778 1779
- Issue #16685: Added support for any bytes-like objects in the audioop module.
  Removed support for strings.

1780 1781 1782
- Issue #7171: Add Windows implementation of ``inet_ntop`` and ``inet_pton``
  to socket module. Patch by Atsuo Ishimoto.

1783 1784
- Issue #19261: Added support for writing 24-bit samples in the sunau module.

1785 1786 1787
- Issue #1097797: Added CP273 encoding, used on IBM mainframes in
  Germany and Austria.  Mapping provided by Michael Bierenfeld.

1788
- Issue #1575020: Fixed support of 24-bit wave files on big-endian platforms.
1789

1790 1791 1792 1793 1794 1795 1796 1797 1798 1799 1800 1801 1802 1803
- Issue #19378: Fixed a number of cases in the dis module where the new
  "file" parameter was not being honoured correctly

- Issue #19378: Removed the "dis.Bytecode.show_info" method

- Issue #19378: Renamed the "dis.Bytecode.display_code" method to
  "dis.Bytecode.dis" and converted it to returning a string rather than
  printing output.

- Issue #19378: the "line_offset" parameter in the new "dis.get_instructions"
  API has been renamed to "first_line" (and the default value and usage
  changed accordingly). This should reduce confusion with the more common use
  of "offset" in the dis docs to refer to bytecode offsets.

1804 1805 1806 1807
- Issue #18678: Corrected spwd struct member names in spwd module:
  sp_nam->sp_namp, and sp_pwd->sp_pwdp.  The old names are kept as extra
  structseq members, for backward compatibility.

1808 1809 1810
- Issue #6157: Fixed tkinter.Text.debug().  tkinter.Text.bbox() now raises
  TypeError instead of TclError on wrong number of arguments.  Original patch
  by Guilherme Polo.
1811

1812 1813
- Issue #10197: Rework subprocess.get[status]output to use subprocess
  functionality and thus to work on Windows. Patch by Nick Coghlan
1814

1815 1816
- Issue #6160: The bbox() method of tkinter.Spinbox now returns a tuple of
  integers instead of a string.  Based on patch by Guilherme Polo.
1817

1818 1819
- Issue #19403: contextlib.redirect_stdout is now reentrant

1820 1821
- Issue #19286: Directories in ``package_data`` are no longer added to
  the filelist, preventing failure outlined in the ticket.
1822

Ezio Melotti's avatar
Ezio Melotti committed
1823 1824
- Issue #19480: HTMLParser now accepts all valid start-tag names as defined
  by the HTML5 standard.
1825

1826 1827 1828
- Issue #15114: The html.parser module now raises a DeprecationWarning when the
  strict argument of HTMLParser or the HTMLParser.error method are used.

1829 1830 1831
- Issue #19410: Undo the special-casing removal of '' for
  importlib.machinery.FileFinder.

1832 1833 1834
- Issue #19424: Fix the warnings module to accept filename containing surrogate
  characters.

Benjamin Peterson's avatar
Benjamin Peterson committed
1835
- Issue #19435: Fix directory traversal attack on CGIHttpRequestHandler.
1836

1837 1838 1839
- Issue #19227: Remove pthread_atfork() handler. The handler was added to
  solve #18747 but has caused issues.

1840 1841 1842
- Issue #19420: Fix reference leak in module initalization code of
  _hashopenssl.c

1843 1844
- Issue #19329: Optimized compiling charsets in regular expressions.

1845 1846 1847
- Issue #19227: Try to fix deadlocks caused by re-seeding then OpenSSL
  pseudo-random number generator on fork().

1848 1849 1850
- Issue #16037: HTTPMessage.readheaders() raises an HTTPException when more than
  100 headers are read.  Adapted from patch by Jyrki Pulliainen.

1851 1852 1853 1854
- Issue #16040: CVE-2013-1752: nntplib: Limit maximum line lengths to 2048 to
  prevent readline() calls from consuming too much memory.  Patch by Jyrki
  Pulliainen.

1855 1856 1857 1858
- Issue #16041: CVE-2013-1752: poplib: Limit maximum line lengths to 2048 to
  prevent readline() calls from consuming too much memory.  Patch by Jyrki
  Pulliainen.

1859 1860 1861 1862
- Issue #17997: Change behavior of ``ssl.match_hostname()`` to follow RFC 6125,
  for security reasons.  It now doesn't match multiple wildcards nor wildcards
  inside IDN fragments.

1863 1864 1865
- Issue #16039: CVE-2013-1752: Change use of readline in imaplib module to limit
  line length.  Patch by Emil Lind.

1866 1867 1868 1869 1870
- Issue #19330: the unnecessary wrapper functions have been removed from the
  implementations of the new contextlib.redirect_stdout and
  contextlib.suppress context managers, which also ensures they provide
  reasonable help() output on instances

Benjamin Peterson's avatar
Benjamin Peterson committed
1871 1872
- Issue #19393: Fix symtable.symtable function to not be confused when there are
  functions or classes named "top".
1873

1874 1875
- Issue #18685: Restore re performance to pre-PEP 393 levels.

1876 1877
- Issue #19339: telnetlib module is now using time.monotonic() when available
  to compute timeout.
1878

1879 1880
- Issue #19399: fix sporadic test_subprocess failure.

1881 1882 1883
- Issue #13234: Fix os.listdir to work with extended paths on Windows.
  Patch by Santoso Wijaya.

1884 1885 1886
- Issue #19375: The site module adding a "site-python" directory to sys.path,
  if it exists, is now deprecated.

1887 1888 1889
- Issue #19379: Lazily import linecache in the warnings module, to make
  startup with warnings faster until a warning gets printed.

1890 1891 1892 1893 1894 1895
- Issue #19288: Fixed the "in" operator of dbm.gnu databases for string
  argument.  Original patch by Arfrever Frehtes Taifersar Arahesis.

- Issue #19287: Fixed the "in" operator of dbm.ndbm databases for string
  argument.  Original patch by Arfrever Frehtes Taifersar Arahesis.

1896
- Issue #19327: Fixed the working of regular expressions with too big charset.
1897

1898 1899 1900
- Issue #17400: New 'is_global' attribute for ipaddress to tell if an address
  is allocated by IANA for global or private networks.

1901 1902
- Issue #19350: Increasing the test coverage of macurl2path. Patch by Colin
  Williams.
1903

1904 1905 1906
- Issue #19365: Optimized the parsing of long replacement string in re.sub*()
  functions.

1907 1908
- Issue #19352: Fix unittest discovery when a module can be reached
  through several paths (e.g. under Debian/Ubuntu with virtualenv).
1909

1910 1911
- Issue #15207: Fix mimetypes to read from correct part of Windows registry
  Original patch by Dave Chambers
1912

1913 1914
- Issue #16595: Add prlimit() to resource module.

1915 1916
- Issue #19324: Expose Linux-specific constants in resource module.

1917 1918
- Load SSL's error strings in hashlib.

1919 1920
- Issue #18527: Upgrade internal copy of zlib to 1.2.8.

1921 1922
- Issue #19274: Add a filterfunc parameter to PyZipFile.writepy.

1923 1924 1925
- Issue #8964: fix platform._sys_version to handle IronPython 2.6+.
  Patch by Martin Matusiak.

1926 1927
- Issue #19413: Restore pre-3.3 reload() semantics of re-finding modules.

1928 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939
- Issue #18958: Improve error message for json.load(s) while passing a string
  that starts with a UTF-8 BOM.

- Issue #19307: Improve error message for json.load(s) while passing objects
  of the wrong type.

- Issue #16038: CVE-2013-1752: ftplib: Limit amount of data read by
  limiting the call to readline().  Original patch by Michał
  Jastrzębski and Giampaolo Rodola.

- Issue #17087: Improved the repr for regular expression match objects.

1940 1941 1942
Tests
-----

1943 1944 1945
- Issue #19664: test_userdict's repr test no longer depends on the order
  of dict elements.

1946 1947 1948 1949
- Issue #19440: Clean up test_capi by removing an unnecessary __future__
  import, converting from test_main to unittest.main, and running the
  _testcapi module tests as subTests of a unittest TestCase method.

1950 1951 1952 1953 1954 1955
- Issue #19378: the main dis module tests are now run with both stdout
  redirection *and* passing an explicit file parameter

- Issue #19378: removed the not-actually-helpful assertInstructionMatches
  and assertBytecodeExactlyMatches helpers from bytecode_helper

1956 1957
- Issue #18702: All skipped tests now reported as skipped.

1958 1959 1960
- Issue #19439: interpreter embedding tests are now executed on Windows
  (Patch by Zachary Ware)

1961 1962
- Issue #19085: Added basic tests for all tkinter widget options.

1963
- Issue #19384: Fix test_py_compile for root user, patch by Claudiu Popa.
1964

Zachary Ware's avatar
Zachary Ware committed
1965 1966
Documentation
-------------
1967

Zachary Ware's avatar
Zachary Ware committed
1968 1969 1970
- Issue #18326: Clarify that list.sort's arguments are keyword-only.  Also,
  attempt to reduce confusion in the glossary by not saying there are
  different "types" of arguments and parameters.
1971

1972 1973
Build
-----
1974

1975 1976 1977
- Issue #19358: "make clinic" now runs the Argument Clinic preprocessor
  over all CPython source files.

Martin v. Löwis's avatar
Martin v. Löwis committed
1978
- Update SQLite to 3.8.1, xz to 5.0.5, and Tcl/Tk to 8.6.1 on Windows.
1979

1980 1981
- Issue #16632: Enable DEP and ASLR on Windows.

1982 1983
- Issue #17791: Drop PREFIX and EXEC_PREFIX definitions from PC/pyconfig.h

1984 1985 1986
- Add workaround for VS 2010 nmake clean issue. VS 2010 doesn't set up PATH
  for nmake.exe correctly.

1987 1988
- Issue #19550: Implement Windows installer changes of PEP 453 (ensurepip).

1989 1990
- Issue #19520: Fix compiler warning in the _sha3 module on 32bit Windows.

1991 1992
- Issue #19356: Avoid using a C variabled named "_self", it's a reserved
  word in some C compilers.
1993

1994 1995
- Issue #15792: Correct build options on Win64. Patch by Jeremy Kloth.

1996 1997 1998
- Issue #19373: Apply upstream change to Tk 8.5.15 fixing OS X 10.9
  screen refresh problem for OS X installer build.

1999 2000 2001 2002 2003 2004
- Issue #19649: On OS X, the same set of file names are now installed
  in bin directories for all configurations: non-framework vs framework,
  and single arch vs universal builds.  pythonx.y-32 is now always
  installed for 64-bit/32-bit universal builds.  The obsolete and
  undocumented pythonw* symlinks are no longer installed anywhere.

2005 2006 2007 2008 2009 2010
- Issue #19553: PEP 453 - "make install" and "make altinstall" now install or
  upgrade pip by default, using the bundled pip provided by the new ensurepip
  module.  A new configure option, --with-ensurepip[=upgrade|install|no], is
  available to override the default ensurepip "--upgrade" option.  The option
  can also be set with "make [alt]install ENSUREPIP=[upgrade|install\no]".

2011 2012
- Issue #19551: PEP 453 - the OS X installer now installs pip by default.

2013 2014
- Update third-party libraries for OS X installers: xz 5.0.3 -> 5.0.5,
  SQLite 3.7.13 -> 3.8.1
2015

2016 2017 2018 2019 2020
- Issue #15663: Revert OS X installer built-in Tcl/Tk support for 3.4.0b1.
  Some third-party projects, such as Matplotlib and PIL/Pillow,
  depended on being able to build with Tcl and Tk frameworks in
  /Library/Frameworks.

2021 2022
Tools/Demos
-----------
2023

2024 2025 2026
- Issue #19730: Argument Clinic now supports all the existing PyArg
  "format units" as legacy converters, as well as two new features:
  "self converters" and the "version" directive.
2027

2028 2029 2030
- Issue #19552: pyvenv now bootstraps pip into virtual environments by
  default (pass --without-pip to request the old behaviour)

2031 2032
- Issue #19390: Argument Clinic no longer accepts malformed Python
  and C ids.
2033

2034
What's New in Python 3.4.0 Alpha 4?
2035
===================================
2036

Larry Hastings's avatar
Larry Hastings committed
2037
Release date: 2013-10-20
2038 2039 2040 2041

Core and Builtins
-----------------

2042 2043 2044
- Issue #19301: Give classes and functions that are explicitly marked global a
  global qualname.

Andrew Kuchling's avatar
Andrew Kuchling committed
2045
- Issue #19279: UTF-7 decoder no longer produces illegal strings.
2046

2047 2048 2049
- Issue #16612: Add "Argument Clinic", a compile-time preprocessor for
  C files to generate argument parsing code.  (See PEP 436.)

2050 2051 2052 2053 2054
- Issue #18810: Shift stat calls in importlib.machinery.FileFinder such that
  the code is optimistic that if something exists in a directory named exactly
  like the possible package being searched for that it's in actuality a
  directory.

2055 2056 2057 2058 2059 2060 2061
- Issue #18416: importlib.machinery.PathFinder now treats '' as the cwd and
  importlib.machinery.FileFinder no longer special-cases '' to '.'. This leads
  to modules imported from cwd to now possess an absolute file path for
  __file__ (this does not affect modules specified by path on the CLI but it
  does affect -m/runpy). It also allows FileFinder to be more consistent by not
  having an edge case.

2062 2063 2064
- Issue #4555: All exported C symbols are now prefixed with either
  "Py" or "_Py".

2065 2066 2067
- Issue #19219: Speed up marshal.loads(), and make pyc files slightly
  (5% to 10%) smaller.

2068 2069
- Issue #19221: Upgrade Unicode database to version 6.3.0.

2070 2071 2072 2073 2074
- Issue #16742: The result of the C callback PyOS_ReadlineFunctionPointer must
  now be a string allocated by PyMem_RawMalloc() or PyMem_RawRealloc() (or NULL
  if an error occurred), instead of a string allocated by PyMem_Malloc() or
  PyMem_Realloc().

2075 2076
- Issue #19199: Remove ``PyThreadState.tick_counter`` field

2077 2078 2079
- Fix macro expansion of _PyErr_OCCURRED(), and make sure to use it in at
  least one place so as to avoid regressions.

2080 2081 2082
- Issue #19087: Improve bytearray allocation in order to allow cheap popping
  of data at the front (slice deletion).

2083 2084
- Issue #19014: memoryview.cast() is now allowed on zero-length views.

2085 2086 2087
- Issue #18690: memoryview is now automatically registered with
  collections.abc.Sequence

2088 2089 2090
- Issue #19078: memoryview now correctly supports the reversed builtin
  (Patch by Claudiu Popa)

2091 2092 2093
Library
-------

2094 2095 2096
- Issue #17457: unittest test discovery now works with namespace packages.
  Patch by Claudiu Popa.

2097 2098
- Issue #18235: Fix the sysconfig variables LDSHARED and BLDSHARED under AIX.
  Patch by David Edelsohn.
2099

2100 2101 2102
- Issue #18606: Add the new "statistics" module (PEP 450).  Contributed
  by Steven D'Aprano.

2103 2104
- Issue #12866: The audioop module now supports 24-bit samples.

Christian Heimes's avatar
Christian Heimes committed
2105
- Issue #19254: Provide an optimized Python implementation of pbkdf2_hmac.
2106

2107 2108 2109
- Issues #19201, Issue #19222, Issue #19223: Add "x" mode (exclusive creation)
  in opening file to bz2, gzip and lzma modules. Patches by Tim Heaney and
  Vajrasky Kok.
2110

Brett Cannon's avatar
Brett Cannon committed
2111 2112
- Fix a reference count leak in _sre.

2113 2114 2115 2116 2117
- Issue #19262: Initial check in of the 'asyncio' package (a.k.a. Tulip,
  a.k.a. PEP 3156).  There are no docs yet, and the PEP is slightly
  out of date with the code.  This module will have *provisional* status
  in Python 3.4.

2118
- Issue #19276: Fixed the wave module on 64-bit big-endian platforms.
2119

2120 2121 2122
- Issue #19266: Rename the new-in-3.4 ``contextlib.ignore`` context manager
  to ``contextlib.suppress`` in order to be more consistent with existing
  descriptions of that operation elsewhere in the language and standard
2123
  library documentation (Patch by Zero Piraeus).
2124

2125 2126 2127
- Issue #18891: Completed the new email package (provisional) API additions
  by adding new classes EmailMessage, MIMEPart, and ContentManager.

Ethan Furman's avatar
Ethan Furman committed
2128 2129
- Issue #18281: Unused stat constants removed from `tarfile`.

2130 2131 2132
- Issue #18999: Multiprocessing now supports 'contexts' with the same API
  as the module, but bound to specified start methods.

2133 2134 2135 2136
- Issue #18468: The re.split, re.findall, and re.sub functions and the group()
  and groups() methods of match object now always return a string or a bytes
  object.

2137 2138
- Issue #18725: The textwrap module now supports truncating multiline text.

2139 2140 2141
- Issue #18776: atexit callbacks now display their full traceback when they
  raise an exception.

2142 2143 2144
- Issue #17827: Add the missing documentation for ``codecs.encode`` and
  ``codecs.decode``.

2145 2146 2147
- Issue #19218: Rename collections.abc to _collections_abc in order to
  speed up interpreter start.

2148 2149 2150
- Issue #18582: Add 'pbkdf2_hmac' to the hashlib module. It implements PKCS#5
  password-based key derivation functions with HMAC as pseudorandom function.

2151 2152
- Issue #19131: The aifc module now correctly reads and writes sampwidth of
  compressed streams.
2153

2154 2155 2156 2157
- Issue #19209: Remove import of copyreg from the os module to speed up
  interpreter startup. stat_result and statvfs_result are now hard-coded to
  reside in the os module.

2158 2159 2160
- Issue #19205: Don't import the 're' module in site and sysconfig module to
  to speed up interpreter start.

2161 2162 2163
- Issue #9548: Add a minimal "_bootlocale" module that is imported by the
  _io module instead of the full locale module.

2164 2165 2166
- Issue #18764: remove the 'print' alias for the PDB 'p' command so that it no
  longer shadows the print function.

Tim Peters's avatar
Tim Peters committed
2167 2168
- Issue #19158:  a rare race in BoundedSemaphore could allow .release() too
  often.
2169

2170 2171
- Issue #15805: Add contextlib.redirect_stdout().

2172 2173
- Issue #18716: Deprecate the formatter module.

2174 2175 2176
- Issue #10712: 2to3 has a new "asserts" fixer that replaces deprecated names
  of unittest methods (e.g. failUnlessEqual -> assertEqual).

2177
- Issue #18037: 2to3 now escapes '\u' and '\U' in native strings.
2178

2179 2180 2181 2182
- Issue #17839: base64.decodebytes and base64.encodebytes now accept any
  object that exports a 1 dimensional array of bytes (this means the same
  is now also true for base64_codec)

2183 2184
- Issue #19132: The pprint module now supports compact mode.

2185 2186
- Issue #19137: The pprint module now correctly formats instances of set and
  frozenset subclasses.
2187

2188 2189 2190 2191
- Issue #10042: functools.total_ordering now correctly handles
  NotImplemented being returned by the underlying comparison function (Patch
  by Katie Miller)

Nick Coghlan's avatar
Nick Coghlan committed
2192 2193 2194
- Issue #19092: contextlib.ExitStack now correctly reraises exceptions
  from the __exit__ callbacks of inner context managers (Patch by Hrvoje
  Nikšić)
2195

2196 2197
- Issue #12641: Avoid passing "-mno-cygwin" to the mingw32 compiler, except
  when necessary.  Patch by Oscar Benjamin.
2198

2199 2200 2201 2202
- Issue #5845: In site.py, only load readline history from ~/.python_history
  if no history has been read already.  This avoids double writes to the
  history file at shutdown.

2203 2204
- Properly initialize all fields of a SSL object after allocation.

2205 2206 2207
- Issue #19095: SSLSocket.getpeercert() now raises ValueError when the
  SSL handshake hasn't been done.

2208 2209 2210
- Issue #4366: Fix building extensions on all platforms when --enable-shared
  is used.

2211 2212 2213 2214 2215
- Issue #19030: Fixed `inspect.getmembers` and `inspect.classify_class_attrs`
  to attempt activating descriptors before falling back to a __dict__ search
  for faulty descriptors.  `inspect.classify_class_attrs` no longer returns
  Attributes whose home class is None.

2216 2217 2218
C API
-----

2219 2220
- Issue #1772673: The type of `char*` arguments now changed to `const char*`.

2221 2222 2223 2224 2225
- Issue #16129: Added a `Py_SetStandardStreamEncoding` pre-initialization API
  to allow embedding applications like Blender to force a particular
  encoding and error handler for the standard IO streams (initial patch by
  Bastien Montagne)

2226 2227 2228
Tests
-----

2229 2230
- Issue #19275: Fix test_site on AMD64 Snow Leopard

2231 2232
- Issue #14407: Fix unittest test discovery in test_concurrent_futures.

2233 2234 2235
- Issue #18919: Unified and extended tests for audio modules: aifc, sunau and
  wave.

2236 2237
- Issue #18714: Added tests for ``pdb.find_function()``.

2238 2239 2240
Documentation
-------------

2241 2242
- Issue #18758: Fixed and improved cross-references.

2243 2244
- Issue #18972: Modernize email examples and use the argparse module in them.

2245 2246 2247 2248 2249
Build
-----

- Issue #19130: Correct PCbuild/readme.txt, Python 3.3 and 3.4 require VS 2010.

2250
- Issue #15663: Update OS X 10.6+ installer to use Tcl/Tk 8.5.15.
2251

2252 2253 2254 2255 2256 2257
- Issue #14499: Fix several problems with OS X universal build support:
    1. ppc arch detection for extension module builds broke with Xcode 5
    2. ppc arch detection in configure did not work on OS X 10.4
    3. -sysroot and -arch flags were unnecessarily duplicated
    4. there was no obvious way to configure an intel-32 only build.

2258 2259 2260 2261 2262
- Issue #19019: Change the OS X installer build script to use CFLAGS instead
  of OPT for special build options.  By setting OPT, some compiler-specific
  options like -fwrapv were overridden and thus not used, which could result
  in broken interpreters when building with clang.

Larry Hastings's avatar
Larry Hastings committed
2263 2264 2265 2266 2267
What's New in Python 3.4.0 Alpha 3?
===================================

Release date: 2013-09-29

2268 2269 2270
Core and Builtins
-----------------

2271 2272
- Issue #18818: The "encodingname" part of PYTHONIOENCODING is now optional.

2273
- Issue #19098: Prevent overflow in the compiler when the recursion limit is set
Benjamin Peterson's avatar
Benjamin Peterson committed
2274
  absurdly high.
2275

2276 2277 2278
Library
-------

Ethan Furman's avatar
Ethan Furman committed
2279 2280 2281
- Issue #18929: `inspect.classify_class_attrs()` now correctly finds class
  attributes returned by `dir()` that are located in the metaclass.

2282 2283 2284 2285 2286 2287 2288
- Issue #18950: Fix miscellaneous bugs in the sunau module.
  Au_read.readframes() now updates current file position and reads correct
  number of frames from multichannel stream.  Au_write.writeframesraw() now
  correctly updates current file position.  Au_read.getnframes() now returns an
  integer (as in Python 2).  Au_read and Au_write now correctly works with file
  object if start file position is not a zero.

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
2289 2290 2291
- Issue #18594: The fast path for collections.Counter() was never taken
  due to an over-restrictive type check.

2292 2293 2294
- Issue #19053: ZipExtFile.read1() with non-zero argument no more returns empty
  bytes until end of data.

2295 2296 2297
- logging: added support for Unix domain sockets to SocketHandler and
  DatagramHandler.

2298 2299 2300
- Issue #18996: TestCase.assertEqual() now more cleverly shorten differing
  strings in error report.

2301 2302
- Issue #19034: repr() for tkinter.Tcl_Obj now exposes string reperesentation.

Jason R. Coombs's avatar
Jason R. Coombs committed
2303 2304 2305
- Issue #18978: ``urllib.request.Request`` now allows the method to be
  indicated on the class and no longer sets it to None in ``__init__``.

2306 2307 2308
- Issue #18626: the inspect module now offers a basic command line
  introspection interface (Initial patch by Claudiu Popa)

2309 2310 2311
- Issue #3015: Fixed tkinter with wantobject=False.  Any Tcl command call
  returned empty string.

2312 2313 2314 2315
- Issue #19037: The mailbox module now makes all changes to maildir files
  before moving them into place, to avoid race conditions with other programs
  that may be accessing the maildir directory.

2316 2317 2318 2319 2320
- Issue #14984: On POSIX systems, when netrc is called without a filename
  argument (and therefore is reading the user's $HOME/.netrc file), it now
  enforces the same security rules as typical ftp clients: the .netrc file must
  be owned by the user that owns the process and must not be readable by any
  other user.
2321

2322 2323
- Issue #18873: The tokenize module now detects Python source code encoding
  only in comment lines.
2324

2325 2326 2327
- Issue #17764: Enable http.server to bind to a user specified network
  interface.  Patch contributed by Malte Swart.

2328 2329
- Issue #18937: Add an assertLogs() context manager to unittest.TestCase
  to ensure that a block of code emits a message using the logging module.
2330

2331 2332
- Issue #17324: Fix http.server's request handling case on trailing '/'. Patch
  contributed by Vajrasky Kok.
2333

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
2334 2335
- Issue #19018: The heapq.merge() function no longer suppresses IndexError
  in the underlying iterables.
2336

R David Murray's avatar
R David Murray committed
2337 2338 2339
- Issue #18784: The uuid module no longer attempts to load libc via ctypes.CDLL
  if all the necessary functions have already been found in libuuid.  Patch by
  Evgeny Sologubov.
2340

2341 2342 2343 2344
- The :envvar:`PYTHONFAULTHANDLER` environment variable now only enables the
  faulthandler module if the variable is non-empty. Same behaviour than other
  variables like :envvar:`PYTHONDONTWRITEBYTECODE`.

2345 2346 2347 2348
- Issue #1565525: New function ``traceback.clear_frames`` will clear
  the local variables of all the stack frames referenced by a traceback
  object.

Nick Coghlan's avatar
Nick Coghlan committed
2349 2350
Tests
-----
2351

Nick Coghlan's avatar
Nick Coghlan committed
2352 2353 2354
- Issue #18952: Fix regression in support data downloads introduced when
  test.support was converted to a package. Regression noticed by Zachary
  Ware.
2355

2356 2357
IDLE
----
2358

2359 2360
- Issue #18873: IDLE now detects Python source code encoding only in comment
  lines.
2361

2362
- Issue #18988: The "Tab" key now works when a word is already autocompleted.
2363

2364 2365 2366 2367 2368 2369
Documentation
-------------

- Issue #17003: Unified the size argument names in the io module with common
  practice.

2370 2371 2372 2373 2374 2375 2376
Build
-----

- Issue #18596: Support the use of address sanity checking in recent versions
  of clang and GCC by appropriately marking known false alarms in the small
  object allocator. Patch contributed by Dhiru Kholia.

2377 2378 2379 2380 2381 2382
Tools/Demos
-----------

- Issue #18873: 2to3 and the findnocoding.py script now detect Python source
  code encoding only in comment lines.

2383

2384 2385 2386
What's New in Python 3.4.0 Alpha 2?
===================================

2387
Release date: 2013-09-09
2388 2389 2390 2391

Core and Builtins
-----------------

2392 2393
- Issue #18942: sys._debugmallocstats() output was damaged on Windows.

2394 2395 2396 2397 2398
- Issue #18571: Implementation of the PEP 446: file descriptors and file
  handles are now created non-inheritable; add functions
  os.get/set_inheritable(), os.get/set_handle_inheritable() and
  socket.socket.get/set_inheritable().

2399 2400 2401
- Issue #11619: The parser and the import machinery do not encode Unicode
  filenames anymore on Windows.

2402 2403 2404
- Issue #18808: Non-daemon threads are now automatically joined when
  a sub-interpreter is shutdown (it would previously dump a fatal error).

R David Murray's avatar
R David Murray committed
2405
- Remove support for compiling on systems without getcwd().
2406

2407 2408
- Issue #18774: Remove last bits of GNU PTH thread code and thread_pth.h.

2409 2410 2411 2412
- Issue #18771: Add optimization to set object lookups to reduce the cost
  of hash collisions.  The core idea is to inspect a second key/hash pair
  for each cache line retrieved.

2413 2414 2415 2416
- Issue #16105: When a signal handler fails to write to the file descriptor
  registered with ``signal.set_wakeup_fd()``, report an exception instead
  of ignoring the error.

2417 2418
- Issue #18722: Remove uses of the "register" keyword in C code.

2419 2420
- Issue #18667: Add missing "HAVE_FCHOWNAT" symbol to posix._have_functions.

2421
- Issue #16499: Add command line option for isolated mode.
2422

2423 2424 2425
- Issue #15301: Parsing fd, uid, and gid parameters for builtins
  in Modules/posixmodule.c is now far more robust.

2426
- Issue #18368: PyOS_StdioReadline() no longer leaks memory when realloc()
2427
  fail.
2428

2429 2430 2431
- Issue #17934: Add a clear() method to frame objects, to help clean up
  expensive details (local variables) and break reference cycles.

2432 2433 2434
- Issue #18780: %-formatting codes %d, %i, and %u now treat int-subclasses
  as int (displays value of int-subclass instead of str(int-subclass) ).

2435 2436 2437
Library
-------

2438 2439 2440 2441
- Issue #18808: Thread.join() now waits for the underlying thread state to
  be destroyed before returning.  This prevents unpredictable aborts in
  Py_EndInterpreter() when some non-daemon threads are still running.

2442 2443 2444
- Issue #18458: Prevent crashes with newer versions of libedit.  Its readline
  emulation has changed from 0-based indexing to 1-based like gnu readline.

2445 2446 2447
- Issue #18852: Handle case of ``readline.__doc__`` being ``None`` in the new
  readline activation code in ``site.py``.

2448
- Issue #18672: Fixed format specifiers for Py_ssize_t in debugging output in
2449
  the _sre module.
2450

R David Murray's avatar
R David Murray committed
2451
- Issue #18830: inspect.getclasstree() no longer produces duplicate entries even
2452 2453
  when input list contains duplicates.

2454 2455 2456
- Issue #18878: sunau.open now supports the context manager protocol.  Based on
  patches by Claudiu Popa and R. David Murray.

2457 2458 2459
- Issue #18909: Fix _tkinter.tkapp.interpaddr() on Windows 64-bit, don't cast
  64-bit pointer to long (32 bits).

2460 2461
- Issue #18876: The FileIO.mode attribute now better reflects the actual mode
  under which the file was opened.  Patch by Erik Bray.
2462

2463 2464
- Issue #16853: Add new selectors module.

2465 2466
- Issue #18882: Add threading.main_thread() function.

2467 2468 2469
- Issue #18901: The sunau getparams method now returns a namedtuple rather than
  a plain tuple.  Patch by Claudiu Popa.

2470 2471 2472
- Issue #17487: The result of the wave getparams method now is pickleable again.
  Patch by Claudiu Popa.

2473 2474 2475 2476
- Issue #18756: os.urandom() now uses a lazily-opened persistent file
  descriptor, so as to avoid using many file descriptors when run in
  parallel from multiple threads.

2477 2478 2479
- Issue #18418: After fork(), reinit all threads states, not only active ones.
  Patch by A. Jesse Jiryu Davis.

2480 2481
- Issue #17974: Switch unittest from using getopt to using argparse.

2482 2483
- Issue #11798: TestSuite now drops references to own tests after execution.

2484 2485 2486
- Issue #16611: http.cookie now correctly parses the 'secure' and 'httponly'
  cookie flags.

2487 2488 2489
- Issue #11973: Fix a problem in kevent. The flags and fflags fields are now
  properly handled as unsigned.

2490 2491 2492
- Issue #18807: ``pyvenv`` now takes a --copies argument allowing copies
  instead of symlinks even where symlinks are available and the default.

2493 2494 2495
- Issue #18538: ``python -m dis`` now uses argparse for argument processing.
  Patch by Michele Orrù.

2496 2497
- Issue #18394: Close cgi.FieldStorage's optional file.

R David Murray's avatar
R David Murray committed
2498
- Issue #17702: On error, os.environb now suppresses the exception context
2499 2500
  when raising a new KeyError with the original key.

2501 2502
- Issue #16809: Fixed some tkinter incompabilities with Tcl/Tk 8.6.

2503 2504 2505
- Issue #16809: Tkinter's splitlist() and split() methods now accept Tcl_Obj
  argument.

2506 2507 2508
- Issue #18324: set_payload now correctly handles binary input.  This also
  supersedes the previous fixes for #14360, #1717, and #16564.

2509 2510 2511
- Issue #18794: Add a fileno() method and a closed attribute to select.devpoll
  objects.

2512 2513 2514
- Issue #17119: Fixed integer overflows when processing large strings and tuples
  in the tkinter module.

2515
- Issue #18747: Re-seed OpenSSL's pseudo-random number generator after fork.
2516
  A pthread_atfork() parent handler is used to seed the PRNG with pid, time
2517 2518
  and some stack data.

2519 2520 2521
- Issue #8865: Concurrent invocation of select.poll.poll() now raises a
  RuntimeError exception.  Patch by Christian Schubert.

2522 2523 2524
- Issue #18777: The ssl module now uses the new CRYPTO_THREADID API of
  OpenSSL 1.0.0+ instead of the deprecated CRYPTO id callback function.

Christian Heimes's avatar
Christian Heimes committed
2525
- Issue #18768: Correct doc string of RAND_edg(). Patch by Vajrasky Kok.
2526

2527 2528 2529
- Issue #18178: Fix ctypes on BSD. dlmalloc.c was compiled twice which broke
  malloc weak symbols.

2530 2531 2532 2533 2534 2535
- Issue #18709: Fix CVE-2013-4238. The SSL module now handles NULL bytes
  inside subjectAltName correctly. Formerly the module has used OpenSSL's
  GENERAL_NAME_print() function to get the string represention of ASN.1
  strings for ``rfc822Name`` (email), ``dNSName`` (DNS) and
  ``uniformResourceIdentifier`` (URI).

2536 2537
- Issue #18701: Remove support of old CPython versions (<3.0) from C code.

2538 2539 2540 2541
- Issue #18756: Improve error reporting in os.urandom() when the failure
  is due to something else than /dev/urandom not existing (for example,
  exhausting the file descriptor limit).

2542 2543 2544
- Issue #18673: Add O_TMPFILE to os module. O_TMPFILE requires Linux kernel
  3.11 or newer. It's only defined on system with 3.11 uapi headers, too.

2545 2546 2547
- Issue #18532: Change the builtin hash algorithms' names to lower case names
  as promised by hashlib's documentation.

2548 2549 2550 2551
- Issue #8713: add new spwan and forkserver start methods, and new functions
  get_all_start_methods, get_start_method, and set_start_method, to
  multiprocessing.

2552 2553
- Issue #18405: Improve the entropy of crypt.mksalt().

2554 2555 2556 2557 2558
- Issue #12015: The tempfile module now uses a suffix of 8 random characters
  instead of 6, to reduce the risk of filename collision. The entropy was
  reduced when uppercase letters were removed from the charset used to generate
  random characters.

2559 2560 2561
- Issue #18585: Add :func:`textwrap.shorten` to collapse and truncate a
  piece of text to a given length.

2562 2563 2564
- Issue #18598: Tweak exception message for importlib.import_module() to
  include the module name when a key argument is missing.

Eric Snow's avatar
Eric Snow committed
2565
- Issue #19151: Fix docstring and use of _get_supported_file_loaders() to
2566 2567
  reflect 2-tuples.

2568 2569
- Issue #19152: Add ExtensionFileLoader.get_filename().

2570 2571 2572
- Issue #18676: Change 'positive' to 'non-negative' in queue.py put and get
  docstrings and ValueError messages. Patch by Zhongyue Luo

2573 2574
- Fix refcounting issue with extension types in tkinter.

2575 2576 2577
- Issue #8112: xlmrpc.server's DocXMLRPCServer server no longer raises an error
  if methods have annotations; it now correctly displays the annotations.

2578 2579 2580
- Issue #18600: Added policy argument to email.message.Message.as_string,
  and as_bytes and __bytes__ methods to Message.

2581 2582
- Issue #18671: Output more information when logging exceptions occur.

2583 2584 2585
- Issue #18621: Prevent the site module's patched builtins from keeping
  too many references alive for too long.

2586 2587 2588 2589
- Issue #4885: Add weakref support to mmap objects.  Patch by Valerie Lambert.

- Issue #8860: Fixed rounding in timedelta constructor.

2590 2591 2592
- Issue #18849: Fixed a Windows-specific tempfile bug where collision with an
  existing directory caused mkstemp and related APIs to fail instead of
  retrying. Report and fix by Vlad Shcherbina.
2593

2594 2595 2596
- Issue #18920: argparse's default destination for the version action (-v,
  --version) has also been changed to stdout, to match the Python executable.

2597 2598 2599
Tests
-----

2600 2601 2602
- Issue #18623: Factor out the _SuppressCoreFiles context manager into
  test.support.  Patch by Valerie Lambert.

2603 2604
- Issue #12037: Fix test_email for desktop Windows.

2605 2606 2607 2608 2609
- Issue #15507: test_subprocess's test_send_signal could fail if the test
  runner were run in an environment where the process inherited an ignore
  setting for SIGINT.  Restore the SIGINT handler to the desired
  KeyboardInterrupt raising one during that test.

2610 2611 2612
- Issue #16799: Switched from getopt to argparse style in regrtest's argument
  parsing.  Added more tests for regrtest's argument parsing.

2613 2614 2615 2616
- Issue #18792: Use "127.0.0.1" or "::1" instead of "localhost" as much as
  possible, since "localhost" goes through a DNS lookup under recent Windows
  versions.

2617 2618 2619 2620 2621
IDLE
----

- Issue #18489: Add tests for SearchEngine. Original patch by Phil Webster.

2622 2623 2624
Documentation
-------------

2625 2626
- Issue #18743: Fix references to non-existant "StringIO" module.

2627 2628 2629
- Issue #18783: Removed existing mentions of Python long type in docstrings,
  error messages and comments.

2630 2631 2632 2633 2634 2635
Build
-----

- Issue #1584: Provide configure options to override default search paths for
  Tcl and Tk when building _tkinter.

2636 2637 2638 2639 2640
- Issue #15663: Tcl/Tk 8.5.14 is now included with the OS X 10.6+ 64-/32-bit
  installer.  It is no longer necessary to install a third-party version of
  Tcl/Tk 8.5 to work around the problems in the Apple-supplied Tcl/Tk 8.5
  shipped in OS X 10.6 and later releases.

2641 2642 2643 2644 2645 2646
Tools/Demos
-----------

- Issue #18922: Now The Lib/smtpd.py and Tools/i18n/msgfmt.py scripts write
  their version strings to stdout, and not to sderr.

2647 2648
What's New in Python 3.4.0 Alpha 1?
===================================
2649

Larry Hastings's avatar
Larry Hastings committed
2650
Release date: 2013-08-03
2651 2652 2653 2654

Core and Builtins
-----------------

2655 2656
- Issue #16741: Fix an error reporting in int().

2657 2658
- Issue #17899: Fix rare file descriptor leak in os.listdir().

2659 2660 2661
- Issue #10241: Clear extension module dict copies at interpreter shutdown.
  Patch by Neil Schemenauer, minimally modified.

2662 2663 2664
- Issue #9035: ismount now recognises volumes mounted below a drive root
  on Windows. Original patch by Atsuo Ishimoto.

2665 2666 2667
- Issue #18214: Improve finalization of Python modules to avoid setting
  their globals to None, in most cases.

2668 2669
- Issue #18112: PEP 442 implementation (safe object finalization).

2670 2671 2672
- Issue #18552: Check return value of PyArena_AddPyObject() in
  obj2ast_object().

2673 2674
- Issue #18560: Fix potential NULL pointer dereference in sum().

2675 2676 2677 2678
- Issue #18520: Add a new PyStructSequence_InitType2() function, same than
  PyStructSequence_InitType() except that it has a return value (0 on success,
  -1 on error).

2679 2680 2681
- Issue #15905: Fix theoretical buffer overflow in handling of sys.argv[0],
  prefix and exec_prefix if the operation system does not obey MAXPATHLEN.

2682 2683 2684
- Issue #18408: Fix many various bugs in code handling errors, especially
  on memory allocation failure (MemoryError).

2685 2686
- Issue #18344: Fix potential ref-leaks in _bufferedreader_read_all().

2687 2688 2689
- Issue #18342: Use the repr of a module name when an import fails when using
  ``from ... import ...``.

2690 2691 2692
- Issue #17872: Fix a segfault in marshal.load() when input stream returns
  more bytes than requested.

2693 2694 2695
- Issue #18338: `python --version` now prints version string to stdout, and
  not to stderr.  Patch by Berker Peksag and Michael Dickens.

2696 2697 2698
- Issue #18426: Fix NULL pointer dereference in C extension import when
  PyModule_GetDef() returns an error.

2699 2700 2701 2702
- Issue #17206: On Windows, increase the stack size from 2 MB to 4.2 MB to fix
  a stack overflow in the marshal module (fix a crash in test_marshal).
  Patch written by Jeremy Kloth.

2703 2704 2705
- Issue #3329: Implement the PEP 445: Add new APIs to customize Python memory
  allocators.

2706 2707 2708
- Issue #18328: Reorder ops in PyThreadState_Delete*() functions. Now the
  tstate is first removed from TLS and then deallocated.

2709 2710
- Issue #13483: Use VirtualAlloc in obmalloc on Windows.

2711 2712 2713
- Issue #18184: PyUnicode_FromFormat() and PyUnicode_FromFormatV() now raise
  OverflowError when an argument of %c format is out of range.

2714 2715 2716 2717
- Issue #18111: The min() and max() functions now support a default argument
  to be returned instead of raising a ValueError on an empty sequence.
  (Contributed by Julian Berman.)

2718 2719 2720
- Issue #18137: Detect integer overflow on precision in float.__format__()
  and complex.__format__().

2721 2722 2723
- Issue #18183: Fix various unicode operations on strings with large unicode
  codepoints.

2724 2725
- Issue #18180: Fix ref leak in _PyImport_GetDynLoadWindows().

2726 2727 2728
- Issue #18038: SyntaxError raised during compilation sources with illegal
  encoding now always contains an encoding name.

2729 2730
- Issue #17931: Resolve confusion on Windows between pids and process
  handles.
2731

2732 2733 2734
- Tweak the exception message when the magic number or size value in a bytecode
  file is truncated.

2735 2736 2737
- Issue #17932: Fix an integer overflow issue on Windows 64-bit in iterators:
  change the C type of seqiterobject.it_index from long to Py_ssize_t.

2738 2739 2740 2741 2742 2743
- Issue #18065: Don't set __path__ to the package name for frozen packages.

- Issue #18088: When reloading a module, unconditionally reset all relevant
  attributes on the module (e.g. __name__, __loader__, __package__, __file__,
  __cached__).

2744 2745
- Issue #17937: Try harder to collect cyclic garbage at shutdown.

2746 2747 2748
- Issue #12370: Prevent class bodies from interfering with the __class__
  closure.

2749 2750 2751
- Issue #17644: Fix a crash in str.format when curly braces are used in square
  brackets.

2752 2753
- Issue #17237: Fix crash in the ASCII decoder on m68k.

2754 2755 2756
- Issue #17927: Frame objects kept arguments alive if they had been
  copied into a cell, even if the cell was cleared.

2757 2758 2759
- Issue #1545463: At shutdown, defer finalization of codec modules so
  that stderr remains usable.

2760 2761 2762
- Issue #7330: Implement width and precision (ex: "%5.3s") for the format
  string of PyUnicode_FromFormat() function, original patch written by Ysj Ray.

2763 2764 2765
- Issue #1545463: Global variables caught in reference cycles are now
  garbage-collected at shutdown.

2766 2767 2768 2769 2770
- Issue #17094: Clear stale thread states after fork().  Note that this
  is a potentially disruptive change since it may release some system
  resources which would otherwise remain perpetually alive (e.g. database
  connections kept in thread-local storage).

2771 2772 2773
- Issue #17408: Avoid using an obsolete instance of the copyreg module when
  the interpreter is shutdown and then started again.

2774 2775 2776
- Issue #5845: Enable tab-completion in the interactive interpreter by
  default, thanks to a new sys.__interactivehook__.

2777 2778 2779
- Issue #17115,17116: Module initialization now includes setting __package__ and
  __loader__ attributes to None.

2780 2781 2782
- Issue #17853: Ensure locals of a class that shadow free variables always win
  over the closures.

2783 2784 2785
- Issue #17863: In the interactive console, don't loop forever if the encoding
  can't be fetched from stdin.

2786 2787
- Issue #17867: Raise an ImportError if __import__ is not found in __builtins__.

2788 2789
- Issue #18698: Ensure importlib.reload() returns the module out of sys.modules.

2790 2791 2792
- Issue #17857: Prevent build failures with pre-3.5.0 versions of sqlite3,
  such as was shipped with Centos 5 and Mac OS X 10.4.

2793 2794 2795 2796
- Issue #17413: sys.settrace callbacks were being passed a string instead of an
  exception instance for the 'value' element of the arg tuple if the exception
  originated from C code; now an exception instance is always provided.

2797 2798 2799
- Issue #17782: Fix undefined behaviour on platforms where
  ``struct timespec``'s "tv_nsec" member is not a C long.

2800 2801
- Issue #17722: When looking up __round__, resolve descriptors.

2802 2803
- Issue #16061: Speed up str.replace() for replacing 1-character strings.

2804 2805 2806
- Issue #17715: Fix segmentation fault from raising an exception in a __trunc__
  method.

2807 2808
- Issue #17643: Add __callback__ attribute to weakref.ref.

2809 2810 2811
- Issue #16447: Fixed potential segmentation fault when setting __name__ on a
  class.

2812 2813
- Issue #17669: Fix crash involving finalization of generators using yield from.

2814 2815
- Issue #14439: Python now prints the traceback on runpy failure at startup.

2816 2817 2818
- Issue #17469: Fix _Py_GetAllocatedBlocks() and sys.getallocatedblocks()
  when running on valgrind.

2819 2820
- Issue #17619: Make input() check for Ctrl-C correctly on Windows.

Brett Cannon's avatar
merge  
Brett Cannon committed
2821 2822
- Issue #17357: Add missing verbosity messages for -v/-vv that were lost during
  the importlib transition.
2823

2824 2825
- Issue #17610: Don't rely on non-standard behavior of the C qsort() function.

2826 2827 2828
- Issue #17323: The "[X refs, Y blocks]" printed by debug builds has been
  disabled by default.  It can be re-enabled with the `-X showrefcount` option.

2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876
- Issue #17328: Fix possible refleak in dict.setdefault.

- Issue #17275: Corrected class name in init error messages of the C version of
  BufferedWriter and BufferedRandom.

- Issue #7963: Fixed misleading error message that issued when object is
  called without arguments.

- Issue #8745: Small speed up zipimport on Windows. Patch by Catalin Iacob.

- Issue #5308: Raise ValueError when marshalling too large object (a sequence
  with size >= 2**31), instead of producing illegal marshal data.

- Issue #12983: Bytes literals with invalid \x escape now raise a SyntaxError
  and a full traceback including line number.

- Issue #16967: In function definition, evaluate positional defaults before
  keyword-only defaults.

- Issue #17173: Remove uses of locale-dependent C functions (isalpha() etc.)
  in the interpreter.

- Issue #17137: When an Unicode string is resized, the internal wide character
  string (wstr) format is now cleared.

- Issue #17043: The unicode-internal decoder no longer read past the end of
  input buffer.

- Issue #17098: All modules now have __loader__ set even if they pre-exist the
  bootstrapping of importlib.

- Issue #16979: Fix error handling bugs in the unicode-escape-decode decoder.

- Issue #16772: The base argument to the int constructor no longer accepts
  floats, or other non-integer objects with an __int__ method.  Objects
  with an __index__ method are now accepted.

- Issue #10156: In the interpreter's initialization phase, unicode globals
  are now initialized dynamically as needed.

- Issue #16980: Fix processing of escaped non-ascii bytes in the
  unicode-escape-decode decoder.

- Issue #16975: Fix error handling bug in the escape-decode bytes decoder.

- Issue #14850: Now a charmap decoder treats U+FFFE as "undefined mapping"
  in any mapping, not only in a string.

2877 2878 2879
- Issue #16613: Add *m* argument to ``collections.Chainmap.new_child`` to
  allow the new child map to be specified explicitly.

2880 2881 2882 2883 2884 2885 2886 2887 2888 2889 2890 2891 2892 2893 2894 2895 2896 2897 2898 2899 2900 2901 2902 2903 2904 2905 2906 2907 2908 2909 2910 2911 2912 2913 2914 2915 2916 2917 2918 2919 2920 2921 2922 2923 2924 2925 2926 2927 2928 2929 2930 2931 2932 2933 2934 2935 2936 2937
- Issue #16730: importlib.machinery.FileFinder now no longers raises an
  exception when trying to populate its cache and it finds out the directory is
  unreadable or has turned into a file. Reported and diagnosed by
  David Pritchard.

- Issue #16906: Fix a logic error that prevented most static strings from being
  cleared.

- Issue #11461: Fix the incremental UTF-16 decoder. Original patch by
  Amaury Forgeot d'Arc.

- Issue #16856: Fix a segmentation fault from calling repr() on a dict with
  a key whose repr raise an exception.

- Issue #16367: Fix FileIO.readall() on Windows for files larger than 2 GB.

- Issue #16761: Calling int() with base argument only now raises TypeError.

- Issue #16759: Support the full DWORD (unsigned long) range in Reg2Py
  when retrieving a REG_DWORD value. This corrects functions like
  winreg.QueryValueEx that may have been returning truncated values.

- Issue #14420: Support the full DWORD (unsigned long) range in Py2Reg
  when passed a REG_DWORD value. Fixes OverflowError in winreg.SetValueEx.

- Issue #11939: Set the st_dev attribute of stat_result to allow Windows to
  take advantage of the os.path.samefile/sameopenfile/samestat implementations
  used by other platforms.

- Issue #16772: The int() constructor's second argument (base) no longer
  accepts non integer values.  Consistent with the behavior in Python 2.

- Issue #14470: Remove w9xpopen support per PEP 11.

- Issue #9856: Replace deprecation warning with raising TypeError
  in object.__format__. Patch by Florent Xicluna.

- Issue #16597: In buffered and text IO, call close() on the underlying stream
  if invoking flush() fails.

- Issue #16722: In the bytes() constructor, try to call __bytes__ on the
  argument before __index__.

- Issue #16421: loading multiple modules from one shared object is now
  handled correctly (previously, the first module loaded from that file
  was silently returned). Patch by Václav Šmilauer.

- Issue #16602: When a weakref's target was part of a long deallocation
  chain, the object could remain reachable through its weakref even though
  its refcount had dropped to zero.

- Issue #16495: Remove extraneous NULL encoding check from bytes_decode().

- Issue #16619: Create NameConstant AST class to represent None, True, and False
  literals. As a result, these constants are never loaded at runtime from
  builtins.

- Issue #16455: On FreeBSD and Solaris, if the locale is C, the
2938
  ASCII/surrogateescape codec is now used (instead of the locale encoding) to
2939
  decode the command line arguments. This change fixes inconsistencies with
2940 2941
  os.fsencode() and os.fsdecode(), because these operating systems announce an
  ASCII locale encoding, but actually use the ISO-8859-1 encoding in practice.
2942 2943 2944 2945 2946 2947 2948 2949 2950 2951 2952 2953 2954 2955 2956 2957 2958 2959 2960 2961 2962 2963 2964 2965 2966 2967 2968 2969 2970 2971 2972 2973 2974 2975 2976 2977 2978 2979 2980 2981 2982 2983 2984 2985 2986 2987 2988 2989 2990 2991 2992 2993 2994 2995 2996 2997 2998 2999 3000 3001 3002 3003 3004 3005 3006 3007 3008 3009 3010 3011 3012 3013 3014 3015 3016 3017 3018 3019 3020 3021 3022 3023 3024 3025 3026 3027 3028 3029 3030 3031

- Issue #16562: Optimize dict equality testing.  Patch by Serhiy Storchaka.

- Issue #16588: Silence unused-but-set warnings in Python/thread_pthread

- Issue #16592: stringlib_bytes_join doesn't raise MemoryError on allocation
  failure.

- Issue #16546: Fix: ast.YieldFrom argument is now mandatory.

- Issue #16514: Fix regression causing a traceback when sys.path[0] is None
  (actually, any non-string or non-bytes type).

- Issue #16306: Fix multiple error messages when unknown command line
  parameters where passed to the interpreter.  Patch by Hieu Nguyen.

- Issue #16215: Fix potential double memory free in str.replace().  Patch
  by Serhiy Storchaka.

- Issue #16290: A float return value from the __complex__ special method is no
  longer accepted in the complex() constructor.

- Issue #16416: On Mac OS X, operating system data are now always
  encoded/decoded to/from UTF-8/surrogateescape, instead of the locale encoding
  (which may be ASCII if no locale environment variable is set), to avoid
  inconsistencies with os.fsencode() and os.fsdecode() functions which are
  already using UTF-8/surrogateescape.

- Issue #16453: Fix equality testing of dead weakref objects.

- Issue #9535: Fix pending signals that have been received but not yet
  handled by Python to not persist after os.fork() in the child process.

- Issue #14794: Fix slice.indices to return correct results for huge values,
  rather than raising OverflowError.

- Issue #15001: fix segfault on "del sys.modules['__main__']". Patch by Victor
  Stinner.

- Issue #8271: the utf-8 decoder now outputs the correct number of U+FFFD
  characters when used with the 'replace' error handler on invalid utf-8
  sequences.  Patch by Serhiy Storchaka, tests by Ezio Melotti.

- Issue #5765: Apply a hard recursion limit in the compiler instead of
  blowing the stack and segfaulting. Initial patch by Andrea Griffini.

- Issue #16402: When slicing a range, fix shadowing of exceptions from
  __index__.

- Issue #16336: fix input checking in the surrogatepass error handler.
  Patch by Serhiy Storchaka.

- Issue #8401: assigning an int to a bytearray slice (e.g. b[3:4] = 5) now
  raises an error.

- Issue #7317: Display full tracebacks when an error occurs asynchronously.
  Patch by Alon Horev with update by Alexey Kachayev.

- Issue #16309: Make PYTHONPATH="" behavior the same as if PYTHONPATH
  not set at all.

- Issue #10189: Improve the error reporting of SyntaxErrors related to global
  and nonlocal statements.

- Fix segfaults on setting __qualname__ on builtin types and attempting to
  delete it on any type.

- Issue #14625: Rewrite the UTF-32 decoder. It is now 3x to 4x faster. Patch
  written by Serhiy Storchaka.

- Issue #16345: Fix an infinite loop when ``fromkeys`` on a dict subclass
  received a nonempty dict from the constructor.

- Issue #16271: Fix strange bugs that resulted from __qualname__ appearing in a
  class's __dict__ and on type.

- Issue #12805: Make bytes.join and bytearray.join faster when the separator
  is empty.  Patch by Serhiy Storchaka.

- Issue #6074: Ensure cached bytecode files can always be updated by the
  user that created them, even when the source file is read-only.

- Issue #15958: bytes.join and bytearray.join now accept arbitrary buffer
  objects.

- Issue #14783: Improve int() docstring and switch docstrings for str(),
  range(), and slice() to use multi-line signatures.

- Issue #16160: Subclass support now works for types.SimpleNamespace.

3032 3033 3034
- Issue #16148: Implement PEP 424, adding operator.length_hint and
  PyObject_LengthHint.

3035 3036 3037 3038 3039 3040 3041 3042 3043 3044 3045 3046 3047 3048 3049 3050 3051 3052 3053 3054 3055 3056 3057 3058 3059 3060 3061 3062 3063 3064 3065
- Upgrade Unicode data (UCD) to version 6.2.

- Issue #15379: Fix passing of non-BMP characters as integers for the charmap
  decoder (already working as unicode strings).  Patch by Serhiy Storchaka.

- Issue #15144: Fix possible integer overflow when handling pointers as integer
  values, by using `Py_uintptr_t` instead of `size_t`.  Patch by Serhiy
  Storchaka.

- Issue #15965: Explicitly cast `AT_FDCWD` as (int).  Required on Solaris 10
  (which defines `AT_FDCWD` as ``0xffd19553``), harmless on other platforms.

- Issue #15839: Convert SystemErrors in `super()` to RuntimeErrors.

- Issue #15448: Buffered IO now frees the buffer when closed, instead
  of when deallocating.

- Issue #15846: Fix SystemError which happened when using `ast.parse()` in an
  exception handler on code with syntax errors.

- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.

- Issue #15801: Make sure mappings passed to '%' formatting are actually
  subscriptable.

- Issue #15111: __import__ should propagate ImportError when raised as a
  side-effect of a module triggered from using fromlist.

- Issue #15022: Add pickle and comparison support to types.SimpleNamespace.

3066 3067
Library
-------
Terry Jan Reedy's avatar
Terry Jan Reedy committed
3068

3069 3070
- Issue #4331: Added functools.partialmethod (Initial patch by Alon Horev)

3071 3072 3073
- Issue #13461: Fix a crash in the TextIOWrapper.tell method on 64-bit
  platforms.  Patch by Yogesh Chaudhari.

Ezio Melotti's avatar
Ezio Melotti committed
3074
- Issue #18681: Fix a NameError in importlib.reload() (noticed by Weizhao Li).
3075

3076 3077 3078
- Issue #14323: Expanded the number of digits in the coefficients for the
  RGB -- YIQ conversions so that they match the FCC NTSC versions.

3079 3080
- Issue #17998: Fix an internal error in regular expression engine.

3081 3082 3083
- Issue #17557: Fix os.getgroups() to work with the modified behavior of
  getgroups(2) on OS X 10.8.  Original patch by Mateusz Lenik.

3084 3085 3086
- Issue #18608: Avoid keeping a strong reference to the locale module
  inside the _io module.

3087 3088 3089
- Issue #18619: Fix atexit leaking callbacks registered from sub-interpreters,
  and make it GC-aware.

3090 3091 3092 3093
- Issue #15699: The readline module now uses PEP 3121-style module
  initialization, so as to reclaim allocated resources (Python callbacks)
  at shutdown.  Original patch by Robin Schreiber.

3094 3095
- Issue #17616: wave.open now supports the context manager protocol.

3096 3097 3098
- Issue #18599: Fix name attribute of _sha1.sha1() object. It now returns
  'SHA1' instead of 'SHA'.

3099 3100 3101
- Issue #13266: Added inspect.unwrap to easily unravel __wrapped__ chains
  (initial patch by Daniel Urban and Aaron Iles)

3102 3103
- Issue #18561: Skip name in ctypes' _build_callargs() if name is NULL.

3104 3105
- Issue #18559: Fix NULL pointer dereference error in _pickle module

Brett Cannon's avatar
Brett Cannon committed
3106 3107 3108
- Issue #18556: Check the return type of PyUnicode_AsWideChar() in ctype's
  U_set().

3109 3110
- Issue #17818: aifc.getparams now returns a namedtuple.

3111 3112
- Issue #18549: Eliminate dead code in socket_ntohl()

3113 3114 3115
- Issue #18530: Remove additional stat call from posixpath.ismount.
  Patch by Alex Gaynor.

3116 3117
- Issue #18514: Fix unreachable Py_DECREF() call in PyCData_FromBaseObj()

3118 3119 3120
- Issue #9177: Calling read() or write() now raises ValueError, not
  AttributeError, on a closed SSL socket.  Patch by Senko Rasic.

3121 3122 3123
- Issue #18513: Fix behaviour of cmath.rect w.r.t. signed zeros on OS X 10.8 +
  gcc.

3124 3125 3126
- Issue #18479: Changed venv Activate.ps1 to make deactivate a function, and
  removed Deactivate.ps1.

3127 3128
- Issue #18480: Add missing call to PyType_Ready to the _elementtree extension.

3129 3130 3131
- Issue #17778: Fix test discovery for test_multiprocessing. (Patch by
  Zachary Ware.)

3132 3133 3134 3135
- Issue #18393: The private module _gestalt and private functions
  platform._mac_ver_gestalt, platform._mac_ver_lookup and
  platform._bcd2str have been removed. This does not affect the public
  interface of the platform module.
3136

3137 3138 3139 3140
- Issue #17482: functools.update_wrapper (and functools.wraps) now set the
  __wrapped__ attribute correctly even if the underlying function has a
  __wrapped__ attribute set.

3141 3142 3143
- Issue #18431: The new email header parser now decodes RFC2047 encoded words
  in structured headers.

3144 3145 3146
- Issue #18432: The sched module's queue method was incorrectly returning
  an iterator instead of a list.

3147 3148 3149 3150
- Issue #18044: The new email header parser was mis-parsing encoded words where
  an encoded character immediately followed the '?' that follows the CTE
  character, resulting in a decoding failure.  They are now decoded correctly.

3151 3152 3153
- Issue #18101: Tcl.split() now process strings nested in a tuple as it
  do with byte strings.

3154
- Issue #18116: getpass was always getting an error when testing /dev/tty,
3155 3156 3157
  and thus was always falling back to stdin, and would then raise an exception
  if stdin could not be used (such as /dev/null).  It also leaked an open file.
  All of these issues are now fixed.
3158

3159 3160 3161
- Issue #17198: Fix a NameError in the dbm module.  Patch by Valentina
  Mukhamedzhanova.

3162 3163
- Issue #18013: Fix cgi.FieldStorage to parse the W3C sample form.

3164 3165 3166
- Issue #18020: improve html.escape speed by an order of magnitude.
  Patch by Matt Bryant.

3167 3168 3169
- Issue #18347: ElementTree's html serializer now preserves the case of
  closing tags.

3170 3171
- Issue #17261: Ensure multiprocessing's proxies use proper address.

3172 3173 3174 3175
- Issue #18343: faulthandler.register() now keeps the previous signal handler
  when the function is called twice, so faulthandler.unregister() restores
  correctly the original signal handler.

3176 3177
- Issue #17097: Make multiprocessing ignore EINTR.

3178 3179 3180
- Issue #18339: Negative ints keys in unpickler.memo dict no longer cause a
  segfault inside the _pickle C extension.

3181
- Issue #18240: The HMAC module is no longer restricted to bytes and accepts
3182 3183
  any bytes-like object, e.g. memoryview. Original patch by Jonas Borgström.

3184 3185
- Issue #18224: Removed pydoc script from created venv, as it causes problems
  on Windows and adds no value over and above python -m pydoc ...
3186

3187 3188 3189
- Issue #18155: The csv module now correctly handles csv files that use
  a delimter character that has a special meaning in regexes, instead of
  throwing an exception.
3190

3191 3192
- Issue #14360: encode_quopri can now be successfully used as an encoder
  when constructing a MIMEApplication object.
3193

3194 3195 3196
- Issue #11390: Add -o and -f command line options to the doctest CLI to
  specify doctest options (and convert it to using argparse).

3197 3198 3199 3200
- Issue #18135: ssl.SSLSocket.write() now raises an OverflowError if the input
  string in longer than 2 gigabytes, and ssl.SSLContext.load_cert_chain()
  raises a ValueError if the password is longer than 2 gigabytes. The ssl
  module does not support partial write.
3201

3202 3203
- Issue #11016: Add C implementation of the stat module as _stat.

Benjamin Peterson's avatar
Benjamin Peterson committed
3204
- Issue #18248: Fix libffi build on AIX.
3205

3206
- Issue #18259: Declare sethostname in socketmodule.c for AIX
3207

3208 3209 3210 3211
- Issue #18147: Add diagnostic functions to ssl.SSLContext(). get_ca_list()
  lists all loaded CA certificates and cert_store_stats() returns amount of
  loaded X.509 certs, X.509 CA certs and CRLs.

3212
- Issue #18167: cgi.FieldStorage no longer fails to handle multipart/form-data
3213
  when \r\n appears at end of 65535 bytes without other newlines.
3214

3215
- Issue #18076: Introduce importlib.util.decode_source().
3216 3217
- Issue #18357: add tests for dictview set difference.
  Patch by Fraser Tweedale.
3218

3219 3220 3221
- importlib.abc.SourceLoader.get_source() no longer changes SyntaxError or
  UnicodeDecodeError into ImportError.

3222 3223 3224 3225
- Issue #18058, 18057: Make the namespace package loader meet the
  importlib.abc.InspectLoader ABC, allowing for namespace packages to work with
  runpy.

3226 3227
- Issue #17177: The imp module is pending deprecation.

3228 3229 3230
- subprocess: Prevent a possible double close of parent pipe fds when the
  subprocess exec runs into an error.  Prevent a regular multi-close of the
  /dev/null fd when any of stdin, stdout and stderr was set to DEVNULL.
3231

3232 3233 3234 3235
- Issue #18194: Introduce importlib.util.cache_from_source() and
  source_from_cache() while documenting the equivalent functions in imp as
  deprecated.

3236 3237 3238
- Issue #17907: Document imp.new_module() as deprecated in favour of
  types.ModuleType.

3239 3240 3241
- Issue #18192: Introduce importlib.util.MAGIC_NUMBER and document as deprecated
  imp.get_magic().

3242 3243 3244
- Issue #18149: Add filecmp.clear_cache() to manually clear the filecmp cache.
  Patch by Mark Levitt

3245 3246
- Issue #18193: Add importlib.reload().

3247 3248
- Issue #18157: Stop using imp.load_module() in pydoc.

3249
- Issue #16102: Make uuid._netbios_getnode() work again on Python 3.
3250

3251 3252
- Issue #17134: Add ssl.enum_cert_store() as interface to Windows' cert store.

3253 3254 3255
- Issue #18143: Implement ssl.get_default_verify_paths() in order to debug
  the default locations for cafile and capath.

3256 3257
- Issue #17314: Move multiprocessing.forking over to importlib.

3258 3259 3260
- Issue #11959: SMTPServer and SMTPChannel now take an optional map, use of
  which avoids affecting global state.

3261 3262 3263
- Issue #18109: os.uname() now decodes fields from the locale encoding, and
  socket.gethostname() now decodes the hostname from the locale encoding,
  instead of using the UTF-8 encoding in strict mode.
3264

3265 3266 3267 3268 3269 3270
- Issue #18089: Implement importlib.abc.InspectLoader.load_module.

- Issue #18088: Introduce importlib.abc.Loader.init_module_attrs for setting
  module attributes. Leads to the pending deprecation of
  importlib.util.module_for_loader.

Senthil Kumaran's avatar
Senthil Kumaran committed
3271 3272 3273
- Issue #17403: urllib.parse.robotparser normalizes the urls before adding to
  ruleline. This helps in handling certain types invalid urls in a conservative
  manner. Patch contributed by Mher Movsisyan.
3274

3275 3276 3277
- Issue #18070: Have importlib.util.module_for_loader() set attributes
  unconditionally in order to properly support reloading.

3278
- Added importlib.util.module_to_load to return a context manager to provide the
3279
  proper module object to load.
3280

3281 3282
- Issue #18025: Fixed a segfault in io.BufferedIOBase.readinto() when raw
  stream's read() returns more bytes than requested.
3283

3284 3285 3286
- Issue #18011: As was originally intended, base64.b32decode() now raises a
  binascii.Error if there are non-b32-alphabet characters present in the input
  string, instead of a TypeError.
3287

Brett Cannon's avatar
Brett Cannon committed
3288 3289 3290
- Issue #18072: Implement importlib.abc.InspectLoader.get_code() and
  importlib.abc.ExecutionLoader.get_code().

3291 3292 3293
- Issue #8240: Set the SSL_MODE_ACCEPT_MOVING_WRITE_BUFFER flag on SSL
  sockets.

3294 3295 3296
- Issue #17269: Workaround for socket.getaddrinfo crash on MacOS X
  with port None or "0" and flags AI_NUMERICSERV.

3297 3298
- Issue #16986: ElementTree now correctly works with string input when the
  internal XML encoding is not UTF-8 or US-ASCII.
3299

3300 3301
- Issue #17996: socket module now exposes AF_LINK constant on BSD and OSX.

3302 3303 3304
- Issue #17900: Allowed pickling of recursive OrderedDicts.  Decreased pickled
  size and pickling time.

3305 3306 3307
- Issue #17914: Add os.cpu_count(). Patch by Yogesh Chaudhari, based on an
  initial patch by Trent Nelson.

3308 3309 3310
- Issue #17812: Fixed quadratic complexity of base64.b32encode().
  Optimize base64.b32encode() and base64.b32decode() (speed up to 3x).

3311 3312 3313
- Issue #17980: Fix possible abuse of ssl.match_hostname() for denial of
  service using certificates with many wildcards (CVE-2013-2099).

3314 3315
- Issue #15758: Fix FileIO.readall() so it no longer has O(n**2) complexity.

3316 3317
- Issue #14596: The struct.Struct() objects now use a more compact
  implementation.
3318

3319 3320
- Issue #17981: logging's SysLogHandler now closes the socket when it catches
  socket OSErrors.
3321

3322 3323 3324
- Issue #17964: Fix os.sysconf(): the return type of the C sysconf() function
  is long, not int.

3325 3326
- Fix typos in the multiprocessing module.

3327 3328
- Issue #17754: Make ctypes.util.find_library() independent of the locale.

3329 3330
- Issue #17968: Fix memory leak in os.listxattr().

3331
- Issue #17606: Fixed support of encoded byte strings in the XMLGenerator
3332
  characters() and ignorableWhitespace() methods.  Original patch by Sebastian
3333 3334
  Ortiz Vasquez.

3335 3336 3337
- Issue #17732: Ignore distutils.cfg options pertaining to install paths if a
  virtual environment is active.

Georg Brandl's avatar
Georg Brandl committed
3338 3339 3340
- Issue #17915: Fix interoperability of xml.sax with file objects returned by
  codecs.open().

3341 3342
- Issue #16601: Restarting iteration over tarfile really restarts rather
  than continuing from where it left off.  Patch by Michael Birtwell.
3343

3344 3345 3346 3347
- Issue #17289: The readline module now plays nicer with external modules
  or applications changing the rl_completer_word_break_characters global
  variable.  Initial patch by Bradley Froehle.

3348 3349 3350
- Issue #12181: select module: Fix struct kevent definition on OpenBSD 64-bit
  platforms. Patch by Federico Schwindt.

3351 3352 3353 3354
- Issue #11816: multiple improvements to the dis module: get_instructions
  generator, ability to redirect output to a file, Bytecode and Instruction
  abstractions. Patch by Nick Coghlan, Ryan Kelly and Thomas Kluyver.

3355
- Issue #13831: Embed stringification of remote traceback in local
3356 3357
  traceback raised when pool task raises an exception.

3358 3359 3360
- Issue #15528: Add weakref.finalize to support finalization using
  weakref callbacks.

3361 3362 3363
- Issue #14173: Avoid crashing when reading a signal handler during
  interpreter shutdown.

3364 3365
- Issue #15902: Fix imp.load_module() accepting None as a file when loading an
  extension module.
3366

3367 3368 3369 3370
- Issue #13721: SSLSocket.getpeercert() and SSLSocket.do_handshake() now
  raise an OSError with ENOTCONN, instead of an AttributeError, when the
  SSLSocket is not connected.

3371 3372
- Issue #14679: add an __all__ (that contains only HTMLParser) to html.parser.

3373 3374 3375
- Issue #17802: Fix an UnboundLocalError in html.parser.  Initial tests by
  Thomas Barlow.

3376 3377 3378
- Issue #17358: Modules loaded by imp.load_source() and load_compiled() (and by
  extention load_module()) now have a better chance of working when reloaded.

3379 3380 3381
- Issue #17804: New function ``struct.iter_unpack`` allows for streaming
  struct unpacking.

3382 3383 3384
- Issue #17830: When keyword.py is used to update a keyword file, it now
  preserves the line endings of the original file.

3385 3386 3387
- Issue #17272: Making the urllib.request's Request.full_url a descriptor.
  Fixes bugs with assignment to full_url. Patch by Demian Brecht.

3388 3389
- Issue #17353: Plistlib emitted empty data tags with deeply nested datastructures

3390 3391 3392
- Issue #11714: Use 'with' statements to assure a Semaphore releases a
  condition variable.  Original patch by Thomas Rachel.

3393 3394 3395 3396
- Issue #16624: `subprocess.check_output` now accepts an `input` argument,
  allowing the subprocess's stdin to be provided as a (byte) string.
  Patch by Zack Weinberg.

3397 3398 3399
- Issue #17795: Reverted backwards-incompatible change in SysLogHandler with
  Unix domain sockets.

3400 3401 3402
- Issue #16694: Add a pure Python implementation of the operator module.
  Patch by Zachary Ware.

3403 3404 3405
- Issue #11182: remove the unused and undocumented pydoc.Scanner class.
  Patch by Martin Morrison.

3406 3407
- Issue #17741: Add ElementTree.XMLPullParser, an event-driven parser for
  non-blocking applications.
3408

3409 3410 3411
- Issue #17555: Fix ForkAwareThreadLock so that size of after fork
  registry does not grow exponentially with generation of process.

3412 3413
- Issue #17707: fix regression in multiprocessing.Queue's get() method where
  it did not block for short timeouts.
3414

3415
- Issue #17720: Fix the Python implementation of pickle.Unpickler to correctly
3416 3417
  process the APPENDS opcode when it is used on non-list objects.

3418 3419
- Issue #17012: shutil.which() no longer falls back to the PATH environment
  variable if an empty path argument is specified.  Patch by Serhiy Storchaka.
3420

3421 3422
- Issue #17710: Fix pickle raising a SystemError on bogus input.

3423 3424 3425
- Issue #17341: Include the invalid name in the error messages from re about
  invalid group names.

3426 3427 3428 3429
- Issue #17702: os.environ now raises KeyError with the original environment
  variable name (str on UNIX), instead of using the encoded name (bytes on
  UNIX).

3430 3431 3432
- Issue #16163: Make the importlib based version of pkgutil.iter_importers
  work for submodules. Initial patch by Berker Peksag.

3433 3434 3435
- Issue #16804: Fix a bug in the 'site' module that caused running
  'python -S -m site' to incorrectly throw an exception.

3436 3437 3438
- Issue #15480: Remove the deprecated and unused TYPE_INT64 code from marshal.
  Initial patch by Daniel Riti.

3439
- Issue #2118: SMTPException is now a subclass of OSError.
3440

3441 3442 3443
- Issue #17016: Get rid of possible pointer wraparounds and integer overflows
  in the re module.  Patch by Nickolai Zeldovich.

3444 3445 3446
- Issue #16658: add missing return to HTTPConnection.send()
  Patch by Jeff Knupp.

3447 3448
- Issue #9556: the logging package now allows specifying a time-of-day for a
  TimedRotatingFileHandler to rotate.
3449

3450 3451 3452
- Issue #14971: unittest test discovery no longer gets confused when a function
  has a different __name__ than its name in the TestCase class dictionary.

3453 3454 3455
- Issue #17487: The wave getparams method now returns a namedtuple rather than
  a plain tuple.

3456 3457
- Issue #17675: socket repr() provides local and remote addresses (if any).
  Patch by Giampaolo Rodola'
3458

3459 3460 3461
- Issue #17093: Make the ABCs in importlib.abc provide default values or raise
  reasonable exceptions for their methods to make them more amenable to super()
  calls.
3462

3463
- Issue #17566: Make importlib.abc.Loader.module_repr() optional instead of an
3464
  abstractmethod; now it raises NotImplementedError so as to be ignored by default.
3465

3466 3467
- Issue #17678: Remove the use of deprecated method in http/cookiejar.py by
  changing the call to get_origin_req_host() to origin_req_host.
Benjamin Peterson's avatar
Benjamin Peterson committed
3468

3469
- Issue #17666: Fix reading gzip files with an extra field.
3470

3471 3472
- Issue #16475: Support object instancing, recursion and interned strings
  in marshal
3473

3474
- Issue #17502: Process DEFAULT values in mock side_effect that returns iterator.
3475

3476 3477 3478
- Issue #16795: On the ast.arguments object, unify vararg with varargannotation
  and kwarg and kwargannotation. Change the column offset of ast.Attribute to be
  at the attribute name.
3479

3480 3481
- Issue #17434: Properly raise a SyntaxError when a string occurs between future
  imports.
3482

3483 3484
- Issue #17117: Import and @importlib.util.set_loader now set __loader__ when
  it has a value of None or the attribute doesn't exist.
3485

3486 3487
- Issue #17032: The "global" in the "NameError: global name 'x' is not defined"
  error message has been removed.  Patch by Ram Rachum.
3488

3489 3490 3491 3492
- Issue #18080: When building a C extension module on OS X, if the compiler
  is overriden with the CC environment variable, use the new compiler as
  the default for linking if LDSHARED is not also overriden.  This restores
  Distutils behavior introduced in 3.2.3 and inadvertently dropped in 3.3.0.
3493

3494 3495
- Issue #18113: Fixed a refcount leak in the curses.panel module's
  set_userptr() method.  Reported by Atsuo Ishimoto.
3496

3497
- Implement PEP 443 "Single-dispatch generic functions".
3498

3499
- Implement PEP 435 "Adding an Enum type to the Python standard library".
3500

3501 3502
- Issue #15596: Faster pickling of unicode strings.

3503
- Issue #17572: Avoid chained exceptions when passing bad directives to
Ezio Melotti's avatar
Ezio Melotti committed
3504 3505
  time.strptime().  Initial patch by Claudiu Popa.

3506 3507 3508
- Issue #17435: threading.Timer's __init__ method no longer uses mutable
  default values for the args and kwargs parameters.

Ezio Melotti's avatar
Ezio Melotti committed
3509 3510 3511
- Issue #17526: fix an IndexError raised while passing code without filename to
  inspect.findsource().  Initial patch by Tyler Doyle.

3512
- Issue #17540: Added style parameter to logging formatter configuration by dict.
3513

3514 3515 3516
- Issue #16692: The ssl module now supports TLS 1.1 and TLS 1.2.  Initial
  patch by Michele Orrù.

3517 3518
- Issue #17025: multiprocessing: Reduce Queue and SimpleQueue contention.

3519 3520 3521
- Issue #17536: Add to webbrowser's browser list: www-browser, x-www-browser,
  iceweasel, iceape.

3522 3523 3524
- Issue #17150: pprint now uses line continuations to wrap long string
  literals.

3525 3526 3527 3528 3529
- Issue #17488: Change the subprocess.Popen bufsize parameter default value
  from unbuffered (0) to buffering (-1) to match the behavior existing code
  expects and match the behavior of the subprocess module in Python 2 to avoid
  introducing hard to track down bugs.

3530 3531 3532
- Issue #17521: Corrected non-enabling of logger following two calls to
  fileConfig().

3533 3534
- Issue #17508: Corrected logging MemoryHandler configuration in dictConfig()
  where the target handler wasn't configured first.
Vinay Sajip's avatar
Vinay Sajip committed
3535

3536
- Issue #17209: curses.window.get_wch() now correctly handles KeyboardInterrupt
3537 3538
  (CTRL+c).

3539 3540 3541 3542
- Issue #5713: smtplib now handles 421 (closing connection) error codes when
  sending mail by closing the socket and reporting the 421 error code via the
  exception appropriate to the command that received the error response.

3543 3544 3545
- Issue #16997: unittest.TestCase now provides a subTest() context manager
  to procedurally generate, in an easy way, small test instances.

3546
- Issue #17485: Also delete the Request Content-Length header if the data
3547
  attribute is deleted.  (Follow on to issue Issue #16464).
3548

3549 3550 3551
- Issue #15927: CVS now correctly parses escaped newlines and carriage
  when parsing with quoting turned off.

3552 3553 3554
- Issue #17467: add readline and readlines support to mock_open in
  unittest.mock.

3555 3556 3557
- Issue #13248: removed deprecated and undocumented difflib.isbjunk,
  isbpopular.

3558 3559 3560 3561
- Issue #17192: Update the ctypes module's libffi to v3.0.13.  This
  specifically addresses a stack misalignment issue on x86 and issues on
  some more recent platforms.

3562 3563
- Issue #8862: Fixed curses cleanup when getkey is interrputed by a signal.

Gregory P. Smith's avatar
Gregory P. Smith committed
3564
- Issue #17443: imaplib.IMAP4_stream was using the default unbuffered IO
3565 3566 3567
  in subprocess, but the imap code assumes buffered IO.  In Python2 this
  worked by accident.  IMAP4_stream now explicitly uses buffered IO.

3568 3569 3570
- Issue #17476: Fixed regression relative to Python2 in undocumented pydoc
  'allmethods'; it was missing unbound methods on the class.

3571 3572
- Issue #17474: Remove the deprecated methods of Request class.

3573 3574 3575
- Issue #16709: unittest discover order is no-longer filesystem specific. Patch
  by Jeff Ramnani.

3576 3577
- Use the HTTPS PyPI url for upload, overriding any plain HTTP URL in pypirc.

3578 3579 3580
- Issue #5024: sndhdr.whichhdr now returns the frame count for WAV files
  rather than -1.

3581 3582 3583 3584
- Issue #17460: Remove the strict argument of HTTPConnection and removing the
  DeprecationWarning being issued from 3.2 onwards.

- Issue #16880: Do not assume _imp.load_dynamic() is defined in the imp module.
3585

3586
- Issue #16389: Fixed a performance regression relative to Python 3.1 in the
3587 3588
  caching of compiled regular expressions.

3589 3590
- Added missing FeedParser and BytesFeedParser to email.parser.__all__.

3591 3592
- Issue #17431: Fix missing import of BytesFeedParser in email.parser.

3593 3594 3595
- Issue #12921: http.server's send_error takes an explain argument to send more
  information in response. Patch contributed by Karl.

3596 3597
- Issue #17414: Add timeit, repeat, and default_timer to timeit.__all__.

3598 3599 3600
- Issue #1285086: Get rid of the refcounting hack and speed up
  urllib.parse.unquote() and urllib.parse.unquote_to_bytes().

3601 3602 3603
- Issue #17099: Have importlib.find_loader() raise ValueError when __loader__
  is not set, harmonizing with what happens when the attribute is set to None.

3604 3605
- Expose the O_PATH constant in the os module if it is available.

3606 3607 3608 3609
- Issue #17368: Fix an off-by-one error in the Python JSON decoder that caused
  a failure while decoding empty object literals when object_pairs_hook was
  specified.

3610
- Issue #17385: Fix quadratic behavior in threading.Condition.  The FIFO
3611 3612
  queue now uses a deque instead of a list.

3613 3614
- Issue #15806: Add contextlib.ignore().  This creates a context manager to
  ignore specified exceptions, replacing the "except SomeException: pass" idiom.
3615

3616 3617 3618 3619 3620
- Issue #14645: The email generator classes now produce output using the
  specified linesep throughout.  Previously if the prolog, epilog, or
  body were stored with a different linesep, that linesep was used.  This
  fix corrects an RFC non-compliance issue with smtplib.send_message.

3621 3622 3623
- Issue #17278: Fix a crash in heapq.heappush() and heapq.heappop() when
  the list is being resized concurrently.

3624 3625 3626
- Issue #16962: Use getdents64 instead of the obsolete getdents syscall
  in the subprocess module on Linux.

3627 3628 3629
- Issue #16935: unittest now counts the module as skipped if it raises SkipTest,
  instead of counting it as an error.  Patch by Zachary Ware.

3630 3631
- Issue #17018: Make Process.join() retry if os.waitpid() fails with EINTR.

3632 3633 3634 3635
- Issue #17223: array module: Fix a crasher when converting an array containing
  invalid characters (outside range [U+0000; U+10ffff]) to Unicode:
  repr(array), str(array) and array.tounicode(). Patch written by Manuel Jacob.

3636 3637 3638
- Issue #17197: profile/cProfile modules refactored so that code of run() and
  runctx() utility functions is not duplicated in both modules.

3639 3640 3641
- Issue #14720: sqlite3: Convert datetime microseconds correctly.
  Patch by Lowe Thiderman.

3642 3643 3644
- Issue #15132: Allow a list for the defaultTest argument of
  unittest.TestProgram. Patch by Jyrki Pulliainen.

3645 3646 3647
- Issue #17225: JSON decoder now counts columns in the first line starting
  with 1, as in other lines.

3648 3649 3650
- Issue #6623: Added explicit DeprecationWarning for ftplib.netrc, which has
  been deprecated and undocumented for a long time.

3651 3652 3653
- Issue #13700: Fix byte/string handling in imaplib authentication when an
  authobject is specified.

3654 3655 3656
- Issue #13153: Tkinter functions now raise TclError instead of ValueError when
  a string argument contains non-BMP character.

3657 3658 3659
- Issue #9669: Protect re against infinite loops on zero-width matching in
  non-greedy repeat.  Patch by Matthew Barnett.

3660 3661 3662 3663
- Issue #13169: The maximal repetition number in a regular expression has been
  increased from 65534 to 2147483647 (on 32-bit platform) or 4294967294 (on
  64-bit).

3664 3665 3666
- Issue #17143: Fix a missing import in the trace module.  Initial patch by
  Berker Peksag.

3667 3668 3669
- Issue #15220: email.feedparser's line splitting algorithm is now simpler and
  faster.

3670 3671
- Issue #16743: Fix mmap overflow check on 32 bit Windows.

3672 3673 3674
- Issue #16996: webbrowser module now uses shutil.which() to find a
  web-browser on the executable search path.

3675 3676 3677
- Issue #16800: tempfile.gettempdir() no longer left temporary files when
  the disk is full.  Original patch by Amir Szekely.

3678 3679
- Issue #17192: Import libffi-3.0.12.

3680 3681 3682
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_7or8bit when used with binary data.

3683
- Issue #17052: unittest discovery should use self.testLoader.
3684

3685 3686
- Issue #4591: Uid and gid values larger than 2**31 are supported now.

3687
- Issue #17141: random.vonmisesvariate() no longer hangs for large kappas.
3688

3689 3690 3691
- Issue #17149: Fix random.vonmisesvariate to always return results in
  [0, 2*math.pi].

3692 3693
- Issue #1470548: XMLGenerator now works with binary output streams.

3694 3695 3696
- Issue #6975: os.path.realpath() now correctly resolves multiple nested
  symlinks on POSIX platforms.

3697 3698 3699
- Issue #13773: sqlite3.connect() gets a new `uri` parameter to pass the
  filename as a URI, allowing to pass custom options.

3700 3701 3702
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_noop when used with binary data.

3703 3704 3705 3706
- Issue #10355: The mode, name, encoding and newlines properties now work on
  SpooledTemporaryFile objects even when they have not yet rolled over.
  Obsolete method xreadline (which has never worked in Python 3) has been
  removed.
3707

3708 3709 3710 3711 3712 3713
- Issue #16686: Fixed a lot of bugs in audioop module.  Fixed crashes in
  avgpp(), maxpp() and ratecv().  Fixed an integer overflow in add(), bias(),
  and ratecv().  reverse(), lin2lin() and ratecv() no more lose precision for
  32-bit samples.  max() and rms() no more returns a negative result and
  various other functions now work correctly with 32-bit sample -0x80000000.

3714 3715
- Issue #17073: Fix some integer overflows in sqlite3 module.

3716 3717
- Issue #16723: httplib.HTTPResponse no longer marked closed when the connection
  is automatically closed.
3718

3719 3720 3721
- Issue #15359: Add CAN_BCM protocol support to the socket module. Patch by
  Brian Thorne.

3722 3723 3724
- Issue #16948: Fix quoted printable body encoding for non-latin1 character
  sets in the email package.

3725 3726 3727
- Issue #16811: Fix folding of headers with no value in the provisional email
  policies.

3728 3729
- Issue #17132: Update symbol for "yield from" grammar changes.

3730
- Issue #17076: Make copying of xattrs more tolerant of missing FS support.
3731 3732
  Patch by Thomas Wouters.

3733 3734 3735
- Issue #17089: Expat parser now correctly works with string input when the
  internal XML encoding is not UTF-8 or US-ASCII.  It also now accepts bytes
  and strings larger than 2 GiB.
3736

3737 3738 3739
- Issue #6083: Fix multiple segmentation faults occured when PyArg_ParseTuple
  parses nested mutating sequence.

3740 3741
- Issue #5289: Fix ctypes.util.find_library on Solaris.

3742 3743 3744 3745
- Issue #17106: Fix a segmentation fault in io.TextIOWrapper when an underlying
  stream or a decoder produces data of an unexpected type (i.e. when
  io.TextIOWrapper initialized with text stream or use bytes-to-bytes codec).

3746 3747 3748 3749
- Issue #17015: When it has a spec, a Mock object now inspects its signature
  when matching calls, so that arguments can be matched positionally or
  by name.

3750 3751 3752
- Issue #15633: httplib.HTTPResponse is now mark closed when the server
  sends less than the advertised Content-Length.

3753 3754 3755
- Issue #12268: The io module file object write methods no longer abort early
  when one of its write system calls is interrupted (EINTR).

3756 3757 3758
- Issue #6972: The zipfile module no longer overwrites files outside of
  its destination path when extracting malicious zip files.

3759 3760 3761 3762
- Issue #4844: ZipFile now raises BadZipFile when opens a ZIP file with an
  incomplete "End of Central Directory" record.  Original patch by Guilherme
  Polo and Alan McIntyre.

3763 3764 3765
- Issue #17071: Signature.bind() now works when one of the keyword arguments
  is named ``self``.

3766 3767 3768
- Issue #12004: Fix an internal error in PyZipFile when writing an invalid
  Python file.  Patch by Ben Morgan.

3769
- Have py_compile use importlib as much as possible to avoid code duplication.
3770 3771 3772
  Code now raises FileExistsError if the file path to be used for the
  byte-compiled file is a symlink or non-regular file as a warning that import
  will not keep the file path type if it writes to that path.
3773

3774
- Issue #16972: Have site.addpackage() consider already known paths even when
3775 3776
  none are explicitly passed in. Bug report and fix by Kirill.

3777 3778 3779
- Issue #1602133: on Mac OS X a shared library build (``--enable-shared``)
  now fills the ``os.environ`` variable correctly.

3780 3781 3782
- Issue #15505: `unittest.installHandler` no longer assumes SIGINT handler is
  set to a callable object.

3783 3784 3785
- Issue #13454: Fix a crash when deleting an iterator created by itertools.tee()
  if all other iterators were very advanced before.

3786 3787 3788
- Issue #12411: Fix to cgi.parse_multipart to correctly use bytes boundaries
  and bytes data. Patch by Jonas Wagner.

3789 3790 3791 3792
- Issue #16957: shutil.which() no longer searches a bare file name in the
  current directory on Unix and no longer searches a relative file path with
  a directory part in PATH directories.  Patch by Thomas Kluyver.

3793 3794 3795
- Issue #1159051: GzipFile now raises EOFError when reading a corrupted file
  with truncated header or footer.

3796 3797 3798
- Issue #16993: shutil.which() now preserves the case of the path and extension
  on Windows.

3799 3800 3801
- Issue #16992: On Windows in signal.set_wakeup_fd, validate the file
  descriptor argument.

3802 3803
- Issue #16422: For compatibility with the Python version, the C version of
  decimal now uses strings instead of integers for rounding mode constants.
3804

3805 3806 3807
- Issue #15861: tkinter now correctly works with lists and tuples containing
  strings with whitespaces, backslashes or unbalanced braces.

3808 3809 3810
- Issue #9720: zipfile now writes correct local headers for files larger than
  4 GiB.

3811 3812 3813
- Issue #16955: Fix the poll() method for multiprocessing's socket
  connections on Windows.

3814 3815
- SSLContext.load_dh_params() now properly closes the input file.

3816 3817 3818 3819
- Issue #15031: Refactor some .pyc management code to cut down on code
  duplication. Thanks to Ronan Lamy for the report and taking an initial stab
  at the problem.

3820 3821 3822
- Issue #16398: Optimize deque.rotate() so that it only moves pointers
  and doesn't touch the underlying data with increfs and decrefs.

3823 3824
- Issue #16900: Issue a ResourceWarning when an ssl socket is left unclosed.

3825 3826 3827
- Issue #13899: \A, \Z, and \B now correctly match the A, Z, and B literals
  when used inside character classes (e.g. '[\A]').  Patch by Matthew Barnett.

3828 3829 3830 3831
- Issue #15545: Fix regression in sqlite3's iterdump method where it was
  failing if the connection used a row factory (such as sqlite3.Row) that
  produced unsortable objects. (Regression was introduced by fix for 9750).

3832 3833
- fcntl: add F_DUPFD_CLOEXEC constant, available on Linux 2.6.24+.

3834 3835 3836
- Issue #15972: Fix error messages when os functions expecting a file name or
  file descriptor receive the incorrect type.

3837 3838 3839 3840
- Issue #8109: The ssl module now has support for server-side SNI, thanks
  to a :meth:`SSLContext.set_servername_callback` method.  Patch by Daniel
  Black.

3841 3842 3843
- Issue #16860: In tempfile, use O_CLOEXEC when available to set the
  close-on-exec flag atomically.

3844 3845
- Issue #16674: random.getrandbits() is now 20-40% faster for small integers.

3846 3847
- Issue #16009: JSON error messages now provide more information.

3848 3849
- Issue #16828: Fix error incorrectly raised by bz2.compress(b'') and
  bz2.BZ2Compressor.compress(b''). Initial patch by Martin Packman.
3850

3851 3852 3853 3854
- Issue #16833: In http.client.HTTPConnection, do not concatenate the request
  headers and body when the payload exceeds 16 KB, since it can consume more
  memory for no benefit.  Patch by Benno Leslie.

3855 3856
- Issue #16541: tk_setPalette() now works with keyword arguments.

3857 3858 3859 3860 3861 3862 3863 3864 3865 3866 3867
- Issue #16820: In configparser, `parser.popitem()` no longer raises ValueError.
  This makes `parser.clean()` work correctly.

- Issue #16820: In configparser, ``parser['section'] = {}`` now preserves
  section order within the parser. This makes `parser.update()` preserve section
  order as well.

- Issue #16820: In configparser, ``parser['DEFAULT'] = {}`` now correctly
  clears previous values stored in the default section. Same goes for
  ``parser.update({'DEFAULT': {}})``.

3868 3869
- Issue #9586: Redefine SEM_FAILED on MacOSX to keep compiler happy.

3870 3871 3872 3873
- Issue #16787: Increase asyncore and asynchat default output buffers size, to
  decrease CPU usage and increase throughput.

- Issue #10527: make multiprocessing use poll() instead of select() if available.
3874

3875 3876
- Issue #16688: Now regexes contained backreferences correctly work with
  non-ASCII strings.  Patch by Matthew Barnett.
3877

3878
- Issue #16486: Make aifc files act as context managers.
3879

3880 3881
- Issue #16485: Now file descriptors are closed if file header patching failed
  on closing an aifc file.
3882

3883 3884
- Issue #16640: Run less code under a lock in sched module.

3885 3886
- Issue #16165: sched.scheduler.run() no longer blocks a scheduler for other
  threads.
3887

3888
- Issue #16641: Default values of sched.scheduler.enter() are no longer
3889 3890
  modifiable.

3891 3892 3893
- Issue #16618: Make glob.glob match consistently across strings and bytes
  regarding leading dots.  Patch by Serhiy Storchaka.

3894 3895
- Issue #16788: Add samestat to Lib/ntpath.py

3896 3897 3898
- Issue #16713: Parsing of 'tel' urls using urlparse separates params from
  path.

3899 3900 3901
- Issue #16443: Add docstrings to regular expression match objects.
  Patch by Anton Kasyanov.

3902 3903
- Issue #15701: Fix HTTPError info method call to return the headers information.

3904 3905
- Issue #16752: Add a missing import to modulefinder. Patch by Berker Peksag.

3906 3907 3908
- Issue #16646: ftplib.FTP.makeport() might lose socket error details.
  (patch by Serhiy Storchaka)

3909 3910 3911 3912
- Issue #16626: Fix infinite recursion in glob.glob() on Windows when the
  pattern contains a wildcard in the drive or UNC path.  Patch by Serhiy
  Storchaka.

3913 3914 3915 3916
- Issue #15783: Except for the number methods, the C version of decimal now
  supports all None default values present in decimal.py. These values were
  largely undocumented.

3917 3918 3919
- Issue #11175: argparse.FileType now accepts encoding and errors
  arguments. Patch by Lucas Maystre.

3920 3921 3922
- Issue #16488: epoll() objects now support the `with` statement.  Patch
  by Serhiy Storchaka.

3923 3924 3925 3926
- Issue #16298: In HTTPResponse.read(), close the socket when there is no
  Content-Length and the incoming stream is finished.  Patch by Eran
  Rundstein.

3927 3928 3929
- Issue #16049: Add abc.ABC class to enable the use of inheritance to create
  ABCs, rather than the more cumbersome metaclass=ABCMeta. Patch by Bruno
  Dupuis.
3930

3931 3932 3933
- Expose the TCP_FASTOPEN and MSG_FASTOPEN flags in socket when they're
  available.

3934 3935 3936
- Issue #15701: Add a .headers attribute to urllib.error.HTTPError. Patch
  contributed by Berker Peksag.

3937 3938 3939 3940
- Issue #15872: Fix 3.3 regression introduced by the new fd-based shutil.rmtree
  that caused it to not ignore certain errors when ignore_errors was set.
  Patch by Alessandro Moura and Serhiy Storchaka.

3941 3942 3943
- Issue #16248: Disable code execution from the user's home directory by
  tkinter when the -E flag is passed to Python.  Patch by Zachary Ware.

3944 3945 3946
- Issue #13390: New function :func:`sys.getallocatedblocks()` returns the
  number of memory blocks currently allocated.

3947 3948
- Issue #16628: Fix a memory leak in ctypes.resize().

3949 3950 3951
- Issue #13614: Fix setup.py register failure with invalid rst in description.
  Patch by Julien Courteau and Pierre Paul Lefebvre.

3952 3953 3954
- Issue #13512: Create ~/.pypirc securely (CVE-2011-4944).  Initial patch by
  Philip Jenvey, tested by Mageia and Debian.

3955 3956 3957
- Issue #7719: Make distutils ignore ``.nfs*`` files instead of choking later
  on.  Initial patch by SilentGhost and Jeff Ramnani.

3958 3959 3960
- Issue #13120: Allow to call pdb.set_trace() from thread.
  Patch by Ilya Sandler.

3961 3962 3963
- Issue #16585: Make CJK encoders support error handlers that return bytes per
  PEP 383.

3964 3965 3966
- Issue #10182: The re module doesn't truncate indices to 32 bits anymore.
  Patch by Serhiy Storchaka.

3967 3968
- Issue #16333: use (",", ": ") as default separator in json when indent is
  specified, to avoid trailing whitespace.  Patch by Serhiy Storchaka.
3969

Benjamin Peterson's avatar
Benjamin Peterson committed
3970 3971 3972 3973
- Issue #16573: In 2to3, treat enumerate() like a consuming call, so superfluous
  list() calls aren't added to filter(), map(), and zip() which are directly
  passed enumerate().

3974 3975 3976
- Issue #16464: Reset the Content-Length header when a urllib Request is reused
  with new data.

3977 3978 3979 3980
- Issue #12848: The pure Python pickle implementation now treats object
  lengths as unsigned 32-bit integers, like the C implementation does.
  Patch by Serhiy Storchaka.

3981 3982 3983
- Issue #16423: urllib.request now has support for ``data:`` URLs.  Patch by
  Mathias Panzenböck.

3984 3985 3986
- Issue #4473: Add a POP3.stls() to switch a clear-text POP3 session into
  an encrypted POP3 session, on supported servers.  Patch by Lorenzo Catucci.

3987 3988 3989
- Issue #4473: Add a POP3.capa() method to query the capabilities advertised
  by the POP3 server.  Patch by Lorenzo Catucci.

3990 3991 3992
- Issue #4473: Ensure the socket is shutdown cleanly in POP3.close().
  Patch by Lorenzo Catucci.

3993 3994
- Issue #16522: added FAIL_FAST flag to doctest.

3995
- Issue #15627: Add the importlib.abc.InspectLoader.source_to_code() method.
3996

3997 3998 3999
- Issue #16408: Fix file descriptors not being closed in error conditions
  in the zipfile module.  Patch by Serhiy Storchaka.

4000 4001 4002
- Issue #14631: Add a new :class:`weakref.WeakMethod` to simulate weak
  references to bound methods.

4003 4004 4005 4006
- Issue #16469: Fix exceptions from float -> Fraction and Decimal -> Fraction
  conversions for special values to be consistent with those for float -> int
  and Decimal -> int.  Patch by Alexey Kachayev.

4007 4008
- Issue #16481: multiprocessing no longer leaks process handles on Windows.

4009 4010 4011
- Issue #12428: Add a pure Python implementation of functools.partial().
  Patch by Brian Thorne.

4012 4013 4014
- Issue #16140: The subprocess module no longer double closes its child
  subprocess.PIPE parent file descriptors on child error prior to exec().

4015 4016 4017
- Remove a bare print to stdout from the subprocess module that could have
  happened if the child process wrote garbage to its pre-exec error pipe.

4018 4019 4020
- The subprocess module now raises its own SubprocessError instead of a
  RuntimeError in various error situations which should not normally happen.

4021 4022 4023
- Issue #16327: The subprocess module no longer leaks file descriptors
  used for stdin/stdout/stderr pipes to the child when fork() fails.

4024 4025 4026
- Issue #14396: Handle the odd rare case of waitpid returning 0 when not
  expected in subprocess.Popen.wait().

4027 4028 4029
- Issue #16411: Fix a bug where zlib.decompressobj().flush() might try to access
  previously-freed memory. Patch by Serhiy Storchaka.

4030 4031 4032
- Issue #16357: fix calling accept() on a SSLSocket created through
  SSLContext.wrap_socket().  Original patch by Jeff McNeil.

4033 4034 4035 4036 4037
- Issue #16409: The reporthook callback made by the legacy
  urllib.request.urlretrieve API now properly supplies a constant non-zero
  block_size as it did in Python 3.2 and 2.7.  This matches the behavior of
  urllib.request.URLopener.retrieve.

4038 4039 4040
- Issue #16431: Use the type information when constructing a Decimal subtype
  from a Decimal argument.

4041 4042 4043
- Issue #15641: Clean up deprecated classes from importlib
  Patch by Taras Lyapun.

4044
- Issue #16350: zlib.decompressobj().decompress() now accumulates data from
4045
  successive calls after EOF in unused_data, instead of only saving the argument
4046 4047 4048
  to the last call. decompressobj().flush() now correctly sets unused_data and
  unconsumed_tail. A bug in the handling of MemoryError when setting the
  unconsumed_tail attribute has also been fixed. Patch by Serhiy Storchaka.
4049

4050 4051 4052
- Issue #12759: sre_parse now raises a proper error when the name of the group
  is missing.  Initial patch by Serhiy Storchaka.

4053 4054 4055
- Issue #16152: fix tokenize to ignore whitespace at the end of the code when
  no newline is found.  Patch by Ned Batchelder.

4056 4057 4058
- Issue #16284: Prevent keeping unnecessary references to worker functions
  in concurrent.futures ThreadPoolExecutor.

4059 4060 4061
- Issue #16230: Fix a crash in select.select() when one the lists changes
  size while iterated on.  Patch by Serhiy Storchaka.

4062 4063 4064
- Issue #16228: Fix a crash in the json module where a list changes size
  while it is being encoded.  Patch by Serhiy Storchaka.

4065 4066 4067
- Issue #16351: New function gc.get_stats() returns per-generation collection
  statistics.

4068 4069 4070
- Issue #14897: Enhance error messages of struct.pack and
  struct.pack_into. Patch by Matti Mäki.

4071 4072 4073
- Issue #16316: mimetypes now recognizes the .xz and .txz (.tar.xz) extensions.
  Patch by Serhiy Storchaka.

4074 4075 4076
- Issue #12890: cgitb no longer prints spurious <p> tags in text
  mode when the logdir option is specified.

4077 4078 4079
- Issue #16307: Fix multiprocessing.Pool.map_async not calling its callbacks.
  Patch by Janne Karila.

4080 4081 4082
- Issue #16305: Fix a segmentation fault occurring when interrupting
  math.factorial.

4083
- Issue #16116: Fix include and library paths to be correct when building C
4084 4085
  extensions in venvs.

4086 4087
- Issue #16245: Fix the value of a few entities in html.entities.html5.

4088 4089 4090
- Issue #16301: Fix the localhost verification in urllib/request.py for file://
  urls.

4091 4092 4093
- Issue #16250: Fix the invocations of URLError which had misplaced filename
  attribute for exception.

4094 4095 4096
- Issue #10836: Fix exception raised when file not found in urlretrieve
  Initial patch by Ezio Melotti.

4097 4098
- Issue #14398: Fix size truncation and overflow bugs in the bz2 module.

4099
- Issue #12692: Fix resource leak in urllib.request when talking to an HTTP
4100
  server that does not include a ``Connection: close`` header in its responses.
4101

4102 4103 4104
- Issue #12034: Fix bogus caching of result in check_GetFinalPathNameByHandle.
  Patch by Atsuo Ishimoto.

4105
- Improve performance of `lzma.LZMAFile` (see also issue #16034).
4106

4107 4108 4109
- Issue #16220: wsgiref now always calls close() on an iterable response.
  Patch by Brent Tubbs.

4110 4111 4112
- Issue #16270: urllib may hang when used for retrieving files via FTP by using
  a context manager.  Patch by Giampaolo Rodola'.

4113 4114 4115
- Issue #16461: Wave library should be able to deal with 4GB wav files,
  and sample rate of 44100 Hz.

4116 4117
- Issue #16176: Properly identify Windows 8 via platform.platform()

4118 4119 4120
- Issue #16088: BaseHTTPRequestHandler's send_error method includes a
  Content-Length header in it's response now. Patch by Antoine Pitrou.

4121 4122 4123
- Issue #16114: The subprocess module no longer provides a misleading error
  message stating that args[0] did not exist when either the cwd or executable
  keyword arguments specified a path that did not exist.
4124

4125 4126
- Issue #16169: Fix ctypes.WinError()'s confusion between errno and winerror.

4127 4128 4129
- Issue #16110: logging.fileConfig now accepts a pre-initialised ConfigParser
  instance.

4130 4131 4132
- Issue #1492704: shutil.copyfile() raises a distinct SameFileError now if
  source and destination are the same file. Patch by Atsuo Ishimoto.

4133 4134 4135
- Issue #13896: Make shelf instances work with 'with' as context managers.
  Original patch by Filip Gruszczyński.

4136 4137
- Issue #15417: Add support for csh and fish in venv activation scripts.

4138 4139 4140 4141
- Issue #14377: ElementTree.write and some of the module-level functions have
  a new parameter - *short_empty_elements*. It controls how elements with no
  contents are emitted.

4142 4143 4144
- Issue #16089: Allow ElementTree.TreeBuilder to work again with a non-Element
  element_factory (fixes a regression in SimpleTAL).

4145 4146 4147
- Issue #9650: List commonly used format codes in time.strftime and
  time.strptime docsttings.  Original patch by Mike Hoy.

4148 4149 4150 4151
- Issue #15452: logging configuration socket listener now has a verify option
  that allows an application to apply a verification function to the
  received configuration data before it is acted upon.

Georg Brandl's avatar
Georg Brandl committed
4152 4153
- Issue #16034: Fix performance regressions in the new `bz2.BZ2File`
  implementation.  Initial patch by Serhiy Storchaka.
4154

Georg Brandl's avatar
Georg Brandl committed
4155
- `pty.spawn()` now returns the child process status returned by `os.waitpid()`.
4156

Georg Brandl's avatar
Georg Brandl committed
4157 4158 4159
- Issue #15756: `subprocess.poll()` now properly handles `errno.ECHILD` to
  return a returncode of 0 when the child has already exited or cannot be waited
  on.
4160

Georg Brandl's avatar
Georg Brandl committed
4161
- Issue #15323: Improve failure message of `Mock.assert_called_once_with()`.
4162

Georg Brandl's avatar
Georg Brandl committed
4163
- Issue #16064: ``unittest -m`` claims executable is "python", not "python3".
4164

Georg Brandl's avatar
Georg Brandl committed
4165
- Issue #12376: Pass on parameters in `TextTestResult.__init__()` super call.
4166

Georg Brandl's avatar
Georg Brandl committed
4167
- Issue #15222: Insert blank line after each message in mbox mailboxes.
4168

Georg Brandl's avatar
Georg Brandl committed
4169
- Issue #16013: Fix `csv.Reader` parsing issue with ending quote characters.
4170 4171
  Patch by Serhiy Storchaka.

Georg Brandl's avatar
Georg Brandl committed
4172 4173
- Issue #15421: Fix an OverflowError in `Calendar.itermonthdates()` after
  `datetime.MAXYEAR`.  Patch by Cédric Krier.
4174

4175 4176 4177
- Issue #16112: platform.architecture does not correctly escape argument to
  /usr/bin/file.  Patch by David Benjamin.

Georg Brandl's avatar
Georg Brandl committed
4178
- Issue #15970: `xml.etree.ElementTree` now serializes correctly the empty HTML
4179 4180
  elements 'meta' and 'param'.

Georg Brandl's avatar
Georg Brandl committed
4181 4182
- Issue #15842: The `SocketIO.{readable,writable,seekable}` methods now raise
  ValueError when the file-like object is closed.  Patch by Alessandro Moura.
4183

Georg Brandl's avatar
Georg Brandl committed
4184
- Issue #15876: Fix a refleak in the `curses` module: window.encoding.
4185

Georg Brandl's avatar
Georg Brandl committed
4186 4187
- Issue #15881: Fix `atexit` hook in `multiprocessing`.  Original patch by Chris
  McDonough.
4188

Georg Brandl's avatar
Georg Brandl committed
4189 4190 4191
- Issue #15841: The readable(), writable() and seekable() methods of
  `io.BytesIO` and `io.StringIO` objects now raise ValueError when the object
  has been closed.  Patch by Alessandro Moura.
4192

Georg Brandl's avatar
Georg Brandl committed
4193 4194
- Issue #15447: Use `subprocess.DEVNULL` in webbrowser, instead of opening
  `os.devnull` explicitly and leaving it open.
4195

Georg Brandl's avatar
Georg Brandl committed
4196 4197
- Issue #15509: `webbrowser.UnixBrowser` no longer passes empty arguments to
  Popen when ``%action`` substitutions produce empty strings.
4198

Georg Brandl's avatar
Georg Brandl committed
4199 4200 4201 4202 4203
- Issue #12776, issue #11839: Call `argparse` type function (specified by
  add_argument) only once. Before, the type function was called twice in the
  case where the default was specified and the argument was given as well.  This
  was especially problematic for the FileType type, as a default file would
  always be opened, even if a file argument was specified on the command line.
4204 4205

- Issue #15906: Fix a regression in argparse caused by the preceding change,
Georg Brandl's avatar
Georg Brandl committed
4206
  when ``action='append'``, ``type='str'`` and ``default=[]``.
4207

Christian Heimes's avatar
Christian Heimes committed
4208 4209 4210 4211 4212
- Issue #16113: Added sha3 module based on the Keccak reference implementation
  3.2. The `hashlib` module has four additional hash algorithms: `sha3_224`,
  `sha3_256`, `sha3_384` and `sha3_512`. As part of the patch some common
  code was moved from _hashopenssl.c to hashlib.h.

4213 4214 4215
- ctypes.call_commethod was removed, since its only usage was in the defunct
  samples directory.

4216 4217 4218 4219
- Issue #16692: Added TLSv1.1 and TLSv1.2 support for the ssl modules.

- Issue #16832: add abc.get_cache_token() to expose cache validity checking
  support in ABCMeta.
4220

Benjamin Peterson's avatar
Benjamin Peterson committed
4221 4222 4223
IDLE
----

4224 4225 4226 4227 4228 4229 4230 4231 4232 4233 4234 4235 4236 4237 4238 4239 4240 4241 4242 4243 4244 4245 4246 4247 4248 4249 4250 4251 4252 4253 4254 4255 4256 4257 4258 4259 4260 4261 4262 4263 4264 4265
- Issue #18429: Format / Format Paragraph, now works when comment blocks
  are selected. As with text blocks, this works best when the selection
  only includes complete lines.

- Issue #18226: Add docstrings and unittests for FormatParagraph.py.
  Original patches by Todd Rovito and Phil Webster.

- Issue #18279: Format - Strip trailing whitespace no longer marks a file as
  changed when it has not been changed. This fix followed the addition of a
  test file originally written by Phil Webster (the issue's main goal).

- Issue #7136: In the Idle File menu, "New Window" is renamed "New File".
  Patch by Tal Einat, Roget Serwy, and Todd Rovito.

- Remove dead imports of imp.

- Issue #18196: Avoid displaying spurious SystemExit tracebacks.

- Issue #5492: Avoid traceback when exiting IDLE caused by a race condition.

- Issue #17511: Keep IDLE find dialog open after clicking "Find Next".
  Original patch by Sarah K.

- Issue #18055: Move IDLE off of imp and on to importlib.

- Issue #15392: Create a unittest framework for IDLE.
  Initial patch by Rajagopalasarma Jayakrishnan.
  See Lib/idlelib/idle_test/README.txt for how to run Idle tests.

- Issue #14146: Highlight source line while debugging on Windows.

- Issue #17838: Allow sys.stdin to be reassigned.

- Issue #13495: Avoid loading the color delegator twice in IDLE.

- Issue #17798: Allow IDLE to edit new files when specified on command line.

- Issue #14735: Update IDLE docs to omit "Control-z on Windows".

- Issue #17532: Always include Options menu for IDLE on OS X.
  Patch by Guilherme Simões.

Roger Serwy's avatar
Roger Serwy committed
4266 4267
- Issue #17585: Fixed IDLE regression. Now closes when using exit() or quit().

Roger Serwy's avatar
Roger Serwy committed
4268 4269 4270
- Issue #17657: Show full Tk version in IDLE's about dialog.
  Patch by Todd Rovito.

Roger Serwy's avatar
Roger Serwy committed
4271 4272
- Issue #17613: Prevent traceback when removing syntax colorizer in IDLE.

Roger Serwy's avatar
Roger Serwy committed
4273 4274
- Issue #1207589: Backwards-compatibility patch for right-click menu in IDLE.

Roger Serwy's avatar
Roger Serwy committed
4275 4276
- Issue #16887: IDLE now accepts Cancel in tabify/untabify dialog box.

4277 4278
- Issue #17625: In IDLE, close the replace dialog after it is used.

Benjamin Peterson's avatar
Benjamin Peterson committed
4279 4280 4281 4282 4283 4284
- Issue #14254: IDLE now handles readline correctly across shell restarts.

- Issue #17614: IDLE no longer raises exception when quickly closing a file.

- Issue #6698: IDLE now opens just an editor window when configured to do so.

4285
- Issue #8900: Using keyboard shortcuts in IDLE to open a file no longer
Benjamin Peterson's avatar
Benjamin Peterson committed
4286 4287 4288 4289
  raises an exception.

- Issue #6649: Fixed missing exit status in IDLE. Patch by Guilherme Polo.

4290
- Issue #17114: IDLE now uses non-strict config parser.
Benjamin Peterson's avatar
Benjamin Peterson committed
4291

4292 4293
- Issue #9290: In IDLE the sys.std* streams now implement io.TextIOBase
  interface and support all mandatory methods and properties.
Benjamin Peterson's avatar
Benjamin Peterson committed
4294

4295
- Issue #5066: Update IDLE docs. Patch by Todd Rovito.
Benjamin Peterson's avatar
Benjamin Peterson committed
4296 4297 4298 4299

- Issue #16829: IDLE printing no longer fails if there are spaces or other
  special characters in the file path.

4300
- Issue #16491: IDLE now prints chained exception tracebacks.
Benjamin Peterson's avatar
Benjamin Peterson committed
4301

4302
- Issue #16819: IDLE method completion now correctly works for bytes literals.
Benjamin Peterson's avatar
Benjamin Peterson committed
4303

4304 4305
- Issue #16504: IDLE now catches SyntaxErrors raised by tokenizer. Patch by
  Roger Serwy.
Benjamin Peterson's avatar
Benjamin Peterson committed
4306

4307 4308
- Issue #16511: Use default IDLE width and height if config param is not valid.
  Patch Serhiy Storchaka.
Benjamin Peterson's avatar
Benjamin Peterson committed
4309

4310 4311
- Issue #1207589: Add Cut/Copy/Paste items to IDLE right click Context Menu
  Patch by Todd Rovito.
Benjamin Peterson's avatar
Benjamin Peterson committed
4312

4313 4314
- Issue #16123: IDLE - deprecate running without a subprocess.
  Patch by Roger Serwy.
Benjamin Peterson's avatar
Benjamin Peterson committed
4315

4316 4317 4318
Tests
-----

4319 4320 4321 4322 4323 4324 4325 4326 4327 4328 4329 4330 4331 4332 4333 4334 4335 4336 4337 4338 4339 4340 4341 4342 4343 4344 4345 4346 4347 4348 4349 4350 4351 4352 4353 4354 4355
- Issue #1666318: Add a test that shutil.copytree() retains directory
  permissions.  Patch by Catherine Devlin.

- Issue #18273: move the tests in Lib/test/json_tests to Lib/test/test_json
  and make them discoverable by unittest.  Patch by Zachary Ware.

- Fix a fcntl test case on KFreeBSD, Debian #708653 (Petr Salinger).

- Issue #18396: Fix spurious test failure in test_signal on Windows when
  faulthandler is enabled (Patch by Jeremy Kloth)

- Issue #17046: Fix broken test_executable_without_cwd in test_subprocess.

- Issue #15415: Add new temp_dir() and change_cwd() context managers to
  test.support, and refactor temp_cwd() to use them.  Patch by Chris Jerdonek.

- Issue #15494: test.support is now a package rather than a module (Initial
  patch by Indra Talip)

- Issue #17944: test_zipfile now discoverable and uses subclassing to
  generate tests for different compression types.  Fixed a bug with skipping
  some tests due to use of exhausted iterators.

- Issue #18266: test_largefile now works with unittest test discovery and
  supports running only selected tests.  Patch by Zachary Ware.

- Issue #17767: test_locale now works with unittest test discovery.
  Original patch by Zachary Ware.

- Issue #18375: Assume --randomize when --randseed is used for running the
  testsuite.

- Issue #11185: Fix test_wait4 under AIX.  Patch by Sébastien Sablé.

- Issue #18207: Fix test_ssl for some versions of OpenSSL that ignore seconds
  in ASN1_TIME fields.

4356
- Issue #18094: test_uuid no longer reports skipped tests as passed.
4357 4358 4359 4360 4361 4362 4363 4364 4365 4366 4367 4368 4369 4370 4371 4372 4373 4374 4375 4376 4377 4378 4379 4380 4381 4382 4383 4384 4385 4386 4387 4388 4389 4390 4391 4392 4393 4394 4395 4396 4397 4398 4399 4400 4401 4402 4403

- Issue #17992: Add timeouts to asyncore and asynchat tests so that they won't
  accidentally hang.

- Issue #17833: Fix test_gdb failures seen on machines where debug symbols
  for glibc are available (seen on PPC64 Linux).

- Issue #7855: Add tests for ctypes/winreg for issues found in IronPython.
  Initial patch by Dino Viehland.

- Issue #11078: test___all__ now checks for duplicates in __all__.
  Initial patch by R. David Murray.

- Issue #17712: Fix test_gdb failures on Ubuntu 13.04.

- Issue #17835: Fix test_io when the default OS pipe buffer size is larger
  than one million bytes.

- Issue #17065: Use process-unique key for winreg tests to avoid failures if
  test is run multiple times in parallel (eg: on a buildbot host).

- Issue #12820: add tests for the xml.dom.minicompat module.
  Patch by John Chandler and Phil Connell.

- Issue #17691: test_univnewlines now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17790: test_set now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17789: test_random now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17779: test_osx_env now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17766: test_iterlen now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17690: test_time now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17692: test_sqlite now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #11995: test_pydoc doesn't import all sys.path modules anymore.

4404 4405
- Issue #17448: test_sax now skips if there are no xml parsers available
  instead of raising an ImportError.
4406

Ezio Melotti's avatar
Ezio Melotti committed
4407 4408
- Issue #11420: make test suite pass with -B/DONTWRITEBYTECODE set.
  Initial patch by Thomas Wouters.
4409

4410 4411
- Issue #10652: make tcl/tk tests run after __all__ test, patch by
  Zachary Ware.
4412

Ezio Melotti's avatar
Ezio Melotti committed
4413
- Issue #11963: remove human verification from test_parser and test_subprocess.
4414

4415 4416
- Issue #11732: add a new suppress_crash_popup() context manager to test.support
  that disables crash popups on Windows and use it in test_faulthandler and
4417
  test_capi.
4418

4419
- Issue #13898: test_ssl no longer prints a spurious stack trace on Ubuntu.
4420

4421 4422 4423
- Issue #17283: Share code between `__main__.py` and `regrtest.py` in
  `Lib/test`.

Ezio Melotti's avatar
Ezio Melotti committed
4424
- Issue #17249: convert a test in test_capi to use unittest and reap threads.
4425

4426 4427 4428 4429
- Issue #17107: Test client-side SNI support in urllib.request thanks to
  the new server-side SNI support in the ssl module.  Initial patch by
  Daniel Black.

4430 4431
- Issue #17041: Fix testing when Python is configured with the
  --without-doc-strings.
4432

4433 4434
- Issue #16923: Fix ResourceWarnings in test_ssl.

4435
- Issue #15539: Added regression tests for Tools/scripts/pindent.py.
4436

4437 4438 4439
- Issue #17479: test_io now works with unittest test discovery.
  Patch by Zachary Ware.

4440 4441 4442
- Issue #17066: test_robotparser now works with unittest test discovery.
  Patch by Zachary Ware.

4443 4444
- Issue #17334: test_index now works with unittest test discovery.
  Patch by Zachary Ware.
4445

4446 4447 4448
- Issue #17333: test_imaplib now works with unittest test discovery.
  Patch by Zachary Ware.

4449 4450 4451
- Issue #17082: test_dbm* now work with unittest test discovery.
  Patch by Zachary Ware.

4452 4453 4454
- Issue #17079: test_ctypes now works with unittest test discovery.
  Patch by Zachary Ware.

4455 4456 4457
- Issue #17304: test_hash now works with unittest test discovery.
  Patch by Zachary Ware.

4458 4459 4460
- Issue #17303: test_future* now work with unittest test discovery.
  Patch by Zachary Ware.

4461 4462 4463
- Issue #17163: test_file now works with unittest test discovery.
  Patch by Zachary Ware.

4464 4465 4466
- Issue #16925: test_configparser now works with unittest test discovery.
  Patch by Zachary Ware.

4467 4468 4469
- Issue #16918: test_codecs now works with unittest test discovery.
  Patch by Zachary Ware.

4470 4471 4472
- Issue #16919: test_crypt now works with unittest test discovery.
  Patch by Zachary Ware.

4473 4474 4475
- Issue #16910: test_bytes, test_unicode, and test_userstring now work with
  unittest test discovery.  Patch by Zachary Ware.

4476 4477 4478
- Issue #16905: test_warnings now works with unittest test discovery.
  Initial patch by Berker Peksag.

4479 4480 4481
- Issue #16898: test_bufio now works with unittest test discovery.
  Patch by Zachary Ware.

4482 4483 4484
- Issue #16888: test_array now works with unittest test discovery.
  Patch by Zachary Ware.

4485 4486 4487
- Issue #16896: test_asyncore now works with unittest test discovery.
  Patch by Zachary Ware.

4488 4489 4490
- Issue #16897: test_bisect now works with unittest test discovery.
  Initial patch by Zachary Ware.

4491 4492 4493
- Issue #16852: test_genericpath, test_posixpath, test_ntpath, and test_macpath
  now work with unittest test discovery.  Patch by Zachary Ware.

4494 4495
- Issue #16748: test_heapq now works with unittest test discovery.

Brian Curtin's avatar
Brian Curtin committed
4496 4497 4498
- Issue #10646: Tests rearranged for os.samefile/samestat to check for not
  just symlinks but also hard links.

4499 4500
- Issue #15302: Switch regrtest from using getopt to using argparse.

4501 4502
- Issue #15324: Fix regrtest parsing of --fromfile, --match, and --randomize
  options.
4503

4504 4505 4506
- Issue #16702: test_urllib2_localnet tests now correctly ignores proxies for
  localhost tests.

4507 4508
- Issue #16664: Add regression tests for glob's behaviour concerning entries
  starting with a ".".  Patch by Sebastian Kreft.
4509

4510 4511 4512
- Issue #13390: The ``-R`` option to regrtest now also checks for memory
  allocation leaks, using :func:`sys.getallocatedblocks()`.

Ezio Melotti's avatar
Ezio Melotti committed
4513 4514
- Issue #16559: Add more tests for the json module, including some from the
  official test suite at json.org.  Patch by Serhiy Storchaka.
4515

4516 4517 4518
- Issue #16661: Fix the `os.getgrouplist()` test by not assuming that it gives
  the same output as :command:`id -G`.

4519 4520 4521
- Issue #16115: Add some tests for the executable argument to
  subprocess.Popen().  Initial patch by Kushal Das.

4522 4523 4524
- Issue #16126: PyErr_Format format mismatch in _testcapimodule.c.
  Patch by Serhiy Storchaka.

Georg Brandl's avatar
Georg Brandl committed
4525 4526
- Issue #15304: Fix warning message when `os.chdir()` fails inside
  `test.support.temp_cwd()`.  Patch by Chris Jerdonek.
4527

Georg Brandl's avatar
Georg Brandl committed
4528 4529
- Issue #15802: Fix test logic in `TestMaildir.test_create_tmp()`. Patch by
  Serhiy Storchaka.
4530

Georg Brandl's avatar
Georg Brandl committed
4531 4532
- Issue #15557: Added a test suite for the webbrowser module, thanks to Anton
  Barkovsky.
4533

Ned Deily's avatar
Ned Deily committed
4534 4535
- Issue #16698: Skip posix test_getgroups when built with OS X
  deployment target prior to 10.6.
4536

4537 4538 4539
Build
-----

4540 4541 4542 4543 4544 4545 4546 4547 4548 4549 4550 4551 4552 4553 4554 4555 4556 4557 4558 4559 4560
- Issue #16067: Add description into MSI file to replace installer's
  temporary name.

- Issue #18257: Fix readlink usage in python-config.  Install the python
  version again on Darwin.

- Issue #18481: Add C coverage reporting with gcov and lcov. A new make target
  "coverage-report" creates an instrumented Python build, runs unit tests
  and creates a HTML. The report can be updated with "make coverage-lcov".

- Issue #17845: Clarified the message printed when some module are not built.

- Issue #18256: Compilation fix for recent AIX releases.  Patch by
  David Edelsohn.

- Issue #17547: In configure, explicitly pass -Wformat for the benefit for GCC
  4.8.

- Issue #15172: Document NASM 2.10+ as requirement for building OpenSSL 1.0.1
  on Windows.

4561 4562 4563
- Issue #17591: Use lowercase filenames when including Windows header files.
  Patch by Roumen Petrov.

Benjamin Peterson's avatar
Benjamin Peterson committed
4564 4565
- Issue #17550: Fix the --enable-profiling configure switch.

4566 4567
- Issue #17425: Build with openssl 1.0.1d on Windows.

4568 4569 4570
- Issue #16754: Fix the incorrect shared library extension on linux. Introduce
  two makefile macros SHLIB_SUFFIX and EXT_SUFFIX. SO now has the value of
  SHLIB_SUFFIX again (as in 2.x and 3.1). The SO macro is removed in 3.4.
4571

4572 4573
- Issue #5033: Fix building of the sqlite3 extension module when the
  SQLite library version has "beta" in it. Patch by Andreas Pelme.
4574

4575 4576
- Issue #17228: Fix building without pymalloc.

4577 4578
- Issue #3718: Use AC_ARG_VAR to set MACHDEP in configure.ac.

4579 4580
- Issue #16235: Implement python-config as a shell script.

4581 4582
- Issue #16769: Remove outdated Visual Studio projects.

4583 4584
- Issue #17031: Fix running regen in cross builds.

4585
- Issue #3754: fix typo in pthread AC_CACHE_VAL.
4586

4587 4588 4589
- Issue #15484: Fix _PYTHON_PROJECT_BASE for srcdir != builddir builds;
  use _PYTHON_PROJECT_BASE in distutils/sysconfig.py.

4590
- Drop support for Windows 2000 (changeset e52df05b496a).
4591

4592
- Issue #17029: Let h2py search the multiarch system include directory.
4593

4594 4595
- Issue #16953: Fix socket module compilation on platforms with
  HAVE_BROKEN_POLL. Patch by Jeffrey Armstrong.
4596

4597 4598
- Issue #16320: Remove redundant Makefile dependencies for strings and bytes.

4599 4600 4601
- Cross compiling needs host and build settings. configure no longer
  creates a broken PYTHON_FOR_BUILD variable when --build is missing.

4602 4603 4604
- Fix cross compiling issue in setup.py, ensure that lib_dirs and inc_dirs are
  defined in cross compiling mode, too.

4605 4606
- Issue #16836: Enable IPv6 support even if IPv6 is disabled on the build host.

4607 4608
- Issue #16593: Have BSD 'make -s' do the right thing, thanks to Daniel Shahaf

4609
- Issue #16262: fix out-of-src-tree builds, if mercurial is not installed.
4610

4611 4612 4613
- Issue #15298: ensure _sysconfigdata is generated in build directory, not
  source directory.

4614 4615 4616 4617
- Issue #15833: Fix a regression in 3.3 that resulted in exceptions being
  raised if importlib failed to write byte-compiled files.  This affected
  attempts to build Python out-of-tree from a read-only source directory.

Georg Brandl's avatar
Georg Brandl committed
4618 4619
- Issue #15923: Fix a mistake in ``asdl_c.py`` that resulted in a TypeError
  after 2801bf875a24 (see #15801).
4620

4621 4622
- Issue #16135: Remove OS/2 support.

4623 4624
- Issue #15819: Make sure we can build Python out-of-tree from a read-only
  source directory.  (Somewhat related to issue #9860.)
4625

Ned Deily's avatar
Ned Deily committed
4626 4627 4628
- Issue #15587: Enable Tk high-resolution text rendering on Macs with
  Retina displays.  Applies to Tkinter apps, such as IDLE, on OS X
  framework builds linked with Cocoa Tk 8.5.
4629

4630
- Issue #17161: make install now also installs a python3 man page.
4631

4632 4633
C-API
-----
4634

4635 4636 4637 4638 4639 4640 4641 4642 4643 4644 4645 4646 4647 4648 4649 4650
- Issue #18351: Fix various issues in a function in importlib provided to help
  PyImport_ExecCodeModuleWithPathnames() (and thus by extension
  PyImport_ExecCodeModule() and PyImport_ExecCodeModuleEx()).

- Issue #9369: The types of `char*` arguments of PyObject_CallFunction() and
  PyObject_CallMethod() now changed to `const char*`.  Based on patches by
  Jörg Müller and Lars Buitinck.

- Issue #17206: Py_CLEAR(), Py_DECREF(), Py_XINCREF() and Py_XDECREF() now
  expand their arguments once instead of multiple times.  Patch written by Illia
  Polosukhin.

- Issue #17522: Add the PyGILState_Check() API.

- Issue #17327: Add PyDict_SetDefault.

4651
- Issue #16881: Fix Py_ARRAY_LENGTH macro for GCC < 3.1.
4652

4653 4654 4655 4656 4657 4658 4659 4660 4661 4662
- Issue #16505: Remove unused Py_TPFLAGS_INT_SUBCLASS.

- Issue #16086: PyTypeObject.tp_flags and PyType_Spec.flags are now unsigned
  (unsigned long and unsigned int) to avoid an undefined behaviour with
  Py_TPFLAGS_TYPE_SUBCLASS ((1 << 31). PyType_GetFlags() result type is
  now unsigned too (unsigned long, instead of long).

- Issue #16166: Add PY_LITTLE_ENDIAN and PY_BIG_ENDIAN macros and unified
  endianness detection and handling.

4663 4664 4665
Documentation
-------------

4666 4667 4668 4669 4670 4671 4672 4673 4674 4675 4676 4677 4678 4679 4680
- Issue #17701: Improving strftime documentation.

- Issue #18440: Clarify that `hash()` can truncate the value returned from an
  object's custom `__hash__()` method.

- Issue #17844: Add links to encoders and decoders for bytes-to-bytes codecs.

- Issue #14097: improve the "introduction" page of the tutorial.

- Issue #17977: The documentation for the cadefault argument's default value
  in urllib.request.urlopen() is fixed to match the code.

- Issue #6696: add documentation for the Profile objects, and improve
  profile/cProfile docs.  Patch by Tom Pinckney.

Terry Jan Reedy's avatar
Terry Jan Reedy committed
4681 4682
- Issue #15940: Specify effect of locale on time functions.

4683
- Issue 17538: Document XML vulnerabilties
4684

4685 4686 4687
- Issue #16642: sched.scheduler timefunc initial default is time.monotonic.
  Patch by Ramchandra Apte

4688 4689
- Issue #17047: remove doubled words in docs and docstrings
  reported by Serhiy Storchaka and Matthew Barnett.
4690

4691 4692 4693
- Issue #15465: Document the versioning macros in the C API docs rather than
  the standard library docs. Patch by Kushal Das.

4694
- Issue #16406: Combine the pages for uploading and registering to PyPI.
4695

4696 4697
- Issue #16403: Document how distutils uses the maintainer field in
  PKG-INFO. Patch by Jyrki Pulliainen.
4698

4699 4700
- Issue #16695: Document how glob handles filenames starting with a
  dot. Initial patch by Jyrki Pulliainen.
4701

4702 4703 4704
- Issue #8890: Stop advertising an insecure practice by replacing uses
  of the /tmp directory with better alternatives in the documentation.
  Patch by Geoff Wilson.
4705

4706
- Issue #17203: add long option names to unittest discovery docs.
4707

Ezio Melotti's avatar
Ezio Melotti committed
4708 4709
- Issue #13094: add "Why do lambdas defined in a loop with different values
  all return the same result?" programming FAQ.
4710

Brian Curtin's avatar
Brian Curtin committed
4711 4712
- Issue #14901: Update portions of the Windows FAQ.
  Patch by Ashish Nitin Patil.
4713

4714 4715 4716
- Issue #16267: Better document the 3.3+ approach to combining
  @abstractmethod with @staticmethod, @classmethod and @property

4717 4718 4719
- Issue #15209: Clarify exception chaining description in exceptions module
  documentation

4720
- Issue #15990: Improve argument/parameter documentation.
4721

4722 4723 4724
- Issue #16209: Move the documentation for the str built-in function to a new
  str class entry in the "Text Sequence Type" section.

4725 4726
- Issue #13538: Improve str() and object.__str__() documentation.

Brett Cannon's avatar
Brett Cannon committed
4727 4728
- Issue #16489: Make it clearer that importlib.find_loader() needs parent
  packages to be explicitly imported.
4729

4730 4731
- Issue #16400: Update the description of which versions of a given package
  PyPI displays.
4732

4733 4734
- Issue #15677: Document that zlib and gzip accept a compression level of 0 to
  mean 'no compression'. Patch by Brian Brazil.
4735

4736 4737 4738
- Issue #16197: Update winreg docstrings and documentation to match code.
  Patch by Zachary Ware.

Ezio Melotti's avatar
Ezio Melotti committed
4739 4740
- Issue #8040: added a version switcher to the documentation.  Patch by
  Yury Selivanov.
4741

4742 4743 4744
- Issue #16241: Document -X faulthandler command line option.
  Patch by Marek Šuppa.

4745 4746 4747
- Additional comments and some style changes in the concurrent.futures URL
  retrieval example

4748 4749 4750
- Issue #16115: Improve subprocess.Popen() documentation around args, shell,
  and executable arguments.

Hynek Schlawack's avatar
Hynek Schlawack committed
4751 4752 4753
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.

Georg Brandl's avatar
Georg Brandl committed
4754
- Issue #15533: Clarify docs and add tests for `subprocess.Popen()`'s cwd
4755
  argument.
4756

Ezio Melotti's avatar
Ezio Melotti committed
4757 4758
- Issue #15979: Improve timeit documentation.

Georg Brandl's avatar
Georg Brandl committed
4759
- Issue #16036: Improve documentation of built-in `int()`'s signature and
4760 4761
  arguments.

Georg Brandl's avatar
Georg Brandl committed
4762
- Issue #15935: Clarification of `argparse` docs, re: add_argument() type and
4763 4764 4765 4766 4767
  default arguments.  Patch contributed by Chris Jerdonek.

- Issue #11964: Document a change in v3.2 to the behavior of the indent
  parameter of json encoding operations.

Ned Deily's avatar
Ned Deily committed
4768 4769
- Issue #15116: Remove references to appscript as it is no longer being
  supported.
4770

4771 4772 4773
Tools/Demos
-----------

4774 4775 4776 4777 4778 4779 4780 4781 4782 4783 4784 4785 4786 4787 4788 4789
- Issue #18817: Fix a resource warning in Lib/aifc.py demo.  Patch by
  Vajrasky Kok.

- Issue #18439: Make patchcheck work on Windows for ACKS, NEWS.

- Issue #18448: Fix a typo in Tools/demo/eiffel.py.

- Issue #18457: Fixed saving of formulas and complex numbers in
  Tools/demo/ss1.py.

- Issue #18449: Make Tools/demo/ss1.py work again on Python 3.  Patch by
  Févry Thibault.

- Issue #12990: The "Python Launcher" on OSX could not launch python scripts
  that have paths that include wide characters.

4790 4791
- Issue #15239: Make mkstringprep.py work again on Python 3.

4792
- Issue #17028: Allowed Python arguments to be supplied to the Windows
4793 4794
  launcher.

4795 4796
- Issue #17156: pygettext.py now detects the encoding of source files and
  correctly writes and escapes non-ascii characters.
4797

4798 4799 4800 4801
- Issue #15539: Fix a number of bugs in Tools/scripts/pindent.py.  Now
  pindent.py works with a "with" statement.  pindent.py no longer produces
  improper indentation.  pindent.py now works with continued lines broken after
  "class" or "def" keywords and with continuations at the start of line.
4802

4803 4804
- Issue #11797: Add a 2to3 fixer that maps reload() to imp.reload().

4805 4806
- Issue #10966: Remove the concept of unexpected skipped tests.

4807 4808 4809 4810
- Issue #9893: Removed the Misc/Vim directory.

- Removed the Misc/TextMate directory.

4811 4812 4813
- Issue #16245: Add the Tools/scripts/parse_html5_entities.py script to parse
  the list of HTML5 entities and update the html.entities.html5 dictionary.

4814
- Issue #15378: Fix Tools/unicode/comparecodecs.py.  Patch by Serhiy Storchaka.
Ronald Oussoren's avatar
Ronald Oussoren committed
4815

4816 4817 4818
- Issue #16549: Make json.tool work again on Python 3 and add tests.
  Initial patch by Berker Peksag and Serhiy Storchaka.

4819 4820 4821
- Issue #13301: use ast.literal_eval() instead of eval() in Tools/i18n/msgfmt.py
  Patch by Serhiy Storchaka.

4822 4823 4824 4825 4826 4827
Windows
-------

- Issue #18569: The installer now adds .py to the PATHEXT variable when extensions
  are registered. Patch by Paul Moore.

4828

Georg Brandl's avatar
Georg Brandl committed
4829 4830 4831
What's New in Python 3.3.0?
===========================

Georg Brandl's avatar
Georg Brandl committed
4832
*Release date: 29-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
4833 4834 4835 4836

Core and Builtins
-----------------

4837 4838
- Issue #16046: Fix loading sourceless legacy .pyo files.

4839 4840
- Issue #16060: Fix refcounting bug when `__trunc__()` returns an object whose
  `__int__()` gives a non-integer.  Patch by Serhiy Storchaka.
4841

4842 4843 4844
Extension Modules
-----------------

4845
- Issue #16012: Fix a regression in pyexpat. The parser's `UseForeignDTD()`
4846 4847
  method doesn't require an argument again.

Georg Brandl's avatar
Georg Brandl committed
4848

4849
What's New in Python 3.3.0 Release Candidate 3?
Georg Brandl's avatar
Georg Brandl committed
4850
===============================================
4851

Georg Brandl's avatar
Georg Brandl committed
4852
*Release date: 23-Sep-2012*
4853 4854 4855 4856

Core and Builtins
-----------------

4857
- Issue #15900: Fix reference leak in `PyUnicode_TranslateCharmap()`.
4858

4859 4860
- Issue #15926: Fix crash after multiple reinitializations of the interpreter.

4861
- Issue #15895: Fix FILE pointer leak in one error branch of
4862 4863
  `PyRun_SimpleFileExFlags()` when filename points to a pyc/pyo file, closeit is
  false an and set_main_loader() fails.
4864

4865 4866
- Fixes for a few crash and memory leak regressions found by Coverity.

4867 4868 4869
Library
-------

4870 4871 4872 4873
- Issue #15882: Change `_decimal` to accept any coefficient tuple when
  constructing infinities. This is done for backwards compatibility with
  decimal.py: Infinity coefficients are undefined in _decimal (in accordance
  with the specification).
4874

4875 4876
- Issue #15925: Fix a regression in `email.util` where the `parsedate()` and
  `parsedate_tz()` functions did not return None anymore when the argument could
4877 4878
  not be parsed.

Georg Brandl's avatar
Georg Brandl committed
4879 4880 4881
Extension Modules
-----------------

4882 4883 4884
- Issue #15973: Fix a segmentation fault when comparing datetime timezone
  objects.

Georg Brandl's avatar
Georg Brandl committed
4885 4886 4887
- Issue #15977: Fix memory leak in Modules/_ssl.c when the function
  _set_npn_protocols() is called multiple times, thanks to Daniel Sommermann.

4888
- Issue #15969: `faulthandler` module: rename dump_tracebacks_later() to
4889 4890 4891
  dump_traceback_later() and cancel_dump_tracebacks_later() to
  cancel_dump_traceback_later().

4892
- _decimal module: use only C 89 style comments.
Georg Brandl's avatar
Georg Brandl committed
4893

4894

Georg Brandl's avatar
Georg Brandl committed
4895 4896 4897
What's New in Python 3.3.0 Release Candidate 2?
===============================================

Georg Brandl's avatar
Georg Brandl committed
4898
*Release date: 09-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
4899 4900 4901 4902

Core and Builtins
-----------------

4903
- Issue #13992: The trashcan mechanism is now thread-safe.  This eliminates
4904 4905
  sporadic crashes in multi-thread programs when several long deallocator chains
  ran concurrently and involved subclasses of built-in container types.
4906

4907 4908
- Issue #15784: Modify `OSError`.__str__() to better distinguish between errno
  error numbers and Windows error numbers.
4909

4910 4911
- Issue #15781: Fix two small race conditions in import's module locking.

Georg Brandl's avatar
Georg Brandl committed
4912 4913 4914
Library
-------

4915 4916 4917
- Issue #17158: Add 'symbols' to help() welcome message; clarify
  'modules spam' messages.

4918 4919
- Issue #15847: Fix a regression in argparse, which did not accept tuples as
  argument lists anymore.
4920

4921
- Issue #15828: Restore support for C extensions in `imp.load_module()`.
4922

4923 4924
- Issue #15340: Fix importing the random module when ``/dev/urandom`` cannot be
  opened.  This was a regression caused by the hash randomization patch.
4925

4926
- Issue #10650: Deprecate the watchexp parameter of the `Decimal.quantize()`
4927 4928
  method.

4929 4930 4931 4932
- Issue #15785: Modify `window.get_wch()` API of the curses module: return a
  character for most keys, and an integer for special keys, instead of always
  returning an integer. So it is now possible to distinguish special keys like
  keypad keys.
4933

4934
- Issue #14223: Fix `window.addch()` of the curses module for special characters
4935 4936 4937 4938 4939 4940
  like curses.ACS_HLINE: the Python function addch(int) and addch(bytes) is now
  calling the C function waddch()/mvwaddch() (as it was done in Python 3.2),
  instead of wadd_wch()/mvwadd_wch(). The Python function addch(str) is still
  calling the C function wadd_wch()/mvwadd_wch() if the Python curses is linked
  to libncursesw.

Georg Brandl's avatar
Georg Brandl committed
4941 4942 4943 4944 4945 4946
Build
-----

- Issue #15822: Really ensure 2to3 grammar pickles are properly installed
  (replaces fixes for Issue #15645).

4947 4948 4949
Documentation
-------------

4950 4951 4952 4953
- Issue #15814: The memoryview enhancements in 3.3.0 accidentally permitted the
  hashing of multi-dimensional memorviews and memoryviews with multi-byte item
  formats. The intended restrictions have now been documented - they will be
  correctly enforced in 3.3.1.
4954

Georg Brandl's avatar
Georg Brandl committed
4955

Georg Brandl's avatar
Georg Brandl committed
4956 4957 4958
What's New in Python 3.3.0 Release Candidate 1?
===============================================

Georg Brandl's avatar
Georg Brandl committed
4959
*Release date: 25-Aug-2012*
Georg Brandl's avatar
Georg Brandl committed
4960 4961 4962 4963

Core and Builtins
-----------------

4964
- Issue #15573: memoryview comparisons are now performed by value with full
4965
  support for any valid struct module format definition.
4966

4967
- Issue #15316: When an item in the fromlist for `__import__()` doesn't exist,
4968 4969 4970
  don't raise an error, but if an exception is raised as part of an import do
  let that propagate.

4971 4972
- Issue #15778: Ensure that ``str(ImportError(msg))`` returns a str even when
  msg isn't a str.
4973

4974 4975 4976 4977
- Issue #2051: Source file permission bits are once again correctly copied to
  the cached bytecode file. (The migration to importlib reintroduced this
  problem because these was no regression test. A test has been added as part of
  this patch)
4978

4979
- Issue #15761: Fix crash when ``PYTHONEXECUTABLE`` is set on Mac OS X.
4980

4981 4982
- Issue #15726: Fix incorrect bounds checking in PyState_FindModule.  Patch by
  Robin Schreiber.
4983

4984
- Issue #15604: Update uses of `PyObject_IsTrue()` to check for and handle
4985 4986
  errors correctly.  Patch by Serhiy Storchaka.

4987 4988
- Issue #14846: `importlib.FileFinder` now handles the case where the directory
  being searched is removed after a previous import attempt.
4989

Georg Brandl's avatar
Georg Brandl committed
4990 4991 4992
Library
-------

4993 4994
- Issue #13370: Ensure that ctypes works on Mac OS X when Python is compiled
  using the clang compiler.
4995

4996 4997
- Issue #13072: The array module's 'u' format code is now deprecated and will be
  removed in Python 4.0.
4998

4999 5000
- Issue #15544: Fix Decimal.__float__ to work with payload-carrying NaNs.

5001 5002
- Issue #15776: Allow pyvenv to work in existing directory with --clean.

5003
- Issue #15249: email's BytesGenerator now correctly mangles From lines (when
5004
  requested) even if the body contains undecodable bytes.
5005

Ross Lagerwall's avatar
Ross Lagerwall committed
5006
- Issue #15777: Fix a refleak in _posixsubprocess.
5007

5008
- Issue ##665194: Update `email.utils.localtime` to use datetime.astimezone and
5009 5010
  correctly handle historic changes in UTC offsets.

5011 5012
- Issue #15199: Fix JavaScript's default MIME type to application/javascript.
  Patch by Bohuslav Kabrda.
5013

5014 5015
- Issue #12643: `code.InteractiveConsole` now respects `sys.excepthook` when
  displaying exceptions.  Patch by Aaron Iles.
5016

5017
- Issue #13579: `string.Formatter` now understands the 'a' conversion specifier.
5018

5019 5020
- Issue #15595: Fix ``subprocess.Popen(universal_newlines=True)`` for certain
  locales (utf-16 and utf-32 family). Patch by Chris Jerdonek.
5021

5022 5023
- Issue #15477: In cmath and math modules, add workaround for platforms whose
  system-supplied log1p function doesn't respect signs of zeros.
5024

5025 5026
- Issue #15715: `importlib.__import__()` will silence an ImportError when the
  use of fromlist leads to a failed import.
5027

5028 5029 5030
- Issue #14669: Fix pickling of connections and sockets on Mac OS X by
  sending/receiving an acknowledgment after file descriptor transfer.
  TestPicklingConnection has been reenabled for Mac OS X.
5031

5032
- Issue #11062: Fix adding a message from file to Babyl mailbox.
5033

5034 5035
- Issue #15646: Prevent equivalent of a fork bomb when using `multiprocessing`
  on Windows without the ``if __name__ == '__main__'`` idiom.
5036

5037 5038 5039
IDLE
----

5040 5041
- Issue #15678: Fix IDLE menus when started from OS X command line (3.3.0b2
  regression).
5042

Senthil Kumaran's avatar
Senthil Kumaran committed
5043 5044
Documentation
-------------
5045

5046 5047
- Touched up the Python 2 to 3 porting guide.

5048
- Issue #14674: Add a discussion of the `json` module's standard compliance.
5049
  Patch by Chris Rebert.
5050

5051 5052
- Create a 'Concurrent Execution' section in the docs, and split up the
  'Optional Operating System Services' section to use a more user-centric
5053
  classification scheme (splitting them across the new CE section, IPC and text
5054
  processing). Operating system limitations can be reflected with the Sphinx
5055
  ``:platform:`` tag, it doesn't make sense as part of the Table of Contents.
5056

5057 5058
- Issue #4966: Bring the sequence docs up to date for the Py3k transition and
  the many language enhancements since they were original written.
5059

5060
- The "path importer" misnomer has been replaced with Eric Snow's
5061 5062
  more-awkward-but-at-least-not-wrong suggestion of "path based finder" in the
  import system reference docs.
5063

5064
- Issue #15640: Document `importlib.abc.Finder` as deprecated.
5065

5066
- Issue #15630: Add an example for "continue" stmt in the tutorial.  Patch by
Senthil Kumaran's avatar
Senthil Kumaran committed
5067
  Daniel Ellis.
5068

5069 5070
Tests
-----
5071

5072
- Issue #15747: ZFS always returns EOPNOTSUPP when attempting to set the
5073 5074
  UF_IMMUTABLE flag (via either chflags or lchflags); refactor affected tests in
  test_posix.py to account for this.
5075

5076 5077
- Issue #15285: Refactor the approach for testing connect timeouts using two
  external hosts that have been configured specifically for this type of test.
5078

5079
- Issue #15743: Remove the deprecated method usage in `urllib` tests. Patch by
5080 5081
  Jeff Knupp.

5082 5083
- Issue #15615: Add some tests for the `json` module's handling of invalid input
  data.  Patch by Kushal Das.
5084

5085 5086 5087
Build
-----

5088 5089
- Output lib files for PGO build into PGO directory.

5090 5091
- Pick up 32-bit launcher from PGO directory on 64-bit PGO build.

5092
- Drop ``PC\python_nt.h`` as it's not used.  Add input dependency on custom
5093 5094
  build step.

5095 5096
- Issue #15511: Drop explicit dependency on pythonxy.lib from _decimal amd64
  configuration.
5097

5098 5099
- Add missing PGI/PGO configurations for pywlauncher.

5100 5101
- Issue #15645: Ensure 2to3 grammar pickles are properly installed.

Georg Brandl's avatar
Georg Brandl committed
5102

5103 5104 5105
What's New in Python 3.3.0 Beta 2?
==================================

Georg Brandl's avatar
Georg Brandl committed
5106
*Release date: 12-Aug-2012*
5107

5108 5109 5110
Core and Builtins
-----------------

5111
- Issue #15568: Fix the return value of ``yield from`` when StopIteration is
5112 5113
  raised by a custom iterator.

5114
- Issue #13119: `sys.stdout` and `sys.stderr` are now using "\r\n" newline on
5115 5116
  Windows, as Python 2.

5117 5118
- Issue #15534: Fix the fast-search function for non-ASCII Unicode strings.

5119
- Issue #15508: Fix the docstring for `__import__()` to have the proper default
Georg Brandl's avatar
Georg Brandl committed
5120 5121
  value of 0 for 'level' and to not mention negative levels since they are not
  supported.
5122

5123
- Issue #15425: Eliminated traceback noise from more situations involving
Georg Brandl's avatar
Georg Brandl committed
5124
  importlib.
5125

5126 5127
- Issue #14578: Support modules registered in the Windows registry again.

Georg Brandl's avatar
Georg Brandl committed
5128 5129
- Issue #15466: Stop using TYPE_INT64 in marshal, to make importlib.h (and other
  byte code files) equal between 32-bit and 64-bit systems.
5130

Georg Brandl's avatar
Georg Brandl committed
5131
- Issue #1692335: Move initial exception args assignment to
5132
  `BaseException.__new__()` to help pickling of naive subclasses.
5133

5134
- Issue #12834: Fix `PyBuffer_ToContiguous()` for non-contiguous arrays.
5135

5136
- Issue #15456: Fix code `__sizeof__()` after #12399 change.  Patch by Serhiy
Georg Brandl's avatar
Georg Brandl committed
5137
  Storchaka.
5138

5139 5140
- Issue #15404: Refleak in PyMethodObject repr.

5141 5142
- Issue #15394: An issue in `PyModule_Create()` that caused references to be
  leaked on some error paths has been fixed.  Patch by Julia Lawall.
5143

Georg Brandl's avatar
Georg Brandl committed
5144 5145
- Issue #15368: An issue that caused bytecode generation to be non-deterministic
  has been fixed.
5146

Georg Brandl's avatar
Georg Brandl committed
5147 5148
- Issue #15202: Consistently use the name "follow_symlinks" for new parameters
  in os and shutil functions.
5149

5150
- Issue #15314: ``__main__.__loader__`` is now set correctly during interpreter
Georg Brandl's avatar
Georg Brandl committed
5151
  startup.
5152

5153 5154 5155 5156
- Issue #15111: When a module imported using 'from import' has an ImportError
  inside itself, don't mask that fact behind a generic ImportError for the
  module itself.

5157 5158
- Issue #15293: Add GC support to the AST base node type.

5159 5160 5161
- Issue #15291: Fix a memory leak where AST nodes where not properly
  deallocated.

Georg Brandl's avatar
Georg Brandl committed
5162 5163
- Issue #15110: Fix the tracebacks generated by "import xxx" to not show the
  importlib stack frames.
5164

5165
- Issue #16369: Global PyTypeObjects not initialized with PyType_Ready(...).
Ronald Oussoren's avatar
Ronald Oussoren committed
5166

5167 5168 5169
- Issue #15020: The program name used to search for Python's path is now
  "python3" under Unix, not "python".

5170 5171
- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.
5172

Ezio Melotti's avatar
Ezio Melotti committed
5173
- Issue #15033: Fix the exit status bug when modules invoked using -m switch,
5174 5175
  return the proper failure return value (1). Patch contributed by Jeff Knupp.

5176
- Issue #15229: An `OSError` subclass whose __init__ doesn't call back
Georg Brandl's avatar
Georg Brandl committed
5177 5178
  OSError.__init__ could produce incomplete instances, leading to crashes when
  calling str() on them.
5179

Ezio Melotti's avatar
Ezio Melotti committed
5180
- Issue #15307: Virtual environments now use symlinks with framework builds on
Georg Brandl's avatar
Georg Brandl committed
5181
  Mac OS X, like other POSIX builds.
5182

5183 5184 5185
Library
-------

5186 5187 5188
- Issue #14590: configparser now correctly strips inline comments when delimiter
  occurs earlier without preceding space.

5189
- Issue #15424: Add a `__sizeof__()` implementation for array objects.  Patch by
Georg Brandl's avatar
Georg Brandl committed
5190
  Ludwig Hähne.
5191

5192 5193
- Issue #15576: Allow extension modules to act as a package's __init__ module.

5194 5195
- Issue #15502: Have `importlib.invalidate_caches()` work on `sys.meta_path`
  instead of `sys.path_importer_cache`.
5196

5197 5198
- Issue #15163: Pydoc shouldn't list __loader__ as module data.

5199
- Issue #15471: Do not use mutable objects as defaults for
5200
  `importlib.__import__()`.
5201

5202
- Issue #15559: To avoid a problematic failure mode when passed to the bytes
5203 5204
  constructor, objects in the ipaddress module no longer implement `__index__()`
  (they still implement `__int__()` as appropriate).
5205

5206 5207
- Issue #15546: Fix handling of pathological input data in the peek() and
  read1() methods of the BZ2File, GzipFile and LZMAFile classes.
5208

5209 5210 5211
- Issue #12655: Instead of requiring a custom type, `os.sched_getaffinity()` and
  `os.sched_setaffinity()` now use regular sets of integers to represent the
  CPUs a process is restricted to.
5212

5213 5214
- Issue #15538: Fix compilation of the `socket.getnameinfo()` /
  `socket.getaddrinfo()` emulation code.  Patch by Philipp Hagemeister.
5215

Georg Brandl's avatar
Georg Brandl committed
5216
- Issue #15519: Properly expose WindowsRegistryFinder in importlib (and use the
5217
  correct term for it).  Original patch by Eric Snow.
5218

Georg Brandl's avatar
Georg Brandl committed
5219
- Issue #15502: Bring the importlib ABCs into line with the current state of the
5220
  import protocols given PEP 420.  Original patch by Eric Snow.
5221

Georg Brandl's avatar
Georg Brandl committed
5222 5223
- Issue #15499: Launching a webbrowser in Unix used to sleep for a few seconds.
  Original patch by Anton Barkovsky.
5224

Georg Brandl's avatar
Georg Brandl committed
5225 5226
- Issue #15463: The faulthandler module truncates strings to 500 characters,
  instead of 100, to be able to display long file paths.
5227

5228
- Issue #6056: Make `multiprocessing` use setblocking(True) on the sockets it
Georg Brandl's avatar
Georg Brandl committed
5229
  uses.  Original patch by J Derek Wilson.
5230

Georg Brandl's avatar
Georg Brandl committed
5231
- Issue #15364: Fix sysconfig.get_config_var('srcdir') to be an absolute path.
5232

5233
- Issue #15413: `os.times()` had disappeared under Windows.
5234

5235
- Issue #15402: An issue in the struct module that caused `sys.getsizeof()` to
Georg Brandl's avatar
Georg Brandl committed
5236 5237
  return incorrect results for struct.Struct instances has been fixed.  Initial
  patch by Serhiy Storchaka.
5238

5239 5240 5241
- Issue #15232: When mangle_from is True, `email.Generator` now correctly
  mangles lines that start with 'From ' that occur in a MIME preamble or
  epilogue.
5242

Georg Brandl's avatar
Georg Brandl committed
5243 5244
- Issue #15094: Incorrectly placed #endif in _tkinter.c.  Patch by Serhiy
  Storchaka.
5245

5246
- Issue #13922: `argparse` no longer incorrectly strips '--'s that appear after
Georg Brandl's avatar
Georg Brandl committed
5247
  the first one.
5248

5249
- Issue #12353: `argparse` now correctly handles null argument values.
5250

Georg Brandl's avatar
Georg Brandl committed
5251
- Issue #10017, issue #14998: Fix TypeError using pprint on dictionaries with
5252
  user-defined types as keys or other unorderable keys.
5253

5254 5255
- Issue #15397: `inspect.getmodulename()` is now based directly on importlib via
  a new `importlib.machinery.all_suffixes()` API.
5256

5257
- Issue #14635: `telnetlib` will use poll() rather than select() when possible to
Georg Brandl's avatar
Georg Brandl committed
5258
  avoid failing due to the select() file descriptor limit.
5259

Georg Brandl's avatar
Georg Brandl committed
5260
- Issue #15180: Clarify posixpath.join() error message when mixing str & bytes.
5261

Georg Brandl's avatar
Georg Brandl committed
5262 5263 5264
- Issue #15343: pkgutil now includes an iter_importer_modules implementation for
  importlib.machinery.FileFinder (similar to the way it already handled
  zipimport.zipimporter).
5265

Georg Brandl's avatar
Georg Brandl committed
5266
- Issue #15314: runpy now sets __main__.__loader__ correctly.
5267

Georg Brandl's avatar
Georg Brandl committed
5268 5269
- Issue #15357: The import emulation in pkgutil is now deprecated. pkgutil uses
  importlib internally rather than the emulation.
5270

Georg Brandl's avatar
Georg Brandl committed
5271 5272
- Issue #15233: Python now guarantees that callables registered with the atexit
  module will be called in a deterministic order.
5273

5274
- Issue #15238: `shutil.copystat()` now copies Linux "extended attributes".
5275

Georg Brandl's avatar
Georg Brandl committed
5276 5277
- Issue #15230: runpy.run_path now correctly sets __package__ as described in
  the documentation.
Nick Coghlan's avatar
Nick Coghlan committed
5278

5279 5280
- Issue #15315: Support VS 2010 in distutils cygwincompiler.

Georg Brandl's avatar
Georg Brandl committed
5281 5282
- Issue #15294: Fix a regression in pkgutil.extend_path()'s handling of nested
  namespace packages.
5283

5284 5285
- Issue #15056: `imp.cache_from_source()` and `imp.source_from_cache()` raise
  NotImplementedError when `sys.implementation.cache_tag` is set to None.
5286

5287
- Issue #15256: Grammatical mistake in exception raised by `imp.find_module()`.
5288

5289
- Issue #5931: `wsgiref` environ variable SERVER_SOFTWARE will specify an
Georg Brandl's avatar
Georg Brandl committed
5290
  implementation specific term like CPython, Jython instead of generic "Python".
5291

Georg Brandl's avatar
Georg Brandl committed
5292 5293
- Issue #13248: Remove obsolete argument "max_buffer_size" of BufferedWriter and
  BufferedRWPair, from the io module.
5294

5295
- Issue #13248: Remove obsolete argument "version" of `argparse.ArgumentParser`.
5296

Georg Brandl's avatar
Georg Brandl committed
5297 5298
- Issue #14814: Implement more consistent ordering and sorting behaviour for
  ipaddress objects.
5299

5300
- Issue #14814: `ipaddress` network objects correctly return NotImplemented when
Georg Brandl's avatar
Georg Brandl committed
5301
  compared to arbitrary objects instead of raising TypeError.
5302

Georg Brandl's avatar
Georg Brandl committed
5303
- Issue #14990: Correctly fail with SyntaxError on invalid encoding declaration.
Florent Xicluna's avatar
Florent Xicluna committed
5304

5305
- Issue #14814: `ipaddress` now provides more informative error messages when
5306
  constructing instances directly (changes permitted during beta due to
Georg Brandl's avatar
Georg Brandl committed
5307
  provisional API status).
5308

5309 5310
- Issue #15247: `io.FileIO` now raises an error when given a file descriptor
  pointing to a directory.
5311

5312 5313
- Issue #15261: Stop os.stat(fd) crashing on Windows when fd not open.

5314
- Issue #15166: Implement `imp.get_tag()` using `sys.implementation.cache_tag`.
5315

5316
- Issue #15210: Catch KeyError when `importlib.__init__()` can't find
5317 5318
  _frozen_importlib in sys.modules, not ImportError.

5319
- Issue #15030: `importlib.abc.PyPycLoader` now supports the new source size
5320 5321
  header field in .pyc files.

Georg Brandl's avatar
Georg Brandl committed
5322 5323
- Issue #5346: Preserve permissions of mbox, MMDF and Babyl mailbox files on
  flush().
5324

Georg Brandl's avatar
Georg Brandl committed
5325 5326
- Issue #10571: Fix the "--sign" option of distutils' upload command.  Patch by
  Jakub Wilk.
5327

Georg Brandl's avatar
Georg Brandl committed
5328 5329 5330
- Issue #9559: If messages were only added, a new file is no longer created and
  renamed over the old file when flush() is called on an mbox, MMDF or Babyl
  mailbox.
5331

Ezio Melotti's avatar
Ezio Melotti committed
5332
- Issue #10924: Fixed `crypt.mksalt()` to use a RNG that is suitable for
Georg Brandl's avatar
Georg Brandl committed
5333
  cryptographic purpose.
5334

Georg Brandl's avatar
Georg Brandl committed
5335 5336 5337 5338
- Issue #15184: Ensure consistent results of OS X configuration tailoring for
  universal builds by factoring out common OS X-specific customizations from
  sysconfig, distutils.sysconfig, distutils.util, and distutils.unixccompiler
  into a new module _osx_support.
5339

5340 5341 5342
C API
-----

5343
- Issue #15610: `PyImport_ImportModuleEx()` now uses a 'level' of 0 instead of -1.
5344

5345 5346
- Issue #15169, issue #14599: Strip out the C implementation of
  `imp.source_from_cache()` used by PyImport_ExecCodeModuleWithPathnames() and
5347 5348 5349 5350
  used the Python code instead. Leads to PyImport_ExecCodeModuleObject() to not
  try to infer the source path from the bytecode path as
  PyImport_ExecCodeModuleWithPathnames() does.

5351 5352 5353
Extension Modules
-----------------

5354 5355
- Issue #6493: An issue in ctypes on Windows that caused structure bitfields of
  type `ctypes.c_uint32` and width 32 to incorrectly be set has been fixed.
5356

5357 5358
- Issue #15194: Update libffi to the 3.0.11 release.

5359 5360 5361 5362 5363 5364
IDLE
----

- Issue #13052: Fix IDLE crashing when replace string in Search/Replace dialog
  ended with ``\``.  Patch by Roger Serwy.

5365 5366 5367
Tools/Demos
-----------

Georg Brandl's avatar
Georg Brandl committed
5368 5369
- Issue #15458: python-config gets a new option --configdir to print the $LIBPL
  value.
5370

5371 5372
- Move importlib.test.benchmark to Tools/importbench.

Georg Brandl's avatar
Georg Brandl committed
5373 5374 5375
- Issue #12605: The gdb hooks for debugging CPython (within Tools/gdb) have been
  enhanced to show information on more C frames relevant to CPython within the
  "py-bt" and "py-bt-full" commands:
Georg Brandl's avatar
Georg Brandl committed
5376 5377 5378 5379

  * C frames that are waiting on the GIL
  * C frames that are garbage-collecting
  * C frames that are due to the invocation of a PyCFunction
5380

5381 5382 5383
Documentation
-------------

5384 5385
- Issue #15041: Update "see also" list in tkinter documentation.

5386 5387
- Issue #15444: Use proper spelling for non-ASCII contributor names.  Patch by
  Serhiy Storchaka.
5388

5389
- Issue #15295: Reorganize and rewrite the documentation on the import system.
Barry Warsaw's avatar
Barry Warsaw committed
5390

Georg Brandl's avatar
Georg Brandl committed
5391 5392
- Issue #15230: Clearly document some of the limitations of the runpy module and
  nudge readers towards importlib when appropriate.
5393

5394 5395 5396
- Issue #15053: Copy Python 3.3 import lock change notice to all relevant
  functions in imp instead of just at the top of the relevant section.

5397 5398 5399 5400 5401
- Issue #15288: Link to the term "loader" in notes in pkgutil about how things
  won't work as expected in Python 3.3 and mark the requisite functions as
  "changed" since they will no longer work with modules directly imported by
  import itself.

5402 5403
- Issue #13557: Clarify effect of giving two different namespaces to `exec()` or
  `execfile()`.
5404

5405
- Issue #15250: Document that `filecmp.dircmp()` compares files shallowly. Patch
5406
  contributed by Chris Jerdonek.
5407

5408 5409 5410 5411
- Issue #15442: Expose the default list of directories ignored by
  `filecmp.dircmp()` as a module attribute, and expand the list to more modern
  values.

5412 5413 5414
Tests
-----

5415 5416
- Issue #15467: Move helpers for `__sizeof__()` tests into test_support.  Patch
  by Serhiy Storchaka.
5417

Georg Brandl's avatar
Georg Brandl committed
5418 5419
- Issue #15320: Make iterating the list of tests thread-safe when running tests
  in multiprocess mode. Patch by Chris Jerdonek.
5420

5421
- Issue #15168: Move `importlib.test` to `test.test_importlib`.
5422

5423
- Issue #15091: Reactivate a test on UNIX which was failing thanks to a
5424
  forgotten `importlib.invalidate_caches()` call.
5425 5426

- Issue #15230: Adopted a more systematic approach in the runpy tests.
Nick Coghlan's avatar
Nick Coghlan committed
5427

5428 5429 5430 5431
- Issue #15300: Ensure the temporary test working directories are in the same
  parent folder when running tests in multiprocess mode from a Python build.
  Patch by Chris Jerdonek.

5432 5433 5434
- Issue #15284: Skip {send,recv}msg tests in test_socket when IPv6 is not
  enabled. Patch by Brian Brazil.

Georg Brandl's avatar
Georg Brandl committed
5435 5436
- Issue #15277: Fix a resource leak in support.py when IPv6 is disabled.  Patch
  by Brian Brazil.
5437

5438 5439 5440
Build
-----

Georg Brandl's avatar
Georg Brandl committed
5441 5442
- Issue #11715: Fix multiarch detection without having Debian development tools
  (dpkg-dev) installed.
5443

5444 5445 5446 5447
- Issue #15037: Build OS X installers with local copy of ncurses 5.9 libraries
  to avoid curses.unget_wch bug present in older versions of ncurses such as
  those shipped with OS X.

Georg Brandl's avatar
Georg Brandl committed
5448 5449 5450 5451
- Issue #15560: Fix building _sqlite3 extension on OS X with an SDK.  Also, for
  OS X installers, ensure consistent sqlite3 behavior and feature availability
  by building a local copy of libsqlite3 rather than depending on the wide range
  of versions supplied with various OS X releases.
5452

5453
- Issue #8847: Disable COMDAT folding in Windows PGO builds.
5454

5455 5456
- Issue #14018: Fix OS X Tcl/Tk framework checking when using OS X SDKs.

Ned Deily's avatar
Ned Deily committed
5457
- Issue #16256: OS X installer now sets correct permissions for doc directory.
5458

Georg Brandl's avatar
Georg Brandl committed
5459 5460
- Issue #15431: Add _freeze_importlib project to regenerate importlib.h on
  Windows. Patch by Kristján Valur Jónsson.
5461

Georg Brandl's avatar
Georg Brandl committed
5462 5463
- Issue #14197: For OS X framework builds, ensure links to the shared library
  are created with the proper ABI suffix.
5464

5465 5466 5467
- Issue #14330: For cross builds, don't use host python, use host search paths
  for host compiler.

5468 5469
- Issue #15235: Allow Berkley DB versions up to 5.3 to build the dbm module.

5470 5471
- Issue #15268: Search curses.h in /usr/include/ncursesw.

5472

5473
What's New in Python 3.3.0 Beta 1?
Georg Brandl's avatar
Georg Brandl committed
5474
==================================
5475

Georg Brandl's avatar
Georg Brandl committed
5476
*Release date: 27-Jun-2012*
5477

Barry Warsaw's avatar
Barry Warsaw committed
5478 5479 5480
Core and Builtins
-----------------

5481 5482 5483
- Fix a (most likely) very rare memory leak when calling main() and not being
  able to decode a command-line argument.

5484 5485 5486
- Issue #14815: Use Py_ssize_t instead of long for the object hash, to
  preserve all 64 bits of hash on Win64.

5487 5488 5489 5490 5491
- Issue #12268: File readline, readlines and read() or readall() methods
  no longer lose data when an underlying read system call is interrupted.
  IOError is no longer raised due to a read system call returning EINTR
  from within these methods.

5492 5493
- Issue #11626: Add _SizeT functions to stable ABI.

5494 5495 5496
- Issue #15142: Fix reference leak when deallocating instances of types
  created using PyType_FromSpec().

5497 5498 5499
- Issue #10053: Don't close FDs when FileIO.__init__ fails. Loosely based on
  the work by Hirokazu Yamamoto.

5500 5501 5502
- Issue #15096: Removed support for ur'' as the raw notation isn't
  compatible with Python 2.x's raw unicode strings.

5503 5504
- Issue #13783: Generator objects now use the identifier APIs internally

5505 5506 5507
- Issue #14874: Restore charmap decoding speed to pre-PEP 393 levels.
  Patch by Serhiy Storchaka.

5508 5509 5510
- Issue #15026: utf-16 encoding is now significantly faster (up to 10x).
  Patch by Serhiy Storchaka.

5511 5512 5513 5514 5515 5516
- Issue #11022: open() and io.TextIOWrapper are now calling
  locale.getpreferredencoding(False) instead of locale.getpreferredencoding()
  in text mode if the encoding is not specified. Don't change temporary the
  locale encoding using locale.setlocale(), use the current locale encoding
  instead of the user preferred encoding.

Barry Warsaw's avatar
Barry Warsaw committed
5517 5518
- Issue #14673: Add Eric Snow's sys.implementation implementation.

5519 5520
- Issue #15038: Optimize python Locks on Windows.

5521 5522 5523
Library
-------

5524 5525
- Issue #12288: Consider '0' and '0.0' as valid initialvalue
  for tkinter SimpleDialog.
5526

5527 5528
- Issue #15512: Add a __sizeof__ implementation for parser.
  Patch by Serhiy Storchaka.
5529

5530 5531
- Issue #15469: Add a __sizeof__ implementation for deque objects.
  Patch by Serhiy Storchaka.
R David Murray's avatar
R David Murray committed
5532

5533 5534
- Issue #15489: Add a __sizeof__ implementation for BytesIO objects.
  Patch by Serhiy Storchaka.
5535

5536 5537
- Issue #15487: Add a __sizeof__ implementation for buffered I/O objects.
  Patch by Serhiy Storchaka.
5538

5539 5540 5541
- Issue #15514: Correct __sizeof__ support for cpu_set.
  Patch by Serhiy Storchaka.

5542 5543
- Issue #15177: Added dir_fd parameter to os.fwalk().

5544 5545 5546 5547
- Issue #15061: Re-implemented hmac.compare_digest() in C to prevent further
  timing analysis and to support all buffer protocol aware objects as well as
  ASCII only str instances safely.

5548 5549
- Issue #15164: Change return value of platform.uname() from a
  plain tuple to a collections.namedtuple.
5550

5551 5552 5553 5554
- Support Mageia Linux in the platform module.

- Issue #11678: Support Arch linux in the platform module.

5555 5556 5557 5558
- Issue #15118: Change return value of os.uname() and os.times() from
  plain tuples to immutable iterable objects with named attributes
  (structseq objects).

5559 5560 5561 5562
- Speed up _decimal by another 10-15% by caching the thread local context
  that was last accessed. In the pi benchmark (64-bit platform, prec=9),
  _decimal is now only 1.5x slower than float.

5563 5564
- Remove the packaging module, which is not ready for prime time.

5565 5566 5567
- Issue #15154: Add "dir_fd" parameter to os.rmdir, remove "rmdir"
  parameter from os.remove / os.unlink.

Hynek Schlawack's avatar
Hynek Schlawack committed
5568
- Issue #4489: Add a shutil.rmtree that isn't susceptible to symlink attacks.
5569 5570 5571
  It is used automatically on platforms supporting the necessary os.openat()
  and os.unlinkat() functions. Main code by Martin von Löwis.

5572 5573
- Issue #15156: HTMLParser now uses the new "html.entities.html5" dictionary.

5574 5575 5576 5577
- Issue #11113: add a new "html5" dictionary containing the named character
  references defined by the HTML5 standard and the equivalent Unicode
  character(s) to the html.entities module.

5578 5579 5580
- Issue #15114: the strict mode of HTMLParser and the HTMLParseError exception
  are deprecated now that the parser is able to parse invalid markup.

5581 5582 5583
- Issue #3665: \u and \U escapes are now supported in unicode regular
  expressions.  Patch by Serhiy Storchaka.

5584 5585 5586
- Issue #15153: Added inspect.getgeneratorlocals to simplify white box
  testing of generator state updates

5587 5588 5589 5590
- Issue #13062: Added inspect.getclosurevars to simplify testing stateful
  closures

- Issue #11024: Fixes and additional tests for Time2Internaldate.
5591

5592 5593
- Issue #14626: Large refactoring of functions / parameters in the os module.
  Many functions now support "dir_fd" and "follow_symlinks" parameters;
5594
  some also support accepting an open file descriptor in place of a path
5595 5596 5597 5598 5599
  string.  Added os.support_* collections as LBYL helpers.  Removed many
  functions only previously seen in 3.3 alpha releases (often starting with
  "f" or "l", or ending with "at").  Originally suggested by Serhiy Storchaka;
  implemented by Larry Hastings.

5600 5601 5602
- Issue #15008: Implement PEP 362 "Signature Objects".
  Patch by Yury Selivanov.

5603 5604
- Issue: #15138: base64.urlsafe_{en,de}code() are now 3-4x faster.

5605 5606 5607 5608
- Issue #444582: Add shutil.which, for finding programs on the system path.
  Original patch by Erik Demaine, with later iterations by Jan Killian
  and Brian Curtin.

5609 5610 5611 5612
- Issue #14837: SSL errors now have ``library`` and ``reason`` attributes
  describing precisely what happened and in which OpenSSL submodule.  The
  str() of a SSLError is also enhanced accordingly.

5613 5614 5615
- Issue #9527: datetime.astimezone() method will now supply a class
  timezone instance corresponding to the system local timezone when
  called with no arguments.
5616

5617 5618
- Issue #14653: email.utils.mktime_tz() no longer relies on system
  mktime() when timezone offest is supplied.
5619

5620 5621 5622
- Issue #14684: zlib.compressobj() and zlib.decompressobj() now support the use
  of predefined compression dictionaries. Original patch by Sam Rushing.

5623
- Fix GzipFile's handling of filenames given as bytes objects.
5624

5625 5626
- Issue #14772: Return destination values from some shutil functions.

5627 5628
- Issue #15064: Implement context manager protocol for multiprocessing types

5629
- Issue #15101: Make pool finalizer avoid joining current thread.
5630

5631 5632 5633
- Issue #14657: The frozen instance of importlib used for bootstrap is now
  also the module imported as importlib._bootstrap.

5634 5635
- Issue #14055: Add __sizeof__ support to _elementtree.

5636 5637 5638 5639
- Issue #15054: A bug in tokenize.tokenize that caused string literals
  with 'b' prefixes to be incorrectly tokenized has been fixed.
  Patch by Serhiy Storchaka.

5640 5641
- Issue #15006: Allow equality comparison between naive and aware
  time or datetime objects.
5642

Petri Lehtinen's avatar
Petri Lehtinen committed
5643 5644 5645
- Issue #15036: Mailbox no longer throws an error if a flush is done
  between operations when removing or changing multiple items in mbox,
  MMDF, or Babyl mailboxes.
5646

5647 5648
- Issue #14059: Implement multiprocessing.Barrier.

5649
- Issue #15061: The inappropriately named hmac.secure_compare has been
Nick Coghlan's avatar
Nick Coghlan committed
5650 5651
  renamed to hmac.compare_digest, restricted to operating on bytes inputs
  only and had its documentation updated to more accurately reflect both its
5652 5653
  intent and its limitations

5654 5655
- Issue #13841: Make child processes exit using sys.exit() on Windows.

5656
- Issue #14936: curses_panel was converted to PEP 3121 and PEP 384 API.
5657 5658
  Patch by Robin Schreiber.

5659 5660 5661 5662 5663
- Issue #1667546: On platforms supporting tm_zone and tm_gmtoff fields
  in struct tm, time.struct_time objects returned by time.gmtime(),
  time.localtime() and time.strptime() functions now have tm_zone and
  tm_gmtoff attributes.  Original patch by Paul Boddie.

5664 5665
- Rename adjusted attribute to adjustable in time.get_clock_info() result.

5666 5667 5668
- Issue #3518: Remove references to non-existent BaseManager.from_address()
  method.

5669 5670 5671
- Issue #13857: Added textwrap.indent() function (initial patch by Ezra
  Berch)

5672 5673
- Issue #2736: Added datetime.timestamp() method.

5674 5675
- Issue #13854: Make multiprocessing properly handle non-integer
  non-string argument to SystemExit.
5676

5677 5678
- Issue #12157: Make pool.map() empty iterables correctly.  Initial
  patch by mouad.
5679

5680 5681
- Issue #11823: disassembly now shows argument counts on calls with keyword args.

5682 5683
- Issue #14711: os.stat_float_times() has been deprecated.

5684 5685
- LZMAFile now accepts the modes "rb"/"wb"/"ab" as synonyms of "r"/"w"/"a".

5686 5687
- The bz2 and lzma modules now each contain an open() function, allowing
  compressed files to readily be opened in text mode as well as binary mode.
5688

5689 5690
- BZ2File.__init__() and LZMAFile.__init__() now accept a file object as their
  first argument, rather than requiring a separate "fileobj" argument.
5691

5692 5693
- gzip.open() now accepts file objects as well as filenames.

5694 5695 5696 5697 5698
- Issue #14992: os.makedirs(path, exist_ok=True) would raise an OSError
  when the path existed and had the S_ISGID mode bit set when it was
  not explicitly asked for.  This is no longer an exception as mkdir
  cannot control if the OS sets that bit for it or not.

5699 5700 5701
- Issue #14989: Make the CGI enable option to http.server available via command
  line.

5702 5703
- Issue #14987: Add a missing import statement to inspect.

5704 5705 5706 5707
- Issue #1079: email.header.decode_header now correctly parses all the examples
  in RFC2047.  There is a necessary visible behavior change: the leading and/or
  trailing whitespace on ASCII parts is now preserved.

5708 5709
- Issue #14969: Better handling of exception chaining in contextlib.ExitStack

5710 5711 5712
- Issue #14963: Convert contextlib.ExitStack.__exit__ to use an iterative
  algorithm (Patch by Alon Horev)

5713 5714 5715
- Issue #14785: Add sys._debugmallocstats() to help debug low-level memory
  allocation issues

5716 5717 5718
- Issue #14443: Ensure that .py files are byte-compiled with the correct Python
  executable within bdist_rpm even on older versions of RPM

5719 5720 5721
C-API
-----

5722 5723 5724 5725 5726
- Issue #15146: Add PyType_FromSpecWithBases. Patch by Robin Schreiber.

- Issue #15042: Add PyState_AddModule and PyState_RemoveModule. Add version
  guard for Py_LIMITED_API additions. Patch by Robin Schreiber.

5727 5728 5729
- Issue #13783: Inadvertent additions to the public C API in the PEP 380
  implementation have either been removed or marked as private interfaces.

5730 5731
Extension Modules
-----------------
5732

5733
- Issue #15000: Support the "unique" x32 architecture in _posixsubprocess.c.
5734

5735 5736 5737 5738 5739 5740 5741 5742 5743
IDLE
----

- Issue #9803: Don't close IDLE on saving if breakpoint is open.
  Patch by Roger Serwy.

- Issue #14962: Update text coloring in IDLE shell window after changing
  options.  Patch by Roger Serwy.

5744 5745 5746
Documentation
-------------

5747 5748 5749 5750 5751 5752 5753
- Issue #15176: Clarified behavior, documentation, and implementation
  of os.listdir().

- Issue #14982: Document that pkgutil's iteration functions require the
  non-standard iter_modules() method to be defined by an importer (something
  the importlib importers do not define).

5754 5755 5756
- Issue #15081: Document PyState_FindModule.
  Patch by Robin Schreiber.

5757 5758
- Issue #14814: Added first draft of ipaddress module API reference

5759 5760 5761
Tests
-----

5762 5763 5764
- Issue #15187: Bugfix: remove temporary directories test_shutil was leaving
  behind.

5765 5766 5767 5768
- Issue #14769: test_capi now has SkipitemTest, which cleverly checks
  for "parity" between PyArg_ParseTuple() and the Python/getargs.c static
  function skipitem() for all possible "format units".

5769 5770 5771
- test_nntplib now tolerates being run from behind NNTP gateways that add
  "X-Antivirus" headers to articles

5772 5773 5774 5775
- Issue #15043: test_gdb is now skipped entirely if gdb security settings
  block loading of the gdb hooks

- Issue #14963: Add test cases for exception handling behaviour
5776
  in contextlib.ExitStack (Initial patch by Alon Horev)
5777

5778 5779 5780
Build
-----

5781 5782 5783 5784 5785 5786 5787 5788 5789 5790 5791 5792 5793 5794 5795
- Issue #13590: Improve support for OS X Xcode 4:
    * Try to avoid building Python or extension modules with problematic
      llvm-gcc compiler.
    * Since Xcode 4 removes ppc support, extension module builds now
      check for ppc compiler support and automatically remove ppc and
      ppc64 archs when not available.
    * Since Xcode 4 no longer install SDKs in default locations,
      extension module builds now revert to using installed headers
      and libs if the SDK used to build the interpreter is not
      available.
    * Update ./configure to use better defaults for universal builds;
      in particular, --enable-universalsdk=yes uses the Xcode default
      SDK and --with-universal-archs now defaults to "intel" if ppc
      not available.

5796 5797
- Issue #14225: Fix Unicode support for curses (#12567) on OS X

5798 5799 5800
- Issue #14928: Fix importlib bootstrap issues by using a custom executable
  (Modules/_freeze_importlib) to build Python/importlib.h.

Georg Brandl's avatar
Georg Brandl committed
5801

5802 5803 5804
What's New in Python 3.3.0 Alpha 4?
===================================

Georg Brandl's avatar
Georg Brandl committed
5805
*Release date: 31-May-2012*
5806 5807 5808 5809

Core and Builtins
-----------------

5810 5811 5812
- Issue #14835: Make plistlib output empty arrays & dicts like OS X.
  Patch by Sidney San Martín.

5813 5814 5815
- Issue #14744: Use the new _PyUnicodeWriter internal API to speed up
  str%args and str.format(args).

5816 5817
- Issue #14930: Make memoryview objects weakrefable.

5818 5819 5820
- Issue #14775: Fix a potential quadratic dict build-up due to the garbage
  collector repeatedly trying to untrack dicts.

5821 5822 5823
- Issue #14857: fix regression in references to PEP 3135 implicit __class__
  closure variable (Reopens issue #12370)

Vinay Sajip's avatar
Vinay Sajip committed
5824 5825
- Issue #14712 (PEP 405): Virtual environments. Implemented by Vinay Sajip.

5826 5827
- Issue #14660 (PEP 420): Namespace packages. Implemented by Eric Smith.

5828 5829 5830 5831
- Issue #14494: Fix __future__.py and its documentation to note that
  absolute imports are the default behavior in 3.0 instead of 2.7.
  Patch by Sven Marnach.

5832 5833 5834 5835
- Issue #9260: A finer-grained import lock.  Most of the import sequence
  now uses per-module locks rather than the global import lock, eliminating
  well-known issues with threads and imports.

5836 5837 5838
- Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs.
  Patch by Serhiy Storchaka.

Martin v. Löwis's avatar
Martin v. Löwis committed
5839 5840
- asdl_seq and asdl_int_seq are now Py_ssize_t sized.

5841 5842 5843
- Issue #14133 (PEP 415): Implement suppression of __context__ display with an
  attribute on BaseException. This replaces the original mechanism of PEP 409.

5844 5845 5846
- Issue #14417: Mutating a dict during lookup now restarts the lookup instead
  of raising a RuntimeError (undoes issue #14205).

5847 5848 5849
- Issue #14738: Speed-up UTF-8 decoding on non-ASCII data.  Patch by Serhiy
  Storchaka.

5850 5851 5852
- Issue #14700: Fix two broken and undefined-behaviour-inducing overflow checks
  in old-style string formatting.

5853 5854 5855
Library
-------

5856 5857 5858
- Issue #14690: Use monotonic clock instead of system clock in the sched,
  subprocess and trace modules.

5859 5860 5861
- Issue #14443: Tell rpmbuild to use the correct version of Python in
  bdist_rpm. Initial patch by Ross Lagerwall.

5862 5863 5864 5865 5866 5867 5868
- Issue #12515: email now registers a defect if it gets to EOF while parsing
  a MIME part without seeing the closing MIME boundary.

- Issue #1672568: email now always decodes base64 payloads, adding padding and
  ignoring non-base64-alphabet characters if needed, and registering defects
  for any such problems.

5869 5870 5871 5872
- Issue #14925: email now registers a defect when the parser decides that there
  is a missing header/body separator line.  MalformedHeaderDefect, which the
  existing code would never actually generate, is deprecated.

5873 5874
- Issue #10365: File open dialog now works instead of crashing even when
  the parent window is closed before the dialog. Patch by Roger Serwy.
5875

5876 5877 5878
- Issue #8739: Updated smtpd to support RFC 5321, and added support for the
  RFC 1870 SIZE extension.

5879 5880 5881
- Issue #665194: Added a localtime function to email.utils to provide an
  aware local datetime for use in setting Date headers.

5882 5883 5884 5885 5886 5887 5888 5889
- Issue #12586: Added new provisional policies that implement convenient
  unicode support for email headers.  See What's New for details.

- Issue #14731: Refactored email Policy framework to support full backward
  compatibility with Python 3.2 by default yet allow for the introduction of
  new features through new policies.  Note that Policy.must_be_7bit is renamed
  to cte_type.

5890 5891
- Issue #14876: Use user-selected font for highlight configuration.

5892 5893 5894
- Issue #14920: Fix the help(urllib.parse) failure on locale C on terminals.
  Have ascii characters in help.

5895 5896 5897
- Issue #14548: Make multiprocessing finalizers check pid before
  running to cope with possibility of gc running just after fork.

5898 5899 5900
- Issue #14036: Add an additional check to validate that port in urlparse does
  not go in illegal range and returns None.

5901 5902
- Issue #14862: Add missing names to os.__all__

5903 5904
- Issue #14875: Use float('inf') instead of float('1e66666') in the json module.

5905 5906
- Issue #13585: Added contextlib.ExitStack

5907 5908
- PEP 3144, Issue #14814: Added the ipaddress module

Senthil Kumaran's avatar
Senthil Kumaran committed
5909 5910 5911
- Issue #14426: Correct the Date format in Expires attribute of Set-Cookie
  Header in Cookie.py.

5912 5913 5914 5915
- Issue #14588: The types module now provide new_class() and prepare_class()
  functions to support PEP 3115 compliant dynamic class creation. Patch by
  Daniel Urban and Nick Coghlan.

5916 5917 5918
- Issue #13152: Allow to specify a custom tabsize for expanding tabs in
  textwrap. Patch by John Feuerstein.

5919 5920 5921
- Issue #14721: Send the correct 'Content-length: 0' header when the body is an
  empty string ''. Initial Patch contributed by Arve Knudsen.

5922 5923 5924
- Issue #14072: Fix parsing of 'tel' URIs in urlparse by making the check for
  ports stricter.

5925 5926 5927
- Issue #9374: Generic parsing of query and fragment portions of url for any
  scheme. Supported both by RFC3986 and RFC2396.

5928 5929 5930 5931
- Issue #14798: Fix the functions in pyclbr to raise an ImportError
  when the first part of a dotted name is not a package. Patch by
  Xavier de Gaye.

5932 5933 5934 5935
- Issue #12098: multiprocessing on Windows now starts child processes
  using the same sys.flags as the current process.  Initial patch by
  Sergey Mezentsev.

5936 5937 5938
- Issue #13031: Small speed-up for tarfile when unzipping tarfiles.
  Patch by Justin Peel.

5939 5940 5941
- Issue #14780: urllib.request.urlopen() now has a ``cadefault`` argument
  to use the default certificate store.  Initial patch by James Oakley.

5942 5943 5944
- Issue #14829: Fix bisect and range() indexing with large indices
  (>= 2 ** 32) under 64-bit Windows.

5945 5946 5947
- Issue #14732: The _csv module now uses PEP 3121 module initialization.
  Patch by Robin Schreiber.

5948 5949 5950
- Issue #14809: Add HTTP status codes introduced by RFC 6585 to http.server
  and http.client. Patch by EungJun Yi.

Ned Deily's avatar
Ned Deily committed
5951 5952 5953 5954 5955
- Issue #14777: tkinter may return undecoded UTF-8 bytes as a string when
  accessing the Tk clipboard.  Modify clipboad_get() to first request type
  UTF8_STRING when no specific type is requested in an X11 windowing
  environment, falling back to the current default type STRING if that fails.
  Original patch by Thomas Kluyver.
5956

5957
- Issue #14773: Fix os.fwalk() failing on dangling symlinks.
5958

5959 5960 5961
- Issue #12541: Be lenient with quotes around Realm field of HTTP Basic
  Authentation in urllib2.

5962
- Issue #14807: move undocumented tarfile.filemode() to stat.filemode() and add
5963 5964
  doc entry. Add tarfile.filemode alias with deprecation warning.

5965 5966
- Issue #13815: TarFile.extractfile() now returns io.BufferedReader objects.

5967
- Issue #14532: Add a secure_compare() helper to the hmac module, to mitigate
5968
  timing attacks. Patch by Jon Oberheide.
5969

5970 5971
- Add importlib.util.resolve_name().

5972 5973 5974
- Issue #14366: Support lzma compression in zip files.
  Patch by Serhiy Storchaka.

5975 5976
- Issue #13959: Introduce importlib.find_loader() and document
  imp.find_module/load_module as deprecated.
5977

5978 5979 5980
- Issue #14082: shutil.copy2() now copies extended attributes, if possible.
  Patch by Hynek Schlawack.

Brett Cannon's avatar
Brett Cannon committed
5981 5982 5983 5984 5985
- Issue #13959: Make importlib.abc.FileLoader.load_module()/get_filename() and
  importlib.machinery.ExtensionFileLoader.load_module() have their single
  argument be optional. Allows for the replacement (and thus deprecation) of
  imp.load_source()/load_package()/load_compiled().

5986 5987 5988 5989 5990
- Issue #13959: imp.get_suffixes() has been deprecated in favour of the new
  attributes on importlib.machinery: SOURCE_SUFFIXES, DEBUG_BYTECODE_SUFFIXES,
  OPTIMIZED_BYTECODE_SUFFIXES, BYTECODE_SUFFIXES, and EXTENSION_SUFFIXES. This
  led to an indirect deprecation of inspect.getmoduleinfo().

5991 5992 5993
- Issue #14662: Prevent shutil failures on OS X when destination does not
  support chflag operations.  Patch by Hynek Schlawack.

5994 5995 5996
- Issue #14157: Fix time.strptime failing without a year on February 29th.
  Patch by Hynek Schlawack.

5997 5998 5999
- Issue #14753: Make multiprocessing's handling of negative timeouts
  the same as it was in Python 3.2.

6000 6001 6002
- Issue #14583: Fix importlib bug when a package's __init__.py would first
  import one of its modules then raise an error.

6003 6004
- Issue #14741: Fix missing support for Ellipsis ('...') in parser module.

6005 6006 6007
- Issue #14697: Fix missing support for set displays and set comprehensions in
  parser module.

6008 6009
- Issue #14701: Fix missing support for 'raise ... from' in parser module.

6010 6011 6012
- Add support for timeouts to the acquire() methods of
  multiprocessing's lock/semaphore/condition proxies.

6013 6014
- Issue #13989: Add support for text mode to gzip.open().

6015
- Issue #14127: The os.stat() result object now provides three additional
Georg Brandl's avatar
Georg Brandl committed
6016 6017 6018 6019
  fields: st_ctime_ns, st_mtime_ns, and st_atime_ns, providing those times as an
  integer with nanosecond resolution.  The functions os.utime(), os.lutimes(),
  and os.futimes() now accept a new parameter, ns, which accepts mtime and atime
  as integers with nanosecond resolution.
6020

Georg Brandl's avatar
Georg Brandl committed
6021 6022
- Issue #14127 and #10148: shutil.copystat now preserves exact mtime and atime
  on filesystems providing nanosecond resolution.
6023

6024 6025 6026 6027 6028 6029 6030 6031 6032 6033 6034 6035 6036 6037 6038
IDLE
----

- Issue #14958: Change IDLE systax highlighting to recognize all string and
  byte literals supported in Python 3.3.

- Issue #10997: Prevent a duplicate entry in IDLE's "Recent Files" menu.

- Issue #14929: Stop IDLE 3.x from closing on Unicode decode errors when
  grepping. Patch by Roger Serwy.

- Issue #12510: Attempting to get invalid tooltip no longer closes IDLE.
  Other tooltipss have been corrected or improved and the number of tests
  has been tripled. Original patch by Roger Serwy.

6039 6040 6041
Tools/Demos
-----------

6042
- Issue #14695: Bring Tools/parser/unparse.py support up to date with
6043 6044
  the Python 3.3 Grammar.

6045 6046 6047
Build
-----

Petri Lehtinen's avatar
Petri Lehtinen committed
6048 6049
- Issue #14472: Update .gitignore. Patch by Matej Cepl.

Martin v. Löwis's avatar
Martin v. Löwis committed
6050 6051
- Upgrade Windows library versions: bzip 1.0.6, OpenSSL 1.0.1c.

6052 6053 6054
- Issue #14693: Under non-Windows platforms, hashlib's fallback modules are
  always compiled, even if OpenSSL is present at build time.

6055 6056
- Issue #13210: Windows build now uses VS2010, ported from VS2008.

6057 6058 6059 6060 6061 6062 6063
C-API
-----

- Issue #14705: The PyArg_Parse() family of functions now support the 'p' format
  unit, which accepts a "boolean predicate" argument.  It converts any Python
  value into an integer--0 if it is "false", and 1 otherwise.

6064 6065 6066
Documentation
-------------

6067 6068 6069
- Issue #14863: Update the documentation of os.fdopen() to reflect the
  fact that it's only a thin wrapper around open() anymore.

6070 6071 6072
- Issue #14588: The language reference now accurately documents the Python 3
  class definition process. Patch by Nick Coghlan.

Brian Curtin's avatar
Brian Curtin committed
6073 6074
- Issue #14943: Correct a default argument value for winreg.OpenKey
  and correctly list the argument names in the function's explanation.
6075

Georg Brandl's avatar
Georg Brandl committed
6076

Georg Brandl's avatar
Georg Brandl committed
6077 6078 6079
What's New in Python 3.3.0 Alpha 3?
===================================

Georg Brandl's avatar
Georg Brandl committed
6080
*Release date: 01-May-2012*
Georg Brandl's avatar
Georg Brandl committed
6081 6082 6083 6084

Core and Builtins
-----------------

6085 6086
- Issue #14699: Fix calling the classmethod descriptor directly.

Georg Brandl's avatar
Georg Brandl committed
6087
- Issue #14433: Prevent msvcrt crash in interactive prompt when stdin is closed.
Georg Brandl's avatar
Georg Brandl committed
6088

Georg Brandl's avatar
Georg Brandl committed
6089 6090
- Issue #14521: Make result of float('nan') and float('-nan') more consistent
  across platforms.
6091

6092 6093
- Issue #14646: __import__() sets __loader__ if the loader did not.

6094 6095 6096
- Issue #14605: No longer have implicit entries in sys.meta_path. If
  sys.meta_path is found to be empty, raise ImportWarning.

6097
- Issue #14605: No longer have implicit entries in sys.path_hooks. If
6098 6099 6100
  sys.path_hooks is found to be empty, a warning will be raised. None is now
  inserted into sys.path_importer_cache if no finder was discovered. This also
  means imp.NullImporter is no longer implicitly used.
6101

6102 6103 6104 6105
- Issue #13903: Implement PEP 412. Individual dictionary instances can now share
  their keys with other dictionaries. Classes take advantage of this to share
  their instance dictionary keys for improved memory and performance.

6106 6107 6108 6109 6110 6111
- Issue #11603 (again): Setting __repr__ to __str__ now raises a RuntimeError
  when repr() or str() is called on such an object.

- Issue #14658: Fix binding a special method to a builtin implementation of a
  special method with a different name.

6112 6113 6114
- Issue #14630: Fix a memory access bug for instances of a subclass of int
  with value 0.

6115 6116 6117
- Issue #14339: Speed improvements to bin, oct and hex functions.  Patch by
  Serhiy Storchaka.

6118 6119 6120 6121 6122
- Issue #14385: It is now possible to use a custom type for the __builtins__
  namespace, instead of a dict. It can be used for sandboxing for example.
  Raise also a NameError instead of ImportError if __build_class__ name if not
  found in __builtins__.

6123 6124 6125 6126
- Issue #12599: Be more strict in accepting None compared to a false-like
  object for importlib.util.module_for_loader and
  importlib.machinery.PathFinder.

6127 6128
- Issue #14612: Fix jumping around with blocks by setting f_lineno.

6129 6130 6131
- Issue #14592: Attempting a relative import w/o __package__ or __name__ set in
  globals raises a KeyError.

Benjamin Peterson's avatar
Benjamin Peterson committed
6132
- Issue #14607: Fix keyword-only arguments which started with ``__``.
6133

6134 6135 6136 6137
- Issue #10854: The ImportError raised when an extension module on Windows
  fails to import now uses the new path and name attributes from
  Issue #1559549.

6138 6139 6140 6141
- Issue #13889: Check and (if necessary) set FPU control word before calling
  any of the dtoa.c string <-> float conversion functions, on MSVC builds of
  Python.  This fixes issues when embedding Python in a Delphi app.

6142 6143 6144
- __import__() now matches PEP 328 and documentation by defaulting 'index' to 0
  instead of -1 and removing support for negative values.

6145 6146
- Issue #2377: Make importlib the implementation of __import__().

6147 6148 6149 6150
- Issue #1559549: ImportError now has 'name' and 'path' attributes that are set
  using keyword arguments to its constructor. They are currently not set by
  import as they are meant for use by importlib.

6151 6152 6153
- Issue #14474: Save and restore exception state in thread.start_new_thread()
  while writing error message if the thread leaves a unhandled exception.

6154 6155 6156
- Issue #13019: Fix potential reference leaks in bytearray.extend().  Patch
  by Suman Saha.

Georg Brandl's avatar
Georg Brandl committed
6157 6158 6159
Library
-------

6160
- Issue #14768: os.path.expanduser('~/a') doesn't works correctly when HOME is '/'.
6161

Georg Brandl's avatar
Georg Brandl committed
6162
- Issue #14371: Support bzip2 in zipfile module.  Patch by Serhiy Storchaka.
6163

6164 6165 6166
- Issue #13183: Fix pdb skipping frames after hitting a breakpoint and running
  step.  Patch by Xavier de Gaye.

6167 6168
- Issue #14696: Fix parser module to understand 'nonlocal' declarations.

6169 6170 6171
- Issue #10941: Fix imaplib.Internaldate2tuple to produce correct result near
  the DST transition.  Patch by Joe Peterson.

6172
- Issue #9154: Fix parser module to understand function annotations.
6173

6174 6175 6176
- Issue #6085: In http.server.py SimpleHTTPServer.address_string returns the
  client ip address instead client hostname. Patch by Charles-François Natali.

6177 6178 6179
- Issue #14309: Deprecate time.clock(), use time.perf_counter() or
  time.process_time() instead.

6180 6181 6182 6183
- Issue #14428: Implement the PEP 418. Add time.get_clock_info(),
  time.perf_counter() and time.process_time() functions, and rename
  time.steady() to time.monotonic().

6184 6185 6186
- Issue #14646: importlib.util.module_for_loader() now sets __loader__ and
  __package__ (when possible).

6187 6188 6189
- Issue #14664: It is now possible to use @unittest.skip{If,Unless} on a
  test class that doesn't inherit from TestCase (i.e. a mixin).

6190 6191 6192
- Issue #4892: multiprocessing Connections can now be transferred over
  multiprocessing Connections.  Patch by Richard Oudkerk (sbt).

6193 6194 6195
- Issue #14160: TarFile.extractfile() failed to resolve symbolic links when
  the links were not located in an archive subdirectory.

6196 6197 6198
- Issue #14638: pydoc now treats non-string __name__ values as if they
  were missing, instead of raising an error.

Senthil Kumaran's avatar
Senthil Kumaran committed
6199 6200 6201
- Issue #13684: Fix httplib tunnel issue of infinite loops for certain sites
  which send EOF without trailing \r\n.

6202
- Issue #14605: Add importlib.abc.FileLoader, importlib.machinery.(FileFinder,
6203
  SourceFileLoader, SourcelessFileLoader, ExtensionFileLoader).
6204

6205 6206 6207 6208 6209
- Issue #13959: imp.cache_from_source()/source_from_cache() now follow
  os.path.join()/split() semantics for path manipulation instead of its prior,
  custom semantics of caring the right-most path separator forward in path
  joining.

6210 6211
- Issue #2193: Allow ":" character in Cookie NAME values.

6212 6213 6214
- Issue #14629: tokenizer.detect_encoding will specify the filename in the
  SyntaxError exception if found at readline.__self__.name.

6215 6216 6217
- Issue #14629: Raise SyntaxError in tokenizer.detect_encoding if the
  first two lines have non-UTF-8 characters without an encoding declaration.

6218 6219 6220
- Issue #14308: Fix an exception when a "dummy" thread is in the threading
  module's active list after a fork().

6221 6222 6223 6224
- Issue #11750: The Windows API functions scattered in the _subprocess and
  _multiprocessing.win32 modules now live in a single module "_winapi".
  Patch by sbt.

6225 6226
- Issue #14087: multiprocessing: add Condition.wait_for(). Patch by sbt.

6227 6228 6229
- Issue #14538: HTMLParser can now parse correctly start tags that contain
  a bare '/'.

6230 6231
- Issue #14452: SysLogHandler no longer inserts a UTF-8 BOM into the message.

6232 6233
- Issue #14386: Expose the dict_proxy internal type as types.MappingProxyType.

6234 6235 6236
- Issue #13959: Make imp.reload() always use a module's __loader__ to perform
  the reload.

6237 6238 6239
- Issue #13959: Add imp.py and rename the built-in module to _imp, allowing for
  re-implementing parts of the module in pure Python.

6240 6241 6242
- Issue #13496: Fix potential overflow in bisect.bisect algorithm when applied
  to a collection of size > sys.maxsize / 2.

6243 6244 6245
- Have importlib take advantage of ImportError's new 'name' and 'path'
  attributes.

R David Murray's avatar
R David Murray committed
6246 6247
- Issue #14399: zipfile now recognizes that the archive has been modified even
  if only the comment is changed.  In addition, the TypeError that results from
6248
  trying to set a non-binary value as a comment is now raised at the time
R David Murray's avatar
R David Murray committed
6249
  the comment is set rather than at the time the zipfile is written.
6250

6251 6252 6253 6254
- trace.CoverageResults.is_ignored_filename() now ignores any name that starts
  with "<" and ends with ">" instead of special-casing "<string>" and
  "<doctest ".

6255 6256 6257
- Issue #12537: The mailbox module no longer depends on knowledge of internal
  implementation details of the email package Message object.

6258 6259 6260 6261
- Issue #7978: socketserver now restarts the select() call when EINTR is
  returned.  This avoids crashing the server loop when a signal is received.
  Patch by Jerzy Kozera.

6262 6263 6264
- Issue #14522: Avoid duplicating socket handles in multiprocessing.connection.
  Patch by sbt.

6265 6266
- Don't Py_DECREF NULL variable in io.IncrementalNewlineDecoder.

6267 6268
- Issue #3033: Add displayof parameter to tkinter font. Patch by Guilherme Polo.

6269 6270 6271 6272
- Issue #14482: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_UNIX type address under
  Windows.  Patch by Popa Claudiu.

6273 6274
- Issue #802310: Generate always unique tkinter font names if not directly passed.

Georg Brandl's avatar
Georg Brandl committed
6275 6276 6277 6278
- Issue #14151: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_PIPE type address under
  non-Windows platforms.  Patch by Popa Claudiu.

6279
- Issue #14493: Use gvfs-open or xdg-open in webbrowser.
6280

6281 6282 6283 6284 6285 6286
Build
-----

- "make touch" will now touch generated files that are checked into Mercurial,
  after a "hg update" which failed to bring the timestamps into the right order.

6287 6288 6289
Tests
-----

6290 6291 6292
- Issue #14026: In test_cmd_line_script, check that sys.argv is populated
  correctly for the various invocation approaches (Patch by Jason Yeo)

Nick Coghlan's avatar
Nick Coghlan committed
6293 6294 6295
- Issue #14032: Fix incorrect variable name in test_cmd_line_script debugging
  message (Patch by Jason Yeo)

6296 6297 6298
- Issue #14589: Update certificate chain for sha256.tbs-internet.com, fixing
  a test failure in test_ssl.

6299 6300 6301
- Issue #14355: Regrtest now supports the standard unittest test loading, and
  will use it if a test file contains no `test_main` method.

6302 6303 6304 6305 6306 6307 6308 6309 6310
IDLE
----

- Issue #8515: Set __file__ when run file in IDLE.
  Initial patch by Bruce Frederiksen.

- Issue #14496: Fix wrong name in idlelib/tabbedpages.py.
  Patch by Popa Claudiu.

6311 6312 6313
Tools / Demos
-------------

6314 6315 6316
- Issue #3561: The Windows installer now has an option, off by default, for
  placing the Python installation into the system "Path" environment variable.

6317 6318 6319
- Issue #13165: stringbench is now available in the Tools/stringbench folder.
  It used to live in its own SVN project.

6320 6321 6322 6323 6324 6325
C-API
-----

- Issue #14098: New functions PyErr_GetExcInfo and PyErr_SetExcInfo.
  Patch by Stefan Behnel.

Georg Brandl's avatar
Georg Brandl committed
6326

Georg Brandl's avatar
Georg Brandl committed
6327 6328 6329
What's New in Python 3.3.0 Alpha 2?
===================================

Georg Brandl's avatar
Georg Brandl committed
6330
*Release date: 01-Apr-2012*
Georg Brandl's avatar
Georg Brandl committed
6331 6332 6333 6334

Core and Builtins
-----------------

6335 6336 6337
- Issue #1683368: object.__new__ and object.__init__ raise a TypeError if they
  are passed arguments and their complementary method is not overridden.

6338 6339 6340
- Issue #14378: Fix compiling ast.ImportFrom nodes with a "__future__" string as
  the module name that was not interned.

6341 6342
- Issue #14331: Use significantly less stack space when importing modules by
  allocating path buffers on the heap instead of the stack.
6343

6344 6345 6346
- Issue #14334: Prevent in a segfault in type.__getattribute__ when it was not
  passed strings.

6347 6348 6349
- Issue #1469629: Allow cycles through an object's __dict__ slot to be
  collected. (For example if ``x.__dict__ is x``).

6350 6351 6352
- Issue #14205: dict lookup raises a RuntimeError if the dict is modified
  during a lookup.

6353 6354 6355
- Issue #14220: When a generator is delegating to another iterator with the
  yield from syntax, it needs to have its ``gi_running`` flag set to True.

6356 6357 6358
- Issue #14435: Remove dedicated block allocator from floatobject.c and rely
  on the PyObject_Malloc() api like all other objects.

6359 6360
- Issue #14471: Fix a possible buffer overrun in the winreg module.

6361 6362
- Issue #14288: Allow the serialization of builtin iterators

Georg Brandl's avatar
Georg Brandl committed
6363 6364 6365
Library
-------

6366 6367 6368
- Issue #14300: Under Windows, sockets created using socket.dup() now allow
  overlapped I/O.  Patch by sbt.

6369 6370 6371
- Issue #13872: socket.detach() now marks the socket closed (as mirrored
  in the socket repr()).  Patch by Matt Joiner.

6372 6373 6374
- Issue #14406: Fix a race condition when using ``concurrent.futures.wait(
  return_when=ALL_COMPLETED)``.  Patch by Matt Joiner.

Andrew Svetlov's avatar
Andrew Svetlov committed
6375
- Issue #5136: deprecate old, unused functions from tkinter.
6376

6377 6378 6379
- Issue #14416: syslog now defines the LOG_ODELAY and LOG_AUTHPRIV constants
  if they are defined in <syslog.h>.

6380 6381
- Issue #14295: Add unittest.mock

6382 6383 6384
- Issue #7652: Add --with-system-libmpdec option to configure for linking
  the _decimal module against an installed libmpdec.

6385 6386 6387
- Issue #14380: MIMEText now defaults to utf-8 when passed non-ASCII unicode
  with no charset specified.

6388 6389 6390 6391
- Issue #10340: asyncore - properly handle EINVAL in dispatcher constructor on
  OSX; avoid to call handle_connect in case of a disconnected socket which
  was not meant to connect.

6392 6393 6394 6395
- Issue #14204: The ssl module now has support for the Next Protocol
  Negotiation extension, if available in the underlying OpenSSL library.
  Patch by Colin Marc.

Georg Brandl's avatar
Georg Brandl committed
6396
- Issue #3035: Unused functions from tkinter are marked as pending deprecated.
6397

6398 6399 6400
- Issue #12757: Fix the skipping of doctests when python is run with -OO so
  that it works in unittest's verbose mode as well as non-verbose mode.

6401 6402
- Issue #7652: Integrate the decimal floating point libmpdec library to speed
  up the decimal module. Performance gains of the new C implementation are
6403
  between 10x and 100x, depending on the application.
6404

6405 6406 6407
- Issue #14269: SMTPD now conforms to the RFC and requires a HELO command
  before MAIL, RCPT, or DATA.

6408 6409 6410
- Issue #13694: asynchronous connect in asyncore.dispatcher does not set addr
  attribute.

6411 6412
- Issue #14344: fixed the repr of email.policy objects.

R David Murray's avatar
R David Murray committed
6413 6414 6415
- Issue #11686: Added missing entries to email package __all__ lists
  (mostly the new Bytes classes).

6416 6417 6418
- Issue #14335: multiprocessing's custom Pickler subclass now inherits from
  the C-accelerated implementation.  Patch by sbt.

6419 6420
- Issue #10484: Fix the CGIHTTPServer's PATH_INFO handling problem.

6421 6422
- Issue #11199: Fix the with urllib which hangs on particular ftp urls.

6423 6424
- Improve the memory utilization and speed of functools.lru_cache.

6425 6426 6427 6428
- Issue #14222: Use the new time.steady() function instead of time.time() for
  timeout in queue and threading modules to not be affected of system time
  update.

6429 6430
- Issue #13248: Remove lib2to3.pytree.Base.get_prefix/set_prefix.

6431 6432 6433 6434 6435
- Issue #14234: CVE-2012-0876: Randomize hashes of xml attributes in the hash
  table internal to the pyexpat module's copy of the expat library to avoid a
  denial of service due to hash collisions.  Patch by David Malcolm with some
  modifications by the expat project.

6436 6437 6438
- Issue #12818: format address no longer needlessly \ escapes ()s in names when
  the name ends up being quoted.

6439 6440 6441
- Issue #14062: BytesGenerator now correctly folds Header objects,
  including using linesep when folding.

6442 6443 6444 6445
- Issue #13839: When invoked on the command-line, the pstats module now
  accepts several filenames of profile stat files and merges them all.
  Patch by Matt Joiner.

6446 6447 6448
- Issue #14291: Email now defaults to utf-8 for non-ASCII unicode headers
  instead of raising an error.  This fixes a regression relative to 2.7.

6449 6450
- Issue #989712: Support using Tk without a mainloop.

6451 6452
- Issue #3835: Refuse to use unthreaded Tcl in threaded Python.

6453 6454
- Issue #2843: Add new Tk API to Tkinter.

6455 6456 6457
- Issue #14184: Increase the default stack size for secondary threads on
  Mac OS X to avoid interpreter crashes when using threads on 10.7.

6458 6459 6460 6461
- Issue #14180: datetime.date.fromtimestamp(),
  datetime.datetime.fromtimestamp() and datetime.datetime.utcfromtimestamp()
  now raise an OSError instead of ValueError if localtime() or gmtime() failed.

6462 6463 6464 6465 6466 6467 6468 6469 6470
- Issue #14180: time.ctime(), gmtime(), time.localtime(),
  datetime.date.fromtimestamp(), datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now raises an OverflowError, instead of
  a ValueError, if the timestamp does not fit in time_t.

- Issue #14180: datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now round microseconds towards zero
  instead of rounding to nearest with ties going away from zero.

6471 6472
- Issue #10543: Fix unittest test discovery with Jython bytecode files.

6473 6474 6475 6476
- Issue #1178863: Separate initialisation from setting when initializing
  Tkinter.Variables; harmonize exceptions to ValueError; only delete variables
  that have not been deleted; assert that variable names are strings.

6477 6478 6479
- Issue #14104: Implement time.monotonic() on Mac OS X, patch written by
  Nicholas Riley.

6480 6481
- Issue #13394: the aifc module now uses warnings.warn() to signal warnings.

6482 6483 6484
- Issue #14252: Fix subprocess.Popen.terminate() to not raise an error under
  Windows when the child process has already exited.

6485 6486 6487 6488
- Issue #14223: curses.addch() is no more limited to the range 0-255 when the
  Python curses is not linked to libncursesw. It was a regression introduced
  in Python 3.3a1.

6489
- Issue #14168: Check for presence of Element._attrs in minidom before
6490 6491
  accessing it.

6492 6493 6494 6495
- Issue #12328: Fix multiprocessing's use of overlapped I/O on Windows.
  Also, add a multiprocessing.connection.wait(rlist, timeout=None) function
  for polling multiple objects at once.  Patch by sbt.

6496 6497 6498 6499
- Issue #14007: Accept incomplete TreeBuilder objects (missing start, end,
  data or close method) for the Python implementation as well.
  Drop the no-op TreeBuilder().xml() method from the C implementation.

6500 6501 6502
- Issue #14210: pdb now has tab-completion not only for command names, but
  also for their arguments, wherever possible.

6503 6504 6505
- Issue #14310: Sockets can now be with other processes on Windows using
  the api socket.socket.share() and socket.fromshare().

6506 6507 6508
- Issue #10576: The gc module now has a 'callbacks' member that will get
  called when garbage collection takes place.

6509 6510 6511
Build
-----

6512 6513
- Issue #14557: Fix extensions build on HP-UX. Patch by Adi Roiban.

6514 6515
- Issue #14387: Do not include accu.h from Python.h.

6516 6517 6518
- Issue #14359: Only use O_CLOEXEC in _posixmodule.c if it is defined.
  Based on patch from Hervé Coatanhay.

6519
- Issue #14321: Do not run pgen during the build if files are up to date.
6520

6521 6522 6523 6524 6525
Documentation
-------------

- Issue #14034: added the argparse tutorial.

6526 6527
- Issue #14324: Fix configure tests for cross builds.

6528
- Issue #14327: Call AC_CANONICAL_HOST in configure.ac and check in
6529
  config.{guess,sub}. Don't use uname calls for cross builds.
6530

Benjamin Peterson's avatar
Benjamin Peterson committed
6531 6532 6533
Extension Modules
-----------------

6534 6535 6536
- Issue #9041: An issue in ctypes.c_longdouble, ctypes.c_double, and
  ctypes.c_float that caused an incorrect exception to be returned in the
  case of overflow has been fixed.
6537

Benjamin Peterson's avatar
Benjamin Peterson committed
6538 6539 6540
- Issue #14212: The re module didn't retain a reference to buffers it was
  scanning, resulting in segfaults.

6541 6542 6543
- Issue #14259: The finditer() method of re objects did not take any
  keyword arguments, contrary to the documentation.

6544 6545
- Issue #10142: Support for SEEK_HOLE/SEEK_DATA (for example, under ZFS).

6546 6547 6548
Tests
-----

6549 6550
- Issue #14442: Add missing errno import in test_smtplib.

6551 6552
- Issue #8315: (partial fix) python -m unittest test.test_email now works.

Georg Brandl's avatar
Georg Brandl committed
6553

Georg Brandl's avatar
Georg Brandl committed
6554 6555
What's New in Python 3.3.0 Alpha 1?
===================================
Georg Brandl's avatar
Georg Brandl committed
6556

Georg Brandl's avatar
Georg Brandl committed
6557
*Release date: 05-Mar-2012*
Georg Brandl's avatar
Georg Brandl committed
6558

6559 6560 6561
Core and Builtins
-----------------

6562 6563 6564
- Issue #14172: Fix reference leak when marshalling a buffer-like object
  (other than a bytes object).

6565 6566 6567
- Issue #13521: dict.setdefault() now does only one lookup for the given key,
  making it "atomic" for many purposes.  Patch by Filip Gruszczyński.

6568 6569 6570 6571
- PEP 409, Issue #6210: "raise X from None" is now supported as a means of
  suppressing the display of the chained exception context. The chained
  context still remains available as the __context__ attribute.

6572 6573 6574 6575 6576 6577 6578 6579 6580 6581 6582 6583 6584 6585 6586 6587 6588
- Issue #10181: New memoryview implementation fixes multiple ownership
  and lifetime issues of dynamically allocated Py_buffer members (#9990)
  as well as crashes (#8305, #7433). Many new features have been added
  (See whatsnew/3.3), and the documentation has been updated extensively.
  The ndarray test object from _testbuffer.c implements all aspects of
  PEP-3118, so further development towards the complete implementation
  of the PEP can proceed in a test-driven manner.

  Thanks to Nick Coghlan, Antoine Pitrou and Pauli Virtanen for review
  and many ideas.

- Issue #12834: Fix incorrect results of memoryview.tobytes() for
  non-contiguous arrays.

- Issue #5231: Introduce memoryview.cast() method that allows changing
  format and shape without making a copy of the underlying memory.

6589 6590 6591
- Issue #14084: Fix a file descriptor leak when importing a module with a
  bad encoding.

Benjamin Peterson's avatar
Benjamin Peterson committed
6592 6593
- Upgrade Unicode data to Unicode 6.1.

6594 6595 6596
- Issue #14040: Remove rarely used file name suffixes for C extensions
  (under POSIX mainly).

6597 6598 6599
- Issue #14051: Allow arbitrary attributes to be set of classmethod and
  staticmethod.

6600 6601 6602
- Issue #13703: oCERT-2011-003: Randomize hashes of str and bytes to protect
  against denial of service attacks due to hash collisions within the dict and
  set types.  Patch by David Malcolm, based on work by Victor Stinner.
6603

6604 6605 6606
- Issue #13020: Fix a reference leak when allocating a structsequence object
  fails.  Patch by Suman Saha.

6607 6608
- Issue #13908: Ready types returned from PyType_FromSpec.

6609 6610 6611
- Issue #11235: Fix OverflowError when trying to import a source file whose
  modification time doesn't fit in a 32-bit timestamp.

6612 6613 6614
- Issue #12705: A SyntaxError exception is now raised when attempting to
  compile multiple statements as a single interactive statement.

6615 6616 6617
- Fix the builtin module initialization code to store the init function for
  future reinitialization.

6618 6619 6620 6621 6622
- Issue #8052: The posix subprocess module would take a long time closing
  all possible file descriptors in the child process rather than just open
  file descriptors.  It now closes only the open fds if possible for the
  default close_fds=True behavior.

6623 6624 6625
- Issue #13629: Renumber the tokens in token.h so that they match the indexes
  into _PyParser_TokenNames.

6626 6627
- Issue #13752: Add a casefold() method to str.

6628 6629 6630
- Issue #13761: Add a "flush" keyword argument to the print() function,
  used to ensure flushing the output stream.

6631 6632 6633 6634
- Issue #13645: pyc files now contain the size of the corresponding source
  code, to avoid timestamp collisions (especially on filesystems with a low
  timestamp resolution) when checking for freshness of the bytecode.

6635 6636 6637 6638
- PEP 380, Issue #11682: Add "yield from <x>" to support easy delegation to
  subgenerators (initial patch by Greg Ewing, integration into 3.3 by
  Renaud Blanch, Ryan Kelly, Zbigniew Jędrzejewski-Szmek and Nick Coghlan)

6639 6640 6641
- Issue #13748: Raw bytes literals can now be written with the ``rb`` prefix
  as well as ``br``.

6642 6643
- Issue #12736: Use full unicode case mappings for upper, lower, and title case.

6644 6645
- Issue #12760: Add a create mode to open(). Patch by David Townshend.

6646 6647
- Issue #13738: Simplify implementation of bytes.lower() and bytes.upper().

6648 6649 6650
- Issue #13577: Built-in methods and functions now have a __qualname__.
  Patch by sbt.

6651 6652 6653
- Issue #6695: Full garbage collection runs now clear the freelist of set
  objects.  Initial patch by Matthias Troffaes.

6654 6655 6656
- Fix OSError.__init__ and OSError.__new__ so that each of them can be
  overriden and take additional arguments (followup to issue #12555).

6657 6658 6659 6660
- Fix the fix for issue #12149: it was incorrect, although it had the side
  effect of appearing to resolve the issue.  Thanks to Mark Shannon for
  noticing.

6661 6662 6663
- Issue #13505: Pickle bytes objects in a way that is compatible with
  Python 2 when using protocols <= 2.

6664 6665 6666
- Issue #11147: Fix an unused argument in _Py_ANNOTATE_MEMORY_ORDER.  (Fix
  given by Campbell Barton).

6667 6668 6669 6670
- Issue #13503: Use a more efficient reduction format for bytearrays with
  pickle protocol >= 3.  The old reduction format is kept with older protocols
  in order to allow unpickling under Python 2.  Patch by Irmen de Jong.

6671 6672 6673 6674
- Issue #7111: Python can now be run without a stdin, stdout or stderr
  stream.  It was already the case with Python 2.  However, the corresponding
  sys module entries are now set to None (instead of an unusable file object).

6675 6676 6677 6678
- Issue #11849: Ensure that free()d memory arenas are really released
  on POSIX systems supporting anonymous memory mappings.  Patch by
  Charles-François Natali.

6679 6680
- PEP 3155 / issue #13448: Qualified name for classes and functions.

6681 6682 6683
- Issue #13436: Fix a bogus error message when an AST object was passed
  an invalid integer value.

6684 6685 6686
- Issue #13411: memoryview objects are now hashable when the underlying
  object is hashable.

6687 6688 6689 6690
- Issue #13338: Handle all enumerations in _Py_ANNOTATE_MEMORY_ORDER
  to allow compiling extension modules with -Wswitch-enum on gcc.
  Initial patch by Floris Bruynooghe.

6691 6692 6693
- Issue #10227: Add an allocation cache for a single slice object.  Patch by
  Stefan Behnel.

6694 6695 6696
- Issue #13393: BufferedReader.read1() now asks the full requested size to
  the raw stream instead of limiting itself to the buffer size.

6697 6698
- Issue #13392: Writing a pyc file should now be atomic under Windows as well.

6699 6700 6701
- Issue #13333: The UTF-7 decoder now accepts lone surrogates (the encoder
  already accepts them).

6702 6703 6704 6705
- Issue #13389: Full garbage collection passes now clear the freelists for
  list and dict objects.  They already cleared other freelists in the
  interpreter.

6706
- Issue #13327: Remove the need for an explicit None as the second argument
Brian Curtin's avatar
Brian Curtin committed
6707 6708 6709
  to os.utime, os.lutimes, os.futimes, os.futimens, os.futimesat, in
  order to update to the current time. Also added keyword argument
  handling to os.utimensat in order to remove the need for explicit None.
6710

6711 6712 6713
- Issue #13350: Simplify some C code by replacing most usages of
  PyUnicode_Format by PyUnicode_FromFormat.

6714 6715 6716
- Issue #13342: input() used to ignore sys.stdin's and sys.stdout's unicode
  error handler in interactive mode (when calling into PyOS_Readline()).

6717 6718
- Issue #9896: Add start, stop, and step attributes to range objects.

6719
- Issue #13343: Fix a SystemError when a lambda expression uses a global
Georg Brandl's avatar
Georg Brandl committed
6720 6721
  variable in the default value of a keyword-only argument: ``lambda *,
  arg=GLOBAL_NAME: None``
6722

6723 6724 6725
- Issue #12797: Added custom opener parameter to builtin open() and
  FileIO.open().

6726 6727 6728
- Issue #10519: Avoid unnecessary recursive function calls in
  setobject.c.

6729 6730
- Issue #10363: Deallocate global locks in Py_Finalize().

6731 6732 6733
- Issue #13018: Fix reference leaks in error paths in dictobject.c.
  Patch by Suman Saha.

6734 6735 6736 6737
- Issue #13201: Define '==' and '!=' to compare range objects based on
  the sequence of values they define (instead of comparing based on
  object identity).

6738 6739 6740 6741
- Issue #1294232: In a few cases involving metaclass inheritance, the
  interpreter would sometimes invoke the wrong metaclass when building a new
  class object. These cases now behave correctly. Patch by Daniel Urban.

6742
- Issue #12753: Add support for Unicode name aliases and named sequences.
Georg Brandl's avatar
Georg Brandl committed
6743 6744
  Both ``unicodedata.lookup()`` and '\N{...}' now resolve aliases,
  and ``unicodedata.lookup()`` resolves named sequences too.
6745

6746 6747 6748 6749
- Issue #12170: The count(), find(), rfind(), index() and rindex() methods
  of bytes and bytearray objects now accept an integer between 0 and 255
  as their first argument.  Patch by Petri Lehtinen.

6750 6751 6752
- Issue #12604: VTRACE macro expanded to no-op in _sre.c to avoid compiler
  warnings. Patch by Josh Triplett and Petri Lehtinen.

6753 6754 6755 6756
- Issue #12281: Rewrite the MBCS codec to handle correctly replace and ignore
  error handlers on all Windows versions. The MBCS codec is now supporting all
  error handlers, instead of only replace to encode and ignore to decode.

6757 6758 6759 6760
- Issue #13188: When called without an explicit traceback argument,
  generator.throw() now gets the traceback from the passed exception's
  ``__traceback__`` attribute.  Patch by Petri Lehtinen.

6761 6762
- Issue #13146: Writing a pyc file is now atomic under POSIX.

6763 6764 6765 6766
- Issue #7833: Extension modules built using distutils on Windows will no
  longer include a "manifest" to prevent them failing at import time in some
  embedded situations.

6767 6768
- PEP 3151 / issue #12555: reworking the OS and IO exception hierarchy.

6769
- Add internal API for static strings (_Py_identifier et al.).
6770

6771 6772 6773 6774
- Issue #13063: the Windows error ERROR_NO_DATA (numbered 232 and described
  as "The pipe is being closed") is now mapped to POSIX errno EPIPE
  (previously EINVAL).

6775 6776 6777
- Issue #12911: Fix memory consumption when calculating the repr() of huge
  tuples or lists.

Martin v. Löwis's avatar
Martin v. Löwis committed
6778 6779
- PEP 393: flexible string representation. Thanks to Torsten Becker for the
  initial implementation, and Victor Stinner for various bug fixes.
Martin v. Löwis's avatar
Martin v. Löwis committed
6780

6781 6782 6783
- Issue #14081: The 'sep' and 'maxsplit' parameter to str.split, bytes.split,
  and bytearray.split may now be passed as keyword arguments.

6784 6785 6786 6787
- Issue #13012: The 'keepends' parameter to str.splitlines may now be passed
  as a keyword argument:  "my_string.splitlines(keepends=True)".  The same
  change also applies to bytes.splitlines and bytearray.splitlines.

6788 6789 6790 6791
- Issue #7732: Don't open a directory as a file anymore while importing a
  module. Ignore the direcotry if its name matchs the module name (e.g.
  "__init__.py") and raise a ImportError instead.

6792 6793 6794
- Issue #13021: Missing decref on an error path.  Thanks to Suman Saha for
  finding the bug and providing a patch.

6795 6796 6797
- Issue #12973: Fix overflow checks that relied on undefined behaviour in
  list_repeat (listobject.c) and islice_next (itertoolsmodule.c).  These bugs
  caused test failures with recent versions of Clang.
6798

6799 6800 6801
- Issue #12904: os.utime, os.futimes, os.lutimes, and os.futimesat now write
  atime and mtime with nanosecond precision on modern POSIX platforms.

6802 6803 6804
- Issue #12802: the Windows error ERROR_DIRECTORY (numbered 267) is now
  mapped to POSIX errno ENOTDIR (previously EINVAL).

6805 6806 6807
- Issue #9200: The str.is* methods now work with strings that contain non-BMP
  characters even in narrow Unicode builds.

6808 6809 6810
- Issue #12791: Break reference cycles early when a generator exits with
  an exception.

6811 6812
- Issue #12773: Make __doc__ mutable on user-defined classes.

6813
- Issue #12766: Raise a ValueError when creating a class with a class variable
6814 6815
  that conflicts with a name in __slots__.

6816 6817 6818
- Issue #12266: Fix str.capitalize() to correctly uppercase/lowercase
  titlecased and cased non-letter characters.

6819 6820 6821
- Issue #12732: In narrow unicode builds, allow Unicode identifiers which fall
  outside the BMP.

6822 6823
- Issue #12575: Validate user-generated AST before it is compiled.

6824 6825
- Make type(None), type(Ellipsis), and type(NotImplemented) callable. They
  return the respective singleton instances.
6826

Benjamin Peterson's avatar
Benjamin Peterson committed
6827
- Forbid summing bytes with sum().
6828

6829 6830 6831
- Verify the types of AST strings and identifiers provided by the user before
  compiling them.

6832 6833 6834 6835
- Issue #12647: The None object now has a __bool__() method that returns False.
  Formerly, bool(None) returned False only because of special case logic
  in PyObject_IsTrue().

6836 6837 6838 6839
- Issue #12579: str.format_map() now raises a ValueError if used on a
  format string that contains positional fields. Initial patch by
  Julian Berman.

6840 6841
- Issue #10271: Allow warnings.showwarning() be any callable.

6842 6843
- Issue #11627: Fix segfault when __new__ on a exception returns a
  non-exception class.
6844

Georg Brandl's avatar
Georg Brandl committed
6845
- Issue #12149: Update the method cache after a type's dictionary gets
6846 6847 6848 6849 6850
  cleared by the garbage collector.  This fixes a segfault when an instance
  and its type get caught in a reference cycle, and the instance's
  deallocator calls one of the methods on the type (e.g. when subclassing
  IOBase).  Diagnosis and patch by Davide Rizzo.

6851
- Issue #9611, Issue #9015: FileIO.read() clamps the length to INT_MAX on Windows.
6852

6853 6854 6855
- Issue #9642: Uniformize the tests on the availability of the mbcs codec, add
  a new HAVE_MBCS define.

6856 6857 6858 6859 6860
- Issue #9642: Fix filesystem encoding initialization: use the ANSI code page
  on Windows if the mbcs codec is not available, and fail with a fatal error if
  we cannot get the locale encoding (if nl_langinfo(CODESET) is not available)
  instead of using UTF-8.

6861 6862 6863
- When a generator yields, do not retain the caller's exception state on the
  generator.

6864
- Issue #12475: Prevent generators from leaking their exception state into the
Benjamin Peterson's avatar
add '  
Benjamin Peterson committed
6865
  caller's frame as they return for the last time.
6866

6867 6868 6869
- Issue #12291: You can now load multiple marshalled objects from a stream,
  with other data interleaved between marshalled objects.

6870 6871 6872 6873
- Issue #12356: When required positional or keyword-only arguments are not
  given, produce a informative error message which includes the name(s) of the
  missing arguments.

6874
- Issue #12370: Fix super with no arguments when __class__ is overriden in the
6875 6876
  class body.

6877 6878 6879
- Issue #12084: os.stat on Windows now works properly with relative symbolic
  links when called from any directory.

6880 6881 6882
- Loosen type restrictions on the __dir__ method. __dir__ can now return any
  sequence, which will be converted to a list and sorted by dir().

6883 6884 6885
- Issue #12265: Make error messages produced by passing an invalid set of
  arguments to a function more informative.

Benjamin Peterson's avatar
Benjamin Peterson committed
6886 6887 6888
- Issue #12225: Still allow Python to build if Python is not in its hg repo or
  mercurial is not installed.

6889
- Issue #1195: my_fgets() now always clears errors before calling fgets(). Fix
6890 6891 6892
  the following case: sys.stdin.read() stopped with CTRL+d (end of file),
  raw_input() interrupted by CTRL+c.

6893 6894
- Issue #12216: Allow unexpected EOF errors to happen on any line of the file.

6895 6896 6897
- Issue #12199: The TryExcept and TryFinally and AST nodes have been unified
  into a Try node.

6898 6899 6900 6901 6902
- Issue #9670: Increase the default stack size for secondary threads on
  Mac OS X and FreeBSD to reduce the chances of a crash instead of a
  "maximum recursion depth" RuntimeError exception.
  (patch by Ronald Oussoren)

6903 6904 6905
- Issue #12106: The use of the multiple-with shorthand syntax is now reflected
  in the AST.

6906 6907 6908
- Issue #12190: Try to use the same filename object when compiling unmarshalling
  a code objects in the same file.

6909 6910 6911
- Issue #12166: Move implementations of dir() specialized for various types into
  the __dir__() methods of those types.

6912
- Issue #5715: In socketserver, close the server socket in the child process.
6913

Benjamin Peterson's avatar
Benjamin Peterson committed
6914 6915 6916
- Correct lookup of __dir__ on objects. Among other things, this causes errors
  besides AttributeError found on lookup to be propagated.

6917 6918 6919
- Issue #12060: Use sig_atomic_t type and volatile keyword in the signal
  module. Patch written by Charles-François Natali.

6920 6921
- Issue #1746656: Added the if_nameindex, if_indextoname, if_nametoindex
  methods to the socket module.
6922

6923 6924 6925 6926
- Issue #12044: Fixed subprocess.Popen when used as a context manager to
  wait for the process to end when exiting the context to avoid unintentionally
  leaving zombie processes around.

6927 6928 6929
- Issue #1195: Fix input() if it is interrupted by CTRL+d and then CTRL+c,
  clear the end-of-file indicator after CTRL+d.

6930 6931 6932 6933
- Issue #1856: Avoid crashes and lockups when daemon threads run while the
  interpreter is shutting down; instead, these threads are now killed when
  they try to take the GIL.

6934 6935 6936
- Issue #9756: When calling a method descriptor or a slot wrapper descriptor,
  the check of the object type doesn't read the __class__ attribute anymore.
  Fix a crash if a class override its __class__ attribute (e.g. a proxy of the
6937
  str type). Patch written by Andreas Stührk.
6938

6939 6940 6941 6942
- Issue #10517: After fork(), reinitialize the TLS used by the PyGILState_*
  APIs, to avoid a crash with the pthread implementation in RHEL 5.  Patch
  by Charles-François Natali.

6943 6944 6945 6946
- Issue #10914: Initialize correctly the filesystem codec when creating a new
  subinterpreter to fix a bootstrap issue with codecs implemented in Python, as
  the ISO-8859-15 codec.

6947 6948 6949
- Issue #11918: OS/2 and VMS are no more supported because of the lack of
  maintainer.

6950 6951 6952
- Issue #6780: fix starts/endswith error message to mention that tuples are
  accepted too.

6953 6954 6955 6956
- Issue #5057: fix a bug in the peepholer that led to non-portable pyc files
  between narrow and wide builds while optimizing BINARY_SUBSCR on non-BMP
  chars (e.g. "\U00012345"[0]).

6957 6958 6959
- Issue #11845: Fix typo in rangeobject.c that caused a crash in
  compute_slice_indices.  Patch by Daniel Urban.

6960 6961 6962 6963 6964
- Issue #5673: Added a `timeout` keyword argument to subprocess.Popen.wait,
  subprocess.Popen.communicated, subprocess.call, subprocess.check_call, and
  subprocess.check_output.  If the blocking operation takes more than `timeout`
  seconds, the `subprocess.TimeoutExpired` exception is raised.

6965 6966 6967 6968
- Issue #11650: PyOS_StdioReadline() retries fgets() if it was interrupted
  (EINTR), for example if the program is stopped with CTRL+z on Mac OS X. Patch
  written by Charles-Francois Natali.

6969 6970
- Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.

6971 6972
- Issue #10785: Store the filename as Unicode in the Python parser.

6973 6974 6975
- Issue #11619: _PyImport_LoadDynamicModule() doesn't encode the path to bytes
  on Windows.

6976 6977 6978
- Issue #10998: Remove mentions of -Q, sys.flags.division_warning and
  Py_DivisionWarningFlag left over from Python 2.

6979 6980 6981
- Issue #11244: Remove an unnecessary peepholer check that was preventing
  negative zeros from being constant-folded properly.

6982 6983 6984 6985 6986 6987
- Issue #11395: io.FileIO().write() clamps the data length to 32,767 bytes on
  Windows if the file is a TTY to workaround a Windows bug. The Windows console
  returns an error (12: not enough space error) on writing into stdout if
  stdout mode is binary and the length is greater than 66,000 bytes (or less,
  depending on heap usage).

6988
- Issue #11320: fix bogus memory management in Modules/getpath.c, leading to
6989 6990
  a possible crash when calling Py_SetPath().

Gregory P. Smith's avatar
Gregory P. Smith committed
6991 6992 6993 6994
- Issue #11432: A bug was introduced in subprocess.Popen on posix systems with
  3.2.0 where the stdout or stderr file descriptor being the same as the stdin
  file descriptor would raise an exception. webbrowser.open would fail. fixed.

6995 6996 6997 6998
- Issue #9856: Change object.__format__ with a non-empty format string
  to be a DeprecationWarning. In 3.2 it was a PendingDeprecationWarning.
  In 3.4 it will be a TypeError.

6999 7000 7001 7002
- Issue #11244: The peephole optimizer is now able to constant-fold
  arbitrarily complex expressions.  This also fixes a 3.2 regression where
  operations involving negative numbers were not constant-folded.

7003 7004 7005
- Issue #11450: Don't truncate hg version info in Py_GetBuildInfo() when
  there are many tags (e.g. when using mq).  Patch by Nadeem Vawda.

7006 7007 7008
- Issue #11335: Fixed a memory leak in list.sort when the key function
  throws an exception.

7009 7010 7011 7012 7013
- Issue #8923: When a string is encoded to UTF-8 in strict mode, the result is
  cached into the object. Examples: str.encode(), str.encode('utf-8'),
  PyUnicode_AsUTF8String() and PyUnicode_AsEncodedString(unicode, "utf-8",
  NULL).

7014 7015 7016
- Issue #10829: Refactor PyUnicode_FromFormat(), use the same function to parse
  the format string in the 3 steps, fix crashs on invalid format strings.

7017 7018
- Issue #13007: whichdb should recognize gdbm 1.9 magic numbers.

7019 7020 7021
- Issue #11286: Raise a ValueError from calling PyMemoryView_FromBuffer with
  a buffer struct having a NULL data pointer.

7022 7023 7024
- Issue #11272: On Windows, input() strips '\r' (and not only '\n'), and
  sys.stdin uses universal newline (replace '\r\n' by '\n').

7025
- Issue #11828: startswith and endswith now accept None as slice index.
7026 7027
  Patch by Torsten Becker.

7028 7029 7030 7031
- Issue #11168: Remove filename debug variable from PyEval_EvalFrameEx().
  It encoded the Unicode filename to UTF-8, but the encoding fails on
  undecodable filename (on surrogate characters) which raises an unexpected
  UnicodeEncodeError on recursion limit.
7032

7033 7034 7035 7036
- Issue #11187: Remove bootstrap code (use ASCII) of
  PyUnicode_AsEncodedString(), it was replaced by a better fallback (use the
  locale encoding) in PyUnicode_EncodeFSDefault().

7037 7038
- Check for NULL result in PyType_FromSpec.

7039
- Issue #10516: New copy() and clear() methods for lists and bytearrays.
7040

7041 7042 7043
- Issue #11386: bytearray.pop() now throws IndexError when the bytearray is
  empty, instead of OverflowError.

7044 7045 7046
- Issue #12380: The rjust, ljust and center methods of bytes and bytearray
  now accept a bytearray argument.

7047 7048
Library
-------
7049

7050 7051 7052 7053
- Issue #14195: An issue that caused weakref.WeakSet instances to incorrectly
  return True for a WeakSet instance 'a' in both 'a < a' and 'a > a' has been
  fixed.

7054 7055 7056 7057
- Issue #14166: Pickler objects now have an optional ``dispatch_table``
  attribute which allows to set custom per-pickler reduction functions.
  Patch by sbt.

7058 7059 7060
- Issue #14177: marshal.loads() now raises TypeError when given an unicode
  string.  Patch by Guilherme Gonçalves.

7061 7062 7063
- Issue #13550: Remove the debug machinery from the threading module: remove
  verbose arguments from all threading classes and functions.

7064 7065 7066 7067 7068
- Issue #14159: Fix the len() of weak containers (WeakSet, WeakKeyDictionary,
  WeakValueDictionary) to return a better approximation when some objects
  are dead or dying.  Moreover, the implementation is now O(1) rather than
  O(n).

7069 7070 7071
- Issue #11841: Fix comparison bug with 'rc' versions in packaging.version.
  Patch by Filip Gruszczyński.

7072
- Issue #6884: Fix long-standing bugs with MANIFEST.in parsing in distutils
7073
  on Windows.  Also fixed in packaging.
7074

7075 7076 7077
- Issue #8033: sqlite3: Fix 64-bit integer handling in user functions
  on 32-bit architectures. Initial patch by Philippe Devalkeneer.

7078 7079
- HTMLParser is now able to handle slashes in the start tag.

7080 7081 7082
- Issue #13641: Decoding functions in the base64 module now accept ASCII-only
  unicode strings.  Patch by Catalin Iacob.

7083 7084 7085
- Issue #14043: Speed up importlib's _FileFinder by at least 8x, and add a
  new importlib.invalidate_caches() function.

7086 7087 7088
- Issue #14001: CVE-2012-0845: xmlrpc: Fix an endless loop in
  SimpleXMLRPCServer upon malformed POST request.

7089 7090
- Issue #13961: Move importlib over to using os.replace() for atomic renaming.

7091 7092 7093
- Do away with ambiguous level values (as suggested by PEP 328) in
  importlib.__import__() by raising ValueError when level < 0.

7094 7095
- Issue #2489: pty.spawn could consume 100% cpu when it encountered an EOF.

7096 7097
- Issue #13014: Fix a possible reference leak in SSLSocket.getpeercert().

7098 7099 7100
- Issue #13777: Add PF_SYSTEM sockets on OS X.
  Patch by Michael Goderbauer.

7101 7102 7103
- Issue #13015: Fix a possible reference leak in defaultdict.__repr__.
  Patch by Suman Saha.

7104 7105 7106
- Issue #1326113: distutils' and packaging's build_ext commands option now
  correctly parses multiple values (separated by whitespace or commas) given
  to their --libraries option.
7107

7108 7109 7110 7111
- Issue #10287: nntplib now queries the server's CAPABILITIES first before
  sending MODE READER, and only sends it if not already in READER mode.
  Patch by Hynek Schlawack.

7112 7113 7114
- Issue #13993: HTMLParser is now able to handle broken end tags when
  strict=False.

7115 7116 7117 7118
- Issue #13930: lib2to3 now supports writing converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.

7119 7120 7121 7122
- Issue #9750: Fix sqlite3.Connection.iterdump on tables and fields
  with a name that is a keyword or contains quotes. Patch by Marko
  Kohtala.

7123 7124 7125 7126
- Issue #10287: nntplib now queries the server's CAPABILITIES again after
  authenticating (since the result may change, according to RFC 4643).
  Patch by Hynek Schlawack.

7127 7128 7129 7130 7131 7132 7133 7134 7135 7136 7137 7138 7139
- Issue #13590: On OS X 10.7 and 10.6 with Xcode 4.2, building
  Distutils-based packages with C extension modules may fail because
  Apple has removed gcc-4.2, the version used to build python.org
  64-bit/32-bit Pythons.  If the user does not explicitly override
  the default C compiler by setting the CC environment variable,
  Distutils will now attempt to compile extension modules with clang
  if gcc-4.2 is required but not found. Also as a convenience, if
  the user does explicitly set CC, substitute its value as the default
  compiler in the Distutils LDSHARED configuration variable for OS X.
  (Note, the python.org 32-bit-only Pythons use gcc-4.0 and the 10.4u
  SDK, neither of which are available in Xcode 4.  This change does not
  attempt to override settings to support their use with Xcode 4.)

7140 7141 7142
- Issue #13960: HTMLParser is now able to handle broken comments when
  strict=False.

7143
- When '' is a path (e.g. in sys.path), make sure __file__ uses the current
Brett Cannon's avatar
Brett Cannon committed
7144
  working directory instead of '' in importlib.
7145

7146 7147 7148 7149
- Issue #13609: Add two functions to query the terminal size:
  os.get_terminal_size (low level) and shutil.get_terminal_size (high level).
  Patch by Zbigniew Jędrzejewski-Szmek.

7150 7151 7152
- Issue #13845: On Windows, time.time() now uses GetSystemTimeAsFileTime()
  instead of ftime() to have a resolution of 100 ns instead of 1 ms (the clock
  accuracy is between 0.5 ms and 15 ms).
7153

7154 7155
- Issue #13846: Add time.monotonic(), monotonic clock.

7156 7157 7158 7159 7160
- Issue #8184: multiprocessing: On Windows, don't set SO_REUSEADDR on
  Connection sockets, and set FILE_FLAG_FIRST_PIPE_INSTANCE on named pipes, to
  make sure two listeners can't bind to the same socket/pipe (or any existing
  socket/pipe).

7161 7162 7163
- Issue #10811: Fix recursive usage of cursors. Instead of crashing,
  raise a ProgrammingError now.

7164 7165 7166
- Issue #13734: Add os.fwalk(), a directory walking function yielding file
  descriptors.

7167 7168
- Issue #2945: Make the distutils upload command aware of bdist_rpm products.

7169 7170
- Issue #13712: pysetup create should not convert package_data to extra_files.

7171 7172
- Issue #11805: package_data in setup.cfg should allow more than one value.

7173 7174
- Issue #13676: Handle strings with embedded zeros correctly in sqlite3.

7175 7176 7177
- Issue #8828: Add new function os.replace(), for cross-platform renaming
  with overwriting.

7178 7179 7180
- Issue #13848: open() and the FileIO constructor now check for NUL
  characters in the file name.  Patch by Hynek Schlawack.

7181 7182 7183
- Issue #13806: The size check in audioop decompression functions was too
  strict and could reject valid compressed data.  Patch by Oleg Plakhotnyuk.

7184 7185 7186
- Issue #13812: When a multiprocessing Process child raises an exception,
  flush stderr after printing the exception traceback.

7187 7188 7189
- Issue #13885: CVE-2011-3389: the _ssl module would always disable the CBC
  IV attack countermeasure.

7190 7191
- Issue #13847: time.localtime() and time.gmtime() now raise an OSError instead
  of ValueError on failure. time.ctime() and time.asctime() now raises an
7192 7193
  OSError if localtime() failed. time.clock() now raises a RuntimeError if the
  processor time used is not available or its value cannot be represented
7194

7195 7196 7197 7198
- Issue #13772: In os.symlink() under Windows, do not try to guess the link
  target's type (file or directory).  The detection was buggy and made the
  call non-atomic (therefore prone to race conditions).

7199
- Issue #6631: Disallow relative file paths in urllib urlopen methods.
7200

7201 7202 7203
- Issue #13722: Avoid silencing ImportErrors when initializing the codecs
  registry.

7204 7205 7206
- Issue #13781: Fix GzipFile bug that caused an exception to be raised when
  opening for writing using a fileobj returned by os.fdopen().

7207 7208 7209
- Issue #13803: Under Solaris, distutils doesn't include bitness
  in the directory name.

7210 7211
- Issue #10278: Add time.wallclock() function, monotonic clock.

7212 7213 7214
- Issue #13809: Fix regression where bz2 module wouldn't work when threads are
  disabled. Original patch by Amaury Forgeot d'Arc.

7215 7216 7217
- Issue #13589: Fix some serialization primitives in the aifc module.
  Patch by Oleg Plakhotnyuk.

7218 7219 7220
- Issue #13642: Unquote before b64encoding user:password during Basic
  Authentication. Patch contributed by Joonas Kuorilehto.

7221 7222 7223 7224
- Issue #12364: Fix a hang in concurrent.futures.ProcessPoolExecutor.
  The hang would occur when retrieving the result of a scheduled future after
  the executor had been shut down.

7225 7226 7227
- Issue #13502: threading: Fix a race condition in Event.wait() that made it
  return False when the event was set and cleared right after.

7228 7229 7230 7231 7232
- Issue #9993: When the source and destination are on different filesystems,
  and the source is a symlink, shutil.move() now recreates a symlink on the
  destination instead of copying the file contents.  Patch by Jonathan Niehof
  and Hynek Schlawack.

7233 7234
- Issue #12926: Fix a bug in tarfile's link extraction.

7235 7236
- Issue #13696: Fix the 302 Relative URL Redirection problem.

7237 7238 7239
- Issue #13636: Weak ciphers are now disabled by default in the ssl module
  (except when SSLv2 is explicitly asked for).

7240 7241 7242 7243 7244
- Issue #12715: Add an optional symlinks argument to shutil functions
  (copyfile, copymode, copystat, copy, copy2).  When that parameter is
  true, symlinks aren't dereferenced and the operation instead acts on the
  symlink itself (or creates one, if relevant).  Patch by Hynek Schlawack.

7245 7246
- Add a flags parameter to select.epoll.

7247 7248 7249
- Issue #13626: Add support for SSL Diffie-Hellman key exchange, through the
  SSLContext.load_dh_params() method and the ssl.OP_SINGLE_DH_USE option.

7250 7251
- Issue #11006: Don't issue low level warning in subprocess when pipe2() fails.

7252
- Issue #13620: Support for Chrome browser in webbrowser.  Patch contributed
7253 7254
  by Arnaud Calmettes.

7255 7256 7257
- Issue #11829: Fix code execution holes in inspect.getattr_static for
  metaclasses with metaclasses. Patch by Andreas Stührk.

7258 7259 7260
- Issue #12708: Add starmap() and starmap_async() methods (similar to
  itertools.starmap()) to multiprocessing.Pool.  Patch by Hynek Schlawack.

7261 7262
- Issue #1785: Fix inspect and pydoc with misbehaving descriptors.

7263 7264 7265
- Issue #13637: "a2b" functions in the binascii module now accept ASCII-only
  unicode strings.

7266 7267
- Issue #13634: Add support for querying and disabling SSL compression.

7268 7269 7270 7271
- Issue #13627: Add support for SSL Elliptic Curve-based Diffie-Hellman
  key exchange, through the SSLContext.set_ecdh_curve() method and the
  ssl.OP_SINGLE_ECDH_USE option.

7272 7273 7274 7275
- Issue #13635: Add ssl.OP_CIPHER_SERVER_PREFERENCE, so that SSL servers
  choose the cipher based on their own preferences, rather than on the
  client's.

7276
- Issue #11813: Fix inspect.getattr_static for modules. Patch by Andreas
7277 7278
  Stührk.

7279 7280 7281
- Issue #7502: Fix equality comparison for DocTestCase instances.  Patch by
  Cédric Krier.

7282 7283 7284
- Issue #11870: threading: Properly reinitialize threads internal locks and
  condition variables to avoid deadlocks in child processes.

7285 7286 7287
- Issue #8035: urllib: Fix a bug where the client could remain stuck after a
  redirection or an error.

7288 7289 7290
- Issue #13560: os.strerror() now uses the current locale encoding instead of
  UTF-8.

7291 7292 7293 7294
- Issue #8373: The filesystem path of AF_UNIX sockets now uses the filesystem
  encoding and the surrogateescape error handler, rather than UTF-8.  Patch
  by David Watson.

7295 7296 7297
- Issue #10350: Read and save errno before calling a function which might
  overwrite it.  Original patch by Hallvard B Furuseth.

7298 7299
- Issue #11610: Introduce a more general way to declare abstract properties.

7300 7301 7302
- Issue #13591: A bug in importlib has been fixed that caused import_module
  to load a module twice.

7303 7304 7305 7306
- Issue #13449 sched.scheduler.run() method has a new "blocking" parameter which
  when set to False makes run() execute the scheduled events due to expire
  soonest (if any) and then return.  Patch by Giampaolo Rodolà.

7307
- Issue #8684 sched.scheduler class can be safely used in multi-threaded
7308
  environments.  Patch by Josiah Carlson and Giampaolo Rodolà.
7309

7310 7311
- Alias resource.error to OSError ala PEP 3151.

7312 7313
- Issue #5689: Add support for lzma compression to the tarfile module.

7314 7315 7316 7317 7318
- Issue #13248: Turn 3.2's PendingDeprecationWarning into 3.3's
  DeprecationWarning.  It covers 'cgi.escape', 'importlib.abc.PyLoader',
  'importlib.abc.PyPycLoader', 'nntplib.NNTP.xgtitle', 'nntplib.NNTP.xpath',
  and private attributes of 'smtpd.SMTPChannel'.

7319
- Issue #5905, Issue #13560: time.strftime() is now using the current locale
7320
  encoding, instead of UTF-8, if the wcsftime() function is not available.
7321

7322 7323 7324
- Issue #13464: Add a readinto() method to http.client.HTTPResponse.  Patch
  by Jon Kuhn.

7325 7326 7327
- tarfile.py: Correctly detect bzip2 compressed streams with blocksizes
  other than 900k.

7328 7329
- Issue #13439: Fix many errors in turtle docstrings.

7330
- Issue #6715: Add a module 'lzma' for compression using the LZMA algorithm.
7331
  Thanks to Per Øyvind Karlsen for the initial implementation.
7332

7333 7334 7335
- Issue #13487: Make inspect.getmodule robust against changes done to
  sys.modules while it is iterating over it.

7336 7337 7338
- Issue #12618: Fix a bug that prevented py_compile from creating byte
  compiled files in the current directory.  Initial patch by Sjoerd de Vries.

7339 7340 7341
- Issue #13444: When stdout has been closed explicitly, we should not attempt
  to flush it at shutdown and print an error.

7342 7343 7344 7345
- Issue #12567: The curses module uses Unicode functions for Unicode arguments
  when it is linked to the ncurses library. It encodes also Unicode strings to
  the locale encoding instead of UTF-8.

7346 7347 7348 7349
- Issue #12856: Ensure child processes do not inherit the parent's random
  seed for filename generation in the tempfile module.  Patch by Brian
  Harring.

7350 7351 7352
- Issue #9957: SpooledTemporaryFile.truncate() now accepts an optional size
  parameter, as other file-like objects.  Patch by Ryan Kelly.

7353 7354 7355
- Issue #13458: Fix a memory leak in the ssl module when decoding a
  certificate with a subjectAltName.  Patch by Robert Xiao.

7356 7357
- Issue #13415: os.unsetenv() doesn't ignore errors anymore.

Giampaolo Rodola's avatar
Giampaolo Rodola committed
7358 7359 7360
- Issue #13245: sched.scheduler class constructor's timefunc and
  delayfunct parameters are now optional.
  scheduler.enter and scheduler.enterabs methods gained a new kwargs parameter.
7361
  Patch contributed by Chris Clark.
Giampaolo Rodola's avatar
Giampaolo Rodola committed
7362

7363 7364 7365 7366
- Issue #12328: Under Windows, refactor handling of Ctrl-C events and
  make _multiprocessing.win32.WaitForMultipleObjects interruptible when
  the wait_flag parameter is false.  Patch by sbt.

7367 7368 7369 7370 7371 7372
- Issue #13322: Fix BufferedWriter.write() to ensure that BlockingIOError is
  raised when the wrapped raw file is non-blocking and the write would block.
  Previous code assumed that the raw write() would raise BlockingIOError, but
  RawIOBase.write() is defined to returned None when the call would block.
  Patch by sbt.

7373 7374
- Issue #13358: HTMLParser now calls handle_data only once for each CDATA.

7375 7376 7377 7378
- Issue #4147: minidom's toprettyxml no longer adds whitespace around a text
  node when it is the only child of an element.  Initial patch by Dan
  Kenigsberg.

7379 7380 7381 7382
- Issue #13374: The Windows bytes API has been deprecated in the os module. Use
  Unicode filenames instead of bytes filenames to not depend on the ANSI code
  page anymore and to support any filename.

7383 7384
- Issue #13297: Use bytes type to send and receive binary data through XMLRPC.

7385 7386 7387
- Issue #6397: Support "/dev/poll" polling objects in select module,
  under Solaris & derivatives.

7388 7389 7390
- Issues #1745761, #755670, #13357, #12629, #1200313: HTMLParser now correctly
  handles non-valid attributes, including adjacent and unquoted attributes.

7391 7392
- Issue #13193: Fix distutils.filelist.FileList and packaging.manifest.Manifest
  under Windows.
Antoine Pitrou's avatar
Antoine Pitrou committed
7393

7394 7395
- Issue #13384: Remove unnecessary __future__ import in Lib/random.py

7396 7397
- Issue #13149: Speed up append-only StringIO objects.

7398 7399 7400
- Issue #13373: multiprocessing.Queue.get() could sometimes block indefinitely
  when called with a timeout.  Patch by Arnaud Ysmal.

7401 7402 7403
- Issue #13254: Fix Maildir initialization so that maildir contents
  are read correctly.

7404
- Issue #3067: locale.setlocale() now raises TypeError if the second
7405 7406
  argument is an invalid iterable. Its documentation and docstring
  were also updated. Initial patch by Jyrki Pulliainen.
7407

7408 7409
- Issue #13140: Fix the daemon_threads attribute of ThreadingMixIn.

7410 7411 7412
- Issue #13339: Fix compile error in posixmodule.c due to missing semicolon.
  Thanks to Robert Xiao.

7413 7414 7415
- Byte compilation in packaging is now isolated from the calling Python -B or
  -O options, instead of being disallowed under -B or buggy under -O.

7416
- Issue #10570: curses.putp() and curses.tparm() are now expecting a byte
7417
  string, instead of a Unicode string.
7418

7419 7420
- Issue #13295: http.server now produces valid HTML 4.01 strict.

7421 7422
- Issue #2892: preserve iterparse events in case of SyntaxError.

7423
- Issue #13287: urllib.request and urllib.error now contains an __all__
Éric Araujo's avatar
Éric Araujo committed
7424
  attribute to expose only relevant classes and functions.  Patch by Florent
7425
  Xicluna.
7426

7427 7428 7429 7430
- Issue #670664: Fix HTMLParser to correctly handle the content of
  ``<script>...</script>`` and ``<style>...</style>``.

- Issue #10817: Fix urlretrieve function to raise ContentTooShortError even
7431 7432
  when reporthook is None. Patch by Jyrki Pulliainen.

7433 7434 7435
- Fix the xmlrpc.client user agent to return something similar to
  urllib.request user agent: "Python-xmlrpc/3.3".

7436 7437 7438
- Issue #13293: Better error message when trying to marshal bytes using
  xmlrpc.client.

7439 7440
- Issue #13291: NameError in xmlrpc package.

7441 7442
- Issue #13258: Use callable() built-in in the standard library.

7443 7444 7445
- Issue #13273: fix a bug that prevented HTMLParser to properly detect some
  tags when strict=False.

7446 7447 7448
- Issue #11183: Add finer-grained exceptions to the ssl module, so that
  you don't have to inspect the exception's attributes in the common case.

7449
- Issue #13216: Add cp65001 codec, the Windows UTF-8 (CP_UTF8).
7450

Victor Stinner's avatar
Victor Stinner committed
7451
- Issue #13226: Add RTLD_xxx constants to the os module. These constants can be
7452 7453
  used with sys.setdlopenflags().

7454 7455 7456 7457
- Issue #10278: Add clock_getres(), clock_gettime() and CLOCK_xxx constants to
  the time module. time.clock_gettime(time.CLOCK_MONOTONIC) provides a
  monotonic clock

7458 7459 7460
- Issue #10332: multiprocessing: fix a race condition when a Pool is closed
  before all tasks have completed.

7461 7462
- Issue #13255: wrong docstrings in array module.

7463 7464
- Issue #8540: Remove deprecated Context._clamp attribute in Decimal module.

R David Murray's avatar
R David Murray committed
7465
- Issue #13235: Added DeprecationWarning to logging.warn() method and function.
7466

7467 7468
- Issue #9168: now smtpd is able to bind privileged port.

7469 7470 7471
- Issue #12529: fix cgi.parse_header issue on strings with double-quotes and
  semicolons together. Patch by Ben Darnell and Petri Lehtinen.

7472 7473 7474
- Issue #13227: functools.lru_cache() now has a option to distinguish
  calls with different argument types.

7475 7476
- Issue #6090: zipfile raises a ValueError when a document with a timestamp
  earlier than 1980 is provided. Patch contributed by Petri Lehtinen.
7477

7478 7479 7480 7481
- Issue #13150: sysconfig no longer parses the Makefile and config.h files
  when imported, instead doing it at build time.  This makes importing
  sysconfig faster and reduces Python startup time by 20%.

Ezio Melotti's avatar
Ezio Melotti committed
7482 7483
- Issue #12448: smtplib now flushes stdout while running ``python -m smtplib``
  in order to display the prompt correctly.
7484

7485
- Issue #12454: The mailbox module is now using ASCII, instead of the locale
R David Murray's avatar
R David Murray committed
7486
  encoding, to read and write .mh_sequences files.
7487

7488 7489
- Issue #13194: zlib.compressobj().copy() and zlib.decompressobj().copy() are
  now available on Windows.
7490

R David Murray's avatar
R David Murray committed
7491
- Issue #1673007: urllib.request now supports HEAD request via new method argument.
7492 7493
  Patch contributions by David Stanek, Patrick Westerhoff and Ezio Melotti.

7494 7495
- Issue #12386: packaging does not fail anymore when writing the RESOURCES
  file.
7496

7497 7498
- Issue #13158: Fix decoding and encoding of GNU tar specific base-256 number
  fields in tarfile.
7499

7500 7501
- Issue #13025: mimetypes is now reading MIME types using the UTF-8 encoding,
  instead of the locale encoding.
7502

7503 7504
- Issue #10653: On Windows, use strftime() instead of wcsftime() because
  wcsftime() doesn't format time zone correctly.
7505

7506 7507 7508
- Issue #13150: The tokenize module doesn't compile large regular expressions
  at startup anymore.

Éric Araujo's avatar
Éric Araujo committed
7509 7510
- Issue #11171: Fix distutils.sysconfig.get_makefile_filename when Python was
  configured with different prefix and exec-prefix.
7511

7512
- Issue #11254: Teach distutils and packaging to compile .pyc and .pyo files in
7513
  PEP 3147-compliant __pycache__ directories.
7514

Ned Deily's avatar
Ned Deily committed
7515 7516
- Issue #7367: Fix pkgutil.walk_paths to skip directories whose
  contents cannot be read.
7517

7518 7519 7520
- Issue #3163: The struct module gets new format characters 'n' and 'N'
  supporting C integer types ``ssize_t`` and ``size_t``, respectively.

7521 7522
- Issue #13099: Fix sqlite3.Cursor.lastrowid under a Turkish locale.
  Reported and diagnosed by Thomas Kluyver.
7523

7524 7525 7526
- Issue #13087: BufferedReader.seek() now always raises UnsupportedOperation
  if the underlying raw stream is unseekable, even if the seek could be
  satisfied using the internal buffer.  Patch by John O'Connor.
7527

7528 7529 7530
- Issue #7689: Allow pickling of dynamically created classes when their
  metaclass is registered with copyreg.  Patch by Nicolas M. Thiéry and Craig
  Citro.
7531

7532 7533 7534
- Issue #13034: When decoding some SSL certificates, the subjectAltName
  extension could be unreported.

7535 7536 7537
- Issue #12306: Expose the runtime version of the zlib C library as a constant,
  ZLIB_RUNTIME_VERSION, in the zlib module. Patch by Torsten Landschoff.

7538
- Issue #12959: Add collections.ChainMap to collections.__all__.
7539

7540 7541 7542
- Issue #8933: distutils' PKG-INFO files and packaging's METADATA files will
  now correctly report Metadata-Version: 1.1 instead of 1.0 if a Classifier or
  Download-URL field is present.
7543

7544 7545 7546
- Issue #12567: Add curses.unget_wch() function. Push a character so the next
  get_wch() will return it.

7547
- Issue #9561: distutils and packaging now writes egg-info files using UTF-8,
7548 7549
  instead of the locale encoding.

7550 7551 7552
- Issue #8286: The distutils command sdist will print a warning message instead
  of crashing when an invalid path is given in the manifest template.

7553 7554 7555 7556 7557
- Issue #12841: tarfile unnecessarily checked the existence of numerical user
  and group ids on extraction. If one of them did not exist the respective id
  of the current user (i.e. root) was used for the file and ownership
  information was lost.

Ezio Melotti's avatar
Ezio Melotti committed
7558 7559 7560
- Issue #12888: Fix a bug in HTMLParser.unescape that prevented it to escape
  more than 128 entities.  Patch by Peter Otten.

7561 7562
- Issue #12878: Expose a __dict__ attribute on io.IOBase and its subclasses.

7563 7564 7565 7566
- Issue #12494: On error, call(), check_call(), check_output() and
  getstatusoutput() functions of the subprocess module now kill the process,
  read its status (to avoid zombis) and close pipes.

Benjamin Peterson's avatar
Benjamin Peterson committed
7567 7568
- Issue #12720: Expose low-level Linux extended file attribute functions in os.

Éric Araujo's avatar
Éric Araujo committed
7569
- Issue #10946: The distutils commands bdist_dumb, bdist_wininst and bdist_msi
7570 7571
  now respect a --skip-build option given to bdist.  The packaging commands
  were fixed too.
Éric Araujo's avatar
Éric Araujo committed
7572

7573 7574 7575
- Issue #12847: Fix a crash with negative PUT and LONG_BINPUT arguments in
  the C pickle implementation.

7576 7577 7578
- Issue #11564: Avoid crashes when trying to pickle huge objects or containers
  (more than 2**31 items).  Instead, in most cases, an OverflowError is raised.

7579 7580 7581
- Issue #12287: Fix a stack corruption in ossaudiodev module when the FD is
  greater than FD_SETSIZE.

7582 7583 7584
- Issue #12839: Fix crash in zlib module due to version mismatch.
  Fix by Richard M. Tew.

7585 7586 7587
- Issue #9923: The mailcap module now correctly uses the platform path
  separator for the MAILCAP environment variable on non-POSIX platforms.

7588 7589 7590 7591
- Issue #12835: Follow up to #6560 that unconditionally prevents use of the
  unencrypted sendmsg/recvmsg APIs on SSL wrapped sockets. Patch by David
  Watson.

7592 7593 7594
- Issue #12803: SSLContext.load_cert_chain() now accepts a password argument
  to be used if the private key is encrypted.  Patch by Adam Simpkins.

7595 7596 7597
- Issue #11657: Fix sending file descriptors over 255 over a multiprocessing
  Pipe.

7598 7599 7600
- Issue #12811: tabnanny.check() now promptly closes checked files. Patch by
  Anthony Briggs.

7601 7602
- Issue #6560: The sendmsg/recvmsg API is now exposed by the socket module
  when provided by the underlying platform, supporting processing of
7603
  ancillary data in pure Python code. Patch by David Watson and Heiko Wundram.
7604

7605 7606 7607 7608
- Issue #12326: On Linux, sys.platform doesn't contain the major version
  anymore. It is now always 'linux', instead of 'linux2' or 'linux3' depending
  on the Linux version used to build Python.

7609 7610 7611
- Issue #12213: Fix a buffering bug with interleaved reads and writes that
  could appear on BufferedRandom streams.

7612 7613 7614
- Issue #12778: Reduce memory consumption when JSON-encoding a large
  container of many small objects.

7615 7616 7617
- Issue #12650: Fix a race condition where a subprocess.Popen could leak
  resources (FD/zombie) when killed at the wrong time.

7618 7619 7620
- Issue #12744: Fix inefficient representation of integers between 2**31 and
  2**63 on systems with a 64-bit C "long".

7621 7622 7623
- Issue #12646: Add an 'eof' attribute to zlib.Decompress, to make it easier to
  detect truncated input streams.

7624 7625 7626
- Issue #11513: Fix exception handling ``tarfile.TarFile.gzopen()`` when
  the file cannot be opened.

7627 7628 7629
- Issue #12687: Fix a possible buffering bug when unpickling text mode
  (protocol 0, mostly) pickles.

Senthil Kumaran's avatar
Senthil Kumaran committed
7630 7631
- Issue #10087: Fix the html output format of the calendar module.

7632 7633 7634
- Issue #13121: add support for inplace math operators to collections.Counter.

- Add support for unary plus and unary minus to collections.Counter.
7635

7636 7637
- Issue #12683: urlparse updated to include svn as schemes that uses relative
  paths. (svn from 1.5 onwards support relative path).
7638

7639 7640 7641 7642 7643
- Issue #12655: Expose functions from sched.h in the os module: sched_yield(),
  sched_setscheduler(), sched_getscheduler(), sched_setparam(),
  sched_get_min_priority(), sched_get_max_priority(), sched_rr_get_interval(),
  sched_getaffinity(), sched_setaffinity().

7644 7645
- Add ThreadError to threading.__all__.

7646 7647
- Issues #11104, #8688: Fix the behavior of distutils' sdist command with
  manually-maintained MANIFEST files.
7648

7649 7650 7651 7652
- Issue #11281: smtplib.STMP gets source_address parameter, which adds the
  ability to bind to specific source address on a machine with multiple
  interfaces. Patch by Paulo Scardine.

7653 7654
- Issue #12464: tempfile.TemporaryDirectory.cleanup() should not follow
  symlinks: fix it. Patch by Petri Lehtinen.
7655

Éric Araujo's avatar
Éric Araujo committed
7656 7657
- Issue #8887: "pydoc somebuiltin.somemethod" (or help('somebuiltin.somemethod')
  in Python code) now finds the doc of the method.
7658

7659
- Issue #10968: Remove indirection in threading.  The public names (Event,
7660
  Condition, etc.) used to be factory functions returning instances of hidden
7661 7662 7663
  classes (_Event, _Condition, etc.), because (if Guido recalls correctly) this
  code pre-dates the ability to subclass extension types.  It is now possible
  to inherit from these classes, without having to import the private
7664 7665
  underscored names like multiprocessing did.

7666 7667 7668
- Issue #9723: Add shlex.quote functions, to escape filenames and command
  lines.

7669 7670
- Issue #12603: Fix pydoc.synopsis() on files with non-negative st_mtime.

7671 7672 7673
- Issue #12514: Use try/finally to assure the timeit module restores garbage
  collections when it is done.

7674 7675 7676
- Issue #12607: In subprocess, fix issue where if stdin, stdout or stderr is
  given as a low fd, it gets overwritten.

7677
- Issue #12576: Fix urlopen behavior on sites which do not send (or obfuscates)
7678
  ``Connection: close`` header.
7679

7680 7681
- Issue #12560: Build libpython.so on OpenBSD. Patch by Stefan Sperling.

7682 7683
- Issue #1813: Fix codec lookup under Turkish locales.

7684 7685 7686
- Issue #12591: Improve support of "universal newlines" in the subprocess
  module: the piped streams can now be properly read from or written to.

7687 7688 7689 7690
- Issue #12591: Allow io.TextIOWrapper to work with raw IO objects (without
  a read1() method), and add a *write_through* parameter to mandate
  unbuffered writes.

7691 7692
- Issue #10883: Fix socket leaks in urllib.request when using FTP.

7693 7694
- Issue #12592: Make Python build on OpenBSD 5 (and future major releases).

7695 7696
- Issue #12372: POSIX semaphores are broken on AIX: don't use them.

7697 7698 7699 7700 7701 7702
- Issue #12551: Provide a get_channel_binding() method on SSL sockets so as
  to get channel binding data for the current SSL session (only the
  "tls-unique" channel binding is implemented).  This allows the implementation
  of certain authentication mechanisms such as SCRAM-SHA-1-PLUS.  Patch by
  Jacek Konieczny.

7703 7704 7705
- Issue #665194: email.utils now has format_datetime and parsedate_to_datetime
  functions, allowing for round tripping of RFC2822 format dates.

7706 7707 7708 7709
- Issue #12571: Add a plat-linux3 directory mirroring the plat-linux2
  directory, so that "import DLFCN" and other similar imports work on
  Linux 3.0.

7710 7711 7712
- Issue #7484: smtplib no longer puts <> around addresses in VRFY and EXPN
  commands; they aren't required and in fact postfix doesn't support that form.

Benjamin Peterson's avatar
Benjamin Peterson committed
7713 7714 7715
- Issue #12273: Remove ast.__version__. AST changes can be accounted for by
  checking sys.version_info or sys._mercurial.

7716 7717 7718
- Silence spurious "broken pipe" tracebacks when shutting down a
  ProcessPoolExecutor.

7719 7720 7721
- Fix potential resource leaks in concurrent.futures.ProcessPoolExecutor
  by joining all queues and processes when shutdown() is called.

7722 7723 7724
- Issue #11603: Fix a crash when __str__ is rebound as __repr__.  Patch by
  Andreas Stührk.

7725 7726 7727
- Issue #11321: Fix a crash with multiple imports of the _pickle module when
  embedding Python.  Patch by Andreas Stührk.

7728 7729 7730
- Issue #6755: Add get_wch() method to curses.window class. Patch by Iñigo
  Serna.

7731 7732
- Add cgi.closelog() function to close the log file.

7733 7734
- Issue #12502: asyncore: fix polling loop with AF_UNIX sockets.

7735 7736 7737
- Issue #4376: ctypes now supports nested structures in a endian different than
  the parent structure. Patch by Vlad Riscutia.

7738 7739 7740
- Raise ValueError when attempting to set the _CHUNK_SIZE attribute of a
  TextIOWrapper to a huge value, not TypeError.

7741 7742 7743
- Issue #12504: Close file handles in a timely manner in packaging.database.
  This fixes a bug with the remove (uninstall) feature on Windows.

7744 7745 7746
- Issues #12169 and #10510: Factor out code used by various packaging commands
  to make HTTP POST requests, and make sure it uses CRLF.

7747 7748 7749 7750
- Issue #12016: Multibyte CJK decoders now resynchronize faster. They only
  ignore the first byte of an invalid byte sequence. For example,
  b'\xff\n'.decode('gb2312', 'replace') gives '\ufffd\n' instead of '\ufffd'.

7751 7752 7753 7754
- Issue #12459: time.sleep() now raises a ValueError if the sleep length is
  negative, instead of an infinite sleep on Windows or raising an IOError on
  Linux for example, to have the same behaviour on all platforms.

7755 7756 7757 7758
- Issue #12451: pydoc: html_getfile() now uses tokenize.open() to support
  Python scripts using a encoding different than UTF-8 (read the coding cookie
  of the script).

7759 7760 7761
- Issue #12493: subprocess: Popen.communicate() now also handles EINTR errors
  if the process has only one pipe.

7762 7763 7764
- Issue #12467: warnings: fix a race condition if a warning is emitted at
  shutdown, if globals()['__file__'] is None.

7765 7766 7767
- Issue #12451: pydoc: importfile() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to avoid encoding issues.

7768 7769 7770 7771
- Issue #12451: runpy: run_path() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to support other encodings
  than UTF-8 (scripts using the coding cookie).

7772 7773 7774
- Issue #12451: xml.dom.pulldom: parse() now opens files in binary mode instead
  of the text mode (using the locale encoding) to avoid encoding issues.

7775 7776 7777
- Issue #12147: Adjust the new-in-3.2 smtplib.send_message method for better
  conformance to the RFCs:  correctly handle Sender and Resent- headers.

7778 7779
- Issue #12352: Fix a deadlock in multiprocessing.Heap when a block is freed by
  the garbage collector while the Heap lock is held.
7780

R David Murray's avatar
R David Murray committed
7781
- Issue #12462: time.sleep() now immediately calls the (Python) signal handler
7782 7783 7784
  if it is interrupted by a signal, instead of having to wait until the next
  instruction.

7785 7786 7787
- Issue #12442: new shutil.disk_usage function, providing total, used and free
  disk space statistics.

7788 7789 7790 7791 7792
- Issue #12451: The XInclude default loader of xml.etree now decodes files from
  UTF-8 instead of the locale encoding if the encoding is not specified. It now
  also opens XML files for the parser in binary mode instead of the text mode
  to avoid encoding issues.

7793 7794 7795
- Issue #12451: doctest.debug_script() doesn't create a temporary file
  anymore to avoid encoding issues.

7796 7797 7798
- Issue #12451: pydoc.synopsis() now reads the encoding cookie if available,
  to read the Python script from the right encoding.

7799 7800 7801
- Issue #12451: distutils now opens the setup script in binary mode to read the
  encoding cookie, instead of opening it in UTF-8.

Ned Deily's avatar
Ned Deily committed
7802 7803 7804 7805
- Issue #9516: On Mac OS X, change Distutils to no longer globally attempt to
  check or set the MACOSX_DEPLOYMENT_TARGET environment variable for the
  interpreter process.  This could cause failures in non-Distutils subprocesses
  and was unreliable since tests or user programs could modify the interpreter
7806
  environment after Distutils set it.  Instead, have Distutils set the
Ned Deily's avatar
Ned Deily committed
7807 7808 7809 7810
  deployment target only in the environment of each build subprocess.  It is
  still possible to globally override the default by setting
  MACOSX_DEPLOYMENT_TARGET before launching the interpreter; its value must be
  greater or equal to the default value, the value with which the interpreter
7811
  was built.  Also, implement the same handling in packaging.
Ned Deily's avatar
Ned Deily committed
7812

7813 7814 7815
- Issue #12422: In the copy module, don't store objects that are their own copy
  in the memo dict.

7816 7817
- Issue #12303: Add sigwaitinfo() and sigtimedwait() to the signal module.

7818 7819 7820
- Issue #12404: Remove C89 incompatible code from mmap module. Patch by Akira
  Kitada.

7821 7822 7823
- Issue #1874: email now detects and reports as a defect the presence of
  any CTE other than 7bit, 8bit, or binary on a multipart.

7824 7825 7826
- Issue #12383: Fix subprocess module with env={}: don't copy the environment
  variables, start with an empty environment.

7827 7828 7829 7830
- Issue #11637: Fix support for importing packaging setup hooks from the
  project directory.

- Issue #6771: Moved the curses.wrapper function from the single-function
7831 7832 7833
  wrapper module into __init__, eliminating the module.  Since __init__ was
  already importing the function to curses.wrapper, there is no API change.

7834
- Issue #11584: email.header.decode_header no longer fails if the header
7835 7836
  passed to it is a Header object, and Header/make_header no longer fail
  if given binary unknown-8bit input.
7837

7838 7839 7840
- Issue #11700: mailbox proxy object close methods can now be called multiple
  times without error.

7841 7842
- Issue #11767: Correct file descriptor leak in mailbox's __getitem__ method.

7843 7844 7845 7846
- Issue #12133: AbstractHTTPHandler.do_open() of urllib.request closes the HTTP
  connection if its getresponse() method fails with a socket error. Patch
  written by Ezio Melotti.

7847 7848 7849
- Issue #12240: Allow multiple setup hooks in packaging's setup.cfg files.
  Original patch by Erik Bray.

7850 7851 7852
- Issue #9284: Allow inspect.findsource() to find the source of doctest
  functions.

7853 7854 7855 7856
- Issue #11595: Fix assorted bugs in packaging.util.cfg_to_args, a
  compatibility helper for the distutils-packaging transition.  Original patch
  by Erik Bray.

7857 7858 7859
- Issue #12287: In ossaudiodev, check that the device isn't closed in several
  methods.

Benjamin Peterson's avatar
Benjamin Peterson committed
7860
- Issue #12009: Fixed regression in netrc file comment handling.
7861

7862 7863 7864 7865
- Issue #12246: Warn and fail when trying to install a third-party project from
  an uninstalled Python (built in a source checkout).  Original patch by
  Tshepang Lekhonkhobe.

7866 7867
- Issue #10694: zipfile now ignores garbage at the end of a zipfile.

7868 7869
- Issue #12283: Fixed regression in smtplib quoting of leading dots in DATA.

7870 7871 7872
- Issue #10424: Argparse now includes the names of the missing required
  arguments in the missing arguments error message.

7873 7874 7875
- Issue #12168: SysLogHandler now allows NUL termination to be controlled using
  a new 'append_nul' attribute on the handler.

7876 7877 7878
- Issue #11583: Speed up os.path.isdir on Windows by using GetFileAttributes
  instead of os.stat.

7879 7880 7881
- Issue #12021: Make mmap's read() method argument optional. Patch by Petri
  Lehtinen.

7882 7883 7884 7885
- Issue #9205: concurrent.futures.ProcessPoolExecutor now detects killed
  children and raises BrokenProcessPool in such a situation.  Previously it
  would reliably freeze/deadlock.

7886
- Issue #12040: Expose a new attribute ``sentinel`` on instances of
Georg Brandl's avatar
Georg Brandl committed
7887 7888
  ``multiprocessing.Process``.  Also, fix Process.join() to not use polling
  anymore, when given a timeout.
7889

7890 7891 7892
- Issue #11893: Remove obsolete internal wrapper class ``SSLFakeFile`` in the
  smtplib module.  Patch by Catalin Iacob.

7893 7894 7895
- Issue #12080: Fix a Decimal.power() case that took an unreasonably long time
  to compute.

7896 7897 7898 7899
- Issue #12221: Remove __version__ attributes from pyexpat, pickle, tarfile,
  pydoc, tkinter, and xml.parsers.expat. This were useless version constants
  left over from the Mercurial transition

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
7900
- Named tuples now work correctly with vars().
7901

7902 7903 7904 7905
- Issue #12085: Fix an attribute error in subprocess.Popen destructor if the
  constructor has failed, e.g. because of an undeclared keyword argument. Patch
  written by Oleg Oshmyan.

7906
- Issue #12028: Make threading._get_ident() public, rename it to
7907
  threading.get_ident() and document it. This function was already used using
7908 7909
  _thread.get_ident().

7910 7911 7912
- Issue #12171: IncrementalEncoder.reset() of CJK codecs (multibytecodec) calls
  encreset() instead of decreset().

7913 7914
- Issue #12218: Removed wsgiref.egg-info.

7915
- Issue #12196: Add pipe2() to the os module.
7916

7917 7918 7919
- Issue #985064: Make plistlib more resilient to faulty input plists.
  Patch by Mher Movsisyan.

7920 7921 7922
- Issue #1625: BZ2File and bz2.decompress() now support multi-stream files.
  Initial patch by Nir Aides.

7923 7924
- Issue #12175: BufferedReader.read(-1) now calls raw.readall() if available.

7925 7926 7927
- Issue #12175: FileIO.readall() now only reads the file position and size
  once.

7928 7929 7930 7931 7932 7933
- Issue #12175: RawIOBase.readall() now returns None if read() returns None.

- Issue #12175: FileIO.readall() now raises a ValueError instead of an IOError
  if the file is closed.

- Issue #11109: New service_action method for BaseServer, used by ForkingMixin
7934
  class for cleanup. Initial Patch by Justin Warkentin.
7935 7936 7937

- Issue #12045: Avoid duplicate execution of command in
  ctypes.util._get_soname().  Patch by Sijin Joseph.
Senthil Kumaran's avatar
Senthil Kumaran committed
7938

7939 7940 7941
- Issue #10818: Remove the Tk GUI and the serve() function of the pydoc module,
  pydoc -g has been deprecated in Python 3.2 and it has a new enhanced web
  server.
7942

7943 7944 7945
- Issue #1441530: In imaplib, read the data in one chunk to speed up large
  reads and simplify code.

7946 7947 7948
- Issue #12070: Fix the Makefile parser of the sysconfig module to handle
  correctly references to "bogus variable" (e.g. "prefix=$/opt/python").

7949 7950 7951 7952
- Issue #12100: Don't reset incremental encoders of CJK codecs at each call to
  their encode() method anymore, but continue to call the reset() method if the
  final argument is True.

7953 7954 7955
- Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl
  module.

7956 7957 7958
- Issue #6501: os.device_encoding() returns None on Windows if the application
  has no console.

7959 7960
- Issue #12105: Add O_CLOEXEC to the os module.

7961 7962 7963 7964
- Issue #12079: Decimal('Infinity').fma(Decimal('0'), (3.91224318126786e+19+0j))
  now raises TypeError (reflecting the invalid type of the 3rd argument) rather
  than Decimal.InvalidOperation.

7965 7966 7967
- Issue #12124: zipimport doesn't keep a reference to zlib.decompress() anymore
  to be able to unload the module.

7968 7969
- Add the packaging module, an improved fork of distutils (also known as
  distutils2).
7970

7971 7972 7973
- Issue #12065: connect_ex() on an SSL socket now returns the original errno
  when the socket's timeout expires (it used to return None).

7974 7975 7976 7977
- Issue #8809: The SMTP_SSL constructor and SMTP.starttls() now support
  passing a ``context`` argument pointing to an ssl.SSLContext instance.
  Patch by Kasun Herath.

7978 7979 7980
- Issue #9516: Issue #9516: avoid errors in sysconfig when MACOSX_DEPLOYMENT_TARGET
  is set in shell.

7981 7982 7983 7984 7985
- Issue #8650: Make zlib module 64-bit clean. compress(), decompress() and
  their incremental counterparts now raise OverflowError if given an input
  larger than 4GB, instead of silently truncating the input and returning
  an incorrect result.

7986 7987 7988
- Issue #12050: zlib.decompressobj().decompress() now clears the unconsumed_tail
  attribute when called without a max_length argument.

7989 7990 7991 7992 7993
- Issue #12062: Fix a flushing bug when doing a certain type of I/O sequence
  on a file opened in read+write mode (namely: reading, seeking a bit forward,
  writing, then seeking before the previous write but still within buffered
  data, and writing again).

7994 7995 7996
- Issue #9971: Write an optimized implementation of BufferedReader.readinto().
  Patch by John O'Connor.

7997 7998 7999 8000
- Issue #11799: urllib.request Authentication Handlers will raise a ValueError
  when presented with an unsupported Authentication Scheme. Patch contributed
  by Yuval Greenfield.

8001 8002 8003 8004 8005
- Issue #10419, #6011: build_scripts command of distutils handles correctly
  non-ASCII path (path to the Python executable). Open and write the script in
  binary mode, but ensure that the shebang is decodable from UTF-8 and from the
  encoding of the script.

8006 8007 8008
- Issue #8498: In socket.accept(), allow to specify 0 as a backlog value in
  order to accept exactly one connection.  Patch by Daniel Evers.

8009 8010 8011
- Issue #12011: signal.signal() and signal.siginterrupt() raise an OSError,
  instead of a RuntimeError: OSError has an errno attribute.

R David Murray's avatar
R David Murray committed
8012 8013 8014
- Issue #3709: add a flush_headers method to BaseHTTPRequestHandler, which
  manages the sending of headers to output stream and flushing the internal
  headers buffer. Patch contribution by Andrew Schaaf
8015

8016 8017
- Issue #11743: Rewrite multiprocessing connection classes in pure Python.

8018 8019
- Issue #11164: Stop trying to use _xmlplus in the xml module.

8020 8021 8022
- Issue #11888: Add log2 function to math module. Patch written by Mark
  Dickinson.

8023 8024
- Issue #12012: ssl.PROTOCOL_SSLv2 becomes optional.

8025 8026 8027 8028
- Issue #8407: The signal handler writes the signal number as a single byte
  instead of a nul byte into the wakeup file descriptor. So it is possible to
  wait more than one signal and know which signals were raised.

8029 8030 8031
- Issue #8407: Add pthread_kill(), sigpending() and sigwait() functions to the
  signal module.

8032 8033 8034
- Issue #11927: SMTP_SSL now uses port 465 by default as documented.  Patch
  by Kasun Herath.

Giampaolo Rodola's avatar
Giampaolo Rodola committed
8035
- Issue #12002: ftplib's abort() method raises TypeError.
8036

Ezio Melotti's avatar
Ezio Melotti committed
8037
- Issue #11916: Add a number of MacOSX specific definitions to the errno module.
8038 8039
  Patch by Pierre Carrier.

8040
- Issue #11999: fixed sporadic sync failure mailbox.Maildir due to its trying to
8041 8042 8043
  detect mtime changes by comparing to the system clock instead of to the
  previous value of the mtime.

8044 8045
- Issue #11072: added MLSD command (RFC-3659) support to ftplib.

8046 8047 8048 8049
- Issue #8808: The IMAP4_SSL constructor now allows passing an SSLContext
  parameter to control parameters of the secure channel.  Patch by Sijin
  Joseph.

8050 8051 8052
- ntpath.samefile failed to notice that "a.txt" and "A.TXT" refer to the same
  file on Windows XP. As noticed in issue #10684.

8053 8054 8055 8056
- Issue #12000: When a SSL certificate has a subjectAltName without any
  dNSName entry, ssl.match_hostname() should use the subject's commonName.
  Patch by Nicolas Bareil.

8057 8058 8059 8060
- Issue #10775: assertRaises, assertRaisesRegex, assertWarns, and
  assertWarnsRegex now accept a keyword argument 'msg' when used as context
  managers.  Initial patch by Winston Ewert.

Ronald Oussoren's avatar
Ronald Oussoren committed
8061 8062 8063 8064
- Issue #10684: shutil.move used to delete a folder on case insensitive
  filesystems when the source and destination name where the same except
  for the case.

8065 8066 8067 8068
- Issue #11647: objects created using contextlib.contextmanager now support
  more than one call to the function when used as a decorator. Initial patch
  by Ysj Ray.

8069 8070 8071
- Issue #11930: Removed deprecated time.accept2dyear variable.
  Removed year >= 1000 restriction from datetime.strftime.

8072 8073
- logging: don't define QueueListener if Python has no thread support.

8074 8075
- functools.cmp_to_key() now works with collections.Hashable().

8076 8077 8078
- Issue #11277: mmap.mmap() calls fcntl(fd, F_FULLFSYNC) on Mac OS X to get
  around a mmap bug with sparse files. Patch written by Steffen Daode Nurpmeso.

8079 8080 8081
- Issue #8407: Add signal.pthread_sigmask() function to fetch and/or change the
  signal mask of the calling thread.

8082 8083 8084 8085 8086
- Issue #11858: configparser.ExtendedInterpolation expected lower-case section
  names.

- Issue #11324: ConfigParser(interpolation=None) now works correctly.

8087 8088 8089
- Issue #11811: ssl.get_server_certificate() is now IPv6-compatible.  Patch
  by Charles-François Natali.

8090 8091 8092
- Issue #11763: don't use difflib in TestCase.assertMultiLineEqual if the
  strings are too long.

8093 8094
- Issue #11236: getpass.getpass responds to ctrl-c or ctrl-z on terminal.

8095 8096
- Issue #11856: Speed up parsing of JSON numbers.

8097
- Issue #11005: threading.RLock()._release_save() raises a RuntimeError if the
8098 8099
  lock was not acquired.

8100 8101 8102
- Issue #11258: Speed up ctypes.util.find_library() under Linux by a factor
  of 5 to 10.  Initial patch by Jonas H.

8103 8104 8105
- Issue #11382: Trivial system calls, such as dup() or pipe(), needn't
  release the GIL.  Patch by Charles-François Natali.

8106 8107 8108
- Issue #11223: Add threading._info() function providing informations about
  the thread implementation.

8109 8110 8111
- Issue #11731: simplify/enhance email parser/generator API by introducing
  policy objects.

8112 8113 8114 8115
- Issue #11768: The signal handler of the signal module only calls
  Py_AddPendingCall() for the first signal to fix a deadlock on reentrant or
  parallel calls. PyErr_SetInterrupt() writes also into the wake up file.

8116 8117
- Issue #11492: fix several issues with header folding in the email package.

8118 8119
- Issue #11852: Add missing imports and update tests.

8120 8121 8122
- Issue #11875: collections.OrderedDict's __reduce__ was temporarily
  mutating the object instead of just working on a copy.

8123
- Issue #11467: Fix urlparse behavior when handling urls which contains scheme
8124 8125
  specific part only digits. Patch by Santoso Wijaya.

8126 8127
- collections.Counter().copy() now works correctly for subclasses.

8128 8129 8130
- Issue #11474: Fix the bug with url2pathname() handling of '/C|/' on Windows.
  Patch by Santoso Wijaya.

8131 8132
- Issue #11684: complete email.parser bytes API by adding BytesHeaderParser.

8133 8134
- The bz2 module now handles 4GiB+ input buffers correctly.

Ezio Melotti's avatar
Ezio Melotti committed
8135 8136
- Issue #9233: Fix json.loads('{}') to return a dict (instead of a list), when
  _json is not available.
8137

Ezio Melotti's avatar
Ezio Melotti committed
8138
- Issue #11830: Remove unnecessary introspection code in the decimal module.
8139 8140

- Issue #11703: urllib2.geturl() does not return correct url when the original
8141
  url contains #fragment.
8142

8143 8144 8145
- Issue #10019: Fixed regression in json module where an indent of 0 stopped
  adding newlines and acted instead like 'None'.

8146 8147 8148
- Issue #11186: pydoc ignores a module if its name contains a surrogate
  character in the index of modules.

8149 8150 8151
- Issue #11815: Use a light-weight SimpleQueue for the result queue in
  concurrent.futures.ProcessPoolExecutor.

brian.curtin's avatar
brian.curtin committed
8152 8153 8154
- Issue #5162: Treat services like frozen executables to allow child spawning
  from multiprocessing.forking on Windows.

8155 8156 8157 8158
- logging.basicConfig now supports an optional 'handlers' argument taking an
  iterable of handlers to be added to the root logger. Additional parameter
  checks were also added to basicConfig.

8159 8160
- Issue #11814: Fix likely typo in multiprocessing.Pool._terminate().

8161 8162 8163
- Issue #11747: Fix range formatting in difflib.context_diff() and
  difflib.unified_diff().

8164 8165 8166 8167
- Issue #8428: Fix a race condition in multiprocessing.Pool when terminating
  worker processes: new processes would be spawned while the pool is being
  shut down.  Patch by Charles-François Natali.

8168 8169
- Issue #2650: re.escape() no longer escapes the '_'.

8170 8171 8172 8173
- Issue #11757: select.select() now raises ValueError when a negative timeout
  is passed (previously, a select.error with EINVAL would be raised).  Patch
  by Charles-François Natali.

8174 8175
- Issue #7311: fix html.parser to accept non-ASCII attribute values.

Georg Brandl's avatar
Georg Brandl committed
8176
- Issue #11605: email.parser.BytesFeedParser was incorrectly converting
Éric Araujo's avatar
Éric Araujo committed
8177
  multipart subparts with an 8-bit CTE into unicode instead of preserving the
Georg Brandl's avatar
Georg Brandl committed
8178
  bytes.
8179

Éric Araujo's avatar
Éric Araujo committed
8180 8181
- Issue #1690608: email.util.formataddr is now RFC 2047 aware:  it now has a
  charset parameter that defaults to utf-8 and is used as the charset for RFC
8182 8183
  2047 encoding when the realname contains non-ASCII characters.

8184 8185
- Issue #10963: Ensure that subprocess.communicate() never raises EPIPE.

8186 8187 8188
- Issue #10791: Implement missing method GzipFile.read1(), allowing GzipFile
  to be wrapped in a TextIOWrapper.  Patch by Nadeem Vawda.

8189 8190 8191
- Issue #11707: Added a fast C version of functools.cmp_to_key().
  Patch by Filip Gruszczyński.

8192 8193 8194
- Issue #11688: Add sqlite3.Connection.set_trace_callback().  Patch by
  Torsten Landschoff.

8195 8196 8197
- Issue #11746: Fix SSLContext.load_cert_chain() to accept elliptic curve
  private keys.

8198 8199 8200 8201
- Issue #5863: Rewrite BZ2File in pure Python, and allow it to accept
  file-like objects using a new ``fileobj`` constructor argument.  Patch by
  Nadeem Vawda.

8202 8203
- unittest.TestCase.assertSameElements has been removed.

8204 8205 8206
- sys.getfilesystemencoding() raises a RuntimeError if initfsencoding() was not
  called yet: detect bootstrap (startup) issues earlier.

8207 8208
- Issue #11393: Add the new faulthandler module.

8209 8210
- Issue #11618: Fix the timeout logic in threading.Lock.acquire() under Windows.

8211 8212 8213
- Removed the 'strict' argument to email.parser.Parser, which has been
  deprecated since Python 2.4.

8214 8215 8216
- Issue #11256: Fix inspect.getcallargs on functions that take only keyword
  arguments.

8217 8218
- Issue #11696: Fix ID generation in msilib.

8219 8220 8221
- itertools.accumulate now supports an optional *func* argument for
  a user-supplied binary function.

8222 8223
- Issue #11692: Remove unnecessary demo functions in subprocess module.

8224 8225 8226
- Issue #9696: Fix exception incorrectly raised by xdrlib.Packer.pack_int when
  trying to pack a negative (in-range) integer.

8227 8228 8229 8230
- Issue #11675: multiprocessing.[Raw]Array objects created from an integer size
  are now zeroed on creation.  This matches the behaviour specified by the
  documentation.

Martin v. Löwis's avatar
Martin v. Löwis committed
8231
- Issue #7639: Fix short file name generation in bdist_msi
8232

8233 8234 8235
- Issue #11635: Don't use polling in worker threads and processes launched by
  concurrent.futures.

8236 8237 8238
- Issue #5845: Automatically read readline configuration to enable completion
  in interactive mode.

8239 8240 8241 8242
- Issue #6811: Allow importlib to change a code object's co_filename attribute
  to match the path to where the source code currently is, not where the code
  object originally came from.

8243 8244
- Issue #8754: Have importlib use the repr of a module name in error messages.

8245 8246 8247
- Issue #11591: Prevent "import site" from modifying sys.path when python
  was started with -S.

8248 8249 8250 8251 8252
- collections.namedtuple() now adds a _source attribute to the generated
  class.  This make the source more accessible than the outdated
  "verbose" option which prints to stdout but doesn't make the source
  string available.

8253 8254 8255
- Issue #11371: Mark getopt error messages as localizable.  Patch by Filip
  Gruszczyński.

8256 8257
- Issue #11333: Add __slots__ to collections ABCs.

8258
- Issue #11628: cmp_to_key generated class should use __slots__.
8259

8260 8261 8262
- Issue #11666: let help() display named tuple attributes and methods
  that start with a leading underscore.

Guido van Rossum's avatar
Guido van Rossum committed
8263 8264 8265
- Issue #11662: Make urllib and urllib2 ignore redirections if the
  scheme is not HTTP, HTTPS or FTP (CVE-2011-1521).

8266 8267 8268
- Issue #5537: Fix time2isoz() and time2netscape() functions of
  httplib.cookiejar for expiration year greater than 2038 on 32-bit systems.

8269 8270
- Issue #4391: Use proper gettext plural forms in optparse.

8271 8272
- Issue #11127: Raise a TypeError when trying to pickle a socket object.

8273
- Issue #11563: ``Connection: close`` header is sent by requests using URLOpener
Senthil Kumaran's avatar
Senthil Kumaran committed
8274 8275 8276
  class which helps in closing of sockets after connection is over. Patch
  contributions by Jeff McNeil and Nadeem Vawda.

8277 8278 8279
- Issue #11459: A ``bufsize`` value of 0 in subprocess.Popen() really creates
  unbuffered pipes, such that select() works properly on them.

8280 8281
- Issue #5421: Fix misleading error message when one of socket.sendto()'s
  arguments has the wrong type.  Patch by Nikita Vetoshkin.
8282

8283
- Issue #10812: Add some extra posix functions to the os module.
8284 8285 8286 8287

- Issue #10979: unittest stdout buffering now works with class and module
  setup and teardown.

8288 8289 8290
- Issue #11243: fix the parameter querying methods of Message to work if
  the headers contain un-encoded non-ASCII data.

8291 8292 8293
- Issue #11401: fix handling of headers with no value; this fixes a regression
  relative to Python2 and the result is now the same as it was in Python2.

8294 8295 8296 8297
- Issue #9298: base64 bodies weren't being folded to line lengths less than 78,
  which was a regression relative to Python2.  Unlike Python2, the last line
  of the folded body now ends with a carriage return.

Nick Coghlan's avatar
Nick Coghlan committed
8298
- Issue #11560: shutil.unpack_archive now correctly handles the format
Nick Coghlan's avatar
Nick Coghlan committed
8299 8300
  parameter. Patch by Evan Dandrea.

8301 8302
- Issue #5870: Add `subprocess.DEVNULL` constant.

8303
- Issue #11133: fix two cases where inspect.getattr_static can trigger code
8304
  execution. Patch by Andreas Stührk.
8305

8306 8307 8308 8309
- Issue #11569: use absolute path to the sysctl command in multiprocessing to
  ensure that it will be found regardless of the shell PATH. This ensures
  that multiprocessing.cpu_count works on default installs of MacOSX.

8310 8311 8312 8313
- Issue #11501: disutils.archive_utils.make_zipfile no longer fails if zlib is
  not installed. Instead, the zipfile.ZIP_STORED compression is used to create
  the ZipFile. Patch by Natalia B. Bidart.

8314
- Issue #11289: `smtp.SMTP` class is now a context manager so it can be used
8315 8316
  in a `with` statement.  Contributed by Giampaolo Rodola.

8317 8318 8319
- Issue #11554: Fixed support for Japanese codecs; previously the body output
  encoding was not done if euc-jp or shift-jis was specified as the charset.

8320 8321 8322
- Issue #11407: `TestCase.run` returns the result object used or created.
  Contributed by Janathan Hartley.

8323
- Issue #11500: Fixed a bug in the OS X proxy bypass code for fully qualified
Antoine Pitrou's avatar
Antoine Pitrou committed
8324
  IP addresses in the proxy exception list.
8325

8326 8327 8328 8329
- Issue #11491: dbm.error is no longer raised when dbm.open is called with
  the "n" as the flag argument and the file exists. The behavior matches
  the documentation and general logic.

Éric Araujo's avatar
Éric Araujo committed
8330
- Issue #1162477: Postel Principle adjustment to email date parsing: handle the
8331 8332
  fact that some non-compliant MUAs use '.' instead of ':' in time specs.

8333 8334 8335
- Issue #11131: Fix sign of zero in decimal.Decimal plus and minus
  operations when the rounding mode is ROUND_FLOOR.

8336 8337
- Issue #9935: Speed up pickling of instances of user-defined classes.

8338 8339 8340
- Issue #5622: Fix curses.wrapper to raise correct exception if curses
  initialization fails.

8341 8342 8343
- Issue #11408: In threading.Lock.acquire(), only call gettimeofday() when
  really necessary.  Patch by Charles-François Natali.

8344 8345 8346 8347
- Issue #11391: Writing to a mmap object created with
  ``mmap.PROT_READ|mmap.PROT_EXEC`` would segfault instead of raising a
  TypeError.  Patch by Charles-François Natali.

8348 8349
- Issue #9795: add context manager protocol support for nntplib.NNTP class.

8350 8351 8352 8353
- Issue #11306: mailbox in certain cases adapts to an inability to open
  certain files in read-write mode.  Previously it detected this by
  checking for EACCES, now it also checks for EROFS.

8354 8355 8356
- Issue #11265: asyncore now correctly handles EPIPE, EBADF and EAGAIN errors
  on accept(), send() and recv().

8357 8358
- Issue #11377: Deprecate platform.popen() and reimplement it with os.popen().

8359 8360
- Issue #8513: On UNIX, subprocess supports bytes command string.

8361 8362
- Issue #10866: Add socket.sethostname().  Initial patch by Ross Lagerwall.

8363 8364
- Issue #11140: Lock.release() now raises a RuntimeError when attempting
  to release an unacquired lock, as claimed in the threading documentation.
Antoine Pitrou's avatar
Antoine Pitrou committed
8365
  The _thread.error exception is now an alias of RuntimeError.  Patch by
8366
  Filip Gruszczyński.  Patch for _dummy_thread by Aymeric Augustin.
8367

8368
- Issue #8594: ftplib now provides a source_address parameter to specify which
8369 8370
  (address, port) to bind to before connecting.

8371 8372 8373
- Issue #11326: Add the missing connect_ex() implementation for SSL sockets,
  and make it work for non-blocking connects.

8374 8375
- Issue #11297: Add collections.ChainMap().

8376
- Issue #10755: Add the posix.flistdir() function.  Patch by Ross Lagerwall.
8377

Georg Brandl's avatar
Georg Brandl committed
8378 8379
- Issue #4761: Add the ``*at()`` family of functions (openat(), etc.) to the
  posix module.  Patch by Ross Lagerwall.
8380

8381 8382 8383
- Issue #7322: Trying to read from a socket's file-like object after a timeout
  occurred now raises an error instead of silently losing data.

8384
- Issue #11291: poplib.POP no longer suppresses errors on quit().
8385

8386
- Issue #11177: asyncore's create_socket() arguments can now be omitted.
8387

8388 8389 8390 8391 8392
- Issue #6064: Add a ``daemon`` keyword argument to the threading.Thread
  and multiprocessing.Process constructors in order to override the
  default behaviour of inheriting the daemonic property from the current
  thread/process.

8393 8394 8395
- Issue #10956: Buffered I/O classes retry reading or writing after a signal
  has arrived and the handler returned successfully.

8396 8397
- Issue #10784: New os.getpriority() and os.setpriority() functions.

8398 8399 8400 8401
- Issue #11114: Fix catastrophic performance of tell() on text files (up
  to 1000x faster in some cases).  It is still one to two order of magnitudes
  slower than binary tell().

8402
- Issue #10882: Add os.sendfile function.
8403

8404 8405 8406
- Issue #10868: Allow usage of the register method of an ABC as a class
  decorator.

8407 8408 8409 8410
- Issue #11224: Fixed a regression in tarfile that affected the file-like
  objects returned by TarFile.extractfile() regarding performance, memory
  consumption and failures with the stream interface.

8411 8412 8413 8414
- Issue #10924: Adding salt and Modular Crypt Format to crypt library.
  Moved old C wrapper to _crypt, and added a Python wrapper with
  enhanced salt generation and simpler API for password generation.

8415 8416
- Issue #11074: Make 'tokenize' so it can be reloaded.

8417 8418 8419 8420 8421
- Issue #11085: Moved collections abstract base classes into a separate
  module called collections.abc, following the pattern used by importlib.abc.
  For backwards compatibility, the names are imported into the collections
  module.

8422 8423 8424 8425
- Issue #4681: Allow mmap() to work on file sizes and offsets larger than
  4GB, even on 32-bit builds.  Initial patch by Ross Lagerwall, adapted for
  32-bit Windows.

8426 8427 8428
- Issue #11169: compileall module uses repr() to format filenames and paths to
  escape surrogate characters and show spaces.

8429
- Issue #11089: Fix performance issue limiting the use of ConfigParser()
8430
  with large config files.
8431

8432 8433 8434
- Issue #10276: Fix the results of zlib.crc32() and zlib.adler32() on buffers
  larger than 4GB.  Patch by Nadeem Vawda.

8435 8436
- Issue #11388: Added a clear() method to MutableSequence

8437 8438 8439
- Issue #11174: Add argparse.MetavarTypeHelpFormatter, which uses type names
  for the names of optional and positional arguments in help messages.

8440 8441
- Issue #9348: Raise an early error if argparse nargs and metavar don't match.

8442 8443
- Issue #9026: Fix order of argparse sub-commands in help messages.

8444 8445
- Issue #9347: Fix formatting for tuples in argparse type= error messages.

8446 8447 8448
- Issue #12191: Added shutil.chown() to change user and/or group owner of a
  given path also specifying their names.

8449 8450 8451
- Issue #13988: The _elementtree accelerator is used whenever available.
  Now xml.etree.cElementTree becomes a deprecated alias to ElementTree.

8452 8453 8454
Build
-----

Martin v. Löwis's avatar
Martin v. Löwis committed
8455 8456
- Issue #6807: Run msisupport.mak earlier.

Martin v. Löwis's avatar
Martin v. Löwis committed
8457 8458
- Issue #10580: Minor grammar change in Windows installer.

8459 8460
- Issue #13326: Clean __pycache__ directories correctly on OpenBSD.

8461 8462
- PEP 393: the configure option --with-wide-unicode is removed.

8463 8464 8465
- Issue #12852: Set _XOPEN_SOURCE to 700, instead of 600, to get POSIX 2008
  functions on OpenBSD (e.g. fdopendir).

8466 8467 8468 8469
- Issue #11863: Remove support for legacy systems deprecated in Python 3.2
  (following PEP 11).  These systems are systems using Mach C Threads,
  SunOS lightweight processes, GNU pth threads and IRIX threads.

8470 8471
- Issue #8746: Correct faulty configure checks so that os.chflags() and
  os.lchflags() are once again built on systems that support these
Georg Brandl's avatar
Georg Brandl committed
8472
  functions (BSD and OS X).  Also add new stat file flags for OS X
8473 8474
  (UF_HIDDEN and UF_COMPRESSED).

8475
- Issue #10645: Installing Python no longer creates a
8476 8477
  Python-X.Y.Z-pyX.Y.egg-info file in the lib-dynload directory.

8478 8479 8480
- Do not accidentally include the directory containing sqlite.h twice when
  building sqlite3.

8481 8482 8483 8484
- Issue #11217: For 64-bit/32-bit Mac OS X universal framework builds,
  ensure "make install" creates symlinks in --prefix bin for the "-32"
  files in the framework bin directory like the installer does.

8485
- Issue #11347: Use --no-as-needed when linking libpython3.so.
8486

Thomas Wouters's avatar
Thomas Wouters committed
8487
- Issue #11411: Fix 'make DESTDIR=' with a relative destination.
Georg Brandl's avatar
Georg Brandl committed
8488

8489 8490
- Issue #11268: Prevent Mac OS X Installer failure if Documentation
  package had previously been installed.
8491

8492
- Issue #11495: OSF support is eliminated. It was deprecated in Python 3.2.
8493

8494 8495 8496
IDLE
----

8497 8498 8499 8500 8501 8502 8503 8504 8505 8506 8507 8508 8509 8510 8511 8512 8513 8514 8515 8516 8517 8518 8519 8520 8521 8522 8523 8524 8525 8526 8527 8528 8529 8530 8531 8532 8533 8534 8535 8536 8537 8538 8539 8540 8541 8542 8543 8544 8545 8546 8547 8548
- Issue #14409: IDLE now properly executes commands in the Shell window
  when it cannot read the normal config files on startup and
  has to use the built-in default key bindings.
  There was previously a bug in one of the defaults.

- IDLE can be launched as python -m idlelib

- Issue #3573: IDLE hangs when passing invalid command line args
  (directory(ies) instead of file(s)) (Patch by Guilherme Polo)

- Issue #14200: IDLE shell crash on printing non-BMP unicode character.

- Issue #5219: Prevent event handler cascade in IDLE.

- Issue #964437: Make IDLE help window non-modal.
  Patch by Guilherme Polo and Roger Serwy.

- Issue #13933: IDLE auto-complete did not work with some imported
  module, like hashlib.  (Patch by Roger Serwy)

- Issue #13506: Add '' to path for IDLE Shell when started and restarted with Restart Shell.
  Original patches by Marco Scataglini and Roger Serwy.

- Issue #4625: If IDLE cannot write to its recent file or breakpoint files,
  display a message popup and continue rather than crash.  Original patch by
  Roger Serwy.

- Issue #8641: Update IDLE 3 syntax coloring to recognize b".." and not u"..".
  Patch by Tal Einat.

- Issue #13296: Fix IDLE to clear compile __future__ flags on shell restart.
  (Patch by Roger Serwy)

- Issue #9871: Prevent IDLE 3 crash when given byte stings
  with invalid hex escape sequences, like b'\x0'.
  (Original patch by Claudiu Popa.)

- Issue #12636: IDLE reads the coding cookie when executing a Python script.

- Issue #12540: Prevent zombie IDLE processes on Windows due to changes
  in os.kill().

- Issue #12590: IDLE editor window now always displays the first line
  when opening a long file.  With Tk 8.5, the first line was hidden.

- Issue #11088: don't crash when using F5 to run a script in IDLE on MacOSX
  with Tk 8.5.

- Issue #1028: Tk returns invalid Unicode null in %A: UnicodeDecodeError.
  With Tk < 8.5 _tkinter.c:PythonCmd() raised UnicodeDecodeError, caused
  IDLE to exit.  Converted to valid Unicode null in PythonCmd().

8549 8550
- Issue #11718: IDLE's open module dialog couldn't find the __init__.py
  file in a package.
8551

8552 8553 8554
Tools/Demos
-----------

8555 8556 8557
- Issue #14053: patchcheck.py ("make patchcheck") now works with MQ patches.
  Patch by Francisco Martín Brugué.

8558 8559 8560 8561 8562
- Issue #13930: 2to3 is now able to write its converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.  See its new -o, -W and --add-suffix options.  This makes it more
  useful in many automated code translation workflows.

8563 8564 8565
- Issue #13628: python-gdb.py is now able to retrieve more frames in the Python
  traceback if Python is optimized.

8566 8567 8568
- Issue #11996: libpython (gdb), replace "py-bt" command by "py-bt-full" and
  add a smarter "py-bt" command printing a classic Python traceback.

8569 8570
- Issue #11179: Make ccbench work under Python 3.1 and 2.7 again.

8571 8572
- Issue #10639: reindent.py no longer converts newlines and will raise
  an error if attempting to convert a file with mixed newlines.
8573
  "--newline" option added to specify new line character.
8574

Ezio Melotti's avatar
Ezio Melotti committed
8575 8576
Extension Modules
-----------------
8577

8578 8579 8580 8581
- Issue #16847: Fixed improper use of _PyUnicode_CheckConsistency() in
  non-pydebug builds. Several extension modules now compile cleanly when
  assert()s are enabled in standard builds (-DDEBUG flag).

8582 8583 8584
- Issue #13840: The error message produced by ctypes.create_string_buffer
  when given a Unicode string has been fixed.

8585 8586 8587
- Issue #9975: socket: Fix incorrect use of flowinfo and scope_id. Patch by
  Vilmos Nebehaj.

8588 8589
- Issue #7777: socket: Add Reliable Datagram Sockets (PF_RDS) support.

8590 8591 8592
- Issue #13159: FileIO and BZ2Compressor/BZ2Decompressor now use a linear-time
  buffer growth strategy instead of a quadratic-time one.

8593 8594 8595
- Issue #10141: socket: Add SocketCAN (PF_CAN) support. Initial patch by
  Matthias Fuchs, updated by Tiago Gonçalves.

8596 8597 8598 8599
- Issue #13070: Fix a crash when a TextIOWrapper caught in a reference cycle
  would be finalized after the reference to its underlying BufferedRWPair's
  writer got cleared by the GC.

8600 8601
- Issue #12881: ctypes: Fix segfault with large structure field names.

8602 8603 8604
- Issue #13058: ossaudiodev: fix a file descriptor leak on error. Patch by
  Thomas Jarosch.

8605 8606 8607
- Issue #13013: ctypes: Fix a reference leak in PyCArrayType_from_ctype.
  Thanks to Suman Saha for finding the bug and providing a patch.

8608 8609 8610
- Issue #13022: Fix: _multiprocessing.recvfd() doesn't check that
  file descriptor was actually received.

8611 8612 8613
- Issue #1172711: Add 'long long' support to the array module.
  Initial patch by Oren Tirosh and Hirokazu Yamamoto.

8614 8615 8616
- Issue #12483: ctypes: Fix a crash when the destruction of a callback
  object triggers the garbage collector.

Jesus Cea's avatar
NEWS  
Jesus Cea committed
8617 8618 8619
- Issue #12950: Fix passing file descriptors in multiprocessing, under
  OpenIndiana/Illumos.

8620 8621 8622
- Issue #12764: Fix a crash in ctypes when the name of a Structure field is not
  a string.

Amaury Forgeot d'Arc's avatar
Amaury Forgeot d'Arc committed
8623 8624 8625 8626 8627
- Issue #11241: subclasses of ctypes.Array can now be subclassed.

- Issue #9651: Fix a crash when ctypes.create_string_buffer(0) was passed to
  some functions like file.write().

8628 8629 8630 8631
- Issue #10309: Define _GNU_SOURCE so that mremap() gets the proper
  signature.  Without this, architectures where sizeof void* != sizeof int are
  broken.  Patch given by Hallvard B Furuseth.

Ezio Melotti's avatar
Ezio Melotti committed
8632 8633
- Issue #12051: Fix segfault in json.dumps() while encoding highly-nested
  objects using the C accelerations.
8634

Ezio Melotti's avatar
Ezio Melotti committed
8635 8636
- Issue #12017: Fix segfault in json.loads() while decoding highly-nested
  objects using the C accelerations.
8637

Benjamin Peterson's avatar
Benjamin Peterson committed
8638 8639
- Issue #1838: Prevent segfault in ctypes, when _as_parameter_ on a class is set
  to an instance of the class.
8640

8641
Tests
8642
-----
8643

8644 8645 8646 8647 8648 8649 8650 8651 8652 8653 8654 8655 8656 8657 8658 8659 8660 8661 8662 8663 8664 8665 8666 8667 8668 8669 8670
- Issue #13125: Silence spurious test_lib2to3 output when in non-verbose mode.
  Patch by Mikhail Novikov.

- Issue #13447: Add a test file to host regression tests for bugs in the
  scripts found in the Tools directory.

- Issue #10881: Fix test_site failure with OS X framework builds.

- Issue #13901: Prevent test_distutils failures on OS X with --enable-shared.

- Issue #13862: Fix spurious failure in test_zlib due to runtime/compile time
  minor versions not matching.

- Issue #12804: Fix test_socket and test_urllib2net failures when running tests
  on a system without internet access.

- Issue #13726: Fix the ambiguous -S flag in regrtest. It is -o/--slow for slow
  tests.

- Issue #11659: Fix ResourceWarning in test_subprocess introduced by #11459.
  Patch by Ben Hayden.

- Issue #11577: fix ResourceWarning triggered by improved binhex test coverage

- Issue #11509: Significantly increase test coverage of fileinput.
  Patch by Denver Coneybeare at PyCon 2011 Sprints.

Petri Lehtinen's avatar
Petri Lehtinen committed
8671 8672
- Issue #11689: Fix a variable scoping error in an sqlite3 test

8673 8674
- Issue #13786: Remove unimplemented 'trace' long option from regrtest.py.

8675 8676 8677
- Issue #13725: Fix regrtest to recognize the documented -d flag.
  Patch by Erno Tukia.

8678 8679 8680
- Issue #13304: Skip test case if user site-packages disabled (-s or
  PYTHONNOUSERSITE).  (Patch by Carl Meyer)

8681 8682 8683
- Issue #5661: Add a test for ECONNRESET/EPIPE handling to test_asyncore. Patch
  by Xavier de Gaye.

8684 8685
- Issue #13218: Fix test_ssl failures on Debian/Ubuntu.

8686 8687 8688
- Re-enable lib2to3's test_parser.py tests, though with an expected failure
  (see issue 13125).

8689 8690
- Issue #12656: Add tests for IPv6 and Unix sockets to test_asyncore.

8691 8692
- Issue #6484: Add unit tests for mailcap module (patch by Gregory Nofi)

8693 8694 8695 8696 8697
- Issue #11651: Improve the Makefile test targets to run more of the test suite
  more quickly. The --multiprocess option is now enabled by default, reducing
  the amount of time needed to run the tests. "make test" and "make quicktest"
  now include some resource-intensive tests, but no longer run the test suite
  twice to check for bugs in .pyc generation. Tools/scripts/run_test.py provides
Éric Araujo's avatar
Éric Araujo committed
8698
  an easy platform-independent way to run test suite with sensible defaults.
8699

8700 8701 8702
- Issue #12331: The test suite for the packaging module can now run from an
  installed Python.

8703 8704 8705
- Issue #12331: The test suite for lib2to3 can now run from an installed
  Python.

8706 8707 8708 8709 8710
- Issue #12626: In regrtest, allow to filter tests using a glob filter
  with the ``-m`` (or ``--match``) option.  This works with all test cases
  using the unittest module.  This is useful with long test suites
  such as test_io or test_subprocess.

8711 8712 8713 8714 8715
- Issue #12624: It is now possible to fail after the first failure when
  running in verbose mode (``-v`` or ``-W``), by using the ``--failfast``
  (or ``-G``) option to regrtest.  This is useful with long test suites
  such as test_io or test_subprocess.

8716 8717 8718
- Issue #12587: Correct faulty test file and reference in test_tokenize.
  (Patch by Robert Xiao)

8719 8720
- Issue #12573: Add resource checks for dangling Thread and Process objects.

8721 8722 8723
- Issue #12549: Correct test_platform to not fail when OS X returns 'x86_64'
  as the processor type on some Mac systems.

8724 8725 8726
- Skip network tests when getaddrinfo() returns EAI_AGAIN, meaning a temporary
  failure in name resolution.

8727 8728 8729
- Issue #11812: Solve transient socket failure to connect to 'localhost'
  in test_telnetlib.py.

8730 8731
- Solved a potential deadlock in test_telnetlib.py. Related to issue #11812.

8732 8733 8734 8735
- Avoid failing in test_robotparser when mueblesmoraleda.com is flaky and
  an overzealous DNS service (e.g. OpenDNS) redirects to a placeholder
  Web site.

8736 8737 8738 8739
- Avoid failing in test_urllibnet.test_bad_address when some overzealous
  DNS service (e.g. OpenDNS) resolves a non-existent domain name.  The test
  is now skipped instead.

8740 8741 8742 8743
- Issue #12440: When testing whether some bits in SSLContext.options can be
  reset, check the version of the OpenSSL headers Python was compiled against,
  rather than the runtime version of the OpenSSL library.

8744 8745
- Issue #11512: Add a test suite for the cgitb module. Patch by Robbie Clemons.

8746 8747 8748 8749
- Issue #12497: Install test/data to prevent failures of the various codecmaps
  tests.

- Issue #12496: Install test/capath directory to prevent test_connect_capath
8750 8751
  testcase failure in test_ssl.

8752 8753 8754 8755
- Issue #12469: Run wakeup and pending signal tests in a subprocess to run the
  test in a fresh process with only one thread and to not change signal
  handling of the parent process.

8756 8757 8758 8759
- Issue #8716: Avoid crashes caused by Aqua Tk on OSX when attempting to run
  test_tk or test_ttk_guionly under a username that is not currently logged
  in to the console windowserver (as may be the case under buildbot or ssh).

8760 8761
- Issue #12407: Explicitly skip test_capi.EmbeddingTest under Windows.

8762 8763 8764 8765
- Issue #12400: regrtest -W doesn't rerun the tests twice anymore, but captures
  the output and displays it on failure instead. regrtest -v doesn't print the
  error twice anymore if there is only one error.

8766 8767 8768 8769 8770
- Issue #12141: Install copies of template C module file so that
  test_build_ext of test_distutils and test_command_build_ext of
  test_packaging are no longer silently skipped when
  run outside of a build directory.

8771 8772 8773
- Issue #8746: Add additional tests for os.chflags() and os.lchflags().
  Patch by Garrett Cooper.

8774 8775 8776
- Issue #10736: Fix test_ttk test_widgets failures with Cocoa Tk 8.5.9
  2.8 +  on Mac OS X.  (Patch by Ronald Oussoren)

8777 8778 8779
- Issue #12057: Add tests for ISO 2022 codecs (iso2022_jp, iso2022_jp_2,
  iso2022_kr).

8780 8781 8782
- Issue #12096: Fix a race condition in test_threading.test_waitfor(). Patch
  written by Charles-François Natali.

8783 8784 8785
- Issue #11614: import __hello__ prints "Hello World!". Patch written by
  Andreas Stührk.

Ezio Melotti's avatar
Ezio Melotti committed
8786 8787
- Issue #5723: Improve json tests to be executed with and without accelerations.

8788 8789
- Issue #12041: Make test_wait3 more robust.

8790 8791 8792
- Issue #11873: Change regex in test_compileall to fix occasional failures when
  when the randomly generated temporary path happened to match the regex.

8793 8794 8795
- Issue #11958: Fix FTP tests for IPv6, bind to "::1" instead of "localhost".
  Patch written by Charles-Francois Natali.

8796 8797 8798 8799
- Issue #8407, #11859: Fix tests of test_io using threads and an alarm: use
  pthread_sigmask() to ensure that the SIGALRM signal is received by the main
  thread.

8800 8801 8802 8803
- Issue #11811: Factor out detection of IPv6 support on the current host
  and make it available as ``test.support.IPV6_ENABLED``.  Patch by
  Charles-François Natali.

8804 8805
- Issue #10914: Add a minimal embedding test to test_capi.

8806 8807 8808 8809 8810 8811
- Issue #11223: Skip test_lock_acquire_interruption() and
  test_rlock_acquire_interruption() of test_threadsignals if a thread lock is
  implemented using a POSIX mutex and a POSIX condition variable. A POSIX
  condition variable cannot be interrupted by a signal (e.g. on Linux, the
  futex system call is restarted).

8812 8813
- Issue #11790: Fix sporadic failures in test_multiprocessing.WithProcessesTestCondition.

8814 8815
- Fix possible "file already exists" error when running the tests in parallel.

Ross Lagerwall's avatar
Ross Lagerwall committed
8816 8817
- Issue #11719: Fix message about unexpected test_msilib skip on non-Windows
  platforms. Patch by Nadeem Vawda.
8818

8819 8820
- Issue #11727: Add a --timeout option to regrtest: if a test takes more than
  TIMEOUT seconds, dumps the traceback of all threads and exits.
8821

8822 8823
- Issue #11653: fix -W with -j in regrtest.

8824 8825 8826 8827 8828
- The email test suite now lives in the Lib/test/test_email package.  The test
  harness code has also been modernized to allow use of new unittest features.

- regrtest now discovers test packages as well as test modules.

8829
- Issue #11577: improve test coverage of binhex.py. Patch by Arkady Koplyarov.
8830

8831 8832 8833
- New test_crashers added to exercise the scripts in the Lib/test/crashers
  directory and confirm they fail as expected

Éric Araujo's avatar
Éric Araujo committed
8834
- Issue #11578: added test for the timeit module.  Patch by Michael Henry.
8835

8836 8837
- Issue #11503: improve test coverage of posixpath.py. Patch by Evan Dandrea.

8838 8839
- Issue #11505: improves test coverage of string.py, increases granularity of
  string.Formatter tests. Initial patch by Alicia Arlen.
8840

Nick Coghlan's avatar
Nick Coghlan committed
8841 8842 8843
- Issue #11548: Improve test coverage of the shutil module. Patch by
  Evan Dandrea.

8844 8845
- Issue #11554: Reactivated test_email_codecs.

8846 8847
- Issue #11505: improves test coverage of string.py. Patch by Alicia
  Arlen
8848

8849
- Issue #11490: test_subprocess.test_leaking_fds_on_error no longer gives a
8850 8851
  false positive if the last directory in the path is inaccessible.

8852 8853 8854
- Issue #11223: Fix test_threadsignals to fail, not hang, when the
  non-semaphore implementation of locks is used under POSIX.

8855 8856 8857
- Issue #10911: Add tests on CGI with non-ASCII characters. Patch written by
  Pierre Quentel.

8858 8859 8860
- Issue #9931: Fix hangs in GUI tests under Windows in certain conditions.
  Patch by Hirokazu Yamamoto.

8861 8862
- Issue #10512: Properly close sockets under test.test_cgi.

8863 8864
- Issue #10992: Make tests pass under coverage.

8865 8866 8867
- Issue #10826: Prevent sporadic failure in test_subprocess on Solaris due
  to open door files.

8868 8869
- Issue #10990: Prevent tests from clobbering a set trace function.

8870 8871 8872
C-API
-----

8873 8874 8875 8876 8877 8878 8879 8880 8881 8882 8883 8884 8885 8886 8887 8888 8889
- Issue #13452: PyUnicode_EncodeDecimal() doesn't support error handlers
  different than "strict" anymore. The caller was unable to compute the
  size of the output buffer: it depends on the error handler.

- Issue #13560: Add PyUnicode_DecodeLocale(), PyUnicode_DecodeLocaleAndSize()
  and PyUnicode_EncodeLocale() functions to the C API to decode/encode from/to
  the current locale encoding.

- Issue #10831: PyUnicode_FromFormat() supports %li, %lli and %zi formats.

- Issue #11246: Fix PyUnicode_FromFormat("%V") to decode the byte string from
  UTF-8 (with replace error handler) instead of ISO-8859-1 (in strict mode).
  Patch written by Ray Allen.

- Issue #10830: Fix PyUnicode_FromFormatV("%c") for non-BMP characters on
  narrow build.

8890 8891 8892 8893
- Add PyObject_GenericGetDict and PyObject_GeneriSetDict. They are generic
  implementations for the getter and setter of a ``__dict__`` descriptor of C
  types.

8894 8895 8896 8897
- Issue #13727: Add 3 macros to access PyDateTime_Delta members:
  PyDateTime_DELTA_GET_DAYS, PyDateTime_DELTA_GET_SECONDS,
  PyDateTime_DELTA_GET_MICROSECONDS.

8898 8899 8900 8901
- Issue #10542: Add 4 macros to work with surrogates: Py_UNICODE_IS_SURROGATE,
  Py_UNICODE_IS_HIGH_SURROGATE, Py_UNICODE_IS_LOW_SURROGATE,
  Py_UNICODE_JOIN_SURROGATES.

Brian Curtin's avatar
Brian Curtin committed
8902 8903
- Issue #12724: Add Py_RETURN_NOTIMPLEMENTED macro for returning NotImplemented.

Benjamin Peterson's avatar
Benjamin Peterson committed
8904 8905
- PY_PATCHLEVEL_REVISION has been removed, since it's meaningless with
  Mercurial.
8906

8907
- Issue #12173: The first argument of PyImport_ImportModuleLevel is now `const
Benjamin Peterson's avatar
Benjamin Peterson committed
8908
  char *` instead of `char *`.
8909

8910 8911
- Issue #12380: PyArg_ParseTuple now accepts a bytearray for the 'c' format.

8912 8913 8914
Documentation
-------------

8915 8916 8917 8918 8919 8920 8921 8922 8923 8924 8925 8926 8927 8928 8929
- Issue #13989: Document that GzipFile does not support text mode, and give a
  more helpful error message when opened with an invalid mode string.

- Issue #13921: Undocument and clean up sqlite3.OptimizedUnicode,
  which is obsolete in Python 3.x. It's now aliased to str for
  backwards compatibility.

- Issue #12102: Document that buffered files must be flushed before being used
  with mmap. Patch by Steffen Daode Nurpmeso.

- Issue #8982: Improve the documentation for the argparse Namespace object.

- Issue #9343: Document that argparse parent parsers must be configured before
  their children.

Hynek Schlawack's avatar
Hynek Schlawack committed
8930 8931
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.
8932

Petri Lehtinen's avatar
Petri Lehtinen committed
8933 8934
- Issues #13491 and #13995: Fix many errors in sqlite3 documentation.
  Initial patch for #13491 by Johannes Vogel.
Petri Lehtinen's avatar
Petri Lehtinen committed
8935

Petri Lehtinen's avatar
Petri Lehtinen committed
8936 8937
- Issue #13402: Document absoluteness of sys.executable.

8938 8939
- Issue #13883: PYTHONCASEOK also works on OS X.

8940 8941 8942 8943 8944 8945 8946
- Issue #9021: Add an introduction to the copy module documentation.

- Issue #6005: Examples in the socket library documentation use sendall, where
  relevant, instead send method.

- Issue #12798: Updated the mimetypes documentation.

8947 8948 8949
- Issue #12949: Document the kwonlyargcount argument for the PyCode_New
  C API function.

8950 8951 8952
- Issue #13513: Fix io.IOBase documentation to correctly link to the
  io.IOBase.readline method instead of the readline module.

8953 8954 8955
- Issue #13237: Reorganise subprocess documentation to emphasise convenience
  functions and the most commonly needed arguments to Popen.

Florent Xicluna's avatar
Florent Xicluna committed
8956 8957
- Issue #13141: Demonstrate recommended style for socketserver examples.

8958 8959
- Issue #11818: Fix tempfile examples for Python 3.

Georg Brandl's avatar
Georg Brandl committed
8960

8961
**(For information about older versions, consult the HISTORY file.)**