NEWS 330 KB
Newer Older
Georg Brandl's avatar
Georg Brandl committed
1
+++++++++++
2
Python News
3 4
+++++++++++

5 6 7 8 9 10 11 12
What's New in Python 3.4.1rc1?
==============================

Release date: TBA

Core and Builtins
-----------------

13 14
- Issue #21274: Define PATH_MAX for GNU/Hurd in Python/pythonrun.c.

15 16 17
- Issue #21209: Fix sending tuples to custom generator objects with the yield
  from syntax.

18 19 20
- Issue #21134: Fix segfault when str is called on an uninitialized
  UnicodeEncodeError, UnicodeDecodeError, or UnicodeTranslateError object.

21 22 23
- Issue #19537: Fix PyUnicode_DATA() alignment under m68k.  Patch by
  Andreas Schwab.

24 25
- Issue #20929: Add a type cast to avoid shifting a negative number.

26 27 28
- Issue #20731: Properly position in source code files even if they
  are opened in text mode. Patch by Serhiy Storchaka.

29 30 31
- Issue #20637: Key-sharing now also works for instance dictionaries of
  subclasses.  Patch by Peter Ingebretson.

32 33 34
- Issue #12546: Allow \x00 to be used as a fill character when using str, int,
  float, and complex __format__ methods.

Yury Selivanov's avatar
Yury Selivanov committed
35
- Issue #13598: Modify string.Formatter to support auto-numbering of
36
  replacement fields. It now matches the behavior of str.format() in
37
  this regard. Patches by Phil Elson and Ramchandra Apte.
38

39 40 41
Library
-------

42 43 44
- Issue #9815: assertRaises now tries to clear references to local variables
  in the exception's traceback.

45 46 47
- Issue #13204: Calling sys.flags.__new__ would crash the interpreter,
  now it raises a TypeError.

48 49 50
- Issue #19385: Make operations on a closed dbm.dumb database always raise the
  same exception.

51 52 53
- Issue #21207: Detect when the os.urandom cached fd has been closed or
  replaced, and open it anew.

54 55 56 57
- Issue #21291: subprocess's Popen.wait() is now thread safe so that
  multiple threads may be calling wait() or poll() on a Popen instance
  at the same time without losing the Popen.returncode value.

58
- Issue #21127: Path objects can now be instantiated from str subclass
59
  instances (such as ``numpy.str_``).
60

Senthil Kumaran's avatar
Senthil Kumaran committed
61 62 63 64
- Issue #15002: urllib.response object to use _TemporaryFileWrapper (and
  _TemporaryFileCloser) facility. Provides a better way to handle file
  descriptor close. Patch contributed by Christian Theune.

65 66 67
- Issue #12220: mindom now raises a custom ValueError indicating it doesn't
  support spaces in URIs instead of letting a 'split' ValueError bubble up.

68 69 70
- Issue #21239: patch.stopall() didn't work deterministically when the same
  name was patched more than once.

Kushal Das's avatar
Kushal Das committed
71 72 73
- Issue #21222: Passing name keyword argument to mock.create_autospec now
  works.

74 75
- Issue #21197: Add lib64 -> lib symlink in venvs on 64-bit non-OS X POSIX.

76 77 78 79 80
- Issue #17498: Some SMTP servers disconnect after certain errors, violating
  strict RFC conformance.  Instead of losing the error code when we issue the
  subsequent RSET, smtplib now returns the error code and defers raising the
  SMTPServerDisconnected error until the next command is issued.

81 82 83
- Issue #17826: setting an iterable side_effect on a mock function created by
  create_autospec now works. Patch by Kushal Das.

84
- Issue #7776: Fix ``Host:`` header and reconnection when using
85 86
  http.client.HTTPConnection.set_tunnel(). Patch by Nikolaus Rath.

87 88 89
- Issue #20968: unittest.mock.MagicMock now supports division.
  Patch by Johannes Baiter.

90 91 92
- Fix arbitrary memory access in JSONDecoder.raw_decode with a negative second
  parameter. Bug reported by Guido Vranken.

93 94 95 96
- Issue #21169: getpass now handles non-ascii characters that the
  input stream encoding cannot encode by re-encoding using the
  replace error handler.

97 98 99
- Issue #21171: Fixed undocumented filter API of the rot13 codec.
  Patch by Berker Peksag.

100 101
- Issue #21172: isinstance check relaxed from dict to collections.Mapping.

102 103 104
- Issue #21155: asyncio.EventLoop.create_unix_server() now raises a ValueError
  if path and sock are specified at the same time.

105 106 107
- Issue #21149: Improved thread-safety in logging cleanup during interpreter
  shutdown. Thanks to Devin Jeanpierre for the patch.

108 109 110
- Issue #20145: `assertRaisesRegex` and `assertWarnsRegex` now raise a
  TypeError if the second argument is not a string or compiled regex.

111 112 113 114
- Issue #21058: Fix a leak of file descriptor in
  :func:`tempfile.NamedTemporaryFile`, close the file descriptor if
  :func:`io.open` fails

115 116
- Issue #21200: Return None from pkgutil.get_loader() when __spec__ is missing.

117 118 119
- Issue #21013: Enhance ssl.create_default_context() when used for server side
  sockets to provide better security by default.

120 121
- Issue #20633: Replace relative import by absolute import.

122 123
- Issue #20980: Stop wrapping exception when using ThreadPool.

124 125 126
- Issue #21082: In os.makedirs, do not set the process-wide umask. Note this
  changes behavior of makedirs when exist_ok=True.

127 128
- Issue #20990: Fix issues found by pyflakes for multiprocessing.

129 130 131 132
- Issue #21015: SSL contexts will now automatically select an elliptic
  curve for ECDH key exchange on OpenSSL 1.0.2 and later, and otherwise
  default to "prime256v1".

133 134 135
- Issue #20995: Enhance default ciphers used by the ssl module to enable
  better security an prioritize perfect forward secrecy.

136 137
- Issue #20884: Don't assume that __file__ is defined on importlib.__init__.

138 139 140 141 142
- Issue #20879: Delay the initialization of encoding and decoding tables for
  base32, ascii85 and base85 codecs in the base64 module, and delay the
  initialization of the unquote_to_bytes() table of the urllib.parse module, to
  not waste memory if these modules are not used.

143 144 145
- Issue #19157: Include the broadcast address in the usuable hosts for IPv6
  in ipaddress.

146 147 148 149
- Issue #11599: When an external command (e.g. compiler) fails, distutils now
  prints out the whole command line (instead of just the command name) if the
  environment variable DISTUTILS_DEBUG is set.

150 151 152
- Issue #4931: distutils should not produce unhelpful "error: None" messages
  anymore.  distutils.util.grok_environment_error is kept but doc-deprecated.

153 154 155
- Issue #20875: Prevent possible gzip "'read' is not defined" NameError.
  Patch by Claudiu Popa.

156 157 158 159
- Issue #11558: ``email.message.Message.attach`` now returns a more
  useful error message if ``attach`` is called on a message for which
  ``is_multipart`` is False.

160 161 162 163
- Issue #20283: RE pattern methods now accept the string keyword parameters
  as documented.  The pattern and source keyword parameters are left as
  deprecated aliases.

164 165
- Issue #20778: Fix modulefinder to work with bytecode-only modules.

166 167 168
- Issue #20791: copy.copy() now doesn't make a copy when the input is
  a bytes object.  Initial patch by Peter Otten.

169 170 171
- Issue #19748: On AIX, time.mktime() now raises an OverflowError for year
  outsize range [1902; 2037].

172 173 174
- Issue #20816: Fix inspect.getcallargs() to raise correct TypeError for
  missing keyword-only arguments. Patch by Jeremiah Lowin.

175 176 177
- Issue #20817: Fix inspect.getcallargs() to fail correctly if more
  than 3 arguments are missing. Patch by Jeremiah Lowin.

178 179 180 181 182
- Issue #6676: Ensure a meaningful exception is raised when attempting
  to parse more than one XML document per pyexpat xmlparser instance.
  (Original patches by Hirokazu Yamamoto and Amaury Forgeot d'Arc, with
  suggested wording by David Gutteridge)

183 184 185 186 187
- Issue #21117: Fix inspect.signature to better support functools.partial.
  Due to the specifics of functools.partial implementation,
  positional-or-keyword arguments passed as keyword arguments become
  keyword-only.

188 189 190
- Issue #21209: Fix asyncio.tasks.CoroWrapper to workaround a bug
  in yield-from implementation in CPythons prior to 3.4.1.

191 192 193
- asyncio: Add gi_{frame,running,code} properties to CoroWrapper
  (upstream issue #163).

194 195 196
- Issue #21311: Avoid exception in _osx_support with non-standard compiler
  configurations.  Patch by John Szakmeister.

197 198 199
- Issue #11571: Ensure that the turtle window becomes the topmost window
  when launched on OS X.

200 201 202 203 204
Extension Modules
-----------------

- Issue #21276: posixmodule: Don't define USE_XATTRS on KFreeBSD and the Hurd.

205 206 207
IDLE
----

208 209 210
- Issue #21139: Change default paragraph width to 72, the PEP 8 recommendation.

- Issue #21284: Paragraph reformat test passes after user changes reformat width.
211

212 213 214
- Issue #17654: Ensure IDLE menus are customized properly on OS X for
  non-framework builds and for all variants of Tk.

215 216 217
Build
-----

218 219 220
- Issue #21285: Refactor and fix curses configure check to always search
  in a ncursesw directory.

221 222 223 224
- Issue #15234: For BerkelyDB and Sqlite, only add the found library and
  include directories if they aren't already being searched. This avoids
  an explicit runtime library dependency.

225 226 227
- Issue #20644: OS X installer build support for documentation build changes
  in 3.4.1: assume externally supplied sphinx-build is available in /usr/bin.

228 229 230 231 232 233
C API
-----
- Issue #20942: PyImport_ImportFrozenModuleObject() no longer sets __file__ to
  match what importlib does; this affects _frozen_importlib as well as any
  module loaded using imp.init_frozen().

234 235 236
Documentation
-------------

237 238 239
- Issue #21043: Remove the recommendation for specific CA organizations and to
  mention the ability to load the OS certificates.

240 241 242
- Issue #20765: Add missing documentation for PurePath.with_name() and
  PurePath.with_suffix().

243 244 245 246 247 248
- Issue #19407: New package installation and distribution guides based on
  the Python Packaging Authority tools. Existing guides have been retained
  as legacy links from the distutils docs, as they still contain some
  required reference material for tool developers that isn't recorded
  anywhere else.

249 250
- Issue #19697: Document cases where __main__.__spec__ is None.

251 252 253
Tests
-----

254 255
- Issue #21275: Fix a socket test on KFreeBSD.

256 257 258
- Issue #21223: Pass test_site/test_startup_imports when some of the extensions
  are built as builtins.

259 260
- Issue #20635: Added tests for Tk geometry managers.

Martin v. Löwis's avatar
Martin v. Löwis committed
261 262
- Add test case for freeze.

263 264
- Issue #20743: Fix a reference leak in test_tcl.

265 266
- Issue #21097: Move test_namespace_pkgs into test_importlib.

267 268 269 270
- Issue #20939: Avoid various network test failures due to new
  redirect of http://www.python.org/ to https://www.python.org:
  use http://www.example.com instead.

271 272 273
- Issue #20668: asyncio tests no longer rely on tests.txt file.
  (Patch by Vajrasky Kok)

274 275 276
- Issue #21093: Prevent failures of ctypes test_macholib on OS X if a
  copy of libz exists in $HOME/lib or /usr/local/lib.

277 278 279
Tools/Demos
-----------

280 281
- Add support for ``yield from`` to 2to3.

282 283
- Add support for the PEP 465 matrix multiplication operator to 2to3.

284 285 286
- Issue #16047: Fix module exception list and __file__ handling in freeze.
  Patch by Meador Inge.

287 288
- Issue #11824: Consider ABI tags in freeze. Patch by Meador Inge.

289 290 291
- Issue #20535: PYTHONWARNING no longer affects the run_tests.py script.
  Patch by Arfrever Frehtes Taifersar Arahesis.

292

293 294 295 296 297 298 299 300
What's New in Python 3.4.0?
===========================

Release date: 2014-03-16

Library
-------

Ned Deily's avatar
Ned Deily committed
301 302 303
- Issue #20939: Fix test_geturl failure in test_urllibnet due to
  new redirect of http://www.python.org/ to https://www.python.org.

304 305 306 307 308
Documentation
-------------

- Merge in all documentation changes since branching 3.4.0rc1.

309

310 311
What's New in Python 3.4.0 release candidate 3?
===============================================
312

313 314
Release date: 2014-03-09

315 316 317 318 319 320
Core and Builtins
-----------------

- Issue #20786: Fix signatures for dict.__delitem__ and
  property.__delete__ builtins.

321 322 323 324 325 326 327
Library
-------

- Issue #20839: Don't trigger a DeprecationWarning in the still supported
  pkgutil.get_loader() API when __loader__ isn't set on a module (nor
  when pkgutil.find_loader() is called directly).

328 329 330
Build
-----

331 332
- Issue #14512: Launch pydoc -b instead of pydocgui.pyw on Windows.

333 334 335
- Issue #20748: Uninstalling pip does not leave behind the pyc of
  the uninstaller anymore.

336 337 338
- Issue #20568: The Windows installer now installs the unversioned ``pip``
  command in addition to the versioned ``pip3`` and ``pip3.4`` commands.

339 340 341 342
- Issue #20757: The ensurepip helper for the Windows uninstaller now skips
  uninstalling pip (rather than failing) if the user has updated pip to a
  different version from the one bundled with ensurepip.

343
- Issue #20465: Update OS X and Windows installer builds to use
344
  SQLite 3.8.3.1.
345 346


347 348 349 350 351 352 353 354
What's New in Python 3.4.0 release candidate 2?
===============================================

Release date: 2014-02-23

Core and Builtins
-----------------

355 356 357
- Issue #20625: Parameter names in __annotations__ were not mangled properly.
  Discovered by Jonas Wielicki, patch by Yury Selivanov.

358 359 360
- Issue #20261: In pickle, lookup __getnewargs__ and __getnewargs_ex__ on the
  type of the object.

361 362 363
- Issue #20619: Give the AST nodes of keyword-only arguments a column and line
  number.

364 365 366 367
- Issue #20526: Revert changes of issue #19466 which introduces a regression:
  don't clear anymore the state of Python threads early during the Python
  shutdown.

368 369 370
Library
-------

371 372 373
- Issue #20710: The pydoc summary line no longer displays the "self" parameter
  for bound methods.

374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392
- Issue #20566: Change asyncio.as_completed() to use a Queue, to
  avoid O(N**2) behavior.

- Issue #20704: Implement new debug API in asyncio. Add new methods
  BaseEventLoop.set_debug() and BaseEventLoop.get_debug().
  Add support for setting 'asyncio.tasks._DEBUG' variable with
  'PYTHONASYNCIODEBUG' environment variable.

- asyncio: Refactoring and fixes: BaseEventLoop.sock_connect() raises an
  error if the address is not resolved; use __slots__ in Handle and
  TimerHandle; as_completed() and wait() raise TypeError if the passed
  list of Futures is a single Future; call_soon() and other 'call_*()'
  functions raise TypeError if the passed callback is a coroutine
  function; _ProactorBasePipeTransport uses _FlowControlMixin;
  WriteTransport.set_write_buffer_size() calls _maybe_pause_protocol()
  to consider pausing receiving if the watermark limits have changed;
  fix _check_resolved_address() for IPv6 address; and other minor
  improvements, along with multiple documentation updates.

393 394 395 396
- Issue #20684: Fix inspect.getfullargspec() to not to follow __wrapped__
  chains. Make its behaviour consistent with bound methods first argument.
  Patch by Nick Coghlan and Yury Selivanov.

397 398 399 400
- Issue #20681: Add new error handling API in asyncio. New APIs:
  loop.set_exception_handler(), loop.default_exception_handler(), and
  loop.call_exception_handler().

401 402 403 404
- Issue #20673: Implement support for UNIX Domain Sockets in asyncio.
  New APIs: loop.create_unix_connection(), loop.create_unix_server(),
  streams.open_unix_connection(), and streams.start_unix_server().

405 406
- Issue #20616: Add a format() method to tracemalloc.Traceback.

407 408 409 410
- Issue #19744: the ensurepip installation step now just prints a warning to
  stderr rather than failing outright if SSL/TLS is unavailable. This allows
  local installation of POSIX builds without SSL/TLS support.

Benjamin Peterson's avatar
Benjamin Peterson committed
411 412
- Issue #20594: Avoid name clash with the libc function posix_close.

Zachary Ware's avatar
Zachary Ware committed
413 414 415
Build
-----

416 417 418
- Issue #20641: Run MSI custom actions (pip installation, pyc compilation)
  with the NoImpersonate flag, to support elevated execution (UAC).

419 420 421
- Issue #20221: Removed conflicting (or circular) hypot definition when
  compiled with VS 2010 or above.  Initial patch by Tabrez Mohammed.

Zachary Ware's avatar
Zachary Ware committed
422 423 424
- Issue #20609: Restored the ability to build 64-bit Windows binaries on
  32-bit Windows, which was broken by the change in issue #19788.

425

426 427 428
What's New in Python 3.4.0 release candidate 1?
===============================================

429
Release date: 2014-02-10
430 431 432 433

Core and Builtins
-----------------

434 435 436
- Issue #19255: The builtins module is restored to initial value before
  cleaning other modules.  The sys and builtins modules are cleaned last.

437 438
- Issue #20588: Make Python-ast.c C89 compliant.

439
- Issue #20437: Fixed 22 potential bugs when deleting objects references.
440

441 442 443 444
- Issue #20500: Displaying an exception at interpreter shutdown no longer
  risks triggering an assertion failure in PyObject_Str.

- Issue #20538: UTF-7 incremental decoder produced inconsistent string when
445 446
  input was truncated in BASE64 section.

447 448 449 450 451 452
- Issue #20404: io.TextIOWrapper (and hence the open() builtin) now uses the
  internal codec marking system added for issue #19619 to throw LookupError
  for known non-text encodings at stream construction time. The existing
  output type checks remain in place to deal with unmarked third party
  codecs.

453 454
- Issue #17162: Add PyType_GetSlot.

455 456 457
- Issue #20162: Fix an alignment issue in the siphash24() hash function which
  caused a crash on PowerPC 64-bit (ppc64).

458 459 460
Library
-------

461 462 463
- Issue #20530: The signatures for slot builtins have been updated
  to reflect the fact that they only accept positional-only arguments.

464 465 466
- Issue #20517: Functions in the os module that accept two filenames
  now register both filenames in the exception on failure.

467 468
- Issue #20563: The ipaddress module API is now considered stable.

469 470 471 472
- Issue #14983: email.generator now always adds a line end after each MIME
  boundary marker, instead of doing so only when there is an epilogue.  This
  fixes an RFC compliance bug and solves an issue with signed MIME parts.

473 474 475 476 477
- Issue #20540: Fix a performance regression (vs. Python 3.2) when layering
  a multiprocessing Connection over a TCP socket.  For small payloads, Nagle's
  algorithm would introduce idle delays before the entire transmission of a
  message.

478 479 480
- Issue #16983: the new email header parsing code will now decode encoded words
  that are (incorrectly) surrounded by quotes, and register a defect.

481 482 483
- Issue #19772: email.generator no longer mutates the message object when
  doing a down-transform from 8bit to 7bit CTEs.

484 485 486
- Issue #20536: the statistics module now correctly handle Decimal instances
  with positive exponents

487
- Issue #18805: the netmask/hostmask parsing in ipaddress now more reliably
Nick Coghlan's avatar
Nick Coghlan committed
488
  filters out illegal values and correctly allows any valid prefix length.
489

490 491 492 493 494 495
- Issue #20481: For at least Python 3.4, the statistics module will require
  that all inputs for a single operation be of a single consistent type, or
  else a mixed of ints and a single other consistent type. This avoids
  some interoperability issues that arose with the previous approach of
  coercing to a suitable common type.

496 497 498
- Issue #20478: the statistics module now treats collections.Counter inputs
  like any other iterable.

499 500 501 502
- Issue #17369: get_filename was raising an exception if the filename
  parameter's RFC2231 encoding was broken in certain ways.  This was
  a regression relative to python2.

503 504 505 506
- Issue #20013: Some imap servers disconnect if the current mailbox is
  deleted, and imaplib did not handle that case gracefully.  Now it
  handles the 'bye' correctly.

507 508 509 510
- Issue #20531: Revert 3.4 version of fix for #19063, and apply the 3.3
  version.  That is, do *not* raise an error if unicode is passed to
  email.message.Message.set_payload.

511 512 513 514
- Issue #20476: If a non-compat32 policy is used with any of the email parsers,
  EmailMessage is now used as the factory class.  The factory class should
  really come from the policy; that will get fixed in 3.5.

515 516 517
- Issue #19920: TarFile.list() no longer fails when outputs a listing
  containing non-encodable characters.  Based on patch by Vajrasky Kok.

518 519
- Issue #20515: Fix NULL pointer dereference introduced by issue #20368.

520 521
- Issue #19186: Restore namespacing of expat symbols inside the pyexpat module.

522 523 524
- Issue #20053: ensurepip (and hence venv) are no longer affected by the
  settings in the default pip configuration file.

525 526 527
- Issue #20426: When passing the re.DEBUG flag, re.compile() displays the
  debug output every time it is called, regardless of the compilation cache.

528 529
- Issue #20368: The null character now correctly passed from Tcl to Python.
  Improved error handling in variables-related commands.
530

531 532
- Issue #20435: Fix _pyio.StringIO.getvalue() to take into account newline
  translation settings.
533

534 535
- tracemalloc: Fix slicing traces and fix slicing a traceback.

536 537 538
- Issue #20354: Fix an alignment issue in the tracemalloc module on 64-bit
  platforms. Bug seen on 64-bit Linux when using "make profile-opt".

539 540 541
- Issue #17159: inspect.signature now accepts duck types of functions,
  which adds support for Cython functions. Initial patch by Stefan Behnel.

542 543 544
- Issue #18801: Fix inspect.classify_class_attrs to correctly classify
  object.__new__ and object.__init__.

545 546
- Fixed cmath.isinf's name in its argument parsing code.

547 548 549 550 551
- Issue #20311, #20452: poll and epoll now round the timeout away from zero,
  instead of rounding towards zero, in select and selectors modules:
  select.epoll.poll(), selectors.PollSelector.poll() and
  selectors.EpollSelector.poll(). For example, a timeout of one microsecond
  (1e-6) is now rounded to one millisecondi (1e-3), instead of being rounded to
Guido van Rossum's avatar
Guido van Rossum committed
552 553
  zero.  However, the granularity property and asyncio's resolution feature
  were removed again.
554

Guido van Rossum's avatar
Guido van Rossum committed
555 556 557 558
- asyncio: Some refactoring; various fixes; add write flow control to
  unix pipes; Future.set_exception() instantiates the exception
  argument if it is a class; improved proactor pipe transport; support
  wait_for(f, None); don't log broken/disconnected pipes; use
Guido van Rossum's avatar
Guido van Rossum committed
559
  ValueError instead of assert for forbidden subprocess_{shell,exec}
Guido van Rossum's avatar
Guido van Rossum committed
560 561 562 563
  arguments; added a convenience API for subprocess management; added
  StreamReader.at_eof(); properly handle duplicate coroutines/futures
  in gather(), wait(), as_completed(); use a bytearray for buffering
  in StreamReader; and more.
Guido van Rossum's avatar
Guido van Rossum committed
564

565 566
- Issue #20288: fix handling of invalid numeric charrefs in HTMLParser.

567 568
- Issue #20424: Python implementation of io.StringIO now supports lone surrogates.

569 570 571
- Issue #20308: inspect.signature now works on classes without user-defined
  __init__ or __new__ methods.

572 573 574 575 576 577 578 579 580 581
- Issue #20372: inspect.getfile (and a bunch of other inspect functions that
  use it) doesn't crash with unexpected AttributeError on classes defined in C
  without __module__.

- Issue #20356: inspect.signature formatting uses '/' to separate
  positional-only parameters from others.

- Issue #20223: inspect.signature now supports methods defined with
  functools.partialmethods.

582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600
- Issue #19456: ntpath.join() now joins relative paths correctly when a drive
  is present.

- Issue #19077: tempfile.TemporaryDirectory cleanup no longer fails when
  called during shutdown.  Emitting resource warning in __del__ no longer fails.
  Original patch by Antoine Pitrou.

- Issue #20394: Silence Coverity warning in audioop module.

- Issue #20367: Fix behavior of concurrent.futures.as_completed() for
  duplicate arguments.  Patch by Glenn Langford.

- Issue #8260: The read(), readline() and readlines() methods of
  codecs.StreamReader returned incomplete data when were called after
  readline() or read(size).  Based on patch by Amaury Forgeot d'Arc.

- Issue #20105: the codec exception chaining now correctly sets the
  traceback of the original exception as its __traceback__ attribute.

601 602
- Issue #17481: inspect.getfullargspec() now uses inspect.signature() API.

603 604 605
- Issue #15304: concurrent.futures.wait() can block forever even if
  Futures have completed. Patch by Glenn Langford.

606 607 608 609
- Issue #14455: plistlib: fix serializing integers integers in the range
  of an unsigned long long but outside of the range of signed long long for
  binary plist files.

610 611 612
IDLE
----

613 614 615
- Issue #20406: Use Python application icons for Idle window title bars.
  Patch mostly by Serhiy Storchaka.

616 617 618
- Update the python.gif icon for the Idle classbrowser and pathbowser
  from the old green snake to the new new blue and yellow snakes.

619 620 621 622 623 624
- Issue #17721: Remove non-functional configuration dialog help button until we
  make it actually gives some help when clicked. Patch by Guilherme Simões.

Tests
-----

625 626
- Issue #20532: Tests which use _testcapi now are marked as CPython only.

627 628
- Issue #19920: Added tests for TarFile.list().  Based on patch by Vajrasky Kok.

629 630 631
- Issue #19990: Added tests for the imghdr module.  Based on patch by
  Claudiu Popa.

632 633
- Issue #20474: Fix test_socket "unexpected success" failures on OS X 10.7+.

634 635 636
Tools/Demos
-----------

637 638 639 640 641 642 643
- Issue #20530: Argument Clinic's signature format has been revised again.
  The new syntax is highly human readable while still preventing false
  positives.  The syntax also extends Python syntax to denote "self" and
  positional-only parameters, allowing inspect.Signature objects to be
  totally accurate for all supported builtins in Python 3.4.

- Issue #20456: Argument Clinic now observes the C preprocessor conditional
644 645 646 647
  compilation statements of the C files it parses.  When a Clinic block is
  inside a conditional code, it adjusts its output to match, including
  automatically generating an empty methoddef macro.

648
- Issue #20456: Cloned functions in Argument Clinic now use the correct
649 650 651
  name, not the name of the function they were cloned from, for text
  strings inside generated code.

652
- Issue #20456: Fixed Argument Clinic's test suite and "--converters" feature.
653

654
- Issue #20456: Argument Clinic now allows specifying different names
655 656
  for a parameter in Python and C, using "as" on the parameter line.

657 658 659 660 661 662 663 664 665
- Issue #20326: Argument Clinic now uses a simple, unique signature to
  annotate text signatures in docstrings, resulting in fewer false
  positives.  "self" parameters are also explicitly marked, allowing
  inspect.Signature() to authoritatively detect (and skip) said parameters.

- Issue #20326: Argument Clinic now generates separate checksums for the
  input and output sections of the block, allowing external tools to verify
  that the input has not changed (and thus the output is not out-of-date).

666 667 668 669 670
Build
-----

- Issue #20465: Update SQLite shipped with OS X installer to 3.8.3.

671 672 673 674
C-API
-----

- Issue #20517: Added new functions allowing OSError exceptions to reference
675 676
  two filenames instead of one: PyErr_SetFromErrnoWithFilenameObjects() and
  PyErr_SetExcFromWindowsErrWithFilenameObjects().
677

678 679 680
Documentation
-------------

Brett Cannon's avatar
Brett Cannon committed
681 682 683
- Issue #20488: Change wording to say importlib is *the* implementation of
  import instead of just *an* implementation.

684 685 686 687
- Issue #6386: Clarify in the tutorial that specifying a symlink to execute
  means the directory containing the executed script and not the symlink is
  added to sys.path.

688

689 690
What's New in Python 3.4.0 Beta 3?
==================================
691

Larry Hastings's avatar
Larry Hastings committed
692
Release date: 2014-01-26
693 694 695 696

Core and Builtins
-----------------

697 698 699 700
- Issue #20189: Four additional builtin types (PyTypeObject,
  PyMethodDescr_Type, _PyMethodWrapper_Type, and PyWrapperDescr_Type)
  have been modified to provide introspection information for builtins.

701 702 703
- Issue #17825: Cursor "^" is correctly positioned for SyntaxError and
  IndentationError.

704 705 706 707
- Issue #2382: SyntaxError cursor "^" is now written at correct position in most
  cases when multibyte characters are in line (before "^").  This still not
  works correctly with wide East Asian characters.

708 709 710 711 712 713 714
- Issue #18960: The first line of Python script could be executed twice when
  the source encoding was specified on the second line.  Now the source encoding
  declaration on the second line isn't effective if the first line contains
  anything except a comment.  'python -x' works now again with files with the
  source encoding declarations, and can be used to make Python batch files
  on Windows.

715 716 717
Library
-------

Guido van Rossum's avatar
Guido van Rossum committed
718 719 720 721 722 723 724
- asyncio: Various improvements and small changes not all covered by
  issues listed below.  E.g. wait_for() now cancels the inner task if
  the timeout occcurs; tweaked the set of exported symbols; renamed
  Empty/Full to QueueEmpty/QueueFull; "with (yield from lock)" now
  uses a separate context manager; readexactly() raises if not enough
  data was read; PTY support tweaks.

725 726 727 728 729
- Issue #20311: asyncio: Add a granularity attribute to BaseEventLoop: maximum
  between the resolution of the BaseEventLoop.time() method and the resolution
  of the selector. The granuarility is used in the scheduler to round time and
  deadline.

730 731
- Issue #20311: selectors: Add a resolution attribute to BaseSelector.

732 733 734 735
- Issue #20189: unittest.mock now no longer assumes that any object for
  which it could get an inspect.Signature is a callable written in Python.
  Fix courtesy of Michael Foord.

736 737 738 739 740 741
- Issue #20317: ExitStack.__exit__ could create a self-referential loop if an
  exception raised by a cleanup operation already had its context set
  correctly (for example, by the @contextmanager decorator). The infinite
  loop this caused is now avoided by checking if the expected context is
  already set before trying to fix it.

742 743
- Issue #20374: Fix build with GNU readline >= 6.3.

744 745 746
- Issue #20262: Warnings are raised now when duplicate names are added in the
  ZIP file or too long ZIP file comment is truncated.

747 748 749
- Issue #20165: The unittest module no longer considers tests marked with
  @expectedFailure successful if they pass.

750 751
- Issue #18574: Added missing newline in 100-Continue reply from
  http.server.BaseHTTPRequestHandler. Patch by Nikolaus Rath.
752

753 754
- Issue #20270: urllib.urlparse now supports empty ports.

755 756
- Issue #20243: TarFile no longer raise ReadError when opened in write mode.

757 758 759
- Issue #20238: TarFile opened with external fileobj and "w:gz" mode didn't
  write complete output on close.

760 761 762
- Issue #20245: The open functions in the tarfile module now correctly handle
  empty mode.

763 764 765
- Issue #20242: Fixed basicConfig() format strings for the alternative
  formatting styles. Thanks to kespindler for the bug report and patch.

Benjamin Peterson's avatar
Benjamin Peterson committed
766 767
- Issue #20246: Fix buffer overflow in socket.recvfrom_into.

768 769 770 771
- Issues #20206 and #5803: Fix edge case in email.quoprimime.encode where it
  truncated lines ending in a character needing encoding but no newline by
  using a more efficient algorithm that doesn't have the bug.

772 773 774
- Issue #19082: Working xmlrpc.server and xmlrpc.client examples. Both in
  modules and in documentation. Initial patch contributed by Vajrasky Kok.

775 776 777
- Issue #20138: The wsgiref.application_uri() and wsgiref.request_uri()
  functions now conform to PEP 3333 when handle non-ASCII URLs.

778
- Issue #19097: Raise the correct Exception when cgi.FieldStorage is given an
779
  invalid fileobj.
780

781
- Issue #20152: Ported Python/import.c over to Argument Clinic.
782

783 784 785 786
- Issue #13107: argparse and optparse no longer raises an exception when output
  a help on environment with too small COLUMNS.  Based on patch by
  Elazar Gershuni.

787 788 789
- Issue #20207: Always disable SSLv2 except when PROTOCOL_SSLv2 is explicitly
  asked for.

790 791 792
- Issue #18960: The tokenize module now ignore the source encoding declaration
  on the second line if the first line contains anything except a comment.

793 794 795
- Issue #20078: Reading malformed zipfiles no longer hangs with 100% CPU
  consumption.

796 797 798
- Issue #20113: os.readv() and os.writev() now raise an OSError exception on
  error instead of returning -1.

799 800 801 802
- Issue #19719: Make importlib.abc.MetaPathFinder.find_module(),
  PathEntryFinder.find_loader(), and Loader.load_module() use PEP 451 APIs to
  help with backwards-compatibility.

803 804 805
- Issue #20144: inspect.Signature now supports parsing simple symbolic
  constants as parameter default values in __text_signature__.

806 807
- Issue #20072: Fixed multiple errors in tkinter with wantobjects is False.

808 809
- Issue #20229: Avoid plistlib deprecation warning in platform.mac_ver().

810 811
- Issue #14455: Fix some problems with the new binary plist support in plistlib.

812 813 814
IDLE
----

815
- Issue #17390: Add Python version to Idle editor window title bar.
Terry Jan Reedy's avatar
Terry Jan Reedy committed
816
  Original patches by Edmond Burnett and Kent Johnson.
817

818 819 820
- Issue #18960: IDLE now ignores the source encoding declaration on the second
  line if the first line contains anything except a comment.

821 822 823
Tests
-----

824 825 826
- Issue #20358: Tests for curses.window.overlay and curses.window.overwrite
  no longer specify min{row,col} > max{row,col}.

827 828 829
- Issue #19804: The test_find_mac test in test_uuid is now skipped if the
  ifconfig executable is not available.

830 831
- Issue #19886: Use better estimated memory requirements for bigmem tests.

832 833
Tools/Demos
-----------
834

835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851
- Issue #20390: Argument Clinic's "file" output preset now defaults to
  "{dirname}/clinic/{basename}.h".

- Issue #20390: Argument Clinic's "class" directive syntax has been extended
  with two new required  arguments: "typedef" and "type_object".

- Issue #20390: Argument Clinic: If __new__ or __init__ functions didn't use
  kwargs (or args), the PyArg_NoKeywords (or PyArg_NoPositional) calls
  generated are only run when the type object is an exact match.

- Issue #20390: Argument Clinic now fails if you have required parameters after
  optional parameters.

- Issue #20390: Argument Clinic converters now have a new template they can
  inject code into: "modifiers".  Code put there is run in the parsing
  function after argument parsing but before the call to the impl.

852 853
- Issue #20376: Argument Clinic now escapes backslashes in docstrings.

854 855 856 857
- Issue #20381: Argument Clinic now sanity checks the default argument when
  c_default is also specified, providing a nice failure message for
  disallowed values.

858 859 860 861 862 863 864 865 866 867
- Issue #20189: Argument Clinic now ensures that parser functions for
  __new__ are always of type newfunc, the type of the tp_new slot.
  Similarly, parser functions for __init__ are now always of type initproc,
  the type of tp_init.

- Issue #20189: Argument Clinic now suppresses the docstring for __new__
  and __init__ functions if no docstring is provided in the input.

- Issue #20189: Argument Clinic now suppresses the "self" parameter in the
  impl for @staticmethod functions.
868

869 870 871
- Issue #20294: Argument Clinic now supports argument parsing for __new__ and
  __init__ functions.

872 873 874
- Issue #20299: Argument Clinic custom converters may now change the default
  value of c_default and py_default with a class member.

875 876 877
- Issue #20287: Argument Clinic's output is now configurable, allowing
  delaying its output or even redirecting it to a separate file.

878 879 880
- Issue #20226: Argument Clinic now permits simple expressions
  (e.g. "sys.maxsize - 1") as default values for parameters.

881 882 883 884 885 886
- Issue #19936: Added executable bits or shebang lines to Python scripts which
  requires them.  Disable executable bits and shebang lines in test and
  benchmark files in order to prevent using a random system python, and in
  source files of modules which don't provide command line interface.  Fixed
  shebang lines in the unittestgui and checkpip scripts.

887 888 889
- Issue #20268: Argument Clinic now supports cloning the parameters and
  return converter of existing functions.

890 891 892
- Issue #20228: Argument Clinic now has special support for class special
  methods.

893 894 895
- Issue #20214: Fixed a number of small issues and documentation errors in
  Argument Clinic (see issue for details).

896 897 898 899
- Issue #20196: Fixed a bug where Argument Clinic did not generate correct
  parsing code for functions with positional-only parameters where all arguments
  are optional.

900 901 902 903
- Issue #18960: 2to3 and the findnocoding.py script now ignore the source
  encoding declaration on the second line if the first line contains anything
  except a comment.

904
- Issue #19723: The marker comments Argument Clinic uses have been changed
905 906
  to improve readability.

907 908 909
- Issue #20157: When Argument Clinic renames a parameter because its name
  collides with a C keyword, it no longer exposes that rename to PyArg_Parse.

910 911 912
- Issue #20141: Improved Argument Clinic's support for the PyArg_Parse "O!"
  format unit.

913 914 915
- Issue #20144: Argument Clinic now supports simple symbolic constants
  as parameter default values.

916 917 918
- Issue #20143: The line numbers reported in Argument Clinic errors are
  now more accurate.

919 920
- Issue #20142: Py_buffer variables generated by Argument Clinic are now
  initialized with a default value.
921

922 923 924 925 926 927
Build
-----

- Issue #12837: Silence a tautological comparison warning on OS X under Clang in
  socketmodule.c.

928 929 930 931 932 933 934 935
What's New in Python 3.4.0 Beta 2?
==================================

Release date: 2014-01-05

Core and Builtins
-----------------

936 937
- Issue #17432: Drop UCS2 from names of Unicode functions in python3.def.

938 939 940
- Issue #19526: Exclude all new API from the stable ABI. Exceptions can be
  made if a need is demonstrated.

941 942 943
- Issue #19969: PyBytes_FromFormatV() now raises an OverflowError if "%c"
  argument is not in range [0; 255].

944 945
- Issue #19995: %c, %o, %x, and %X now issue a DeprecationWarning on non-integer
  input; reworded docs to clarify that an integer type should define both __int__
946 947
  and __index__.

948 949 950 951
- Issue #19787: PyThread_set_key_value() now always set the value. In Python
  3.3, the function did nothing if the key already exists (if the current value
  is a non-NULL pointer).

952 953 954 955 956 957
- Issue #14432: Remove the thread state field from the frame structure. Fix a
  crash when a generator is created in a C thread that is destroyed while the
  generator is still used. The issue was that a generator contains a frame, and
  the frame kept a reference to the Python state of the destroyed C thread. The
  crash occurs when a trace function is setup.

958 959 960 961 962
- Issue #19576: PyGILState_Ensure() now initializes threads. At startup, Python
  has no concrete GIL. If PyGILState_Ensure() is called from a new thread for
  the first time and PyEval_InitThreads() was not called yet, a GIL needs to be
  created.

963 964 965
- Issue #17576: Deprecation warning emitted now when __int__() or __index__()
  return not int instance.

966 967
- Issue #19932: Fix typo in import.h, missing whitespaces in function prototypes.

968 969 970
- Issue #19736: Add module-level statvfs constants defined for GNU/glibc
  based systems.

971 972
- Issue #20097: Fix bad use of "self" in importlib's WindowsRegistryFinder.

973 974
- Issue #19729: In str.format(), fix recursive expansion in format spec.

975 976 977
- Issue #19638: Fix possible crash / undefined behaviour from huge (more than 2
  billion characters) input strings in _Py_dg_strtod.

978 979 980
Library
-------

981 982
- Issue #20154: Deadlock in asyncio.StreamReader.readexactly().

983 984
- Issue #16113: Remove sha3 module again.

985 986
- Issue #20111: pathlib.Path.with_suffix() now sanity checks the given suffix.

987 988
- Fix breakage in TestSuite.countTestCases() introduced by issue #11798.

989 990
- Issue #20108: Avoid parameter name clash in inspect.getcallargs().

991 992
- Issue #19918: Fix PurePath.relative_to() under Windows.

993 994 995
- Issue #19422: Explicitly disallow non-SOCK_STREAM sockets in the ssl
  module, rather than silently let them emit clear text data.

996 997 998
- Issue #20046: Locale alias table no longer contains entities which can be
  calculated.  Generalized support of the euro modifier.

999 1000
- Issue #20027: Fixed locale aliases for devanagari locales.

1001 1002
- Issue #20067: Tkinter variables now work when wantobjects is false.

1003 1004 1005
- Issue #19020: Tkinter now uses splitlist() instead of split() in configure
  methods.

1006 1007 1008 1009
- Issue #19744: ensurepip now provides a better error message when Python is
  built without SSL/TLS support (pip currently requires that support to run,
  even if only operating with local wheel files)

1010 1011 1012
- Issue #19734: ensurepip now ignores all pip environment variables to avoid
  odd behaviour based on user configuration settings

1013 1014
- Fix TypeError on "setup.py upload --show-response".

1015 1016
- Issue #20045: Fix "setup.py register --list-classifiers".

1017 1018 1019
- Issue #18879: When a method is looked up on a temporary file, avoid closing
  the file before the method is possibly called.

1020 1021 1022
- Issue #20037: Avoid crashes when opening a text file late at interpreter
  shutdown.

1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036
- Issue #19967: Thanks to the PEP 442, asyncio.Future now uses a
  destructor to log uncaught exceptions, instead of the dedicated
  _TracebackLogger class.

- Added a Task.current_task() class method to asyncio.

- Issue #19850: Set SA_RESTART in asyncio when registering a signal
  handler to limit EINTR occurrences.

- Implemented write flow control in asyncio for proactor event loop (Windows).

- Change write buffer in asyncio use to avoid O(N**2) behavior.  Make
  write()/sendto() accept bytearray/memoryview.

1037 1038 1039
- Issue #20034: Updated alias mapping to most recent locale.alias file
  from X.org distribution using makelocalealias.py.

1040 1041 1042
- Issue #5815: Fixed support for locales with modifiers.  Fixed support for
  locale encodings with hyphens.

1043 1044 1045
- Issue #20026: Fix the sqlite module to handle correctly invalid isolation
  level (wrong type).

1046 1047 1048
- Issue #18829: csv.Dialect() now checks type for delimiter, escapechar and
  quotechar fields.  Original patch by Vajrasky Kok.

1049 1050 1051 1052
- Issue #19855: uuid.getnode() on Unix now looks on the PATH for the
  executables used to find the mac address, with /sbin and /usr/sbin as
  fallbacks.

1053 1054 1055
- Issue #20007: HTTPResponse.read(0) no more prematurely closes connection.
  Original patch by Simon Sapin.

1056 1057 1058 1059 1060 1061
- Issue #19946: multiprocessing now uses runpy to initialize __main__ in
  child processes when necessary, allowing it to correctly handle scripts
  without suffixes and submodules that use explicit relative imports or
  otherwise rely on parent modules being correctly imported prior to
  execution.

1062 1063 1064 1065
- Issue #19921: When Path.mkdir() is called with parents=True, any missing
  parent is created with the default permissions, ignoring the mode argument
  (mimicking the POSIX "mkdir -p" command).

1066 1067 1068
- Issue #19887: Improve the Path.resolve() algorithm to support certain
  symlink chains.

1069 1070
- Issue #19912: Fixed numerous bugs in ntpath.splitunc().

1071 1072 1073
- Issue #19911: ntpath.splitdrive() now correctly processes the 'İ' character
  (U+0130, LATIN CAPITAL LETTER I WITH DOT ABOVE).

1074 1075 1076
- Issue #19532: python -m compileall with no filename/directory arguments now
  respects the -f and -q flags instead of ignoring them.

1077 1078
- Issue #19623: Fixed writing to unseekable files in the aifc module.

1079 1080 1081
- Issue #19946: multiprocessing.spawn now raises ImportError when the module to
  be used as the main module cannot be imported.

1082 1083
- Issue #17919: select.poll.register() again works with poll.POLLNVAL on AIX.
  Fixed integer overflow in the eventmask parameter.
1084

1085 1086 1087 1088 1089 1090 1091
- Issue #19063: if a Charset's body_encoding was set to None, the email
  package would generate a message claiming the Content-Transfer-Encoding
  was 7bit, and produce garbage output for the content.  This now works.
  A couple of other set_payload mishandlings of non-ASCII are also fixed.
  In addition, calling set_payload with a string argument without
  specifying a charset now raises an error (this is a new error in 3.4).

1092 1093
- Issue #15475: Add __sizeof__ implementations for itertools objects.

1094 1095 1096
- Issue #19944: Fix importlib.find_spec() so it imports parents as needed
  and move the function to importlib.util.

1097 1098 1099
- Issue #19880: Fix a reference leak in unittest.TestCase. Explicitly break
  reference cycles between frames and the _Outcome instance.

1100 1101 1102 1103 1104 1105
- Issue #17429: platform.linux_distribution() now decodes files from the UTF-8
  encoding with the surrogateescape error handler, instead of decoding from the
  locale encoding in strict mode. It fixes the function on Fedora 19 which is
  probably the first major distribution release with a non-ASCII name. Patch
  written by Toshio Kuratomi.

1106 1107 1108
- Issue #19343: Expose FreeBSD-specific APIs in resource module.  Original
  patch by Koobs.

1109 1110 1111 1112
- Issue #19929: Call os.read with 32768 within subprocess.Popen.communicate
  rather than 4096 for efficiency.  A microbenchmark shows Linux and OS X
  both using ~50% less cpu time this way.

1113 1114 1115
- Issue #19506: Use a memoryview to avoid a data copy when piping data
  to stdin within subprocess.Popen.communicate.  5-10% less cpu usage.

Guido van Rossum's avatar
Guido van Rossum committed
1116 1117 1118
- Issue #19876: selectors unregister() no longer raises ValueError or OSError
  if the FD is closed (as long as it was registered).

1119 1120
- Issue #19908: pathlib now joins relative Windows paths correctly when a drive
  is present.  Original patch by Antoine Pitrou.
1121

1122 1123
- Issue #19296: Silence compiler warning in dbm_open

1124 1125 1126 1127
- Issue #6784: Strings from Python 2 can now be unpickled as bytes
  objects by setting the encoding argument of Unpickler to be 'bytes'.
  Initial patch by Merlijn van Deen.

1128
- Issue #19839: Fix regression in bz2 module's handling of non-bzip2 data at
1129
  EOF, and analogous bug in lzma module.
1130

1131 1132 1133
- Issue #19881: Fix pickling bug where cpickle would emit bad pickle data for
  large bytes string (i.e., with size greater than 2**32-1).

1134 1135 1136 1137
- Issue #19138: doctest's IGNORE_EXCEPTION_DETAIL now allows a match when
  no exception detail exists (no colon following the exception's name, or
  a colon does follow but no text follows the colon).

1138 1139
- Issue #19927: Add __eq__ to path-based loaders in importlib.

1140 1141 1142 1143
- Issue #19827: On UNIX, setblocking() and settimeout() methods of
  socket.socket can now avoid a second syscall if the ioctl() function can be
  used, or if the non-blocking flag of the socket is unchanged.

1144 1145 1146
- Issue #19785: smtplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1147 1148 1149
- Issue #19784: poplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1150 1151 1152
- Issue #19783: nntplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1153 1154 1155
- Issue #19782: imaplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1156 1157
- Issue 20123: Fix pydoc.synopsis() for "binary" modules.

1158 1159
- Issue #19834: Support unpickling of exceptions pickled by Python 2.

1160 1161 1162
- Issue #19781: ftplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

1163 1164 1165
- Issue #19509: Add SSLContext.check_hostname to match the peer's certificate
  with server_hostname on handshake.

1166 1167 1168
- Issue #15798: Fixed subprocess.Popen() to no longer fail if file
  descriptor 0, 1 or 2 is closed.

1169 1170
- Issue #17897: Optimized unpickle prefetching.

1171 1172 1173 1174
- Issue #3693: Make the error message more helpful when the array.array()
  constructor is given a str. Move the array module typecode documentation to
  the docstring of the constructor.

1175 1176 1177
- Issue #19088: Fixed incorrect caching of the copyreg module in
  object.__reduce__() and object.__reduce_ex__().

1178 1179 1180
- Issue #19698: Removed exec_module() methods from
  importlib.machinery.BuiltinImporter and ExtensionFileLoader.

1181 1182
- Issue #18864: Added a setter for ModuleSpec.has_location.

1183 1184 1185
- Fixed _pickle.Unpickler to not fail when loading empty strings as
  persistent IDs.

1186 1187 1188
- Issue #11480: Fixed copy.copy to work with classes with custom metaclasses.
  Patch by Daniel Urban.

1189 1190 1191
- Issue #6477: Added support for pickling the types of built-in singletons
  (i.e., Ellipsis, NotImplemented, None).

1192 1193
- Issue #19713: Add remaining PEP 451-related deprecations and move away
  from using find_module/find_loaer/load_module.
1194

1195 1196
- Issue #19708: Update pkgutil to use the new importer APIs.

1197 1198
- Issue #19703: Update pydoc to use the new importer APIs.

1199 1200
- Issue #19851: Fixed a regression in reloading sub-modules.

1201 1202
- ssl.create_default_context() sets OP_NO_COMPRESSION to prevent CRIME.

1203 1204
- Issue #19802: Add socket.SO_PRIORITY.

1205 1206 1207
- Issue #11508: Fixed uuid.getnode() and uuid.uuid1() on environment with
  virtual interface.  Original patch by Kent Frazier.

1208 1209
- Issue #11489: JSON decoder now accepts lone surrogates.

1210 1211 1212
- Issue #19545: Avoid chained exceptions while passing stray % to
  time.strptime().  Initial patch by Claudiu Popa.

1213 1214 1215
IDLE
----

1216 1217
- Issue #20058: sys.stdin.readline() in IDLE now always returns only one line.

1218 1219 1220 1221
- Issue #19481: print() of string subclass instance in IDLE no longer hangs.

- Issue #18270: Prevent possible IDLE AttributeError on OS X when no initial
  shell window is present.
1222

Zachary Ware's avatar
Zachary Ware committed
1223 1224
Tests
-----
1225

1226 1227 1228
- Issue #20055: Fix test_shutil under Windows with symlink privileges held.
  Patch by Vajrasky Kok.

1229 1230 1231
- Issue #20070: Don't run test_urllib2net when network resources are not
  enabled.

1232 1233 1234
- Issue #19938: Re-enabled test_bug_1333982 in test_dis, which had been
  disabled since 3.0 due to the changes in listcomp handling.

1235 1236
- Issue #19320: test_tcl no longer fails when wantobjects is false.

1237
- Issue #19919: Fix flaky SSL test. connect_ex() sometimes returns
1238 1239
  EWOULDBLOCK on Windows or VMs hosted on Windows.

1240 1241
- Issue #19912: Added tests for ntpath.splitunc().

1242 1243
- Issue #19828: Fixed test_site when the whole suite is run with -S.

1244 1245
- Issue #19928: Implemented a test for repr() of cell objects.

1246 1247
- Issue #19535: Fixed test_docxmlrpc, test_functools, test_inspect, and
  test_statistics when python is run with -OO.
1248

1249 1250 1251
- Issue #19926: Removed unneeded test_main from test_abstract_numbers.
  Patch by Vajrasky Kok.

1252
- Issue #19572: More skipped tests explicitly marked as skipped.
1253

1254
- Issue #19595, #19987: Re-enabled a long-disabled test in test_winsound.
1255

Zachary Ware's avatar
Zachary Ware committed
1256 1257
- Issue #19588: Fixed tests in test_random that were silently skipped most
  of the time.  Patch by Julian Gindi.
1258

1259 1260
Build
-----
1261

1262 1263
- Issue #19728: Enable pip installation by default on Windows.

1264 1265
- Issue #16136: Remove VMS support

1266 1267 1268
- Issue #18215: Add script Tools/ssl/test_multiple_versions.py to compile and
  run Python's unit tests with multiple versions of OpenSSL.

1269 1270 1271
- Issue #19922: define _INCLUDE__STDC_A1_SOURCE in HP-UX to include mbstate_t
  for mbrtowc().

1272 1273 1274
- Issue #19788: kill_python(_d).exe is now run as a PreBuildEvent on the
  pythoncore sub-project.  This should prevent build errors due a previous
  build's python(_d).exe still running.
1275

1276 1277
Documentation
-------------
Tim Golden's avatar
Tim Golden committed
1278

1279 1280
- Issue #20265: Updated some parts of the Using Windows document.

1281 1282 1283
- Issue #20266: Updated some parts of the Windows FAQ.

- Issue #20255: Updated the about and bugs pages.
1284

1285 1286 1287
- Issue #20253: Fixed a typo in the ipaddress docs that advertised an
  illegal attribute name.  Found by INADA Naoki.

1288
- Issue #18840: Introduce the json module in the tutorial, and de-emphasize
1289
  the pickle module.
1290

1291
- Issue #19845: Updated the Compiling Python on Windows section.
1292

1293
- Issue #19795: Improved markup of True/False constants.
1294

1295 1296 1297
Tools/Demos
-----------

1298 1299
- Issue #19659: Added documentation for Argument Clinic.

1300 1301
- Issue #19976: Argument Clinic METH_NOARGS functions now always
  take two parameters.
1302

1303
What's New in Python 3.4.0 Beta 1?
1304
==================================
1305

1306
Release date: 2013-11-24
1307 1308 1309

Core and Builtins
-----------------
1310

1311 1312
- Use the repr of a module name in more places in import, especially
  exceptions.
1313

1314 1315 1316 1317 1318 1319
- Issue #19619: str.encode, bytes.decode and bytearray.decode now use an
  internal API to throw LookupError for known non-text encodings, rather
  than attempting the encoding or decoding operation and then throwing a
  TypeError for an unexpected output type. (The latter mechanism remains
  in place for third party non-text encodings)

1320 1321 1322
- Issue #19183: Implement PEP 456 'secure and interchangeable hash algorithm'.
  Python now uses SipHash24 on all major platforms.

1323 1324 1325 1326 1327 1328
- Issue #12892: The utf-16* and utf-32* encoders no longer allow surrogate code
  points (U+D800-U+DFFF) to be encoded.  The utf-32* decoders no longer decode
  byte sequences that correspond to surrogate code points.  The surrogatepass
  error handler now works with the utf-16* and utf-32* codecs.  Based on
  patches by Victor Stinner and Kang-Hao (Kenny) Lu.

1329 1330 1331
- Issue #17806: Added keyword-argument support for "tabsize" to
  str/bytes.expandtabs().

1332 1333 1334 1335 1336 1337 1338 1339 1340
- Issue #17828: Output type errors in str.encode(), bytes.decode() and
  bytearray.decode() now direct users to codecs.encode() or codecs.decode()
  as appropriate.

- Issue #17828: The interpreter now attempts to chain errors that occur in
  codec processing with a replacement exception of the same type that
  includes the codec name in the error message. It ensures it only does this
  when the creation of the replacement exception won't lose any information.

1341 1342 1343 1344
- Issue #19466: Clear the frames of daemon threads earlier during the
  Python shutdown to call objects destructors. So "unclosed file" resource
  warnings are now corretly emitted for daemon threads.

1345
- Issue #19514: Deduplicate some _Py_IDENTIFIER declarations.
1346 1347
  Patch by Andrei Dorian Duma.

1348 1349 1350
- Issue #17936: Fix O(n**2) behaviour when adding or removing many subclasses
  of a given type.

1351 1352 1353
- Issue #19428: zipimport now handles errors when reading truncated or invalid
  ZIP archive.

1354 1355 1356 1357
- Issue #18408: Add a new PyFrame_FastToLocalsWithError() function to handle
  exceptions when merging fast locals into f_locals of a frame.
  PyEval_GetLocals() now raises an exception and return NULL on failure.

1358 1359
- Issue #19369: Optimized the usage of __length_hint__().

1360 1361 1362
- Issue #18603: Ensure that PyOS_mystricmp and PyOS_mystrnicmp are in the
  Python executable and not removed by the linker's optimizer.

1363
- Issue #19306: Add extra hints to the faulthandler module's stack
1364 1365
  dumps that these are "upside down".

1366 1367
Library
-------
1368

1369 1370 1371
- Issue #3158: doctest can now find doctests in functions and methods
  written in C.

1372 1373 1374
- Issue #13477: Added command line interface to the tarfile module.
  Original patch by Berker Peksag.

1375 1376 1377
- Issue #19674: inspect.signature() now produces a correct signature
  for some builtins.

1378 1379
- Issue #19722: Added opcode.stack_effect(), which
  computes the stack effect of bytecode instructions.
1380

1381 1382 1383 1384
- Issue #19735: Implement private function ssl._create_stdlib_context() to
  create SSLContext objects in Python's stdlib module. It provides a single
  configuration point and makes use of SSLContext.load_default_certs().

1385 1386 1387 1388
- Issue #16203: Add re.fullmatch() function and regex.fullmatch() method,
  which anchor the pattern at both ends of the string to match.
  Original patch by Matthew Barnett.

1389 1390 1391
- Issue #13592: Improved the repr for regular expression pattern objects.
  Based on patch by Hugo Lopes Tavares.

1392 1393 1394
- Issue #19641: Added the audioop.byteswap() function to convert big-endian
  samples to little-endian and vice versa.

1395 1396
- Issue #15204: Deprecated the 'U' mode in file-like objects.

1397 1398
- Issue #17810: Implement PEP 3154, pickle protocol 4.

1399 1400
- Issue #19668: Added support for the cp1125 encoding.

1401 1402 1403
- Issue #19689: Add ssl.create_default_context() factory function. It creates
  a new SSLContext object with secure default settings.

1404 1405 1406
- Issue #19727: os.utime(..., None) is now potentially more precise
  under Windows.

1407 1408 1409
- Issue #17201: ZIP64 extensions now are enabled by default.  Patch by
  William Mallard.

1410 1411 1412 1413
- Issue #19292: Add SSLContext.load_default_certs() to load default root CA
  certificates from default stores or system stores. By default the method
  loads CA certs for authentication of server certs.

1414 1415
- Issue #19673: Add pathlib to the stdlib as a provisional module (PEP 428).

1416 1417 1418 1419
- Issue #16596: pdb in a generator now properly skips over yield and
  yield from rather than stepping out of the generator into its
  caller.  (This is essential for stepping through asyncio coroutines.)

1420 1421 1422 1423
- Issue #17916: Added dis.Bytecode.from_traceback() and
  dis.Bytecode.current_offset to easily display "current instruction"
  markers in the new disassembly API (Patch by Claudiu Popa).

1424 1425
- Issue #19552: venv now supports bootstrapping pip into virtual environments

1426 1427 1428 1429
- Issue #17134: Finalize interface to Windows' certificate store. Cert and
  CRL enumeration are now two functions. enum_certificates() also returns
  purpose flags as set of OIDs.

1430 1431
- Issue #19555: Restore sysconfig.get_config_var('SO'), (and the distutils
  equivalent) with a DeprecationWarning pointing people at $EXT_SUFFIX.
1432

1433 1434 1435 1436
- Issue #8813: Add SSLContext.verify_flags to change the verification flags
  of the context in order to enable certification revocation list (CRL)
  checks or strict X509 rules.

1437 1438
- Issue #18294: Fix the zlib module to make it 64-bit safe.

1439 1440 1441
- Issue #19682: Fix compatibility issue with old version of OpenSSL that
  was introduced by Issue #18379.

1442 1443
- Issue #14455: plistlib now supports binary plists and has an updated API.

1444 1445
- Issue #19633: Fixed writing not compressed 16- and 32-bit wave files on
  big-endian platforms.
1446

1447 1448 1449
- Issue #18379: SSLSocket.getpeercert() returns CA issuer AIA fields, OCSP
  and CRL distribution points.

1450 1451 1452 1453
- Issue #18138: Implement cadata argument of SSLContext.load_verify_location()
  to load CA certificates and CRL from memory. It supports PEM and DER
  encoded strings.

1454 1455 1456
- Issue #18775: Add name and block_size attribute to HMAC object. They now
  provide the same API elements as non-keyed cryptographic hash functions.

1457 1458 1459
- Issue #17276: MD5 as default digestmod for HMAC is deprecated. The HMAC
  module supports digestmod names, e.g. hmac.HMAC('sha1').

1460 1461
- Issue #19449: in csv's writerow, handle non-string keys when generating the
  error message that certain keys are not in the 'fieldnames' list.
Georg Brandl's avatar
Georg Brandl committed
1462

1463 1464 1465
- Issue #13633: Added a new convert_charrefs keyword arg to HTMLParser that,
  when True, automatically converts all character references.

1466 1467
- Issue #2927: Added the unescape() function to the html module.

1468 1469
- Issue #8402: Added the escape() function to the glob module.

1470 1471
- Issue #17618: Add Base85 and Ascii85 encoding/decoding to the base64 module.

1472 1473 1474
- Issue #19634: time.strftime("%y") now raises a ValueError on AIX when given a
  year before 1900.

1475 1476 1477
- Fix test.support.bind_port() to not cause an error when Python was compiled
  on a system with SO_REUSEPORT defined in the headers but run on a system
  with an OS kernel that does not support that reasonably new socket option.
1478

1479
- Fix compilation error under gcc of the ctypes module bundled libffi for arm.
Georg Brandl's avatar
Georg Brandl committed
1480

1481 1482 1483
- Issue #19448: Add private API to SSL module to lookup ASN.1 objects by OID,
  NID, short name and long name.

1484 1485 1486
- Issue #19282: dbm.open now supports the context manager protocol. (Inital
  patch by Claudiu Popa)

1487
- Issue #8311: Added support for writing any bytes-like objects in the aifc,
1488 1489
  sunau, and wave modules.

1490 1491
- Issue #5202: Added support for unseekable files in the wave module.

1492 1493 1494 1495
- Issue #19544 and Issue #1180: Restore global option to ignore
  ~/.pydistutils.cfg in Distutils, accidentally removed in backout of
  distutils2 changes.

1496
- Issue #19523: Closed FileHandler leak which occurred when delay was set.
1497

1498 1499 1500
- Issue #19544 and Issue #6516: Restore support for --user and --group
  parameters to sdist command accidentally rolled back as part of the
  distutils2 rollback.
1501

Tim Golden's avatar
Tim Golden committed
1502 1503 1504
- Issue #13674: Prevented time.strftime from crashing on Windows when given
  a year before 1900 and a format of %y.

1505 1506 1507
- Issue #19406: implementation of the ensurepip module (part of PEP 453).
  Patch by Donald Stufft and Nick Coghlan.

1508 1509 1510
- Issue #19544 and Issue #6286: Restore use of urllib over http allowing use
  of http_proxy for Distutils upload command, a feature accidentally lost
  in the rollback of distutils2.
1511

1512 1513 1514
- Issue #19544 and Issue #7457: Restore the read_pkg_file method to
  distutils.dist.DistributionMetadata accidentally removed in the undo of
  distutils2.
1515

1516 1517 1518
- Issue #16685: Added support for any bytes-like objects in the audioop module.
  Removed support for strings.

1519 1520 1521
- Issue #7171: Add Windows implementation of ``inet_ntop`` and ``inet_pton``
  to socket module. Patch by Atsuo Ishimoto.

1522 1523
- Issue #19261: Added support for writing 24-bit samples in the sunau module.

1524 1525 1526
- Issue #1097797: Added CP273 encoding, used on IBM mainframes in
  Germany and Austria.  Mapping provided by Michael Bierenfeld.

1527
- Issue #1575020: Fixed support of 24-bit wave files on big-endian platforms.
1528

1529 1530 1531 1532 1533 1534 1535 1536 1537 1538 1539 1540 1541 1542
- Issue #19378: Fixed a number of cases in the dis module where the new
  "file" parameter was not being honoured correctly

- Issue #19378: Removed the "dis.Bytecode.show_info" method

- Issue #19378: Renamed the "dis.Bytecode.display_code" method to
  "dis.Bytecode.dis" and converted it to returning a string rather than
  printing output.

- Issue #19378: the "line_offset" parameter in the new "dis.get_instructions"
  API has been renamed to "first_line" (and the default value and usage
  changed accordingly). This should reduce confusion with the more common use
  of "offset" in the dis docs to refer to bytecode offsets.

1543 1544 1545 1546
- Issue #18678: Corrected spwd struct member names in spwd module:
  sp_nam->sp_namp, and sp_pwd->sp_pwdp.  The old names are kept as extra
  structseq members, for backward compatibility.

1547 1548 1549
- Issue #6157: Fixed tkinter.Text.debug().  tkinter.Text.bbox() now raises
  TypeError instead of TclError on wrong number of arguments.  Original patch
  by Guilherme Polo.
1550

1551 1552
- Issue #10197: Rework subprocess.get[status]output to use subprocess
  functionality and thus to work on Windows. Patch by Nick Coghlan
1553

1554 1555
- Issue #6160: The bbox() method of tkinter.Spinbox now returns a tuple of
  integers instead of a string.  Based on patch by Guilherme Polo.
1556

1557 1558
- Issue #19403: contextlib.redirect_stdout is now reentrant

1559 1560
- Issue #19286: Directories in ``package_data`` are no longer added to
  the filelist, preventing failure outlined in the ticket.
1561

Ezio Melotti's avatar
Ezio Melotti committed
1562 1563
- Issue #19480: HTMLParser now accepts all valid start-tag names as defined
  by the HTML5 standard.
1564

1565 1566 1567
- Issue #15114: The html.parser module now raises a DeprecationWarning when the
  strict argument of HTMLParser or the HTMLParser.error method are used.

1568 1569 1570
- Issue #19410: Undo the special-casing removal of '' for
  importlib.machinery.FileFinder.

1571 1572 1573
- Issue #19424: Fix the warnings module to accept filename containing surrogate
  characters.

Benjamin Peterson's avatar
Benjamin Peterson committed
1574
- Issue #19435: Fix directory traversal attack on CGIHttpRequestHandler.
1575

1576 1577 1578
- Issue #19227: Remove pthread_atfork() handler. The handler was added to
  solve #18747 but has caused issues.

1579 1580 1581
- Issue #19420: Fix reference leak in module initalization code of
  _hashopenssl.c

1582 1583
- Issue #19329: Optimized compiling charsets in regular expressions.

1584 1585 1586
- Issue #19227: Try to fix deadlocks caused by re-seeding then OpenSSL
  pseudo-random number generator on fork().

1587 1588 1589
- Issue #16037: HTTPMessage.readheaders() raises an HTTPException when more than
  100 headers are read.  Adapted from patch by Jyrki Pulliainen.

1590 1591 1592 1593
- Issue #16040: CVE-2013-1752: nntplib: Limit maximum line lengths to 2048 to
  prevent readline() calls from consuming too much memory.  Patch by Jyrki
  Pulliainen.

1594 1595 1596 1597
- Issue #16041: CVE-2013-1752: poplib: Limit maximum line lengths to 2048 to
  prevent readline() calls from consuming too much memory.  Patch by Jyrki
  Pulliainen.

1598 1599 1600 1601
- Issue #17997: Change behavior of ``ssl.match_hostname()`` to follow RFC 6125,
  for security reasons.  It now doesn't match multiple wildcards nor wildcards
  inside IDN fragments.

1602 1603 1604
- Issue #16039: CVE-2013-1752: Change use of readline in imaplib module to limit
  line length.  Patch by Emil Lind.

1605 1606 1607 1608 1609
- Issue #19330: the unnecessary wrapper functions have been removed from the
  implementations of the new contextlib.redirect_stdout and
  contextlib.suppress context managers, which also ensures they provide
  reasonable help() output on instances

Benjamin Peterson's avatar
Benjamin Peterson committed
1610 1611
- Issue #19393: Fix symtable.symtable function to not be confused when there are
  functions or classes named "top".
1612

1613 1614
- Issue #18685: Restore re performance to pre-PEP 393 levels.

1615 1616
- Issue #19339: telnetlib module is now using time.monotonic() when available
  to compute timeout.
1617

1618 1619
- Issue #19399: fix sporadic test_subprocess failure.

1620 1621 1622
- Issue #13234: Fix os.listdir to work with extended paths on Windows.
  Patch by Santoso Wijaya.

1623 1624 1625
- Issue #19375: The site module adding a "site-python" directory to sys.path,
  if it exists, is now deprecated.

1626 1627 1628
- Issue #19379: Lazily import linecache in the warnings module, to make
  startup with warnings faster until a warning gets printed.

1629 1630 1631 1632 1633 1634
- Issue #19288: Fixed the "in" operator of dbm.gnu databases for string
  argument.  Original patch by Arfrever Frehtes Taifersar Arahesis.

- Issue #19287: Fixed the "in" operator of dbm.ndbm databases for string
  argument.  Original patch by Arfrever Frehtes Taifersar Arahesis.

1635
- Issue #19327: Fixed the working of regular expressions with too big charset.
1636

1637 1638 1639
- Issue #17400: New 'is_global' attribute for ipaddress to tell if an address
  is allocated by IANA for global or private networks.

1640 1641
- Issue #19350: Increasing the test coverage of macurl2path. Patch by Colin
  Williams.
1642

1643 1644 1645
- Issue #19365: Optimized the parsing of long replacement string in re.sub*()
  functions.

1646 1647
- Issue #19352: Fix unittest discovery when a module can be reached
  through several paths (e.g. under Debian/Ubuntu with virtualenv).
1648

1649 1650
- Issue #15207: Fix mimetypes to read from correct part of Windows registry
  Original patch by Dave Chambers
1651

1652 1653
- Issue #16595: Add prlimit() to resource module.

1654 1655
- Issue #19324: Expose Linux-specific constants in resource module.

1656 1657
- Load SSL's error strings in hashlib.

1658 1659
- Issue #18527: Upgrade internal copy of zlib to 1.2.8.

1660 1661
- Issue #19274: Add a filterfunc parameter to PyZipFile.writepy.

1662 1663 1664
- Issue #8964: fix platform._sys_version to handle IronPython 2.6+.
  Patch by Martin Matusiak.

1665 1666
- Issue #19413: Restore pre-3.3 reload() semantics of re-finding modules.

1667 1668 1669 1670 1671 1672 1673 1674 1675 1676 1677 1678
- Issue #18958: Improve error message for json.load(s) while passing a string
  that starts with a UTF-8 BOM.

- Issue #19307: Improve error message for json.load(s) while passing objects
  of the wrong type.

- Issue #16038: CVE-2013-1752: ftplib: Limit amount of data read by
  limiting the call to readline().  Original patch by Michał
  Jastrzębski and Giampaolo Rodola.

- Issue #17087: Improved the repr for regular expression match objects.

1679 1680 1681
Tests
-----

1682 1683 1684
- Issue #19664: test_userdict's repr test no longer depends on the order
  of dict elements.

1685 1686 1687 1688
- Issue #19440: Clean up test_capi by removing an unnecessary __future__
  import, converting from test_main to unittest.main, and running the
  _testcapi module tests as subTests of a unittest TestCase method.

1689 1690 1691 1692 1693 1694
- Issue #19378: the main dis module tests are now run with both stdout
  redirection *and* passing an explicit file parameter

- Issue #19378: removed the not-actually-helpful assertInstructionMatches
  and assertBytecodeExactlyMatches helpers from bytecode_helper

1695 1696
- Issue #18702: All skipped tests now reported as skipped.

1697 1698 1699
- Issue #19439: interpreter embedding tests are now executed on Windows
  (Patch by Zachary Ware)

1700 1701
- Issue #19085: Added basic tests for all tkinter widget options.

1702
- Issue #19384: Fix test_py_compile for root user, patch by Claudiu Popa.
1703

Zachary Ware's avatar
Zachary Ware committed
1704 1705
Documentation
-------------
1706

Zachary Ware's avatar
Zachary Ware committed
1707 1708 1709
- Issue #18326: Clarify that list.sort's arguments are keyword-only.  Also,
  attempt to reduce confusion in the glossary by not saying there are
  different "types" of arguments and parameters.
1710

1711 1712
Build
-----
1713

1714 1715 1716
- Issue #19358: "make clinic" now runs the Argument Clinic preprocessor
  over all CPython source files.

Martin v. Löwis's avatar
Martin v. Löwis committed
1717
- Update SQLite to 3.8.1, xz to 5.0.5, and Tcl/Tk to 8.6.1 on Windows.
1718

1719 1720
- Issue #16632: Enable DEP and ASLR on Windows.

1721 1722
- Issue #17791: Drop PREFIX and EXEC_PREFIX definitions from PC/pyconfig.h

1723 1724 1725
- Add workaround for VS 2010 nmake clean issue. VS 2010 doesn't set up PATH
  for nmake.exe correctly.

1726 1727
- Issue #19550: Implement Windows installer changes of PEP 453 (ensurepip).

1728 1729
- Issue #19520: Fix compiler warning in the _sha3 module on 32bit Windows.

1730 1731
- Issue #19356: Avoid using a C variabled named "_self", it's a reserved
  word in some C compilers.
1732

1733 1734
- Issue #15792: Correct build options on Win64. Patch by Jeremy Kloth.

Ned Deily's avatar
Ned Deily committed
1735 1736 1737
- Issue #19373: Apply upstream change to Tk 8.5.15 fixing OS X 10.9
  screen refresh problem for OS X installer build.

1738 1739 1740 1741 1742 1743
- Issue #19649: On OS X, the same set of file names are now installed
  in bin directories for all configurations: non-framework vs framework,
  and single arch vs universal builds.  pythonx.y-32 is now always
  installed for 64-bit/32-bit universal builds.  The obsolete and
  undocumented pythonw* symlinks are no longer installed anywhere.

1744 1745 1746 1747 1748 1749
- Issue #19553: PEP 453 - "make install" and "make altinstall" now install or
  upgrade pip by default, using the bundled pip provided by the new ensurepip
  module.  A new configure option, --with-ensurepip[=upgrade|install|no], is
  available to override the default ensurepip "--upgrade" option.  The option
  can also be set with "make [alt]install ENSUREPIP=[upgrade|install\no]".

1750 1751
- Issue #19551: PEP 453 - the OS X installer now installs pip by default.

R David Murray's avatar
R David Murray committed
1752 1753
- Update third-party libraries for OS X installers: xz 5.0.3 -> 5.0.5,
  SQLite 3.7.13 -> 3.8.1
1754

1755 1756 1757 1758 1759
- Issue #15663: Revert OS X installer built-in Tcl/Tk support for 3.4.0b1.
  Some third-party projects, such as Matplotlib and PIL/Pillow,
  depended on being able to build with Tcl and Tk frameworks in
  /Library/Frameworks.

1760 1761
Tools/Demos
-----------
1762

1763 1764 1765
- Issue #19730: Argument Clinic now supports all the existing PyArg
  "format units" as legacy converters, as well as two new features:
  "self converters" and the "version" directive.
1766

1767 1768 1769
- Issue #19552: pyvenv now bootstraps pip into virtual environments by
  default (pass --without-pip to request the old behaviour)

1770 1771
- Issue #19390: Argument Clinic no longer accepts malformed Python
  and C ids.
1772

Larry Hastings's avatar
Larry Hastings committed
1773
What's New in Python 3.4.0 Alpha 4?
1774
===================================
Larry Hastings's avatar
Larry Hastings committed
1775

Larry Hastings's avatar
Larry Hastings committed
1776
Release date: 2013-10-20
Larry Hastings's avatar
Larry Hastings committed
1777 1778 1779 1780

Core and Builtins
-----------------

1781 1782 1783
- Issue #19301: Give classes and functions that are explicitly marked global a
  global qualname.

Andrew Kuchling's avatar
Andrew Kuchling committed
1784
- Issue #19279: UTF-7 decoder no longer produces illegal strings.
1785

1786 1787 1788
- Issue #16612: Add "Argument Clinic", a compile-time preprocessor for
  C files to generate argument parsing code.  (See PEP 436.)

Brett Cannon's avatar
Brett Cannon committed
1789 1790 1791 1792 1793
- Issue #18810: Shift stat calls in importlib.machinery.FileFinder such that
  the code is optimistic that if something exists in a directory named exactly
  like the possible package being searched for that it's in actuality a
  directory.

1794 1795 1796 1797 1798 1799 1800
- Issue #18416: importlib.machinery.PathFinder now treats '' as the cwd and
  importlib.machinery.FileFinder no longer special-cases '' to '.'. This leads
  to modules imported from cwd to now possess an absolute file path for
  __file__ (this does not affect modules specified by path on the CLI but it
  does affect -m/runpy). It also allows FileFinder to be more consistent by not
  having an edge case.

1801 1802 1803
- Issue #4555: All exported C symbols are now prefixed with either
  "Py" or "_Py".

1804 1805 1806
- Issue #19219: Speed up marshal.loads(), and make pyc files slightly
  (5% to 10%) smaller.

1807 1808
- Issue #19221: Upgrade Unicode database to version 6.3.0.

1809 1810 1811 1812 1813
- Issue #16742: The result of the C callback PyOS_ReadlineFunctionPointer must
  now be a string allocated by PyMem_RawMalloc() or PyMem_RawRealloc() (or NULL
  if an error occurred), instead of a string allocated by PyMem_Malloc() or
  PyMem_Realloc().

1814 1815
- Issue #19199: Remove ``PyThreadState.tick_counter`` field

1816 1817 1818
- Fix macro expansion of _PyErr_OCCURRED(), and make sure to use it in at
  least one place so as to avoid regressions.

1819 1820 1821
- Issue #19087: Improve bytearray allocation in order to allow cheap popping
  of data at the front (slice deletion).

1822 1823
- Issue #19014: memoryview.cast() is now allowed on zero-length views.

1824 1825 1826
- Issue #18690: memoryview is now automatically registered with
  collections.abc.Sequence

1827 1828 1829
- Issue #19078: memoryview now correctly supports the reversed builtin
  (Patch by Claudiu Popa)

Larry Hastings's avatar
Larry Hastings committed
1830 1831 1832
Library
-------

1833 1834 1835
- Issue #17457: unittest test discovery now works with namespace packages.
  Patch by Claudiu Popa.

1836 1837
- Issue #18235: Fix the sysconfig variables LDSHARED and BLDSHARED under AIX.
  Patch by David Edelsohn.
1838

1839 1840 1841
- Issue #18606: Add the new "statistics" module (PEP 450).  Contributed
  by Steven D'Aprano.

1842 1843
- Issue #12866: The audioop module now supports 24-bit samples.

Christian Heimes's avatar
Christian Heimes committed
1844
- Issue #19254: Provide an optimized Python implementation of pbkdf2_hmac.
1845

1846 1847 1848
- Issues #19201, Issue #19222, Issue #19223: Add "x" mode (exclusive creation)
  in opening file to bz2, gzip and lzma modules. Patches by Tim Heaney and
  Vajrasky Kok.
1849

Brett Cannon's avatar
Brett Cannon committed
1850 1851
- Fix a reference count leak in _sre.

1852 1853 1854 1855 1856
- Issue #19262: Initial check in of the 'asyncio' package (a.k.a. Tulip,
  a.k.a. PEP 3156).  There are no docs yet, and the PEP is slightly
  out of date with the code.  This module will have *provisional* status
  in Python 3.4.

1857
- Issue #19276: Fixed the wave module on 64-bit big-endian platforms.
1858

1859 1860 1861
- Issue #19266: Rename the new-in-3.4 ``contextlib.ignore`` context manager
  to ``contextlib.suppress`` in order to be more consistent with existing
  descriptions of that operation elsewhere in the language and standard
1862
  library documentation (Patch by Zero Piraeus).
1863

1864 1865 1866
- Issue #18891: Completed the new email package (provisional) API additions
  by adding new classes EmailMessage, MIMEPart, and ContentManager.

Ethan Furman's avatar
Ethan Furman committed
1867 1868
- Issue #18281: Unused stat constants removed from `tarfile`.

1869 1870 1871
- Issue #18999: Multiprocessing now supports 'contexts' with the same API
  as the module, but bound to specified start methods.

1872 1873 1874 1875
- Issue #18468: The re.split, re.findall, and re.sub functions and the group()
  and groups() methods of match object now always return a string or a bytes
  object.

1876 1877
- Issue #18725: The textwrap module now supports truncating multiline text.

1878 1879 1880
- Issue #18776: atexit callbacks now display their full traceback when they
  raise an exception.

1881 1882 1883
- Issue #17827: Add the missing documentation for ``codecs.encode`` and
  ``codecs.decode``.

1884 1885 1886
- Issue #19218: Rename collections.abc to _collections_abc in order to
  speed up interpreter start.

1887 1888 1889
- Issue #18582: Add 'pbkdf2_hmac' to the hashlib module. It implements PKCS#5
  password-based key derivation functions with HMAC as pseudorandom function.

1890 1891
- Issue #19131: The aifc module now correctly reads and writes sampwidth of
  compressed streams.
1892

1893 1894 1895 1896
- Issue #19209: Remove import of copyreg from the os module to speed up
  interpreter startup. stat_result and statvfs_result are now hard-coded to
  reside in the os module.

1897 1898 1899
- Issue #19205: Don't import the 're' module in site and sysconfig module to
  to speed up interpreter start.

1900 1901 1902
- Issue #9548: Add a minimal "_bootlocale" module that is imported by the
  _io module instead of the full locale module.

1903 1904 1905
- Issue #18764: remove the 'print' alias for the PDB 'p' command so that it no
  longer shadows the print function.

Tim Peters's avatar
Tim Peters committed
1906 1907
- Issue #19158:  a rare race in BoundedSemaphore could allow .release() too
  often.
1908

1909 1910
- Issue #15805: Add contextlib.redirect_stdout().

1911 1912
- Issue #18716: Deprecate the formatter module.

1913 1914 1915
- Issue #10712: 2to3 has a new "asserts" fixer that replaces deprecated names
  of unittest methods (e.g. failUnlessEqual -> assertEqual).

1916
- Issue #18037: 2to3 now escapes '\u' and '\U' in native strings.
1917

1918 1919 1920 1921
- Issue #17839: base64.decodebytes and base64.encodebytes now accept any
  object that exports a 1 dimensional array of bytes (this means the same
  is now also true for base64_codec)

1922 1923
- Issue #19132: The pprint module now supports compact mode.

1924 1925
- Issue #19137: The pprint module now correctly formats instances of set and
  frozenset subclasses.
1926

1927 1928 1929 1930
- Issue #10042: functools.total_ordering now correctly handles
  NotImplemented being returned by the underlying comparison function (Patch
  by Katie Miller)

Nick Coghlan's avatar
Nick Coghlan committed
1931 1932 1933
- Issue #19092: contextlib.ExitStack now correctly reraises exceptions
  from the __exit__ callbacks of inner context managers (Patch by Hrvoje
  Nikšić)
1934

1935 1936
- Issue #12641: Avoid passing "-mno-cygwin" to the mingw32 compiler, except
  when necessary.  Patch by Oscar Benjamin.
1937

1938 1939 1940 1941
- Issue #5845: In site.py, only load readline history from ~/.python_history
  if no history has been read already.  This avoids double writes to the
  history file at shutdown.

1942 1943
- Properly initialize all fields of a SSL object after allocation.

1944 1945 1946
- Issue #19095: SSLSocket.getpeercert() now raises ValueError when the
  SSL handshake hasn't been done.

1947 1948 1949
- Issue #4366: Fix building extensions on all platforms when --enable-shared
  is used.

1950 1951 1952 1953 1954
- Issue #19030: Fixed `inspect.getmembers` and `inspect.classify_class_attrs`
  to attempt activating descriptors before falling back to a __dict__ search
  for faulty descriptors.  `inspect.classify_class_attrs` no longer returns
  Attributes whose home class is None.

1955 1956 1957
C API
-----

1958 1959
- Issue #1772673: The type of `char*` arguments now changed to `const char*`.

1960 1961 1962 1963 1964
- Issue #16129: Added a `Py_SetStandardStreamEncoding` pre-initialization API
  to allow embedding applications like Blender to force a particular
  encoding and error handler for the standard IO streams (initial patch by
  Bastien Montagne)

1965 1966 1967
Tests
-----

1968 1969
- Issue #19275: Fix test_site on AMD64 Snow Leopard

1970 1971
- Issue #14407: Fix unittest test discovery in test_concurrent_futures.

1972 1973 1974
- Issue #18919: Unified and extended tests for audio modules: aifc, sunau and
  wave.

1975 1976
- Issue #18714: Added tests for ``pdb.find_function()``.

1977 1978 1979
Documentation
-------------

1980 1981
- Issue #18758: Fixed and improved cross-references.

1982 1983
- Issue #18972: Modernize email examples and use the argparse module in them.

1984 1985 1986 1987 1988
Build
-----

- Issue #19130: Correct PCbuild/readme.txt, Python 3.3 and 3.4 require VS 2010.

1989
- Issue #15663: Update OS X 10.6+ installer to use Tcl/Tk 8.5.15.
Larry Hastings's avatar
Larry Hastings committed
1990

1991 1992 1993 1994 1995 1996
- Issue #14499: Fix several problems with OS X universal build support:
    1. ppc arch detection for extension module builds broke with Xcode 5
    2. ppc arch detection in configure did not work on OS X 10.4
    3. -sysroot and -arch flags were unnecessarily duplicated
    4. there was no obvious way to configure an intel-32 only build.

1997 1998 1999 2000 2001
- Issue #19019: Change the OS X installer build script to use CFLAGS instead
  of OPT for special build options.  By setting OPT, some compiler-specific
  options like -fwrapv were overridden and thus not used, which could result
  in broken interpreters when building with clang.

Larry Hastings's avatar
Larry Hastings committed
2002 2003 2004 2005 2006
What's New in Python 3.4.0 Alpha 3?
===================================

Release date: 2013-09-29

Larry Hastings's avatar
Larry Hastings committed
2007 2008 2009
Core and Builtins
-----------------

2010 2011
- Issue #18818: The "encodingname" part of PYTHONIOENCODING is now optional.

2012
- Issue #19098: Prevent overflow in the compiler when the recursion limit is set
Benjamin Peterson's avatar
Benjamin Peterson committed
2013
  absurdly high.
2014

Larry Hastings's avatar
Larry Hastings committed
2015 2016 2017
Library
-------

Ethan Furman's avatar
Ethan Furman committed
2018 2019 2020
- Issue #18929: `inspect.classify_class_attrs()` now correctly finds class
  attributes returned by `dir()` that are located in the metaclass.

2021 2022 2023 2024 2025 2026 2027
- Issue #18950: Fix miscellaneous bugs in the sunau module.
  Au_read.readframes() now updates current file position and reads correct
  number of frames from multichannel stream.  Au_write.writeframesraw() now
  correctly updates current file position.  Au_read.getnframes() now returns an
  integer (as in Python 2).  Au_read and Au_write now correctly works with file
  object if start file position is not a zero.

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
2028 2029 2030
- Issue #18594: The fast path for collections.Counter() was never taken
  due to an over-restrictive type check.

2031 2032 2033
- Issue #19053: ZipExtFile.read1() with non-zero argument no more returns empty
  bytes until end of data.

2034 2035 2036
- logging: added support for Unix domain sockets to SocketHandler and
  DatagramHandler.

2037 2038 2039
- Issue #18996: TestCase.assertEqual() now more cleverly shorten differing
  strings in error report.

2040 2041
- Issue #19034: repr() for tkinter.Tcl_Obj now exposes string reperesentation.

Jason R. Coombs's avatar
Jason R. Coombs committed
2042 2043 2044
- Issue #18978: ``urllib.request.Request`` now allows the method to be
  indicated on the class and no longer sets it to None in ``__init__``.

2045 2046 2047
- Issue #18626: the inspect module now offers a basic command line
  introspection interface (Initial patch by Claudiu Popa)

2048 2049 2050
- Issue #3015: Fixed tkinter with wantobject=False.  Any Tcl command call
  returned empty string.

2051 2052 2053 2054
- Issue #19037: The mailbox module now makes all changes to maildir files
  before moving them into place, to avoid race conditions with other programs
  that may be accessing the maildir directory.

2055 2056 2057 2058 2059
- Issue #14984: On POSIX systems, when netrc is called without a filename
  argument (and therefore is reading the user's $HOME/.netrc file), it now
  enforces the same security rules as typical ftp clients: the .netrc file must
  be owned by the user that owns the process and must not be readable by any
  other user.
2060

2061 2062
- Issue #18873: The tokenize module now detects Python source code encoding
  only in comment lines.
2063

2064 2065 2066
- Issue #17764: Enable http.server to bind to a user specified network
  interface.  Patch contributed by Malte Swart.

2067 2068
- Issue #18937: Add an assertLogs() context manager to unittest.TestCase
  to ensure that a block of code emits a message using the logging module.
2069

2070 2071
- Issue #17324: Fix http.server's request handling case on trailing '/'. Patch
  contributed by Vajrasky Kok.
2072

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
2073 2074
- Issue #19018: The heapq.merge() function no longer suppresses IndexError
  in the underlying iterables.
2075

R David Murray's avatar
R David Murray committed
2076 2077 2078
- Issue #18784: The uuid module no longer attempts to load libc via ctypes.CDLL
  if all the necessary functions have already been found in libuuid.  Patch by
  Evgeny Sologubov.
2079

2080 2081 2082 2083
- The :envvar:`PYTHONFAULTHANDLER` environment variable now only enables the
  faulthandler module if the variable is non-empty. Same behaviour than other
  variables like :envvar:`PYTHONDONTWRITEBYTECODE`.

2084 2085 2086 2087
- Issue #1565525: New function ``traceback.clear_frames`` will clear
  the local variables of all the stack frames referenced by a traceback
  object.

Nick Coghlan's avatar
Nick Coghlan committed
2088 2089
Tests
-----
2090

Nick Coghlan's avatar
Nick Coghlan committed
2091 2092 2093
- Issue #18952: Fix regression in support data downloads introduced when
  test.support was converted to a package. Regression noticed by Zachary
  Ware.
2094

2095 2096
IDLE
----
2097

2098 2099
- Issue #18873: IDLE now detects Python source code encoding only in comment
  lines.
2100

2101
- Issue #18988: The "Tab" key now works when a word is already autocompleted.
2102

2103 2104 2105 2106 2107 2108
Documentation
-------------

- Issue #17003: Unified the size argument names in the io module with common
  practice.

2109 2110 2111 2112 2113 2114 2115
Build
-----

- Issue #18596: Support the use of address sanity checking in recent versions
  of clang and GCC by appropriately marking known false alarms in the small
  object allocator. Patch contributed by Dhiru Kholia.

2116 2117 2118 2119 2120 2121
Tools/Demos
-----------

- Issue #18873: 2to3 and the findnocoding.py script now detect Python source
  code encoding only in comment lines.

Larry Hastings's avatar
Larry Hastings committed
2122

2123 2124 2125
What's New in Python 3.4.0 Alpha 2?
===================================

Larry Hastings's avatar
Larry Hastings committed
2126
Release date: 2013-09-09
2127 2128 2129 2130

Core and Builtins
-----------------

2131 2132
- Issue #18942: sys._debugmallocstats() output was damaged on Windows.

2133 2134 2135 2136 2137
- Issue #18571: Implementation of the PEP 446: file descriptors and file
  handles are now created non-inheritable; add functions
  os.get/set_inheritable(), os.get/set_handle_inheritable() and
  socket.socket.get/set_inheritable().

2138 2139 2140
- Issue #11619: The parser and the import machinery do not encode Unicode
  filenames anymore on Windows.

2141 2142 2143
- Issue #18808: Non-daemon threads are now automatically joined when
  a sub-interpreter is shutdown (it would previously dump a fatal error).

R David Murray's avatar
R David Murray committed
2144
- Remove support for compiling on systems without getcwd().
2145

2146 2147
- Issue #18774: Remove last bits of GNU PTH thread code and thread_pth.h.

2148 2149 2150 2151
- Issue #18771: Add optimization to set object lookups to reduce the cost
  of hash collisions.  The core idea is to inspect a second key/hash pair
  for each cache line retrieved.

2152 2153 2154 2155
- Issue #16105: When a signal handler fails to write to the file descriptor
  registered with ``signal.set_wakeup_fd()``, report an exception instead
  of ignoring the error.

2156 2157
- Issue #18722: Remove uses of the "register" keyword in C code.

2158 2159
- Issue #18667: Add missing "HAVE_FCHOWNAT" symbol to posix._have_functions.

2160
- Issue #16499: Add command line option for isolated mode.
2161

2162 2163 2164
- Issue #15301: Parsing fd, uid, and gid parameters for builtins
  in Modules/posixmodule.c is now far more robust.

2165
- Issue #18368: PyOS_StdioReadline() no longer leaks memory when realloc()
2166
  fail.
2167

2168 2169 2170
- Issue #17934: Add a clear() method to frame objects, to help clean up
  expensive details (local variables) and break reference cycles.

2171 2172 2173
- Issue #18780: %-formatting codes %d, %i, and %u now treat int-subclasses
  as int (displays value of int-subclass instead of str(int-subclass) ).

2174 2175 2176
Library
-------

2177 2178 2179 2180
- Issue #18808: Thread.join() now waits for the underlying thread state to
  be destroyed before returning.  This prevents unpredictable aborts in
  Py_EndInterpreter() when some non-daemon threads are still running.

2181 2182 2183
- Issue #18458: Prevent crashes with newer versions of libedit.  Its readline
  emulation has changed from 0-based indexing to 1-based like gnu readline.

2184 2185 2186
- Issue #18852: Handle case of ``readline.__doc__`` being ``None`` in the new
  readline activation code in ``site.py``.

2187
- Issue #18672: Fixed format specifiers for Py_ssize_t in debugging output in
Serhiy Storchaka's avatar
Serhiy Storchaka committed
2188
  the _sre module.
2189

R David Murray's avatar
R David Murray committed
2190
- Issue #18830: inspect.getclasstree() no longer produces duplicate entries even
2191 2192
  when input list contains duplicates.

2193 2194 2195
- Issue #18878: sunau.open now supports the context manager protocol.  Based on
  patches by Claudiu Popa and R. David Murray.

2196 2197 2198
- Issue #18909: Fix _tkinter.tkapp.interpaddr() on Windows 64-bit, don't cast
  64-bit pointer to long (32 bits).

2199 2200
- Issue #18876: The FileIO.mode attribute now better reflects the actual mode
  under which the file was opened.  Patch by Erik Bray.
2201

2202 2203
- Issue #16853: Add new selectors module.

2204 2205
- Issue #18882: Add threading.main_thread() function.

2206 2207 2208
- Issue #18901: The sunau getparams method now returns a namedtuple rather than
  a plain tuple.  Patch by Claudiu Popa.

2209 2210 2211
- Issue #17487: The result of the wave getparams method now is pickleable again.
  Patch by Claudiu Popa.

2212 2213 2214 2215
- Issue #18756: os.urandom() now uses a lazily-opened persistent file
  descriptor, so as to avoid using many file descriptors when run in
  parallel from multiple threads.

2216 2217 2218
- Issue #18418: After fork(), reinit all threads states, not only active ones.
  Patch by A. Jesse Jiryu Davis.

2219 2220
- Issue #17974: Switch unittest from using getopt to using argparse.

2221 2222
- Issue #11798: TestSuite now drops references to own tests after execution.

2223 2224 2225
- Issue #16611: http.cookie now correctly parses the 'secure' and 'httponly'
  cookie flags.

2226 2227 2228
- Issue #11973: Fix a problem in kevent. The flags and fflags fields are now
  properly handled as unsigned.

2229 2230 2231
- Issue #18807: ``pyvenv`` now takes a --copies argument allowing copies
  instead of symlinks even where symlinks are available and the default.

2232 2233 2234
- Issue #18538: ``python -m dis`` now uses argparse for argument processing.
  Patch by Michele Orrù.

2235 2236
- Issue #18394: Close cgi.FieldStorage's optional file.

R David Murray's avatar
R David Murray committed
2237
- Issue #17702: On error, os.environb now suppresses the exception context
2238 2239
  when raising a new KeyError with the original key.

2240 2241
- Issue #16809: Fixed some tkinter incompabilities with Tcl/Tk 8.6.

2242 2243 2244
- Issue #16809: Tkinter's splitlist() and split() methods now accept Tcl_Obj
  argument.

2245 2246 2247
- Issue #18324: set_payload now correctly handles binary input.  This also
  supersedes the previous fixes for #14360, #1717, and #16564.

2248 2249 2250
- Issue #18794: Add a fileno() method and a closed attribute to select.devpoll
  objects.

2251 2252 2253
- Issue #17119: Fixed integer overflows when processing large strings and tuples
  in the tkinter module.

2254
- Issue #18747: Re-seed OpenSSL's pseudo-random number generator after fork.
2255
  A pthread_atfork() parent handler is used to seed the PRNG with pid, time
2256 2257
  and some stack data.

2258 2259 2260
- Issue #8865: Concurrent invocation of select.poll.poll() now raises a
  RuntimeError exception.  Patch by Christian Schubert.

2261 2262 2263
- Issue #18777: The ssl module now uses the new CRYPTO_THREADID API of
  OpenSSL 1.0.0+ instead of the deprecated CRYPTO id callback function.

Christian Heimes's avatar
Christian Heimes committed
2264
- Issue #18768: Correct doc string of RAND_edg(). Patch by Vajrasky Kok.
2265

2266 2267 2268
- Issue #18178: Fix ctypes on BSD. dlmalloc.c was compiled twice which broke
  malloc weak symbols.

2269 2270 2271 2272 2273 2274
- Issue #18709: Fix CVE-2013-4238. The SSL module now handles NULL bytes
  inside subjectAltName correctly. Formerly the module has used OpenSSL's
  GENERAL_NAME_print() function to get the string represention of ASN.1
  strings for ``rfc822Name`` (email), ``dNSName`` (DNS) and
  ``uniformResourceIdentifier`` (URI).

2275 2276
- Issue #18701: Remove support of old CPython versions (<3.0) from C code.

2277 2278 2279 2280
- Issue #18756: Improve error reporting in os.urandom() when the failure
  is due to something else than /dev/urandom not existing (for example,
  exhausting the file descriptor limit).

2281 2282 2283
- Issue #18673: Add O_TMPFILE to os module. O_TMPFILE requires Linux kernel
  3.11 or newer. It's only defined on system with 3.11 uapi headers, too.

2284 2285 2286
- Issue #18532: Change the builtin hash algorithms' names to lower case names
  as promised by hashlib's documentation.

2287 2288 2289 2290
- Issue #8713: add new spwan and forkserver start methods, and new functions
  get_all_start_methods, get_start_method, and set_start_method, to
  multiprocessing.

2291 2292
- Issue #18405: Improve the entropy of crypt.mksalt().

2293 2294 2295 2296 2297
- Issue #12015: The tempfile module now uses a suffix of 8 random characters
  instead of 6, to reduce the risk of filename collision. The entropy was
  reduced when uppercase letters were removed from the charset used to generate
  random characters.

2298 2299 2300
- Issue #18585: Add :func:`textwrap.shorten` to collapse and truncate a
  piece of text to a given length.

2301 2302 2303
- Issue #18598: Tweak exception message for importlib.import_module() to
  include the module name when a key argument is missing.

Eric Snow's avatar
Eric Snow committed
2304
- Issue #19151: Fix docstring and use of _get_supported_file_loaders() to
2305 2306
  reflect 2-tuples.

2307 2308
- Issue #19152: Add ExtensionFileLoader.get_filename().

Terry Jan Reedy's avatar
Terry Jan Reedy committed
2309 2310 2311
- Issue #18676: Change 'positive' to 'non-negative' in queue.py put and get
  docstrings and ValueError messages. Patch by Zhongyue Luo

2312 2313
- Fix refcounting issue with extension types in tkinter.

2314 2315 2316
- Issue #8112: xlmrpc.server's DocXMLRPCServer server no longer raises an error
  if methods have annotations; it now correctly displays the annotations.

2317 2318 2319
- Issue #18600: Added policy argument to email.message.Message.as_string,
  and as_bytes and __bytes__ methods to Message.

2320 2321
- Issue #18671: Output more information when logging exceptions occur.

2322 2323 2324
- Issue #18621: Prevent the site module's patched builtins from keeping
  too many references alive for too long.

2325 2326 2327 2328
- Issue #4885: Add weakref support to mmap objects.  Patch by Valerie Lambert.

- Issue #8860: Fixed rounding in timedelta constructor.

2329 2330 2331
- Issue #18849: Fixed a Windows-specific tempfile bug where collision with an
  existing directory caused mkstemp and related APIs to fail instead of
  retrying. Report and fix by Vlad Shcherbina.
2332

2333 2334 2335
- Issue #18920: argparse's default destination for the version action (-v,
  --version) has also been changed to stdout, to match the Python executable.

2336 2337 2338
Tests
-----

2339 2340 2341
- Issue #18623: Factor out the _SuppressCoreFiles context manager into
  test.support.  Patch by Valerie Lambert.

2342 2343
- Issue #12037: Fix test_email for desktop Windows.

2344 2345 2346 2347 2348
- Issue #15507: test_subprocess's test_send_signal could fail if the test
  runner were run in an environment where the process inherited an ignore
  setting for SIGINT.  Restore the SIGINT handler to the desired
  KeyboardInterrupt raising one during that test.

2349 2350 2351
- Issue #16799: Switched from getopt to argparse style in regrtest's argument
  parsing.  Added more tests for regrtest's argument parsing.

2352 2353 2354 2355
- Issue #18792: Use "127.0.0.1" or "::1" instead of "localhost" as much as
  possible, since "localhost" goes through a DNS lookup under recent Windows
  versions.

2356 2357 2358 2359 2360
IDLE
----

- Issue #18489: Add tests for SearchEngine. Original patch by Phil Webster.

2361 2362 2363
Documentation
-------------

2364 2365
- Issue #18743: Fix references to non-existant "StringIO" module.

2366 2367 2368
- Issue #18783: Removed existing mentions of Python long type in docstrings,
  error messages and comments.

2369 2370 2371 2372 2373 2374
Build
-----

- Issue #1584: Provide configure options to override default search paths for
  Tcl and Tk when building _tkinter.

2375 2376 2377 2378 2379
- Issue #15663: Tcl/Tk 8.5.14 is now included with the OS X 10.6+ 64-/32-bit
  installer.  It is no longer necessary to install a third-party version of
  Tcl/Tk 8.5 to work around the problems in the Apple-supplied Tcl/Tk 8.5
  shipped in OS X 10.6 and later releases.

2380 2381 2382 2383 2384 2385
Tools/Demos
-----------

- Issue #18922: Now The Lib/smtpd.py and Tools/i18n/msgfmt.py scripts write
  their version strings to stdout, and not to sderr.

Georg Brandl's avatar
Georg Brandl committed
2386 2387
What's New in Python 3.4.0 Alpha 1?
===================================
2388

Larry Hastings's avatar
Larry Hastings committed
2389
Release date: 2013-08-03
2390 2391 2392 2393

Core and Builtins
-----------------

2394 2395
- Issue #16741: Fix an error reporting in int().

2396 2397
- Issue #17899: Fix rare file descriptor leak in os.listdir().

2398 2399 2400
- Issue #10241: Clear extension module dict copies at interpreter shutdown.
  Patch by Neil Schemenauer, minimally modified.

2401 2402 2403
- Issue #9035: ismount now recognises volumes mounted below a drive root
  on Windows. Original patch by Atsuo Ishimoto.

2404 2405 2406
- Issue #18214: Improve finalization of Python modules to avoid setting
  their globals to None, in most cases.

2407 2408
- Issue #18112: PEP 442 implementation (safe object finalization).

2409 2410 2411
- Issue #18552: Check return value of PyArena_AddPyObject() in
  obj2ast_object().

2412 2413
- Issue #18560: Fix potential NULL pointer dereference in sum().

2414 2415 2416 2417
- Issue #18520: Add a new PyStructSequence_InitType2() function, same than
  PyStructSequence_InitType() except that it has a return value (0 on success,
  -1 on error).

2418 2419 2420
- Issue #15905: Fix theoretical buffer overflow in handling of sys.argv[0],
  prefix and exec_prefix if the operation system does not obey MAXPATHLEN.

2421 2422 2423
- Issue #18408: Fix many various bugs in code handling errors, especially
  on memory allocation failure (MemoryError).

2424 2425
- Issue #18344: Fix potential ref-leaks in _bufferedreader_read_all().

2426 2427 2428
- Issue #18342: Use the repr of a module name when an import fails when using
  ``from ... import ...``.

2429 2430 2431
- Issue #17872: Fix a segfault in marshal.load() when input stream returns
  more bytes than requested.

2432 2433 2434
- Issue #18338: `python --version` now prints version string to stdout, and
  not to stderr.  Patch by Berker Peksag and Michael Dickens.

2435 2436 2437
- Issue #18426: Fix NULL pointer dereference in C extension import when
  PyModule_GetDef() returns an error.

2438 2439 2440 2441
- Issue #17206: On Windows, increase the stack size from 2 MB to 4.2 MB to fix
  a stack overflow in the marshal module (fix a crash in test_marshal).
  Patch written by Jeremy Kloth.

2442 2443 2444
- Issue #3329: Implement the PEP 445: Add new APIs to customize Python memory
  allocators.

2445 2446 2447
- Issue #18328: Reorder ops in PyThreadState_Delete*() functions. Now the
  tstate is first removed from TLS and then deallocated.

2448 2449
- Issue #13483: Use VirtualAlloc in obmalloc on Windows.

2450 2451 2452
- Issue #18184: PyUnicode_FromFormat() and PyUnicode_FromFormatV() now raise
  OverflowError when an argument of %c format is out of range.

2453 2454 2455 2456
- Issue #18111: The min() and max() functions now support a default argument
  to be returned instead of raising a ValueError on an empty sequence.
  (Contributed by Julian Berman.)

2457 2458 2459
- Issue #18137: Detect integer overflow on precision in float.__format__()
  and complex.__format__().

2460 2461 2462
- Issue #18183: Fix various unicode operations on strings with large unicode
  codepoints.

2463 2464
- Issue #18180: Fix ref leak in _PyImport_GetDynLoadWindows().

2465 2466 2467
- Issue #18038: SyntaxError raised during compilation sources with illegal
  encoding now always contains an encoding name.

2468 2469
- Issue #17931: Resolve confusion on Windows between pids and process
  handles.
2470

2471 2472 2473
- Tweak the exception message when the magic number or size value in a bytecode
  file is truncated.

2474 2475 2476
- Issue #17932: Fix an integer overflow issue on Windows 64-bit in iterators:
  change the C type of seqiterobject.it_index from long to Py_ssize_t.

2477 2478 2479 2480 2481 2482
- Issue #18065: Don't set __path__ to the package name for frozen packages.

- Issue #18088: When reloading a module, unconditionally reset all relevant
  attributes on the module (e.g. __name__, __loader__, __package__, __file__,
  __cached__).

2483 2484
- Issue #17937: Try harder to collect cyclic garbage at shutdown.

2485 2486 2487
- Issue #12370: Prevent class bodies from interfering with the __class__
  closure.

2488 2489 2490
- Issue #17644: Fix a crash in str.format when curly braces are used in square
  brackets.

2491 2492
- Issue #17237: Fix crash in the ASCII decoder on m68k.

2493 2494 2495
- Issue #17927: Frame objects kept arguments alive if they had been
  copied into a cell, even if the cell was cleared.

2496 2497 2498
- Issue #1545463: At shutdown, defer finalization of codec modules so
  that stderr remains usable.

2499 2500 2501
- Issue #7330: Implement width and precision (ex: "%5.3s") for the format
  string of PyUnicode_FromFormat() function, original patch written by Ysj Ray.

2502 2503 2504
- Issue #1545463: Global variables caught in reference cycles are now
  garbage-collected at shutdown.

2505 2506 2507 2508 2509
- Issue #17094: Clear stale thread states after fork().  Note that this
  is a potentially disruptive change since it may release some system
  resources which would otherwise remain perpetually alive (e.g. database
  connections kept in thread-local storage).

2510 2511 2512
- Issue #17408: Avoid using an obsolete instance of the copyreg module when
  the interpreter is shutdown and then started again.

2513 2514 2515
- Issue #5845: Enable tab-completion in the interactive interpreter by
  default, thanks to a new sys.__interactivehook__.

2516 2517 2518
- Issue #17115,17116: Module initialization now includes setting __package__ and
  __loader__ attributes to None.

2519 2520 2521
- Issue #17853: Ensure locals of a class that shadow free variables always win
  over the closures.

2522 2523 2524
- Issue #17863: In the interactive console, don't loop forever if the encoding
  can't be fetched from stdin.

2525 2526
- Issue #17867: Raise an ImportError if __import__ is not found in __builtins__.

2527 2528
- Issue #18698: Ensure importlib.reload() returns the module out of sys.modules.

2529 2530 2531
- Issue #17857: Prevent build failures with pre-3.5.0 versions of sqlite3,
  such as was shipped with Centos 5 and Mac OS X 10.4.

2532 2533 2534 2535
- Issue #17413: sys.settrace callbacks were being passed a string instead of an
  exception instance for the 'value' element of the arg tuple if the exception
  originated from C code; now an exception instance is always provided.

2536 2537 2538
- Issue #17782: Fix undefined behaviour on platforms where
  ``struct timespec``'s "tv_nsec" member is not a C long.

2539 2540
- Issue #17722: When looking up __round__, resolve descriptors.

2541 2542
- Issue #16061: Speed up str.replace() for replacing 1-character strings.

2543 2544 2545
- Issue #17715: Fix segmentation fault from raising an exception in a __trunc__
  method.

2546 2547
- Issue #17643: Add __callback__ attribute to weakref.ref.

2548 2549 2550
- Issue #16447: Fixed potential segmentation fault when setting __name__ on a
  class.

2551 2552
- Issue #17669: Fix crash involving finalization of generators using yield from.

2553 2554
- Issue #14439: Python now prints the traceback on runpy failure at startup.

2555 2556 2557
- Issue #17469: Fix _Py_GetAllocatedBlocks() and sys.getallocatedblocks()
  when running on valgrind.

2558 2559
- Issue #17619: Make input() check for Ctrl-C correctly on Windows.

Brett Cannon's avatar
merge  
Brett Cannon committed
2560 2561
- Issue #17357: Add missing verbosity messages for -v/-vv that were lost during
  the importlib transition.
2562

2563 2564
- Issue #17610: Don't rely on non-standard behavior of the C qsort() function.

2565 2566 2567
- Issue #17323: The "[X refs, Y blocks]" printed by debug builds has been
  disabled by default.  It can be re-enabled with the `-X showrefcount` option.

2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 2582 2583 2584 2585 2586 2587 2588 2589 2590 2591 2592 2593 2594 2595 2596 2597 2598 2599 2600 2601 2602 2603 2604 2605 2606 2607 2608 2609 2610 2611 2612 2613 2614 2615
- Issue #17328: Fix possible refleak in dict.setdefault.

- Issue #17275: Corrected class name in init error messages of the C version of
  BufferedWriter and BufferedRandom.

- Issue #7963: Fixed misleading error message that issued when object is
  called without arguments.

- Issue #8745: Small speed up zipimport on Windows. Patch by Catalin Iacob.

- Issue #5308: Raise ValueError when marshalling too large object (a sequence
  with size >= 2**31), instead of producing illegal marshal data.

- Issue #12983: Bytes literals with invalid \x escape now raise a SyntaxError
  and a full traceback including line number.

- Issue #16967: In function definition, evaluate positional defaults before
  keyword-only defaults.

- Issue #17173: Remove uses of locale-dependent C functions (isalpha() etc.)
  in the interpreter.

- Issue #17137: When an Unicode string is resized, the internal wide character
  string (wstr) format is now cleared.

- Issue #17043: The unicode-internal decoder no longer read past the end of
  input buffer.

- Issue #17098: All modules now have __loader__ set even if they pre-exist the
  bootstrapping of importlib.

- Issue #16979: Fix error handling bugs in the unicode-escape-decode decoder.

- Issue #16772: The base argument to the int constructor no longer accepts
  floats, or other non-integer objects with an __int__ method.  Objects
  with an __index__ method are now accepted.

- Issue #10156: In the interpreter's initialization phase, unicode globals
  are now initialized dynamically as needed.

- Issue #16980: Fix processing of escaped non-ascii bytes in the
  unicode-escape-decode decoder.

- Issue #16975: Fix error handling bug in the escape-decode bytes decoder.

- Issue #14850: Now a charmap decoder treats U+FFFE as "undefined mapping"
  in any mapping, not only in a string.

2616 2617 2618
- Issue #16613: Add *m* argument to ``collections.Chainmap.new_child`` to
  allow the new child map to be specified explicitly.

2619 2620 2621 2622 2623 2624 2625 2626 2627 2628 2629 2630 2631 2632 2633 2634 2635 2636 2637 2638 2639 2640 2641 2642 2643 2644 2645 2646 2647 2648 2649 2650 2651 2652 2653 2654 2655 2656 2657 2658 2659 2660 2661 2662 2663 2664 2665 2666 2667 2668 2669 2670 2671 2672 2673 2674 2675 2676
- Issue #16730: importlib.machinery.FileFinder now no longers raises an
  exception when trying to populate its cache and it finds out the directory is
  unreadable or has turned into a file. Reported and diagnosed by
  David Pritchard.

- Issue #16906: Fix a logic error that prevented most static strings from being
  cleared.

- Issue #11461: Fix the incremental UTF-16 decoder. Original patch by
  Amaury Forgeot d'Arc.

- Issue #16856: Fix a segmentation fault from calling repr() on a dict with
  a key whose repr raise an exception.

- Issue #16367: Fix FileIO.readall() on Windows for files larger than 2 GB.

- Issue #16761: Calling int() with base argument only now raises TypeError.

- Issue #16759: Support the full DWORD (unsigned long) range in Reg2Py
  when retrieving a REG_DWORD value. This corrects functions like
  winreg.QueryValueEx that may have been returning truncated values.

- Issue #14420: Support the full DWORD (unsigned long) range in Py2Reg
  when passed a REG_DWORD value. Fixes OverflowError in winreg.SetValueEx.

- Issue #11939: Set the st_dev attribute of stat_result to allow Windows to
  take advantage of the os.path.samefile/sameopenfile/samestat implementations
  used by other platforms.

- Issue #16772: The int() constructor's second argument (base) no longer
  accepts non integer values.  Consistent with the behavior in Python 2.

- Issue #14470: Remove w9xpopen support per PEP 11.

- Issue #9856: Replace deprecation warning with raising TypeError
  in object.__format__. Patch by Florent Xicluna.

- Issue #16597: In buffered and text IO, call close() on the underlying stream
  if invoking flush() fails.

- Issue #16722: In the bytes() constructor, try to call __bytes__ on the
  argument before __index__.

- Issue #16421: loading multiple modules from one shared object is now
  handled correctly (previously, the first module loaded from that file
  was silently returned). Patch by Václav Šmilauer.

- Issue #16602: When a weakref's target was part of a long deallocation
  chain, the object could remain reachable through its weakref even though
  its refcount had dropped to zero.

- Issue #16495: Remove extraneous NULL encoding check from bytes_decode().

- Issue #16619: Create NameConstant AST class to represent None, True, and False
  literals. As a result, these constants are never loaded at runtime from
  builtins.

- Issue #16455: On FreeBSD and Solaris, if the locale is C, the
2677
  ASCII/surrogateescape codec is now used (instead of the locale encoding) to
2678
  decode the command line arguments. This change fixes inconsistencies with
2679 2680
  os.fsencode() and os.fsdecode(), because these operating systems announce an
  ASCII locale encoding, but actually use the ISO-8859-1 encoding in practice.
2681 2682 2683 2684 2685 2686 2687 2688 2689 2690 2691 2692 2693 2694 2695 2696 2697 2698 2699 2700 2701 2702 2703 2704 2705 2706 2707 2708 2709 2710 2711 2712 2713 2714 2715 2716 2717 2718 2719 2720 2721 2722 2723 2724 2725 2726 2727 2728 2729 2730 2731 2732 2733 2734 2735 2736 2737 2738 2739 2740 2741 2742 2743 2744 2745 2746 2747 2748 2749 2750 2751 2752 2753 2754 2755 2756 2757 2758 2759 2760 2761 2762 2763 2764 2765 2766 2767 2768 2769 2770

- Issue #16562: Optimize dict equality testing.  Patch by Serhiy Storchaka.

- Issue #16588: Silence unused-but-set warnings in Python/thread_pthread

- Issue #16592: stringlib_bytes_join doesn't raise MemoryError on allocation
  failure.

- Issue #16546: Fix: ast.YieldFrom argument is now mandatory.

- Issue #16514: Fix regression causing a traceback when sys.path[0] is None
  (actually, any non-string or non-bytes type).

- Issue #16306: Fix multiple error messages when unknown command line
  parameters where passed to the interpreter.  Patch by Hieu Nguyen.

- Issue #16215: Fix potential double memory free in str.replace().  Patch
  by Serhiy Storchaka.

- Issue #16290: A float return value from the __complex__ special method is no
  longer accepted in the complex() constructor.

- Issue #16416: On Mac OS X, operating system data are now always
  encoded/decoded to/from UTF-8/surrogateescape, instead of the locale encoding
  (which may be ASCII if no locale environment variable is set), to avoid
  inconsistencies with os.fsencode() and os.fsdecode() functions which are
  already using UTF-8/surrogateescape.

- Issue #16453: Fix equality testing of dead weakref objects.

- Issue #9535: Fix pending signals that have been received but not yet
  handled by Python to not persist after os.fork() in the child process.

- Issue #14794: Fix slice.indices to return correct results for huge values,
  rather than raising OverflowError.

- Issue #15001: fix segfault on "del sys.modules['__main__']". Patch by Victor
  Stinner.

- Issue #8271: the utf-8 decoder now outputs the correct number of U+FFFD
  characters when used with the 'replace' error handler on invalid utf-8
  sequences.  Patch by Serhiy Storchaka, tests by Ezio Melotti.

- Issue #5765: Apply a hard recursion limit in the compiler instead of
  blowing the stack and segfaulting. Initial patch by Andrea Griffini.

- Issue #16402: When slicing a range, fix shadowing of exceptions from
  __index__.

- Issue #16336: fix input checking in the surrogatepass error handler.
  Patch by Serhiy Storchaka.

- Issue #8401: assigning an int to a bytearray slice (e.g. b[3:4] = 5) now
  raises an error.

- Issue #7317: Display full tracebacks when an error occurs asynchronously.
  Patch by Alon Horev with update by Alexey Kachayev.

- Issue #16309: Make PYTHONPATH="" behavior the same as if PYTHONPATH
  not set at all.

- Issue #10189: Improve the error reporting of SyntaxErrors related to global
  and nonlocal statements.

- Fix segfaults on setting __qualname__ on builtin types and attempting to
  delete it on any type.

- Issue #14625: Rewrite the UTF-32 decoder. It is now 3x to 4x faster. Patch
  written by Serhiy Storchaka.

- Issue #16345: Fix an infinite loop when ``fromkeys`` on a dict subclass
  received a nonempty dict from the constructor.

- Issue #16271: Fix strange bugs that resulted from __qualname__ appearing in a
  class's __dict__ and on type.

- Issue #12805: Make bytes.join and bytearray.join faster when the separator
  is empty.  Patch by Serhiy Storchaka.

- Issue #6074: Ensure cached bytecode files can always be updated by the
  user that created them, even when the source file is read-only.

- Issue #15958: bytes.join and bytearray.join now accept arbitrary buffer
  objects.

- Issue #14783: Improve int() docstring and switch docstrings for str(),
  range(), and slice() to use multi-line signatures.

- Issue #16160: Subclass support now works for types.SimpleNamespace.

2771 2772 2773
- Issue #16148: Implement PEP 424, adding operator.length_hint and
  PyObject_LengthHint.

2774 2775 2776 2777 2778 2779 2780 2781 2782 2783 2784 2785 2786 2787 2788 2789 2790 2791 2792 2793 2794 2795 2796 2797 2798 2799 2800 2801 2802 2803 2804
- Upgrade Unicode data (UCD) to version 6.2.

- Issue #15379: Fix passing of non-BMP characters as integers for the charmap
  decoder (already working as unicode strings).  Patch by Serhiy Storchaka.

- Issue #15144: Fix possible integer overflow when handling pointers as integer
  values, by using `Py_uintptr_t` instead of `size_t`.  Patch by Serhiy
  Storchaka.

- Issue #15965: Explicitly cast `AT_FDCWD` as (int).  Required on Solaris 10
  (which defines `AT_FDCWD` as ``0xffd19553``), harmless on other platforms.

- Issue #15839: Convert SystemErrors in `super()` to RuntimeErrors.

- Issue #15448: Buffered IO now frees the buffer when closed, instead
  of when deallocating.

- Issue #15846: Fix SystemError which happened when using `ast.parse()` in an
  exception handler on code with syntax errors.

- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.

- Issue #15801: Make sure mappings passed to '%' formatting are actually
  subscriptable.

- Issue #15111: __import__ should propagate ImportError when raised as a
  side-effect of a module triggered from using fromlist.

- Issue #15022: Add pickle and comparison support to types.SimpleNamespace.

2805 2806
Library
-------
Terry Jan Reedy's avatar
Terry Jan Reedy committed
2807

2808 2809
- Issue #4331: Added functools.partialmethod (Initial patch by Alon Horev)

2810 2811 2812
- Issue #13461: Fix a crash in the TextIOWrapper.tell method on 64-bit
  platforms.  Patch by Yogesh Chaudhari.

Ezio Melotti's avatar
Ezio Melotti committed
2813
- Issue #18681: Fix a NameError in importlib.reload() (noticed by Weizhao Li).
2814

2815 2816 2817
- Issue #14323: Expanded the number of digits in the coefficients for the
  RGB -- YIQ conversions so that they match the FCC NTSC versions.

2818 2819
- Issue #17998: Fix an internal error in regular expression engine.

2820 2821 2822
- Issue #17557: Fix os.getgroups() to work with the modified behavior of
  getgroups(2) on OS X 10.8.  Original patch by Mateusz Lenik.

2823 2824 2825
- Issue #18608: Avoid keeping a strong reference to the locale module
  inside the _io module.

2826 2827 2828
- Issue #18619: Fix atexit leaking callbacks registered from sub-interpreters,
  and make it GC-aware.

2829 2830 2831 2832
- Issue #15699: The readline module now uses PEP 3121-style module
  initialization, so as to reclaim allocated resources (Python callbacks)
  at shutdown.  Original patch by Robin Schreiber.

2833 2834
- Issue #17616: wave.open now supports the context manager protocol.

2835 2836 2837
- Issue #18599: Fix name attribute of _sha1.sha1() object. It now returns
  'SHA1' instead of 'SHA'.

2838 2839 2840
- Issue #13266: Added inspect.unwrap to easily unravel __wrapped__ chains
  (initial patch by Daniel Urban and Aaron Iles)

2841 2842
- Issue #18561: Skip name in ctypes' _build_callargs() if name is NULL.

2843 2844
- Issue #18559: Fix NULL pointer dereference error in _pickle module

Brett Cannon's avatar
Brett Cannon committed
2845 2846 2847
- Issue #18556: Check the return type of PyUnicode_AsWideChar() in ctype's
  U_set().

2848 2849
- Issue #17818: aifc.getparams now returns a namedtuple.

2850 2851
- Issue #18549: Eliminate dead code in socket_ntohl()

2852 2853 2854
- Issue #18530: Remove additional stat call from posixpath.ismount.
  Patch by Alex Gaynor.

2855 2856
- Issue #18514: Fix unreachable Py_DECREF() call in PyCData_FromBaseObj()

2857 2858 2859
- Issue #9177: Calling read() or write() now raises ValueError, not
  AttributeError, on a closed SSL socket.  Patch by Senko Rasic.

2860 2861 2862
- Issue #18513: Fix behaviour of cmath.rect w.r.t. signed zeros on OS X 10.8 +
  gcc.

2863 2864 2865
- Issue #18479: Changed venv Activate.ps1 to make deactivate a function, and
  removed Deactivate.ps1.

2866 2867
- Issue #18480: Add missing call to PyType_Ready to the _elementtree extension.

2868 2869 2870
- Issue #17778: Fix test discovery for test_multiprocessing. (Patch by
  Zachary Ware.)

2871 2872 2873 2874
- Issue #18393: The private module _gestalt and private functions
  platform._mac_ver_gestalt, platform._mac_ver_lookup and
  platform._bcd2str have been removed. This does not affect the public
  interface of the platform module.
2875

2876 2877 2878 2879
- Issue #17482: functools.update_wrapper (and functools.wraps) now set the
  __wrapped__ attribute correctly even if the underlying function has a
  __wrapped__ attribute set.

2880 2881 2882
- Issue #18431: The new email header parser now decodes RFC2047 encoded words
  in structured headers.

2883 2884 2885
- Issue #18432: The sched module's queue method was incorrectly returning
  an iterator instead of a list.

2886 2887 2888 2889
- Issue #18044: The new email header parser was mis-parsing encoded words where
  an encoded character immediately followed the '?' that follows the CTE
  character, resulting in a decoding failure.  They are now decoded correctly.

2890 2891 2892
- Issue #18101: Tcl.split() now process strings nested in a tuple as it
  do with byte strings.

2893
- Issue #18116: getpass was always getting an error when testing /dev/tty,
2894 2895 2896
  and thus was always falling back to stdin, and would then raise an exception
  if stdin could not be used (such as /dev/null).  It also leaked an open file.
  All of these issues are now fixed.
2897

2898 2899 2900
- Issue #17198: Fix a NameError in the dbm module.  Patch by Valentina
  Mukhamedzhanova.

2901 2902
- Issue #18013: Fix cgi.FieldStorage to parse the W3C sample form.

2903 2904 2905
- Issue #18020: improve html.escape speed by an order of magnitude.
  Patch by Matt Bryant.

2906 2907 2908
- Issue #18347: ElementTree's html serializer now preserves the case of
  closing tags.

2909 2910
- Issue #17261: Ensure multiprocessing's proxies use proper address.

2911 2912 2913 2914
- Issue #18343: faulthandler.register() now keeps the previous signal handler
  when the function is called twice, so faulthandler.unregister() restores
  correctly the original signal handler.

2915 2916
- Issue #17097: Make multiprocessing ignore EINTR.

2917 2918 2919
- Issue #18339: Negative ints keys in unpickler.memo dict no longer cause a
  segfault inside the _pickle C extension.

2920
- Issue #18240: The HMAC module is no longer restricted to bytes and accepts
2921 2922
  any bytes-like object, e.g. memoryview. Original patch by Jonas Borgström.

2923 2924
- Issue #18224: Removed pydoc script from created venv, as it causes problems
  on Windows and adds no value over and above python -m pydoc ...
2925

2926 2927 2928
- Issue #18155: The csv module now correctly handles csv files that use
  a delimter character that has a special meaning in regexes, instead of
  throwing an exception.
2929

R David Murray's avatar
R David Murray committed
2930 2931
- Issue #14360: encode_quopri can now be successfully used as an encoder
  when constructing a MIMEApplication object.
2932

2933 2934 2935
- Issue #11390: Add -o and -f command line options to the doctest CLI to
  specify doctest options (and convert it to using argparse).

2936 2937 2938 2939
- Issue #18135: ssl.SSLSocket.write() now raises an OverflowError if the input
  string in longer than 2 gigabytes, and ssl.SSLContext.load_cert_chain()
  raises a ValueError if the password is longer than 2 gigabytes. The ssl
  module does not support partial write.
2940

2941 2942
- Issue #11016: Add C implementation of the stat module as _stat.

Benjamin Peterson's avatar
Benjamin Peterson committed
2943
- Issue #18248: Fix libffi build on AIX.
2944

2945
- Issue #18259: Declare sethostname in socketmodule.c for AIX
2946

2947 2948 2949 2950
- Issue #18147: Add diagnostic functions to ssl.SSLContext(). get_ca_list()
  lists all loaded CA certificates and cert_store_stats() returns amount of
  loaded X.509 certs, X.509 CA certs and CRLs.

2951
- Issue #18167: cgi.FieldStorage no longer fails to handle multipart/form-data
2952
  when \r\n appears at end of 65535 bytes without other newlines.
2953

2954
- Issue #18076: Introduce importlib.util.decode_source().
2955 2956
- Issue #18357: add tests for dictview set difference.
  Patch by Fraser Tweedale.
2957

2958 2959 2960
- importlib.abc.SourceLoader.get_source() no longer changes SyntaxError or
  UnicodeDecodeError into ImportError.

2961 2962 2963 2964
- Issue #18058, 18057: Make the namespace package loader meet the
  importlib.abc.InspectLoader ABC, allowing for namespace packages to work with
  runpy.

2965 2966
- Issue #17177: The imp module is pending deprecation.

2967 2968 2969
- subprocess: Prevent a possible double close of parent pipe fds when the
  subprocess exec runs into an error.  Prevent a regular multi-close of the
  /dev/null fd when any of stdin, stdout and stderr was set to DEVNULL.
2970

2971 2972 2973 2974
- Issue #18194: Introduce importlib.util.cache_from_source() and
  source_from_cache() while documenting the equivalent functions in imp as
  deprecated.

2975 2976 2977
- Issue #17907: Document imp.new_module() as deprecated in favour of
  types.ModuleType.

2978 2979 2980
- Issue #18192: Introduce importlib.util.MAGIC_NUMBER and document as deprecated
  imp.get_magic().

2981 2982 2983
- Issue #18149: Add filecmp.clear_cache() to manually clear the filecmp cache.
  Patch by Mark Levitt

2984 2985
- Issue #18193: Add importlib.reload().

2986 2987
- Issue #18157: Stop using imp.load_module() in pydoc.

2988
- Issue #16102: Make uuid._netbios_getnode() work again on Python 3.
2989

2990 2991
- Issue #17134: Add ssl.enum_cert_store() as interface to Windows' cert store.

2992 2993 2994
- Issue #18143: Implement ssl.get_default_verify_paths() in order to debug
  the default locations for cafile and capath.

2995 2996
- Issue #17314: Move multiprocessing.forking over to importlib.

2997 2998 2999
- Issue #11959: SMTPServer and SMTPChannel now take an optional map, use of
  which avoids affecting global state.

3000 3001 3002
- Issue #18109: os.uname() now decodes fields from the locale encoding, and
  socket.gethostname() now decodes the hostname from the locale encoding,
  instead of using the UTF-8 encoding in strict mode.
3003

Brett Cannon's avatar
Brett Cannon committed
3004 3005 3006 3007 3008 3009
- Issue #18089: Implement importlib.abc.InspectLoader.load_module.

- Issue #18088: Introduce importlib.abc.Loader.init_module_attrs for setting
  module attributes. Leads to the pending deprecation of
  importlib.util.module_for_loader.

Senthil Kumaran's avatar
Senthil Kumaran committed
3010 3011 3012
- Issue #17403: urllib.parse.robotparser normalizes the urls before adding to
  ruleline. This helps in handling certain types invalid urls in a conservative
  manner. Patch contributed by Mher Movsisyan.
3013

3014 3015 3016
- Issue #18070: Have importlib.util.module_for_loader() set attributes
  unconditionally in order to properly support reloading.

Brett Cannon's avatar
Brett Cannon committed
3017
- Added importlib.util.module_to_load to return a context manager to provide the
3018
  proper module object to load.
3019

3020 3021
- Issue #18025: Fixed a segfault in io.BufferedIOBase.readinto() when raw
  stream's read() returns more bytes than requested.
3022

3023 3024 3025
- Issue #18011: As was originally intended, base64.b32decode() now raises a
  binascii.Error if there are non-b32-alphabet characters present in the input
  string, instead of a TypeError.
3026

Brett Cannon's avatar
Brett Cannon committed
3027 3028 3029
- Issue #18072: Implement importlib.abc.InspectLoader.get_code() and
  importlib.abc.ExecutionLoader.get_code().

3030 3031 3032
- Issue #8240: Set the SSL_MODE_ACCEPT_MOVING_WRITE_BUFFER flag on SSL
  sockets.

3033 3034 3035
- Issue #17269: Workaround for socket.getaddrinfo crash on MacOS X
  with port None or "0" and flags AI_NUMERICSERV.

3036 3037
- Issue #16986: ElementTree now correctly works with string input when the
  internal XML encoding is not UTF-8 or US-ASCII.
3038

3039 3040
- Issue #17996: socket module now exposes AF_LINK constant on BSD and OSX.

3041 3042 3043
- Issue #17900: Allowed pickling of recursive OrderedDicts.  Decreased pickled
  size and pickling time.

3044 3045 3046
- Issue #17914: Add os.cpu_count(). Patch by Yogesh Chaudhari, based on an
  initial patch by Trent Nelson.

3047 3048 3049
- Issue #17812: Fixed quadratic complexity of base64.b32encode().
  Optimize base64.b32encode() and base64.b32decode() (speed up to 3x).

3050 3051 3052
- Issue #17980: Fix possible abuse of ssl.match_hostname() for denial of
  service using certificates with many wildcards (CVE-2013-2099).

3053 3054
- Issue #15758: Fix FileIO.readall() so it no longer has O(n**2) complexity.

3055 3056
- Issue #14596: The struct.Struct() objects now use a more compact
  implementation.
3057

3058 3059
- Issue #17981: logging's SysLogHandler now closes the socket when it catches
  socket OSErrors.
3060

3061 3062 3063
- Issue #17964: Fix os.sysconf(): the return type of the C sysconf() function
  is long, not int.

3064 3065
- Fix typos in the multiprocessing module.

3066 3067
- Issue #17754: Make ctypes.util.find_library() independent of the locale.

3068 3069
- Issue #17968: Fix memory leak in os.listxattr().

3070
- Issue #17606: Fixed support of encoded byte strings in the XMLGenerator
3071
  characters() and ignorableWhitespace() methods.  Original patch by Sebastian
3072 3073
  Ortiz Vasquez.

3074 3075 3076
- Issue #17732: Ignore distutils.cfg options pertaining to install paths if a
  virtual environment is active.

Georg Brandl's avatar
Georg Brandl committed
3077 3078 3079
- Issue #17915: Fix interoperability of xml.sax with file objects returned by
  codecs.open().

3080 3081
- Issue #16601: Restarting iteration over tarfile really restarts rather
  than continuing from where it left off.  Patch by Michael Birtwell.
3082

3083 3084 3085 3086
- Issue #17289: The readline module now plays nicer with external modules
  or applications changing the rl_completer_word_break_characters global
  variable.  Initial patch by Bradley Froehle.

3087 3088 3089
- Issue #12181: select module: Fix struct kevent definition on OpenBSD 64-bit
  platforms. Patch by Federico Schwindt.

3090 3091 3092 3093
- Issue #11816: multiple improvements to the dis module: get_instructions
  generator, ability to redirect output to a file, Bytecode and Instruction
  abstractions. Patch by Nick Coghlan, Ryan Kelly and Thomas Kluyver.

3094
- Issue #13831: Embed stringification of remote traceback in local
3095 3096
  traceback raised when pool task raises an exception.

3097 3098 3099
- Issue #15528: Add weakref.finalize to support finalization using
  weakref callbacks.

3100 3101 3102
- Issue #14173: Avoid crashing when reading a signal handler during
  interpreter shutdown.

3103 3104
- Issue #15902: Fix imp.load_module() accepting None as a file when loading an
  extension module.
3105

3106 3107 3108 3109
- Issue #13721: SSLSocket.getpeercert() and SSLSocket.do_handshake() now
  raise an OSError with ENOTCONN, instead of an AttributeError, when the
  SSLSocket is not connected.

3110 3111
- Issue #14679: add an __all__ (that contains only HTMLParser) to html.parser.

3112 3113 3114
- Issue #17802: Fix an UnboundLocalError in html.parser.  Initial tests by
  Thomas Barlow.

3115 3116 3117
- Issue #17358: Modules loaded by imp.load_source() and load_compiled() (and by
  extention load_module()) now have a better chance of working when reloaded.

3118 3119 3120
- Issue #17804: New function ``struct.iter_unpack`` allows for streaming
  struct unpacking.

3121 3122 3123
- Issue #17830: When keyword.py is used to update a keyword file, it now
  preserves the line endings of the original file.

3124 3125 3126
- Issue #17272: Making the urllib.request's Request.full_url a descriptor.
  Fixes bugs with assignment to full_url. Patch by Demian Brecht.

3127 3128
- Issue #17353: Plistlib emitted empty data tags with deeply nested datastructures

3129 3130 3131
- Issue #11714: Use 'with' statements to assure a Semaphore releases a
  condition variable.  Original patch by Thomas Rachel.

3132 3133 3134 3135
- Issue #16624: `subprocess.check_output` now accepts an `input` argument,
  allowing the subprocess's stdin to be provided as a (byte) string.
  Patch by Zack Weinberg.

3136 3137 3138
- Issue #17795: Reverted backwards-incompatible change in SysLogHandler with
  Unix domain sockets.

3139 3140 3141
- Issue #16694: Add a pure Python implementation of the operator module.
  Patch by Zachary Ware.

3142 3143 3144
- Issue #11182: remove the unused and undocumented pydoc.Scanner class.
  Patch by Martin Morrison.

3145 3146
- Issue #17741: Add ElementTree.XMLPullParser, an event-driven parser for
  non-blocking applications.
3147

3148 3149 3150
- Issue #17555: Fix ForkAwareThreadLock so that size of after fork
  registry does not grow exponentially with generation of process.

3151 3152
- Issue #17707: fix regression in multiprocessing.Queue's get() method where
  it did not block for short timeouts.
3153

3154
- Issue #17720: Fix the Python implementation of pickle.Unpickler to correctly
3155 3156
  process the APPENDS opcode when it is used on non-list objects.

3157 3158
- Issue #17012: shutil.which() no longer falls back to the PATH environment
  variable if an empty path argument is specified.  Patch by Serhiy Storchaka.
3159

3160 3161
- Issue #17710: Fix pickle raising a SystemError on bogus input.

3162 3163 3164
- Issue #17341: Include the invalid name in the error messages from re about
  invalid group names.

3165 3166 3167 3168
- Issue #17702: os.environ now raises KeyError with the original environment
  variable name (str on UNIX), instead of using the encoded name (bytes on
  UNIX).

3169 3170 3171
- Issue #16163: Make the importlib based version of pkgutil.iter_importers
  work for submodules. Initial patch by Berker Peksag.

3172 3173 3174
- Issue #16804: Fix a bug in the 'site' module that caused running
  'python -S -m site' to incorrectly throw an exception.

3175 3176 3177
- Issue #15480: Remove the deprecated and unused TYPE_INT64 code from marshal.
  Initial patch by Daniel Riti.

3178
- Issue #2118: SMTPException is now a subclass of OSError.
3179

3180 3181 3182
- Issue #17016: Get rid of possible pointer wraparounds and integer overflows
  in the re module.  Patch by Nickolai Zeldovich.

3183 3184 3185
- Issue #16658: add missing return to HTTPConnection.send()
  Patch by Jeff Knupp.

3186 3187
- Issue #9556: the logging package now allows specifying a time-of-day for a
  TimedRotatingFileHandler to rotate.
3188

3189 3190 3191
- Issue #14971: unittest test discovery no longer gets confused when a function
  has a different __name__ than its name in the TestCase class dictionary.

3192 3193 3194
- Issue #17487: The wave getparams method now returns a namedtuple rather than
  a plain tuple.

3195 3196
- Issue #17675: socket repr() provides local and remote addresses (if any).
  Patch by Giampaolo Rodola'
3197

3198 3199 3200
- Issue #17093: Make the ABCs in importlib.abc provide default values or raise
  reasonable exceptions for their methods to make them more amenable to super()
  calls.
3201

3202
- Issue #17566: Make importlib.abc.Loader.module_repr() optional instead of an
3203
  abstractmethod; now it raises NotImplementedError so as to be ignored by default.
3204

3205 3206
- Issue #17678: Remove the use of deprecated method in http/cookiejar.py by
  changing the call to get_origin_req_host() to origin_req_host.
Benjamin Peterson's avatar
Benjamin Peterson committed
3207

3208
- Issue #17666: Fix reading gzip files with an extra field.
3209

3210 3211
- Issue #16475: Support object instancing, recursion and interned strings
  in marshal
3212

3213
- Issue #17502: Process DEFAULT values in mock side_effect that returns iterator.
3214

3215 3216 3217
- Issue #16795: On the ast.arguments object, unify vararg with varargannotation
  and kwarg and kwargannotation. Change the column offset of ast.Attribute to be
  at the attribute name.
3218

3219 3220
- Issue #17434: Properly raise a SyntaxError when a string occurs between future
  imports.
3221

3222 3223
- Issue #17117: Import and @importlib.util.set_loader now set __loader__ when
  it has a value of None or the attribute doesn't exist.
3224

3225 3226
- Issue #17032: The "global" in the "NameError: global name 'x' is not defined"
  error message has been removed.  Patch by Ram Rachum.
3227

3228 3229 3230 3231
- Issue #18080: When building a C extension module on OS X, if the compiler
  is overriden with the CC environment variable, use the new compiler as
  the default for linking if LDSHARED is not also overriden.  This restores
  Distutils behavior introduced in 3.2.3 and inadvertently dropped in 3.3.0.
3232

3233 3234
- Issue #18113: Fixed a refcount leak in the curses.panel module's
  set_userptr() method.  Reported by Atsuo Ishimoto.
3235

3236
- Implement PEP 443 "Single-dispatch generic functions".
3237

3238
- Implement PEP 435 "Adding an Enum type to the Python standard library".
3239

3240 3241
- Issue #15596: Faster pickling of unicode strings.

3242
- Issue #17572: Avoid chained exceptions when passing bad directives to
Ezio Melotti's avatar
Ezio Melotti committed
3243 3244
  time.strptime().  Initial patch by Claudiu Popa.

3245 3246 3247
- Issue #17435: threading.Timer's __init__ method no longer uses mutable
  default values for the args and kwargs parameters.

Ezio Melotti's avatar
Ezio Melotti committed
3248 3249 3250
- Issue #17526: fix an IndexError raised while passing code without filename to
  inspect.findsource().  Initial patch by Tyler Doyle.

3251
- Issue #17540: Added style parameter to logging formatter configuration by dict.
3252

3253 3254 3255
- Issue #16692: The ssl module now supports TLS 1.1 and TLS 1.2.  Initial
  patch by Michele Orrù.

3256 3257
- Issue #17025: multiprocessing: Reduce Queue and SimpleQueue contention.

3258 3259 3260
- Issue #17536: Add to webbrowser's browser list: www-browser, x-www-browser,
  iceweasel, iceape.

3261 3262 3263
- Issue #17150: pprint now uses line continuations to wrap long string
  literals.

3264 3265 3266 3267 3268
- Issue #17488: Change the subprocess.Popen bufsize parameter default value
  from unbuffered (0) to buffering (-1) to match the behavior existing code
  expects and match the behavior of the subprocess module in Python 2 to avoid
  introducing hard to track down bugs.

3269 3270 3271
- Issue #17521: Corrected non-enabling of logger following two calls to
  fileConfig().

3272 3273
- Issue #17508: Corrected logging MemoryHandler configuration in dictConfig()
  where the target handler wasn't configured first.
Vinay Sajip's avatar
Vinay Sajip committed
3274

3275
- Issue #17209: curses.window.get_wch() now correctly handles KeyboardInterrupt
3276 3277
  (CTRL+c).

3278 3279 3280 3281
- Issue #5713: smtplib now handles 421 (closing connection) error codes when
  sending mail by closing the socket and reporting the 421 error code via the
  exception appropriate to the command that received the error response.

3282 3283 3284
- Issue #16997: unittest.TestCase now provides a subTest() context manager
  to procedurally generate, in an easy way, small test instances.

3285
- Issue #17485: Also delete the Request Content-Length header if the data
3286
  attribute is deleted.  (Follow on to issue Issue #16464).
3287

3288 3289 3290
- Issue #15927: CVS now correctly parses escaped newlines and carriage
  when parsing with quoting turned off.

3291 3292 3293
- Issue #17467: add readline and readlines support to mock_open in
  unittest.mock.

3294 3295 3296
- Issue #13248: removed deprecated and undocumented difflib.isbjunk,
  isbpopular.

3297 3298 3299 3300
- Issue #17192: Update the ctypes module's libffi to v3.0.13.  This
  specifically addresses a stack misalignment issue on x86 and issues on
  some more recent platforms.

3301 3302
- Issue #8862: Fixed curses cleanup when getkey is interrputed by a signal.

Gregory P. Smith's avatar
Gregory P. Smith committed
3303
- Issue #17443: imaplib.IMAP4_stream was using the default unbuffered IO
3304 3305 3306
  in subprocess, but the imap code assumes buffered IO.  In Python2 this
  worked by accident.  IMAP4_stream now explicitly uses buffered IO.

3307 3308 3309
- Issue #17476: Fixed regression relative to Python2 in undocumented pydoc
  'allmethods'; it was missing unbound methods on the class.

3310 3311
- Issue #17474: Remove the deprecated methods of Request class.

3312 3313 3314
- Issue #16709: unittest discover order is no-longer filesystem specific. Patch
  by Jeff Ramnani.

3315 3316
- Use the HTTPS PyPI url for upload, overriding any plain HTTP URL in pypirc.

3317 3318 3319
- Issue #5024: sndhdr.whichhdr now returns the frame count for WAV files
  rather than -1.

3320 3321 3322 3323
- Issue #17460: Remove the strict argument of HTTPConnection and removing the
  DeprecationWarning being issued from 3.2 onwards.

- Issue #16880: Do not assume _imp.load_dynamic() is defined in the imp module.
3324

3325
- Issue #16389: Fixed a performance regression relative to Python 3.1 in the
3326 3327
  caching of compiled regular expressions.

3328 3329
- Added missing FeedParser and BytesFeedParser to email.parser.__all__.

3330 3331
- Issue #17431: Fix missing import of BytesFeedParser in email.parser.

3332 3333 3334
- Issue #12921: http.server's send_error takes an explain argument to send more
  information in response. Patch contributed by Karl.

3335 3336
- Issue #17414: Add timeit, repeat, and default_timer to timeit.__all__.

3337 3338 3339
- Issue #1285086: Get rid of the refcounting hack and speed up
  urllib.parse.unquote() and urllib.parse.unquote_to_bytes().

3340 3341 3342
- Issue #17099: Have importlib.find_loader() raise ValueError when __loader__
  is not set, harmonizing with what happens when the attribute is set to None.

Benjamin Peterson's avatar
Benjamin Peterson committed
3343 3344
- Expose the O_PATH constant in the os module if it is available.

3345 3346 3347 3348
- Issue #17368: Fix an off-by-one error in the Python JSON decoder that caused
  a failure while decoding empty object literals when object_pairs_hook was
  specified.

3349
- Issue #17385: Fix quadratic behavior in threading.Condition.  The FIFO
3350 3351
  queue now uses a deque instead of a list.

3352 3353
- Issue #15806: Add contextlib.ignore().  This creates a context manager to
  ignore specified exceptions, replacing the "except SomeException: pass" idiom.
3354

3355 3356 3357 3358 3359
- Issue #14645: The email generator classes now produce output using the
  specified linesep throughout.  Previously if the prolog, epilog, or
  body were stored with a different linesep, that linesep was used.  This
  fix corrects an RFC non-compliance issue with smtplib.send_message.

3360 3361 3362
- Issue #17278: Fix a crash in heapq.heappush() and heapq.heappop() when
  the list is being resized concurrently.

3363 3364 3365
- Issue #16962: Use getdents64 instead of the obsolete getdents syscall
  in the subprocess module on Linux.

3366 3367 3368
- Issue #16935: unittest now counts the module as skipped if it raises SkipTest,
  instead of counting it as an error.  Patch by Zachary Ware.

3369 3370
- Issue #17018: Make Process.join() retry if os.waitpid() fails with EINTR.

3371 3372 3373 3374
- Issue #17223: array module: Fix a crasher when converting an array containing
  invalid characters (outside range [U+0000; U+10ffff]) to Unicode:
  repr(array), str(array) and array.tounicode(). Patch written by Manuel Jacob.

3375 3376 3377
- Issue #17197: profile/cProfile modules refactored so that code of run() and
  runctx() utility functions is not duplicated in both modules.

3378 3379 3380
- Issue #14720: sqlite3: Convert datetime microseconds correctly.
  Patch by Lowe Thiderman.

3381 3382 3383
- Issue #15132: Allow a list for the defaultTest argument of
  unittest.TestProgram. Patch by Jyrki Pulliainen.

3384 3385 3386
- Issue #17225: JSON decoder now counts columns in the first line starting
  with 1, as in other lines.

3387 3388 3389
- Issue #6623: Added explicit DeprecationWarning for ftplib.netrc, which has
  been deprecated and undocumented for a long time.

3390 3391 3392
- Issue #13700: Fix byte/string handling in imaplib authentication when an
  authobject is specified.

3393 3394 3395
- Issue #13153: Tkinter functions now raise TclError instead of ValueError when
  a string argument contains non-BMP character.

3396 3397 3398
- Issue #9669: Protect re against infinite loops on zero-width matching in
  non-greedy repeat.  Patch by Matthew Barnett.

3399 3400 3401 3402
- Issue #13169: The maximal repetition number in a regular expression has been
  increased from 65534 to 2147483647 (on 32-bit platform) or 4294967294 (on
  64-bit).

3403 3404 3405
- Issue #17143: Fix a missing import in the trace module.  Initial patch by
  Berker Peksag.

3406 3407 3408
- Issue #15220: email.feedparser's line splitting algorithm is now simpler and
  faster.

3409 3410
- Issue #16743: Fix mmap overflow check on 32 bit Windows.

3411 3412 3413
- Issue #16996: webbrowser module now uses shutil.which() to find a
  web-browser on the executable search path.

3414 3415 3416
- Issue #16800: tempfile.gettempdir() no longer left temporary files when
  the disk is full.  Original patch by Amir Szekely.

3417 3418
- Issue #17192: Import libffi-3.0.12.

3419 3420 3421
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_7or8bit when used with binary data.

Michael Foord's avatar
Michael Foord committed
3422
- Issue #17052: unittest discovery should use self.testLoader.
3423

3424 3425
- Issue #4591: Uid and gid values larger than 2**31 are supported now.

3426
- Issue #17141: random.vonmisesvariate() no longer hangs for large kappas.
3427

3428 3429 3430
- Issue #17149: Fix random.vonmisesvariate to always return results in
  [0, 2*math.pi].

3431 3432
- Issue #1470548: XMLGenerator now works with binary output streams.

3433 3434 3435
- Issue #6975: os.path.realpath() now correctly resolves multiple nested
  symlinks on POSIX platforms.

3436 3437 3438
- Issue #13773: sqlite3.connect() gets a new `uri` parameter to pass the
  filename as a URI, allowing to pass custom options.

3439 3440 3441
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_noop when used with binary data.

3442 3443 3444 3445
- Issue #10355: The mode, name, encoding and newlines properties now work on
  SpooledTemporaryFile objects even when they have not yet rolled over.
  Obsolete method xreadline (which has never worked in Python 3) has been
  removed.
3446

3447 3448 3449 3450 3451 3452
- Issue #16686: Fixed a lot of bugs in audioop module.  Fixed crashes in
  avgpp(), maxpp() and ratecv().  Fixed an integer overflow in add(), bias(),
  and ratecv().  reverse(), lin2lin() and ratecv() no more lose precision for
  32-bit samples.  max() and rms() no more returns a negative result and
  various other functions now work correctly with 32-bit sample -0x80000000.

3453 3454
- Issue #17073: Fix some integer overflows in sqlite3 module.

3455 3456
- Issue #16723: httplib.HTTPResponse no longer marked closed when the connection
  is automatically closed.
3457

3458 3459 3460
- Issue #15359: Add CAN_BCM protocol support to the socket module. Patch by
  Brian Thorne.

3461 3462 3463
- Issue #16948: Fix quoted printable body encoding for non-latin1 character
  sets in the email package.

3464 3465 3466
- Issue #16811: Fix folding of headers with no value in the provisional email
  policies.

3467 3468
- Issue #17132: Update symbol for "yield from" grammar changes.

3469
- Issue #17076: Make copying of xattrs more tolerant of missing FS support.
3470 3471
  Patch by Thomas Wouters.

3472 3473 3474
- Issue #17089: Expat parser now correctly works with string input when the
  internal XML encoding is not UTF-8 or US-ASCII.  It also now accepts bytes
  and strings larger than 2 GiB.
3475

3476 3477 3478
- Issue #6083: Fix multiple segmentation faults occured when PyArg_ParseTuple
  parses nested mutating sequence.

3479 3480
- Issue #5289: Fix ctypes.util.find_library on Solaris.

3481 3482 3483 3484
- Issue #17106: Fix a segmentation fault in io.TextIOWrapper when an underlying
  stream or a decoder produces data of an unexpected type (i.e. when
  io.TextIOWrapper initialized with text stream or use bytes-to-bytes codec).

3485 3486 3487 3488
- Issue #17015: When it has a spec, a Mock object now inspects its signature
  when matching calls, so that arguments can be matched positionally or
  by name.

3489 3490 3491
- Issue #15633: httplib.HTTPResponse is now mark closed when the server
  sends less than the advertised Content-Length.

3492 3493 3494
- Issue #12268: The io module file object write methods no longer abort early
  when one of its write system calls is interrupted (EINTR).

3495 3496 3497
- Issue #6972: The zipfile module no longer overwrites files outside of
  its destination path when extracting malicious zip files.

3498 3499 3500 3501
- Issue #4844: ZipFile now raises BadZipFile when opens a ZIP file with an
  incomplete "End of Central Directory" record.  Original patch by Guilherme
  Polo and Alan McIntyre.

3502 3503 3504
- Issue #17071: Signature.bind() now works when one of the keyword arguments
  is named ``self``.

3505 3506 3507
- Issue #12004: Fix an internal error in PyZipFile when writing an invalid
  Python file.  Patch by Ben Morgan.

3508
- Have py_compile use importlib as much as possible to avoid code duplication.
3509 3510 3511
  Code now raises FileExistsError if the file path to be used for the
  byte-compiled file is a symlink or non-regular file as a warning that import
  will not keep the file path type if it writes to that path.
3512

3513
- Issue #16972: Have site.addpackage() consider already known paths even when
3514 3515
  none are explicitly passed in. Bug report and fix by Kirill.

3516 3517 3518
- Issue #1602133: on Mac OS X a shared library build (``--enable-shared``)
  now fills the ``os.environ`` variable correctly.

3519 3520 3521
- Issue #15505: `unittest.installHandler` no longer assumes SIGINT handler is
  set to a callable object.

3522 3523 3524
- Issue #13454: Fix a crash when deleting an iterator created by itertools.tee()
  if all other iterators were very advanced before.

3525 3526 3527
- Issue #12411: Fix to cgi.parse_multipart to correctly use bytes boundaries
  and bytes data. Patch by Jonas Wagner.

3528 3529 3530 3531
- Issue #16957: shutil.which() no longer searches a bare file name in the
  current directory on Unix and no longer searches a relative file path with
  a directory part in PATH directories.  Patch by Thomas Kluyver.

3532 3533 3534
- Issue #1159051: GzipFile now raises EOFError when reading a corrupted file
  with truncated header or footer.

3535 3536 3537
- Issue #16993: shutil.which() now preserves the case of the path and extension
  on Windows.

3538 3539 3540
- Issue #16992: On Windows in signal.set_wakeup_fd, validate the file
  descriptor argument.

3541 3542
- Issue #16422: For compatibility with the Python version, the C version of
  decimal now uses strings instead of integers for rounding mode constants.
3543

3544 3545 3546
- Issue #15861: tkinter now correctly works with lists and tuples containing
  strings with whitespaces, backslashes or unbalanced braces.

3547 3548 3549
- Issue #9720: zipfile now writes correct local headers for files larger than
  4 GiB.

3550 3551 3552
- Issue #16955: Fix the poll() method for multiprocessing's socket
  connections on Windows.

3553 3554
- SSLContext.load_dh_params() now properly closes the input file.

3555 3556 3557 3558
- Issue #15031: Refactor some .pyc management code to cut down on code
  duplication. Thanks to Ronan Lamy for the report and taking an initial stab
  at the problem.

3559 3560 3561
- Issue #16398: Optimize deque.rotate() so that it only moves pointers
  and doesn't touch the underlying data with increfs and decrefs.

3562 3563
- Issue #16900: Issue a ResourceWarning when an ssl socket is left unclosed.

3564 3565 3566
- Issue #13899: \A, \Z, and \B now correctly match the A, Z, and B literals
  when used inside character classes (e.g. '[\A]').  Patch by Matthew Barnett.

3567 3568 3569 3570
- Issue #15545: Fix regression in sqlite3's iterdump method where it was
  failing if the connection used a row factory (such as sqlite3.Row) that
  produced unsortable objects. (Regression was introduced by fix for 9750).

3571 3572
- fcntl: add F_DUPFD_CLOEXEC constant, available on Linux 2.6.24+.

3573 3574 3575
- Issue #15972: Fix error messages when os functions expecting a file name or
  file descriptor receive the incorrect type.

3576 3577 3578 3579
- Issue #8109: The ssl module now has support for server-side SNI, thanks
  to a :meth:`SSLContext.set_servername_callback` method.  Patch by Daniel
  Black.

3580 3581 3582
- Issue #16860: In tempfile, use O_CLOEXEC when available to set the
  close-on-exec flag atomically.

3583 3584
- Issue #16674: random.getrandbits() is now 20-40% faster for small integers.

3585 3586
- Issue #16009: JSON error messages now provide more information.

3587 3588
- Issue #16828: Fix error incorrectly raised by bz2.compress(b'') and
  bz2.BZ2Compressor.compress(b''). Initial patch by Martin Packman.
3589

3590 3591 3592 3593
- Issue #16833: In http.client.HTTPConnection, do not concatenate the request
  headers and body when the payload exceeds 16 KB, since it can consume more
  memory for no benefit.  Patch by Benno Leslie.

3594 3595
- Issue #16541: tk_setPalette() now works with keyword arguments.

3596 3597 3598 3599 3600 3601 3602 3603 3604 3605 3606
- Issue #16820: In configparser, `parser.popitem()` no longer raises ValueError.
  This makes `parser.clean()` work correctly.

- Issue #16820: In configparser, ``parser['section'] = {}`` now preserves
  section order within the parser. This makes `parser.update()` preserve section
  order as well.

- Issue #16820: In configparser, ``parser['DEFAULT'] = {}`` now correctly
  clears previous values stored in the default section. Same goes for
  ``parser.update({'DEFAULT': {}})``.

3607 3608
- Issue #9586: Redefine SEM_FAILED on MacOSX to keep compiler happy.

3609 3610 3611 3612
- Issue #16787: Increase asyncore and asynchat default output buffers size, to
  decrease CPU usage and increase throughput.

- Issue #10527: make multiprocessing use poll() instead of select() if available.
3613

3614 3615
- Issue #16688: Now regexes contained backreferences correctly work with
  non-ASCII strings.  Patch by Matthew Barnett.
3616

3617
- Issue #16486: Make aifc files act as context managers.
3618

3619 3620
- Issue #16485: Now file descriptors are closed if file header patching failed
  on closing an aifc file.
3621

3622 3623
- Issue #16640: Run less code under a lock in sched module.

3624 3625
- Issue #16165: sched.scheduler.run() no longer blocks a scheduler for other
  threads.
3626

3627
- Issue #16641: Default values of sched.scheduler.enter() are no longer
3628 3629
  modifiable.

3630 3631 3632
- Issue #16618: Make glob.glob match consistently across strings and bytes
  regarding leading dots.  Patch by Serhiy Storchaka.

3633 3634
- Issue #16788: Add samestat to Lib/ntpath.py

3635 3636 3637
- Issue #16713: Parsing of 'tel' urls using urlparse separates params from
  path.

3638 3639 3640
- Issue #16443: Add docstrings to regular expression match objects.
  Patch by Anton Kasyanov.

3641 3642
- Issue #15701: Fix HTTPError info method call to return the headers information.

3643 3644
- Issue #16752: Add a missing import to modulefinder. Patch by Berker Peksag.

3645 3646 3647
- Issue #16646: ftplib.FTP.makeport() might lose socket error details.
  (patch by Serhiy Storchaka)

3648 3649 3650 3651
- Issue #16626: Fix infinite recursion in glob.glob() on Windows when the
  pattern contains a wildcard in the drive or UNC path.  Patch by Serhiy
  Storchaka.

3652 3653 3654 3655
- Issue #15783: Except for the number methods, the C version of decimal now
  supports all None default values present in decimal.py. These values were
  largely undocumented.

3656 3657 3658
- Issue #11175: argparse.FileType now accepts encoding and errors
  arguments. Patch by Lucas Maystre.

3659 3660 3661
- Issue #16488: epoll() objects now support the `with` statement.  Patch
  by Serhiy Storchaka.

3662 3663 3664 3665
- Issue #16298: In HTTPResponse.read(), close the socket when there is no
  Content-Length and the incoming stream is finished.  Patch by Eran
  Rundstein.

3666 3667 3668
- Issue #16049: Add abc.ABC class to enable the use of inheritance to create
  ABCs, rather than the more cumbersome metaclass=ABCMeta. Patch by Bruno
  Dupuis.
3669

3670 3671 3672
- Expose the TCP_FASTOPEN and MSG_FASTOPEN flags in socket when they're
  available.

3673 3674 3675
- Issue #15701: Add a .headers attribute to urllib.error.HTTPError. Patch
  contributed by Berker Peksag.

3676 3677 3678 3679
- Issue #15872: Fix 3.3 regression introduced by the new fd-based shutil.rmtree
  that caused it to not ignore certain errors when ignore_errors was set.
  Patch by Alessandro Moura and Serhiy Storchaka.

3680 3681 3682
- Issue #16248: Disable code execution from the user's home directory by
  tkinter when the -E flag is passed to Python.  Patch by Zachary Ware.

3683 3684 3685
- Issue #13390: New function :func:`sys.getallocatedblocks()` returns the
  number of memory blocks currently allocated.

3686 3687
- Issue #16628: Fix a memory leak in ctypes.resize().

3688 3689 3690
- Issue #13614: Fix setup.py register failure with invalid rst in description.
  Patch by Julien Courteau and Pierre Paul Lefebvre.

3691 3692 3693
- Issue #13512: Create ~/.pypirc securely (CVE-2011-4944).  Initial patch by
  Philip Jenvey, tested by Mageia and Debian.

3694 3695 3696
- Issue #7719: Make distutils ignore ``.nfs*`` files instead of choking later
  on.  Initial patch by SilentGhost and Jeff Ramnani.

3697 3698 3699
- Issue #13120: Allow to call pdb.set_trace() from thread.
  Patch by Ilya Sandler.

3700 3701 3702
- Issue #16585: Make CJK encoders support error handlers that return bytes per
  PEP 383.

3703 3704 3705
- Issue #10182: The re module doesn't truncate indices to 32 bits anymore.
  Patch by Serhiy Storchaka.

3706 3707
- Issue #16333: use (",", ": ") as default separator in json when indent is
  specified, to avoid trailing whitespace.  Patch by Serhiy Storchaka.
3708

Benjamin Peterson's avatar
Benjamin Peterson committed
3709 3710 3711 3712
- Issue #16573: In 2to3, treat enumerate() like a consuming call, so superfluous
  list() calls aren't added to filter(), map(), and zip() which are directly
  passed enumerate().

3713 3714 3715
- Issue #16464: Reset the Content-Length header when a urllib Request is reused
  with new data.

3716 3717 3718 3719
- Issue #12848: The pure Python pickle implementation now treats object
  lengths as unsigned 32-bit integers, like the C implementation does.
  Patch by Serhiy Storchaka.

3720 3721 3722
- Issue #16423: urllib.request now has support for ``data:`` URLs.  Patch by
  Mathias Panzenböck.

3723 3724 3725
- Issue #4473: Add a POP3.stls() to switch a clear-text POP3 session into
  an encrypted POP3 session, on supported servers.  Patch by Lorenzo Catucci.

3726 3727 3728
- Issue #4473: Add a POP3.capa() method to query the capabilities advertised
  by the POP3 server.  Patch by Lorenzo Catucci.

3729 3730 3731
- Issue #4473: Ensure the socket is shutdown cleanly in POP3.close().
  Patch by Lorenzo Catucci.

3732 3733
- Issue #16522: added FAIL_FAST flag to doctest.

3734
- Issue #15627: Add the importlib.abc.InspectLoader.source_to_code() method.
3735

3736 3737 3738
- Issue #16408: Fix file descriptors not being closed in error conditions
  in the zipfile module.  Patch by Serhiy Storchaka.

3739 3740 3741
- Issue #14631: Add a new :class:`weakref.WeakMethod` to simulate weak
  references to bound methods.

3742 3743 3744 3745
- Issue #16469: Fix exceptions from float -> Fraction and Decimal -> Fraction
  conversions for special values to be consistent with those for float -> int
  and Decimal -> int.  Patch by Alexey Kachayev.

3746 3747
- Issue #16481: multiprocessing no longer leaks process handles on Windows.

3748 3749 3750
- Issue #12428: Add a pure Python implementation of functools.partial().
  Patch by Brian Thorne.

3751 3752 3753
- Issue #16140: The subprocess module no longer double closes its child
  subprocess.PIPE parent file descriptors on child error prior to exec().

3754 3755 3756
- Remove a bare print to stdout from the subprocess module that could have
  happened if the child process wrote garbage to its pre-exec error pipe.

3757 3758 3759
- The subprocess module now raises its own SubprocessError instead of a
  RuntimeError in various error situations which should not normally happen.

3760 3761 3762
- Issue #16327: The subprocess module no longer leaks file descriptors
  used for stdin/stdout/stderr pipes to the child when fork() fails.

3763 3764 3765
- Issue #14396: Handle the odd rare case of waitpid returning 0 when not
  expected in subprocess.Popen.wait().

3766 3767 3768
- Issue #16411: Fix a bug where zlib.decompressobj().flush() might try to access
  previously-freed memory. Patch by Serhiy Storchaka.

3769 3770 3771
- Issue #16357: fix calling accept() on a SSLSocket created through
  SSLContext.wrap_socket().  Original patch by Jeff McNeil.

3772 3773 3774 3775 3776
- Issue #16409: The reporthook callback made by the legacy
  urllib.request.urlretrieve API now properly supplies a constant non-zero
  block_size as it did in Python 3.2 and 2.7.  This matches the behavior of
  urllib.request.URLopener.retrieve.

3777 3778 3779
- Issue #16431: Use the type information when constructing a Decimal subtype
  from a Decimal argument.

3780 3781 3782
- Issue #15641: Clean up deprecated classes from importlib
  Patch by Taras Lyapun.

3783
- Issue #16350: zlib.decompressobj().decompress() now accumulates data from
3784
  successive calls after EOF in unused_data, instead of only saving the argument
3785 3786 3787
  to the last call. decompressobj().flush() now correctly sets unused_data and
  unconsumed_tail. A bug in the handling of MemoryError when setting the
  unconsumed_tail attribute has also been fixed. Patch by Serhiy Storchaka.
3788

3789 3790 3791
- Issue #12759: sre_parse now raises a proper error when the name of the group
  is missing.  Initial patch by Serhiy Storchaka.

3792 3793 3794
- Issue #16152: fix tokenize to ignore whitespace at the end of the code when
  no newline is found.  Patch by Ned Batchelder.

3795 3796 3797
- Issue #16284: Prevent keeping unnecessary references to worker functions
  in concurrent.futures ThreadPoolExecutor.

3798 3799 3800
- Issue #16230: Fix a crash in select.select() when one the lists changes
  size while iterated on.  Patch by Serhiy Storchaka.

3801 3802 3803
- Issue #16228: Fix a crash in the json module where a list changes size
  while it is being encoded.  Patch by Serhiy Storchaka.

3804 3805 3806
- Issue #16351: New function gc.get_stats() returns per-generation collection
  statistics.

3807 3808 3809
- Issue #14897: Enhance error messages of struct.pack and
  struct.pack_into. Patch by Matti Mäki.

3810 3811 3812
- Issue #16316: mimetypes now recognizes the .xz and .txz (.tar.xz) extensions.
  Patch by Serhiy Storchaka.

3813 3814 3815
- Issue #12890: cgitb no longer prints spurious <p> tags in text
  mode when the logdir option is specified.

3816 3817 3818
- Issue #16307: Fix multiprocessing.Pool.map_async not calling its callbacks.
  Patch by Janne Karila.

3819 3820 3821
- Issue #16305: Fix a segmentation fault occurring when interrupting
  math.factorial.

3822
- Issue #16116: Fix include and library paths to be correct when building C
3823 3824
  extensions in venvs.

3825 3826
- Issue #16245: Fix the value of a few entities in html.entities.html5.

3827 3828 3829
- Issue #16301: Fix the localhost verification in urllib/request.py for file://
  urls.

3830 3831 3832
- Issue #16250: Fix the invocations of URLError which had misplaced filename
  attribute for exception.

3833 3834 3835
- Issue #10836: Fix exception raised when file not found in urlretrieve
  Initial patch by Ezio Melotti.

3836 3837
- Issue #14398: Fix size truncation and overflow bugs in the bz2 module.

3838
- Issue #12692: Fix resource leak in urllib.request when talking to an HTTP
3839
  server that does not include a ``Connection: close`` header in its responses.
3840

3841 3842 3843
- Issue #12034: Fix bogus caching of result in check_GetFinalPathNameByHandle.
  Patch by Atsuo Ishimoto.

3844
- Improve performance of `lzma.LZMAFile` (see also issue #16034).
3845

3846 3847 3848
- Issue #16220: wsgiref now always calls close() on an iterable response.
  Patch by Brent Tubbs.

3849 3850 3851
- Issue #16270: urllib may hang when used for retrieving files via FTP by using
  a context manager.  Patch by Giampaolo Rodola'.

3852 3853 3854
- Issue #16461: Wave library should be able to deal with 4GB wav files,
  and sample rate of 44100 Hz.

3855 3856
- Issue #16176: Properly identify Windows 8 via platform.platform()

3857 3858 3859
- Issue #16088: BaseHTTPRequestHandler's send_error method includes a
  Content-Length header in it's response now. Patch by Antoine Pitrou.

3860 3861 3862
- Issue #16114: The subprocess module no longer provides a misleading error
  message stating that args[0] did not exist when either the cwd or executable
  keyword arguments specified a path that did not exist.
3863

3864 3865
- Issue #16169: Fix ctypes.WinError()'s confusion between errno and winerror.

3866 3867 3868
- Issue #16110: logging.fileConfig now accepts a pre-initialised ConfigParser
  instance.

3869 3870 3871
- Issue #1492704: shutil.copyfile() raises a distinct SameFileError now if
  source and destination are the same file. Patch by Atsuo Ishimoto.

3872 3873 3874
- Issue #13896: Make shelf instances work with 'with' as context managers.
  Original patch by Filip Gruszczyński.

3875 3876
- Issue #15417: Add support for csh and fish in venv activation scripts.

3877 3878 3879 3880
- Issue #14377: ElementTree.write and some of the module-level functions have
  a new parameter - *short_empty_elements*. It controls how elements with no
  contents are emitted.

3881 3882 3883
- Issue #16089: Allow ElementTree.TreeBuilder to work again with a non-Element
  element_factory (fixes a regression in SimpleTAL).

3884 3885 3886
- Issue #9650: List commonly used format codes in time.strftime and
  time.strptime docsttings.  Original patch by Mike Hoy.

3887 3888 3889 3890
- Issue #15452: logging configuration socket listener now has a verify option
  that allows an application to apply a verification function to the
  received configuration data before it is acted upon.

Georg Brandl's avatar
Georg Brandl committed
3891 3892
- Issue #16034: Fix performance regressions in the new `bz2.BZ2File`
  implementation.  Initial patch by Serhiy Storchaka.
3893

Georg Brandl's avatar
Georg Brandl committed
3894
- `pty.spawn()` now returns the child process status returned by `os.waitpid()`.
3895

Georg Brandl's avatar
Georg Brandl committed
3896 3897 3898
- Issue #15756: `subprocess.poll()` now properly handles `errno.ECHILD` to
  return a returncode of 0 when the child has already exited or cannot be waited
  on.
3899

Georg Brandl's avatar
Georg Brandl committed
3900
- Issue #15323: Improve failure message of `Mock.assert_called_once_with()`.
3901

Georg Brandl's avatar
Georg Brandl committed
3902
- Issue #16064: ``unittest -m`` claims executable is "python", not "python3".
3903

Georg Brandl's avatar
Georg Brandl committed
3904
- Issue #12376: Pass on parameters in `TextTestResult.__init__()` super call.
3905

Georg Brandl's avatar
Georg Brandl committed
3906
- Issue #15222: Insert blank line after each message in mbox mailboxes.
3907

Georg Brandl's avatar
Georg Brandl committed
3908
- Issue #16013: Fix `csv.Reader` parsing issue with ending quote characters.
3909 3910
  Patch by Serhiy Storchaka.

Georg Brandl's avatar
Georg Brandl committed
3911 3912
- Issue #15421: Fix an OverflowError in `Calendar.itermonthdates()` after
  `datetime.MAXYEAR`.  Patch by Cédric Krier.
3913

3914 3915 3916
- Issue #16112: platform.architecture does not correctly escape argument to
  /usr/bin/file.  Patch by David Benjamin.

Georg Brandl's avatar
Georg Brandl committed
3917
- Issue #15970: `xml.etree.ElementTree` now serializes correctly the empty HTML
3918 3919
  elements 'meta' and 'param'.

Georg Brandl's avatar
Georg Brandl committed
3920 3921
- Issue #15842: The `SocketIO.{readable,writable,seekable}` methods now raise
  ValueError when the file-like object is closed.  Patch by Alessandro Moura.
3922

Georg Brandl's avatar
Georg Brandl committed
3923
- Issue #15876: Fix a refleak in the `curses` module: window.encoding.
3924

Georg Brandl's avatar
Georg Brandl committed
3925 3926
- Issue #15881: Fix `atexit` hook in `multiprocessing`.  Original patch by Chris
  McDonough.
3927

Georg Brandl's avatar
Georg Brandl committed
3928 3929 3930
- Issue #15841: The readable(), writable() and seekable() methods of
  `io.BytesIO` and `io.StringIO` objects now raise ValueError when the object
  has been closed.  Patch by Alessandro Moura.
3931

Georg Brandl's avatar
Georg Brandl committed
3932 3933
- Issue #15447: Use `subprocess.DEVNULL` in webbrowser, instead of opening
  `os.devnull` explicitly and leaving it open.
3934

Georg Brandl's avatar
Georg Brandl committed
3935 3936
- Issue #15509: `webbrowser.UnixBrowser` no longer passes empty arguments to
  Popen when ``%action`` substitutions produce empty strings.
3937

Georg Brandl's avatar
Georg Brandl committed
3938 3939 3940 3941 3942
- Issue #12776, issue #11839: Call `argparse` type function (specified by
  add_argument) only once. Before, the type function was called twice in the
  case where the default was specified and the argument was given as well.  This
  was especially problematic for the FileType type, as a default file would
  always be opened, even if a file argument was specified on the command line.
3943 3944

- Issue #15906: Fix a regression in argparse caused by the preceding change,
Georg Brandl's avatar
Georg Brandl committed
3945
  when ``action='append'``, ``type='str'`` and ``default=[]``.
3946

Christian Heimes's avatar
Christian Heimes committed
3947 3948 3949 3950 3951
- Issue #16113: Added sha3 module based on the Keccak reference implementation
  3.2. The `hashlib` module has four additional hash algorithms: `sha3_224`,
  `sha3_256`, `sha3_384` and `sha3_512`. As part of the patch some common
  code was moved from _hashopenssl.c to hashlib.h.

3952 3953 3954
- ctypes.call_commethod was removed, since its only usage was in the defunct
  samples directory.

3955 3956 3957 3958
- Issue #16692: Added TLSv1.1 and TLSv1.2 support for the ssl modules.

- Issue #16832: add abc.get_cache_token() to expose cache validity checking
  support in ABCMeta.
3959

Benjamin Peterson's avatar
Benjamin Peterson committed
3960 3961 3962
IDLE
----

3963 3964 3965 3966 3967 3968 3969 3970 3971 3972 3973 3974 3975 3976 3977 3978 3979 3980 3981 3982 3983 3984 3985 3986 3987 3988 3989 3990 3991 3992 3993 3994 3995 3996 3997 3998 3999 4000 4001 4002 4003 4004
- Issue #18429: Format / Format Paragraph, now works when comment blocks
  are selected. As with text blocks, this works best when the selection
  only includes complete lines.

- Issue #18226: Add docstrings and unittests for FormatParagraph.py.
  Original patches by Todd Rovito and Phil Webster.

- Issue #18279: Format - Strip trailing whitespace no longer marks a file as
  changed when it has not been changed. This fix followed the addition of a
  test file originally written by Phil Webster (the issue's main goal).

- Issue #7136: In the Idle File menu, "New Window" is renamed "New File".
  Patch by Tal Einat, Roget Serwy, and Todd Rovito.

- Remove dead imports of imp.

- Issue #18196: Avoid displaying spurious SystemExit tracebacks.

- Issue #5492: Avoid traceback when exiting IDLE caused by a race condition.

- Issue #17511: Keep IDLE find dialog open after clicking "Find Next".
  Original patch by Sarah K.

- Issue #18055: Move IDLE off of imp and on to importlib.

- Issue #15392: Create a unittest framework for IDLE.
  Initial patch by Rajagopalasarma Jayakrishnan.
  See Lib/idlelib/idle_test/README.txt for how to run Idle tests.

- Issue #14146: Highlight source line while debugging on Windows.

- Issue #17838: Allow sys.stdin to be reassigned.

- Issue #13495: Avoid loading the color delegator twice in IDLE.

- Issue #17798: Allow IDLE to edit new files when specified on command line.

- Issue #14735: Update IDLE docs to omit "Control-z on Windows".

- Issue #17532: Always include Options menu for IDLE on OS X.
  Patch by Guilherme Simões.

Roger Serwy's avatar
Roger Serwy committed
4005 4006
- Issue #17585: Fixed IDLE regression. Now closes when using exit() or quit().

Roger Serwy's avatar
Roger Serwy committed
4007 4008 4009
- Issue #17657: Show full Tk version in IDLE's about dialog.
  Patch by Todd Rovito.

Roger Serwy's avatar
Roger Serwy committed
4010 4011
- Issue #17613: Prevent traceback when removing syntax colorizer in IDLE.

Roger Serwy's avatar
Roger Serwy committed
4012 4013
- Issue #1207589: Backwards-compatibility patch for right-click menu in IDLE.

Roger Serwy's avatar
Roger Serwy committed
4014 4015
- Issue #16887: IDLE now accepts Cancel in tabify/untabify dialog box.

4016 4017
- Issue #17625: In IDLE, close the replace dialog after it is used.

Benjamin Peterson's avatar
Benjamin Peterson committed
4018 4019 4020 4021 4022 4023
- Issue #14254: IDLE now handles readline correctly across shell restarts.

- Issue #17614: IDLE no longer raises exception when quickly closing a file.

- Issue #6698: IDLE now opens just an editor window when configured to do so.

4024
- Issue #8900: Using keyboard shortcuts in IDLE to open a file no longer
Benjamin Peterson's avatar
Benjamin Peterson committed
4025 4026 4027 4028
  raises an exception.

- Issue #6649: Fixed missing exit status in IDLE. Patch by Guilherme Polo.

4029
- Issue #17114: IDLE now uses non-strict config parser.
Benjamin Peterson's avatar
Benjamin Peterson committed
4030

4031 4032
- Issue #9290: In IDLE the sys.std* streams now implement io.TextIOBase
  interface and support all mandatory methods and properties.
Benjamin Peterson's avatar
Benjamin Peterson committed
4033

4034
- Issue #5066: Update IDLE docs. Patch by Todd Rovito.
Benjamin Peterson's avatar
Benjamin Peterson committed
4035 4036 4037 4038

- Issue #16829: IDLE printing no longer fails if there are spaces or other
  special characters in the file path.

4039
- Issue #16491: IDLE now prints chained exception tracebacks.
Benjamin Peterson's avatar
Benjamin Peterson committed
4040

4041
- Issue #16819: IDLE method completion now correctly works for bytes literals.
Benjamin Peterson's avatar
Benjamin Peterson committed
4042

4043 4044
- Issue #16504: IDLE now catches SyntaxErrors raised by tokenizer. Patch by
  Roger Serwy.
Benjamin Peterson's avatar
Benjamin Peterson committed
4045

4046 4047
- Issue #16511: Use default IDLE width and height if config param is not valid.
  Patch Serhiy Storchaka.
Benjamin Peterson's avatar
Benjamin Peterson committed
4048

4049 4050
- Issue #1207589: Add Cut/Copy/Paste items to IDLE right click Context Menu
  Patch by Todd Rovito.
Benjamin Peterson's avatar
Benjamin Peterson committed
4051

4052 4053
- Issue #16123: IDLE - deprecate running without a subprocess.
  Patch by Roger Serwy.
Benjamin Peterson's avatar
Benjamin Peterson committed
4054

4055 4056 4057
Tests
-----

4058 4059 4060 4061 4062 4063 4064 4065 4066 4067 4068 4069 4070 4071 4072 4073 4074 4075 4076 4077 4078 4079 4080 4081 4082 4083 4084 4085 4086 4087 4088 4089 4090 4091 4092 4093 4094
- Issue #1666318: Add a test that shutil.copytree() retains directory
  permissions.  Patch by Catherine Devlin.

- Issue #18273: move the tests in Lib/test/json_tests to Lib/test/test_json
  and make them discoverable by unittest.  Patch by Zachary Ware.

- Fix a fcntl test case on KFreeBSD, Debian #708653 (Petr Salinger).

- Issue #18396: Fix spurious test failure in test_signal on Windows when
  faulthandler is enabled (Patch by Jeremy Kloth)

- Issue #17046: Fix broken test_executable_without_cwd in test_subprocess.

- Issue #15415: Add new temp_dir() and change_cwd() context managers to
  test.support, and refactor temp_cwd() to use them.  Patch by Chris Jerdonek.

- Issue #15494: test.support is now a package rather than a module (Initial
  patch by Indra Talip)

- Issue #17944: test_zipfile now discoverable and uses subclassing to
  generate tests for different compression types.  Fixed a bug with skipping
  some tests due to use of exhausted iterators.

- Issue #18266: test_largefile now works with unittest test discovery and
  supports running only selected tests.  Patch by Zachary Ware.

- Issue #17767: test_locale now works with unittest test discovery.
  Original patch by Zachary Ware.

- Issue #18375: Assume --randomize when --randseed is used for running the
  testsuite.

- Issue #11185: Fix test_wait4 under AIX.  Patch by Sébastien Sablé.

- Issue #18207: Fix test_ssl for some versions of OpenSSL that ignore seconds
  in ASN1_TIME fields.

R David Murray's avatar
R David Murray committed
4095
- Issue #18094: test_uuid no longer reports skipped tests as passed.
4096 4097 4098 4099 4100 4101 4102 4103 4104 4105 4106 4107 4108 4109 4110 4111 4112 4113 4114 4115 4116 4117 4118 4119 4120 4121 4122 4123 4124 4125 4126 4127 4128 4129 4130 4131 4132 4133 4134 4135 4136 4137 4138 4139 4140 4141 4142

- Issue #17992: Add timeouts to asyncore and asynchat tests so that they won't
  accidentally hang.

- Issue #17833: Fix test_gdb failures seen on machines where debug symbols
  for glibc are available (seen on PPC64 Linux).

- Issue #7855: Add tests for ctypes/winreg for issues found in IronPython.
  Initial patch by Dino Viehland.

- Issue #11078: test___all__ now checks for duplicates in __all__.
  Initial patch by R. David Murray.

- Issue #17712: Fix test_gdb failures on Ubuntu 13.04.

- Issue #17835: Fix test_io when the default OS pipe buffer size is larger
  than one million bytes.

- Issue #17065: Use process-unique key for winreg tests to avoid failures if
  test is run multiple times in parallel (eg: on a buildbot host).

- Issue #12820: add tests for the xml.dom.minicompat module.
  Patch by John Chandler and Phil Connell.

- Issue #17691: test_univnewlines now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17790: test_set now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17789: test_random now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17779: test_osx_env now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17766: test_iterlen now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17690: test_time now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17692: test_sqlite now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #11995: test_pydoc doesn't import all sys.path modules anymore.

4143 4144
- Issue #17448: test_sax now skips if there are no xml parsers available
  instead of raising an ImportError.
4145

Ezio Melotti's avatar
Ezio Melotti committed
4146 4147
- Issue #11420: make test suite pass with -B/DONTWRITEBYTECODE set.
  Initial patch by Thomas Wouters.
4148

4149 4150
- Issue #10652: make tcl/tk tests run after __all__ test, patch by
  Zachary Ware.
4151

Ezio Melotti's avatar
Ezio Melotti committed
4152
- Issue #11963: remove human verification from test_parser and test_subprocess.
4153

4154 4155
- Issue #11732: add a new suppress_crash_popup() context manager to test.support
  that disables crash popups on Windows and use it in test_faulthandler and
4156
  test_capi.
4157

4158
- Issue #13898: test_ssl no longer prints a spurious stack trace on Ubuntu.
4159

4160 4161 4162
- Issue #17283: Share code between `__main__.py` and `regrtest.py` in
  `Lib/test`.

Ezio Melotti's avatar
Ezio Melotti committed
4163
- Issue #17249: convert a test in test_capi to use unittest and reap threads.
4164

4165 4166 4167 4168
- Issue #17107: Test client-side SNI support in urllib.request thanks to
  the new server-side SNI support in the ssl module.  Initial patch by
  Daniel Black.

4169 4170
- Issue #17041: Fix testing when Python is configured with the
  --without-doc-strings.
4171

4172 4173
- Issue #16923: Fix ResourceWarnings in test_ssl.

4174
- Issue #15539: Added regression tests for Tools/scripts/pindent.py.
4175

4176 4177 4178
- Issue #17479: test_io now works with unittest test discovery.
  Patch by Zachary Ware.

4179 4180 4181
- Issue #17066: test_robotparser now works with unittest test discovery.
  Patch by Zachary Ware.

4182 4183
- Issue #17334: test_index now works with unittest test discovery.
  Patch by Zachary Ware.
4184

4185 4186 4187
- Issue #17333: test_imaplib now works with unittest test discovery.
  Patch by Zachary Ware.

4188 4189 4190
- Issue #17082: test_dbm* now work with unittest test discovery.
  Patch by Zachary Ware.

4191 4192 4193
- Issue #17079: test_ctypes now works with unittest test discovery.
  Patch by Zachary Ware.

4194 4195 4196
- Issue #17304: test_hash now works with unittest test discovery.
  Patch by Zachary Ware.

4197 4198 4199
- Issue #17303: test_future* now work with unittest test discovery.
  Patch by Zachary Ware.

4200 4201 4202
- Issue #17163: test_file now works with unittest test discovery.
  Patch by Zachary Ware.

4203 4204 4205
- Issue #16925: test_configparser now works with unittest test discovery.
  Patch by Zachary Ware.

4206 4207 4208
- Issue #16918: test_codecs now works with unittest test discovery.
  Patch by Zachary Ware.

4209 4210 4211
- Issue #16919: test_crypt now works with unittest test discovery.
  Patch by Zachary Ware.

4212 4213 4214
- Issue #16910: test_bytes, test_unicode, and test_userstring now work with
  unittest test discovery.  Patch by Zachary Ware.

4215 4216 4217
- Issue #16905: test_warnings now works with unittest test discovery.
  Initial patch by Berker Peksag.

4218 4219 4220
- Issue #16898: test_bufio now works with unittest test discovery.
  Patch by Zachary Ware.

4221 4222 4223
- Issue #16888: test_array now works with unittest test discovery.
  Patch by Zachary Ware.

4224 4225 4226
- Issue #16896: test_asyncore now works with unittest test discovery.
  Patch by Zachary Ware.

4227 4228 4229
- Issue #16897: test_bisect now works with unittest test discovery.
  Initial patch by Zachary Ware.

4230 4231 4232
- Issue #16852: test_genericpath, test_posixpath, test_ntpath, and test_macpath
  now work with unittest test discovery.  Patch by Zachary Ware.

4233 4234
- Issue #16748: test_heapq now works with unittest test discovery.

Brian Curtin's avatar
Brian Curtin committed
4235 4236 4237
- Issue #10646: Tests rearranged for os.samefile/samestat to check for not
  just symlinks but also hard links.

4238 4239
- Issue #15302: Switch regrtest from using getopt to using argparse.

4240 4241
- Issue #15324: Fix regrtest parsing of --fromfile, --match, and --randomize
  options.
4242

4243 4244 4245
- Issue #16702: test_urllib2_localnet tests now correctly ignores proxies for
  localhost tests.

4246 4247
- Issue #16664: Add regression tests for glob's behaviour concerning entries
  starting with a ".".  Patch by Sebastian Kreft.
4248

4249 4250 4251
- Issue #13390: The ``-R`` option to regrtest now also checks for memory
  allocation leaks, using :func:`sys.getallocatedblocks()`.

Ezio Melotti's avatar
Ezio Melotti committed
4252 4253
- Issue #16559: Add more tests for the json module, including some from the
  official test suite at json.org.  Patch by Serhiy Storchaka.
4254

4255 4256 4257
- Issue #16661: Fix the `os.getgrouplist()` test by not assuming that it gives
  the same output as :command:`id -G`.

4258 4259 4260
- Issue #16115: Add some tests for the executable argument to
  subprocess.Popen().  Initial patch by Kushal Das.

4261 4262 4263
- Issue #16126: PyErr_Format format mismatch in _testcapimodule.c.
  Patch by Serhiy Storchaka.

Georg Brandl's avatar
Georg Brandl committed
4264 4265
- Issue #15304: Fix warning message when `os.chdir()` fails inside
  `test.support.temp_cwd()`.  Patch by Chris Jerdonek.
4266

Georg Brandl's avatar
Georg Brandl committed
4267 4268
- Issue #15802: Fix test logic in `TestMaildir.test_create_tmp()`. Patch by
  Serhiy Storchaka.
4269

Georg Brandl's avatar
Georg Brandl committed
4270 4271
- Issue #15557: Added a test suite for the webbrowser module, thanks to Anton
  Barkovsky.
4272

Ned Deily's avatar
Ned Deily committed
4273 4274
- Issue #16698: Skip posix test_getgroups when built with OS X
  deployment target prior to 10.6.
4275

4276 4277 4278
Build
-----

4279 4280 4281 4282 4283 4284 4285 4286 4287 4288 4289 4290 4291 4292 4293 4294 4295 4296 4297 4298 4299
- Issue #16067: Add description into MSI file to replace installer's
  temporary name.

- Issue #18257: Fix readlink usage in python-config.  Install the python
  version again on Darwin.

- Issue #18481: Add C coverage reporting with gcov and lcov. A new make target
  "coverage-report" creates an instrumented Python build, runs unit tests
  and creates a HTML. The report can be updated with "make coverage-lcov".

- Issue #17845: Clarified the message printed when some module are not built.

- Issue #18256: Compilation fix for recent AIX releases.  Patch by
  David Edelsohn.

- Issue #17547: In configure, explicitly pass -Wformat for the benefit for GCC
  4.8.

- Issue #15172: Document NASM 2.10+ as requirement for building OpenSSL 1.0.1
  on Windows.

4300 4301 4302
- Issue #17591: Use lowercase filenames when including Windows header files.
  Patch by Roumen Petrov.

Benjamin Peterson's avatar
Benjamin Peterson committed
4303 4304
- Issue #17550: Fix the --enable-profiling configure switch.

4305 4306
- Issue #17425: Build with openssl 1.0.1d on Windows.

4307 4308 4309
- Issue #16754: Fix the incorrect shared library extension on linux. Introduce
  two makefile macros SHLIB_SUFFIX and EXT_SUFFIX. SO now has the value of
  SHLIB_SUFFIX again (as in 2.x and 3.1). The SO macro is removed in 3.4.
4310

4311 4312
- Issue #5033: Fix building of the sqlite3 extension module when the
  SQLite library version has "beta" in it. Patch by Andreas Pelme.
4313

4314 4315
- Issue #17228: Fix building without pymalloc.

4316 4317
- Issue #3718: Use AC_ARG_VAR to set MACHDEP in configure.ac.

4318 4319
- Issue #16235: Implement python-config as a shell script.

4320 4321
- Issue #16769: Remove outdated Visual Studio projects.

4322 4323
- Issue #17031: Fix running regen in cross builds.

4324
- Issue #3754: fix typo in pthread AC_CACHE_VAL.
4325

4326 4327 4328
- Issue #15484: Fix _PYTHON_PROJECT_BASE for srcdir != builddir builds;
  use _PYTHON_PROJECT_BASE in distutils/sysconfig.py.

4329
- Drop support for Windows 2000 (changeset e52df05b496a).
4330

4331
- Issue #17029: Let h2py search the multiarch system include directory.
4332

4333 4334
- Issue #16953: Fix socket module compilation on platforms with
  HAVE_BROKEN_POLL. Patch by Jeffrey Armstrong.
4335

4336 4337
- Issue #16320: Remove redundant Makefile dependencies for strings and bytes.

4338 4339 4340
- Cross compiling needs host and build settings. configure no longer
  creates a broken PYTHON_FOR_BUILD variable when --build is missing.

4341 4342 4343
- Fix cross compiling issue in setup.py, ensure that lib_dirs and inc_dirs are
  defined in cross compiling mode, too.

4344 4345
- Issue #16836: Enable IPv6 support even if IPv6 is disabled on the build host.

4346 4347
- Issue #16593: Have BSD 'make -s' do the right thing, thanks to Daniel Shahaf

4348
- Issue #16262: fix out-of-src-tree builds, if mercurial is not installed.
4349

4350 4351 4352
- Issue #15298: ensure _sysconfigdata is generated in build directory, not
  source directory.

4353 4354 4355 4356
- Issue #15833: Fix a regression in 3.3 that resulted in exceptions being
  raised if importlib failed to write byte-compiled files.  This affected
  attempts to build Python out-of-tree from a read-only source directory.

Georg Brandl's avatar
Georg Brandl committed
4357 4358
- Issue #15923: Fix a mistake in ``asdl_c.py`` that resulted in a TypeError
  after 2801bf875a24 (see #15801).
4359

4360 4361
- Issue #16135: Remove OS/2 support.

4362 4363
- Issue #15819: Make sure we can build Python out-of-tree from a read-only
  source directory.  (Somewhat related to issue #9860.)
4364

Ned Deily's avatar
Ned Deily committed
4365 4366 4367
- Issue #15587: Enable Tk high-resolution text rendering on Macs with
  Retina displays.  Applies to Tkinter apps, such as IDLE, on OS X
  framework builds linked with Cocoa Tk 8.5.
4368

4369
- Issue #17161: make install now also installs a python3 man page.
4370

4371 4372
C-API
-----
4373

4374 4375 4376 4377 4378 4379 4380 4381 4382 4383 4384 4385 4386 4387 4388 4389
- Issue #18351: Fix various issues in a function in importlib provided to help
  PyImport_ExecCodeModuleWithPathnames() (and thus by extension
  PyImport_ExecCodeModule() and PyImport_ExecCodeModuleEx()).

- Issue #9369: The types of `char*` arguments of PyObject_CallFunction() and
  PyObject_CallMethod() now changed to `const char*`.  Based on patches by
  Jörg Müller and Lars Buitinck.

- Issue #17206: Py_CLEAR(), Py_DECREF(), Py_XINCREF() and Py_XDECREF() now
  expand their arguments once instead of multiple times.  Patch written by Illia
  Polosukhin.

- Issue #17522: Add the PyGILState_Check() API.

- Issue #17327: Add PyDict_SetDefault.

4390
- Issue #16881: Fix Py_ARRAY_LENGTH macro for GCC < 3.1.
4391

4392 4393 4394 4395 4396 4397 4398 4399 4400 4401
- Issue #16505: Remove unused Py_TPFLAGS_INT_SUBCLASS.

- Issue #16086: PyTypeObject.tp_flags and PyType_Spec.flags are now unsigned
  (unsigned long and unsigned int) to avoid an undefined behaviour with
  Py_TPFLAGS_TYPE_SUBCLASS ((1 << 31). PyType_GetFlags() result type is
  now unsigned too (unsigned long, instead of long).

- Issue #16166: Add PY_LITTLE_ENDIAN and PY_BIG_ENDIAN macros and unified
  endianness detection and handling.

4402 4403 4404
Documentation
-------------

4405 4406 4407 4408 4409 4410 4411 4412 4413 4414 4415 4416 4417 4418 4419
- Issue #17701: Improving strftime documentation.

- Issue #18440: Clarify that `hash()` can truncate the value returned from an
  object's custom `__hash__()` method.

- Issue #17844: Add links to encoders and decoders for bytes-to-bytes codecs.

- Issue #14097: improve the "introduction" page of the tutorial.

- Issue #17977: The documentation for the cadefault argument's default value
  in urllib.request.urlopen() is fixed to match the code.

- Issue #6696: add documentation for the Profile objects, and improve
  profile/cProfile docs.  Patch by Tom Pinckney.

Terry Jan Reedy's avatar
Terry Jan Reedy committed
4420 4421
- Issue #15940: Specify effect of locale on time functions.

4422
- Issue 17538: Document XML vulnerabilties
Barry Warsaw's avatar
Barry Warsaw committed
4423

4424 4425 4426
- Issue #16642: sched.scheduler timefunc initial default is time.monotonic.
  Patch by Ramchandra Apte

4427 4428
- Issue #17047: remove doubled words in docs and docstrings
  reported by Serhiy Storchaka and Matthew Barnett.
4429

4430 4431 4432
- Issue #15465: Document the versioning macros in the C API docs rather than
  the standard library docs. Patch by Kushal Das.

4433
- Issue #16406: Combine the pages for uploading and registering to PyPI.
4434

4435 4436
- Issue #16403: Document how distutils uses the maintainer field in
  PKG-INFO. Patch by Jyrki Pulliainen.
4437

4438 4439
- Issue #16695: Document how glob handles filenames starting with a
  dot. Initial patch by Jyrki Pulliainen.
4440

4441 4442 4443
- Issue #8890: Stop advertising an insecure practice by replacing uses
  of the /tmp directory with better alternatives in the documentation.
  Patch by Geoff Wilson.
4444

4445
- Issue #17203: add long option names to unittest discovery docs.
4446

Ezio Melotti's avatar
Ezio Melotti committed
4447 4448
- Issue #13094: add "Why do lambdas defined in a loop with different values
  all return the same result?" programming FAQ.
4449

Brian Curtin's avatar
Brian Curtin committed
4450 4451
- Issue #14901: Update portions of the Windows FAQ.
  Patch by Ashish Nitin Patil.
4452

4453 4454 4455
- Issue #16267: Better document the 3.3+ approach to combining
  @abstractmethod with @staticmethod, @classmethod and @property

4456 4457 4458
- Issue #15209: Clarify exception chaining description in exceptions module
  documentation

4459
- Issue #15990: Improve argument/parameter documentation.
4460

4461 4462 4463
- Issue #16209: Move the documentation for the str built-in function to a new
  str class entry in the "Text Sequence Type" section.

4464 4465
- Issue #13538: Improve str() and object.__str__() documentation.

Brett Cannon's avatar
Brett Cannon committed
4466 4467
- Issue #16489: Make it clearer that importlib.find_loader() needs parent
  packages to be explicitly imported.
4468

4469 4470
- Issue #16400: Update the description of which versions of a given package
  PyPI displays.
4471

4472 4473
- Issue #15677: Document that zlib and gzip accept a compression level of 0 to
  mean 'no compression'. Patch by Brian Brazil.
4474

4475 4476 4477
- Issue #16197: Update winreg docstrings and documentation to match code.
  Patch by Zachary Ware.

Ezio Melotti's avatar
Ezio Melotti committed
4478 4479
- Issue #8040: added a version switcher to the documentation.  Patch by
  Yury Selivanov.
4480

4481 4482 4483
- Issue #16241: Document -X faulthandler command line option.
  Patch by Marek Šuppa.

4484 4485 4486
- Additional comments and some style changes in the concurrent.futures URL
  retrieval example

4487 4488 4489
- Issue #16115: Improve subprocess.Popen() documentation around args, shell,
  and executable arguments.

Hynek Schlawack's avatar
Hynek Schlawack committed
4490 4491 4492
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.

Georg Brandl's avatar
Georg Brandl committed
4493
- Issue #15533: Clarify docs and add tests for `subprocess.Popen()`'s cwd
4494
  argument.
4495

Ezio Melotti's avatar
Ezio Melotti committed
4496 4497
- Issue #15979: Improve timeit documentation.

Georg Brandl's avatar
Georg Brandl committed
4498
- Issue #16036: Improve documentation of built-in `int()`'s signature and
4499 4500
  arguments.

Georg Brandl's avatar
Georg Brandl committed
4501
- Issue #15935: Clarification of `argparse` docs, re: add_argument() type and
4502 4503 4504 4505 4506
  default arguments.  Patch contributed by Chris Jerdonek.

- Issue #11964: Document a change in v3.2 to the behavior of the indent
  parameter of json encoding operations.

Ned Deily's avatar
Ned Deily committed
4507 4508
- Issue #15116: Remove references to appscript as it is no longer being
  supported.
4509

4510 4511 4512
Tools/Demos
-----------

4513 4514 4515 4516 4517 4518 4519 4520 4521 4522 4523 4524 4525 4526 4527 4528
- Issue #18817: Fix a resource warning in Lib/aifc.py demo.  Patch by
  Vajrasky Kok.

- Issue #18439: Make patchcheck work on Windows for ACKS, NEWS.

- Issue #18448: Fix a typo in Tools/demo/eiffel.py.

- Issue #18457: Fixed saving of formulas and complex numbers in
  Tools/demo/ss1.py.

- Issue #18449: Make Tools/demo/ss1.py work again on Python 3.  Patch by
  Févry Thibault.

- Issue #12990: The "Python Launcher" on OSX could not launch python scripts
  that have paths that include wide characters.

4529 4530
- Issue #15239: Make mkstringprep.py work again on Python 3.

4531
- Issue #17028: Allowed Python arguments to be supplied to the Windows
4532 4533
  launcher.

4534 4535
- Issue #17156: pygettext.py now detects the encoding of source files and
  correctly writes and escapes non-ascii characters.
4536

4537 4538 4539 4540
- Issue #15539: Fix a number of bugs in Tools/scripts/pindent.py.  Now
  pindent.py works with a "with" statement.  pindent.py no longer produces
  improper indentation.  pindent.py now works with continued lines broken after
  "class" or "def" keywords and with continuations at the start of line.
4541

4542 4543
- Issue #11797: Add a 2to3 fixer that maps reload() to imp.reload().

4544 4545
- Issue #10966: Remove the concept of unexpected skipped tests.

4546 4547 4548 4549
- Issue #9893: Removed the Misc/Vim directory.

- Removed the Misc/TextMate directory.

4550 4551 4552
- Issue #16245: Add the Tools/scripts/parse_html5_entities.py script to parse
  the list of HTML5 entities and update the html.entities.html5 dictionary.

4553
- Issue #15378: Fix Tools/unicode/comparecodecs.py.  Patch by Serhiy Storchaka.
Ronald Oussoren's avatar
Ronald Oussoren committed
4554

4555 4556 4557
- Issue #16549: Make json.tool work again on Python 3 and add tests.
  Initial patch by Berker Peksag and Serhiy Storchaka.

4558 4559 4560
- Issue #13301: use ast.literal_eval() instead of eval() in Tools/i18n/msgfmt.py
  Patch by Serhiy Storchaka.

4561 4562 4563 4564 4565 4566
Windows
-------

- Issue #18569: The installer now adds .py to the PATHEXT variable when extensions
  are registered. Patch by Paul Moore.

4567

Georg Brandl's avatar
Georg Brandl committed
4568 4569 4570
What's New in Python 3.3.0?
===========================

Georg Brandl's avatar
Georg Brandl committed
4571
*Release date: 29-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
4572 4573 4574 4575

Core and Builtins
-----------------

4576 4577
- Issue #16046: Fix loading sourceless legacy .pyo files.

4578 4579
- Issue #16060: Fix refcounting bug when `__trunc__()` returns an object whose
  `__int__()` gives a non-integer.  Patch by Serhiy Storchaka.
4580

4581 4582 4583
Extension Modules
-----------------

4584
- Issue #16012: Fix a regression in pyexpat. The parser's `UseForeignDTD()`
4585 4586
  method doesn't require an argument again.

Georg Brandl's avatar
Georg Brandl committed
4587

4588
What's New in Python 3.3.0 Release Candidate 3?
Georg Brandl's avatar
Georg Brandl committed
4589
===============================================
4590

Georg Brandl's avatar
Georg Brandl committed
4591
*Release date: 23-Sep-2012*
4592 4593 4594 4595

Core and Builtins
-----------------

4596
- Issue #15900: Fix reference leak in `PyUnicode_TranslateCharmap()`.
4597

4598 4599
- Issue #15926: Fix crash after multiple reinitializations of the interpreter.

4600
- Issue #15895: Fix FILE pointer leak in one error branch of
4601 4602
  `PyRun_SimpleFileExFlags()` when filename points to a pyc/pyo file, closeit is
  false an and set_main_loader() fails.
4603

4604 4605
- Fixes for a few crash and memory leak regressions found by Coverity.

4606 4607 4608
Library
-------

4609 4610 4611 4612
- Issue #15882: Change `_decimal` to accept any coefficient tuple when
  constructing infinities. This is done for backwards compatibility with
  decimal.py: Infinity coefficients are undefined in _decimal (in accordance
  with the specification).
4613

4614 4615
- Issue #15925: Fix a regression in `email.util` where the `parsedate()` and
  `parsedate_tz()` functions did not return None anymore when the argument could
4616 4617
  not be parsed.

Georg Brandl's avatar
Georg Brandl committed
4618 4619 4620
Extension Modules
-----------------

4621 4622 4623
- Issue #15973: Fix a segmentation fault when comparing datetime timezone
  objects.

Georg Brandl's avatar
Georg Brandl committed
4624 4625 4626
- Issue #15977: Fix memory leak in Modules/_ssl.c when the function
  _set_npn_protocols() is called multiple times, thanks to Daniel Sommermann.

4627
- Issue #15969: `faulthandler` module: rename dump_tracebacks_later() to
4628 4629 4630
  dump_traceback_later() and cancel_dump_tracebacks_later() to
  cancel_dump_traceback_later().

4631
- _decimal module: use only C 89 style comments.
Georg Brandl's avatar
Georg Brandl committed
4632

4633

Georg Brandl's avatar
Georg Brandl committed
4634 4635 4636
What's New in Python 3.3.0 Release Candidate 2?
===============================================

Georg Brandl's avatar
Georg Brandl committed
4637
*Release date: 09-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
4638 4639 4640 4641

Core and Builtins
-----------------

4642
- Issue #13992: The trashcan mechanism is now thread-safe.  This eliminates
4643 4644
  sporadic crashes in multi-thread programs when several long deallocator chains
  ran concurrently and involved subclasses of built-in container types.
4645

4646 4647
- Issue #15784: Modify `OSError`.__str__() to better distinguish between errno
  error numbers and Windows error numbers.
4648

4649 4650
- Issue #15781: Fix two small race conditions in import's module locking.

Georg Brandl's avatar
Georg Brandl committed
4651 4652 4653
Library
-------

4654 4655 4656
- Issue #17158: Add 'symbols' to help() welcome message; clarify
  'modules spam' messages.

4657 4658
- Issue #15847: Fix a regression in argparse, which did not accept tuples as
  argument lists anymore.
4659

4660
- Issue #15828: Restore support for C extensions in `imp.load_module()`.
4661

4662 4663
- Issue #15340: Fix importing the random module when ``/dev/urandom`` cannot be
  opened.  This was a regression caused by the hash randomization patch.
4664

4665
- Issue #10650: Deprecate the watchexp parameter of the `Decimal.quantize()`
4666 4667
  method.

4668 4669 4670 4671
- Issue #15785: Modify `window.get_wch()` API of the curses module: return a
  character for most keys, and an integer for special keys, instead of always
  returning an integer. So it is now possible to distinguish special keys like
  keypad keys.
4672

4673
- Issue #14223: Fix `window.addch()` of the curses module for special characters
4674 4675 4676 4677 4678 4679
  like curses.ACS_HLINE: the Python function addch(int) and addch(bytes) is now
  calling the C function waddch()/mvwaddch() (as it was done in Python 3.2),
  instead of wadd_wch()/mvwadd_wch(). The Python function addch(str) is still
  calling the C function wadd_wch()/mvwadd_wch() if the Python curses is linked
  to libncursesw.

Georg Brandl's avatar
Georg Brandl committed
4680 4681 4682 4683 4684 4685
Build
-----

- Issue #15822: Really ensure 2to3 grammar pickles are properly installed
  (replaces fixes for Issue #15645).

4686 4687 4688
Documentation
-------------

4689 4690 4691 4692
- Issue #15814: The memoryview enhancements in 3.3.0 accidentally permitted the
  hashing of multi-dimensional memorviews and memoryviews with multi-byte item
  formats. The intended restrictions have now been documented - they will be
  correctly enforced in 3.3.1.
4693

Georg Brandl's avatar
Georg Brandl committed
4694

Georg Brandl's avatar
Georg Brandl committed
4695 4696 4697
What's New in Python 3.3.0 Release Candidate 1?
===============================================

Georg Brandl's avatar
Georg Brandl committed
4698
*Release date: 25-Aug-2012*
Georg Brandl's avatar
Georg Brandl committed
4699 4700 4701 4702

Core and Builtins
-----------------

4703
- Issue #15573: memoryview comparisons are now performed by value with full
4704
  support for any valid struct module format definition.
4705

4706
- Issue #15316: When an item in the fromlist for `__import__()` doesn't exist,
4707 4708 4709
  don't raise an error, but if an exception is raised as part of an import do
  let that propagate.

4710 4711
- Issue #15778: Ensure that ``str(ImportError(msg))`` returns a str even when
  msg isn't a str.
4712

4713 4714 4715 4716
- Issue #2051: Source file permission bits are once again correctly copied to
  the cached bytecode file. (The migration to importlib reintroduced this
  problem because these was no regression test. A test has been added as part of
  this patch)
4717

4718
- Issue #15761: Fix crash when ``PYTHONEXECUTABLE`` is set on Mac OS X.
4719

4720 4721
- Issue #15726: Fix incorrect bounds checking in PyState_FindModule.  Patch by
  Robin Schreiber.
4722

4723
- Issue #15604: Update uses of `PyObject_IsTrue()` to check for and handle
4724 4725
  errors correctly.  Patch by Serhiy Storchaka.

4726 4727
- Issue #14846: `importlib.FileFinder` now handles the case where the directory
  being searched is removed after a previous import attempt.
4728

Georg Brandl's avatar
Georg Brandl committed
4729 4730 4731
Library
-------

4732 4733
- Issue #13370: Ensure that ctypes works on Mac OS X when Python is compiled
  using the clang compiler.
4734

4735 4736
- Issue #13072: The array module's 'u' format code is now deprecated and will be
  removed in Python 4.0.
4737

4738 4739
- Issue #15544: Fix Decimal.__float__ to work with payload-carrying NaNs.

4740 4741
- Issue #15776: Allow pyvenv to work in existing directory with --clean.

4742
- Issue #15249: email's BytesGenerator now correctly mangles From lines (when
4743
  requested) even if the body contains undecodable bytes.
4744

Ross Lagerwall's avatar
Ross Lagerwall committed
4745
- Issue #15777: Fix a refleak in _posixsubprocess.
4746

4747
- Issue ##665194: Update `email.utils.localtime` to use datetime.astimezone and
4748 4749
  correctly handle historic changes in UTC offsets.

4750 4751
- Issue #15199: Fix JavaScript's default MIME type to application/javascript.
  Patch by Bohuslav Kabrda.
4752

4753 4754
- Issue #12643: `code.InteractiveConsole` now respects `sys.excepthook` when
  displaying exceptions.  Patch by Aaron Iles.
4755

4756
- Issue #13579: `string.Formatter` now understands the 'a' conversion specifier.
4757

4758 4759
- Issue #15595: Fix ``subprocess.Popen(universal_newlines=True)`` for certain
  locales (utf-16 and utf-32 family). Patch by Chris Jerdonek.
4760

4761 4762
- Issue #15477: In cmath and math modules, add workaround for platforms whose
  system-supplied log1p function doesn't respect signs of zeros.
4763

4764 4765
- Issue #15715: `importlib.__import__()` will silence an ImportError when the
  use of fromlist leads to a failed import.
4766

4767 4768 4769
- Issue #14669: Fix pickling of connections and sockets on Mac OS X by
  sending/receiving an acknowledgment after file descriptor transfer.
  TestPicklingConnection has been reenabled for Mac OS X.
4770

4771
- Issue #11062: Fix adding a message from file to Babyl mailbox.
4772

4773 4774
- Issue #15646: Prevent equivalent of a fork bomb when using `multiprocessing`
  on Windows without the ``if __name__ == '__main__'`` idiom.
4775

4776 4777 4778
IDLE
----

4779 4780
- Issue #15678: Fix IDLE menus when started from OS X command line (3.3.0b2
  regression).
4781

Senthil Kumaran's avatar
Senthil Kumaran committed
4782 4783
Documentation
-------------
4784

4785 4786
- Touched up the Python 2 to 3 porting guide.

4787
- Issue #14674: Add a discussion of the `json` module's standard compliance.
4788
  Patch by Chris Rebert.
4789

4790 4791
- Create a 'Concurrent Execution' section in the docs, and split up the
  'Optional Operating System Services' section to use a more user-centric
4792
  classification scheme (splitting them across the new CE section, IPC and text
4793
  processing). Operating system limitations can be reflected with the Sphinx
4794
  ``:platform:`` tag, it doesn't make sense as part of the Table of Contents.
4795

4796 4797
- Issue #4966: Bring the sequence docs up to date for the Py3k transition and
  the many language enhancements since they were original written.
4798

4799
- The "path importer" misnomer has been replaced with Eric Snow's
4800 4801
  more-awkward-but-at-least-not-wrong suggestion of "path based finder" in the
  import system reference docs.
4802

4803
- Issue #15640: Document `importlib.abc.Finder` as deprecated.
4804

4805
- Issue #15630: Add an example for "continue" stmt in the tutorial.  Patch by
Senthil Kumaran's avatar
Senthil Kumaran committed
4806
  Daniel Ellis.
4807

4808 4809
Tests
-----
4810

4811
- Issue #15747: ZFS always returns EOPNOTSUPP when attempting to set the
4812 4813
  UF_IMMUTABLE flag (via either chflags or lchflags); refactor affected tests in
  test_posix.py to account for this.
4814

4815 4816
- Issue #15285: Refactor the approach for testing connect timeouts using two
  external hosts that have been configured specifically for this type of test.
4817

4818
- Issue #15743: Remove the deprecated method usage in `urllib` tests. Patch by
4819 4820
  Jeff Knupp.

4821 4822
- Issue #15615: Add some tests for the `json` module's handling of invalid input
  data.  Patch by Kushal Das.
4823

4824 4825 4826
Build
-----

4827 4828
- Output lib files for PGO build into PGO directory.

4829 4830
- Pick up 32-bit launcher from PGO directory on 64-bit PGO build.

4831
- Drop ``PC\python_nt.h`` as it's not used.  Add input dependency on custom
4832 4833
  build step.

4834 4835
- Issue #15511: Drop explicit dependency on pythonxy.lib from _decimal amd64
  configuration.
4836

4837 4838
- Add missing PGI/PGO configurations for pywlauncher.

4839 4840
- Issue #15645: Ensure 2to3 grammar pickles are properly installed.

Georg Brandl's avatar
Georg Brandl committed
4841

4842 4843 4844
What's New in Python 3.3.0 Beta 2?
==================================

Georg Brandl's avatar
Georg Brandl committed
4845
*Release date: 12-Aug-2012*
4846

4847 4848 4849
Core and Builtins
-----------------

4850
- Issue #15568: Fix the return value of ``yield from`` when StopIteration is
4851 4852
  raised by a custom iterator.

4853
- Issue #13119: `sys.stdout` and `sys.stderr` are now using "\r\n" newline on
4854 4855
  Windows, as Python 2.

4856 4857
- Issue #15534: Fix the fast-search function for non-ASCII Unicode strings.

4858
- Issue #15508: Fix the docstring for `__import__()` to have the proper default
Georg Brandl's avatar
Georg Brandl committed
4859 4860
  value of 0 for 'level' and to not mention negative levels since they are not
  supported.
4861

4862
- Issue #15425: Eliminated traceback noise from more situations involving
Georg Brandl's avatar
Georg Brandl committed
4863
  importlib.
4864

4865 4866
- Issue #14578: Support modules registered in the Windows registry again.

Georg Brandl's avatar
Georg Brandl committed
4867 4868
- Issue #15466: Stop using TYPE_INT64 in marshal, to make importlib.h (and other
  byte code files) equal between 32-bit and 64-bit systems.
4869

Georg Brandl's avatar
Georg Brandl committed
4870
- Issue #1692335: Move initial exception args assignment to
4871
  `BaseException.__new__()` to help pickling of naive subclasses.
4872

4873
- Issue #12834: Fix `PyBuffer_ToContiguous()` for non-contiguous arrays.
4874

4875
- Issue #15456: Fix code `__sizeof__()` after #12399 change.  Patch by Serhiy
Georg Brandl's avatar
Georg Brandl committed
4876
  Storchaka.
4877

4878 4879
- Issue #15404: Refleak in PyMethodObject repr.

4880 4881
- Issue #15394: An issue in `PyModule_Create()` that caused references to be
  leaked on some error paths has been fixed.  Patch by Julia Lawall.
4882

Georg Brandl's avatar
Georg Brandl committed
4883 4884
- Issue #15368: An issue that caused bytecode generation to be non-deterministic
  has been fixed.
4885

Georg Brandl's avatar
Georg Brandl committed
4886 4887
- Issue #15202: Consistently use the name "follow_symlinks" for new parameters
  in os and shutil functions.
4888

4889
- Issue #15314: ``__main__.__loader__`` is now set correctly during interpreter
Georg Brandl's avatar
Georg Brandl committed
4890
  startup.
4891

4892 4893 4894 4895
- Issue #15111: When a module imported using 'from import' has an ImportError
  inside itself, don't mask that fact behind a generic ImportError for the
  module itself.

4896 4897
- Issue #15293: Add GC support to the AST base node type.

4898 4899 4900
- Issue #15291: Fix a memory leak where AST nodes where not properly
  deallocated.

Georg Brandl's avatar
Georg Brandl committed
4901 4902
- Issue #15110: Fix the tracebacks generated by "import xxx" to not show the
  importlib stack frames.
4903

4904
- Issue #16369: Global PyTypeObjects not initialized with PyType_Ready(...).
Ronald Oussoren's avatar
Ronald Oussoren committed
4905

4906 4907 4908
- Issue #15020: The program name used to search for Python's path is now
  "python3" under Unix, not "python".

4909 4910
- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.
4911

Ezio Melotti's avatar
Ezio Melotti committed
4912
- Issue #15033: Fix the exit status bug when modules invoked using -m switch,
4913 4914
  return the proper failure return value (1). Patch contributed by Jeff Knupp.

4915
- Issue #15229: An `OSError` subclass whose __init__ doesn't call back
Georg Brandl's avatar
Georg Brandl committed
4916 4917
  OSError.__init__ could produce incomplete instances, leading to crashes when
  calling str() on them.
4918

Ezio Melotti's avatar
Ezio Melotti committed
4919
- Issue #15307: Virtual environments now use symlinks with framework builds on
Georg Brandl's avatar
Georg Brandl committed
4920
  Mac OS X, like other POSIX builds.
4921

4922 4923 4924
Library
-------

4925 4926 4927
- Issue #14590: configparser now correctly strips inline comments when delimiter
  occurs earlier without preceding space.

4928
- Issue #15424: Add a `__sizeof__()` implementation for array objects.  Patch by
Georg Brandl's avatar
Georg Brandl committed
4929
  Ludwig Hähne.
4930

4931 4932
- Issue #15576: Allow extension modules to act as a package's __init__ module.

4933 4934
- Issue #15502: Have `importlib.invalidate_caches()` work on `sys.meta_path`
  instead of `sys.path_importer_cache`.
4935

4936 4937
- Issue #15163: Pydoc shouldn't list __loader__ as module data.

4938
- Issue #15471: Do not use mutable objects as defaults for
4939
  `importlib.__import__()`.
4940

4941
- Issue #15559: To avoid a problematic failure mode when passed to the bytes
4942 4943
  constructor, objects in the ipaddress module no longer implement `__index__()`
  (they still implement `__int__()` as appropriate).
4944

4945 4946
- Issue #15546: Fix handling of pathological input data in the peek() and
  read1() methods of the BZ2File, GzipFile and LZMAFile classes.
4947

4948 4949 4950
- Issue #12655: Instead of requiring a custom type, `os.sched_getaffinity()` and
  `os.sched_setaffinity()` now use regular sets of integers to represent the
  CPUs a process is restricted to.
4951

4952 4953
- Issue #15538: Fix compilation of the `socket.getnameinfo()` /
  `socket.getaddrinfo()` emulation code.  Patch by Philipp Hagemeister.
4954

Georg Brandl's avatar
Georg Brandl committed
4955
- Issue #15519: Properly expose WindowsRegistryFinder in importlib (and use the
4956
  correct term for it).  Original patch by Eric Snow.
4957

Georg Brandl's avatar
Georg Brandl committed
4958
- Issue #15502: Bring the importlib ABCs into line with the current state of the
4959
  import protocols given PEP 420.  Original patch by Eric Snow.
4960

Georg Brandl's avatar
Georg Brandl committed
4961 4962
- Issue #15499: Launching a webbrowser in Unix used to sleep for a few seconds.
  Original patch by Anton Barkovsky.
4963

Georg Brandl's avatar
Georg Brandl committed
4964 4965
- Issue #15463: The faulthandler module truncates strings to 500 characters,
  instead of 100, to be able to display long file paths.
4966

4967
- Issue #6056: Make `multiprocessing` use setblocking(True) on the sockets it
Georg Brandl's avatar
Georg Brandl committed
4968
  uses.  Original patch by J Derek Wilson.
4969

Georg Brandl's avatar
Georg Brandl committed
4970
- Issue #15364: Fix sysconfig.get_config_var('srcdir') to be an absolute path.
4971

4972
- Issue #15413: `os.times()` had disappeared under Windows.
4973

4974
- Issue #15402: An issue in the struct module that caused `sys.getsizeof()` to
Georg Brandl's avatar
Georg Brandl committed
4975 4976
  return incorrect results for struct.Struct instances has been fixed.  Initial
  patch by Serhiy Storchaka.
4977

4978 4979 4980
- Issue #15232: When mangle_from is True, `email.Generator` now correctly
  mangles lines that start with 'From ' that occur in a MIME preamble or
  epilogue.
4981

Georg Brandl's avatar
Georg Brandl committed
4982 4983
- Issue #15094: Incorrectly placed #endif in _tkinter.c.  Patch by Serhiy
  Storchaka.
4984

4985
- Issue #13922: `argparse` no longer incorrectly strips '--'s that appear after
Georg Brandl's avatar
Georg Brandl committed
4986
  the first one.
4987

4988
- Issue #12353: `argparse` now correctly handles null argument values.
4989

Georg Brandl's avatar
Georg Brandl committed
4990
- Issue #10017, issue #14998: Fix TypeError using pprint on dictionaries with
4991
  user-defined types as keys or other unorderable keys.
4992

4993 4994
- Issue #15397: `inspect.getmodulename()` is now based directly on importlib via
  a new `importlib.machinery.all_suffixes()` API.
4995

4996
- Issue #14635: `telnetlib` will use poll() rather than select() when possible to
Georg Brandl's avatar
Georg Brandl committed
4997
  avoid failing due to the select() file descriptor limit.
4998

Georg Brandl's avatar
Georg Brandl committed
4999
- Issue #15180: Clarify posixpath.join() error message when mixing str & bytes.
5000

Georg Brandl's avatar
Georg Brandl committed
5001 5002 5003
- Issue #15343: pkgutil now includes an iter_importer_modules implementation for
  importlib.machinery.FileFinder (similar to the way it already handled
  zipimport.zipimporter).
5004

Georg Brandl's avatar
Georg Brandl committed
5005
- Issue #15314: runpy now sets __main__.__loader__ correctly.
5006

Georg Brandl's avatar
Georg Brandl committed
5007 5008
- Issue #15357: The import emulation in pkgutil is now deprecated. pkgutil uses
  importlib internally rather than the emulation.
5009

Georg Brandl's avatar
Georg Brandl committed
5010 5011
- Issue #15233: Python now guarantees that callables registered with the atexit
  module will be called in a deterministic order.
5012

5013
- Issue #15238: `shutil.copystat()` now copies Linux "extended attributes".
5014

Georg Brandl's avatar
Georg Brandl committed
5015 5016
- Issue #15230: runpy.run_path now correctly sets __package__ as described in
  the documentation.
Nick Coghlan's avatar
Nick Coghlan committed
5017

5018 5019
- Issue #15315: Support VS 2010 in distutils cygwincompiler.

Georg Brandl's avatar
Georg Brandl committed
5020 5021
- Issue #15294: Fix a regression in pkgutil.extend_path()'s handling of nested
  namespace packages.
5022

5023 5024
- Issue #15056: `imp.cache_from_source()` and `imp.source_from_cache()` raise
  NotImplementedError when `sys.implementation.cache_tag` is set to None.
5025

5026
- Issue #15256: Grammatical mistake in exception raised by `imp.find_module()`.
5027

5028
- Issue #5931: `wsgiref` environ variable SERVER_SOFTWARE will specify an
Georg Brandl's avatar
Georg Brandl committed
5029
  implementation specific term like CPython, Jython instead of generic "Python".
5030

Georg Brandl's avatar
Georg Brandl committed
5031 5032
- Issue #13248: Remove obsolete argument "max_buffer_size" of BufferedWriter and
  BufferedRWPair, from the io module.
5033

5034
- Issue #13248: Remove obsolete argument "version" of `argparse.ArgumentParser`.
5035

Georg Brandl's avatar
Georg Brandl committed
5036 5037
- Issue #14814: Implement more consistent ordering and sorting behaviour for
  ipaddress objects.
5038

5039
- Issue #14814: `ipaddress` network objects correctly return NotImplemented when
Georg Brandl's avatar
Georg Brandl committed
5040
  compared to arbitrary objects instead of raising TypeError.
5041

Georg Brandl's avatar
Georg Brandl committed
5042
- Issue #14990: Correctly fail with SyntaxError on invalid encoding declaration.
Florent Xicluna's avatar
Florent Xicluna committed
5043

5044
- Issue #14814: `ipaddress` now provides more informative error messages when
5045
  constructing instances directly (changes permitted during beta due to
Georg Brandl's avatar
Georg Brandl committed
5046
  provisional API status).
5047

5048 5049
- Issue #15247: `io.FileIO` now raises an error when given a file descriptor
  pointing to a directory.
5050

5051 5052
- Issue #15261: Stop os.stat(fd) crashing on Windows when fd not open.

5053
- Issue #15166: Implement `imp.get_tag()` using `sys.implementation.cache_tag`.
5054

5055
- Issue #15210: Catch KeyError when `importlib.__init__()` can't find
5056 5057
  _frozen_importlib in sys.modules, not ImportError.

5058
- Issue #15030: `importlib.abc.PyPycLoader` now supports the new source size
5059 5060
  header field in .pyc files.

Georg Brandl's avatar
Georg Brandl committed
5061 5062
- Issue #5346: Preserve permissions of mbox, MMDF and Babyl mailbox files on
  flush().
5063

Georg Brandl's avatar
Georg Brandl committed
5064 5065
- Issue #10571: Fix the "--sign" option of distutils' upload command.  Patch by
  Jakub Wilk.
5066

Georg Brandl's avatar
Georg Brandl committed
5067 5068 5069
- Issue #9559: If messages were only added, a new file is no longer created and
  renamed over the old file when flush() is called on an mbox, MMDF or Babyl
  mailbox.
5070

Ezio Melotti's avatar
Ezio Melotti committed
5071
- Issue #10924: Fixed `crypt.mksalt()` to use a RNG that is suitable for
Georg Brandl's avatar
Georg Brandl committed
5072
  cryptographic purpose.
5073

Georg Brandl's avatar
Georg Brandl committed
5074 5075 5076 5077
- Issue #15184: Ensure consistent results of OS X configuration tailoring for
  universal builds by factoring out common OS X-specific customizations from
  sysconfig, distutils.sysconfig, distutils.util, and distutils.unixccompiler
  into a new module _osx_support.
5078

5079 5080 5081
C API
-----

5082
- Issue #15610: `PyImport_ImportModuleEx()` now uses a 'level' of 0 instead of -1.
5083

5084 5085
- Issue #15169, issue #14599: Strip out the C implementation of
  `imp.source_from_cache()` used by PyImport_ExecCodeModuleWithPathnames() and
5086 5087 5088 5089
  used the Python code instead. Leads to PyImport_ExecCodeModuleObject() to not
  try to infer the source path from the bytecode path as
  PyImport_ExecCodeModuleWithPathnames() does.

5090 5091 5092
Extension Modules
-----------------

5093 5094
- Issue #6493: An issue in ctypes on Windows that caused structure bitfields of
  type `ctypes.c_uint32` and width 32 to incorrectly be set has been fixed.
5095

5096 5097
- Issue #15194: Update libffi to the 3.0.11 release.

5098 5099 5100 5101 5102 5103
IDLE
----

- Issue #13052: Fix IDLE crashing when replace string in Search/Replace dialog
  ended with ``\``.  Patch by Roger Serwy.

5104 5105 5106
Tools/Demos
-----------

Georg Brandl's avatar
Georg Brandl committed
5107 5108
- Issue #15458: python-config gets a new option --configdir to print the $LIBPL
  value.
5109

5110 5111
- Move importlib.test.benchmark to Tools/importbench.

Georg Brandl's avatar
Georg Brandl committed
5112 5113 5114
- Issue #12605: The gdb hooks for debugging CPython (within Tools/gdb) have been
  enhanced to show information on more C frames relevant to CPython within the
  "py-bt" and "py-bt-full" commands:
Georg Brandl's avatar
Georg Brandl committed
5115 5116 5117 5118

  * C frames that are waiting on the GIL
  * C frames that are garbage-collecting
  * C frames that are due to the invocation of a PyCFunction
5119

Terry Jan Reedy's avatar
Terry Jan Reedy committed
5120 5121 5122
Documentation
-------------

5123 5124
- Issue #15041: Update "see also" list in tkinter documentation.

5125 5126
- Issue #15444: Use proper spelling for non-ASCII contributor names.  Patch by
  Serhiy Storchaka.
5127

5128
- Issue #15295: Reorganize and rewrite the documentation on the import system.
Barry Warsaw's avatar
Barry Warsaw committed
5129

Georg Brandl's avatar
Georg Brandl committed
5130 5131
- Issue #15230: Clearly document some of the limitations of the runpy module and
  nudge readers towards importlib when appropriate.
5132

5133 5134 5135
- Issue #15053: Copy Python 3.3 import lock change notice to all relevant
  functions in imp instead of just at the top of the relevant section.

5136 5137 5138 5139 5140
- Issue #15288: Link to the term "loader" in notes in pkgutil about how things
  won't work as expected in Python 3.3 and mark the requisite functions as
  "changed" since they will no longer work with modules directly imported by
  import itself.

5141 5142
- Issue #13557: Clarify effect of giving two different namespaces to `exec()` or
  `execfile()`.
Terry Jan Reedy's avatar
Terry Jan Reedy committed
5143

5144
- Issue #15250: Document that `filecmp.dircmp()` compares files shallowly. Patch
5145
  contributed by Chris Jerdonek.
5146

5147 5148 5149 5150
- Issue #15442: Expose the default list of directories ignored by
  `filecmp.dircmp()` as a module attribute, and expand the list to more modern
  values.

5151 5152 5153
Tests
-----

5154 5155
- Issue #15467: Move helpers for `__sizeof__()` tests into test_support.  Patch
  by Serhiy Storchaka.
5156

Georg Brandl's avatar
Georg Brandl committed
5157 5158
- Issue #15320: Make iterating the list of tests thread-safe when running tests
  in multiprocess mode. Patch by Chris Jerdonek.
5159

5160
- Issue #15168: Move `importlib.test` to `test.test_importlib`.
5161

5162
- Issue #15091: Reactivate a test on UNIX which was failing thanks to a
5163
  forgotten `importlib.invalidate_caches()` call.
5164 5165

- Issue #15230: Adopted a more systematic approach in the runpy tests.
Nick Coghlan's avatar
Nick Coghlan committed
5166

5167 5168 5169 5170
- Issue #15300: Ensure the temporary test working directories are in the same
  parent folder when running tests in multiprocess mode from a Python build.
  Patch by Chris Jerdonek.

5171 5172 5173
- Issue #15284: Skip {send,recv}msg tests in test_socket when IPv6 is not
  enabled. Patch by Brian Brazil.

Georg Brandl's avatar
Georg Brandl committed
5174 5175
- Issue #15277: Fix a resource leak in support.py when IPv6 is disabled.  Patch
  by Brian Brazil.
5176

5177 5178 5179
Build
-----

Georg Brandl's avatar
Georg Brandl committed
5180 5181
- Issue #11715: Fix multiarch detection without having Debian development tools
  (dpkg-dev) installed.
5182

5183 5184 5185 5186
- Issue #15037: Build OS X installers with local copy of ncurses 5.9 libraries
  to avoid curses.unget_wch bug present in older versions of ncurses such as
  those shipped with OS X.

Georg Brandl's avatar
Georg Brandl committed
5187 5188 5189 5190
- Issue #15560: Fix building _sqlite3 extension on OS X with an SDK.  Also, for
  OS X installers, ensure consistent sqlite3 behavior and feature availability
  by building a local copy of libsqlite3 rather than depending on the wide range
  of versions supplied with various OS X releases.
5191

Martin v. Löwis's avatar
Martin v. Löwis committed
5192
- Issue #8847: Disable COMDAT folding in Windows PGO builds.
5193

5194 5195
- Issue #14018: Fix OS X Tcl/Tk framework checking when using OS X SDKs.

Ned Deily's avatar
Ned Deily committed
5196
- Issue #16256: OS X installer now sets correct permissions for doc directory.
5197

Georg Brandl's avatar
Georg Brandl committed
5198 5199
- Issue #15431: Add _freeze_importlib project to regenerate importlib.h on
  Windows. Patch by Kristján Valur Jónsson.
5200

Georg Brandl's avatar
Georg Brandl committed
5201 5202
- Issue #14197: For OS X framework builds, ensure links to the shared library
  are created with the proper ABI suffix.
5203

5204 5205 5206
- Issue #14330: For cross builds, don't use host python, use host search paths
  for host compiler.

5207 5208
- Issue #15235: Allow Berkley DB versions up to 5.3 to build the dbm module.

5209 5210
- Issue #15268: Search curses.h in /usr/include/ncursesw.

5211

5212
What's New in Python 3.3.0 Beta 1?
Georg Brandl's avatar
Georg Brandl committed
5213
==================================
5214

Georg Brandl's avatar
Georg Brandl committed
5215
*Release date: 27-Jun-2012*
5216

Barry Warsaw's avatar
Barry Warsaw committed
5217 5218 5219
Core and Builtins
-----------------

5220 5221 5222
- Fix a (most likely) very rare memory leak when calling main() and not being
  able to decode a command-line argument.

5223 5224 5225
- Issue #14815: Use Py_ssize_t instead of long for the object hash, to
  preserve all 64 bits of hash on Win64.

5226 5227 5228 5229 5230
- Issue #12268: File readline, readlines and read() or readall() methods
  no longer lose data when an underlying read system call is interrupted.
  IOError is no longer raised due to a read system call returning EINTR
  from within these methods.

5231 5232
- Issue #11626: Add _SizeT functions to stable ABI.

5233 5234 5235
- Issue #15142: Fix reference leak when deallocating instances of types
  created using PyType_FromSpec().

5236 5237 5238
- Issue #10053: Don't close FDs when FileIO.__init__ fails. Loosely based on
  the work by Hirokazu Yamamoto.

5239 5240 5241
- Issue #15096: Removed support for ur'' as the raw notation isn't
  compatible with Python 2.x's raw unicode strings.

5242 5243
- Issue #13783: Generator objects now use the identifier APIs internally

5244 5245 5246
- Issue #14874: Restore charmap decoding speed to pre-PEP 393 levels.
  Patch by Serhiy Storchaka.

5247 5248 5249
- Issue #15026: utf-16 encoding is now significantly faster (up to 10x).
  Patch by Serhiy Storchaka.

5250 5251 5252 5253 5254 5255
- Issue #11022: open() and io.TextIOWrapper are now calling
  locale.getpreferredencoding(False) instead of locale.getpreferredencoding()
  in text mode if the encoding is not specified. Don't change temporary the
  locale encoding using locale.setlocale(), use the current locale encoding
  instead of the user preferred encoding.

Barry Warsaw's avatar
Barry Warsaw committed
5256 5257
- Issue #14673: Add Eric Snow's sys.implementation implementation.

5258 5259
- Issue #15038: Optimize python Locks on Windows.

5260 5261 5262
Library
-------

5263 5264
- Issue #12288: Consider '0' and '0.0' as valid initialvalue
  for tkinter SimpleDialog.
5265

5266 5267
- Issue #15512: Add a __sizeof__ implementation for parser.
  Patch by Serhiy Storchaka.
5268

5269 5270
- Issue #15469: Add a __sizeof__ implementation for deque objects.
  Patch by Serhiy Storchaka.
R David Murray's avatar
R David Murray committed
5271

5272 5273
- Issue #15489: Add a __sizeof__ implementation for BytesIO objects.
  Patch by Serhiy Storchaka.
5274

5275 5276
- Issue #15487: Add a __sizeof__ implementation for buffered I/O objects.
  Patch by Serhiy Storchaka.
5277

5278 5279 5280
- Issue #15514: Correct __sizeof__ support for cpu_set.
  Patch by Serhiy Storchaka.

5281 5282
- Issue #15177: Added dir_fd parameter to os.fwalk().

5283 5284 5285 5286
- Issue #15061: Re-implemented hmac.compare_digest() in C to prevent further
  timing analysis and to support all buffer protocol aware objects as well as
  ASCII only str instances safely.

5287 5288
- Issue #15164: Change return value of platform.uname() from a
  plain tuple to a collections.namedtuple.
5289

5290 5291 5292 5293
- Support Mageia Linux in the platform module.

- Issue #11678: Support Arch linux in the platform module.

5294 5295 5296 5297
- Issue #15118: Change return value of os.uname() and os.times() from
  plain tuples to immutable iterable objects with named attributes
  (structseq objects).

5298 5299 5300 5301
- Speed up _decimal by another 10-15% by caching the thread local context
  that was last accessed. In the pi benchmark (64-bit platform, prec=9),
  _decimal is now only 1.5x slower than float.

5302 5303
- Remove the packaging module, which is not ready for prime time.

5304 5305 5306
- Issue #15154: Add "dir_fd" parameter to os.rmdir, remove "rmdir"
  parameter from os.remove / os.unlink.

Hynek Schlawack's avatar
Hynek Schlawack committed
5307
- Issue #4489: Add a shutil.rmtree that isn't susceptible to symlink attacks.
5308 5309 5310
  It is used automatically on platforms supporting the necessary os.openat()
  and os.unlinkat() functions. Main code by Martin von Löwis.

5311 5312
- Issue #15156: HTMLParser now uses the new "html.entities.html5" dictionary.

5313 5314 5315 5316
- Issue #11113: add a new "html5" dictionary containing the named character
  references defined by the HTML5 standard and the equivalent Unicode
  character(s) to the html.entities module.

5317 5318 5319
- Issue #15114: the strict mode of HTMLParser and the HTMLParseError exception
  are deprecated now that the parser is able to parse invalid markup.

5320 5321 5322
- Issue #3665: \u and \U escapes are now supported in unicode regular
  expressions.  Patch by Serhiy Storchaka.

5323 5324 5325
- Issue #15153: Added inspect.getgeneratorlocals to simplify white box
  testing of generator state updates

5326 5327 5328 5329
- Issue #13062: Added inspect.getclosurevars to simplify testing stateful
  closures

- Issue #11024: Fixes and additional tests for Time2Internaldate.
5330

5331 5332
- Issue #14626: Large refactoring of functions / parameters in the os module.
  Many functions now support "dir_fd" and "follow_symlinks" parameters;
Ezio Melotti's avatar
Ezio Melotti committed
5333
  some also support accepting an open file descriptor in place of a path
5334 5335 5336 5337 5338
  string.  Added os.support_* collections as LBYL helpers.  Removed many
  functions only previously seen in 3.3 alpha releases (often starting with
  "f" or "l", or ending with "at").  Originally suggested by Serhiy Storchaka;
  implemented by Larry Hastings.

5339 5340 5341
- Issue #15008: Implement PEP 362 "Signature Objects".
  Patch by Yury Selivanov.

5342 5343
- Issue: #15138: base64.urlsafe_{en,de}code() are now 3-4x faster.

5344 5345 5346 5347
- Issue #444582: Add shutil.which, for finding programs on the system path.
  Original patch by Erik Demaine, with later iterations by Jan Killian
  and Brian Curtin.

5348 5349 5350 5351
- Issue #14837: SSL errors now have ``library`` and ``reason`` attributes
  describing precisely what happened and in which OpenSSL submodule.  The
  str() of a SSLError is also enhanced accordingly.

5352 5353 5354
- Issue #9527: datetime.astimezone() method will now supply a class
  timezone instance corresponding to the system local timezone when
  called with no arguments.
5355

5356 5357
- Issue #14653: email.utils.mktime_tz() no longer relies on system
  mktime() when timezone offest is supplied.
5358

5359 5360 5361
- Issue #14684: zlib.compressobj() and zlib.decompressobj() now support the use
  of predefined compression dictionaries. Original patch by Sam Rushing.

5362
- Fix GzipFile's handling of filenames given as bytes objects.
5363

5364 5365
- Issue #14772: Return destination values from some shutil functions.

5366 5367
- Issue #15064: Implement context manager protocol for multiprocessing types

5368
- Issue #15101: Make pool finalizer avoid joining current thread.
5369

5370 5371 5372
- Issue #14657: The frozen instance of importlib used for bootstrap is now
  also the module imported as importlib._bootstrap.

5373 5374
- Issue #14055: Add __sizeof__ support to _elementtree.

5375 5376 5377 5378
- Issue #15054: A bug in tokenize.tokenize that caused string literals
  with 'b' prefixes to be incorrectly tokenized has been fixed.
  Patch by Serhiy Storchaka.

5379 5380
- Issue #15006: Allow equality comparison between naive and aware
  time or datetime objects.
5381

Petri Lehtinen's avatar
Petri Lehtinen committed
5382 5383 5384
- Issue #15036: Mailbox no longer throws an error if a flush is done
  between operations when removing or changing multiple items in mbox,
  MMDF, or Babyl mailboxes.
5385

5386 5387
- Issue #14059: Implement multiprocessing.Barrier.

5388
- Issue #15061: The inappropriately named hmac.secure_compare has been
Nick Coghlan's avatar
Nick Coghlan committed
5389 5390
  renamed to hmac.compare_digest, restricted to operating on bytes inputs
  only and had its documentation updated to more accurately reflect both its
5391 5392
  intent and its limitations

5393 5394
- Issue #13841: Make child processes exit using sys.exit() on Windows.

5395
- Issue #14936: curses_panel was converted to PEP 3121 and PEP 384 API.
5396 5397
  Patch by Robin Schreiber.

5398 5399 5400 5401 5402
- Issue #1667546: On platforms supporting tm_zone and tm_gmtoff fields
  in struct tm, time.struct_time objects returned by time.gmtime(),
  time.localtime() and time.strptime() functions now have tm_zone and
  tm_gmtoff attributes.  Original patch by Paul Boddie.

5403 5404
- Rename adjusted attribute to adjustable in time.get_clock_info() result.

5405 5406 5407
- Issue #3518: Remove references to non-existent BaseManager.from_address()
  method.

5408 5409 5410
- Issue #13857: Added textwrap.indent() function (initial patch by Ezra
  Berch)

5411 5412
- Issue #2736: Added datetime.timestamp() method.

5413 5414
- Issue #13854: Make multiprocessing properly handle non-integer
  non-string argument to SystemExit.
5415

5416 5417
- Issue #12157: Make pool.map() empty iterables correctly.  Initial
  patch by mouad.
5418

5419 5420
- Issue #11823: disassembly now shows argument counts on calls with keyword args.

5421 5422
- Issue #14711: os.stat_float_times() has been deprecated.

5423 5424
- LZMAFile now accepts the modes "rb"/"wb"/"ab" as synonyms of "r"/"w"/"a".

5425 5426
- The bz2 and lzma modules now each contain an open() function, allowing
  compressed files to readily be opened in text mode as well as binary mode.
5427

5428 5429
- BZ2File.__init__() and LZMAFile.__init__() now accept a file object as their
  first argument, rather than requiring a separate "fileobj" argument.
5430

5431 5432
- gzip.open() now accepts file objects as well as filenames.

5433 5434 5435 5436 5437
- Issue #14992: os.makedirs(path, exist_ok=True) would raise an OSError
  when the path existed and had the S_ISGID mode bit set when it was
  not explicitly asked for.  This is no longer an exception as mkdir
  cannot control if the OS sets that bit for it or not.

5438 5439 5440
- Issue #14989: Make the CGI enable option to http.server available via command
  line.

5441 5442
- Issue #14987: Add a missing import statement to inspect.

5443 5444 5445 5446
- Issue #1079: email.header.decode_header now correctly parses all the examples
  in RFC2047.  There is a necessary visible behavior change: the leading and/or
  trailing whitespace on ASCII parts is now preserved.

5447 5448
- Issue #14969: Better handling of exception chaining in contextlib.ExitStack

5449 5450 5451
- Issue #14963: Convert contextlib.ExitStack.__exit__ to use an iterative
  algorithm (Patch by Alon Horev)

5452 5453 5454
- Issue #14785: Add sys._debugmallocstats() to help debug low-level memory
  allocation issues

5455 5456 5457
- Issue #14443: Ensure that .py files are byte-compiled with the correct Python
  executable within bdist_rpm even on older versions of RPM

5458 5459 5460
C-API
-----

5461 5462 5463 5464 5465
- Issue #15146: Add PyType_FromSpecWithBases. Patch by Robin Schreiber.

- Issue #15042: Add PyState_AddModule and PyState_RemoveModule. Add version
  guard for Py_LIMITED_API additions. Patch by Robin Schreiber.

5466 5467 5468
- Issue #13783: Inadvertent additions to the public C API in the PEP 380
  implementation have either been removed or marked as private interfaces.

5469 5470
Extension Modules
-----------------
5471

5472
- Issue #15000: Support the "unique" x32 architecture in _posixsubprocess.c.
5473

5474 5475 5476 5477 5478 5479 5480 5481 5482
IDLE
----

- Issue #9803: Don't close IDLE on saving if breakpoint is open.
  Patch by Roger Serwy.

- Issue #14962: Update text coloring in IDLE shell window after changing
  options.  Patch by Roger Serwy.

5483 5484 5485
Documentation
-------------

5486 5487 5488 5489 5490 5491 5492
- Issue #15176: Clarified behavior, documentation, and implementation
  of os.listdir().

- Issue #14982: Document that pkgutil's iteration functions require the
  non-standard iter_modules() method to be defined by an importer (something
  the importlib importers do not define).

5493 5494 5495
- Issue #15081: Document PyState_FindModule.
  Patch by Robin Schreiber.

5496 5497
- Issue #14814: Added first draft of ipaddress module API reference

5498 5499 5500
Tests
-----

5501 5502 5503
- Issue #15187: Bugfix: remove temporary directories test_shutil was leaving
  behind.

5504 5505 5506 5507
- Issue #14769: test_capi now has SkipitemTest, which cleverly checks
  for "parity" between PyArg_ParseTuple() and the Python/getargs.c static
  function skipitem() for all possible "format units".

5508 5509 5510
- test_nntplib now tolerates being run from behind NNTP gateways that add
  "X-Antivirus" headers to articles

5511 5512 5513 5514
- Issue #15043: test_gdb is now skipped entirely if gdb security settings
  block loading of the gdb hooks

- Issue #14963: Add test cases for exception handling behaviour
5515
  in contextlib.ExitStack (Initial patch by Alon Horev)
5516

5517 5518 5519
Build
-----

5520 5521 5522 5523 5524 5525 5526 5527 5528 5529 5530 5531 5532 5533 5534
- Issue #13590: Improve support for OS X Xcode 4:
    * Try to avoid building Python or extension modules with problematic
      llvm-gcc compiler.
    * Since Xcode 4 removes ppc support, extension module builds now
      check for ppc compiler support and automatically remove ppc and
      ppc64 archs when not available.
    * Since Xcode 4 no longer install SDKs in default locations,
      extension module builds now revert to using installed headers
      and libs if the SDK used to build the interpreter is not
      available.
    * Update ./configure to use better defaults for universal builds;
      in particular, --enable-universalsdk=yes uses the Xcode default
      SDK and --with-universal-archs now defaults to "intel" if ppc
      not available.

5535 5536
- Issue #14225: Fix Unicode support for curses (#12567) on OS X

5537 5538 5539
- Issue #14928: Fix importlib bootstrap issues by using a custom executable
  (Modules/_freeze_importlib) to build Python/importlib.h.

Georg Brandl's avatar
Georg Brandl committed
5540

5541 5542 5543
What's New in Python 3.3.0 Alpha 4?
===================================

Georg Brandl's avatar
Georg Brandl committed
5544
*Release date: 31-May-2012*
5545 5546 5547 5548

Core and Builtins
-----------------

5549 5550 5551
- Issue #14835: Make plistlib output empty arrays & dicts like OS X.
  Patch by Sidney San Martín.

5552 5553 5554
- Issue #14744: Use the new _PyUnicodeWriter internal API to speed up
  str%args and str.format(args).

5555 5556
- Issue #14930: Make memoryview objects weakrefable.

5557 5558 5559
- Issue #14775: Fix a potential quadratic dict build-up due to the garbage
  collector repeatedly trying to untrack dicts.

5560 5561 5562
- Issue #14857: fix regression in references to PEP 3135 implicit __class__
  closure variable (Reopens issue #12370)

Vinay Sajip's avatar
Vinay Sajip committed
5563 5564
- Issue #14712 (PEP 405): Virtual environments. Implemented by Vinay Sajip.

5565 5566
- Issue #14660 (PEP 420): Namespace packages. Implemented by Eric Smith.

5567 5568 5569 5570
- Issue #14494: Fix __future__.py and its documentation to note that
  absolute imports are the default behavior in 3.0 instead of 2.7.
  Patch by Sven Marnach.

5571 5572 5573 5574
- Issue #9260: A finer-grained import lock.  Most of the import sequence
  now uses per-module locks rather than the global import lock, eliminating
  well-known issues with threads and imports.

5575 5576 5577
- Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs.
  Patch by Serhiy Storchaka.

Martin v. Löwis's avatar
Martin v. Löwis committed
5578 5579
- asdl_seq and asdl_int_seq are now Py_ssize_t sized.

5580 5581 5582
- Issue #14133 (PEP 415): Implement suppression of __context__ display with an
  attribute on BaseException. This replaces the original mechanism of PEP 409.

5583 5584 5585
- Issue #14417: Mutating a dict during lookup now restarts the lookup instead
  of raising a RuntimeError (undoes issue #14205).

5586 5587 5588
- Issue #14738: Speed-up UTF-8 decoding on non-ASCII data.  Patch by Serhiy
  Storchaka.

5589 5590 5591
- Issue #14700: Fix two broken and undefined-behaviour-inducing overflow checks
  in old-style string formatting.

5592 5593 5594
Library
-------

5595 5596 5597
- Issue #14690: Use monotonic clock instead of system clock in the sched,
  subprocess and trace modules.

5598 5599 5600
- Issue #14443: Tell rpmbuild to use the correct version of Python in
  bdist_rpm. Initial patch by Ross Lagerwall.

5601 5602 5603 5604 5605 5606 5607
- Issue #12515: email now registers a defect if it gets to EOF while parsing
  a MIME part without seeing the closing MIME boundary.

- Issue #1672568: email now always decodes base64 payloads, adding padding and
  ignoring non-base64-alphabet characters if needed, and registering defects
  for any such problems.

5608 5609 5610 5611
- Issue #14925: email now registers a defect when the parser decides that there
  is a missing header/body separator line.  MalformedHeaderDefect, which the
  existing code would never actually generate, is deprecated.

5612 5613
- Issue #10365: File open dialog now works instead of crashing even when
  the parent window is closed before the dialog. Patch by Roger Serwy.
5614

5615 5616 5617
- Issue #8739: Updated smtpd to support RFC 5321, and added support for the
  RFC 1870 SIZE extension.

5618 5619 5620
- Issue #665194: Added a localtime function to email.utils to provide an
  aware local datetime for use in setting Date headers.

5621 5622 5623 5624 5625 5626 5627 5628
- Issue #12586: Added new provisional policies that implement convenient
  unicode support for email headers.  See What's New for details.

- Issue #14731: Refactored email Policy framework to support full backward
  compatibility with Python 3.2 by default yet allow for the introduction of
  new features through new policies.  Note that Policy.must_be_7bit is renamed
  to cte_type.

5629 5630
- Issue #14876: Use user-selected font for highlight configuration.

5631 5632 5633
- Issue #14920: Fix the help(urllib.parse) failure on locale C on terminals.
  Have ascii characters in help.

5634 5635 5636
- Issue #14548: Make multiprocessing finalizers check pid before
  running to cope with possibility of gc running just after fork.

5637 5638 5639
- Issue #14036: Add an additional check to validate that port in urlparse does
  not go in illegal range and returns None.

5640 5641
- Issue #14862: Add missing names to os.__all__

5642 5643
- Issue #14875: Use float('inf') instead of float('1e66666') in the json module.

5644 5645
- Issue #13585: Added contextlib.ExitStack

5646 5647
- PEP 3144, Issue #14814: Added the ipaddress module

Senthil Kumaran's avatar
Senthil Kumaran committed
5648 5649 5650
- Issue #14426: Correct the Date format in Expires attribute of Set-Cookie
  Header in Cookie.py.

5651 5652 5653 5654
- Issue #14588: The types module now provide new_class() and prepare_class()
  functions to support PEP 3115 compliant dynamic class creation. Patch by
  Daniel Urban and Nick Coghlan.

5655 5656 5657
- Issue #13152: Allow to specify a custom tabsize for expanding tabs in
  textwrap. Patch by John Feuerstein.

5658 5659 5660
- Issue #14721: Send the correct 'Content-length: 0' header when the body is an
  empty string ''. Initial Patch contributed by Arve Knudsen.

5661 5662 5663
- Issue #14072: Fix parsing of 'tel' URIs in urlparse by making the check for
  ports stricter.

5664 5665 5666
- Issue #9374: Generic parsing of query and fragment portions of url for any
  scheme. Supported both by RFC3986 and RFC2396.

5667 5668 5669 5670
- Issue #14798: Fix the functions in pyclbr to raise an ImportError
  when the first part of a dotted name is not a package. Patch by
  Xavier de Gaye.

5671 5672 5673 5674
- Issue #12098: multiprocessing on Windows now starts child processes
  using the same sys.flags as the current process.  Initial patch by
  Sergey Mezentsev.

5675 5676 5677
- Issue #13031: Small speed-up for tarfile when unzipping tarfiles.
  Patch by Justin Peel.

5678 5679 5680
- Issue #14780: urllib.request.urlopen() now has a ``cadefault`` argument
  to use the default certificate store.  Initial patch by James Oakley.

5681 5682 5683
- Issue #14829: Fix bisect and range() indexing with large indices
  (>= 2 ** 32) under 64-bit Windows.

5684 5685 5686
- Issue #14732: The _csv module now uses PEP 3121 module initialization.
  Patch by Robin Schreiber.

5687 5688 5689
- Issue #14809: Add HTTP status codes introduced by RFC 6585 to http.server
  and http.client. Patch by EungJun Yi.

Ned Deily's avatar
Ned Deily committed
5690 5691 5692 5693 5694
- Issue #14777: tkinter may return undecoded UTF-8 bytes as a string when
  accessing the Tk clipboard.  Modify clipboad_get() to first request type
  UTF8_STRING when no specific type is requested in an X11 windowing
  environment, falling back to the current default type STRING if that fails.
  Original patch by Thomas Kluyver.
5695

5696
- Issue #14773: Fix os.fwalk() failing on dangling symlinks.
5697

5698 5699 5700
- Issue #12541: Be lenient with quotes around Realm field of HTTP Basic
  Authentation in urllib2.

5701
- Issue #14807: move undocumented tarfile.filemode() to stat.filemode() and add
5702 5703
  doc entry. Add tarfile.filemode alias with deprecation warning.

5704 5705
- Issue #13815: TarFile.extractfile() now returns io.BufferedReader objects.

5706
- Issue #14532: Add a secure_compare() helper to the hmac module, to mitigate
5707
  timing attacks. Patch by Jon Oberheide.
5708

5709 5710
- Add importlib.util.resolve_name().

5711 5712 5713
- Issue #14366: Support lzma compression in zip files.
  Patch by Serhiy Storchaka.

5714 5715
- Issue #13959: Introduce importlib.find_loader() and document
  imp.find_module/load_module as deprecated.
5716

5717 5718 5719
- Issue #14082: shutil.copy2() now copies extended attributes, if possible.
  Patch by Hynek Schlawack.

Brett Cannon's avatar
Brett Cannon committed
5720 5721 5722 5723 5724
- Issue #13959: Make importlib.abc.FileLoader.load_module()/get_filename() and
  importlib.machinery.ExtensionFileLoader.load_module() have their single
  argument be optional. Allows for the replacement (and thus deprecation) of
  imp.load_source()/load_package()/load_compiled().

5725 5726 5727 5728 5729
- Issue #13959: imp.get_suffixes() has been deprecated in favour of the new
  attributes on importlib.machinery: SOURCE_SUFFIXES, DEBUG_BYTECODE_SUFFIXES,
  OPTIMIZED_BYTECODE_SUFFIXES, BYTECODE_SUFFIXES, and EXTENSION_SUFFIXES. This
  led to an indirect deprecation of inspect.getmoduleinfo().

5730 5731 5732
- Issue #14662: Prevent shutil failures on OS X when destination does not
  support chflag operations.  Patch by Hynek Schlawack.

5733 5734 5735
- Issue #14157: Fix time.strptime failing without a year on February 29th.
  Patch by Hynek Schlawack.

5736 5737 5738
- Issue #14753: Make multiprocessing's handling of negative timeouts
  the same as it was in Python 3.2.

5739 5740 5741
- Issue #14583: Fix importlib bug when a package's __init__.py would first
  import one of its modules then raise an error.

5742 5743
- Issue #14741: Fix missing support for Ellipsis ('...') in parser module.

5744 5745 5746
- Issue #14697: Fix missing support for set displays and set comprehensions in
  parser module.

5747 5748
- Issue #14701: Fix missing support for 'raise ... from' in parser module.

5749 5750 5751
- Add support for timeouts to the acquire() methods of
  multiprocessing's lock/semaphore/condition proxies.

5752 5753
- Issue #13989: Add support for text mode to gzip.open().

5754
- Issue #14127: The os.stat() result object now provides three additional
Georg Brandl's avatar
Georg Brandl committed
5755 5756 5757 5758
  fields: st_ctime_ns, st_mtime_ns, and st_atime_ns, providing those times as an
  integer with nanosecond resolution.  The functions os.utime(), os.lutimes(),
  and os.futimes() now accept a new parameter, ns, which accepts mtime and atime
  as integers with nanosecond resolution.
5759

Georg Brandl's avatar
Georg Brandl committed
5760 5761
- Issue #14127 and #10148: shutil.copystat now preserves exact mtime and atime
  on filesystems providing nanosecond resolution.
5762

5763 5764 5765 5766 5767 5768 5769 5770 5771 5772 5773 5774 5775 5776 5777
IDLE
----

- Issue #14958: Change IDLE systax highlighting to recognize all string and
  byte literals supported in Python 3.3.

- Issue #10997: Prevent a duplicate entry in IDLE's "Recent Files" menu.

- Issue #14929: Stop IDLE 3.x from closing on Unicode decode errors when
  grepping. Patch by Roger Serwy.

- Issue #12510: Attempting to get invalid tooltip no longer closes IDLE.
  Other tooltipss have been corrected or improved and the number of tests
  has been tripled. Original patch by Roger Serwy.

5778 5779 5780
Tools/Demos
-----------

5781
- Issue #14695: Bring Tools/parser/unparse.py support up to date with
5782 5783
  the Python 3.3 Grammar.

5784 5785 5786
Build
-----

Petri Lehtinen's avatar
Petri Lehtinen committed
5787 5788
- Issue #14472: Update .gitignore. Patch by Matej Cepl.

Martin v. Löwis's avatar
Martin v. Löwis committed
5789 5790
- Upgrade Windows library versions: bzip 1.0.6, OpenSSL 1.0.1c.

5791 5792 5793
- Issue #14693: Under non-Windows platforms, hashlib's fallback modules are
  always compiled, even if OpenSSL is present at build time.

5794 5795
- Issue #13210: Windows build now uses VS2010, ported from VS2008.

5796 5797 5798 5799 5800 5801 5802
C-API
-----

- Issue #14705: The PyArg_Parse() family of functions now support the 'p' format
  unit, which accepts a "boolean predicate" argument.  It converts any Python
  value into an integer--0 if it is "false", and 1 otherwise.

5803 5804 5805
Documentation
-------------

5806 5807 5808
- Issue #14863: Update the documentation of os.fdopen() to reflect the
  fact that it's only a thin wrapper around open() anymore.

5809 5810 5811
- Issue #14588: The language reference now accurately documents the Python 3
  class definition process. Patch by Nick Coghlan.

Brian Curtin's avatar
Brian Curtin committed
5812 5813
- Issue #14943: Correct a default argument value for winreg.OpenKey
  and correctly list the argument names in the function's explanation.
5814

Georg Brandl's avatar
Georg Brandl committed
5815

Georg Brandl's avatar
Georg Brandl committed
5816 5817 5818
What's New in Python 3.3.0 Alpha 3?
===================================

Georg Brandl's avatar
Georg Brandl committed
5819
*Release date: 01-May-2012*
Georg Brandl's avatar
Georg Brandl committed
5820 5821 5822 5823

Core and Builtins
-----------------

5824 5825
- Issue #14699: Fix calling the classmethod descriptor directly.

Georg Brandl's avatar
Georg Brandl committed
5826
- Issue #14433: Prevent msvcrt crash in interactive prompt when stdin is closed.
Georg Brandl's avatar
Georg Brandl committed
5827

Georg Brandl's avatar
Georg Brandl committed
5828 5829
- Issue #14521: Make result of float('nan') and float('-nan') more consistent
  across platforms.
5830

5831 5832
- Issue #14646: __import__() sets __loader__ if the loader did not.

5833 5834 5835
- Issue #14605: No longer have implicit entries in sys.meta_path. If
  sys.meta_path is found to be empty, raise ImportWarning.

5836
- Issue #14605: No longer have implicit entries in sys.path_hooks. If
5837 5838 5839
  sys.path_hooks is found to be empty, a warning will be raised. None is now
  inserted into sys.path_importer_cache if no finder was discovered. This also
  means imp.NullImporter is no longer implicitly used.
5840

5841 5842 5843 5844
- Issue #13903: Implement PEP 412. Individual dictionary instances can now share
  their keys with other dictionaries. Classes take advantage of this to share
  their instance dictionary keys for improved memory and performance.

5845 5846 5847 5848 5849 5850
- Issue #11603 (again): Setting __repr__ to __str__ now raises a RuntimeError
  when repr() or str() is called on such an object.

- Issue #14658: Fix binding a special method to a builtin implementation of a
  special method with a different name.

5851 5852 5853
- Issue #14630: Fix a memory access bug for instances of a subclass of int
  with value 0.

5854 5855 5856
- Issue #14339: Speed improvements to bin, oct and hex functions.  Patch by
  Serhiy Storchaka.

5857 5858 5859 5860 5861
- Issue #14385: It is now possible to use a custom type for the __builtins__
  namespace, instead of a dict. It can be used for sandboxing for example.
  Raise also a NameError instead of ImportError if __build_class__ name if not
  found in __builtins__.

5862 5863 5864 5865
- Issue #12599: Be more strict in accepting None compared to a false-like
  object for importlib.util.module_for_loader and
  importlib.machinery.PathFinder.

5866 5867
- Issue #14612: Fix jumping around with blocks by setting f_lineno.

5868 5869 5870
- Issue #14592: Attempting a relative import w/o __package__ or __name__ set in
  globals raises a KeyError.

Benjamin Peterson's avatar
improve  
Benjamin Peterson committed
5871
- Issue #14607: Fix keyword-only arguments which started with ``__``.
5872

5873 5874 5875 5876
- Issue #10854: The ImportError raised when an extension module on Windows
  fails to import now uses the new path and name attributes from
  Issue #1559549.

5877 5878 5879 5880
- Issue #13889: Check and (if necessary) set FPU control word before calling
  any of the dtoa.c string <-> float conversion functions, on MSVC builds of
  Python.  This fixes issues when embedding Python in a Delphi app.

5881 5882 5883
- __import__() now matches PEP 328 and documentation by defaulting 'index' to 0
  instead of -1 and removing support for negative values.

5884 5885
- Issue #2377: Make importlib the implementation of __import__().

5886 5887 5888 5889
- Issue #1559549: ImportError now has 'name' and 'path' attributes that are set
  using keyword arguments to its constructor. They are currently not set by
  import as they are meant for use by importlib.

5890 5891 5892
- Issue #14474: Save and restore exception state in thread.start_new_thread()
  while writing error message if the thread leaves a unhandled exception.

5893 5894 5895
- Issue #13019: Fix potential reference leaks in bytearray.extend().  Patch
  by Suman Saha.

Georg Brandl's avatar
Georg Brandl committed
5896 5897 5898
Library
-------

5899
- Issue #14768: os.path.expanduser('~/a') doesn't works correctly when HOME is '/'.
5900

Georg Brandl's avatar
Georg Brandl committed
5901
- Issue #14371: Support bzip2 in zipfile module.  Patch by Serhiy Storchaka.
5902

5903 5904 5905
- Issue #13183: Fix pdb skipping frames after hitting a breakpoint and running
  step.  Patch by Xavier de Gaye.

5906 5907
- Issue #14696: Fix parser module to understand 'nonlocal' declarations.

5908 5909 5910
- Issue #10941: Fix imaplib.Internaldate2tuple to produce correct result near
  the DST transition.  Patch by Joe Peterson.

5911
- Issue #9154: Fix parser module to understand function annotations.
5912

5913 5914 5915
- Issue #6085: In http.server.py SimpleHTTPServer.address_string returns the
  client ip address instead client hostname. Patch by Charles-François Natali.

5916 5917 5918
- Issue #14309: Deprecate time.clock(), use time.perf_counter() or
  time.process_time() instead.

5919 5920 5921 5922
- Issue #14428: Implement the PEP 418. Add time.get_clock_info(),
  time.perf_counter() and time.process_time() functions, and rename
  time.steady() to time.monotonic().

5923 5924 5925
- Issue #14646: importlib.util.module_for_loader() now sets __loader__ and
  __package__ (when possible).

5926 5927 5928
- Issue #14664: It is now possible to use @unittest.skip{If,Unless} on a
  test class that doesn't inherit from TestCase (i.e. a mixin).

5929 5930 5931
- Issue #4892: multiprocessing Connections can now be transferred over
  multiprocessing Connections.  Patch by Richard Oudkerk (sbt).

5932 5933 5934
- Issue #14160: TarFile.extractfile() failed to resolve symbolic links when
  the links were not located in an archive subdirectory.

5935 5936 5937
- Issue #14638: pydoc now treats non-string __name__ values as if they
  were missing, instead of raising an error.

Senthil Kumaran's avatar
Senthil Kumaran committed
5938 5939 5940
- Issue #13684: Fix httplib tunnel issue of infinite loops for certain sites
  which send EOF without trailing \r\n.

5941
- Issue #14605: Add importlib.abc.FileLoader, importlib.machinery.(FileFinder,
5942
  SourceFileLoader, SourcelessFileLoader, ExtensionFileLoader).
5943

5944 5945 5946 5947 5948
- Issue #13959: imp.cache_from_source()/source_from_cache() now follow
  os.path.join()/split() semantics for path manipulation instead of its prior,
  custom semantics of caring the right-most path separator forward in path
  joining.

5949 5950
- Issue #2193: Allow ":" character in Cookie NAME values.

5951 5952 5953
- Issue #14629: tokenizer.detect_encoding will specify the filename in the
  SyntaxError exception if found at readline.__self__.name.

5954 5955 5956
- Issue #14629: Raise SyntaxError in tokenizer.detect_encoding if the
  first two lines have non-UTF-8 characters without an encoding declaration.

5957 5958 5959
- Issue #14308: Fix an exception when a "dummy" thread is in the threading
  module's active list after a fork().

5960 5961 5962 5963
- Issue #11750: The Windows API functions scattered in the _subprocess and
  _multiprocessing.win32 modules now live in a single module "_winapi".
  Patch by sbt.

5964 5965
- Issue #14087: multiprocessing: add Condition.wait_for(). Patch by sbt.

5966 5967 5968
- Issue #14538: HTMLParser can now parse correctly start tags that contain
  a bare '/'.

5969 5970
- Issue #14452: SysLogHandler no longer inserts a UTF-8 BOM into the message.

5971 5972
- Issue #14386: Expose the dict_proxy internal type as types.MappingProxyType.

5973 5974 5975
- Issue #13959: Make imp.reload() always use a module's __loader__ to perform
  the reload.

5976 5977 5978
- Issue #13959: Add imp.py and rename the built-in module to _imp, allowing for
  re-implementing parts of the module in pure Python.

5979 5980 5981
- Issue #13496: Fix potential overflow in bisect.bisect algorithm when applied
  to a collection of size > sys.maxsize / 2.

5982 5983 5984
- Have importlib take advantage of ImportError's new 'name' and 'path'
  attributes.

R David Murray's avatar
R David Murray committed
5985 5986
- Issue #14399: zipfile now recognizes that the archive has been modified even
  if only the comment is changed.  In addition, the TypeError that results from
Ezio Melotti's avatar
Ezio Melotti committed
5987
  trying to set a non-binary value as a comment is now raised at the time
R David Murray's avatar
R David Murray committed
5988
  the comment is set rather than at the time the zipfile is written.
5989

5990 5991 5992 5993
- trace.CoverageResults.is_ignored_filename() now ignores any name that starts
  with "<" and ends with ">" instead of special-casing "<string>" and
  "<doctest ".

5994 5995 5996
- Issue #12537: The mailbox module no longer depends on knowledge of internal
  implementation details of the email package Message object.

5997 5998 5999 6000
- Issue #7978: socketserver now restarts the select() call when EINTR is
  returned.  This avoids crashing the server loop when a signal is received.
  Patch by Jerzy Kozera.

6001 6002 6003
- Issue #14522: Avoid duplicating socket handles in multiprocessing.connection.
  Patch by sbt.

6004 6005
- Don't Py_DECREF NULL variable in io.IncrementalNewlineDecoder.

6006 6007
- Issue #3033: Add displayof parameter to tkinter font. Patch by Guilherme Polo.

6008 6009 6010 6011
- Issue #14482: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_UNIX type address under
  Windows.  Patch by Popa Claudiu.

6012 6013
- Issue #802310: Generate always unique tkinter font names if not directly passed.

Georg Brandl's avatar
Merge.  
Georg Brandl committed
6014 6015 6016 6017
- Issue #14151: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_PIPE type address under
  non-Windows platforms.  Patch by Popa Claudiu.

6018
- Issue #14493: Use gvfs-open or xdg-open in webbrowser.
6019

6020 6021 6022 6023 6024 6025
Build
-----

- "make touch" will now touch generated files that are checked into Mercurial,
  after a "hg update" which failed to bring the timestamps into the right order.

6026 6027 6028
Tests
-----

Nick Coghlan's avatar
Nick Coghlan committed
6029 6030 6031
- Issue #14026: In test_cmd_line_script, check that sys.argv is populated
  correctly for the various invocation approaches (Patch by Jason Yeo)

Nick Coghlan's avatar
Nick Coghlan committed
6032 6033 6034
- Issue #14032: Fix incorrect variable name in test_cmd_line_script debugging
  message (Patch by Jason Yeo)

6035 6036 6037
- Issue #14589: Update certificate chain for sha256.tbs-internet.com, fixing
  a test failure in test_ssl.

6038 6039 6040
- Issue #14355: Regrtest now supports the standard unittest test loading, and
  will use it if a test file contains no `test_main` method.

6041 6042 6043 6044 6045 6046 6047 6048 6049
IDLE
----

- Issue #8515: Set __file__ when run file in IDLE.
  Initial patch by Bruce Frederiksen.

- Issue #14496: Fix wrong name in idlelib/tabbedpages.py.
  Patch by Popa Claudiu.

6050 6051 6052
Tools / Demos
-------------

6053 6054 6055
- Issue #3561: The Windows installer now has an option, off by default, for
  placing the Python installation into the system "Path" environment variable.

6056 6057 6058
- Issue #13165: stringbench is now available in the Tools/stringbench folder.
  It used to live in its own SVN project.

6059 6060 6061 6062 6063 6064
C-API
-----

- Issue #14098: New functions PyErr_GetExcInfo and PyErr_SetExcInfo.
  Patch by Stefan Behnel.

Georg Brandl's avatar
Georg Brandl committed
6065

Georg Brandl's avatar
Georg Brandl committed
6066 6067 6068
What's New in Python 3.3.0 Alpha 2?
===================================

Georg Brandl's avatar
Georg Brandl committed
6069
*Release date: 01-Apr-2012*
Georg Brandl's avatar
Georg Brandl committed
6070 6071 6072 6073

Core and Builtins
-----------------

6074 6075 6076
- Issue #1683368: object.__new__ and object.__init__ raise a TypeError if they
  are passed arguments and their complementary method is not overridden.

6077 6078 6079
- Issue #14378: Fix compiling ast.ImportFrom nodes with a "__future__" string as
  the module name that was not interned.

6080 6081
- Issue #14331: Use significantly less stack space when importing modules by
  allocating path buffers on the heap instead of the stack.
6082

6083 6084 6085
- Issue #14334: Prevent in a segfault in type.__getattribute__ when it was not
  passed strings.

6086 6087 6088
- Issue #1469629: Allow cycles through an object's __dict__ slot to be
  collected. (For example if ``x.__dict__ is x``).

6089 6090 6091
- Issue #14205: dict lookup raises a RuntimeError if the dict is modified
  during a lookup.

6092 6093 6094
- Issue #14220: When a generator is delegating to another iterator with the
  yield from syntax, it needs to have its ``gi_running`` flag set to True.

6095 6096 6097
- Issue #14435: Remove dedicated block allocator from floatobject.c and rely
  on the PyObject_Malloc() api like all other objects.

6098 6099
- Issue #14471: Fix a possible buffer overrun in the winreg module.

6100 6101
- Issue #14288: Allow the serialization of builtin iterators

Georg Brandl's avatar
Georg Brandl committed
6102 6103 6104
Library
-------

6105 6106 6107
- Issue #14300: Under Windows, sockets created using socket.dup() now allow
  overlapped I/O.  Patch by sbt.

6108 6109 6110
- Issue #13872: socket.detach() now marks the socket closed (as mirrored
  in the socket repr()).  Patch by Matt Joiner.

6111 6112 6113
- Issue #14406: Fix a race condition when using ``concurrent.futures.wait(
  return_when=ALL_COMPLETED)``.  Patch by Matt Joiner.

Andrew Svetlov's avatar
Andrew Svetlov committed
6114
- Issue #5136: deprecate old, unused functions from tkinter.
6115

6116 6117 6118
- Issue #14416: syslog now defines the LOG_ODELAY and LOG_AUTHPRIV constants
  if they are defined in <syslog.h>.

6119 6120
- Issue #14295: Add unittest.mock

6121 6122 6123
- Issue #7652: Add --with-system-libmpdec option to configure for linking
  the _decimal module against an installed libmpdec.

6124 6125 6126
- Issue #14380: MIMEText now defaults to utf-8 when passed non-ASCII unicode
  with no charset specified.

6127 6128 6129 6130
- Issue #10340: asyncore - properly handle EINVAL in dispatcher constructor on
  OSX; avoid to call handle_connect in case of a disconnected socket which
  was not meant to connect.

6131 6132 6133 6134
- Issue #14204: The ssl module now has support for the Next Protocol
  Negotiation extension, if available in the underlying OpenSSL library.
  Patch by Colin Marc.

Georg Brandl's avatar
Georg Brandl committed
6135
- Issue #3035: Unused functions from tkinter are marked as pending deprecated.
6136

6137 6138 6139
- Issue #12757: Fix the skipping of doctests when python is run with -OO so
  that it works in unittest's verbose mode as well as non-verbose mode.

6140 6141
- Issue #7652: Integrate the decimal floating point libmpdec library to speed
  up the decimal module. Performance gains of the new C implementation are
6142
  between 10x and 100x, depending on the application.
6143

6144 6145 6146
- Issue #14269: SMTPD now conforms to the RFC and requires a HELO command
  before MAIL, RCPT, or DATA.

6147 6148 6149
- Issue #13694: asynchronous connect in asyncore.dispatcher does not set addr
  attribute.

6150 6151
- Issue #14344: fixed the repr of email.policy objects.

R David Murray's avatar
R David Murray committed
6152 6153 6154
- Issue #11686: Added missing entries to email package __all__ lists
  (mostly the new Bytes classes).

6155 6156 6157
- Issue #14335: multiprocessing's custom Pickler subclass now inherits from
  the C-accelerated implementation.  Patch by sbt.

6158 6159
- Issue #10484: Fix the CGIHTTPServer's PATH_INFO handling problem.

6160 6161
- Issue #11199: Fix the with urllib which hangs on particular ftp urls.

6162 6163
- Improve the memory utilization and speed of functools.lru_cache.

6164 6165 6166 6167
- Issue #14222: Use the new time.steady() function instead of time.time() for
  timeout in queue and threading modules to not be affected of system time
  update.

6168 6169
- Issue #13248: Remove lib2to3.pytree.Base.get_prefix/set_prefix.

6170 6171 6172 6173 6174
- Issue #14234: CVE-2012-0876: Randomize hashes of xml attributes in the hash
  table internal to the pyexpat module's copy of the expat library to avoid a
  denial of service due to hash collisions.  Patch by David Malcolm with some
  modifications by the expat project.

6175 6176 6177
- Issue #12818: format address no longer needlessly \ escapes ()s in names when
  the name ends up being quoted.

6178 6179 6180
- Issue #14062: BytesGenerator now correctly folds Header objects,
  including using linesep when folding.

6181 6182 6183 6184
- Issue #13839: When invoked on the command-line, the pstats module now
  accepts several filenames of profile stat files and merges them all.
  Patch by Matt Joiner.

6185 6186 6187
- Issue #14291: Email now defaults to utf-8 for non-ASCII unicode headers
  instead of raising an error.  This fixes a regression relative to 2.7.

6188 6189
- Issue #989712: Support using Tk without a mainloop.

6190 6191
- Issue #3835: Refuse to use unthreaded Tcl in threaded Python.

6192 6193
- Issue #2843: Add new Tk API to Tkinter.

6194 6195 6196
- Issue #14184: Increase the default stack size for secondary threads on
  Mac OS X to avoid interpreter crashes when using threads on 10.7.

6197 6198 6199 6200
- Issue #14180: datetime.date.fromtimestamp(),
  datetime.datetime.fromtimestamp() and datetime.datetime.utcfromtimestamp()
  now raise an OSError instead of ValueError if localtime() or gmtime() failed.

6201 6202 6203 6204 6205 6206 6207 6208 6209
- Issue #14180: time.ctime(), gmtime(), time.localtime(),
  datetime.date.fromtimestamp(), datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now raises an OverflowError, instead of
  a ValueError, if the timestamp does not fit in time_t.

- Issue #14180: datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now round microseconds towards zero
  instead of rounding to nearest with ties going away from zero.

6210 6211
- Issue #10543: Fix unittest test discovery with Jython bytecode files.

6212 6213 6214 6215
- Issue #1178863: Separate initialisation from setting when initializing
  Tkinter.Variables; harmonize exceptions to ValueError; only delete variables
  that have not been deleted; assert that variable names are strings.

6216 6217 6218
- Issue #14104: Implement time.monotonic() on Mac OS X, patch written by
  Nicholas Riley.

6219 6220
- Issue #13394: the aifc module now uses warnings.warn() to signal warnings.

6221 6222 6223
- Issue #14252: Fix subprocess.Popen.terminate() to not raise an error under
  Windows when the child process has already exited.

6224 6225 6226 6227
- Issue #14223: curses.addch() is no more limited to the range 0-255 when the
  Python curses is not linked to libncursesw. It was a regression introduced
  in Python 3.3a1.

6228
- Issue #14168: Check for presence of Element._attrs in minidom before
6229 6230
  accessing it.

6231 6232 6233 6234
- Issue #12328: Fix multiprocessing's use of overlapped I/O on Windows.
  Also, add a multiprocessing.connection.wait(rlist, timeout=None) function
  for polling multiple objects at once.  Patch by sbt.

6235 6236 6237 6238
- Issue #14007: Accept incomplete TreeBuilder objects (missing start, end,
  data or close method) for the Python implementation as well.
  Drop the no-op TreeBuilder().xml() method from the C implementation.

6239 6240 6241
- Issue #14210: pdb now has tab-completion not only for command names, but
  also for their arguments, wherever possible.

6242 6243 6244
- Issue #14310: Sockets can now be with other processes on Windows using
  the api socket.socket.share() and socket.fromshare().

6245 6246 6247
- Issue #10576: The gc module now has a 'callbacks' member that will get
  called when garbage collection takes place.

6248 6249 6250
Build
-----

6251 6252
- Issue #14557: Fix extensions build on HP-UX. Patch by Adi Roiban.

6253 6254
- Issue #14387: Do not include accu.h from Python.h.

6255 6256 6257
- Issue #14359: Only use O_CLOEXEC in _posixmodule.c if it is defined.
  Based on patch from Hervé Coatanhay.

6258
- Issue #14321: Do not run pgen during the build if files are up to date.
6259

6260 6261 6262 6263 6264
Documentation
-------------

- Issue #14034: added the argparse tutorial.

6265 6266
- Issue #14324: Fix configure tests for cross builds.

6267
- Issue #14327: Call AC_CANONICAL_HOST in configure.ac and check in
6268
  config.{guess,sub}. Don't use uname calls for cross builds.
6269

Benjamin Peterson's avatar
Benjamin Peterson committed
6270 6271 6272
Extension Modules
-----------------

6273 6274 6275
- Issue #9041: An issue in ctypes.c_longdouble, ctypes.c_double, and
  ctypes.c_float that caused an incorrect exception to be returned in the
  case of overflow has been fixed.
6276

Benjamin Peterson's avatar
Benjamin Peterson committed
6277 6278 6279
- Issue #14212: The re module didn't retain a reference to buffers it was
  scanning, resulting in segfaults.

6280 6281 6282
- Issue #14259: The finditer() method of re objects did not take any
  keyword arguments, contrary to the documentation.

6283 6284
- Issue #10142: Support for SEEK_HOLE/SEEK_DATA (for example, under ZFS).

6285 6286 6287
Tests
-----

6288 6289
- Issue #14442: Add missing errno import in test_smtplib.

6290 6291
- Issue #8315: (partial fix) python -m unittest test.test_email now works.

Georg Brandl's avatar
Georg Brandl committed
6292

Georg Brandl's avatar
Georg Brandl committed
6293 6294
What's New in Python 3.3.0 Alpha 1?
===================================
Georg Brandl's avatar
Georg Brandl committed
6295

Georg Brandl's avatar
Georg Brandl committed
6296
*Release date: 05-Mar-2012*
Georg Brandl's avatar
Georg Brandl committed
6297

6298 6299 6300
Core and Builtins
-----------------

6301 6302 6303
- Issue #14172: Fix reference leak when marshalling a buffer-like object
  (other than a bytes object).

6304 6305 6306
- Issue #13521: dict.setdefault() now does only one lookup for the given key,
  making it "atomic" for many purposes.  Patch by Filip Gruszczyński.

6307 6308 6309 6310
- PEP 409, Issue #6210: "raise X from None" is now supported as a means of
  suppressing the display of the chained exception context. The chained
  context still remains available as the __context__ attribute.

6311 6312 6313 6314 6315 6316 6317 6318 6319 6320 6321 6322 6323 6324 6325 6326 6327
- Issue #10181: New memoryview implementation fixes multiple ownership
  and lifetime issues of dynamically allocated Py_buffer members (#9990)
  as well as crashes (#8305, #7433). Many new features have been added
  (See whatsnew/3.3), and the documentation has been updated extensively.
  The ndarray test object from _testbuffer.c implements all aspects of
  PEP-3118, so further development towards the complete implementation
  of the PEP can proceed in a test-driven manner.

  Thanks to Nick Coghlan, Antoine Pitrou and Pauli Virtanen for review
  and many ideas.

- Issue #12834: Fix incorrect results of memoryview.tobytes() for
  non-contiguous arrays.

- Issue #5231: Introduce memoryview.cast() method that allows changing
  format and shape without making a copy of the underlying memory.

6328 6329 6330
- Issue #14084: Fix a file descriptor leak when importing a module with a
  bad encoding.

Benjamin Peterson's avatar
Benjamin Peterson committed
6331 6332
- Upgrade Unicode data to Unicode 6.1.

6333 6334 6335
- Issue #14040: Remove rarely used file name suffixes for C extensions
  (under POSIX mainly).

6336 6337 6338
- Issue #14051: Allow arbitrary attributes to be set of classmethod and
  staticmethod.

6339 6340 6341
- Issue #13703: oCERT-2011-003: Randomize hashes of str and bytes to protect
  against denial of service attacks due to hash collisions within the dict and
  set types.  Patch by David Malcolm, based on work by Victor Stinner.
6342

6343 6344 6345
- Issue #13020: Fix a reference leak when allocating a structsequence object
  fails.  Patch by Suman Saha.

6346 6347
- Issue #13908: Ready types returned from PyType_FromSpec.

6348 6349 6350
- Issue #11235: Fix OverflowError when trying to import a source file whose
  modification time doesn't fit in a 32-bit timestamp.

6351 6352 6353
- Issue #12705: A SyntaxError exception is now raised when attempting to
  compile multiple statements as a single interactive statement.

6354 6355 6356
- Fix the builtin module initialization code to store the init function for
  future reinitialization.

6357 6358 6359 6360 6361
- Issue #8052: The posix subprocess module would take a long time closing
  all possible file descriptors in the child process rather than just open
  file descriptors.  It now closes only the open fds if possible for the
  default close_fds=True behavior.

6362 6363 6364
- Issue #13629: Renumber the tokens in token.h so that they match the indexes
  into _PyParser_TokenNames.

6365 6366
- Issue #13752: Add a casefold() method to str.

6367 6368 6369
- Issue #13761: Add a "flush" keyword argument to the print() function,
  used to ensure flushing the output stream.

6370 6371 6372 6373
- Issue #13645: pyc files now contain the size of the corresponding source
  code, to avoid timestamp collisions (especially on filesystems with a low
  timestamp resolution) when checking for freshness of the bytecode.

6374 6375 6376 6377
- PEP 380, Issue #11682: Add "yield from <x>" to support easy delegation to
  subgenerators (initial patch by Greg Ewing, integration into 3.3 by
  Renaud Blanch, Ryan Kelly, Zbigniew Jędrzejewski-Szmek and Nick Coghlan)

6378 6379 6380
- Issue #13748: Raw bytes literals can now be written with the ``rb`` prefix
  as well as ``br``.

6381 6382
- Issue #12736: Use full unicode case mappings for upper, lower, and title case.

6383 6384
- Issue #12760: Add a create mode to open(). Patch by David Townshend.

6385 6386
- Issue #13738: Simplify implementation of bytes.lower() and bytes.upper().

6387 6388 6389
- Issue #13577: Built-in methods and functions now have a __qualname__.
  Patch by sbt.

6390 6391 6392
- Issue #6695: Full garbage collection runs now clear the freelist of set
  objects.  Initial patch by Matthias Troffaes.

6393 6394 6395
- Fix OSError.__init__ and OSError.__new__ so that each of them can be
  overriden and take additional arguments (followup to issue #12555).

6396 6397 6398 6399
- Fix the fix for issue #12149: it was incorrect, although it had the side
  effect of appearing to resolve the issue.  Thanks to Mark Shannon for
  noticing.

6400 6401 6402
- Issue #13505: Pickle bytes objects in a way that is compatible with
  Python 2 when using protocols <= 2.

6403 6404 6405
- Issue #11147: Fix an unused argument in _Py_ANNOTATE_MEMORY_ORDER.  (Fix
  given by Campbell Barton).

6406 6407 6408 6409
- Issue #13503: Use a more efficient reduction format for bytearrays with
  pickle protocol >= 3.  The old reduction format is kept with older protocols
  in order to allow unpickling under Python 2.  Patch by Irmen de Jong.

6410 6411 6412 6413
- Issue #7111: Python can now be run without a stdin, stdout or stderr
  stream.  It was already the case with Python 2.  However, the corresponding
  sys module entries are now set to None (instead of an unusable file object).

6414 6415 6416 6417
- Issue #11849: Ensure that free()d memory arenas are really released
  on POSIX systems supporting anonymous memory mappings.  Patch by
  Charles-François Natali.

6418 6419
- PEP 3155 / issue #13448: Qualified name for classes and functions.

6420 6421 6422
- Issue #13436: Fix a bogus error message when an AST object was passed
  an invalid integer value.

6423 6424 6425
- Issue #13411: memoryview objects are now hashable when the underlying
  object is hashable.

6426 6427 6428 6429
- Issue #13338: Handle all enumerations in _Py_ANNOTATE_MEMORY_ORDER
  to allow compiling extension modules with -Wswitch-enum on gcc.
  Initial patch by Floris Bruynooghe.

6430 6431 6432
- Issue #10227: Add an allocation cache for a single slice object.  Patch by
  Stefan Behnel.

6433 6434 6435
- Issue #13393: BufferedReader.read1() now asks the full requested size to
  the raw stream instead of limiting itself to the buffer size.

6436 6437
- Issue #13392: Writing a pyc file should now be atomic under Windows as well.

6438 6439 6440
- Issue #13333: The UTF-7 decoder now accepts lone surrogates (the encoder
  already accepts them).

6441 6442 6443 6444
- Issue #13389: Full garbage collection passes now clear the freelists for
  list and dict objects.  They already cleared other freelists in the
  interpreter.

6445
- Issue #13327: Remove the need for an explicit None as the second argument
Brian Curtin's avatar
Brian Curtin committed
6446 6447 6448
  to os.utime, os.lutimes, os.futimes, os.futimens, os.futimesat, in
  order to update to the current time. Also added keyword argument
  handling to os.utimensat in order to remove the need for explicit None.
6449

6450 6451 6452
- Issue #13350: Simplify some C code by replacing most usages of
  PyUnicode_Format by PyUnicode_FromFormat.

6453 6454 6455
- Issue #13342: input() used to ignore sys.stdin's and sys.stdout's unicode
  error handler in interactive mode (when calling into PyOS_Readline()).

6456 6457
- Issue #9896: Add start, stop, and step attributes to range objects.

6458
- Issue #13343: Fix a SystemError when a lambda expression uses a global
Georg Brandl's avatar
Georg Brandl committed
6459 6460
  variable in the default value of a keyword-only argument: ``lambda *,
  arg=GLOBAL_NAME: None``
6461

6462 6463 6464
- Issue #12797: Added custom opener parameter to builtin open() and
  FileIO.open().

6465 6466 6467
- Issue #10519: Avoid unnecessary recursive function calls in
  setobject.c.

6468 6469
- Issue #10363: Deallocate global locks in Py_Finalize().

6470 6471 6472
- Issue #13018: Fix reference leaks in error paths in dictobject.c.
  Patch by Suman Saha.

6473 6474 6475 6476
- Issue #13201: Define '==' and '!=' to compare range objects based on
  the sequence of values they define (instead of comparing based on
  object identity).

6477 6478 6479 6480
- Issue #1294232: In a few cases involving metaclass inheritance, the
  interpreter would sometimes invoke the wrong metaclass when building a new
  class object. These cases now behave correctly. Patch by Daniel Urban.

6481
- Issue #12753: Add support for Unicode name aliases and named sequences.
Georg Brandl's avatar
Georg Brandl committed
6482 6483
  Both ``unicodedata.lookup()`` and '\N{...}' now resolve aliases,
  and ``unicodedata.lookup()`` resolves named sequences too.
6484

6485 6486 6487 6488
- Issue #12170: The count(), find(), rfind(), index() and rindex() methods
  of bytes and bytearray objects now accept an integer between 0 and 255
  as their first argument.  Patch by Petri Lehtinen.

6489 6490 6491
- Issue #12604: VTRACE macro expanded to no-op in _sre.c to avoid compiler
  warnings. Patch by Josh Triplett and Petri Lehtinen.

6492 6493 6494 6495
- Issue #12281: Rewrite the MBCS codec to handle correctly replace and ignore
  error handlers on all Windows versions. The MBCS codec is now supporting all
  error handlers, instead of only replace to encode and ignore to decode.

6496 6497 6498 6499
- Issue #13188: When called without an explicit traceback argument,
  generator.throw() now gets the traceback from the passed exception's
  ``__traceback__`` attribute.  Patch by Petri Lehtinen.

6500 6501
- Issue #13146: Writing a pyc file is now atomic under POSIX.

6502 6503 6504 6505
- Issue #7833: Extension modules built using distutils on Windows will no
  longer include a "manifest" to prevent them failing at import time in some
  embedded situations.

6506 6507
- PEP 3151 / issue #12555: reworking the OS and IO exception hierarchy.

6508
- Add internal API for static strings (_Py_identifier et al.).
6509

6510 6511 6512 6513
- Issue #13063: the Windows error ERROR_NO_DATA (numbered 232 and described
  as "The pipe is being closed") is now mapped to POSIX errno EPIPE
  (previously EINVAL).

6514 6515 6516
- Issue #12911: Fix memory consumption when calculating the repr() of huge
  tuples or lists.

Martin v. Löwis's avatar
Martin v. Löwis committed
6517 6518
- PEP 393: flexible string representation. Thanks to Torsten Becker for the
  initial implementation, and Victor Stinner for various bug fixes.
Martin v. Löwis's avatar
Martin v. Löwis committed
6519

6520 6521 6522
- Issue #14081: The 'sep' and 'maxsplit' parameter to str.split, bytes.split,
  and bytearray.split may now be passed as keyword arguments.

6523 6524 6525 6526
- Issue #13012: The 'keepends' parameter to str.splitlines may now be passed
  as a keyword argument:  "my_string.splitlines(keepends=True)".  The same
  change also applies to bytes.splitlines and bytearray.splitlines.

6527 6528 6529 6530
- Issue #7732: Don't open a directory as a file anymore while importing a
  module. Ignore the direcotry if its name matchs the module name (e.g.
  "__init__.py") and raise a ImportError instead.

6531 6532 6533
- Issue #13021: Missing decref on an error path.  Thanks to Suman Saha for
  finding the bug and providing a patch.

6534 6535 6536
- Issue #12973: Fix overflow checks that relied on undefined behaviour in
  list_repeat (listobject.c) and islice_next (itertoolsmodule.c).  These bugs
  caused test failures with recent versions of Clang.
6537

6538 6539 6540
- Issue #12904: os.utime, os.futimes, os.lutimes, and os.futimesat now write
  atime and mtime with nanosecond precision on modern POSIX platforms.

6541 6542 6543
- Issue #12802: the Windows error ERROR_DIRECTORY (numbered 267) is now
  mapped to POSIX errno ENOTDIR (previously EINVAL).

6544 6545 6546
- Issue #9200: The str.is* methods now work with strings that contain non-BMP
  characters even in narrow Unicode builds.

6547 6548 6549
- Issue #12791: Break reference cycles early when a generator exits with
  an exception.

6550 6551
- Issue #12773: Make __doc__ mutable on user-defined classes.

6552
- Issue #12766: Raise a ValueError when creating a class with a class variable
6553 6554
  that conflicts with a name in __slots__.

6555 6556 6557
- Issue #12266: Fix str.capitalize() to correctly uppercase/lowercase
  titlecased and cased non-letter characters.

6558 6559 6560
- Issue #12732: In narrow unicode builds, allow Unicode identifiers which fall
  outside the BMP.

6561 6562
- Issue #12575: Validate user-generated AST before it is compiled.

6563 6564
- Make type(None), type(Ellipsis), and type(NotImplemented) callable. They
  return the respective singleton instances.
6565

Benjamin Peterson's avatar
Benjamin Peterson committed
6566
- Forbid summing bytes with sum().
6567

6568 6569 6570
- Verify the types of AST strings and identifiers provided by the user before
  compiling them.

6571 6572 6573 6574
- Issue #12647: The None object now has a __bool__() method that returns False.
  Formerly, bool(None) returned False only because of special case logic
  in PyObject_IsTrue().

6575 6576 6577 6578
- Issue #12579: str.format_map() now raises a ValueError if used on a
  format string that contains positional fields. Initial patch by
  Julian Berman.

6579 6580
- Issue #10271: Allow warnings.showwarning() be any callable.

6581 6582
- Issue #11627: Fix segfault when __new__ on a exception returns a
  non-exception class.
6583

Georg Brandl's avatar
Georg Brandl committed
6584
- Issue #12149: Update the method cache after a type's dictionary gets
6585 6586 6587 6588 6589
  cleared by the garbage collector.  This fixes a segfault when an instance
  and its type get caught in a reference cycle, and the instance's
  deallocator calls one of the methods on the type (e.g. when subclassing
  IOBase).  Diagnosis and patch by Davide Rizzo.

6590
- Issue #9611, Issue #9015: FileIO.read() clamps the length to INT_MAX on Windows.
6591

6592 6593 6594
- Issue #9642: Uniformize the tests on the availability of the mbcs codec, add
  a new HAVE_MBCS define.

6595 6596 6597 6598 6599
- Issue #9642: Fix filesystem encoding initialization: use the ANSI code page
  on Windows if the mbcs codec is not available, and fail with a fatal error if
  we cannot get the locale encoding (if nl_langinfo(CODESET) is not available)
  instead of using UTF-8.

6600 6601 6602
- When a generator yields, do not retain the caller's exception state on the
  generator.

6603
- Issue #12475: Prevent generators from leaking their exception state into the
Benjamin Peterson's avatar
add '  
Benjamin Peterson committed
6604
  caller's frame as they return for the last time.
6605

6606 6607 6608
- Issue #12291: You can now load multiple marshalled objects from a stream,
  with other data interleaved between marshalled objects.

6609 6610 6611 6612
- Issue #12356: When required positional or keyword-only arguments are not
  given, produce a informative error message which includes the name(s) of the
  missing arguments.

6613
- Issue #12370: Fix super with no arguments when __class__ is overriden in the
6614 6615
  class body.

6616 6617 6618
- Issue #12084: os.stat on Windows now works properly with relative symbolic
  links when called from any directory.

6619 6620 6621
- Loosen type restrictions on the __dir__ method. __dir__ can now return any
  sequence, which will be converted to a list and sorted by dir().

6622 6623 6624
- Issue #12265: Make error messages produced by passing an invalid set of
  arguments to a function more informative.

Benjamin Peterson's avatar
Benjamin Peterson committed
6625 6626 6627
- Issue #12225: Still allow Python to build if Python is not in its hg repo or
  mercurial is not installed.

6628
- Issue #1195: my_fgets() now always clears errors before calling fgets(). Fix
6629 6630 6631
  the following case: sys.stdin.read() stopped with CTRL+d (end of file),
  raw_input() interrupted by CTRL+c.

6632 6633
- Issue #12216: Allow unexpected EOF errors to happen on any line of the file.

6634 6635 6636
- Issue #12199: The TryExcept and TryFinally and AST nodes have been unified
  into a Try node.

6637 6638 6639 6640 6641
- Issue #9670: Increase the default stack size for secondary threads on
  Mac OS X and FreeBSD to reduce the chances of a crash instead of a
  "maximum recursion depth" RuntimeError exception.
  (patch by Ronald Oussoren)

6642 6643 6644
- Issue #12106: The use of the multiple-with shorthand syntax is now reflected
  in the AST.

6645 6646 6647
- Issue #12190: Try to use the same filename object when compiling unmarshalling
  a code objects in the same file.

6648 6649 6650
- Issue #12166: Move implementations of dir() specialized for various types into
  the __dir__() methods of those types.

6651
- Issue #5715: In socketserver, close the server socket in the child process.
6652

Benjamin Peterson's avatar
Benjamin Peterson committed
6653 6654 6655
- Correct lookup of __dir__ on objects. Among other things, this causes errors
  besides AttributeError found on lookup to be propagated.

6656 6657 6658
- Issue #12060: Use sig_atomic_t type and volatile keyword in the signal
  module. Patch written by Charles-François Natali.

6659 6660
- Issue #1746656: Added the if_nameindex, if_indextoname, if_nametoindex
  methods to the socket module.
6661

6662 6663 6664 6665
- Issue #12044: Fixed subprocess.Popen when used as a context manager to
  wait for the process to end when exiting the context to avoid unintentionally
  leaving zombie processes around.

6666 6667 6668
- Issue #1195: Fix input() if it is interrupted by CTRL+d and then CTRL+c,
  clear the end-of-file indicator after CTRL+d.

6669 6670 6671 6672
- Issue #1856: Avoid crashes and lockups when daemon threads run while the
  interpreter is shutting down; instead, these threads are now killed when
  they try to take the GIL.

6673 6674 6675
- Issue #9756: When calling a method descriptor or a slot wrapper descriptor,
  the check of the object type doesn't read the __class__ attribute anymore.
  Fix a crash if a class override its __class__ attribute (e.g. a proxy of the
6676
  str type). Patch written by Andreas Stührk.
6677

6678 6679 6680 6681
- Issue #10517: After fork(), reinitialize the TLS used by the PyGILState_*
  APIs, to avoid a crash with the pthread implementation in RHEL 5.  Patch
  by Charles-François Natali.

6682 6683 6684 6685
- Issue #10914: Initialize correctly the filesystem codec when creating a new
  subinterpreter to fix a bootstrap issue with codecs implemented in Python, as
  the ISO-8859-15 codec.

6686 6687 6688
- Issue #11918: OS/2 and VMS are no more supported because of the lack of
  maintainer.

6689 6690 6691
- Issue #6780: fix starts/endswith error message to mention that tuples are
  accepted too.

6692 6693 6694 6695
- Issue #5057: fix a bug in the peepholer that led to non-portable pyc files
  between narrow and wide builds while optimizing BINARY_SUBSCR on non-BMP
  chars (e.g. "\U00012345"[0]).

6696 6697 6698
- Issue #11845: Fix typo in rangeobject.c that caused a crash in
  compute_slice_indices.  Patch by Daniel Urban.

6699 6700 6701 6702 6703
- Issue #5673: Added a `timeout` keyword argument to subprocess.Popen.wait,
  subprocess.Popen.communicated, subprocess.call, subprocess.check_call, and
  subprocess.check_output.  If the blocking operation takes more than `timeout`
  seconds, the `subprocess.TimeoutExpired` exception is raised.

6704 6705 6706 6707
- Issue #11650: PyOS_StdioReadline() retries fgets() if it was interrupted
  (EINTR), for example if the program is stopped with CTRL+z on Mac OS X. Patch
  written by Charles-Francois Natali.

6708 6709
- Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.

6710 6711
- Issue #10785: Store the filename as Unicode in the Python parser.

6712 6713 6714
- Issue #11619: _PyImport_LoadDynamicModule() doesn't encode the path to bytes
  on Windows.

6715 6716 6717
- Issue #10998: Remove mentions of -Q, sys.flags.division_warning and
  Py_DivisionWarningFlag left over from Python 2.

6718 6719 6720
- Issue #11244: Remove an unnecessary peepholer check that was preventing
  negative zeros from being constant-folded properly.

6721 6722 6723 6724 6725 6726
- Issue #11395: io.FileIO().write() clamps the data length to 32,767 bytes on
  Windows if the file is a TTY to workaround a Windows bug. The Windows console
  returns an error (12: not enough space error) on writing into stdout if
  stdout mode is binary and the length is greater than 66,000 bytes (or less,
  depending on heap usage).

6727
- Issue #11320: fix bogus memory management in Modules/getpath.c, leading to
6728 6729
  a possible crash when calling Py_SetPath().

Gregory P. Smith's avatar
Gregory P. Smith committed
6730 6731 6732 6733
- Issue #11432: A bug was introduced in subprocess.Popen on posix systems with
  3.2.0 where the stdout or stderr file descriptor being the same as the stdin
  file descriptor would raise an exception. webbrowser.open would fail. fixed.

6734 6735 6736 6737
- Issue #9856: Change object.__format__ with a non-empty format string
  to be a DeprecationWarning. In 3.2 it was a PendingDeprecationWarning.
  In 3.4 it will be a TypeError.

6738 6739 6740 6741
- Issue #11244: The peephole optimizer is now able to constant-fold
  arbitrarily complex expressions.  This also fixes a 3.2 regression where
  operations involving negative numbers were not constant-folded.

6742 6743 6744
- Issue #11450: Don't truncate hg version info in Py_GetBuildInfo() when
  there are many tags (e.g. when using mq).  Patch by Nadeem Vawda.

6745 6746 6747
- Issue #11335: Fixed a memory leak in list.sort when the key function
  throws an exception.

6748 6749 6750 6751 6752
- Issue #8923: When a string is encoded to UTF-8 in strict mode, the result is
  cached into the object. Examples: str.encode(), str.encode('utf-8'),
  PyUnicode_AsUTF8String() and PyUnicode_AsEncodedString(unicode, "utf-8",
  NULL).

6753 6754 6755
- Issue #10829: Refactor PyUnicode_FromFormat(), use the same function to parse
  the format string in the 3 steps, fix crashs on invalid format strings.

6756 6757
- Issue #13007: whichdb should recognize gdbm 1.9 magic numbers.

6758 6759 6760
- Issue #11286: Raise a ValueError from calling PyMemoryView_FromBuffer with
  a buffer struct having a NULL data pointer.

6761 6762 6763
- Issue #11272: On Windows, input() strips '\r' (and not only '\n'), and
  sys.stdin uses universal newline (replace '\r\n' by '\n').

6764
- Issue #11828: startswith and endswith now accept None as slice index.
6765 6766
  Patch by Torsten Becker.

6767 6768 6769 6770
- Issue #11168: Remove filename debug variable from PyEval_EvalFrameEx().
  It encoded the Unicode filename to UTF-8, but the encoding fails on
  undecodable filename (on surrogate characters) which raises an unexpected
  UnicodeEncodeError on recursion limit.
6771

6772 6773 6774 6775
- Issue #11187: Remove bootstrap code (use ASCII) of
  PyUnicode_AsEncodedString(), it was replaced by a better fallback (use the
  locale encoding) in PyUnicode_EncodeFSDefault().

6776 6777
- Check for NULL result in PyType_FromSpec.

6778
- Issue #10516: New copy() and clear() methods for lists and bytearrays.
6779

6780 6781 6782
- Issue #11386: bytearray.pop() now throws IndexError when the bytearray is
  empty, instead of OverflowError.

6783 6784 6785
- Issue #12380: The rjust, ljust and center methods of bytes and bytearray
  now accept a bytearray argument.

6786 6787
Library
-------
6788

6789 6790 6791 6792
- Issue #14195: An issue that caused weakref.WeakSet instances to incorrectly
  return True for a WeakSet instance 'a' in both 'a < a' and 'a > a' has been
  fixed.

6793 6794 6795 6796
- Issue #14166: Pickler objects now have an optional ``dispatch_table``
  attribute which allows to set custom per-pickler reduction functions.
  Patch by sbt.

6797 6798 6799
- Issue #14177: marshal.loads() now raises TypeError when given an unicode
  string.  Patch by Guilherme Gonçalves.

6800 6801 6802
- Issue #13550: Remove the debug machinery from the threading module: remove
  verbose arguments from all threading classes and functions.

6803 6804 6805 6806 6807
- Issue #14159: Fix the len() of weak containers (WeakSet, WeakKeyDictionary,
  WeakValueDictionary) to return a better approximation when some objects
  are dead or dying.  Moreover, the implementation is now O(1) rather than
  O(n).

6808 6809 6810
- Issue #11841: Fix comparison bug with 'rc' versions in packaging.version.
  Patch by Filip Gruszczyński.

6811
- Issue #6884: Fix long-standing bugs with MANIFEST.in parsing in distutils
Éric Araujo's avatar
Éric Araujo committed
6812
  on Windows.  Also fixed in packaging.
6813

6814 6815 6816
- Issue #8033: sqlite3: Fix 64-bit integer handling in user functions
  on 32-bit architectures. Initial patch by Philippe Devalkeneer.

6817 6818
- HTMLParser is now able to handle slashes in the start tag.

6819 6820 6821
- Issue #13641: Decoding functions in the base64 module now accept ASCII-only
  unicode strings.  Patch by Catalin Iacob.

6822 6823 6824
- Issue #14043: Speed up importlib's _FileFinder by at least 8x, and add a
  new importlib.invalidate_caches() function.

6825 6826 6827
- Issue #14001: CVE-2012-0845: xmlrpc: Fix an endless loop in
  SimpleXMLRPCServer upon malformed POST request.

6828 6829
- Issue #13961: Move importlib over to using os.replace() for atomic renaming.

6830 6831 6832
- Do away with ambiguous level values (as suggested by PEP 328) in
  importlib.__import__() by raising ValueError when level < 0.

6833 6834
- Issue #2489: pty.spawn could consume 100% cpu when it encountered an EOF.

6835 6836
- Issue #13014: Fix a possible reference leak in SSLSocket.getpeercert().

6837 6838 6839
- Issue #13777: Add PF_SYSTEM sockets on OS X.
  Patch by Michael Goderbauer.

6840 6841 6842
- Issue #13015: Fix a possible reference leak in defaultdict.__repr__.
  Patch by Suman Saha.

6843 6844 6845
- Issue #1326113: distutils' and packaging's build_ext commands option now
  correctly parses multiple values (separated by whitespace or commas) given
  to their --libraries option.
6846

6847 6848 6849 6850
- Issue #10287: nntplib now queries the server's CAPABILITIES first before
  sending MODE READER, and only sends it if not already in READER mode.
  Patch by Hynek Schlawack.

6851 6852 6853
- Issue #13993: HTMLParser is now able to handle broken end tags when
  strict=False.

6854 6855 6856 6857
- Issue #13930: lib2to3 now supports writing converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.

6858 6859 6860 6861
- Issue #9750: Fix sqlite3.Connection.iterdump on tables and fields
  with a name that is a keyword or contains quotes. Patch by Marko
  Kohtala.

6862 6863 6864 6865
- Issue #10287: nntplib now queries the server's CAPABILITIES again after
  authenticating (since the result may change, according to RFC 4643).
  Patch by Hynek Schlawack.

6866 6867 6868 6869 6870 6871 6872 6873 6874 6875 6876 6877 6878
- Issue #13590: On OS X 10.7 and 10.6 with Xcode 4.2, building
  Distutils-based packages with C extension modules may fail because
  Apple has removed gcc-4.2, the version used to build python.org
  64-bit/32-bit Pythons.  If the user does not explicitly override
  the default C compiler by setting the CC environment variable,
  Distutils will now attempt to compile extension modules with clang
  if gcc-4.2 is required but not found. Also as a convenience, if
  the user does explicitly set CC, substitute its value as the default
  compiler in the Distutils LDSHARED configuration variable for OS X.
  (Note, the python.org 32-bit-only Pythons use gcc-4.0 and the 10.4u
  SDK, neither of which are available in Xcode 4.  This change does not
  attempt to override settings to support their use with Xcode 4.)

6879 6880 6881
- Issue #13960: HTMLParser is now able to handle broken comments when
  strict=False.

6882
- When '' is a path (e.g. in sys.path), make sure __file__ uses the current
Brett Cannon's avatar
Brett Cannon committed
6883
  working directory instead of '' in importlib.
6884

6885 6886 6887 6888
- Issue #13609: Add two functions to query the terminal size:
  os.get_terminal_size (low level) and shutil.get_terminal_size (high level).
  Patch by Zbigniew Jędrzejewski-Szmek.

6889 6890 6891
- Issue #13845: On Windows, time.time() now uses GetSystemTimeAsFileTime()
  instead of ftime() to have a resolution of 100 ns instead of 1 ms (the clock
  accuracy is between 0.5 ms and 15 ms).
6892

6893 6894
- Issue #13846: Add time.monotonic(), monotonic clock.

6895 6896 6897 6898 6899
- Issue #8184: multiprocessing: On Windows, don't set SO_REUSEADDR on
  Connection sockets, and set FILE_FLAG_FIRST_PIPE_INSTANCE on named pipes, to
  make sure two listeners can't bind to the same socket/pipe (or any existing
  socket/pipe).

6900 6901 6902
- Issue #10811: Fix recursive usage of cursors. Instead of crashing,
  raise a ProgrammingError now.

6903 6904 6905
- Issue #13734: Add os.fwalk(), a directory walking function yielding file
  descriptors.

6906 6907
- Issue #2945: Make the distutils upload command aware of bdist_rpm products.

6908 6909
- Issue #13712: pysetup create should not convert package_data to extra_files.

6910 6911
- Issue #11805: package_data in setup.cfg should allow more than one value.

6912 6913
- Issue #13676: Handle strings with embedded zeros correctly in sqlite3.

6914 6915 6916
- Issue #8828: Add new function os.replace(), for cross-platform renaming
  with overwriting.

6917 6918 6919
- Issue #13848: open() and the FileIO constructor now check for NUL
  characters in the file name.  Patch by Hynek Schlawack.

6920 6921 6922
- Issue #13806: The size check in audioop decompression functions was too
  strict and could reject valid compressed data.  Patch by Oleg Plakhotnyuk.

6923 6924 6925
- Issue #13812: When a multiprocessing Process child raises an exception,
  flush stderr after printing the exception traceback.

6926 6927 6928
- Issue #13885: CVE-2011-3389: the _ssl module would always disable the CBC
  IV attack countermeasure.

6929 6930
- Issue #13847: time.localtime() and time.gmtime() now raise an OSError instead
  of ValueError on failure. time.ctime() and time.asctime() now raises an
6931 6932
  OSError if localtime() failed. time.clock() now raises a RuntimeError if the
  processor time used is not available or its value cannot be represented
6933

6934 6935 6936 6937
- Issue #13772: In os.symlink() under Windows, do not try to guess the link
  target's type (file or directory).  The detection was buggy and made the
  call non-atomic (therefore prone to race conditions).

6938
- Issue #6631: Disallow relative file paths in urllib urlopen methods.
6939

6940 6941 6942
- Issue #13722: Avoid silencing ImportErrors when initializing the codecs
  registry.

6943 6944 6945
- Issue #13781: Fix GzipFile bug that caused an exception to be raised when
  opening for writing using a fileobj returned by os.fdopen().

6946 6947 6948
- Issue #13803: Under Solaris, distutils doesn't include bitness
  in the directory name.

6949 6950
- Issue #10278: Add time.wallclock() function, monotonic clock.

6951 6952 6953
- Issue #13809: Fix regression where bz2 module wouldn't work when threads are
  disabled. Original patch by Amaury Forgeot d'Arc.

6954 6955 6956
- Issue #13589: Fix some serialization primitives in the aifc module.
  Patch by Oleg Plakhotnyuk.

6957 6958 6959
- Issue #13642: Unquote before b64encoding user:password during Basic
  Authentication. Patch contributed by Joonas Kuorilehto.

6960 6961 6962 6963
- Issue #12364: Fix a hang in concurrent.futures.ProcessPoolExecutor.
  The hang would occur when retrieving the result of a scheduled future after
  the executor had been shut down.

6964 6965 6966
- Issue #13502: threading: Fix a race condition in Event.wait() that made it
  return False when the event was set and cleared right after.

6967 6968 6969 6970 6971
- Issue #9993: When the source and destination are on different filesystems,
  and the source is a symlink, shutil.move() now recreates a symlink on the
  destination instead of copying the file contents.  Patch by Jonathan Niehof
  and Hynek Schlawack.

6972 6973
- Issue #12926: Fix a bug in tarfile's link extraction.

6974 6975
- Issue #13696: Fix the 302 Relative URL Redirection problem.

6976 6977 6978
- Issue #13636: Weak ciphers are now disabled by default in the ssl module
  (except when SSLv2 is explicitly asked for).

6979 6980 6981 6982 6983
- Issue #12715: Add an optional symlinks argument to shutil functions
  (copyfile, copymode, copystat, copy, copy2).  When that parameter is
  true, symlinks aren't dereferenced and the operation instead acts on the
  symlink itself (or creates one, if relevant).  Patch by Hynek Schlawack.

6984 6985
- Add a flags parameter to select.epoll.

6986 6987 6988
- Issue #13626: Add support for SSL Diffie-Hellman key exchange, through the
  SSLContext.load_dh_params() method and the ssl.OP_SINGLE_DH_USE option.

6989 6990
- Issue #11006: Don't issue low level warning in subprocess when pipe2() fails.

6991
- Issue #13620: Support for Chrome browser in webbrowser.  Patch contributed
6992 6993
  by Arnaud Calmettes.

6994 6995 6996
- Issue #11829: Fix code execution holes in inspect.getattr_static for
  metaclasses with metaclasses. Patch by Andreas Stührk.

6997 6998 6999
- Issue #12708: Add starmap() and starmap_async() methods (similar to
  itertools.starmap()) to multiprocessing.Pool.  Patch by Hynek Schlawack.

7000 7001
- Issue #1785: Fix inspect and pydoc with misbehaving descriptors.

7002 7003 7004
- Issue #13637: "a2b" functions in the binascii module now accept ASCII-only
  unicode strings.

7005 7006
- Issue #13634: Add support for querying and disabling SSL compression.

7007 7008 7009 7010
- Issue #13627: Add support for SSL Elliptic Curve-based Diffie-Hellman
  key exchange, through the SSLContext.set_ecdh_curve() method and the
  ssl.OP_SINGLE_ECDH_USE option.

7011 7012 7013 7014
- Issue #13635: Add ssl.OP_CIPHER_SERVER_PREFERENCE, so that SSL servers
  choose the cipher based on their own preferences, rather than on the
  client's.

7015
- Issue #11813: Fix inspect.getattr_static for modules. Patch by Andreas
7016 7017
  Stührk.

7018 7019 7020
- Issue #7502: Fix equality comparison for DocTestCase instances.  Patch by
  Cédric Krier.

7021 7022 7023
- Issue #11870: threading: Properly reinitialize threads internal locks and
  condition variables to avoid deadlocks in child processes.

7024 7025 7026
- Issue #8035: urllib: Fix a bug where the client could remain stuck after a
  redirection or an error.

7027 7028 7029
- Issue #13560: os.strerror() now uses the current locale encoding instead of
  UTF-8.

7030 7031 7032 7033
- Issue #8373: The filesystem path of AF_UNIX sockets now uses the filesystem
  encoding and the surrogateescape error handler, rather than UTF-8.  Patch
  by David Watson.

7034 7035 7036
- Issue #10350: Read and save errno before calling a function which might
  overwrite it.  Original patch by Hallvard B Furuseth.

7037 7038
- Issue #11610: Introduce a more general way to declare abstract properties.

7039 7040 7041
- Issue #13591: A bug in importlib has been fixed that caused import_module
  to load a module twice.

7042 7043 7044 7045
- Issue #13449 sched.scheduler.run() method has a new "blocking" parameter which
  when set to False makes run() execute the scheduled events due to expire
  soonest (if any) and then return.  Patch by Giampaolo Rodolà.

7046
- Issue #8684 sched.scheduler class can be safely used in multi-threaded
7047
  environments.  Patch by Josiah Carlson and Giampaolo Rodolà.
7048

7049 7050
- Alias resource.error to OSError ala PEP 3151.

7051 7052
- Issue #5689: Add support for lzma compression to the tarfile module.

7053 7054 7055 7056 7057
- Issue #13248: Turn 3.2's PendingDeprecationWarning into 3.3's
  DeprecationWarning.  It covers 'cgi.escape', 'importlib.abc.PyLoader',
  'importlib.abc.PyPycLoader', 'nntplib.NNTP.xgtitle', 'nntplib.NNTP.xpath',
  and private attributes of 'smtpd.SMTPChannel'.

7058
- Issue #5905, Issue #13560: time.strftime() is now using the current locale
7059
  encoding, instead of UTF-8, if the wcsftime() function is not available.
7060

7061 7062 7063
- Issue #13464: Add a readinto() method to http.client.HTTPResponse.  Patch
  by Jon Kuhn.

7064 7065 7066
- tarfile.py: Correctly detect bzip2 compressed streams with blocksizes
  other than 900k.

7067 7068
- Issue #13439: Fix many errors in turtle docstrings.

7069
- Issue #6715: Add a module 'lzma' for compression using the LZMA algorithm.
7070
  Thanks to Per Øyvind Karlsen for the initial implementation.
7071

7072 7073 7074
- Issue #13487: Make inspect.getmodule robust against changes done to
  sys.modules while it is iterating over it.

7075 7076 7077
- Issue #12618: Fix a bug that prevented py_compile from creating byte
  compiled files in the current directory.  Initial patch by Sjoerd de Vries.

7078 7079 7080
- Issue #13444: When stdout has been closed explicitly, we should not attempt
  to flush it at shutdown and print an error.

7081 7082 7083 7084
- Issue #12567: The curses module uses Unicode functions for Unicode arguments
  when it is linked to the ncurses library. It encodes also Unicode strings to
  the locale encoding instead of UTF-8.

7085 7086 7087 7088
- Issue #12856: Ensure child processes do not inherit the parent's random
  seed for filename generation in the tempfile module.  Patch by Brian
  Harring.

7089 7090 7091
- Issue #9957: SpooledTemporaryFile.truncate() now accepts an optional size
  parameter, as other file-like objects.  Patch by Ryan Kelly.

7092 7093 7094
- Issue #13458: Fix a memory leak in the ssl module when decoding a
  certificate with a subjectAltName.  Patch by Robert Xiao.

7095 7096
- Issue #13415: os.unsetenv() doesn't ignore errors anymore.

Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
7097 7098 7099
- Issue #13245: sched.scheduler class constructor's timefunc and
  delayfunct parameters are now optional.
  scheduler.enter and scheduler.enterabs methods gained a new kwargs parameter.
7100
  Patch contributed by Chris Clark.
Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
7101

7102 7103 7104 7105
- Issue #12328: Under Windows, refactor handling of Ctrl-C events and
  make _multiprocessing.win32.WaitForMultipleObjects interruptible when
  the wait_flag parameter is false.  Patch by sbt.

7106 7107 7108 7109 7110 7111
- Issue #13322: Fix BufferedWriter.write() to ensure that BlockingIOError is
  raised when the wrapped raw file is non-blocking and the write would block.
  Previous code assumed that the raw write() would raise BlockingIOError, but
  RawIOBase.write() is defined to returned None when the call would block.
  Patch by sbt.

7112 7113
- Issue #13358: HTMLParser now calls handle_data only once for each CDATA.

7114 7115 7116 7117
- Issue #4147: minidom's toprettyxml no longer adds whitespace around a text
  node when it is the only child of an element.  Initial patch by Dan
  Kenigsberg.

7118 7119 7120 7121
- Issue #13374: The Windows bytes API has been deprecated in the os module. Use
  Unicode filenames instead of bytes filenames to not depend on the ANSI code
  page anymore and to support any filename.

7122 7123
- Issue #13297: Use bytes type to send and receive binary data through XMLRPC.

7124 7125 7126
- Issue #6397: Support "/dev/poll" polling objects in select module,
  under Solaris & derivatives.

7127 7128 7129
- Issues #1745761, #755670, #13357, #12629, #1200313: HTMLParser now correctly
  handles non-valid attributes, including adjacent and unquoted attributes.

7130 7131
- Issue #13193: Fix distutils.filelist.FileList and packaging.manifest.Manifest
  under Windows.
Antoine Pitrou's avatar
Antoine Pitrou committed
7132

7133 7134
- Issue #13384: Remove unnecessary __future__ import in Lib/random.py

7135 7136
- Issue #13149: Speed up append-only StringIO objects.

7137 7138 7139
- Issue #13373: multiprocessing.Queue.get() could sometimes block indefinitely
  when called with a timeout.  Patch by Arnaud Ysmal.

7140 7141 7142
- Issue #13254: Fix Maildir initialization so that maildir contents
  are read correctly.

7143
- Issue #3067: locale.setlocale() now raises TypeError if the second
7144 7145
  argument is an invalid iterable. Its documentation and docstring
  were also updated. Initial patch by Jyrki Pulliainen.
7146

7147 7148
- Issue #13140: Fix the daemon_threads attribute of ThreadingMixIn.

7149 7150 7151
- Issue #13339: Fix compile error in posixmodule.c due to missing semicolon.
  Thanks to Robert Xiao.

7152 7153 7154
- Byte compilation in packaging is now isolated from the calling Python -B or
  -O options, instead of being disallowed under -B or buggy under -O.

7155
- Issue #10570: curses.putp() and curses.tparm() are now expecting a byte
7156
  string, instead of a Unicode string.
7157

7158 7159
- Issue #13295: http.server now produces valid HTML 4.01 strict.

7160 7161
- Issue #2892: preserve iterparse events in case of SyntaxError.

7162
- Issue #13287: urllib.request and urllib.error now contains an __all__
Éric Araujo's avatar
Éric Araujo committed
7163
  attribute to expose only relevant classes and functions.  Patch by Florent
7164
  Xicluna.
7165

7166 7167 7168 7169
- Issue #670664: Fix HTMLParser to correctly handle the content of
  ``<script>...</script>`` and ``<style>...</style>``.

- Issue #10817: Fix urlretrieve function to raise ContentTooShortError even
7170 7171
  when reporthook is None. Patch by Jyrki Pulliainen.

7172 7173 7174
- Fix the xmlrpc.client user agent to return something similar to
  urllib.request user agent: "Python-xmlrpc/3.3".

7175 7176 7177
- Issue #13293: Better error message when trying to marshal bytes using
  xmlrpc.client.

7178 7179
- Issue #13291: NameError in xmlrpc package.

7180 7181
- Issue #13258: Use callable() built-in in the standard library.

7182 7183 7184
- Issue #13273: fix a bug that prevented HTMLParser to properly detect some
  tags when strict=False.

7185 7186 7187
- Issue #11183: Add finer-grained exceptions to the ssl module, so that
  you don't have to inspect the exception's attributes in the common case.

7188
- Issue #13216: Add cp65001 codec, the Windows UTF-8 (CP_UTF8).
7189

Victor Stinner's avatar
Victor Stinner committed
7190
- Issue #13226: Add RTLD_xxx constants to the os module. These constants can be
7191 7192
  used with sys.setdlopenflags().

7193 7194 7195 7196
- Issue #10278: Add clock_getres(), clock_gettime() and CLOCK_xxx constants to
  the time module. time.clock_gettime(time.CLOCK_MONOTONIC) provides a
  monotonic clock

7197 7198 7199
- Issue #10332: multiprocessing: fix a race condition when a Pool is closed
  before all tasks have completed.

7200 7201
- Issue #13255: wrong docstrings in array module.

7202 7203
- Issue #8540: Remove deprecated Context._clamp attribute in Decimal module.

R David Murray's avatar
R David Murray committed
7204
- Issue #13235: Added DeprecationWarning to logging.warn() method and function.
7205

7206 7207
- Issue #9168: now smtpd is able to bind privileged port.

7208 7209 7210
- Issue #12529: fix cgi.parse_header issue on strings with double-quotes and
  semicolons together. Patch by Ben Darnell and Petri Lehtinen.

7211 7212 7213
- Issue #13227: functools.lru_cache() now has a option to distinguish
  calls with different argument types.

7214 7215
- Issue #6090: zipfile raises a ValueError when a document with a timestamp
  earlier than 1980 is provided. Patch contributed by Petri Lehtinen.
7216

7217 7218 7219 7220
- Issue #13150: sysconfig no longer parses the Makefile and config.h files
  when imported, instead doing it at build time.  This makes importing
  sysconfig faster and reduces Python startup time by 20%.

Ezio Melotti's avatar
Ezio Melotti committed
7221 7222
- Issue #12448: smtplib now flushes stdout while running ``python -m smtplib``
  in order to display the prompt correctly.
7223

7224
- Issue #12454: The mailbox module is now using ASCII, instead of the locale
R David Murray's avatar
R David Murray committed
7225
  encoding, to read and write .mh_sequences files.
7226

7227 7228
- Issue #13194: zlib.compressobj().copy() and zlib.decompressobj().copy() are
  now available on Windows.
7229

R David Murray's avatar
R David Murray committed
7230
- Issue #1673007: urllib.request now supports HEAD request via new method argument.
7231 7232
  Patch contributions by David Stanek, Patrick Westerhoff and Ezio Melotti.

7233 7234
- Issue #12386: packaging does not fail anymore when writing the RESOURCES
  file.
7235

7236 7237
- Issue #13158: Fix decoding and encoding of GNU tar specific base-256 number
  fields in tarfile.
7238

7239 7240
- Issue #13025: mimetypes is now reading MIME types using the UTF-8 encoding,
  instead of the locale encoding.
7241

7242 7243
- Issue #10653: On Windows, use strftime() instead of wcsftime() because
  wcsftime() doesn't format time zone correctly.
7244

7245 7246 7247
- Issue #13150: The tokenize module doesn't compile large regular expressions
  at startup anymore.

Éric Araujo's avatar
Éric Araujo committed
7248 7249
- Issue #11171: Fix distutils.sysconfig.get_makefile_filename when Python was
  configured with different prefix and exec-prefix.
7250

7251
- Issue #11254: Teach distutils and packaging to compile .pyc and .pyo files in
7252
  PEP 3147-compliant __pycache__ directories.
7253

Ned Deily's avatar
Ned Deily committed
7254 7255
- Issue #7367: Fix pkgutil.walk_paths to skip directories whose
  contents cannot be read.
7256

7257 7258 7259
- Issue #3163: The struct module gets new format characters 'n' and 'N'
  supporting C integer types ``ssize_t`` and ``size_t``, respectively.

7260 7261
- Issue #13099: Fix sqlite3.Cursor.lastrowid under a Turkish locale.
  Reported and diagnosed by Thomas Kluyver.
7262

7263 7264 7265
- Issue #13087: BufferedReader.seek() now always raises UnsupportedOperation
  if the underlying raw stream is unseekable, even if the seek could be
  satisfied using the internal buffer.  Patch by John O'Connor.
7266

7267 7268 7269
- Issue #7689: Allow pickling of dynamically created classes when their
  metaclass is registered with copyreg.  Patch by Nicolas M. Thiéry and Craig
  Citro.
7270

7271 7272 7273
- Issue #13034: When decoding some SSL certificates, the subjectAltName
  extension could be unreported.

7274 7275 7276
- Issue #12306: Expose the runtime version of the zlib C library as a constant,
  ZLIB_RUNTIME_VERSION, in the zlib module. Patch by Torsten Landschoff.

7277
- Issue #12959: Add collections.ChainMap to collections.__all__.
7278

7279 7280 7281
- Issue #8933: distutils' PKG-INFO files and packaging's METADATA files will
  now correctly report Metadata-Version: 1.1 instead of 1.0 if a Classifier or
  Download-URL field is present.
7282

7283 7284 7285
- Issue #12567: Add curses.unget_wch() function. Push a character so the next
  get_wch() will return it.

7286
- Issue #9561: distutils and packaging now writes egg-info files using UTF-8,
7287 7288
  instead of the locale encoding.

7289 7290 7291
- Issue #8286: The distutils command sdist will print a warning message instead
  of crashing when an invalid path is given in the manifest template.

7292 7293 7294 7295 7296
- Issue #12841: tarfile unnecessarily checked the existence of numerical user
  and group ids on extraction. If one of them did not exist the respective id
  of the current user (i.e. root) was used for the file and ownership
  information was lost.

Ezio Melotti's avatar
Ezio Melotti committed
7297 7298 7299
- Issue #12888: Fix a bug in HTMLParser.unescape that prevented it to escape
  more than 128 entities.  Patch by Peter Otten.

7300 7301
- Issue #12878: Expose a __dict__ attribute on io.IOBase and its subclasses.

7302 7303 7304 7305
- Issue #12494: On error, call(), check_call(), check_output() and
  getstatusoutput() functions of the subprocess module now kill the process,
  read its status (to avoid zombis) and close pipes.

Benjamin Peterson's avatar
Benjamin Peterson committed
7306 7307
- Issue #12720: Expose low-level Linux extended file attribute functions in os.

Éric Araujo's avatar
Éric Araujo committed
7308
- Issue #10946: The distutils commands bdist_dumb, bdist_wininst and bdist_msi
7309 7310
  now respect a --skip-build option given to bdist.  The packaging commands
  were fixed too.
Éric Araujo's avatar
Éric Araujo committed
7311

7312 7313 7314
- Issue #12847: Fix a crash with negative PUT and LONG_BINPUT arguments in
  the C pickle implementation.

7315 7316 7317
- Issue #11564: Avoid crashes when trying to pickle huge objects or containers
  (more than 2**31 items).  Instead, in most cases, an OverflowError is raised.

7318 7319 7320
- Issue #12287: Fix a stack corruption in ossaudiodev module when the FD is
  greater than FD_SETSIZE.

7321 7322 7323
- Issue #12839: Fix crash in zlib module due to version mismatch.
  Fix by Richard M. Tew.

7324 7325 7326
- Issue #9923: The mailcap module now correctly uses the platform path
  separator for the MAILCAP environment variable on non-POSIX platforms.

7327 7328 7329 7330
- Issue #12835: Follow up to #6560 that unconditionally prevents use of the
  unencrypted sendmsg/recvmsg APIs on SSL wrapped sockets. Patch by David
  Watson.

7331 7332 7333
- Issue #12803: SSLContext.load_cert_chain() now accepts a password argument
  to be used if the private key is encrypted.  Patch by Adam Simpkins.

7334 7335 7336
- Issue #11657: Fix sending file descriptors over 255 over a multiprocessing
  Pipe.

7337 7338 7339
- Issue #12811: tabnanny.check() now promptly closes checked files. Patch by
  Anthony Briggs.

7340 7341
- Issue #6560: The sendmsg/recvmsg API is now exposed by the socket module
  when provided by the underlying platform, supporting processing of
7342
  ancillary data in pure Python code. Patch by David Watson and Heiko Wundram.
7343

7344 7345 7346 7347
- Issue #12326: On Linux, sys.platform doesn't contain the major version
  anymore. It is now always 'linux', instead of 'linux2' or 'linux3' depending
  on the Linux version used to build Python.

7348 7349 7350
- Issue #12213: Fix a buffering bug with interleaved reads and writes that
  could appear on BufferedRandom streams.

7351 7352 7353
- Issue #12778: Reduce memory consumption when JSON-encoding a large
  container of many small objects.

7354 7355 7356
- Issue #12650: Fix a race condition where a subprocess.Popen could leak
  resources (FD/zombie) when killed at the wrong time.

7357 7358 7359
- Issue #12744: Fix inefficient representation of integers between 2**31 and
  2**63 on systems with a 64-bit C "long".

7360 7361 7362
- Issue #12646: Add an 'eof' attribute to zlib.Decompress, to make it easier to
  detect truncated input streams.

7363 7364 7365
- Issue #11513: Fix exception handling ``tarfile.TarFile.gzopen()`` when
  the file cannot be opened.

7366 7367 7368
- Issue #12687: Fix a possible buffering bug when unpickling text mode
  (protocol 0, mostly) pickles.

Senthil Kumaran's avatar
Senthil Kumaran committed
7369 7370
- Issue #10087: Fix the html output format of the calendar module.

7371 7372 7373
- Issue #13121: add support for inplace math operators to collections.Counter.

- Add support for unary plus and unary minus to collections.Counter.
7374

7375 7376
- Issue #12683: urlparse updated to include svn as schemes that uses relative
  paths. (svn from 1.5 onwards support relative path).
7377

7378 7379 7380 7381 7382
- Issue #12655: Expose functions from sched.h in the os module: sched_yield(),
  sched_setscheduler(), sched_getscheduler(), sched_setparam(),
  sched_get_min_priority(), sched_get_max_priority(), sched_rr_get_interval(),
  sched_getaffinity(), sched_setaffinity().

7383 7384
- Add ThreadError to threading.__all__.

7385 7386
- Issues #11104, #8688: Fix the behavior of distutils' sdist command with
  manually-maintained MANIFEST files.
7387

7388 7389 7390 7391
- Issue #11281: smtplib.STMP gets source_address parameter, which adds the
  ability to bind to specific source address on a machine with multiple
  interfaces. Patch by Paulo Scardine.

7392 7393
- Issue #12464: tempfile.TemporaryDirectory.cleanup() should not follow
  symlinks: fix it. Patch by Petri Lehtinen.
7394

Éric Araujo's avatar
Éric Araujo committed
7395 7396
- Issue #8887: "pydoc somebuiltin.somemethod" (or help('somebuiltin.somemethod')
  in Python code) now finds the doc of the method.
7397

7398
- Issue #10968: Remove indirection in threading.  The public names (Event,
7399
  Condition, etc.) used to be factory functions returning instances of hidden
7400 7401 7402
  classes (_Event, _Condition, etc.), because (if Guido recalls correctly) this
  code pre-dates the ability to subclass extension types.  It is now possible
  to inherit from these classes, without having to import the private
7403 7404
  underscored names like multiprocessing did.

7405 7406 7407
- Issue #9723: Add shlex.quote functions, to escape filenames and command
  lines.

7408 7409
- Issue #12603: Fix pydoc.synopsis() on files with non-negative st_mtime.

7410 7411 7412
- Issue #12514: Use try/finally to assure the timeit module restores garbage
  collections when it is done.

7413 7414 7415
- Issue #12607: In subprocess, fix issue where if stdin, stdout or stderr is
  given as a low fd, it gets overwritten.

7416
- Issue #12576: Fix urlopen behavior on sites which do not send (or obfuscates)
7417
  ``Connection: close`` header.
7418

7419 7420
- Issue #12560: Build libpython.so on OpenBSD. Patch by Stefan Sperling.

7421 7422
- Issue #1813: Fix codec lookup under Turkish locales.

7423 7424 7425
- Issue #12591: Improve support of "universal newlines" in the subprocess
  module: the piped streams can now be properly read from or written to.

7426 7427 7428 7429
- Issue #12591: Allow io.TextIOWrapper to work with raw IO objects (without
  a read1() method), and add a *write_through* parameter to mandate
  unbuffered writes.

7430 7431
- Issue #10883: Fix socket leaks in urllib.request when using FTP.

7432 7433
- Issue #12592: Make Python build on OpenBSD 5 (and future major releases).

7434 7435
- Issue #12372: POSIX semaphores are broken on AIX: don't use them.

7436 7437 7438 7439 7440 7441
- Issue #12551: Provide a get_channel_binding() method on SSL sockets so as
  to get channel binding data for the current SSL session (only the
  "tls-unique" channel binding is implemented).  This allows the implementation
  of certain authentication mechanisms such as SCRAM-SHA-1-PLUS.  Patch by
  Jacek Konieczny.

7442 7443 7444
- Issue #665194: email.utils now has format_datetime and parsedate_to_datetime
  functions, allowing for round tripping of RFC2822 format dates.

7445 7446 7447 7448
- Issue #12571: Add a plat-linux3 directory mirroring the plat-linux2
  directory, so that "import DLFCN" and other similar imports work on
  Linux 3.0.

7449 7450 7451
- Issue #7484: smtplib no longer puts <> around addresses in VRFY and EXPN
  commands; they aren't required and in fact postfix doesn't support that form.

Benjamin Peterson's avatar
Benjamin Peterson committed
7452 7453 7454
- Issue #12273: Remove ast.__version__. AST changes can be accounted for by
  checking sys.version_info or sys._mercurial.

7455 7456 7457
- Silence spurious "broken pipe" tracebacks when shutting down a
  ProcessPoolExecutor.

7458 7459 7460
- Fix potential resource leaks in concurrent.futures.ProcessPoolExecutor
  by joining all queues and processes when shutdown() is called.

7461 7462 7463
- Issue #11603: Fix a crash when __str__ is rebound as __repr__.  Patch by
  Andreas Stührk.

7464 7465 7466
- Issue #11321: Fix a crash with multiple imports of the _pickle module when
  embedding Python.  Patch by Andreas Stührk.

7467 7468 7469
- Issue #6755: Add get_wch() method to curses.window class. Patch by Iñigo
  Serna.

7470 7471
- Add cgi.closelog() function to close the log file.

7472 7473
- Issue #12502: asyncore: fix polling loop with AF_UNIX sockets.

7474 7475 7476
- Issue #4376: ctypes now supports nested structures in a endian different than
  the parent structure. Patch by Vlad Riscutia.

7477 7478 7479
- Raise ValueError when attempting to set the _CHUNK_SIZE attribute of a
  TextIOWrapper to a huge value, not TypeError.

7480 7481 7482
- Issue #12504: Close file handles in a timely manner in packaging.database.
  This fixes a bug with the remove (uninstall) feature on Windows.

7483 7484 7485
- Issues #12169 and #10510: Factor out code used by various packaging commands
  to make HTTP POST requests, and make sure it uses CRLF.

7486 7487 7488 7489
- Issue #12016: Multibyte CJK decoders now resynchronize faster. They only
  ignore the first byte of an invalid byte sequence. For example,
  b'\xff\n'.decode('gb2312', 'replace') gives '\ufffd\n' instead of '\ufffd'.

7490 7491 7492 7493
- Issue #12459: time.sleep() now raises a ValueError if the sleep length is
  negative, instead of an infinite sleep on Windows or raising an IOError on
  Linux for example, to have the same behaviour on all platforms.

7494 7495 7496 7497
- Issue #12451: pydoc: html_getfile() now uses tokenize.open() to support
  Python scripts using a encoding different than UTF-8 (read the coding cookie
  of the script).

7498 7499 7500
- Issue #12493: subprocess: Popen.communicate() now also handles EINTR errors
  if the process has only one pipe.

7501 7502 7503
- Issue #12467: warnings: fix a race condition if a warning is emitted at
  shutdown, if globals()['__file__'] is None.

7504 7505 7506
- Issue #12451: pydoc: importfile() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to avoid encoding issues.

7507 7508 7509 7510
- Issue #12451: runpy: run_path() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to support other encodings
  than UTF-8 (scripts using the coding cookie).

7511 7512 7513
- Issue #12451: xml.dom.pulldom: parse() now opens files in binary mode instead
  of the text mode (using the locale encoding) to avoid encoding issues.

7514 7515 7516
- Issue #12147: Adjust the new-in-3.2 smtplib.send_message method for better
  conformance to the RFCs:  correctly handle Sender and Resent- headers.

7517 7518
- Issue #12352: Fix a deadlock in multiprocessing.Heap when a block is freed by
  the garbage collector while the Heap lock is held.
7519

R David Murray's avatar
R David Murray committed
7520
- Issue #12462: time.sleep() now immediately calls the (Python) signal handler
7521 7522 7523
  if it is interrupted by a signal, instead of having to wait until the next
  instruction.

7524 7525 7526
- Issue #12442: new shutil.disk_usage function, providing total, used and free
  disk space statistics.

7527 7528 7529 7530 7531
- Issue #12451: The XInclude default loader of xml.etree now decodes files from
  UTF-8 instead of the locale encoding if the encoding is not specified. It now
  also opens XML files for the parser in binary mode instead of the text mode
  to avoid encoding issues.

7532 7533 7534
- Issue #12451: doctest.debug_script() doesn't create a temporary file
  anymore to avoid encoding issues.

7535 7536 7537
- Issue #12451: pydoc.synopsis() now reads the encoding cookie if available,
  to read the Python script from the right encoding.

7538 7539 7540
- Issue #12451: distutils now opens the setup script in binary mode to read the
  encoding cookie, instead of opening it in UTF-8.

Ned Deily's avatar
Ned Deily committed
7541 7542 7543 7544
- Issue #9516: On Mac OS X, change Distutils to no longer globally attempt to
  check or set the MACOSX_DEPLOYMENT_TARGET environment variable for the
  interpreter process.  This could cause failures in non-Distutils subprocesses
  and was unreliable since tests or user programs could modify the interpreter
Ezio Melotti's avatar
Ezio Melotti committed
7545
  environment after Distutils set it.  Instead, have Distutils set the
Ned Deily's avatar
Ned Deily committed
7546 7547 7548 7549
  deployment target only in the environment of each build subprocess.  It is
  still possible to globally override the default by setting
  MACOSX_DEPLOYMENT_TARGET before launching the interpreter; its value must be
  greater or equal to the default value, the value with which the interpreter
7550
  was built.  Also, implement the same handling in packaging.
Ned Deily's avatar
Ned Deily committed
7551

7552 7553 7554
- Issue #12422: In the copy module, don't store objects that are their own copy
  in the memo dict.

7555 7556
- Issue #12303: Add sigwaitinfo() and sigtimedwait() to the signal module.

7557 7558 7559
- Issue #12404: Remove C89 incompatible code from mmap module. Patch by Akira
  Kitada.

7560 7561 7562
- Issue #1874: email now detects and reports as a defect the presence of
  any CTE other than 7bit, 8bit, or binary on a multipart.

7563 7564 7565
- Issue #12383: Fix subprocess module with env={}: don't copy the environment
  variables, start with an empty environment.

7566 7567 7568 7569
- Issue #11637: Fix support for importing packaging setup hooks from the
  project directory.

- Issue #6771: Moved the curses.wrapper function from the single-function
7570 7571 7572
  wrapper module into __init__, eliminating the module.  Since __init__ was
  already importing the function to curses.wrapper, there is no API change.

7573
- Issue #11584: email.header.decode_header no longer fails if the header
7574 7575
  passed to it is a Header object, and Header/make_header no longer fail
  if given binary unknown-8bit input.
7576

7577 7578 7579
- Issue #11700: mailbox proxy object close methods can now be called multiple
  times without error.

7580 7581
- Issue #11767: Correct file descriptor leak in mailbox's __getitem__ method.

7582 7583 7584 7585
- Issue #12133: AbstractHTTPHandler.do_open() of urllib.request closes the HTTP
  connection if its getresponse() method fails with a socket error. Patch
  written by Ezio Melotti.

7586 7587 7588
- Issue #12240: Allow multiple setup hooks in packaging's setup.cfg files.
  Original patch by Erik Bray.

7589 7590 7591
- Issue #9284: Allow inspect.findsource() to find the source of doctest
  functions.

7592 7593 7594 7595
- Issue #11595: Fix assorted bugs in packaging.util.cfg_to_args, a
  compatibility helper for the distutils-packaging transition.  Original patch
  by Erik Bray.

7596 7597 7598
- Issue #12287: In ossaudiodev, check that the device isn't closed in several
  methods.

Benjamin Peterson's avatar
Benjamin Peterson committed
7599
- Issue #12009: Fixed regression in netrc file comment handling.
7600

7601 7602 7603 7604
- Issue #12246: Warn and fail when trying to install a third-party project from
  an uninstalled Python (built in a source checkout).  Original patch by
  Tshepang Lekhonkhobe.

7605 7606
- Issue #10694: zipfile now ignores garbage at the end of a zipfile.

7607 7608
- Issue #12283: Fixed regression in smtplib quoting of leading dots in DATA.

7609 7610 7611
- Issue #10424: Argparse now includes the names of the missing required
  arguments in the missing arguments error message.

7612 7613 7614
- Issue #12168: SysLogHandler now allows NUL termination to be controlled using
  a new 'append_nul' attribute on the handler.

7615 7616 7617
- Issue #11583: Speed up os.path.isdir on Windows by using GetFileAttributes
  instead of os.stat.

7618 7619 7620
- Issue #12021: Make mmap's read() method argument optional. Patch by Petri
  Lehtinen.

7621 7622 7623 7624
- Issue #9205: concurrent.futures.ProcessPoolExecutor now detects killed
  children and raises BrokenProcessPool in such a situation.  Previously it
  would reliably freeze/deadlock.

7625
- Issue #12040: Expose a new attribute ``sentinel`` on instances of
Georg Brandl's avatar
Georg Brandl committed
7626 7627
  ``multiprocessing.Process``.  Also, fix Process.join() to not use polling
  anymore, when given a timeout.
7628

7629 7630 7631
- Issue #11893: Remove obsolete internal wrapper class ``SSLFakeFile`` in the
  smtplib module.  Patch by Catalin Iacob.

7632 7633 7634
- Issue #12080: Fix a Decimal.power() case that took an unreasonably long time
  to compute.

7635 7636 7637 7638
- Issue #12221: Remove __version__ attributes from pyexpat, pickle, tarfile,
  pydoc, tkinter, and xml.parsers.expat. This were useless version constants
  left over from the Mercurial transition

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
7639
- Named tuples now work correctly with vars().
7640

7641 7642 7643 7644
- Issue #12085: Fix an attribute error in subprocess.Popen destructor if the
  constructor has failed, e.g. because of an undeclared keyword argument. Patch
  written by Oleg Oshmyan.

7645
- Issue #12028: Make threading._get_ident() public, rename it to
Victor Stinner's avatar
Victor Stinner committed
7646
  threading.get_ident() and document it. This function was already used using
7647 7648
  _thread.get_ident().

7649 7650 7651
- Issue #12171: IncrementalEncoder.reset() of CJK codecs (multibytecodec) calls
  encreset() instead of decreset().

7652 7653
- Issue #12218: Removed wsgiref.egg-info.

7654
- Issue #12196: Add pipe2() to the os module.
7655

7656 7657 7658
- Issue #985064: Make plistlib more resilient to faulty input plists.
  Patch by Mher Movsisyan.

7659 7660 7661
- Issue #1625: BZ2File and bz2.decompress() now support multi-stream files.
  Initial patch by Nir Aides.

7662 7663
- Issue #12175: BufferedReader.read(-1) now calls raw.readall() if available.

7664 7665 7666
- Issue #12175: FileIO.readall() now only reads the file position and size
  once.

7667 7668 7669 7670 7671 7672
- Issue #12175: RawIOBase.readall() now returns None if read() returns None.

- Issue #12175: FileIO.readall() now raises a ValueError instead of an IOError
  if the file is closed.

- Issue #11109: New service_action method for BaseServer, used by ForkingMixin
7673
  class for cleanup. Initial Patch by Justin Warkentin.
7674 7675 7676

- Issue #12045: Avoid duplicate execution of command in
  ctypes.util._get_soname().  Patch by Sijin Joseph.
Senthil Kumaran's avatar
Senthil Kumaran committed
7677

7678 7679 7680
- Issue #10818: Remove the Tk GUI and the serve() function of the pydoc module,
  pydoc -g has been deprecated in Python 3.2 and it has a new enhanced web
  server.
7681

7682 7683 7684
- Issue #1441530: In imaplib, read the data in one chunk to speed up large
  reads and simplify code.

7685 7686 7687
- Issue #12070: Fix the Makefile parser of the sysconfig module to handle
  correctly references to "bogus variable" (e.g. "prefix=$/opt/python").

7688 7689 7690 7691
- Issue #12100: Don't reset incremental encoders of CJK codecs at each call to
  their encode() method anymore, but continue to call the reset() method if the
  final argument is True.

7692 7693 7694
- Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl
  module.

7695 7696 7697
- Issue #6501: os.device_encoding() returns None on Windows if the application
  has no console.

7698 7699
- Issue #12105: Add O_CLOEXEC to the os module.

7700 7701 7702 7703
- Issue #12079: Decimal('Infinity').fma(Decimal('0'), (3.91224318126786e+19+0j))
  now raises TypeError (reflecting the invalid type of the 3rd argument) rather
  than Decimal.InvalidOperation.

7704 7705 7706
- Issue #12124: zipimport doesn't keep a reference to zlib.decompress() anymore
  to be able to unload the module.

7707 7708
- Add the packaging module, an improved fork of distutils (also known as
  distutils2).
7709

7710 7711 7712
- Issue #12065: connect_ex() on an SSL socket now returns the original errno
  when the socket's timeout expires (it used to return None).

7713 7714 7715 7716
- Issue #8809: The SMTP_SSL constructor and SMTP.starttls() now support
  passing a ``context`` argument pointing to an ssl.SSLContext instance.
  Patch by Kasun Herath.

7717 7718 7719
- Issue #9516: Issue #9516: avoid errors in sysconfig when MACOSX_DEPLOYMENT_TARGET
  is set in shell.

7720 7721 7722 7723 7724
- Issue #8650: Make zlib module 64-bit clean. compress(), decompress() and
  their incremental counterparts now raise OverflowError if given an input
  larger than 4GB, instead of silently truncating the input and returning
  an incorrect result.

7725 7726 7727
- Issue #12050: zlib.decompressobj().decompress() now clears the unconsumed_tail
  attribute when called without a max_length argument.

7728 7729 7730 7731 7732
- Issue #12062: Fix a flushing bug when doing a certain type of I/O sequence
  on a file opened in read+write mode (namely: reading, seeking a bit forward,
  writing, then seeking before the previous write but still within buffered
  data, and writing again).

7733 7734 7735
- Issue #9971: Write an optimized implementation of BufferedReader.readinto().
  Patch by John O'Connor.

7736 7737 7738 7739
- Issue #11799: urllib.request Authentication Handlers will raise a ValueError
  when presented with an unsupported Authentication Scheme. Patch contributed
  by Yuval Greenfield.

7740 7741 7742 7743 7744
- Issue #10419, #6011: build_scripts command of distutils handles correctly
  non-ASCII path (path to the Python executable). Open and write the script in
  binary mode, but ensure that the shebang is decodable from UTF-8 and from the
  encoding of the script.

7745 7746 7747
- Issue #8498: In socket.accept(), allow to specify 0 as a backlog value in
  order to accept exactly one connection.  Patch by Daniel Evers.

7748 7749 7750
- Issue #12011: signal.signal() and signal.siginterrupt() raise an OSError,
  instead of a RuntimeError: OSError has an errno attribute.

R David Murray's avatar
R David Murray committed
7751 7752 7753
- Issue #3709: add a flush_headers method to BaseHTTPRequestHandler, which
  manages the sending of headers to output stream and flushing the internal
  headers buffer. Patch contribution by Andrew Schaaf
7754

7755 7756
- Issue #11743: Rewrite multiprocessing connection classes in pure Python.

7757 7758
- Issue #11164: Stop trying to use _xmlplus in the xml module.

7759 7760 7761
- Issue #11888: Add log2 function to math module. Patch written by Mark
  Dickinson.

7762 7763
- Issue #12012: ssl.PROTOCOL_SSLv2 becomes optional.

7764 7765 7766 7767
- Issue #8407: The signal handler writes the signal number as a single byte
  instead of a nul byte into the wakeup file descriptor. So it is possible to
  wait more than one signal and know which signals were raised.

7768 7769 7770
- Issue #8407: Add pthread_kill(), sigpending() and sigwait() functions to the
  signal module.

7771 7772 7773
- Issue #11927: SMTP_SSL now uses port 465 by default as documented.  Patch
  by Kasun Herath.

Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
7774
- Issue #12002: ftplib's abort() method raises TypeError.
7775

Ezio Melotti's avatar
Ezio Melotti committed
7776
- Issue #11916: Add a number of MacOSX specific definitions to the errno module.
7777 7778
  Patch by Pierre Carrier.

7779
- Issue #11999: fixed sporadic sync failure mailbox.Maildir due to its trying to
7780 7781 7782
  detect mtime changes by comparing to the system clock instead of to the
  previous value of the mtime.

7783 7784
- Issue #11072: added MLSD command (RFC-3659) support to ftplib.

7785 7786 7787 7788
- Issue #8808: The IMAP4_SSL constructor now allows passing an SSLContext
  parameter to control parameters of the secure channel.  Patch by Sijin
  Joseph.

7789 7790 7791
- ntpath.samefile failed to notice that "a.txt" and "A.TXT" refer to the same
  file on Windows XP. As noticed in issue #10684.

7792 7793 7794 7795
- Issue #12000: When a SSL certificate has a subjectAltName without any
  dNSName entry, ssl.match_hostname() should use the subject's commonName.
  Patch by Nicolas Bareil.

7796 7797 7798 7799
- Issue #10775: assertRaises, assertRaisesRegex, assertWarns, and
  assertWarnsRegex now accept a keyword argument 'msg' when used as context
  managers.  Initial patch by Winston Ewert.

Ronald Oussoren's avatar
Ronald Oussoren committed
7800 7801 7802 7803
- Issue #10684: shutil.move used to delete a folder on case insensitive
  filesystems when the source and destination name where the same except
  for the case.

7804 7805 7806 7807
- Issue #11647: objects created using contextlib.contextmanager now support
  more than one call to the function when used as a decorator. Initial patch
  by Ysj Ray.

7808 7809 7810
- Issue #11930: Removed deprecated time.accept2dyear variable.
  Removed year >= 1000 restriction from datetime.strftime.

7811 7812
- logging: don't define QueueListener if Python has no thread support.

7813 7814
- functools.cmp_to_key() now works with collections.Hashable().

7815 7816 7817
- Issue #11277: mmap.mmap() calls fcntl(fd, F_FULLFSYNC) on Mac OS X to get
  around a mmap bug with sparse files. Patch written by Steffen Daode Nurpmeso.

7818 7819 7820
- Issue #8407: Add signal.pthread_sigmask() function to fetch and/or change the
  signal mask of the calling thread.

7821 7822 7823 7824 7825
- Issue #11858: configparser.ExtendedInterpolation expected lower-case section
  names.

- Issue #11324: ConfigParser(interpolation=None) now works correctly.

7826 7827 7828
- Issue #11811: ssl.get_server_certificate() is now IPv6-compatible.  Patch
  by Charles-François Natali.

7829 7830 7831
- Issue #11763: don't use difflib in TestCase.assertMultiLineEqual if the
  strings are too long.

7832 7833
- Issue #11236: getpass.getpass responds to ctrl-c or ctrl-z on terminal.

7834 7835
- Issue #11856: Speed up parsing of JSON numbers.

7836
- Issue #11005: threading.RLock()._release_save() raises a RuntimeError if the
7837 7838
  lock was not acquired.

7839 7840 7841
- Issue #11258: Speed up ctypes.util.find_library() under Linux by a factor
  of 5 to 10.  Initial patch by Jonas H.

7842 7843 7844
- Issue #11382: Trivial system calls, such as dup() or pipe(), needn't
  release the GIL.  Patch by Charles-François Natali.

7845 7846 7847
- Issue #11223: Add threading._info() function providing informations about
  the thread implementation.

7848 7849 7850
- Issue #11731: simplify/enhance email parser/generator API by introducing
  policy objects.

7851 7852 7853 7854
- Issue #11768: The signal handler of the signal module only calls
  Py_AddPendingCall() for the first signal to fix a deadlock on reentrant or
  parallel calls. PyErr_SetInterrupt() writes also into the wake up file.

7855 7856
- Issue #11492: fix several issues with header folding in the email package.

7857 7858
- Issue #11852: Add missing imports and update tests.

7859 7860 7861
- Issue #11875: collections.OrderedDict's __reduce__ was temporarily
  mutating the object instead of just working on a copy.

7862
- Issue #11467: Fix urlparse behavior when handling urls which contains scheme
7863 7864
  specific part only digits. Patch by Santoso Wijaya.

7865 7866
- collections.Counter().copy() now works correctly for subclasses.

7867 7868 7869
- Issue #11474: Fix the bug with url2pathname() handling of '/C|/' on Windows.
  Patch by Santoso Wijaya.

7870 7871
- Issue #11684: complete email.parser bytes API by adding BytesHeaderParser.

7872 7873
- The bz2 module now handles 4GiB+ input buffers correctly.

Ezio Melotti's avatar
Ezio Melotti committed
7874 7875
- Issue #9233: Fix json.loads('{}') to return a dict (instead of a list), when
  _json is not available.
7876

Ezio Melotti's avatar
Ezio Melotti committed
7877
- Issue #11830: Remove unnecessary introspection code in the decimal module.
7878 7879

- Issue #11703: urllib2.geturl() does not return correct url when the original
7880
  url contains #fragment.
7881

7882 7883 7884
- Issue #10019: Fixed regression in json module where an indent of 0 stopped
  adding newlines and acted instead like 'None'.

7885 7886 7887
- Issue #11186: pydoc ignores a module if its name contains a surrogate
  character in the index of modules.

7888 7889 7890
- Issue #11815: Use a light-weight SimpleQueue for the result queue in
  concurrent.futures.ProcessPoolExecutor.

brian.curtin's avatar
brian.curtin committed
7891 7892 7893
- Issue #5162: Treat services like frozen executables to allow child spawning
  from multiprocessing.forking on Windows.

7894 7895 7896 7897
- logging.basicConfig now supports an optional 'handlers' argument taking an
  iterable of handlers to be added to the root logger. Additional parameter
  checks were also added to basicConfig.

7898 7899
- Issue #11814: Fix likely typo in multiprocessing.Pool._terminate().

7900 7901 7902
- Issue #11747: Fix range formatting in difflib.context_diff() and
  difflib.unified_diff().

7903 7904 7905 7906
- Issue #8428: Fix a race condition in multiprocessing.Pool when terminating
  worker processes: new processes would be spawned while the pool is being
  shut down.  Patch by Charles-François Natali.

7907 7908
- Issue #2650: re.escape() no longer escapes the '_'.

7909 7910 7911 7912
- Issue #11757: select.select() now raises ValueError when a negative timeout
  is passed (previously, a select.error with EINVAL would be raised).  Patch
  by Charles-François Natali.

7913 7914
- Issue #7311: fix html.parser to accept non-ASCII attribute values.

Georg Brandl's avatar
Georg Brandl committed
7915
- Issue #11605: email.parser.BytesFeedParser was incorrectly converting
Éric Araujo's avatar
Éric Araujo committed
7916
  multipart subparts with an 8-bit CTE into unicode instead of preserving the
Georg Brandl's avatar
Georg Brandl committed
7917
  bytes.
7918

Éric Araujo's avatar
Éric Araujo committed
7919 7920
- Issue #1690608: email.util.formataddr is now RFC 2047 aware:  it now has a
  charset parameter that defaults to utf-8 and is used as the charset for RFC
7921 7922
  2047 encoding when the realname contains non-ASCII characters.

7923 7924
- Issue #10963: Ensure that subprocess.communicate() never raises EPIPE.

7925 7926 7927
- Issue #10791: Implement missing method GzipFile.read1(), allowing GzipFile
  to be wrapped in a TextIOWrapper.  Patch by Nadeem Vawda.

7928 7929 7930
- Issue #11707: Added a fast C version of functools.cmp_to_key().
  Patch by Filip Gruszczyński.

7931 7932 7933
- Issue #11688: Add sqlite3.Connection.set_trace_callback().  Patch by
  Torsten Landschoff.

7934 7935 7936
- Issue #11746: Fix SSLContext.load_cert_chain() to accept elliptic curve
  private keys.

7937 7938 7939 7940
- Issue #5863: Rewrite BZ2File in pure Python, and allow it to accept
  file-like objects using a new ``fileobj`` constructor argument.  Patch by
  Nadeem Vawda.

7941 7942
- unittest.TestCase.assertSameElements has been removed.

7943 7944 7945
- sys.getfilesystemencoding() raises a RuntimeError if initfsencoding() was not
  called yet: detect bootstrap (startup) issues earlier.

7946 7947
- Issue #11393: Add the new faulthandler module.

7948 7949
- Issue #11618: Fix the timeout logic in threading.Lock.acquire() under Windows.

7950 7951 7952
- Removed the 'strict' argument to email.parser.Parser, which has been
  deprecated since Python 2.4.

7953 7954 7955
- Issue #11256: Fix inspect.getcallargs on functions that take only keyword
  arguments.

7956 7957
- Issue #11696: Fix ID generation in msilib.

7958 7959 7960
- itertools.accumulate now supports an optional *func* argument for
  a user-supplied binary function.

7961 7962
- Issue #11692: Remove unnecessary demo functions in subprocess module.

7963 7964 7965
- Issue #9696: Fix exception incorrectly raised by xdrlib.Packer.pack_int when
  trying to pack a negative (in-range) integer.

7966 7967 7968 7969
- Issue #11675: multiprocessing.[Raw]Array objects created from an integer size
  are now zeroed on creation.  This matches the behaviour specified by the
  documentation.

Martin v. Löwis's avatar
Martin v. Löwis committed
7970
- Issue #7639: Fix short file name generation in bdist_msi
7971

7972 7973 7974
- Issue #11635: Don't use polling in worker threads and processes launched by
  concurrent.futures.

7975 7976 7977
- Issue #5845: Automatically read readline configuration to enable completion
  in interactive mode.

7978 7979 7980 7981
- Issue #6811: Allow importlib to change a code object's co_filename attribute
  to match the path to where the source code currently is, not where the code
  object originally came from.

7982 7983
- Issue #8754: Have importlib use the repr of a module name in error messages.

7984 7985 7986
- Issue #11591: Prevent "import site" from modifying sys.path when python
  was started with -S.

7987 7988 7989 7990 7991
- collections.namedtuple() now adds a _source attribute to the generated
  class.  This make the source more accessible than the outdated
  "verbose" option which prints to stdout but doesn't make the source
  string available.

7992 7993 7994
- Issue #11371: Mark getopt error messages as localizable.  Patch by Filip
  Gruszczyński.

7995 7996
- Issue #11333: Add __slots__ to collections ABCs.

7997
- Issue #11628: cmp_to_key generated class should use __slots__.
7998

7999 8000 8001
- Issue #11666: let help() display named tuple attributes and methods
  that start with a leading underscore.

Guido van Rossum's avatar
Guido van Rossum committed
8002 8003 8004
- Issue #11662: Make urllib and urllib2 ignore redirections if the
  scheme is not HTTP, HTTPS or FTP (CVE-2011-1521).

8005 8006 8007
- Issue #5537: Fix time2isoz() and time2netscape() functions of
  httplib.cookiejar for expiration year greater than 2038 on 32-bit systems.

8008 8009
- Issue #4391: Use proper gettext plural forms in optparse.

8010 8011
- Issue #11127: Raise a TypeError when trying to pickle a socket object.

8012
- Issue #11563: ``Connection: close`` header is sent by requests using URLOpener
Senthil Kumaran's avatar
Senthil Kumaran committed
8013 8014 8015
  class which helps in closing of sockets after connection is over. Patch
  contributions by Jeff McNeil and Nadeem Vawda.

8016 8017 8018
- Issue #11459: A ``bufsize`` value of 0 in subprocess.Popen() really creates
  unbuffered pipes, such that select() works properly on them.

8019 8020
- Issue #5421: Fix misleading error message when one of socket.sendto()'s
  arguments has the wrong type.  Patch by Nikita Vetoshkin.
8021

8022
- Issue #10812: Add some extra posix functions to the os module.
8023 8024 8025 8026

- Issue #10979: unittest stdout buffering now works with class and module
  setup and teardown.

8027 8028 8029
- Issue #11243: fix the parameter querying methods of Message to work if
  the headers contain un-encoded non-ASCII data.

8030 8031 8032
- Issue #11401: fix handling of headers with no value; this fixes a regression
  relative to Python2 and the result is now the same as it was in Python2.

8033 8034 8035 8036
- Issue #9298: base64 bodies weren't being folded to line lengths less than 78,
  which was a regression relative to Python2.  Unlike Python2, the last line
  of the folded body now ends with a carriage return.

Nick Coghlan's avatar
Nick Coghlan committed
8037
- Issue #11560: shutil.unpack_archive now correctly handles the format
Nick Coghlan's avatar
Nick Coghlan committed
8038 8039
  parameter. Patch by Evan Dandrea.

8040 8041
- Issue #5870: Add `subprocess.DEVNULL` constant.

8042
- Issue #11133: fix two cases where inspect.getattr_static can trigger code
Benjamin Peterson's avatar
Benjamin Peterson committed
8043
  execution. Patch by Andreas Stührk.
8044

8045 8046 8047 8048
- Issue #11569: use absolute path to the sysctl command in multiprocessing to
  ensure that it will be found regardless of the shell PATH. This ensures
  that multiprocessing.cpu_count works on default installs of MacOSX.

8049 8050 8051 8052
- Issue #11501: disutils.archive_utils.make_zipfile no longer fails if zlib is
  not installed. Instead, the zipfile.ZIP_STORED compression is used to create
  the ZipFile. Patch by Natalia B. Bidart.

8053
- Issue #11289: `smtp.SMTP` class is now a context manager so it can be used
8054 8055
  in a `with` statement.  Contributed by Giampaolo Rodola.

8056 8057 8058
- Issue #11554: Fixed support for Japanese codecs; previously the body output
  encoding was not done if euc-jp or shift-jis was specified as the charset.

8059 8060 8061
- Issue #11407: `TestCase.run` returns the result object used or created.
  Contributed by Janathan Hartley.

8062
- Issue #11500: Fixed a bug in the OS X proxy bypass code for fully qualified
Antoine Pitrou's avatar
Antoine Pitrou committed
8063
  IP addresses in the proxy exception list.
8064

8065 8066 8067 8068
- Issue #11491: dbm.error is no longer raised when dbm.open is called with
  the "n" as the flag argument and the file exists. The behavior matches
  the documentation and general logic.

Éric Araujo's avatar
Éric Araujo committed
8069
- Issue #1162477: Postel Principle adjustment to email date parsing: handle the
8070 8071
  fact that some non-compliant MUAs use '.' instead of ':' in time specs.

8072 8073 8074
- Issue #11131: Fix sign of zero in decimal.Decimal plus and minus
  operations when the rounding mode is ROUND_FLOOR.

8075 8076
- Issue #9935: Speed up pickling of instances of user-defined classes.

8077 8078 8079
- Issue #5622: Fix curses.wrapper to raise correct exception if curses
  initialization fails.

8080 8081 8082
- Issue #11408: In threading.Lock.acquire(), only call gettimeofday() when
  really necessary.  Patch by Charles-François Natali.

8083 8084 8085 8086
- Issue #11391: Writing to a mmap object created with
  ``mmap.PROT_READ|mmap.PROT_EXEC`` would segfault instead of raising a
  TypeError.  Patch by Charles-François Natali.

8087 8088
- Issue #9795: add context manager protocol support for nntplib.NNTP class.

8089 8090 8091 8092
- Issue #11306: mailbox in certain cases adapts to an inability to open
  certain files in read-write mode.  Previously it detected this by
  checking for EACCES, now it also checks for EROFS.

8093 8094 8095
- Issue #11265: asyncore now correctly handles EPIPE, EBADF and EAGAIN errors
  on accept(), send() and recv().

8096 8097
- Issue #11377: Deprecate platform.popen() and reimplement it with os.popen().

8098 8099
- Issue #8513: On UNIX, subprocess supports bytes command string.

8100 8101
- Issue #10866: Add socket.sethostname().  Initial patch by Ross Lagerwall.

8102 8103
- Issue #11140: Lock.release() now raises a RuntimeError when attempting
  to release an unacquired lock, as claimed in the threading documentation.
Antoine Pitrou's avatar
Antoine Pitrou committed
8104
  The _thread.error exception is now an alias of RuntimeError.  Patch by
8105
  Filip Gruszczyński.  Patch for _dummy_thread by Aymeric Augustin.
8106

8107
- Issue #8594: ftplib now provides a source_address parameter to specify which
8108 8109
  (address, port) to bind to before connecting.

8110 8111 8112
- Issue #11326: Add the missing connect_ex() implementation for SSL sockets,
  and make it work for non-blocking connects.

8113 8114
- Issue #11297: Add collections.ChainMap().

8115
- Issue #10755: Add the posix.flistdir() function.  Patch by Ross Lagerwall.
8116

Georg Brandl's avatar
Georg Brandl committed
8117 8118
- Issue #4761: Add the ``*at()`` family of functions (openat(), etc.) to the
  posix module.  Patch by Ross Lagerwall.
8119

8120 8121 8122
- Issue #7322: Trying to read from a socket's file-like object after a timeout
  occurred now raises an error instead of silently losing data.

8123
- Issue #11291: poplib.POP no longer suppresses errors on quit().
8124

8125
- Issue #11177: asyncore's create_socket() arguments can now be omitted.
8126

8127 8128 8129 8130 8131
- Issue #6064: Add a ``daemon`` keyword argument to the threading.Thread
  and multiprocessing.Process constructors in order to override the
  default behaviour of inheriting the daemonic property from the current
  thread/process.

8132 8133 8134
- Issue #10956: Buffered I/O classes retry reading or writing after a signal
  has arrived and the handler returned successfully.

8135 8136
- Issue #10784: New os.getpriority() and os.setpriority() functions.

8137 8138 8139 8140
- Issue #11114: Fix catastrophic performance of tell() on text files (up
  to 1000x faster in some cases).  It is still one to two order of magnitudes
  slower than binary tell().

8141
- Issue #10882: Add os.sendfile function.
8142

8143 8144 8145
- Issue #10868: Allow usage of the register method of an ABC as a class
  decorator.

8146 8147 8148 8149
- Issue #11224: Fixed a regression in tarfile that affected the file-like
  objects returned by TarFile.extractfile() regarding performance, memory
  consumption and failures with the stream interface.

8150 8151 8152 8153
- Issue #10924: Adding salt and Modular Crypt Format to crypt library.
  Moved old C wrapper to _crypt, and added a Python wrapper with
  enhanced salt generation and simpler API for password generation.

8154 8155
- Issue #11074: Make 'tokenize' so it can be reloaded.

8156 8157 8158 8159 8160
- Issue #11085: Moved collections abstract base classes into a separate
  module called collections.abc, following the pattern used by importlib.abc.
  For backwards compatibility, the names are imported into the collections
  module.

8161 8162 8163 8164
- Issue #4681: Allow mmap() to work on file sizes and offsets larger than
  4GB, even on 32-bit builds.  Initial patch by Ross Lagerwall, adapted for
  32-bit Windows.

8165 8166 8167
- Issue #11169: compileall module uses repr() to format filenames and paths to
  escape surrogate characters and show spaces.

8168
- Issue #11089: Fix performance issue limiting the use of ConfigParser()
8169
  with large config files.
8170

8171 8172 8173
- Issue #10276: Fix the results of zlib.crc32() and zlib.adler32() on buffers
  larger than 4GB.  Patch by Nadeem Vawda.

8174 8175
- Issue #11388: Added a clear() method to MutableSequence

8176 8177 8178
- Issue #11174: Add argparse.MetavarTypeHelpFormatter, which uses type names
  for the names of optional and positional arguments in help messages.

8179 8180
- Issue #9348: Raise an early error if argparse nargs and metavar don't match.

8181 8182
- Issue #9026: Fix order of argparse sub-commands in help messages.

8183 8184
- Issue #9347: Fix formatting for tuples in argparse type= error messages.

8185 8186 8187
- Issue #12191: Added shutil.chown() to change user and/or group owner of a
  given path also specifying their names.

8188 8189 8190
- Issue #13988: The _elementtree accelerator is used whenever available.
  Now xml.etree.cElementTree becomes a deprecated alias to ElementTree.

8191 8192 8193
Build
-----

Martin v. Löwis's avatar
Martin v. Löwis committed
8194 8195
- Issue #6807: Run msisupport.mak earlier.

Martin v. Löwis's avatar
Martin v. Löwis committed
8196 8197
- Issue #10580: Minor grammar change in Windows installer.

8198 8199
- Issue #13326: Clean __pycache__ directories correctly on OpenBSD.

8200 8201
- PEP 393: the configure option --with-wide-unicode is removed.

8202 8203 8204
- Issue #12852: Set _XOPEN_SOURCE to 700, instead of 600, to get POSIX 2008
  functions on OpenBSD (e.g. fdopendir).

8205 8206 8207 8208
- Issue #11863: Remove support for legacy systems deprecated in Python 3.2
  (following PEP 11).  These systems are systems using Mach C Threads,
  SunOS lightweight processes, GNU pth threads and IRIX threads.

8209 8210
- Issue #8746: Correct faulty configure checks so that os.chflags() and
  os.lchflags() are once again built on systems that support these
Georg Brandl's avatar
Georg Brandl committed
8211
  functions (BSD and OS X).  Also add new stat file flags for OS X
8212 8213
  (UF_HIDDEN and UF_COMPRESSED).

8214
- Issue #10645: Installing Python no longer creates a
8215 8216
  Python-X.Y.Z-pyX.Y.egg-info file in the lib-dynload directory.

8217 8218 8219
- Do not accidentally include the directory containing sqlite.h twice when
  building sqlite3.

8220 8221 8222 8223
- Issue #11217: For 64-bit/32-bit Mac OS X universal framework builds,
  ensure "make install" creates symlinks in --prefix bin for the "-32"
  files in the framework bin directory like the installer does.

8224
- Issue #11347: Use --no-as-needed when linking libpython3.so.
8225

Thomas Wouters's avatar
Thomas Wouters committed
8226
- Issue #11411: Fix 'make DESTDIR=' with a relative destination.
Georg Brandl's avatar
Georg Brandl committed
8227

8228 8229
- Issue #11268: Prevent Mac OS X Installer failure if Documentation
  package had previously been installed.
8230

8231
- Issue #11495: OSF support is eliminated. It was deprecated in Python 3.2.
8232

8233 8234 8235
IDLE
----

8236 8237 8238 8239 8240 8241 8242 8243 8244 8245 8246 8247 8248 8249 8250 8251 8252 8253 8254 8255 8256 8257 8258 8259 8260 8261 8262 8263 8264 8265 8266 8267 8268 8269 8270 8271 8272 8273 8274 8275 8276 8277 8278 8279 8280 8281 8282 8283 8284 8285 8286 8287
- Issue #14409: IDLE now properly executes commands in the Shell window
  when it cannot read the normal config files on startup and
  has to use the built-in default key bindings.
  There was previously a bug in one of the defaults.

- IDLE can be launched as python -m idlelib

- Issue #3573: IDLE hangs when passing invalid command line args
  (directory(ies) instead of file(s)) (Patch by Guilherme Polo)

- Issue #14200: IDLE shell crash on printing non-BMP unicode character.

- Issue #5219: Prevent event handler cascade in IDLE.

- Issue #964437: Make IDLE help window non-modal.
  Patch by Guilherme Polo and Roger Serwy.

- Issue #13933: IDLE auto-complete did not work with some imported
  module, like hashlib.  (Patch by Roger Serwy)

- Issue #13506: Add '' to path for IDLE Shell when started and restarted with Restart Shell.
  Original patches by Marco Scataglini and Roger Serwy.

- Issue #4625: If IDLE cannot write to its recent file or breakpoint files,
  display a message popup and continue rather than crash.  Original patch by
  Roger Serwy.

- Issue #8641: Update IDLE 3 syntax coloring to recognize b".." and not u"..".
  Patch by Tal Einat.

- Issue #13296: Fix IDLE to clear compile __future__ flags on shell restart.
  (Patch by Roger Serwy)

- Issue #9871: Prevent IDLE 3 crash when given byte stings
  with invalid hex escape sequences, like b'\x0'.
  (Original patch by Claudiu Popa.)

- Issue #12636: IDLE reads the coding cookie when executing a Python script.

- Issue #12540: Prevent zombie IDLE processes on Windows due to changes
  in os.kill().

- Issue #12590: IDLE editor window now always displays the first line
  when opening a long file.  With Tk 8.5, the first line was hidden.

- Issue #11088: don't crash when using F5 to run a script in IDLE on MacOSX
  with Tk 8.5.

- Issue #1028: Tk returns invalid Unicode null in %A: UnicodeDecodeError.
  With Tk < 8.5 _tkinter.c:PythonCmd() raised UnicodeDecodeError, caused
  IDLE to exit.  Converted to valid Unicode null in PythonCmd().

8288 8289
- Issue #11718: IDLE's open module dialog couldn't find the __init__.py
  file in a package.
8290

8291 8292 8293
Tools/Demos
-----------

8294 8295 8296
- Issue #14053: patchcheck.py ("make patchcheck") now works with MQ patches.
  Patch by Francisco Martín Brugué.

8297 8298 8299 8300 8301
- Issue #13930: 2to3 is now able to write its converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.  See its new -o, -W and --add-suffix options.  This makes it more
  useful in many automated code translation workflows.

8302 8303 8304
- Issue #13628: python-gdb.py is now able to retrieve more frames in the Python
  traceback if Python is optimized.

8305 8306 8307
- Issue #11996: libpython (gdb), replace "py-bt" command by "py-bt-full" and
  add a smarter "py-bt" command printing a classic Python traceback.

8308 8309
- Issue #11179: Make ccbench work under Python 3.1 and 2.7 again.

8310 8311
- Issue #10639: reindent.py no longer converts newlines and will raise
  an error if attempting to convert a file with mixed newlines.
8312
  "--newline" option added to specify new line character.
8313

Ezio Melotti's avatar
Ezio Melotti committed
8314 8315
Extension Modules
-----------------
8316

8317 8318 8319 8320
- Issue #16847: Fixed improper use of _PyUnicode_CheckConsistency() in
  non-pydebug builds. Several extension modules now compile cleanly when
  assert()s are enabled in standard builds (-DDEBUG flag).

8321 8322 8323
- Issue #13840: The error message produced by ctypes.create_string_buffer
  when given a Unicode string has been fixed.

8324 8325 8326
- Issue #9975: socket: Fix incorrect use of flowinfo and scope_id. Patch by
  Vilmos Nebehaj.

8327 8328
- Issue #7777: socket: Add Reliable Datagram Sockets (PF_RDS) support.

8329 8330 8331
- Issue #13159: FileIO and BZ2Compressor/BZ2Decompressor now use a linear-time
  buffer growth strategy instead of a quadratic-time one.

8332 8333 8334
- Issue #10141: socket: Add SocketCAN (PF_CAN) support. Initial patch by
  Matthias Fuchs, updated by Tiago Gonçalves.

8335 8336 8337 8338
- Issue #13070: Fix a crash when a TextIOWrapper caught in a reference cycle
  would be finalized after the reference to its underlying BufferedRWPair's
  writer got cleared by the GC.

8339 8340
- Issue #12881: ctypes: Fix segfault with large structure field names.

8341 8342 8343
- Issue #13058: ossaudiodev: fix a file descriptor leak on error. Patch by
  Thomas Jarosch.

8344 8345 8346
- Issue #13013: ctypes: Fix a reference leak in PyCArrayType_from_ctype.
  Thanks to Suman Saha for finding the bug and providing a patch.

8347 8348 8349
- Issue #13022: Fix: _multiprocessing.recvfd() doesn't check that
  file descriptor was actually received.

8350 8351 8352
- Issue #1172711: Add 'long long' support to the array module.
  Initial patch by Oren Tirosh and Hirokazu Yamamoto.

8353 8354 8355
- Issue #12483: ctypes: Fix a crash when the destruction of a callback
  object triggers the garbage collector.

Jesus Cea's avatar
NEWS  
Jesus Cea committed
8356 8357 8358
- Issue #12950: Fix passing file descriptors in multiprocessing, under
  OpenIndiana/Illumos.

8359 8360 8361
- Issue #12764: Fix a crash in ctypes when the name of a Structure field is not
  a string.

Amaury Forgeot d'Arc's avatar
Amaury Forgeot d'Arc committed
8362 8363 8364 8365 8366
- Issue #11241: subclasses of ctypes.Array can now be subclassed.

- Issue #9651: Fix a crash when ctypes.create_string_buffer(0) was passed to
  some functions like file.write().

8367 8368 8369 8370
- Issue #10309: Define _GNU_SOURCE so that mremap() gets the proper
  signature.  Without this, architectures where sizeof void* != sizeof int are
  broken.  Patch given by Hallvard B Furuseth.

Ezio Melotti's avatar
Ezio Melotti committed
8371 8372
- Issue #12051: Fix segfault in json.dumps() while encoding highly-nested
  objects using the C accelerations.
8373

Ezio Melotti's avatar
Ezio Melotti committed
8374 8375
- Issue #12017: Fix segfault in json.loads() while decoding highly-nested
  objects using the C accelerations.
8376

Benjamin Peterson's avatar
Benjamin Peterson committed
8377 8378
- Issue #1838: Prevent segfault in ctypes, when _as_parameter_ on a class is set
  to an instance of the class.
8379

8380
Tests
8381
-----
8382

8383 8384 8385 8386 8387 8388 8389 8390 8391 8392 8393 8394 8395 8396 8397 8398 8399 8400 8401 8402 8403 8404 8405 8406 8407 8408 8409
- Issue #13125: Silence spurious test_lib2to3 output when in non-verbose mode.
  Patch by Mikhail Novikov.

- Issue #13447: Add a test file to host regression tests for bugs in the
  scripts found in the Tools directory.

- Issue #10881: Fix test_site failure with OS X framework builds.

- Issue #13901: Prevent test_distutils failures on OS X with --enable-shared.

- Issue #13862: Fix spurious failure in test_zlib due to runtime/compile time
  minor versions not matching.

- Issue #12804: Fix test_socket and test_urllib2net failures when running tests
  on a system without internet access.

- Issue #13726: Fix the ambiguous -S flag in regrtest. It is -o/--slow for slow
  tests.

- Issue #11659: Fix ResourceWarning in test_subprocess introduced by #11459.
  Patch by Ben Hayden.

- Issue #11577: fix ResourceWarning triggered by improved binhex test coverage

- Issue #11509: Significantly increase test coverage of fileinput.
  Patch by Denver Coneybeare at PyCon 2011 Sprints.

Petri Lehtinen's avatar
Petri Lehtinen committed
8410 8411
- Issue #11689: Fix a variable scoping error in an sqlite3 test

8412 8413
- Issue #13786: Remove unimplemented 'trace' long option from regrtest.py.

Meador Inge's avatar
Meador Inge committed
8414 8415 8416
- Issue #13725: Fix regrtest to recognize the documented -d flag.
  Patch by Erno Tukia.

8417 8418 8419
- Issue #13304: Skip test case if user site-packages disabled (-s or
  PYTHONNOUSERSITE).  (Patch by Carl Meyer)

8420 8421 8422
- Issue #5661: Add a test for ECONNRESET/EPIPE handling to test_asyncore. Patch
  by Xavier de Gaye.

8423 8424
- Issue #13218: Fix test_ssl failures on Debian/Ubuntu.

8425 8426 8427
- Re-enable lib2to3's test_parser.py tests, though with an expected failure
  (see issue 13125).

8428 8429
- Issue #12656: Add tests for IPv6 and Unix sockets to test_asyncore.

8430 8431
- Issue #6484: Add unit tests for mailcap module (patch by Gregory Nofi)

8432 8433 8434 8435 8436
- Issue #11651: Improve the Makefile test targets to run more of the test suite
  more quickly. The --multiprocess option is now enabled by default, reducing
  the amount of time needed to run the tests. "make test" and "make quicktest"
  now include some resource-intensive tests, but no longer run the test suite
  twice to check for bugs in .pyc generation. Tools/scripts/run_test.py provides
Éric Araujo's avatar
Éric Araujo committed
8437
  an easy platform-independent way to run test suite with sensible defaults.
8438

8439 8440 8441
- Issue #12331: The test suite for the packaging module can now run from an
  installed Python.

8442 8443 8444
- Issue #12331: The test suite for lib2to3 can now run from an installed
  Python.

8445 8446 8447 8448 8449
- Issue #12626: In regrtest, allow to filter tests using a glob filter
  with the ``-m`` (or ``--match``) option.  This works with all test cases
  using the unittest module.  This is useful with long test suites
  such as test_io or test_subprocess.

8450 8451 8452 8453 8454
- Issue #12624: It is now possible to fail after the first failure when
  running in verbose mode (``-v`` or ``-W``), by using the ``--failfast``
  (or ``-G``) option to regrtest.  This is useful with long test suites
  such as test_io or test_subprocess.

8455 8456 8457
- Issue #12587: Correct faulty test file and reference in test_tokenize.
  (Patch by Robert Xiao)

8458 8459
- Issue #12573: Add resource checks for dangling Thread and Process objects.

8460 8461 8462
- Issue #12549: Correct test_platform to not fail when OS X returns 'x86_64'
  as the processor type on some Mac systems.

8463 8464 8465
- Skip network tests when getaddrinfo() returns EAI_AGAIN, meaning a temporary
  failure in name resolution.

8466 8467 8468
- Issue #11812: Solve transient socket failure to connect to 'localhost'
  in test_telnetlib.py.

8469 8470
- Solved a potential deadlock in test_telnetlib.py. Related to issue #11812.

8471 8472 8473 8474
- Avoid failing in test_robotparser when mueblesmoraleda.com is flaky and
  an overzealous DNS service (e.g. OpenDNS) redirects to a placeholder
  Web site.

8475 8476 8477 8478
- Avoid failing in test_urllibnet.test_bad_address when some overzealous
  DNS service (e.g. OpenDNS) resolves a non-existent domain name.  The test
  is now skipped instead.

8479 8480 8481 8482
- Issue #12440: When testing whether some bits in SSLContext.options can be
  reset, check the version of the OpenSSL headers Python was compiled against,
  rather than the runtime version of the OpenSSL library.

8483 8484
- Issue #11512: Add a test suite for the cgitb module. Patch by Robbie Clemons.

8485 8486 8487 8488
- Issue #12497: Install test/data to prevent failures of the various codecmaps
  tests.

- Issue #12496: Install test/capath directory to prevent test_connect_capath
8489 8490
  testcase failure in test_ssl.

8491 8492 8493 8494
- Issue #12469: Run wakeup and pending signal tests in a subprocess to run the
  test in a fresh process with only one thread and to not change signal
  handling of the parent process.

8495 8496 8497 8498
- Issue #8716: Avoid crashes caused by Aqua Tk on OSX when attempting to run
  test_tk or test_ttk_guionly under a username that is not currently logged
  in to the console windowserver (as may be the case under buildbot or ssh).

8499 8500
- Issue #12407: Explicitly skip test_capi.EmbeddingTest under Windows.

8501 8502 8503 8504
- Issue #12400: regrtest -W doesn't rerun the tests twice anymore, but captures
  the output and displays it on failure instead. regrtest -v doesn't print the
  error twice anymore if there is only one error.

8505 8506 8507 8508 8509
- Issue #12141: Install copies of template C module file so that
  test_build_ext of test_distutils and test_command_build_ext of
  test_packaging are no longer silently skipped when
  run outside of a build directory.

8510 8511 8512
- Issue #8746: Add additional tests for os.chflags() and os.lchflags().
  Patch by Garrett Cooper.

8513 8514 8515
- Issue #10736: Fix test_ttk test_widgets failures with Cocoa Tk 8.5.9
  2.8 +  on Mac OS X.  (Patch by Ronald Oussoren)

8516 8517 8518
- Issue #12057: Add tests for ISO 2022 codecs (iso2022_jp, iso2022_jp_2,
  iso2022_kr).

8519 8520 8521
- Issue #12096: Fix a race condition in test_threading.test_waitfor(). Patch
  written by Charles-François Natali.

8522 8523 8524
- Issue #11614: import __hello__ prints "Hello World!". Patch written by
  Andreas Stührk.

Ezio Melotti's avatar
Ezio Melotti committed
8525 8526
- Issue #5723: Improve json tests to be executed with and without accelerations.

8527 8528
- Issue #12041: Make test_wait3 more robust.

8529 8530 8531
- Issue #11873: Change regex in test_compileall to fix occasional failures when
  when the randomly generated temporary path happened to match the regex.

8532 8533 8534
- Issue #11958: Fix FTP tests for IPv6, bind to "::1" instead of "localhost".
  Patch written by Charles-Francois Natali.

8535 8536 8537 8538
- Issue #8407, #11859: Fix tests of test_io using threads and an alarm: use
  pthread_sigmask() to ensure that the SIGALRM signal is received by the main
  thread.

8539 8540 8541 8542
- Issue #11811: Factor out detection of IPv6 support on the current host
  and make it available as ``test.support.IPV6_ENABLED``.  Patch by
  Charles-François Natali.

Antoine Pitrou's avatar
Antoine Pitrou committed
8543 8544
- Issue #10914: Add a minimal embedding test to test_capi.

8545 8546 8547 8548 8549 8550
- Issue #11223: Skip test_lock_acquire_interruption() and
  test_rlock_acquire_interruption() of test_threadsignals if a thread lock is
  implemented using a POSIX mutex and a POSIX condition variable. A POSIX
  condition variable cannot be interrupted by a signal (e.g. on Linux, the
  futex system call is restarted).

8551 8552
- Issue #11790: Fix sporadic failures in test_multiprocessing.WithProcessesTestCondition.

8553 8554
- Fix possible "file already exists" error when running the tests in parallel.

Ross Lagerwall's avatar
Ross Lagerwall committed
8555 8556
- Issue #11719: Fix message about unexpected test_msilib skip on non-Windows
  platforms. Patch by Nadeem Vawda.
8557

8558 8559
- Issue #11727: Add a --timeout option to regrtest: if a test takes more than
  TIMEOUT seconds, dumps the traceback of all threads and exits.
8560

8561 8562
- Issue #11653: fix -W with -j in regrtest.

8563 8564 8565 8566 8567
- The email test suite now lives in the Lib/test/test_email package.  The test
  harness code has also been modernized to allow use of new unittest features.

- regrtest now discovers test packages as well as test modules.

8568
- Issue #11577: improve test coverage of binhex.py. Patch by Arkady Koplyarov.
8569

8570 8571 8572
- New test_crashers added to exercise the scripts in the Lib/test/crashers
  directory and confirm they fail as expected

Éric Araujo's avatar
Éric Araujo committed
8573
- Issue #11578: added test for the timeit module.  Patch by Michael Henry.
8574

8575 8576
- Issue #11503: improve test coverage of posixpath.py. Patch by Evan Dandrea.

8577 8578
- Issue #11505: improves test coverage of string.py, increases granularity of
  string.Formatter tests. Initial patch by Alicia Arlen.
8579

Nick Coghlan's avatar
Nick Coghlan committed
8580 8581 8582
- Issue #11548: Improve test coverage of the shutil module. Patch by
  Evan Dandrea.

8583 8584
- Issue #11554: Reactivated test_email_codecs.

8585 8586
- Issue #11505: improves test coverage of string.py. Patch by Alicia
  Arlen
8587

8588
- Issue #11490: test_subprocess.test_leaking_fds_on_error no longer gives a
8589 8590
  false positive if the last directory in the path is inaccessible.

8591 8592 8593
- Issue #11223: Fix test_threadsignals to fail, not hang, when the
  non-semaphore implementation of locks is used under POSIX.

8594 8595 8596
- Issue #10911: Add tests on CGI with non-ASCII characters. Patch written by
  Pierre Quentel.

8597 8598 8599
- Issue #9931: Fix hangs in GUI tests under Windows in certain conditions.
  Patch by Hirokazu Yamamoto.

8600 8601
- Issue #10512: Properly close sockets under test.test_cgi.

8602 8603
- Issue #10992: Make tests pass under coverage.

8604 8605 8606
- Issue #10826: Prevent sporadic failure in test_subprocess on Solaris due
  to open door files.

8607 8608
- Issue #10990: Prevent tests from clobbering a set trace function.

8609 8610 8611
C-API
-----

8612 8613 8614 8615 8616 8617 8618 8619 8620 8621 8622 8623 8624 8625 8626 8627 8628
- Issue #13452: PyUnicode_EncodeDecimal() doesn't support error handlers
  different than "strict" anymore. The caller was unable to compute the
  size of the output buffer: it depends on the error handler.

- Issue #13560: Add PyUnicode_DecodeLocale(), PyUnicode_DecodeLocaleAndSize()
  and PyUnicode_EncodeLocale() functions to the C API to decode/encode from/to
  the current locale encoding.

- Issue #10831: PyUnicode_FromFormat() supports %li, %lli and %zi formats.

- Issue #11246: Fix PyUnicode_FromFormat("%V") to decode the byte string from
  UTF-8 (with replace error handler) instead of ISO-8859-1 (in strict mode).
  Patch written by Ray Allen.

- Issue #10830: Fix PyUnicode_FromFormatV("%c") for non-BMP characters on
  narrow build.

8629 8630 8631 8632
- Add PyObject_GenericGetDict and PyObject_GeneriSetDict. They are generic
  implementations for the getter and setter of a ``__dict__`` descriptor of C
  types.

8633 8634 8635 8636
- Issue #13727: Add 3 macros to access PyDateTime_Delta members:
  PyDateTime_DELTA_GET_DAYS, PyDateTime_DELTA_GET_SECONDS,
  PyDateTime_DELTA_GET_MICROSECONDS.

8637 8638 8639 8640
- Issue #10542: Add 4 macros to work with surrogates: Py_UNICODE_IS_SURROGATE,
  Py_UNICODE_IS_HIGH_SURROGATE, Py_UNICODE_IS_LOW_SURROGATE,
  Py_UNICODE_JOIN_SURROGATES.

Brian Curtin's avatar
Brian Curtin committed
8641 8642
- Issue #12724: Add Py_RETURN_NOTIMPLEMENTED macro for returning NotImplemented.

Benjamin Peterson's avatar
Benjamin Peterson committed
8643 8644
- PY_PATCHLEVEL_REVISION has been removed, since it's meaningless with
  Mercurial.
8645

8646
- Issue #12173: The first argument of PyImport_ImportModuleLevel is now `const
Benjamin Peterson's avatar
Benjamin Peterson committed
8647
  char *` instead of `char *`.
8648

8649 8650
- Issue #12380: PyArg_ParseTuple now accepts a bytearray for the 'c' format.

8651 8652 8653
Documentation
-------------

8654 8655 8656 8657 8658 8659 8660 8661 8662 8663 8664 8665 8666 8667 8668
- Issue #13989: Document that GzipFile does not support text mode, and give a
  more helpful error message when opened with an invalid mode string.

- Issue #13921: Undocument and clean up sqlite3.OptimizedUnicode,
  which is obsolete in Python 3.x. It's now aliased to str for
  backwards compatibility.

- Issue #12102: Document that buffered files must be flushed before being used
  with mmap. Patch by Steffen Daode Nurpmeso.

- Issue #8982: Improve the documentation for the argparse Namespace object.

- Issue #9343: Document that argparse parent parsers must be configured before
  their children.

Hynek Schlawack's avatar
Hynek Schlawack committed
8669 8670
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.
8671

Petri Lehtinen's avatar
Petri Lehtinen committed
8672 8673
- Issues #13491 and #13995: Fix many errors in sqlite3 documentation.
  Initial patch for #13491 by Johannes Vogel.
Petri Lehtinen's avatar
Petri Lehtinen committed
8674

Petri Lehtinen's avatar
Petri Lehtinen committed
8675 8676
- Issue #13402: Document absoluteness of sys.executable.

8677 8678
- Issue #13883: PYTHONCASEOK also works on OS X.

8679 8680 8681 8682 8683 8684 8685
- Issue #9021: Add an introduction to the copy module documentation.

- Issue #6005: Examples in the socket library documentation use sendall, where
  relevant, instead send method.

- Issue #12798: Updated the mimetypes documentation.

8686 8687 8688
- Issue #12949: Document the kwonlyargcount argument for the PyCode_New
  C API function.

8689 8690 8691
- Issue #13513: Fix io.IOBase documentation to correctly link to the
  io.IOBase.readline method instead of the readline module.

8692 8693 8694
- Issue #13237: Reorganise subprocess documentation to emphasise convenience
  functions and the most commonly needed arguments to Popen.

Florent Xicluna's avatar
Florent Xicluna committed
8695 8696
- Issue #13141: Demonstrate recommended style for socketserver examples.

8697 8698
- Issue #11818: Fix tempfile examples for Python 3.

Georg Brandl's avatar
Georg Brandl committed
8699

8700
**(For information about older versions, consult the HISTORY file.)**