NEWS 321 KB
Newer Older
Georg Brandl's avatar
Georg Brandl committed
1
+++++++++++
2
Python News
3 4
+++++++++++

5 6 7
What's New in Python 3.4.1?
===========================

8 9 10
Core and Builtins
-----------------

11 12 13
- Issue #20731: Properly position in source code files even if they
  are opened in text mode. Patch by Serhiy Storchaka.

14 15 16
- Issue #20637: Key-sharing now also works for instance dictionaries of
  subclasses.  Patch by Peter Ingebretson.

17 18 19
- Issue #20786: Fix signatures for dict.__delitem__ and
  property.__delete__ builtins.

20 21 22
Library
-------

23 24 25 26
- Issue #20283: RE pattern methods now accept the string keyword parameters
  as documented.  The pattern and source keyword parameters are left as
  deprecated aliases.

27 28 29 30
- Issue #20839: Don't trigger a DeprecationWarning in the still supported
  pkgutil.get_loader() API when __loader__ isn't set on a module (nor
  when pkgutil.find_loader() is called directly).

31 32
- Issue #20778: Fix modulefinder to work with bytecode-only modules.

33 34 35
- Issue #20791: copy.copy() now doesn't make a copy when the input is
  a bytes object.  Initial patch by Peter Otten.

36 37 38
- Issue #19748: On AIX, time.mktime() now raises an OverflowError for year
  outsize range [1902; 2037].

39 40 41 42 43 44
Documentation
-------------

- Issue #20765: Add missing documentation for PurePath.with_name() and
  PurePath.with_suffix().

45 46 47 48 49
Tests
-----

- Issue #20743: Fix a reference leak in test_tcl.

50 51 52
Build
-----

53 54
- Issue #14512: Launch pydoc -b instead of pydocgui.pyw on Windows.

55 56 57
- Issue #20748: Uninstalling pip does not leave behind the pyc of
  the uninstaller anymore.

58 59 60
- Issue #20568: The Windows installer now installs the unversioned ``pip``
  command in addition to the versioned ``pip3`` and ``pip3.4`` commands.

61 62 63 64
- Issue #20757: The ensurepip helper for the Windows uninstaller now skips
  uninstalling pip (rather than failing) if the user has updated pip to a
  different version from the one bundled with ensurepip.

65 66
- Issue #20465: Update OS X and Windows installer builds to use 
  SQLite 3.8.3.1.
67

68 69 70 71 72 73
Tools/Demos
-----------

- Issue #20535: PYTHONWARNING no longer affects the run_tests.py script.
  Patch by Arfrever Frehtes Taifersar Arahesis.

74

75 76 77 78 79 80 81 82
What's New in Python 3.4.0 release candidate 2?
===============================================

Release date: 2014-02-23

Core and Builtins
-----------------

83 84 85
- Issue #20261: In pickle, lookup __getnewargs__ and __getnewargs_ex__ on the
  type of the object.

86 87 88
- Issue #20619: Give the AST nodes of keyword-only arguments a column and line
  number.

89 90 91 92
- Issue #20526: Revert changes of issue #19466 which introduces a regression:
  don't clear anymore the state of Python threads early during the Python
  shutdown.

93 94
- Issue #20595: Make getargs.c C89 compliant.

95 96 97
- Issue #20625: Parameter names in __annotations__ were not mangled properly.
  Discovered by Jonas Wielicki, patch by Yury Selivanov.

98 99
Library
-------
100 101 102

- Issue #20710: The pydoc summary line no longer displays the "self" parameter
  for bound methods.
103

104 105
- Issue #20654: Fixed pydoc for enums with zero value.  Patch by Vajrasky Kok.

106 107 108
- Issue #20635: Fixed grid_columnconfigure() and grid_rowconfigure() methods of
  Tkinter widgets to work in wantobjects=True mode.

109 110 111 112
- Issue #19612: On Windows, subprocess.Popen.communicate() now ignores
  OSError(22, 'Invalid argument') when writing input data into stdin, whereas
  the process already exited.

113 114 115
- Issue #20320: select.select() and select.kqueue.control() now round the
  timeout aways from zero, instead of rounding towards zero.

116 117
- Issue #20616: Add a format() method to tracemalloc.Traceback.

118 119 120 121
- Issue #19744: the ensurepip installation step now just prints a warning to
  stderr rather than failing outright if SSL/TLS is unavailable. This allows
  local installation of POSIX builds without SSL/TLS support.

122 123 124
- Issue #6815: os.path.expandvars() now supports non-ASCII environment
  variables names and values.

125 126 127
- Issue #17671: Fixed a crash when use non-initialized io.BufferedRWPair.
  Based on patch by Stephen Tu.

128
- Issue #8478: Untokenizer.compat processes first token from iterator input.
129
  Patch based on lines from Georg Brandl, Eric Snow, and Gareth Rees.
130

Benjamin Peterson's avatar
Benjamin Peterson committed
131 132
- Issue #20594: Avoid name clash with the libc function posix_close.

Serhiy Storchaka's avatar
Serhiy Storchaka committed
133 134 135
- Issue #19856: shutil.move() failed to move a directory to other directory
  on Windows if source name ends with os.altsep.

136 137 138 139
- Issue #20673: Implement support for UNIX Domain Sockets in asyncio.
  New APIs: loop.create_unix_connection(), loop.create_unix_server(),
  streams.open_unix_connection(), and streams.start_unix_server().

140 141 142 143
- Issue #20681: Add new error handling API in asyncio. New APIs:
  loop.set_exception_handler(), loop.default_exception_handler(), and
  loop.call_exception_handler().

144 145 146 147
- Issue #20684: Fix inspect.getfullargspec() to not to follow __wrapped__
  chains. Make its behaviour consistent with bound methods first argument.
  Patch by Nick Coghlan and Yury Selivanov.

148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166
- Issue #20566: Change asyncio.as_completed() to use a Queue, to
  avoid O(N**2) behavior.

- Issue #20704: Implement new debug API in asyncio. Add new methods
  BaseEventLoop.set_debug() and BaseEventLoop.get_debug().
  Add support for setting 'asyncio.tasks._DEBUG' variable with
  'PYTHONASYNCIODEBUG' environment variable.

- asyncio: Refactoring and fixes: BaseEventLoop.sock_connect() raises an
  error if the address is not resolved; use __slots__ in Handle and
  TimerHandle; as_completed() and wait() raise TypeError if the passed
  list of Futures is a single Future; call_soon() and other 'call_*()'
  functions raise TypeError if the passed callback is a coroutine
  function; _ProactorBasePipeTransport uses _FlowControlMixin;
  WriteTransport.set_write_buffer_size() calls _maybe_pause_protocol()
  to consider pausing receiving if the watermark limits have changed;
  fix _check_resolved_address() for IPv6 address; and other minor
  improvements, along with multiple documentation updates.

167 168 169
Tests
-----

Zachary Ware's avatar
Zachary Ware committed
170 171 172 173
- Issue #20510: Rewrote test_exit in test_sys to match existing comments,
  use modern unittest features, and use helpers from test.script_helper
  instead of using subprocess directly.  Patch by Gareth Rees.

174 175
- Issue #20605: Make test_socket getaddrinfo OS X segfault test more robust.

Zachary Ware's avatar
Zachary Ware committed
176 177 178
Build
-----

179 180 181
- Issue #20641: Run MSI custom actions (pip installation, pyc compilation)
  with the NoImpersonate flag, to support elevated execution (UAC).

182 183 184
- Issue #20221: Removed conflicting (or circular) hypot definition when
  compiled with VS 2010 or above.  Initial patch by Tabrez Mohammed.

Zachary Ware's avatar
Zachary Ware committed
185 186 187
- Issue #20609: Restored the ability to build 64-bit Windows binaries on
  32-bit Windows, which was broken by the change in issue #19788.

188

189 190 191
What's New in Python 3.4.0 release candidate 1?
===============================================

192
Release date: 2014-02-10
193 194 195 196

Core and Builtins
-----------------

197 198 199
- Issue #19255: The builtins module is restored to initial value before
  cleaning other modules.  The sys and builtins modules are cleaned last.

200 201
- Issue #20588: Make Python-ast.c C89 compliant.

202
- Issue #20437: Fixed 22 potential bugs when deleting objects references.
203

204 205 206 207
- Issue #20500: Displaying an exception at interpreter shutdown no longer
  risks triggering an assertion failure in PyObject_Str.

- Issue #20538: UTF-7 incremental decoder produced inconsistent string when
208 209
  input was truncated in BASE64 section.

210 211 212 213 214 215
- Issue #20404: io.TextIOWrapper (and hence the open() builtin) now uses the
  internal codec marking system added for issue #19619 to throw LookupError
  for known non-text encodings at stream construction time. The existing
  output type checks remain in place to deal with unmarked third party
  codecs.

216 217
- Issue #17162: Add PyType_GetSlot.

218 219 220
- Issue #20162: Fix an alignment issue in the siphash24() hash function which
  caused a crash on PowerPC 64-bit (ppc64).

221 222 223
Library
-------

224 225 226
- Issue #20530: The signatures for slot builtins have been updated
  to reflect the fact that they only accept positional-only arguments.

227 228 229
- Issue #20517: Functions in the os module that accept two filenames
  now register both filenames in the exception on failure.

230 231
- Issue #20563: The ipaddress module API is now considered stable.

232 233 234 235
- Issue #14983: email.generator now always adds a line end after each MIME
  boundary marker, instead of doing so only when there is an epilogue.  This
  fixes an RFC compliance bug and solves an issue with signed MIME parts.

236 237 238 239 240
- Issue #20540: Fix a performance regression (vs. Python 3.2) when layering
  a multiprocessing Connection over a TCP socket.  For small payloads, Nagle's
  algorithm would introduce idle delays before the entire transmission of a
  message.

241 242 243
- Issue #16983: the new email header parsing code will now decode encoded words
  that are (incorrectly) surrounded by quotes, and register a defect.

244 245 246
- Issue #19772: email.generator no longer mutates the message object when
  doing a down-transform from 8bit to 7bit CTEs.

247 248 249
- Issue #20536: the statistics module now correctly handle Decimal instances
  with positive exponents

250
- Issue #18805: the netmask/hostmask parsing in ipaddress now more reliably
Nick Coghlan's avatar
Nick Coghlan committed
251
  filters out illegal values and correctly allows any valid prefix length.
252

253 254 255 256 257 258
- Issue #20481: For at least Python 3.4, the statistics module will require
  that all inputs for a single operation be of a single consistent type, or
  else a mixed of ints and a single other consistent type. This avoids
  some interoperability issues that arose with the previous approach of
  coercing to a suitable common type.

259 260 261
- Issue #20478: the statistics module now treats collections.Counter inputs
  like any other iterable.

262 263 264 265
- Issue #17369: get_filename was raising an exception if the filename
  parameter's RFC2231 encoding was broken in certain ways.  This was
  a regression relative to python2.

266 267 268 269
- Issue #20013: Some imap servers disconnect if the current mailbox is
  deleted, and imaplib did not handle that case gracefully.  Now it
  handles the 'bye' correctly.

270 271 272 273
- Issue #20531: Revert 3.4 version of fix for #19063, and apply the 3.3
  version.  That is, do *not* raise an error if unicode is passed to
  email.message.Message.set_payload.

274 275 276 277
- Issue #20476: If a non-compat32 policy is used with any of the email parsers,
  EmailMessage is now used as the factory class.  The factory class should
  really come from the policy; that will get fixed in 3.5.

278 279 280
- Issue #19920: TarFile.list() no longer fails when outputs a listing
  containing non-encodable characters.  Based on patch by Vajrasky Kok.

281 282
- Issue #20515: Fix NULL pointer dereference introduced by issue #20368.

283 284
- Issue #19186: Restore namespacing of expat symbols inside the pyexpat module.

285 286 287
- Issue #20053: ensurepip (and hence venv) are no longer affected by the
  settings in the default pip configuration file.

288 289 290
- Issue #20426: When passing the re.DEBUG flag, re.compile() displays the
  debug output every time it is called, regardless of the compilation cache.

291 292
- Issue #20368: The null character now correctly passed from Tcl to Python.
  Improved error handling in variables-related commands.
293

294 295
- Issue #20435: Fix _pyio.StringIO.getvalue() to take into account newline
  translation settings.
296

297 298
- tracemalloc: Fix slicing traces and fix slicing a traceback.

299 300 301
- Issue #20354: Fix an alignment issue in the tracemalloc module on 64-bit
  platforms. Bug seen on 64-bit Linux when using "make profile-opt".

302 303 304
- Issue #17159: inspect.signature now accepts duck types of functions,
  which adds support for Cython functions. Initial patch by Stefan Behnel.

305 306 307
- Issue #18801: Fix inspect.classify_class_attrs to correctly classify
  object.__new__ and object.__init__.

308 309
- Fixed cmath.isinf's name in its argument parsing code.

310 311 312 313 314
- Issue #20311, #20452: poll and epoll now round the timeout away from zero,
  instead of rounding towards zero, in select and selectors modules:
  select.epoll.poll(), selectors.PollSelector.poll() and
  selectors.EpollSelector.poll(). For example, a timeout of one microsecond
  (1e-6) is now rounded to one millisecondi (1e-3), instead of being rounded to
Guido van Rossum's avatar
Guido van Rossum committed
315 316
  zero.  However, the granularity property and asyncio's resolution feature
  were removed again.
317

Guido van Rossum's avatar
Guido van Rossum committed
318 319 320 321
- asyncio: Some refactoring; various fixes; add write flow control to
  unix pipes; Future.set_exception() instantiates the exception
  argument if it is a class; improved proactor pipe transport; support
  wait_for(f, None); don't log broken/disconnected pipes; use
Guido van Rossum's avatar
Guido van Rossum committed
322
  ValueError instead of assert for forbidden subprocess_{shell,exec}
Guido van Rossum's avatar
Guido van Rossum committed
323 324 325 326
  arguments; added a convenience API for subprocess management; added
  StreamReader.at_eof(); properly handle duplicate coroutines/futures
  in gather(), wait(), as_completed(); use a bytearray for buffering
  in StreamReader; and more.
Guido van Rossum's avatar
Guido van Rossum committed
327

328 329
- Issue #20288: fix handling of invalid numeric charrefs in HTMLParser.

330 331
- Issue #20424: Python implementation of io.StringIO now supports lone surrogates.

332 333 334
- Issue #20308: inspect.signature now works on classes without user-defined
  __init__ or __new__ methods.

335 336 337 338 339 340 341 342 343 344
- Issue #20372: inspect.getfile (and a bunch of other inspect functions that
  use it) doesn't crash with unexpected AttributeError on classes defined in C
  without __module__.

- Issue #20356: inspect.signature formatting uses '/' to separate
  positional-only parameters from others.

- Issue #20223: inspect.signature now supports methods defined with
  functools.partialmethods.

345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363
- Issue #19456: ntpath.join() now joins relative paths correctly when a drive
  is present.

- Issue #19077: tempfile.TemporaryDirectory cleanup no longer fails when
  called during shutdown.  Emitting resource warning in __del__ no longer fails.
  Original patch by Antoine Pitrou.

- Issue #20394: Silence Coverity warning in audioop module.

- Issue #20367: Fix behavior of concurrent.futures.as_completed() for
  duplicate arguments.  Patch by Glenn Langford.

- Issue #8260: The read(), readline() and readlines() methods of
  codecs.StreamReader returned incomplete data when were called after
  readline() or read(size).  Based on patch by Amaury Forgeot d'Arc.

- Issue #20105: the codec exception chaining now correctly sets the
  traceback of the original exception as its __traceback__ attribute.

364 365
- Issue #17481: inspect.getfullargspec() now uses inspect.signature() API.

366 367 368
- Issue #15304: concurrent.futures.wait() can block forever even if
  Futures have completed. Patch by Glenn Langford.

369 370 371 372
- Issue #14455: plistlib: fix serializing integers integers in the range
  of an unsigned long long but outside of the range of signed long long for
  binary plist files.

373 374 375
IDLE
----

376 377 378
- Issue #20406: Use Python application icons for Idle window title bars.
  Patch mostly by Serhiy Storchaka.

379 380 381
- Update the python.gif icon for the Idle classbrowser and pathbowser
  from the old green snake to the new new blue and yellow snakes.

382 383 384 385 386 387
- Issue #17721: Remove non-functional configuration dialog help button until we
  make it actually gives some help when clicked. Patch by Guilherme Simões.

Tests
-----

388 389
- Issue #20532: Tests which use _testcapi now are marked as CPython only.

390 391
- Issue #19920: Added tests for TarFile.list().  Based on patch by Vajrasky Kok.

392 393 394
- Issue #19990: Added tests for the imghdr module.  Based on patch by
  Claudiu Popa.

395 396
- Issue #20474: Fix test_socket "unexpected success" failures on OS X 10.7+.

397 398 399
Tools/Demos
-----------

400 401 402 403 404 405 406
- Issue #20530: Argument Clinic's signature format has been revised again.
  The new syntax is highly human readable while still preventing false
  positives.  The syntax also extends Python syntax to denote "self" and
  positional-only parameters, allowing inspect.Signature objects to be
  totally accurate for all supported builtins in Python 3.4.

- Issue #20456: Argument Clinic now observes the C preprocessor conditional
407 408 409 410
  compilation statements of the C files it parses.  When a Clinic block is
  inside a conditional code, it adjusts its output to match, including
  automatically generating an empty methoddef macro.

411
- Issue #20456: Cloned functions in Argument Clinic now use the correct
412 413 414
  name, not the name of the function they were cloned from, for text
  strings inside generated code.

415
- Issue #20456: Fixed Argument Clinic's test suite and "--converters" feature.
416

417
- Issue #20456: Argument Clinic now allows specifying different names
418 419
  for a parameter in Python and C, using "as" on the parameter line.

420 421 422 423 424 425 426 427 428
- Issue #20326: Argument Clinic now uses a simple, unique signature to
  annotate text signatures in docstrings, resulting in fewer false
  positives.  "self" parameters are also explicitly marked, allowing
  inspect.Signature() to authoritatively detect (and skip) said parameters.

- Issue #20326: Argument Clinic now generates separate checksums for the
  input and output sections of the block, allowing external tools to verify
  that the input has not changed (and thus the output is not out-of-date).

429 430 431 432 433
Build
-----

- Issue #20465: Update SQLite shipped with OS X installer to 3.8.3.

434 435 436 437
C-API
-----

- Issue #20517: Added new functions allowing OSError exceptions to reference
438 439
  two filenames instead of one: PyErr_SetFromErrnoWithFilenameObjects() and
  PyErr_SetExcFromWindowsErrWithFilenameObjects().
440

441 442 443
Documentation
-------------

Brett Cannon's avatar
Brett Cannon committed
444 445 446
- Issue #20488: Change wording to say importlib is *the* implementation of
  import instead of just *an* implementation.

447 448 449 450
- Issue #6386: Clarify in the tutorial that specifying a symlink to execute
  means the directory containing the executed script and not the symlink is
  added to sys.path.

451

452 453
What's New in Python 3.4.0 Beta 3?
==================================
454

Larry Hastings's avatar
Larry Hastings committed
455
Release date: 2014-01-26
456 457 458 459

Core and Builtins
-----------------

460 461 462 463
- Issue #20189: Four additional builtin types (PyTypeObject,
  PyMethodDescr_Type, _PyMethodWrapper_Type, and PyWrapperDescr_Type)
  have been modified to provide introspection information for builtins.

464 465 466
- Issue #17825: Cursor "^" is correctly positioned for SyntaxError and
  IndentationError.

467 468 469 470
- Issue #2382: SyntaxError cursor "^" is now written at correct position in most
  cases when multibyte characters are in line (before "^").  This still not
  works correctly with wide East Asian characters.

471 472 473 474 475 476 477
- Issue #18960: The first line of Python script could be executed twice when
  the source encoding was specified on the second line.  Now the source encoding
  declaration on the second line isn't effective if the first line contains
  anything except a comment.  'python -x' works now again with files with the
  source encoding declarations, and can be used to make Python batch files
  on Windows.

478 479 480
Library
-------

Guido van Rossum's avatar
Guido van Rossum committed
481 482 483 484 485 486 487
- asyncio: Various improvements and small changes not all covered by
  issues listed below.  E.g. wait_for() now cancels the inner task if
  the timeout occcurs; tweaked the set of exported symbols; renamed
  Empty/Full to QueueEmpty/QueueFull; "with (yield from lock)" now
  uses a separate context manager; readexactly() raises if not enough
  data was read; PTY support tweaks.

488 489 490 491 492
- Issue #20311: asyncio: Add a granularity attribute to BaseEventLoop: maximum
  between the resolution of the BaseEventLoop.time() method and the resolution
  of the selector. The granuarility is used in the scheduler to round time and
  deadline.

493 494
- Issue #20311: selectors: Add a resolution attribute to BaseSelector.

495 496 497 498
- Issue #20189: unittest.mock now no longer assumes that any object for
  which it could get an inspect.Signature is a callable written in Python.
  Fix courtesy of Michael Foord.

499 500 501 502 503 504
- Issue #20317: ExitStack.__exit__ could create a self-referential loop if an
  exception raised by a cleanup operation already had its context set
  correctly (for example, by the @contextmanager decorator). The infinite
  loop this caused is now avoided by checking if the expected context is
  already set before trying to fix it.

505 506
- Issue #20374: Fix build with GNU readline >= 6.3.

507 508 509
- Issue #20262: Warnings are raised now when duplicate names are added in the
  ZIP file or too long ZIP file comment is truncated.

510 511 512
- Issue #20165: The unittest module no longer considers tests marked with
  @expectedFailure successful if they pass.

513 514
- Issue #18574: Added missing newline in 100-Continue reply from
  http.server.BaseHTTPRequestHandler. Patch by Nikolaus Rath.
515

516 517
- Issue #20270: urllib.urlparse now supports empty ports.

518 519
- Issue #20243: TarFile no longer raise ReadError when opened in write mode.

520 521 522
- Issue #20238: TarFile opened with external fileobj and "w:gz" mode didn't
  write complete output on close.

523 524 525
- Issue #20245: The open functions in the tarfile module now correctly handle
  empty mode.

526 527 528
- Issue #20242: Fixed basicConfig() format strings for the alternative
  formatting styles. Thanks to kespindler for the bug report and patch.

Benjamin Peterson's avatar
Benjamin Peterson committed
529 530
- Issue #20246: Fix buffer overflow in socket.recvfrom_into.

531 532 533 534
- Issues #20206 and #5803: Fix edge case in email.quoprimime.encode where it
  truncated lines ending in a character needing encoding but no newline by
  using a more efficient algorithm that doesn't have the bug.

535 536 537
- Issue #19082: Working xmlrpc.server and xmlrpc.client examples. Both in
  modules and in documentation. Initial patch contributed by Vajrasky Kok.

538 539 540
- Issue #20138: The wsgiref.application_uri() and wsgiref.request_uri()
  functions now conform to PEP 3333 when handle non-ASCII URLs.

541
- Issue #19097: Raise the correct Exception when cgi.FieldStorage is given an
542
  invalid fileobj.
543

544
- Issue #20152: Ported Python/import.c over to Argument Clinic.
545

546 547 548 549
- Issue #13107: argparse and optparse no longer raises an exception when output
  a help on environment with too small COLUMNS.  Based on patch by
  Elazar Gershuni.

550 551 552
- Issue #20207: Always disable SSLv2 except when PROTOCOL_SSLv2 is explicitly
  asked for.

553 554 555
- Issue #18960: The tokenize module now ignore the source encoding declaration
  on the second line if the first line contains anything except a comment.

556 557 558
- Issue #20078: Reading malformed zipfiles no longer hangs with 100% CPU
  consumption.

559 560 561
- Issue #20113: os.readv() and os.writev() now raise an OSError exception on
  error instead of returning -1.

562 563 564 565
- Issue #19719: Make importlib.abc.MetaPathFinder.find_module(),
  PathEntryFinder.find_loader(), and Loader.load_module() use PEP 451 APIs to
  help with backwards-compatibility.

566 567 568
- Issue #20144: inspect.Signature now supports parsing simple symbolic
  constants as parameter default values in __text_signature__.

569 570
- Issue #20072: Fixed multiple errors in tkinter with wantobjects is False.

571 572
- Issue #20229: Avoid plistlib deprecation warning in platform.mac_ver().

573 574
- Issue #14455: Fix some problems with the new binary plist support in plistlib.

575 576 577
IDLE
----

578
- Issue #17390: Add Python version to Idle editor window title bar.
Terry Jan Reedy's avatar
Terry Jan Reedy committed
579
  Original patches by Edmond Burnett and Kent Johnson.
580

581 582 583
- Issue #18960: IDLE now ignores the source encoding declaration on the second
  line if the first line contains anything except a comment.

584 585 586
Tests
-----

587 588 589
- Issue #20358: Tests for curses.window.overlay and curses.window.overwrite
  no longer specify min{row,col} > max{row,col}.

590 591 592
- Issue #19804: The test_find_mac test in test_uuid is now skipped if the
  ifconfig executable is not available.

593 594
- Issue #19886: Use better estimated memory requirements for bigmem tests.

595 596
Tools/Demos
-----------
597

598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614
- Issue #20390: Argument Clinic's "file" output preset now defaults to
  "{dirname}/clinic/{basename}.h".

- Issue #20390: Argument Clinic's "class" directive syntax has been extended
  with two new required  arguments: "typedef" and "type_object".

- Issue #20390: Argument Clinic: If __new__ or __init__ functions didn't use
  kwargs (or args), the PyArg_NoKeywords (or PyArg_NoPositional) calls
  generated are only run when the type object is an exact match.

- Issue #20390: Argument Clinic now fails if you have required parameters after
  optional parameters.

- Issue #20390: Argument Clinic converters now have a new template they can
  inject code into: "modifiers".  Code put there is run in the parsing
  function after argument parsing but before the call to the impl.

615 616
- Issue #20376: Argument Clinic now escapes backslashes in docstrings.

617 618 619 620
- Issue #20381: Argument Clinic now sanity checks the default argument when
  c_default is also specified, providing a nice failure message for
  disallowed values.

621 622 623 624 625 626 627 628 629 630
- Issue #20189: Argument Clinic now ensures that parser functions for
  __new__ are always of type newfunc, the type of the tp_new slot.
  Similarly, parser functions for __init__ are now always of type initproc,
  the type of tp_init.

- Issue #20189: Argument Clinic now suppresses the docstring for __new__
  and __init__ functions if no docstring is provided in the input.

- Issue #20189: Argument Clinic now suppresses the "self" parameter in the
  impl for @staticmethod functions.
631

632 633 634
- Issue #20294: Argument Clinic now supports argument parsing for __new__ and
  __init__ functions.

635 636 637
- Issue #20299: Argument Clinic custom converters may now change the default
  value of c_default and py_default with a class member.

638 639 640
- Issue #20287: Argument Clinic's output is now configurable, allowing
  delaying its output or even redirecting it to a separate file.

641 642 643
- Issue #20226: Argument Clinic now permits simple expressions
  (e.g. "sys.maxsize - 1") as default values for parameters.

644 645 646 647 648 649
- Issue #19936: Added executable bits or shebang lines to Python scripts which
  requires them.  Disable executable bits and shebang lines in test and
  benchmark files in order to prevent using a random system python, and in
  source files of modules which don't provide command line interface.  Fixed
  shebang lines in the unittestgui and checkpip scripts.

650 651 652
- Issue #20268: Argument Clinic now supports cloning the parameters and
  return converter of existing functions.

653 654 655
- Issue #20228: Argument Clinic now has special support for class special
  methods.

656 657 658
- Issue #20214: Fixed a number of small issues and documentation errors in
  Argument Clinic (see issue for details).

659 660 661 662
- Issue #20196: Fixed a bug where Argument Clinic did not generate correct
  parsing code for functions with positional-only parameters where all arguments
  are optional.

663 664 665 666
- Issue #18960: 2to3 and the findnocoding.py script now ignore the source
  encoding declaration on the second line if the first line contains anything
  except a comment.

667
- Issue #19723: The marker comments Argument Clinic uses have been changed
668 669
  to improve readability.

670 671 672
- Issue #20157: When Argument Clinic renames a parameter because its name
  collides with a C keyword, it no longer exposes that rename to PyArg_Parse.

673 674 675
- Issue #20141: Improved Argument Clinic's support for the PyArg_Parse "O!"
  format unit.

676 677 678
- Issue #20144: Argument Clinic now supports simple symbolic constants
  as parameter default values.

679 680 681
- Issue #20143: The line numbers reported in Argument Clinic errors are
  now more accurate.

682 683
- Issue #20142: Py_buffer variables generated by Argument Clinic are now
  initialized with a default value.
684

685 686 687 688 689 690
Build
-----

- Issue #12837: Silence a tautological comparison warning on OS X under Clang in
  socketmodule.c.

691 692 693 694 695 696 697 698
What's New in Python 3.4.0 Beta 2?
==================================

Release date: 2014-01-05

Core and Builtins
-----------------

699 700
- Issue #17432: Drop UCS2 from names of Unicode functions in python3.def.

701 702 703
- Issue #19526: Exclude all new API from the stable ABI. Exceptions can be
  made if a need is demonstrated.

704 705 706
- Issue #19969: PyBytes_FromFormatV() now raises an OverflowError if "%c"
  argument is not in range [0; 255].

707 708
- Issue #19995: %c, %o, %x, and %X now issue a DeprecationWarning on non-integer
  input; reworded docs to clarify that an integer type should define both __int__
709 710
  and __index__.

711 712 713 714
- Issue #19787: PyThread_set_key_value() now always set the value. In Python
  3.3, the function did nothing if the key already exists (if the current value
  is a non-NULL pointer).

715 716 717 718 719 720
- Issue #14432: Remove the thread state field from the frame structure. Fix a
  crash when a generator is created in a C thread that is destroyed while the
  generator is still used. The issue was that a generator contains a frame, and
  the frame kept a reference to the Python state of the destroyed C thread. The
  crash occurs when a trace function is setup.

721 722 723 724 725
- Issue #19576: PyGILState_Ensure() now initializes threads. At startup, Python
  has no concrete GIL. If PyGILState_Ensure() is called from a new thread for
  the first time and PyEval_InitThreads() was not called yet, a GIL needs to be
  created.

726 727 728
- Issue #17576: Deprecation warning emitted now when __int__() or __index__()
  return not int instance.

729 730
- Issue #19932: Fix typo in import.h, missing whitespaces in function prototypes.

731 732 733
- Issue #19736: Add module-level statvfs constants defined for GNU/glibc
  based systems.

734 735
- Issue #20097: Fix bad use of "self" in importlib's WindowsRegistryFinder.

736 737
- Issue #19729: In str.format(), fix recursive expansion in format spec.

738 739 740
- Issue #19638: Fix possible crash / undefined behaviour from huge (more than 2
  billion characters) input strings in _Py_dg_strtod.

741 742 743
Library
-------

744 745
- Issue #20154: Deadlock in asyncio.StreamReader.readexactly().

746 747
- Issue #16113: Remove sha3 module again.

748 749
- Issue #20111: pathlib.Path.with_suffix() now sanity checks the given suffix.

750 751
- Fix breakage in TestSuite.countTestCases() introduced by issue #11798.

752 753
- Issue #20108: Avoid parameter name clash in inspect.getcallargs().

754 755
- Issue #19918: Fix PurePath.relative_to() under Windows.

756 757 758
- Issue #19422: Explicitly disallow non-SOCK_STREAM sockets in the ssl
  module, rather than silently let them emit clear text data.

759 760 761
- Issue #20046: Locale alias table no longer contains entities which can be
  calculated.  Generalized support of the euro modifier.

762 763
- Issue #20027: Fixed locale aliases for devanagari locales.

764 765
- Issue #20067: Tkinter variables now work when wantobjects is false.

766 767 768
- Issue #19020: Tkinter now uses splitlist() instead of split() in configure
  methods.

769 770 771 772
- Issue #19744: ensurepip now provides a better error message when Python is
  built without SSL/TLS support (pip currently requires that support to run,
  even if only operating with local wheel files)

773 774 775
- Issue #19734: ensurepip now ignores all pip environment variables to avoid
  odd behaviour based on user configuration settings

776 777
- Fix TypeError on "setup.py upload --show-response".

778 779
- Issue #20045: Fix "setup.py register --list-classifiers".

780 781 782
- Issue #18879: When a method is looked up on a temporary file, avoid closing
  the file before the method is possibly called.

783 784 785
- Issue #20037: Avoid crashes when opening a text file late at interpreter
  shutdown.

786 787 788 789 790 791 792 793 794 795 796 797 798 799
- Issue #19967: Thanks to the PEP 442, asyncio.Future now uses a
  destructor to log uncaught exceptions, instead of the dedicated
  _TracebackLogger class.

- Added a Task.current_task() class method to asyncio.

- Issue #19850: Set SA_RESTART in asyncio when registering a signal
  handler to limit EINTR occurrences.

- Implemented write flow control in asyncio for proactor event loop (Windows).

- Change write buffer in asyncio use to avoid O(N**2) behavior.  Make
  write()/sendto() accept bytearray/memoryview.

800 801 802
- Issue #20034: Updated alias mapping to most recent locale.alias file
  from X.org distribution using makelocalealias.py.

803 804 805
- Issue #5815: Fixed support for locales with modifiers.  Fixed support for
  locale encodings with hyphens.

806 807 808
- Issue #20026: Fix the sqlite module to handle correctly invalid isolation
  level (wrong type).

809 810 811
- Issue #18829: csv.Dialect() now checks type for delimiter, escapechar and
  quotechar fields.  Original patch by Vajrasky Kok.

812 813 814 815
- Issue #19855: uuid.getnode() on Unix now looks on the PATH for the
  executables used to find the mac address, with /sbin and /usr/sbin as
  fallbacks.

816 817 818
- Issue #20007: HTTPResponse.read(0) no more prematurely closes connection.
  Original patch by Simon Sapin.

819 820 821 822 823 824
- Issue #19946: multiprocessing now uses runpy to initialize __main__ in
  child processes when necessary, allowing it to correctly handle scripts
  without suffixes and submodules that use explicit relative imports or
  otherwise rely on parent modules being correctly imported prior to
  execution.

825 826 827 828
- Issue #19921: When Path.mkdir() is called with parents=True, any missing
  parent is created with the default permissions, ignoring the mode argument
  (mimicking the POSIX "mkdir -p" command).

829 830 831
- Issue #19887: Improve the Path.resolve() algorithm to support certain
  symlink chains.

832 833
- Issue #19912: Fixed numerous bugs in ntpath.splitunc().

834 835 836
- Issue #19911: ntpath.splitdrive() now correctly processes the 'İ' character
  (U+0130, LATIN CAPITAL LETTER I WITH DOT ABOVE).

837 838 839
- Issue #19532: python -m compileall with no filename/directory arguments now
  respects the -f and -q flags instead of ignoring them.

840 841
- Issue #19623: Fixed writing to unseekable files in the aifc module.

842 843 844
- Issue #19946: multiprocessing.spawn now raises ImportError when the module to
  be used as the main module cannot be imported.

845 846
- Issue #17919: select.poll.register() again works with poll.POLLNVAL on AIX.
  Fixed integer overflow in the eventmask parameter.
847

848 849 850 851 852 853 854
- Issue #19063: if a Charset's body_encoding was set to None, the email
  package would generate a message claiming the Content-Transfer-Encoding
  was 7bit, and produce garbage output for the content.  This now works.
  A couple of other set_payload mishandlings of non-ASCII are also fixed.
  In addition, calling set_payload with a string argument without
  specifying a charset now raises an error (this is a new error in 3.4).

855 856
- Issue #15475: Add __sizeof__ implementations for itertools objects.

857 858 859
- Issue #19944: Fix importlib.find_spec() so it imports parents as needed
  and move the function to importlib.util.

860 861 862
- Issue #19880: Fix a reference leak in unittest.TestCase. Explicitly break
  reference cycles between frames and the _Outcome instance.

863 864 865 866 867 868
- Issue #17429: platform.linux_distribution() now decodes files from the UTF-8
  encoding with the surrogateescape error handler, instead of decoding from the
  locale encoding in strict mode. It fixes the function on Fedora 19 which is
  probably the first major distribution release with a non-ASCII name. Patch
  written by Toshio Kuratomi.

869 870 871
- Issue #19343: Expose FreeBSD-specific APIs in resource module.  Original
  patch by Koobs.

872 873 874 875
- Issue #19929: Call os.read with 32768 within subprocess.Popen.communicate
  rather than 4096 for efficiency.  A microbenchmark shows Linux and OS X
  both using ~50% less cpu time this way.

876 877 878
- Issue #19506: Use a memoryview to avoid a data copy when piping data
  to stdin within subprocess.Popen.communicate.  5-10% less cpu usage.

Guido van Rossum's avatar
Guido van Rossum committed
879 880 881
- Issue #19876: selectors unregister() no longer raises ValueError or OSError
  if the FD is closed (as long as it was registered).

882 883
- Issue #19908: pathlib now joins relative Windows paths correctly when a drive
  is present.  Original patch by Antoine Pitrou.
884

885 886
- Issue #19296: Silence compiler warning in dbm_open

887 888 889 890
- Issue #6784: Strings from Python 2 can now be unpickled as bytes
  objects by setting the encoding argument of Unpickler to be 'bytes'.
  Initial patch by Merlijn van Deen.

891
- Issue #19839: Fix regression in bz2 module's handling of non-bzip2 data at
892
  EOF, and analogous bug in lzma module.
893

894 895 896
- Issue #19881: Fix pickling bug where cpickle would emit bad pickle data for
  large bytes string (i.e., with size greater than 2**32-1).

897 898 899 900
- Issue #19138: doctest's IGNORE_EXCEPTION_DETAIL now allows a match when
  no exception detail exists (no colon following the exception's name, or
  a colon does follow but no text follows the colon).

901 902
- Issue #19927: Add __eq__ to path-based loaders in importlib.

903 904 905 906
- Issue #19827: On UNIX, setblocking() and settimeout() methods of
  socket.socket can now avoid a second syscall if the ioctl() function can be
  used, or if the non-blocking flag of the socket is unchanged.

907 908 909
- Issue #19785: smtplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

910 911 912
- Issue #19784: poplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

913 914 915
- Issue #19783: nntplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

916 917 918
- Issue #19782: imaplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

919 920
- Issue 20123: Fix pydoc.synopsis() for "binary" modules.

921 922
- Issue #19834: Support unpickling of exceptions pickled by Python 2.

923 924 925
- Issue #19781: ftplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

926 927 928
- Issue #19509: Add SSLContext.check_hostname to match the peer's certificate
  with server_hostname on handshake.

929 930 931
- Issue #15798: Fixed subprocess.Popen() to no longer fail if file
  descriptor 0, 1 or 2 is closed.

932 933
- Issue #17897: Optimized unpickle prefetching.

934 935 936 937
- Issue #3693: Make the error message more helpful when the array.array()
  constructor is given a str. Move the array module typecode documentation to
  the docstring of the constructor.

938 939 940
- Issue #19088: Fixed incorrect caching of the copyreg module in
  object.__reduce__() and object.__reduce_ex__().

941 942 943
- Issue #19698: Removed exec_module() methods from
  importlib.machinery.BuiltinImporter and ExtensionFileLoader.

944 945
- Issue #18864: Added a setter for ModuleSpec.has_location.

946 947 948
- Fixed _pickle.Unpickler to not fail when loading empty strings as
  persistent IDs.

949 950 951
- Issue #11480: Fixed copy.copy to work with classes with custom metaclasses.
  Patch by Daniel Urban.

952 953 954
- Issue #6477: Added support for pickling the types of built-in singletons
  (i.e., Ellipsis, NotImplemented, None).

955 956
- Issue #19713: Add remaining PEP 451-related deprecations and move away
  from using find_module/find_loaer/load_module.
957

958 959
- Issue #19708: Update pkgutil to use the new importer APIs.

960 961
- Issue #19703: Update pydoc to use the new importer APIs.

962 963
- Issue #19851: Fixed a regression in reloading sub-modules.

964 965
- ssl.create_default_context() sets OP_NO_COMPRESSION to prevent CRIME.

966 967
- Issue #19802: Add socket.SO_PRIORITY.

968 969 970
- Issue #11508: Fixed uuid.getnode() and uuid.uuid1() on environment with
  virtual interface.  Original patch by Kent Frazier.

971 972
- Issue #11489: JSON decoder now accepts lone surrogates.

973 974 975
- Issue #19545: Avoid chained exceptions while passing stray % to
  time.strptime().  Initial patch by Claudiu Popa.

976 977 978
IDLE
----

979 980
- Issue #20058: sys.stdin.readline() in IDLE now always returns only one line.

981 982 983 984
- Issue #19481: print() of string subclass instance in IDLE no longer hangs.

- Issue #18270: Prevent possible IDLE AttributeError on OS X when no initial
  shell window is present.
985

Zachary Ware's avatar
Zachary Ware committed
986 987
Tests
-----
988

989 990 991
- Issue #20055: Fix test_shutil under Windows with symlink privileges held.
  Patch by Vajrasky Kok.

992 993 994
- Issue #20070: Don't run test_urllib2net when network resources are not
  enabled.

995 996 997
- Issue #19938: Re-enabled test_bug_1333982 in test_dis, which had been
  disabled since 3.0 due to the changes in listcomp handling.

998 999
- Issue #19320: test_tcl no longer fails when wantobjects is false.

1000
- Issue #19919: Fix flaky SSL test. connect_ex() sometimes returns
1001 1002
  EWOULDBLOCK on Windows or VMs hosted on Windows.

1003 1004
- Issue #19912: Added tests for ntpath.splitunc().

1005 1006
- Issue #19828: Fixed test_site when the whole suite is run with -S.

1007 1008
- Issue #19928: Implemented a test for repr() of cell objects.

1009 1010
- Issue #19535: Fixed test_docxmlrpc, test_functools, test_inspect, and
  test_statistics when python is run with -OO.
1011

1012 1013 1014
- Issue #19926: Removed unneeded test_main from test_abstract_numbers.
  Patch by Vajrasky Kok.

1015
- Issue #19572: More skipped tests explicitly marked as skipped.
1016

1017
- Issue #19595, #19987: Re-enabled a long-disabled test in test_winsound.
1018

Zachary Ware's avatar
Zachary Ware committed
1019 1020
- Issue #19588: Fixed tests in test_random that were silently skipped most
  of the time.  Patch by Julian Gindi.
1021

1022 1023
Build
-----
1024

1025 1026
- Issue #19728: Enable pip installation by default on Windows.

1027 1028
- Issue #16136: Remove VMS support

1029 1030 1031
- Issue #18215: Add script Tools/ssl/test_multiple_versions.py to compile and
  run Python's unit tests with multiple versions of OpenSSL.

1032 1033 1034
- Issue #19922: define _INCLUDE__STDC_A1_SOURCE in HP-UX to include mbstate_t
  for mbrtowc().

1035 1036 1037
- Issue #19788: kill_python(_d).exe is now run as a PreBuildEvent on the
  pythoncore sub-project.  This should prevent build errors due a previous
  build's python(_d).exe still running.
1038

1039 1040
Documentation
-------------
Tim Golden's avatar
Tim Golden committed
1041

1042 1043
- Issue #20265: Updated some parts of the Using Windows document.

1044 1045 1046
- Issue #20266: Updated some parts of the Windows FAQ.

- Issue #20255: Updated the about and bugs pages.
1047

1048 1049 1050
- Issue #20253: Fixed a typo in the ipaddress docs that advertised an
  illegal attribute name.  Found by INADA Naoki.

1051
- Issue #18840: Introduce the json module in the tutorial, and de-emphasize
1052
  the pickle module.
1053

1054
- Issue #19845: Updated the Compiling Python on Windows section.
1055

1056
- Issue #19795: Improved markup of True/False constants.
1057

1058 1059 1060
Tools/Demos
-----------

1061 1062
- Issue #19659: Added documentation for Argument Clinic.

1063 1064
- Issue #19976: Argument Clinic METH_NOARGS functions now always
  take two parameters.
1065

1066
What's New in Python 3.4.0 Beta 1?
1067
==================================
1068

1069
Release date: 2013-11-24
1070 1071 1072

Core and Builtins
-----------------
1073

1074 1075
- Use the repr of a module name in more places in import, especially
  exceptions.
1076

1077 1078 1079 1080 1081 1082
- Issue #19619: str.encode, bytes.decode and bytearray.decode now use an
  internal API to throw LookupError for known non-text encodings, rather
  than attempting the encoding or decoding operation and then throwing a
  TypeError for an unexpected output type. (The latter mechanism remains
  in place for third party non-text encodings)

1083 1084 1085
- Issue #19183: Implement PEP 456 'secure and interchangeable hash algorithm'.
  Python now uses SipHash24 on all major platforms.

1086 1087 1088 1089 1090 1091
- Issue #12892: The utf-16* and utf-32* encoders no longer allow surrogate code
  points (U+D800-U+DFFF) to be encoded.  The utf-32* decoders no longer decode
  byte sequences that correspond to surrogate code points.  The surrogatepass
  error handler now works with the utf-16* and utf-32* codecs.  Based on
  patches by Victor Stinner and Kang-Hao (Kenny) Lu.

1092 1093 1094
- Issue #17806: Added keyword-argument support for "tabsize" to
  str/bytes.expandtabs().

1095 1096 1097 1098 1099 1100 1101 1102 1103
- Issue #17828: Output type errors in str.encode(), bytes.decode() and
  bytearray.decode() now direct users to codecs.encode() or codecs.decode()
  as appropriate.

- Issue #17828: The interpreter now attempts to chain errors that occur in
  codec processing with a replacement exception of the same type that
  includes the codec name in the error message. It ensures it only does this
  when the creation of the replacement exception won't lose any information.

1104 1105 1106 1107
- Issue #19466: Clear the frames of daemon threads earlier during the
  Python shutdown to call objects destructors. So "unclosed file" resource
  warnings are now corretly emitted for daemon threads.

1108
- Issue #19514: Deduplicate some _Py_IDENTIFIER declarations.
1109 1110
  Patch by Andrei Dorian Duma.

1111 1112 1113
- Issue #17936: Fix O(n**2) behaviour when adding or removing many subclasses
  of a given type.

1114 1115 1116
- Issue #19428: zipimport now handles errors when reading truncated or invalid
  ZIP archive.

1117 1118 1119 1120
- Issue #18408: Add a new PyFrame_FastToLocalsWithError() function to handle
  exceptions when merging fast locals into f_locals of a frame.
  PyEval_GetLocals() now raises an exception and return NULL on failure.

1121 1122
- Issue #19369: Optimized the usage of __length_hint__().

1123 1124 1125
- Issue #18603: Ensure that PyOS_mystricmp and PyOS_mystrnicmp are in the
  Python executable and not removed by the linker's optimizer.

1126
- Issue #19306: Add extra hints to the faulthandler module's stack
1127 1128
  dumps that these are "upside down".

1129 1130
Library
-------
1131

1132 1133 1134
- Issue #3158: doctest can now find doctests in functions and methods
  written in C.

1135 1136 1137
- Issue #13477: Added command line interface to the tarfile module.
  Original patch by Berker Peksag.

1138 1139 1140
- Issue #19674: inspect.signature() now produces a correct signature
  for some builtins.

1141 1142
- Issue #19722: Added opcode.stack_effect(), which
  computes the stack effect of bytecode instructions.
1143

1144 1145 1146 1147
- Issue #19735: Implement private function ssl._create_stdlib_context() to
  create SSLContext objects in Python's stdlib module. It provides a single
  configuration point and makes use of SSLContext.load_default_certs().

1148 1149 1150 1151
- Issue #16203: Add re.fullmatch() function and regex.fullmatch() method,
  which anchor the pattern at both ends of the string to match.
  Original patch by Matthew Barnett.

1152 1153 1154
- Issue #13592: Improved the repr for regular expression pattern objects.
  Based on patch by Hugo Lopes Tavares.

1155 1156 1157
- Issue #19641: Added the audioop.byteswap() function to convert big-endian
  samples to little-endian and vice versa.

1158 1159
- Issue #15204: Deprecated the 'U' mode in file-like objects.

1160 1161
- Issue #17810: Implement PEP 3154, pickle protocol 4.

1162 1163
- Issue #19668: Added support for the cp1125 encoding.

1164 1165 1166
- Issue #19689: Add ssl.create_default_context() factory function. It creates
  a new SSLContext object with secure default settings.

1167 1168 1169
- Issue #19727: os.utime(..., None) is now potentially more precise
  under Windows.

1170 1171 1172
- Issue #17201: ZIP64 extensions now are enabled by default.  Patch by
  William Mallard.

1173 1174 1175 1176
- Issue #19292: Add SSLContext.load_default_certs() to load default root CA
  certificates from default stores or system stores. By default the method
  loads CA certs for authentication of server certs.

1177 1178
- Issue #19673: Add pathlib to the stdlib as a provisional module (PEP 428).

1179 1180 1181 1182
- Issue #16596: pdb in a generator now properly skips over yield and
  yield from rather than stepping out of the generator into its
  caller.  (This is essential for stepping through asyncio coroutines.)

1183 1184 1185 1186
- Issue #17916: Added dis.Bytecode.from_traceback() and
  dis.Bytecode.current_offset to easily display "current instruction"
  markers in the new disassembly API (Patch by Claudiu Popa).

1187 1188
- Issue #19552: venv now supports bootstrapping pip into virtual environments

1189 1190 1191 1192
- Issue #17134: Finalize interface to Windows' certificate store. Cert and
  CRL enumeration are now two functions. enum_certificates() also returns
  purpose flags as set of OIDs.

1193 1194
- Issue #19555: Restore sysconfig.get_config_var('SO'), (and the distutils
  equivalent) with a DeprecationWarning pointing people at $EXT_SUFFIX.
1195

1196 1197 1198 1199
- Issue #8813: Add SSLContext.verify_flags to change the verification flags
  of the context in order to enable certification revocation list (CRL)
  checks or strict X509 rules.

1200 1201
- Issue #18294: Fix the zlib module to make it 64-bit safe.

1202 1203 1204
- Issue #19682: Fix compatibility issue with old version of OpenSSL that
  was introduced by Issue #18379.

1205 1206
- Issue #14455: plistlib now supports binary plists and has an updated API.

1207 1208
- Issue #19633: Fixed writing not compressed 16- and 32-bit wave files on
  big-endian platforms.
1209

1210 1211 1212
- Issue #18379: SSLSocket.getpeercert() returns CA issuer AIA fields, OCSP
  and CRL distribution points.

1213 1214 1215 1216
- Issue #18138: Implement cadata argument of SSLContext.load_verify_location()
  to load CA certificates and CRL from memory. It supports PEM and DER
  encoded strings.

1217 1218 1219
- Issue #18775: Add name and block_size attribute to HMAC object. They now
  provide the same API elements as non-keyed cryptographic hash functions.

1220 1221 1222
- Issue #17276: MD5 as default digestmod for HMAC is deprecated. The HMAC
  module supports digestmod names, e.g. hmac.HMAC('sha1').

1223 1224
- Issue #19449: in csv's writerow, handle non-string keys when generating the
  error message that certain keys are not in the 'fieldnames' list.
Georg Brandl's avatar
Georg Brandl committed
1225

1226 1227 1228
- Issue #13633: Added a new convert_charrefs keyword arg to HTMLParser that,
  when True, automatically converts all character references.

1229 1230
- Issue #2927: Added the unescape() function to the html module.

1231 1232
- Issue #8402: Added the escape() function to the glob module.

1233 1234
- Issue #17618: Add Base85 and Ascii85 encoding/decoding to the base64 module.

1235 1236 1237
- Issue #19634: time.strftime("%y") now raises a ValueError on AIX when given a
  year before 1900.

1238 1239 1240
- Fix test.support.bind_port() to not cause an error when Python was compiled
  on a system with SO_REUSEPORT defined in the headers but run on a system
  with an OS kernel that does not support that reasonably new socket option.
1241

1242
- Fix compilation error under gcc of the ctypes module bundled libffi for arm.
Georg Brandl's avatar
Georg Brandl committed
1243

1244 1245 1246
- Issue #19448: Add private API to SSL module to lookup ASN.1 objects by OID,
  NID, short name and long name.

1247 1248 1249
- Issue #19282: dbm.open now supports the context manager protocol. (Inital
  patch by Claudiu Popa)

1250
- Issue #8311: Added support for writing any bytes-like objects in the aifc,
1251 1252
  sunau, and wave modules.

1253 1254
- Issue #5202: Added support for unseekable files in the wave module.

1255 1256 1257 1258
- Issue #19544 and Issue #1180: Restore global option to ignore
  ~/.pydistutils.cfg in Distutils, accidentally removed in backout of
  distutils2 changes.

1259
- Issue #19523: Closed FileHandler leak which occurred when delay was set.
1260

1261 1262 1263
- Issue #19544 and #6516: Restore support for --user and --group parameters to
  sdist command accidentally rolled back as part of the distutils2 rollback.

Tim Golden's avatar
Tim Golden committed
1264 1265 1266
- Issue #13674: Prevented time.strftime from crashing on Windows when given
  a year before 1900 and a format of %y.

1267 1268 1269
- Issue #19406: implementation of the ensurepip module (part of PEP 453).
  Patch by Donald Stufft and Nick Coghlan.

1270 1271 1272
- Issue #19544 and Issue #6286: Restore use of urllib over http allowing use
  of http_proxy for Distutils upload command, a feature accidentally lost
  in the rollback of distutils2.
1273

1274 1275 1276
- Issue #19544 and Issue #7457: Restore the read_pkg_file method to
  distutils.dist.DistributionMetadata accidentally removed in the undo of
  distutils2.
1277

1278 1279 1280
- Issue #16685: Added support for any bytes-like objects in the audioop module.
  Removed support for strings.

1281 1282 1283
- Issue #7171: Add Windows implementation of ``inet_ntop`` and ``inet_pton``
  to socket module. Patch by Atsuo Ishimoto.

1284 1285
- Issue #19261: Added support for writing 24-bit samples in the sunau module.

1286 1287 1288
- Issue #1097797: Added CP273 encoding, used on IBM mainframes in
  Germany and Austria.  Mapping provided by Michael Bierenfeld.

1289
- Issue #1575020: Fixed support of 24-bit wave files on big-endian platforms.
1290

1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304
- Issue #19378: Fixed a number of cases in the dis module where the new
  "file" parameter was not being honoured correctly

- Issue #19378: Removed the "dis.Bytecode.show_info" method

- Issue #19378: Renamed the "dis.Bytecode.display_code" method to
  "dis.Bytecode.dis" and converted it to returning a string rather than
  printing output.

- Issue #19378: the "line_offset" parameter in the new "dis.get_instructions"
  API has been renamed to "first_line" (and the default value and usage
  changed accordingly). This should reduce confusion with the more common use
  of "offset" in the dis docs to refer to bytecode offsets.

1305 1306 1307 1308
- Issue #18678: Corrected spwd struct member names in spwd module:
  sp_nam->sp_namp, and sp_pwd->sp_pwdp.  The old names are kept as extra
  structseq members, for backward compatibility.

1309 1310 1311
- Issue #6157: Fixed tkinter.Text.debug().  tkinter.Text.bbox() now raises
  TypeError instead of TclError on wrong number of arguments.  Original patch
  by Guilherme Polo.
1312

1313 1314
- Issue #10197: Rework subprocess.get[status]output to use subprocess
  functionality and thus to work on Windows. Patch by Nick Coghlan
1315

1316 1317
- Issue #6160: The bbox() method of tkinter.Spinbox now returns a tuple of
  integers instead of a string.  Based on patch by Guilherme Polo.
1318

1319 1320
- Issue #19403: contextlib.redirect_stdout is now reentrant

1321 1322
- Issue #19286: Directories in ``package_data`` are no longer added to
  the filelist, preventing failure outlined in the ticket.
1323

Ezio Melotti's avatar
Ezio Melotti committed
1324 1325
- Issue #19480: HTMLParser now accepts all valid start-tag names as defined
  by the HTML5 standard.
1326

1327 1328 1329
- Issue #15114: The html.parser module now raises a DeprecationWarning when the
  strict argument of HTMLParser or the HTMLParser.error method are used.

1330 1331 1332
- Issue #19410: Undo the special-casing removal of '' for
  importlib.machinery.FileFinder.

1333 1334 1335
- Issue #19424: Fix the warnings module to accept filename containing surrogate
  characters.

Benjamin Peterson's avatar
Benjamin Peterson committed
1336
- Issue #19435: Fix directory traversal attack on CGIHttpRequestHandler.
1337

1338 1339 1340
- Issue #19227: Remove pthread_atfork() handler. The handler was added to
  solve #18747 but has caused issues.

1341 1342 1343
- Issue #19420: Fix reference leak in module initalization code of
  _hashopenssl.c

1344 1345
- Issue #19329: Optimized compiling charsets in regular expressions.

1346 1347 1348
- Issue #19227: Try to fix deadlocks caused by re-seeding then OpenSSL
  pseudo-random number generator on fork().

1349 1350 1351
- Issue #16037: HTTPMessage.readheaders() raises an HTTPException when more than
  100 headers are read.  Adapted from patch by Jyrki Pulliainen.

1352 1353 1354 1355
- Issue #16040: CVE-2013-1752: nntplib: Limit maximum line lengths to 2048 to
  prevent readline() calls from consuming too much memory.  Patch by Jyrki
  Pulliainen.

1356 1357 1358 1359
- Issue #16041: CVE-2013-1752: poplib: Limit maximum line lengths to 2048 to
  prevent readline() calls from consuming too much memory.  Patch by Jyrki
  Pulliainen.

1360 1361 1362 1363
- Issue #17997: Change behavior of ``ssl.match_hostname()`` to follow RFC 6125,
  for security reasons.  It now doesn't match multiple wildcards nor wildcards
  inside IDN fragments.

1364 1365 1366
- Issue #16039: CVE-2013-1752: Change use of readline in imaplib module to limit
  line length.  Patch by Emil Lind.

1367 1368 1369 1370 1371
- Issue #19330: the unnecessary wrapper functions have been removed from the
  implementations of the new contextlib.redirect_stdout and
  contextlib.suppress context managers, which also ensures they provide
  reasonable help() output on instances

Benjamin Peterson's avatar
Benjamin Peterson committed
1372 1373
- Issue #19393: Fix symtable.symtable function to not be confused when there are
  functions or classes named "top".
1374

1375 1376
- Issue #18685: Restore re performance to pre-PEP 393 levels.

1377 1378
- Issue #19339: telnetlib module is now using time.monotonic() when available
  to compute timeout.
1379

1380 1381
- Issue #19399: fix sporadic test_subprocess failure.

1382 1383 1384
- Issue #13234: Fix os.listdir to work with extended paths on Windows.
  Patch by Santoso Wijaya.

1385 1386 1387
- Issue #19375: The site module adding a "site-python" directory to sys.path,
  if it exists, is now deprecated.

1388 1389 1390
- Issue #19379: Lazily import linecache in the warnings module, to make
  startup with warnings faster until a warning gets printed.

1391 1392 1393 1394 1395 1396
- Issue #19288: Fixed the "in" operator of dbm.gnu databases for string
  argument.  Original patch by Arfrever Frehtes Taifersar Arahesis.

- Issue #19287: Fixed the "in" operator of dbm.ndbm databases for string
  argument.  Original patch by Arfrever Frehtes Taifersar Arahesis.

1397
- Issue #19327: Fixed the working of regular expressions with too big charset.
1398

1399 1400 1401
- Issue #17400: New 'is_global' attribute for ipaddress to tell if an address
  is allocated by IANA for global or private networks.

1402 1403
- Issue #19350: Increasing the test coverage of macurl2path. Patch by Colin
  Williams.
1404

1405 1406 1407
- Issue #19365: Optimized the parsing of long replacement string in re.sub*()
  functions.

1408 1409
- Issue #19352: Fix unittest discovery when a module can be reached
  through several paths (e.g. under Debian/Ubuntu with virtualenv).
1410

1411 1412
- Issue #15207: Fix mimetypes to read from correct part of Windows registry
  Original patch by Dave Chambers
1413

1414 1415
- Issue #16595: Add prlimit() to resource module.

1416 1417
- Issue #19324: Expose Linux-specific constants in resource module.

1418 1419
- Issue #17400: ipaddress should make it easy to identify rfc6598 addresses.

1420 1421
- Load SSL's error strings in hashlib.

1422 1423
- Issue #18527: Upgrade internal copy of zlib to 1.2.8.

1424 1425
- Issue #19274: Add a filterfunc parameter to PyZipFile.writepy.

1426 1427 1428
- Issue #8964: fix platform._sys_version to handle IronPython 2.6+.
  Patch by Martin Matusiak.

1429 1430
- Issue #19413: Restore pre-3.3 reload() semantics of re-finding modules.

1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442
- Issue #18958: Improve error message for json.load(s) while passing a string
  that starts with a UTF-8 BOM.

- Issue #19307: Improve error message for json.load(s) while passing objects
  of the wrong type.

- Issue #16038: CVE-2013-1752: ftplib: Limit amount of data read by
  limiting the call to readline().  Original patch by Michał
  Jastrzębski and Giampaolo Rodola.

- Issue #17087: Improved the repr for regular expression match objects.

1443 1444 1445
Tests
-----

1446 1447 1448
- Issue #19664: test_userdict's repr test no longer depends on the order
  of dict elements.

1449 1450 1451 1452
- Issue #19440: Clean up test_capi by removing an unnecessary __future__
  import, converting from test_main to unittest.main, and running the
  _testcapi module tests as subTests of a unittest TestCase method.

1453 1454 1455 1456 1457 1458
- Issue #19378: the main dis module tests are now run with both stdout
  redirection *and* passing an explicit file parameter

- Issue #19378: removed the not-actually-helpful assertInstructionMatches
  and assertBytecodeExactlyMatches helpers from bytecode_helper

1459 1460
- Issue #18702: All skipped tests now reported as skipped.

1461 1462 1463
- Issue #19439: interpreter embedding tests are now executed on Windows
  (Patch by Zachary Ware)

1464 1465
- Issue #19085: Added basic tests for all tkinter widget options.

1466
- Issue #19384: Fix test_py_compile for root user, patch by Claudiu Popa.
1467

Zachary Ware's avatar
Zachary Ware committed
1468 1469
Documentation
-------------
1470

Zachary Ware's avatar
Zachary Ware committed
1471 1472 1473
- Issue #18326: Clarify that list.sort's arguments are keyword-only.  Also,
  attempt to reduce confusion in the glossary by not saying there are
  different "types" of arguments and parameters.
1474

1475 1476
Build
-----
1477

1478 1479 1480
- Issue #19358: "make clinic" now runs the Argument Clinic preprocessor
  over all CPython source files.

Martin v. Löwis's avatar
Martin v. Löwis committed
1481
- Update SQLite to 3.8.1, xz to 5.0.5, and Tcl/Tk to 8.6.1 on Windows.
1482

1483 1484
- Issue #16632: Enable DEP and ASLR on Windows.

1485 1486
- Issue #17791: Drop PREFIX and EXEC_PREFIX definitions from PC/pyconfig.h

1487 1488 1489
- Add workaround for VS 2010 nmake clean issue. VS 2010 doesn't set up PATH
  for nmake.exe correctly.

1490 1491
- Issue #19550: Implement Windows installer changes of PEP 453 (ensurepip).

1492 1493
- Issue #19520: Fix compiler warning in the _sha3 module on 32bit Windows.

1494 1495
- Issue #19356: Avoid using a C variabled named "_self", it's a reserved
  word in some C compilers.
1496

1497 1498
- Issue #15792: Correct build options on Win64. Patch by Jeremy Kloth.

Ned Deily's avatar
Ned Deily committed
1499 1500 1501
- Issue #19373: Apply upstream change to Tk 8.5.15 fixing OS X 10.9
  screen refresh problem for OS X installer build.

1502 1503 1504 1505 1506 1507
- Issue #19649: On OS X, the same set of file names are now installed
  in bin directories for all configurations: non-framework vs framework,
  and single arch vs universal builds.  pythonx.y-32 is now always
  installed for 64-bit/32-bit universal builds.  The obsolete and
  undocumented pythonw* symlinks are no longer installed anywhere.

1508 1509 1510 1511 1512 1513
- Issue #19553: PEP 453 - "make install" and "make altinstall" now install or
  upgrade pip by default, using the bundled pip provided by the new ensurepip
  module.  A new configure option, --with-ensurepip[=upgrade|install|no], is
  available to override the default ensurepip "--upgrade" option.  The option
  can also be set with "make [alt]install ENSUREPIP=[upgrade|install\no]".

1514 1515
- Issue #19551: PEP 453 - the OS X installer now installs pip by default.

R David Murray's avatar
R David Murray committed
1516 1517
- Update third-party libraries for OS X installers: xz 5.0.3 -> 5.0.5,
  SQLite 3.7.13 -> 3.8.1
1518

1519 1520 1521 1522 1523
- Issue #15663: Revert OS X installer built-in Tcl/Tk support for 3.4.0b1.
  Some third-party projects, such as Matplotlib and PIL/Pillow,
  depended on being able to build with Tcl and Tk frameworks in
  /Library/Frameworks.

1524 1525
Tools/Demos
-----------
1526

1527 1528 1529
- Issue #19730: Argument Clinic now supports all the existing PyArg
  "format units" as legacy converters, as well as two new features:
  "self converters" and the "version" directive.
1530

1531 1532 1533
- Issue #19552: pyvenv now bootstraps pip into virtual environments by
  default (pass --without-pip to request the old behaviour)

1534 1535
- Issue #19390: Argument Clinic no longer accepts malformed Python
  and C ids.
1536

Larry Hastings's avatar
Larry Hastings committed
1537
What's New in Python 3.4.0 Alpha 4?
1538
===================================
Larry Hastings's avatar
Larry Hastings committed
1539

Larry Hastings's avatar
Larry Hastings committed
1540
Release date: 2013-10-20
Larry Hastings's avatar
Larry Hastings committed
1541 1542 1543 1544

Core and Builtins
-----------------

1545 1546 1547
- Issue #19301: Give classes and functions that are explicitly marked global a
  global qualname.

Andrew Kuchling's avatar
Andrew Kuchling committed
1548
- Issue #19279: UTF-7 decoder no longer produces illegal strings.
1549

1550 1551 1552
- Issue #16612: Add "Argument Clinic", a compile-time preprocessor for
  C files to generate argument parsing code.  (See PEP 436.)

Brett Cannon's avatar
Brett Cannon committed
1553 1554 1555 1556 1557
- Issue #18810: Shift stat calls in importlib.machinery.FileFinder such that
  the code is optimistic that if something exists in a directory named exactly
  like the possible package being searched for that it's in actuality a
  directory.

1558 1559 1560 1561 1562 1563 1564
- Issue #18416: importlib.machinery.PathFinder now treats '' as the cwd and
  importlib.machinery.FileFinder no longer special-cases '' to '.'. This leads
  to modules imported from cwd to now possess an absolute file path for
  __file__ (this does not affect modules specified by path on the CLI but it
  does affect -m/runpy). It also allows FileFinder to be more consistent by not
  having an edge case.

1565 1566 1567
- Issue #4555: All exported C symbols are now prefixed with either
  "Py" or "_Py".

1568 1569 1570
- Issue #19219: Speed up marshal.loads(), and make pyc files slightly
  (5% to 10%) smaller.

1571 1572
- Issue #19221: Upgrade Unicode database to version 6.3.0.

1573 1574 1575 1576 1577
- Issue #16742: The result of the C callback PyOS_ReadlineFunctionPointer must
  now be a string allocated by PyMem_RawMalloc() or PyMem_RawRealloc() (or NULL
  if an error occurred), instead of a string allocated by PyMem_Malloc() or
  PyMem_Realloc().

1578 1579
- Issue #19199: Remove ``PyThreadState.tick_counter`` field

1580 1581 1582
- Fix macro expansion of _PyErr_OCCURRED(), and make sure to use it in at
  least one place so as to avoid regressions.

1583 1584 1585
- Issue #19087: Improve bytearray allocation in order to allow cheap popping
  of data at the front (slice deletion).

1586 1587
- Issue #19014: memoryview.cast() is now allowed on zero-length views.

1588 1589 1590
- Issue #18690: memoryview is now automatically registered with
  collections.abc.Sequence

1591 1592 1593
- Issue #19078: memoryview now correctly supports the reversed builtin
  (Patch by Claudiu Popa)

Larry Hastings's avatar
Larry Hastings committed
1594 1595 1596
Library
-------

1597 1598 1599
- Issue #17457: unittest test discovery now works with namespace packages.
  Patch by Claudiu Popa.

1600 1601
- Issue #18235: Fix the sysconfig variables LDSHARED and BLDSHARED under AIX.
  Patch by David Edelsohn.
1602

1603 1604 1605
- Issue #18606: Add the new "statistics" module (PEP 450).  Contributed
  by Steven D'Aprano.

1606 1607
- Issue #12866: The audioop module now supports 24-bit samples.

Christian Heimes's avatar
Christian Heimes committed
1608
- Issue #19254: Provide an optimized Python implementation of pbkdf2_hmac.
1609

1610 1611
- Issues #19201, #19222, #19223: Add "x" mode (exclusive creation) in opening
  file to bz2, gzip and lzma modules. Patches by Tim Heaney and Vajrasky Kok.
1612

Brett Cannon's avatar
Brett Cannon committed
1613 1614
- Fix a reference count leak in _sre.

1615 1616 1617 1618 1619
- Issue #19262: Initial check in of the 'asyncio' package (a.k.a. Tulip,
  a.k.a. PEP 3156).  There are no docs yet, and the PEP is slightly
  out of date with the code.  This module will have *provisional* status
  in Python 3.4.

1620
- Issue #19276: Fixed the wave module on 64-bit big-endian platforms.
1621

1622 1623 1624
- Issue #19266: Rename the new-in-3.4 ``contextlib.ignore`` context manager
  to ``contextlib.suppress`` in order to be more consistent with existing
  descriptions of that operation elsewhere in the language and standard
1625
  library documentation (Patch by Zero Piraeus).
1626

1627 1628 1629
- Issue #18891: Completed the new email package (provisional) API additions
  by adding new classes EmailMessage, MIMEPart, and ContentManager.

Ethan Furman's avatar
Ethan Furman committed
1630 1631
- Issue #18281: Unused stat constants removed from `tarfile`.

1632 1633 1634 1635
- Issue #18468: The re.split, re.findall, and re.sub functions and the group()
  and groups() methods of match object now always return a string or a bytes
  object.

1636 1637
- Issue #18725: The textwrap module now supports truncating multiline text.

1638 1639 1640
- Issue #18776: atexit callbacks now display their full traceback when they
  raise an exception.

1641 1642 1643
- Issue #17827: Add the missing documentation for ``codecs.encode`` and
  ``codecs.decode``.

1644 1645 1646
- Issue #19218: Rename collections.abc to _collections_abc in order to
  speed up interpreter start.

1647 1648 1649
- Issue #18582: Add 'pbkdf2_hmac' to the hashlib module. It implements PKCS#5
  password-based key derivation functions with HMAC as pseudorandom function.

1650 1651
- Issue #19131: The aifc module now correctly reads and writes sampwidth of
  compressed streams.
1652

1653 1654 1655 1656
- Issue #19209: Remove import of copyreg from the os module to speed up
  interpreter startup. stat_result and statvfs_result are now hard-coded to
  reside in the os module.

1657 1658 1659
- Issue #19205: Don't import the 're' module in site and sysconfig module to
  to speed up interpreter start.

1660 1661 1662
- Issue #9548: Add a minimal "_bootlocale" module that is imported by the
  _io module instead of the full locale module.

1663 1664 1665
- Issue #18764: remove the 'print' alias for the PDB 'p' command so that it no
  longer shadows the print function.

Tim Peters's avatar
Tim Peters committed
1666 1667
- Issue #19158:  a rare race in BoundedSemaphore could allow .release() too
  often.
1668

1669 1670
- Issue #15805: Add contextlib.redirect_stdout().

1671 1672
- Issue #18716: Deprecate the formatter module.

1673 1674 1675
- Issue #10712: 2to3 has a new "asserts" fixer that replaces deprecated names
  of unittest methods (e.g. failUnlessEqual -> assertEqual).

1676
- Issue #18037: 2to3 now escapes '\u' and '\U' in native strings.
1677

1678 1679 1680 1681
- Issue #17839: base64.decodebytes and base64.encodebytes now accept any
  object that exports a 1 dimensional array of bytes (this means the same
  is now also true for base64_codec)

1682 1683
- Issue #19132: The pprint module now supports compact mode.

1684 1685
- Issue #19137: The pprint module now correctly formats instances of set and
  frozenset subclasses.
1686

1687 1688 1689 1690
- Issue #10042: functools.total_ordering now correctly handles
  NotImplemented being returned by the underlying comparison function (Patch
  by Katie Miller)

Nick Coghlan's avatar
Nick Coghlan committed
1691 1692 1693
- Issue #19092: contextlib.ExitStack now correctly reraises exceptions
  from the __exit__ callbacks of inner context managers (Patch by Hrvoje
  Nikšić)
1694

1695 1696
- Issue #12641: Avoid passing "-mno-cygwin" to the mingw32 compiler, except
  when necessary.  Patch by Oscar Benjamin.
1697

1698 1699 1700 1701
- Issue #5845: In site.py, only load readline history from ~/.python_history
  if no history has been read already.  This avoids double writes to the
  history file at shutdown.

1702 1703
- Properly initialize all fields of a SSL object after allocation.

1704 1705 1706
- Issue #19095: SSLSocket.getpeercert() now raises ValueError when the
  SSL handshake hasn't been done.

1707 1708 1709
- Issue #4366: Fix building extensions on all platforms when --enable-shared
  is used.

1710 1711 1712 1713 1714
- Issue #19030: Fixed `inspect.getmembers` and `inspect.classify_class_attrs`
  to attempt activating descriptors before falling back to a __dict__ search
  for faulty descriptors.  `inspect.classify_class_attrs` no longer returns
  Attributes whose home class is None.

1715 1716 1717
C API
-----

1718 1719
- Issue #1772673: The type of `char*` arguments now changed to `const char*`.

1720 1721 1722 1723 1724
- Issue #16129: Added a `Py_SetStandardStreamEncoding` pre-initialization API
  to allow embedding applications like Blender to force a particular
  encoding and error handler for the standard IO streams (initial patch by
  Bastien Montagne)

1725 1726 1727
Tests
-----

1728 1729
- Issue #19275: Fix test_site on AMD64 Snow Leopard

1730 1731
- Issue #14407: Fix unittest test discovery in test_concurrent_futures.

1732 1733 1734
- Issue #18919: Unified and extended tests for audio modules: aifc, sunau and
  wave.

1735 1736
- Issue #18714: Added tests for ``pdb.find_function()``.

1737 1738 1739
Documentation
-------------

1740 1741
- Issue #18758: Fixed and improved cross-references.

1742 1743
- Issue #18972: Modernize email examples and use the argparse module in them.

1744 1745 1746 1747 1748
Build
-----

- Issue #19130: Correct PCbuild/readme.txt, Python 3.3 and 3.4 require VS 2010.

1749
- Issue #15663: Update OS X 10.6+ installer to use Tcl/Tk 8.5.15.
Larry Hastings's avatar
Larry Hastings committed
1750

1751 1752 1753 1754 1755 1756
- Issue #14499: Fix several problems with OS X universal build support:
    1. ppc arch detection for extension module builds broke with Xcode 5
    2. ppc arch detection in configure did not work on OS X 10.4
    3. -sysroot and -arch flags were unnecessarily duplicated
    4. there was no obvious way to configure an intel-32 only build.

1757 1758 1759 1760 1761
- Issue #19019: Change the OS X installer build script to use CFLAGS instead
  of OPT for special build options.  By setting OPT, some compiler-specific
  options like -fwrapv were overridden and thus not used, which could result
  in broken interpreters when building with clang.

Larry Hastings's avatar
Larry Hastings committed
1762 1763 1764 1765 1766
What's New in Python 3.4.0 Alpha 3?
===================================

Release date: 2013-09-29

Larry Hastings's avatar
Larry Hastings committed
1767 1768 1769
Core and Builtins
-----------------

1770 1771
- Issue #18818: The "encodingname" part of PYTHONIOENCODING is now optional.

1772
- Issue #19098: Prevent overflow in the compiler when the recursion limit is set
Benjamin Peterson's avatar
Benjamin Peterson committed
1773
  absurdly high.
1774

Larry Hastings's avatar
Larry Hastings committed
1775 1776 1777
Library
-------

Ethan Furman's avatar
Ethan Furman committed
1778 1779 1780
- Issue #18929: `inspect.classify_class_attrs()` now correctly finds class
  attributes returned by `dir()` that are located in the metaclass.

1781 1782 1783 1784 1785 1786 1787
- Issue #18950: Fix miscellaneous bugs in the sunau module.
  Au_read.readframes() now updates current file position and reads correct
  number of frames from multichannel stream.  Au_write.writeframesraw() now
  correctly updates current file position.  Au_read.getnframes() now returns an
  integer (as in Python 2).  Au_read and Au_write now correctly works with file
  object if start file position is not a zero.

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
1788 1789 1790
- Issue #18594: The fast path for collections.Counter() was never taken
  due to an over-restrictive type check.

1791 1792 1793
- Issue #19053: ZipExtFile.read1() with non-zero argument no more returns empty
  bytes until end of data.

1794 1795 1796
- logging: added support for Unix domain sockets to SocketHandler and
  DatagramHandler.

1797 1798 1799
- Issue #18996: TestCase.assertEqual() now more cleverly shorten differing
  strings in error report.

1800 1801
- Issue #19034: repr() for tkinter.Tcl_Obj now exposes string reperesentation.

Jason R. Coombs's avatar
Jason R. Coombs committed
1802 1803 1804
- Issue #18978: ``urllib.request.Request`` now allows the method to be
  indicated on the class and no longer sets it to None in ``__init__``.

1805 1806 1807
- Issue #18626: the inspect module now offers a basic command line
  introspection interface (Initial patch by Claudiu Popa)

1808 1809 1810
- Issue #3015: Fixed tkinter with wantobject=False.  Any Tcl command call
  returned empty string.

1811 1812 1813 1814
- Issue #19037: The mailbox module now makes all changes to maildir files
  before moving them into place, to avoid race conditions with other programs
  that may be accessing the maildir directory.

1815 1816 1817 1818 1819
- Issue #14984: On POSIX systems, when netrc is called without a filename
  argument (and therefore is reading the user's $HOME/.netrc file), it now
  enforces the same security rules as typical ftp clients: the .netrc file must
  be owned by the user that owns the process and must not be readable by any
  other user.
1820

1821 1822
- Issue #18873: The tokenize module now detects Python source code encoding
  only in comment lines.
1823

1824 1825 1826
- Issue #17764: Enable http.server to bind to a user specified network
  interface.  Patch contributed by Malte Swart.

1827 1828
- Issue #18937: Add an assertLogs() context manager to unittest.TestCase
  to ensure that a block of code emits a message using the logging module.
1829

1830 1831
- Issue #17324: Fix http.server's request handling case on trailing '/'. Patch
  contributed by Vajrasky Kok.
1832

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
1833 1834
- Issue #19018: The heapq.merge() function no longer suppresses IndexError
  in the underlying iterables.
1835

R David Murray's avatar
R David Murray committed
1836 1837 1838
- Issue #18784: The uuid module no longer attempts to load libc via ctypes.CDLL
  if all the necessary functions have already been found in libuuid.  Patch by
  Evgeny Sologubov.
1839

1840 1841 1842 1843
- The :envvar:`PYTHONFAULTHANDLER` environment variable now only enables the
  faulthandler module if the variable is non-empty. Same behaviour than other
  variables like :envvar:`PYTHONDONTWRITEBYTECODE`.

1844 1845 1846 1847
- Issue #1565525: New function ``traceback.clear_frames`` will clear
  the local variables of all the stack frames referenced by a traceback
  object.

Nick Coghlan's avatar
Nick Coghlan committed
1848 1849
Tests
-----
1850

Nick Coghlan's avatar
Nick Coghlan committed
1851 1852 1853
- Issue #18952: Fix regression in support data downloads introduced when
  test.support was converted to a package. Regression noticed by Zachary
  Ware.
1854

1855 1856
IDLE
----
1857

1858 1859
- Issue #18873: IDLE now detects Python source code encoding only in comment
  lines.
1860

1861
- Issue #18988: The "Tab" key now works when a word is already autocompleted.
1862

1863 1864 1865 1866 1867 1868
Documentation
-------------

- Issue #17003: Unified the size argument names in the io module with common
  practice.

1869 1870 1871 1872 1873 1874 1875
Build
-----

- Issue #18596: Support the use of address sanity checking in recent versions
  of clang and GCC by appropriately marking known false alarms in the small
  object allocator. Patch contributed by Dhiru Kholia.

1876 1877 1878 1879 1880 1881
Tools/Demos
-----------

- Issue #18873: 2to3 and the findnocoding.py script now detect Python source
  code encoding only in comment lines.

Larry Hastings's avatar
Larry Hastings committed
1882

1883 1884 1885
What's New in Python 3.4.0 Alpha 2?
===================================

Larry Hastings's avatar
Larry Hastings committed
1886
Release date: 2013-09-09
1887 1888 1889 1890

Core and Builtins
-----------------

1891 1892
- Issue #18942: sys._debugmallocstats() output was damaged on Windows.

1893 1894 1895 1896 1897
- Issue #18571: Implementation of the PEP 446: file descriptors and file
  handles are now created non-inheritable; add functions
  os.get/set_inheritable(), os.get/set_handle_inheritable() and
  socket.socket.get/set_inheritable().

1898 1899 1900
- Issue #11619: The parser and the import machinery do not encode Unicode
  filenames anymore on Windows.

1901 1902 1903
- Issue #18808: Non-daemon threads are now automatically joined when
  a sub-interpreter is shutdown (it would previously dump a fatal error).

R David Murray's avatar
R David Murray committed
1904
- Remove support for compiling on systems without getcwd().
1905

1906 1907
- Issue #18774: Remove last bits of GNU PTH thread code and thread_pth.h.

1908 1909 1910 1911
- Issue #18771: Add optimization to set object lookups to reduce the cost
  of hash collisions.  The core idea is to inspect a second key/hash pair
  for each cache line retrieved.

1912 1913 1914 1915
- Issue #16105: When a signal handler fails to write to the file descriptor
  registered with ``signal.set_wakeup_fd()``, report an exception instead
  of ignoring the error.

1916 1917
- Issue #18722: Remove uses of the "register" keyword in C code.

1918 1919
- Issue #18667: Add missing "HAVE_FCHOWNAT" symbol to posix._have_functions.

1920
- Issue #16499: Add command line option for isolated mode.
1921

1922 1923 1924
- Issue #15301: Parsing fd, uid, and gid parameters for builtins
  in Modules/posixmodule.c is now far more robust.

1925
- Issue #18368: PyOS_StdioReadline() no longer leaks memory when realloc()
1926
  fail.
1927

1928 1929 1930
- Issue #17934: Add a clear() method to frame objects, to help clean up
  expensive details (local variables) and break reference cycles.

1931 1932 1933
- Issue #18780: %-formatting codes %d, %i, and %u now treat int-subclasses
  as int (displays value of int-subclass instead of str(int-subclass) ).

1934 1935 1936
Library
-------

1937 1938 1939 1940
- Issue #18808: Thread.join() now waits for the underlying thread state to
  be destroyed before returning.  This prevents unpredictable aborts in
  Py_EndInterpreter() when some non-daemon threads are still running.

1941 1942 1943
- Issue #18458: Prevent crashes with newer versions of libedit.  Its readline
  emulation has changed from 0-based indexing to 1-based like gnu readline.

1944 1945 1946
- Issue #18852: Handle case of ``readline.__doc__`` being ``None`` in the new
  readline activation code in ``site.py``.

1947
- Issue #18672: Fixed format specifiers for Py_ssize_t in debugging output in
Serhiy Storchaka's avatar
Serhiy Storchaka committed
1948
  the _sre module.
1949

R David Murray's avatar
R David Murray committed
1950
- Issue #18830: inspect.getclasstree() no longer produces duplicate entries even
1951 1952
  when input list contains duplicates.

1953 1954 1955
- Issue #18878: sunau.open now supports the context manager protocol.  Based on
  patches by Claudiu Popa and R. David Murray.

1956 1957 1958
- Issue #18909: Fix _tkinter.tkapp.interpaddr() on Windows 64-bit, don't cast
  64-bit pointer to long (32 bits).

1959 1960
- Issue #18876: The FileIO.mode attribute now better reflects the actual mode
  under which the file was opened.  Patch by Erik Bray.
1961

1962 1963
- Issue #16853: Add new selectors module.

1964 1965
- Issue #18882: Add threading.main_thread() function.

1966 1967 1968
- Issue #18901: The sunau getparams method now returns a namedtuple rather than
  a plain tuple.  Patch by Claudiu Popa.

1969 1970 1971
- Issue #17487: The result of the wave getparams method now is pickleable again.
  Patch by Claudiu Popa.

1972 1973 1974 1975
- Issue #18756: os.urandom() now uses a lazily-opened persistent file
  descriptor, so as to avoid using many file descriptors when run in
  parallel from multiple threads.

1976 1977 1978
- Issue #18418: After fork(), reinit all threads states, not only active ones.
  Patch by A. Jesse Jiryu Davis.

1979 1980
- Issue #17974: Switch unittest from using getopt to using argparse.

1981 1982
- Issue #11798: TestSuite now drops references to own tests after execution.

1983 1984 1985
- Issue #16611: http.cookie now correctly parses the 'secure' and 'httponly'
  cookie flags.

1986 1987 1988
- Issue #11973: Fix a problem in kevent. The flags and fflags fields are now
  properly handled as unsigned.

1989 1990 1991
- Issue #18807: ``pyvenv`` now takes a --copies argument allowing copies
  instead of symlinks even where symlinks are available and the default.

1992 1993 1994
- Issue #18538: ``python -m dis`` now uses argparse for argument processing.
  Patch by Michele Orrù.

1995 1996
- Issue #18394: Close cgi.FieldStorage's optional file.

R David Murray's avatar
R David Murray committed
1997
- Issue #17702: On error, os.environb now suppresses the exception context
1998 1999
  when raising a new KeyError with the original key.

2000 2001
- Issue #16809: Fixed some tkinter incompabilities with Tcl/Tk 8.6.

2002 2003 2004
- Issue #16809: Tkinter's splitlist() and split() methods now accept Tcl_Obj
  argument.

2005 2006 2007
- Issue #18324: set_payload now correctly handles binary input.  This also
  supersedes the previous fixes for #14360, #1717, and #16564.

2008 2009 2010
- Issue #18794: Add a fileno() method and a closed attribute to select.devpoll
  objects.

2011 2012 2013
- Issue #17119: Fixed integer overflows when processing large strings and tuples
  in the tkinter module.

2014
- Issue #18747: Re-seed OpenSSL's pseudo-random number generator after fork.
2015
  A pthread_atfork() parent handler is used to seed the PRNG with pid, time
2016 2017
  and some stack data.

2018 2019 2020
- Issue #8865: Concurrent invocation of select.poll.poll() now raises a
  RuntimeError exception.  Patch by Christian Schubert.

2021 2022 2023
- Issue #18777: The ssl module now uses the new CRYPTO_THREADID API of
  OpenSSL 1.0.0+ instead of the deprecated CRYPTO id callback function.

Christian Heimes's avatar
Christian Heimes committed
2024
- Issue #18768: Correct doc string of RAND_edg(). Patch by Vajrasky Kok.
2025

2026 2027 2028
- Issue #18178: Fix ctypes on BSD. dlmalloc.c was compiled twice which broke
  malloc weak symbols.

2029 2030 2031 2032 2033 2034
- Issue #18709: Fix CVE-2013-4238. The SSL module now handles NULL bytes
  inside subjectAltName correctly. Formerly the module has used OpenSSL's
  GENERAL_NAME_print() function to get the string represention of ASN.1
  strings for ``rfc822Name`` (email), ``dNSName`` (DNS) and
  ``uniformResourceIdentifier`` (URI).

2035 2036
- Issue #18701: Remove support of old CPython versions (<3.0) from C code.

2037 2038 2039 2040
- Issue #18756: Improve error reporting in os.urandom() when the failure
  is due to something else than /dev/urandom not existing (for example,
  exhausting the file descriptor limit).

2041 2042 2043
- Issue #18673: Add O_TMPFILE to os module. O_TMPFILE requires Linux kernel
  3.11 or newer. It's only defined on system with 3.11 uapi headers, too.

2044 2045 2046
- Issue #18532: Change the builtin hash algorithms' names to lower case names
  as promised by hashlib's documentation.

2047 2048
- Issue #18405: Improve the entropy of crypt.mksalt().

2049 2050 2051 2052 2053
- Issue #12015: The tempfile module now uses a suffix of 8 random characters
  instead of 6, to reduce the risk of filename collision. The entropy was
  reduced when uppercase letters were removed from the charset used to generate
  random characters.

2054 2055 2056
- Issue #18585: Add :func:`textwrap.shorten` to collapse and truncate a
  piece of text to a given length.

2057 2058 2059
- Issue #18598: Tweak exception message for importlib.import_module() to
  include the module name when a key argument is missing.

Eric Snow's avatar
Eric Snow committed
2060
- Issue #19151: Fix docstring and use of _get_supported_file_loaders() to
2061 2062
  reflect 2-tuples.

2063 2064
- Issue #19152: Add ExtensionFileLoader.get_filename().

Terry Jan Reedy's avatar
Terry Jan Reedy committed
2065 2066 2067
- Issue #18676: Change 'positive' to 'non-negative' in queue.py put and get
  docstrings and ValueError messages. Patch by Zhongyue Luo

2068 2069
- Fix refcounting issue with extension types in tkinter.

2070 2071 2072
- Issue #8112: xlmrpc.server's DocXMLRPCServer server no longer raises an error
  if methods have annotations; it now correctly displays the annotations.

2073 2074 2075
- Issue #18600: Added policy argument to email.message.Message.as_string,
  and as_bytes and __bytes__ methods to Message.

2076 2077
- Issue #18671: Output more information when logging exceptions occur.

2078 2079 2080
- Issue #18621: Prevent the site module's patched builtins from keeping
  too many references alive for too long.

2081 2082 2083 2084
- Issue #4885: Add weakref support to mmap objects.  Patch by Valerie Lambert.

- Issue #8860: Fixed rounding in timedelta constructor.

2085 2086 2087
- Issue #18849: Fixed a Windows-specific tempfile bug where collision with an
  existing directory caused mkstemp and related APIs to fail instead of
  retrying. Report and fix by Vlad Shcherbina.
2088

2089 2090 2091
- Issue #18920: argparse's default destination for the version action (-v,
  --version) has also been changed to stdout, to match the Python executable.

2092 2093 2094
Tests
-----

2095 2096 2097
- Issue #18623: Factor out the _SuppressCoreFiles context manager into
  test.support.  Patch by Valerie Lambert.

2098 2099
- Issue #12037: Fix test_email for desktop Windows.

2100 2101 2102 2103 2104
- Issue #15507: test_subprocess's test_send_signal could fail if the test
  runner were run in an environment where the process inherited an ignore
  setting for SIGINT.  Restore the SIGINT handler to the desired
  KeyboardInterrupt raising one during that test.

2105 2106 2107
- Issue #16799: Switched from getopt to argparse style in regrtest's argument
  parsing.  Added more tests for regrtest's argument parsing.

2108 2109 2110 2111
- Issue #18792: Use "127.0.0.1" or "::1" instead of "localhost" as much as
  possible, since "localhost" goes through a DNS lookup under recent Windows
  versions.

2112 2113 2114 2115 2116
IDLE
----

- Issue #18489: Add tests for SearchEngine. Original patch by Phil Webster.

2117 2118 2119
Documentation
-------------

2120 2121
- Issue #18743: Fix references to non-existant "StringIO" module.

2122 2123 2124
- Issue #18783: Removed existing mentions of Python long type in docstrings,
  error messages and comments.

2125 2126 2127 2128 2129 2130
Build
-----

- Issue #1584: Provide configure options to override default search paths for
  Tcl and Tk when building _tkinter.

2131 2132 2133 2134 2135
- Issue #15663: Tcl/Tk 8.5.14 is now included with the OS X 10.6+ 64-/32-bit
  installer.  It is no longer necessary to install a third-party version of
  Tcl/Tk 8.5 to work around the problems in the Apple-supplied Tcl/Tk 8.5
  shipped in OS X 10.6 and later releases.

2136 2137 2138 2139 2140 2141
Tools/Demos
-----------

- Issue #18922: Now The Lib/smtpd.py and Tools/i18n/msgfmt.py scripts write
  their version strings to stdout, and not to sderr.

Georg Brandl's avatar
Georg Brandl committed
2142 2143
What's New in Python 3.4.0 Alpha 1?
===================================
2144

Larry Hastings's avatar
Larry Hastings committed
2145
Release date: 2013-08-03
2146 2147 2148 2149

Core and Builtins
-----------------

2150 2151
- Issue #16741: Fix an error reporting in int().

2152 2153
- Issue #17899: Fix rare file descriptor leak in os.listdir().

2154 2155 2156
- Issue #10241: Clear extension module dict copies at interpreter shutdown.
  Patch by Neil Schemenauer, minimally modified.

2157 2158 2159
- Issue #9035: ismount now recognises volumes mounted below a drive root
  on Windows. Original patch by Atsuo Ishimoto.

2160 2161 2162
- Issue #18214: Improve finalization of Python modules to avoid setting
  their globals to None, in most cases.

2163 2164
- Issue #18112: PEP 442 implementation (safe object finalization).

2165 2166 2167
- Issue #18552: Check return value of PyArena_AddPyObject() in
  obj2ast_object().

2168 2169
- Issue #18560: Fix potential NULL pointer dereference in sum().

2170 2171 2172 2173
- Issue #18520: Add a new PyStructSequence_InitType2() function, same than
  PyStructSequence_InitType() except that it has a return value (0 on success,
  -1 on error).

2174 2175 2176
- Issue #15905: Fix theoretical buffer overflow in handling of sys.argv[0],
  prefix and exec_prefix if the operation system does not obey MAXPATHLEN.

2177 2178 2179
- Issue #18408: Fix many various bugs in code handling errors, especially
  on memory allocation failure (MemoryError).

2180 2181
- Issue #18344: Fix potential ref-leaks in _bufferedreader_read_all().

2182 2183 2184
- Issue #18342: Use the repr of a module name when an import fails when using
  ``from ... import ...``.

2185 2186 2187
- Issue #17872: Fix a segfault in marshal.load() when input stream returns
  more bytes than requested.

2188 2189 2190
- Issue #18338: `python --version` now prints version string to stdout, and
  not to stderr.  Patch by Berker Peksag and Michael Dickens.

2191 2192 2193
- Issue #18426: Fix NULL pointer dereference in C extension import when
  PyModule_GetDef() returns an error.

2194 2195 2196 2197
- Issue #17206: On Windows, increase the stack size from 2 MB to 4.2 MB to fix
  a stack overflow in the marshal module (fix a crash in test_marshal).
  Patch written by Jeremy Kloth.

2198 2199 2200
- Issue #3329: Implement the PEP 445: Add new APIs to customize Python memory
  allocators.

2201 2202 2203
- Issue #18328: Reorder ops in PyThreadState_Delete*() functions. Now the
  tstate is first removed from TLS and then deallocated.

2204 2205
- Issue #13483: Use VirtualAlloc in obmalloc on Windows.

2206 2207 2208
- Issue #18184: PyUnicode_FromFormat() and PyUnicode_FromFormatV() now raise
  OverflowError when an argument of %c format is out of range.

2209 2210 2211 2212
- Issue #18111: The min() and max() functions now support a default argument
  to be returned instead of raising a ValueError on an empty sequence.
  (Contributed by Julian Berman.)

2213 2214 2215
- Issue #18137: Detect integer overflow on precision in float.__format__()
  and complex.__format__().

2216 2217 2218
- Issue #18183: Fix various unicode operations on strings with large unicode
  codepoints.

2219 2220
- Issue #18180: Fix ref leak in _PyImport_GetDynLoadWindows().

2221 2222 2223
- Issue #18038: SyntaxError raised during compilation sources with illegal
  encoding now always contains an encoding name.

2224 2225
- Issue #17931: Resolve confusion on Windows between pids and process
  handles.
2226

2227 2228 2229
- Tweak the exception message when the magic number or size value in a bytecode
  file is truncated.

2230 2231 2232
- Issue #17932: Fix an integer overflow issue on Windows 64-bit in iterators:
  change the C type of seqiterobject.it_index from long to Py_ssize_t.

2233 2234 2235 2236 2237 2238
- Issue #18065: Don't set __path__ to the package name for frozen packages.

- Issue #18088: When reloading a module, unconditionally reset all relevant
  attributes on the module (e.g. __name__, __loader__, __package__, __file__,
  __cached__).

2239 2240
- Issue #17937: Try harder to collect cyclic garbage at shutdown.

2241 2242 2243
- Issue #12370: Prevent class bodies from interfering with the __class__
  closure.

2244 2245 2246
- Issue #17644: Fix a crash in str.format when curly braces are used in square
  brackets.

2247 2248
- Issue #17237: Fix crash in the ASCII decoder on m68k.

2249 2250 2251
- Issue #17927: Frame objects kept arguments alive if they had been
  copied into a cell, even if the cell was cleared.

2252 2253 2254
- Issue #1545463: At shutdown, defer finalization of codec modules so
  that stderr remains usable.

2255 2256 2257
- Issue #7330: Implement width and precision (ex: "%5.3s") for the format
  string of PyUnicode_FromFormat() function, original patch written by Ysj Ray.

2258 2259 2260
- Issue #1545463: Global variables caught in reference cycles are now
  garbage-collected at shutdown.

2261 2262 2263 2264 2265
- Issue #17094: Clear stale thread states after fork().  Note that this
  is a potentially disruptive change since it may release some system
  resources which would otherwise remain perpetually alive (e.g. database
  connections kept in thread-local storage).

2266 2267 2268
- Issue #17408: Avoid using an obsolete instance of the copyreg module when
  the interpreter is shutdown and then started again.

2269 2270 2271
- Issue #5845: Enable tab-completion in the interactive interpreter by
  default, thanks to a new sys.__interactivehook__.

2272 2273 2274
- Issue #17115,17116: Module initialization now includes setting __package__ and
  __loader__ attributes to None.

2275 2276 2277
- Issue #17853: Ensure locals of a class that shadow free variables always win
  over the closures.

2278 2279 2280
- Issue #17863: In the interactive console, don't loop forever if the encoding
  can't be fetched from stdin.

2281 2282
- Issue #17867: Raise an ImportError if __import__ is not found in __builtins__.

2283 2284
- Issue #18698: Ensure importlib.reload() returns the module out of sys.modules.

2285 2286 2287
- Issue #17857: Prevent build failures with pre-3.5.0 versions of sqlite3,
  such as was shipped with Centos 5 and Mac OS X 10.4.

2288 2289 2290 2291
- Issue #17413: sys.settrace callbacks were being passed a string instead of an
  exception instance for the 'value' element of the arg tuple if the exception
  originated from C code; now an exception instance is always provided.

2292 2293 2294
- Issue #17782: Fix undefined behaviour on platforms where
  ``struct timespec``'s "tv_nsec" member is not a C long.

2295 2296
- Issue #17722: When looking up __round__, resolve descriptors.

2297 2298
- Issue #16061: Speed up str.replace() for replacing 1-character strings.

2299 2300 2301
- Issue #17715: Fix segmentation fault from raising an exception in a __trunc__
  method.

2302 2303
- Issue #17643: Add __callback__ attribute to weakref.ref.

2304 2305 2306
- Issue #16447: Fixed potential segmentation fault when setting __name__ on a
  class.

2307 2308
- Issue #17669: Fix crash involving finalization of generators using yield from.

2309 2310
- Issue #14439: Python now prints the traceback on runpy failure at startup.

2311 2312 2313
- Issue #17469: Fix _Py_GetAllocatedBlocks() and sys.getallocatedblocks()
  when running on valgrind.

2314 2315
- Issue #17619: Make input() check for Ctrl-C correctly on Windows.

Brett Cannon's avatar
merge  
Brett Cannon committed
2316 2317
- Issue #17357: Add missing verbosity messages for -v/-vv that were lost during
  the importlib transition.
2318

2319 2320
- Issue #17610: Don't rely on non-standard behavior of the C qsort() function.

2321 2322 2323
- Issue #17323: The "[X refs, Y blocks]" printed by debug builds has been
  disabled by default.  It can be re-enabled with the `-X showrefcount` option.

2324 2325 2326 2327 2328 2329 2330 2331 2332 2333 2334 2335 2336 2337 2338 2339 2340 2341 2342 2343 2344 2345 2346 2347 2348 2349 2350 2351 2352 2353 2354 2355 2356 2357 2358 2359 2360 2361 2362 2363 2364 2365 2366 2367 2368 2369 2370 2371 2372 2373 2374 2375 2376 2377 2378 2379 2380 2381 2382 2383 2384 2385 2386 2387 2388 2389 2390 2391 2392 2393 2394 2395 2396 2397 2398 2399 2400 2401 2402 2403 2404 2405 2406 2407 2408 2409 2410 2411 2412 2413 2414 2415 2416 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429
- Issue #17328: Fix possible refleak in dict.setdefault.

- Issue #17275: Corrected class name in init error messages of the C version of
  BufferedWriter and BufferedRandom.

- Issue #7963: Fixed misleading error message that issued when object is
  called without arguments.

- Issue #8745: Small speed up zipimport on Windows. Patch by Catalin Iacob.

- Issue #5308: Raise ValueError when marshalling too large object (a sequence
  with size >= 2**31), instead of producing illegal marshal data.

- Issue #12983: Bytes literals with invalid \x escape now raise a SyntaxError
  and a full traceback including line number.

- Issue #16967: In function definition, evaluate positional defaults before
  keyword-only defaults.

- Issue #17173: Remove uses of locale-dependent C functions (isalpha() etc.)
  in the interpreter.

- Issue #17137: When an Unicode string is resized, the internal wide character
  string (wstr) format is now cleared.

- Issue #17043: The unicode-internal decoder no longer read past the end of
  input buffer.

- Issue #17098: All modules now have __loader__ set even if they pre-exist the
  bootstrapping of importlib.

- Issue #16979: Fix error handling bugs in the unicode-escape-decode decoder.

- Issue #16772: The base argument to the int constructor no longer accepts
  floats, or other non-integer objects with an __int__ method.  Objects
  with an __index__ method are now accepted.

- Issue #10156: In the interpreter's initialization phase, unicode globals
  are now initialized dynamically as needed.

- Issue #16980: Fix processing of escaped non-ascii bytes in the
  unicode-escape-decode decoder.

- Issue #16975: Fix error handling bug in the escape-decode bytes decoder.

- Issue #14850: Now a charmap decoder treats U+FFFE as "undefined mapping"
  in any mapping, not only in a string.

- Issue #16730: importlib.machinery.FileFinder now no longers raises an
  exception when trying to populate its cache and it finds out the directory is
  unreadable or has turned into a file. Reported and diagnosed by
  David Pritchard.

- Issue #16906: Fix a logic error that prevented most static strings from being
  cleared.

- Issue #11461: Fix the incremental UTF-16 decoder. Original patch by
  Amaury Forgeot d'Arc.

- Issue #16856: Fix a segmentation fault from calling repr() on a dict with
  a key whose repr raise an exception.

- Issue #16367: Fix FileIO.readall() on Windows for files larger than 2 GB.

- Issue #16761: Calling int() with base argument only now raises TypeError.

- Issue #16759: Support the full DWORD (unsigned long) range in Reg2Py
  when retrieving a REG_DWORD value. This corrects functions like
  winreg.QueryValueEx that may have been returning truncated values.

- Issue #14420: Support the full DWORD (unsigned long) range in Py2Reg
  when passed a REG_DWORD value. Fixes OverflowError in winreg.SetValueEx.

- Issue #11939: Set the st_dev attribute of stat_result to allow Windows to
  take advantage of the os.path.samefile/sameopenfile/samestat implementations
  used by other platforms.

- Issue #16772: The int() constructor's second argument (base) no longer
  accepts non integer values.  Consistent with the behavior in Python 2.

- Issue #14470: Remove w9xpopen support per PEP 11.

- Issue #9856: Replace deprecation warning with raising TypeError
  in object.__format__. Patch by Florent Xicluna.

- Issue #16597: In buffered and text IO, call close() on the underlying stream
  if invoking flush() fails.

- Issue #16722: In the bytes() constructor, try to call __bytes__ on the
  argument before __index__.

- Issue #16421: loading multiple modules from one shared object is now
  handled correctly (previously, the first module loaded from that file
  was silently returned). Patch by Václav Šmilauer.

- Issue #16602: When a weakref's target was part of a long deallocation
  chain, the object could remain reachable through its weakref even though
  its refcount had dropped to zero.

- Issue #16495: Remove extraneous NULL encoding check from bytes_decode().

- Issue #16619: Create NameConstant AST class to represent None, True, and False
  literals. As a result, these constants are never loaded at runtime from
  builtins.

- Issue #16455: On FreeBSD and Solaris, if the locale is C, the
2430
  ASCII/surrogateescape codec is now used (instead of the locale encoding) to
2431
  decode the command line arguments. This change fixes inconsistencies with
2432 2433
  os.fsencode() and os.fsdecode(), because these operating systems announce an
  ASCII locale encoding, but actually use the ISO-8859-1 encoding in practice.
2434 2435 2436 2437 2438 2439 2440 2441 2442 2443 2444 2445 2446 2447 2448 2449 2450 2451 2452 2453 2454 2455 2456 2457 2458 2459 2460 2461 2462 2463 2464 2465 2466 2467 2468 2469 2470 2471 2472 2473 2474 2475 2476 2477 2478 2479 2480 2481 2482 2483 2484 2485 2486 2487 2488 2489 2490 2491 2492 2493 2494 2495 2496 2497 2498 2499 2500 2501 2502 2503 2504 2505 2506 2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554

- Issue #16562: Optimize dict equality testing.  Patch by Serhiy Storchaka.

- Issue #16588: Silence unused-but-set warnings in Python/thread_pthread

- Issue #16592: stringlib_bytes_join doesn't raise MemoryError on allocation
  failure.

- Issue #16546: Fix: ast.YieldFrom argument is now mandatory.

- Issue #16514: Fix regression causing a traceback when sys.path[0] is None
  (actually, any non-string or non-bytes type).

- Issue #16306: Fix multiple error messages when unknown command line
  parameters where passed to the interpreter.  Patch by Hieu Nguyen.

- Issue #16215: Fix potential double memory free in str.replace().  Patch
  by Serhiy Storchaka.

- Issue #16290: A float return value from the __complex__ special method is no
  longer accepted in the complex() constructor.

- Issue #16416: On Mac OS X, operating system data are now always
  encoded/decoded to/from UTF-8/surrogateescape, instead of the locale encoding
  (which may be ASCII if no locale environment variable is set), to avoid
  inconsistencies with os.fsencode() and os.fsdecode() functions which are
  already using UTF-8/surrogateescape.

- Issue #16453: Fix equality testing of dead weakref objects.

- Issue #9535: Fix pending signals that have been received but not yet
  handled by Python to not persist after os.fork() in the child process.

- Issue #14794: Fix slice.indices to return correct results for huge values,
  rather than raising OverflowError.

- Issue #15001: fix segfault on "del sys.modules['__main__']". Patch by Victor
  Stinner.

- Issue #8271: the utf-8 decoder now outputs the correct number of U+FFFD
  characters when used with the 'replace' error handler on invalid utf-8
  sequences.  Patch by Serhiy Storchaka, tests by Ezio Melotti.

- Issue #5765: Apply a hard recursion limit in the compiler instead of
  blowing the stack and segfaulting. Initial patch by Andrea Griffini.

- Issue #16402: When slicing a range, fix shadowing of exceptions from
  __index__.

- Issue #16336: fix input checking in the surrogatepass error handler.
  Patch by Serhiy Storchaka.

- Issue #8401: assigning an int to a bytearray slice (e.g. b[3:4] = 5) now
  raises an error.

- Issue #7317: Display full tracebacks when an error occurs asynchronously.
  Patch by Alon Horev with update by Alexey Kachayev.

- Issue #16309: Make PYTHONPATH="" behavior the same as if PYTHONPATH
  not set at all.

- Issue #10189: Improve the error reporting of SyntaxErrors related to global
  and nonlocal statements.

- Fix segfaults on setting __qualname__ on builtin types and attempting to
  delete it on any type.

- Issue #14625: Rewrite the UTF-32 decoder. It is now 3x to 4x faster. Patch
  written by Serhiy Storchaka.

- Issue #16345: Fix an infinite loop when ``fromkeys`` on a dict subclass
  received a nonempty dict from the constructor.

- Issue #16271: Fix strange bugs that resulted from __qualname__ appearing in a
  class's __dict__ and on type.

- Issue #12805: Make bytes.join and bytearray.join faster when the separator
  is empty.  Patch by Serhiy Storchaka.

- Issue #6074: Ensure cached bytecode files can always be updated by the
  user that created them, even when the source file is read-only.

- Issue #15958: bytes.join and bytearray.join now accept arbitrary buffer
  objects.

- Issue #14783: Improve int() docstring and switch docstrings for str(),
  range(), and slice() to use multi-line signatures.

- Issue #16160: Subclass support now works for types.SimpleNamespace.

- Upgrade Unicode data (UCD) to version 6.2.

- Issue #15379: Fix passing of non-BMP characters as integers for the charmap
  decoder (already working as unicode strings).  Patch by Serhiy Storchaka.

- Issue #15144: Fix possible integer overflow when handling pointers as integer
  values, by using `Py_uintptr_t` instead of `size_t`.  Patch by Serhiy
  Storchaka.

- Issue #15965: Explicitly cast `AT_FDCWD` as (int).  Required on Solaris 10
  (which defines `AT_FDCWD` as ``0xffd19553``), harmless on other platforms.

- Issue #15839: Convert SystemErrors in `super()` to RuntimeErrors.

- Issue #15448: Buffered IO now frees the buffer when closed, instead
  of when deallocating.

- Issue #15846: Fix SystemError which happened when using `ast.parse()` in an
  exception handler on code with syntax errors.

- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.

- Issue #15801: Make sure mappings passed to '%' formatting are actually
  subscriptable.

- Issue #15111: __import__ should propagate ImportError when raised as a
  side-effect of a module triggered from using fromlist.

- Issue #15022: Add pickle and comparison support to types.SimpleNamespace.

2555 2556
Library
-------
Terry Jan Reedy's avatar
Terry Jan Reedy committed
2557

2558 2559
- Issue #4331: Added functools.partialmethod (Initial patch by Alon Horev)

2560 2561 2562
- Issue #13461: Fix a crash in the TextIOWrapper.tell method on 64-bit
  platforms.  Patch by Yogesh Chaudhari.

Ezio Melotti's avatar
Ezio Melotti committed
2563
- Issue #18681: Fix a NameError in importlib.reload() (noticed by Weizhao Li).
2564

2565 2566 2567
- Issue #14323: Expanded the number of digits in the coefficients for the
  RGB -- YIQ conversions so that they match the FCC NTSC versions.

2568 2569
- Issue #17998: Fix an internal error in regular expression engine.

2570 2571 2572
- Issue #17557: Fix os.getgroups() to work with the modified behavior of
  getgroups(2) on OS X 10.8.  Original patch by Mateusz Lenik.

2573 2574 2575
- Issue #18608: Avoid keeping a strong reference to the locale module
  inside the _io module.

2576 2577 2578
- Issue #18619: Fix atexit leaking callbacks registered from sub-interpreters,
  and make it GC-aware.

2579 2580 2581 2582
- Issue #15699: The readline module now uses PEP 3121-style module
  initialization, so as to reclaim allocated resources (Python callbacks)
  at shutdown.  Original patch by Robin Schreiber.

2583 2584
- Issue #17616: wave.open now supports the context manager protocol.

2585 2586 2587
- Issue #18599: Fix name attribute of _sha1.sha1() object. It now returns
  'SHA1' instead of 'SHA'.

2588 2589 2590
- Issue #13266: Added inspect.unwrap to easily unravel __wrapped__ chains
  (initial patch by Daniel Urban and Aaron Iles)

2591 2592
- Issue #18561: Skip name in ctypes' _build_callargs() if name is NULL.

2593 2594
- Issue #18559: Fix NULL pointer dereference error in _pickle module

Brett Cannon's avatar
Brett Cannon committed
2595 2596 2597
- Issue #18556: Check the return type of PyUnicode_AsWideChar() in ctype's
  U_set().

2598 2599
- Issue #17818: aifc.getparams now returns a namedtuple.

2600 2601
- Issue #18549: Eliminate dead code in socket_ntohl()

2602 2603 2604
- Issue #18530: Remove additional stat call from posixpath.ismount.
  Patch by Alex Gaynor.

2605 2606
- Issue #18514: Fix unreachable Py_DECREF() call in PyCData_FromBaseObj()

2607 2608 2609
- Issue #9177: Calling read() or write() now raises ValueError, not
  AttributeError, on a closed SSL socket.  Patch by Senko Rasic.

2610 2611 2612
- Issue #18513: Fix behaviour of cmath.rect w.r.t. signed zeros on OS X 10.8 +
  gcc.

2613 2614 2615
- Issue #18479: Changed venv Activate.ps1 to make deactivate a function, and
  removed Deactivate.ps1.

2616 2617
- Issue #18480: Add missing call to PyType_Ready to the _elementtree extension.

2618 2619 2620
- Issue #17778: Fix test discovery for test_multiprocessing. (Patch by
  Zachary Ware.)

2621 2622 2623 2624
- Issue #18393: The private module _gestalt and private functions
  platform._mac_ver_gestalt, platform._mac_ver_lookup and
  platform._bcd2str have been removed. This does not affect the public
  interface of the platform module.
2625

2626 2627 2628 2629
- Issue #17482: functools.update_wrapper (and functools.wraps) now set the
  __wrapped__ attribute correctly even if the underlying function has a
  __wrapped__ attribute set.

2630 2631 2632
- Issue #18431: The new email header parser now decodes RFC2047 encoded words
  in structured headers.

2633 2634 2635
- Issue #18432: The sched module's queue method was incorrectly returning
  an iterator instead of a list.

2636 2637 2638 2639
- Issue #18044: The new email header parser was mis-parsing encoded words where
  an encoded character immediately followed the '?' that follows the CTE
  character, resulting in a decoding failure.  They are now decoded correctly.

2640 2641 2642
- Issue #18101: Tcl.split() now process strings nested in a tuple as it
  do with byte strings.

2643
- Issue #18116: getpass was always getting an error when testing /dev/tty,
2644 2645 2646
  and thus was always falling back to stdin, and would then raise an exception
  if stdin could not be used (such as /dev/null).  It also leaked an open file.
  All of these issues are now fixed.
2647

2648 2649 2650
- Issue #17198: Fix a NameError in the dbm module.  Patch by Valentina
  Mukhamedzhanova.

2651 2652
- Issue #18013: Fix cgi.FieldStorage to parse the W3C sample form.

2653 2654 2655
- Issue #18020: improve html.escape speed by an order of magnitude.
  Patch by Matt Bryant.

2656 2657 2658
- Issue #18347: ElementTree's html serializer now preserves the case of
  closing tags.

2659 2660
- Issue #17261: Ensure multiprocessing's proxies use proper address.

2661 2662 2663 2664
- Issue #18343: faulthandler.register() now keeps the previous signal handler
  when the function is called twice, so faulthandler.unregister() restores
  correctly the original signal handler.

2665 2666
- Issue #17097: Make multiprocessing ignore EINTR.

2667 2668 2669
- Issue #18339: Negative ints keys in unpickler.memo dict no longer cause a
  segfault inside the _pickle C extension.

2670
- Issue #18240: The HMAC module is no longer restricted to bytes and accepts
2671 2672
  any bytes-like object, e.g. memoryview. Original patch by Jonas Borgström.

2673 2674
- Issue #18224: Removed pydoc script from created venv, as it causes problems
  on Windows and adds no value over and above python -m pydoc ...
2675

2676 2677 2678
- Issue #18155: The csv module now correctly handles csv files that use
  a delimter character that has a special meaning in regexes, instead of
  throwing an exception.
2679

R David Murray's avatar
R David Murray committed
2680 2681
- Issue #14360: encode_quopri can now be successfully used as an encoder
  when constructing a MIMEApplication object.
2682

2683 2684 2685
- Issue #11390: Add -o and -f command line options to the doctest CLI to
  specify doctest options (and convert it to using argparse).

2686 2687 2688 2689
- Issue #18135: ssl.SSLSocket.write() now raises an OverflowError if the input
  string in longer than 2 gigabytes, and ssl.SSLContext.load_cert_chain()
  raises a ValueError if the password is longer than 2 gigabytes. The ssl
  module does not support partial write.
2690

2691 2692
- Issue #11016: Add C implementation of the stat module as _stat.

Benjamin Peterson's avatar
Benjamin Peterson committed
2693
- Issue #18248: Fix libffi build on AIX.
2694

2695
- Issue #18259: Declare sethostname in socketmodule.c for AIX
2696

2697 2698 2699 2700
- Issue #18147: Add diagnostic functions to ssl.SSLContext(). get_ca_list()
  lists all loaded CA certificates and cert_store_stats() returns amount of
  loaded X.509 certs, X.509 CA certs and CRLs.

2701
- Issue #18167: cgi.FieldStorage no longer fails to handle multipart/form-data
2702
  when \r\n appears at end of 65535 bytes without other newlines.
2703

2704
- Issue #18076: Introduce importlib.util.decode_source().
2705 2706
- Issue #18357: add tests for dictview set difference.
  Patch by Fraser Tweedale.
2707

2708 2709 2710
- importlib.abc.SourceLoader.get_source() no longer changes SyntaxError or
  UnicodeDecodeError into ImportError.

2711 2712 2713 2714
- Issue #18058, 18057: Make the namespace package loader meet the
  importlib.abc.InspectLoader ABC, allowing for namespace packages to work with
  runpy.

2715 2716
- Issue #17177: The imp module is pending deprecation.

2717 2718 2719
- subprocess: Prevent a possible double close of parent pipe fds when the
  subprocess exec runs into an error.  Prevent a regular multi-close of the
  /dev/null fd when any of stdin, stdout and stderr was set to DEVNULL.
2720

2721 2722 2723 2724
- Issue #18194: Introduce importlib.util.cache_from_source() and
  source_from_cache() while documenting the equivalent functions in imp as
  deprecated.

2725 2726 2727
- Issue #17907: Document imp.new_module() as deprecated in favour of
  types.ModuleType.

2728 2729 2730
- Issue #18192: Introduce importlib.util.MAGIC_NUMBER and document as deprecated
  imp.get_magic().

2731 2732 2733
- Issue #18149: Add filecmp.clear_cache() to manually clear the filecmp cache.
  Patch by Mark Levitt

2734 2735
- Issue #18193: Add importlib.reload().

2736 2737
- Issue #18157: Stop using imp.load_module() in pydoc.

2738
- Issue #16102: Make uuid._netbios_getnode() work again on Python 3.
2739

2740 2741
- Issue #17134: Add ssl.enum_cert_store() as interface to Windows' cert store.

2742 2743 2744
- Issue #18143: Implement ssl.get_default_verify_paths() in order to debug
  the default locations for cafile and capath.

2745 2746
- Issue #17314: Move multiprocessing.forking over to importlib.

2747 2748 2749
- Issue #11959: SMTPServer and SMTPChannel now take an optional map, use of
  which avoids affecting global state.

2750 2751 2752
- Issue #18109: os.uname() now decodes fields from the locale encoding, and
  socket.gethostname() now decodes the hostname from the locale encoding,
  instead of using the UTF-8 encoding in strict mode.
2753

Brett Cannon's avatar
Brett Cannon committed
2754 2755 2756 2757 2758 2759
- Issue #18089: Implement importlib.abc.InspectLoader.load_module.

- Issue #18088: Introduce importlib.abc.Loader.init_module_attrs for setting
  module attributes. Leads to the pending deprecation of
  importlib.util.module_for_loader.

Senthil Kumaran's avatar
Senthil Kumaran committed
2760 2761 2762
- Issue #17403: urllib.parse.robotparser normalizes the urls before adding to
  ruleline. This helps in handling certain types invalid urls in a conservative
  manner. Patch contributed by Mher Movsisyan.
2763

2764 2765 2766
- Issue #18070: Have importlib.util.module_for_loader() set attributes
  unconditionally in order to properly support reloading.

Brett Cannon's avatar
Brett Cannon committed
2767
- Added importlib.util.module_to_load to return a context manager to provide the
2768
  proper module object to load.
2769

2770 2771
- Issue #18025: Fixed a segfault in io.BufferedIOBase.readinto() when raw
  stream's read() returns more bytes than requested.
2772

2773 2774 2775
- Issue #18011: As was originally intended, base64.b32decode() now raises a
  binascii.Error if there are non-b32-alphabet characters present in the input
  string, instead of a TypeError.
2776

Brett Cannon's avatar
Brett Cannon committed
2777 2778 2779
- Issue #18072: Implement importlib.abc.InspectLoader.get_code() and
  importlib.abc.ExecutionLoader.get_code().

2780 2781 2782
- Issue #8240: Set the SSL_MODE_ACCEPT_MOVING_WRITE_BUFFER flag on SSL
  sockets.

2783 2784 2785
- Issue #17269: Workaround for socket.getaddrinfo crash on MacOS X
  with port None or "0" and flags AI_NUMERICSERV.

2786 2787
- Issue #16986: ElementTree now correctly works with string input when the
  internal XML encoding is not UTF-8 or US-ASCII.
2788

2789 2790
- Issue #17996: socket module now exposes AF_LINK constant on BSD and OSX.

2791 2792 2793
- Issue #17900: Allowed pickling of recursive OrderedDicts.  Decreased pickled
  size and pickling time.

2794 2795 2796
- Issue #17914: Add os.cpu_count(). Patch by Yogesh Chaudhari, based on an
  initial patch by Trent Nelson.

2797 2798 2799
- Issue #17812: Fixed quadratic complexity of base64.b32encode().
  Optimize base64.b32encode() and base64.b32decode() (speed up to 3x).

2800 2801 2802
- Issue #17980: Fix possible abuse of ssl.match_hostname() for denial of
  service using certificates with many wildcards (CVE-2013-2099).

2803 2804
- Issue #15758: Fix FileIO.readall() so it no longer has O(n**2) complexity.

2805 2806
- Issue #14596: The struct.Struct() objects now use a more compact
  implementation.
2807

2808 2809
- Issue #17981: logging's SysLogHandler now closes the socket when it catches
  socket OSErrors.
2810

2811 2812 2813
- Issue #17964: Fix os.sysconf(): the return type of the C sysconf() function
  is long, not int.

2814 2815
- Fix typos in the multiprocessing module.

2816 2817
- Issue #17754: Make ctypes.util.find_library() independent of the locale.

2818 2819
- Issue #17968: Fix memory leak in os.listxattr().

2820
- Issue #17606: Fixed support of encoded byte strings in the XMLGenerator
2821
  characters() and ignorableWhitespace() methods.  Original patch by Sebastian
2822 2823
  Ortiz Vasquez.

2824 2825 2826
- Issue #17732: Ignore distutils.cfg options pertaining to install paths if a
  virtual environment is active.

Georg Brandl's avatar
Georg Brandl committed
2827 2828 2829
- Issue #17915: Fix interoperability of xml.sax with file objects returned by
  codecs.open().

2830 2831
- Issue #16601: Restarting iteration over tarfile really restarts rather
  than continuing from where it left off.  Patch by Michael Birtwell.
2832

2833 2834 2835 2836
- Issue #17289: The readline module now plays nicer with external modules
  or applications changing the rl_completer_word_break_characters global
  variable.  Initial patch by Bradley Froehle.

2837 2838 2839
- Issue #12181: select module: Fix struct kevent definition on OpenBSD 64-bit
  platforms. Patch by Federico Schwindt.

2840 2841 2842 2843
- Issue #11816: multiple improvements to the dis module: get_instructions
  generator, ability to redirect output to a file, Bytecode and Instruction
  abstractions. Patch by Nick Coghlan, Ryan Kelly and Thomas Kluyver.

2844
- Issue #13831: Embed stringification of remote traceback in local
2845 2846
  traceback raised when pool task raises an exception.

2847 2848 2849
- Issue #15528: Add weakref.finalize to support finalization using
  weakref callbacks.

2850 2851 2852
- Issue #14173: Avoid crashing when reading a signal handler during
  interpreter shutdown.

2853 2854
- Issue #15902: Fix imp.load_module() accepting None as a file when loading an
  extension module.
2855

2856 2857 2858 2859
- Issue #13721: SSLSocket.getpeercert() and SSLSocket.do_handshake() now
  raise an OSError with ENOTCONN, instead of an AttributeError, when the
  SSLSocket is not connected.

2860 2861
- Issue #14679: add an __all__ (that contains only HTMLParser) to html.parser.

2862 2863 2864
- Issue #17802: Fix an UnboundLocalError in html.parser.  Initial tests by
  Thomas Barlow.

2865 2866 2867
- Issue #17358: Modules loaded by imp.load_source() and load_compiled() (and by
  extention load_module()) now have a better chance of working when reloaded.

2868 2869 2870
- Issue #17804: New function ``struct.iter_unpack`` allows for streaming
  struct unpacking.

2871 2872 2873
- Issue #17830: When keyword.py is used to update a keyword file, it now
  preserves the line endings of the original file.

2874 2875 2876
- Issue #17272: Making the urllib.request's Request.full_url a descriptor.
  Fixes bugs with assignment to full_url. Patch by Demian Brecht.

2877 2878
- Issue #17353: Plistlib emitted empty data tags with deeply nested datastructures

2879 2880 2881
- Issue #11714: Use 'with' statements to assure a Semaphore releases a
  condition variable.  Original patch by Thomas Rachel.

2882 2883 2884 2885
- Issue #16624: `subprocess.check_output` now accepts an `input` argument,
  allowing the subprocess's stdin to be provided as a (byte) string.
  Patch by Zack Weinberg.

2886 2887 2888
- Issue #17795: Reverted backwards-incompatible change in SysLogHandler with
  Unix domain sockets.

2889 2890 2891
- Issue #16694: Add a pure Python implementation of the operator module.
  Patch by Zachary Ware.

2892 2893 2894
- Issue #11182: remove the unused and undocumented pydoc.Scanner class.
  Patch by Martin Morrison.

2895 2896
- Issue #17741: Add ElementTree.XMLPullParser, an event-driven parser for
  non-blocking applications.
2897

2898 2899 2900
- Issue #17555: Fix ForkAwareThreadLock so that size of after fork
  registry does not grow exponentially with generation of process.

2901 2902
- Issue #17707: fix regression in multiprocessing.Queue's get() method where
  it did not block for short timeouts.
2903

2904
- Issue #17720: Fix the Python implementation of pickle.Unpickler to correctly
2905 2906
  process the APPENDS opcode when it is used on non-list objects.

2907 2908
- Issue #17012: shutil.which() no longer falls back to the PATH environment
  variable if an empty path argument is specified.  Patch by Serhiy Storchaka.
2909

2910 2911
- Issue #17710: Fix pickle raising a SystemError on bogus input.

2912 2913 2914
- Issue #17341: Include the invalid name in the error messages from re about
  invalid group names.

2915 2916 2917 2918
- Issue #17702: os.environ now raises KeyError with the original environment
  variable name (str on UNIX), instead of using the encoded name (bytes on
  UNIX).

2919 2920 2921
- Issue #16163: Make the importlib based version of pkgutil.iter_importers
  work for submodules. Initial patch by Berker Peksag.

2922 2923 2924
- Issue #16804: Fix a bug in the 'site' module that caused running
  'python -S -m site' to incorrectly throw an exception.

2925 2926 2927
- Issue #15480: Remove the deprecated and unused TYPE_INT64 code from marshal.
  Initial patch by Daniel Riti.

2928
- Issue #2118: SMTPException is now a subclass of OSError.
2929

2930 2931 2932
- Issue #17016: Get rid of possible pointer wraparounds and integer overflows
  in the re module.  Patch by Nickolai Zeldovich.

2933 2934 2935
- Issue #16658: add missing return to HTTPConnection.send()
  Patch by Jeff Knupp.

2936 2937
- Issue #9556: the logging package now allows specifying a time-of-day for a
  TimedRotatingFileHandler to rotate.
2938

2939 2940 2941
- Issue #14971: unittest test discovery no longer gets confused when a function
  has a different __name__ than its name in the TestCase class dictionary.

2942 2943 2944
- Issue #17487: The wave getparams method now returns a namedtuple rather than
  a plain tuple.

2945 2946
- Issue #17675: socket repr() provides local and remote addresses (if any).
  Patch by Giampaolo Rodola'
2947

2948 2949 2950
- Issue #17093: Make the ABCs in importlib.abc provide default values or raise
  reasonable exceptions for their methods to make them more amenable to super()
  calls.
2951

2952
- Issue #17566: Make importlib.abc.Loader.module_repr() optional instead of an
2953
  abstractmethod; now it raises NotImplementedError so as to be ignored by default.
2954

2955 2956
- Issue #17678: Remove the use of deprecated method in http/cookiejar.py by
  changing the call to get_origin_req_host() to origin_req_host.
Benjamin Peterson's avatar
Benjamin Peterson committed
2957

2958
- Issue #17666: Fix reading gzip files with an extra field.
2959

2960 2961
- Issue #16475: Support object instancing, recursion and interned strings
  in marshal
2962

2963
- Issue #17502: Process DEFAULT values in mock side_effect that returns iterator.
2964

2965 2966 2967
- Issue #16795: On the ast.arguments object, unify vararg with varargannotation
  and kwarg and kwargannotation. Change the column offset of ast.Attribute to be
  at the attribute name.
2968

2969 2970
- Issue #17434: Properly raise a SyntaxError when a string occurs between future
  imports.
2971

2972 2973
- Issue #17117: Import and @importlib.util.set_loader now set __loader__ when
  it has a value of None or the attribute doesn't exist.
2974

2975 2976
- Issue #17032: The "global" in the "NameError: global name 'x' is not defined"
  error message has been removed.  Patch by Ram Rachum.
2977

2978 2979 2980 2981
- Issue #18080: When building a C extension module on OS X, if the compiler
  is overriden with the CC environment variable, use the new compiler as
  the default for linking if LDSHARED is not also overriden.  This restores
  Distutils behavior introduced in 3.2.3 and inadvertently dropped in 3.3.0.
2982

2983 2984
- Issue #18113: Fixed a refcount leak in the curses.panel module's
  set_userptr() method.  Reported by Atsuo Ishimoto.
2985

2986
- Implement PEP 443 "Single-dispatch generic functions".
2987

2988
- Implement PEP 435 "Adding an Enum type to the Python standard library".
2989

2990 2991
- Issue #15596: Faster pickling of unicode strings.

2992
- Issue #17572: Avoid chained exceptions when passing bad directives to
Ezio Melotti's avatar
Ezio Melotti committed
2993 2994
  time.strptime().  Initial patch by Claudiu Popa.

2995 2996 2997
- Issue #17435: threading.Timer's __init__ method no longer uses mutable
  default values for the args and kwargs parameters.

Ezio Melotti's avatar
Ezio Melotti committed
2998 2999 3000
- Issue #17526: fix an IndexError raised while passing code without filename to
  inspect.findsource().  Initial patch by Tyler Doyle.

3001
- Issue #17540: Added style parameter to logging formatter configuration by dict.
3002

3003 3004 3005
- Issue #16692: The ssl module now supports TLS 1.1 and TLS 1.2.  Initial
  patch by Michele Orrù.

3006 3007
- Issue #17025: multiprocessing: Reduce Queue and SimpleQueue contention.

3008 3009 3010
- Issue #17536: Add to webbrowser's browser list: www-browser, x-www-browser,
  iceweasel, iceape.

3011 3012 3013
- Issue #17150: pprint now uses line continuations to wrap long string
  literals.

3014 3015 3016 3017 3018
- Issue #17488: Change the subprocess.Popen bufsize parameter default value
  from unbuffered (0) to buffering (-1) to match the behavior existing code
  expects and match the behavior of the subprocess module in Python 2 to avoid
  introducing hard to track down bugs.

3019 3020 3021
- Issue #17521: Corrected non-enabling of logger following two calls to
  fileConfig().

3022 3023
- Issue #17508: Corrected logging MemoryHandler configuration in dictConfig()
  where the target handler wasn't configured first.
Vinay Sajip's avatar
Vinay Sajip committed
3024

3025
- Issue #17209: curses.window.get_wch() now correctly handles KeyboardInterrupt
3026 3027
  (CTRL+c).

3028 3029 3030 3031
- Issue #5713: smtplib now handles 421 (closing connection) error codes when
  sending mail by closing the socket and reporting the 421 error code via the
  exception appropriate to the command that received the error response.

3032 3033 3034
- Issue #16997: unittest.TestCase now provides a subTest() context manager
  to procedurally generate, in an easy way, small test instances.

3035 3036 3037
- Issue #17485: Also delete the Request Content-Length header if the data
  attribute is deleted.  (Follow on to issue 16464).

3038 3039 3040
- Issue #15927: CVS now correctly parses escaped newlines and carriage
  when parsing with quoting turned off.

3041 3042 3043
- Issue #17467: add readline and readlines support to mock_open in
  unittest.mock.

3044 3045 3046 3047
- Issue #17192: Update the ctypes module's libffi to v3.0.13.  This
  specifically addresses a stack misalignment issue on x86 and issues on
  some more recent platforms.

3048 3049
- Issue #8862: Fixed curses cleanup when getkey is interrputed by a signal.

Gregory P. Smith's avatar
Gregory P. Smith committed
3050
- Issue #17443: imaplib.IMAP4_stream was using the default unbuffered IO
3051 3052 3053
  in subprocess, but the imap code assumes buffered IO.  In Python2 this
  worked by accident.  IMAP4_stream now explicitly uses buffered IO.

3054 3055 3056
- Issue #17476: Fixed regression relative to Python2 in undocumented pydoc
  'allmethods'; it was missing unbound methods on the class.

3057 3058
- Issue #17474: Remove the deprecated methods of Request class.

3059 3060 3061
- Issue #16709: unittest discover order is no-longer filesystem specific. Patch
  by Jeff Ramnani.

3062 3063
- Use the HTTPS PyPI url for upload, overriding any plain HTTP URL in pypirc.

3064 3065 3066
- Issue #5024: sndhdr.whichhdr now returns the frame count for WAV files
  rather than -1.

3067 3068 3069 3070
- Issue #17460: Remove the strict argument of HTTPConnection and removing the
  DeprecationWarning being issued from 3.2 onwards.

- Issue #16880: Do not assume _imp.load_dynamic() is defined in the imp module.
3071

3072
- Issue #16389: Fixed a performance regression relative to Python 3.1 in the
3073 3074
  caching of compiled regular expressions.

3075 3076
- Added missing FeedParser and BytesFeedParser to email.parser.__all__.

3077 3078
- Issue #17431: Fix missing import of BytesFeedParser in email.parser.

3079 3080 3081
- Issue #12921: http.server's send_error takes an explain argument to send more
  information in response. Patch contributed by Karl.

3082 3083
- Issue #17414: Add timeit, repeat, and default_timer to timeit.__all__.

3084 3085 3086
- Issue #1285086: Get rid of the refcounting hack and speed up
  urllib.parse.unquote() and urllib.parse.unquote_to_bytes().

3087 3088 3089
- Issue #17099: Have importlib.find_loader() raise ValueError when __loader__
  is not set, harmonizing with what happens when the attribute is set to None.

Benjamin Peterson's avatar
Benjamin Peterson committed
3090 3091
- Expose the O_PATH constant in the os module if it is available.

3092 3093 3094 3095
- Issue #17368: Fix an off-by-one error in the Python JSON decoder that caused
  a failure while decoding empty object literals when object_pairs_hook was
  specified.

3096
- Issue #17385: Fix quadratic behavior in threading.Condition.  The FIFO
3097 3098
  queue now uses a deque instead of a list.

3099 3100
- Issue #15806: Add contextlib.ignore().  This creates a context manager to
  ignore specified exceptions, replacing the "except SomeException: pass" idiom.
3101

3102 3103 3104 3105 3106
- Issue #14645: The email generator classes now produce output using the
  specified linesep throughout.  Previously if the prolog, epilog, or
  body were stored with a different linesep, that linesep was used.  This
  fix corrects an RFC non-compliance issue with smtplib.send_message.

3107 3108 3109
- Issue #17278: Fix a crash in heapq.heappush() and heapq.heappop() when
  the list is being resized concurrently.

3110 3111 3112
- Issue #16962: Use getdents64 instead of the obsolete getdents syscall
  in the subprocess module on Linux.

3113 3114 3115
- Issue #16935: unittest now counts the module as skipped if it raises SkipTest,
  instead of counting it as an error.  Patch by Zachary Ware.

3116 3117
- Issue #17018: Make Process.join() retry if os.waitpid() fails with EINTR.

3118 3119 3120 3121
- Issue #17223: array module: Fix a crasher when converting an array containing
  invalid characters (outside range [U+0000; U+10ffff]) to Unicode:
  repr(array), str(array) and array.tounicode(). Patch written by Manuel Jacob.

3122 3123 3124
- Issue #17197: profile/cProfile modules refactored so that code of run() and
  runctx() utility functions is not duplicated in both modules.

3125 3126 3127
- Issue #14720: sqlite3: Convert datetime microseconds correctly.
  Patch by Lowe Thiderman.

3128 3129 3130
- Issue #15132: Allow a list for the defaultTest argument of
  unittest.TestProgram. Patch by Jyrki Pulliainen.

3131 3132 3133
- Issue #17225: JSON decoder now counts columns in the first line starting
  with 1, as in other lines.

3134 3135 3136
- Issue #6623: Added explicit DeprecationWarning for ftplib.netrc, which has
  been deprecated and undocumented for a long time.

3137 3138 3139
- Issue #13700: Fix byte/string handling in imaplib authentication when an
  authobject is specified.

3140 3141 3142
- Issue #13153: Tkinter functions now raise TclError instead of ValueError when
  a string argument contains non-BMP character.

3143 3144 3145
- Issue #9669: Protect re against infinite loops on zero-width matching in
  non-greedy repeat.  Patch by Matthew Barnett.

3146 3147 3148 3149
- Issue #13169: The maximal repetition number in a regular expression has been
  increased from 65534 to 2147483647 (on 32-bit platform) or 4294967294 (on
  64-bit).

3150 3151 3152
- Issue #17143: Fix a missing import in the trace module.  Initial patch by
  Berker Peksag.

3153 3154 3155
- Issue #15220: email.feedparser's line splitting algorithm is now simpler and
  faster.

3156 3157
- Issue #16743: Fix mmap overflow check on 32 bit Windows.

3158 3159 3160
- Issue #16996: webbrowser module now uses shutil.which() to find a
  web-browser on the executable search path.

3161 3162 3163
- Issue #16800: tempfile.gettempdir() no longer left temporary files when
  the disk is full.  Original patch by Amir Szekely.

3164 3165
- Issue #17192: Import libffi-3.0.12.

3166 3167 3168
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_7or8bit when used with binary data.

Michael Foord's avatar
Michael Foord committed
3169
- Issue #17052: unittest discovery should use self.testLoader.
3170

3171 3172
- Issue #4591: Uid and gid values larger than 2**31 are supported now.

3173
- Issue #17141: random.vonmisesvariate() no longer hangs for large kappas.
3174

3175 3176 3177
- Issue #17149: Fix random.vonmisesvariate to always return results in
  [0, 2*math.pi].

3178 3179
- Issue #1470548: XMLGenerator now works with binary output streams.

3180 3181 3182
- Issue #6975: os.path.realpath() now correctly resolves multiple nested
  symlinks on POSIX platforms.

3183 3184 3185
- Issue #13773: sqlite3.connect() gets a new `uri` parameter to pass the
  filename as a URI, allowing to pass custom options.

3186 3187 3188
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_noop when used with binary data.

3189 3190 3191 3192
- Issue #10355: The mode, name, encoding and newlines properties now work on
  SpooledTemporaryFile objects even when they have not yet rolled over.
  Obsolete method xreadline (which has never worked in Python 3) has been
  removed.
3193

3194 3195 3196 3197 3198 3199
- Issue #16686: Fixed a lot of bugs in audioop module.  Fixed crashes in
  avgpp(), maxpp() and ratecv().  Fixed an integer overflow in add(), bias(),
  and ratecv().  reverse(), lin2lin() and ratecv() no more lose precision for
  32-bit samples.  max() and rms() no more returns a negative result and
  various other functions now work correctly with 32-bit sample -0x80000000.

3200 3201
- Issue #17073: Fix some integer overflows in sqlite3 module.

3202 3203
- Issue #16723: httplib.HTTPResponse no longer marked closed when the connection
  is automatically closed.
3204

3205 3206 3207
- Issue #15359: Add CAN_BCM protocol support to the socket module. Patch by
  Brian Thorne.

3208 3209 3210
- Issue #16948: Fix quoted printable body encoding for non-latin1 character
  sets in the email package.

3211 3212 3213
- Issue #16811: Fix folding of headers with no value in the provisional email
  policies.

3214 3215
- Issue #17132: Update symbol for "yield from" grammar changes.

3216
- Issue #17076: Make copying of xattrs more tolerant of missing FS support.
3217 3218
  Patch by Thomas Wouters.

3219 3220 3221
- Issue #17089: Expat parser now correctly works with string input when the
  internal XML encoding is not UTF-8 or US-ASCII.  It also now accepts bytes
  and strings larger than 2 GiB.
3222

3223 3224 3225
- Issue #6083: Fix multiple segmentation faults occured when PyArg_ParseTuple
  parses nested mutating sequence.

3226 3227
- Issue #5289: Fix ctypes.util.find_library on Solaris.

3228 3229 3230 3231
- Issue #17106: Fix a segmentation fault in io.TextIOWrapper when an underlying
  stream or a decoder produces data of an unexpected type (i.e. when
  io.TextIOWrapper initialized with text stream or use bytes-to-bytes codec).

3232 3233 3234 3235
- Issue #17015: When it has a spec, a Mock object now inspects its signature
  when matching calls, so that arguments can be matched positionally or
  by name.

3236 3237 3238
- Issue #15633: httplib.HTTPResponse is now mark closed when the server
  sends less than the advertised Content-Length.

3239 3240 3241
- Issue #12268: The io module file object write methods no longer abort early
  when one of its write system calls is interrupted (EINTR).

3242 3243 3244
- Issue #6972: The zipfile module no longer overwrites files outside of
  its destination path when extracting malicious zip files.

3245 3246 3247 3248
- Issue #4844: ZipFile now raises BadZipFile when opens a ZIP file with an
  incomplete "End of Central Directory" record.  Original patch by Guilherme
  Polo and Alan McIntyre.

3249 3250 3251
- Issue #17071: Signature.bind() now works when one of the keyword arguments
  is named ``self``.

3252 3253 3254
- Issue #12004: Fix an internal error in PyZipFile when writing an invalid
  Python file.  Patch by Ben Morgan.

3255
- Have py_compile use importlib as much as possible to avoid code duplication.
3256 3257 3258
  Code now raises FileExistsError if the file path to be used for the
  byte-compiled file is a symlink or non-regular file as a warning that import
  will not keep the file path type if it writes to that path.
3259

3260
- Issue #16972: Have site.addpackage() consider already known paths even when
3261 3262
  none are explicitly passed in. Bug report and fix by Kirill.

3263 3264 3265
- Issue #1602133: on Mac OS X a shared library build (``--enable-shared``)
  now fills the ``os.environ`` variable correctly.

3266 3267 3268
- Issue #15505: `unittest.installHandler` no longer assumes SIGINT handler is
  set to a callable object.

3269 3270 3271
- Issue #13454: Fix a crash when deleting an iterator created by itertools.tee()
  if all other iterators were very advanced before.

3272 3273 3274
- Issue #12411: Fix to cgi.parse_multipart to correctly use bytes boundaries
  and bytes data. Patch by Jonas Wagner.

3275 3276 3277 3278
- Issue #16957: shutil.which() no longer searches a bare file name in the
  current directory on Unix and no longer searches a relative file path with
  a directory part in PATH directories.  Patch by Thomas Kluyver.

3279 3280 3281
- Issue #1159051: GzipFile now raises EOFError when reading a corrupted file
  with truncated header or footer.

3282 3283 3284
- Issue #16993: shutil.which() now preserves the case of the path and extension
  on Windows.

3285 3286 3287
- Issue #16992: On Windows in signal.set_wakeup_fd, validate the file
  descriptor argument.

3288 3289
- Issue #16422: For compatibility with the Python version, the C version of
  decimal now uses strings instead of integers for rounding mode constants.
3290

3291 3292 3293
- Issue #15861: tkinter now correctly works with lists and tuples containing
  strings with whitespaces, backslashes or unbalanced braces.

3294 3295 3296
- Issue #9720: zipfile now writes correct local headers for files larger than
  4 GiB.

3297 3298 3299
- Issue #16955: Fix the poll() method for multiprocessing's socket
  connections on Windows.

3300 3301
- SSLContext.load_dh_params() now properly closes the input file.

3302 3303 3304 3305
- Issue #15031: Refactor some .pyc management code to cut down on code
  duplication. Thanks to Ronan Lamy for the report and taking an initial stab
  at the problem.

3306 3307 3308
- Issue #16398: Optimize deque.rotate() so that it only moves pointers
  and doesn't touch the underlying data with increfs and decrefs.

3309 3310
- Issue #16900: Issue a ResourceWarning when an ssl socket is left unclosed.

3311 3312 3313
- Issue #13899: \A, \Z, and \B now correctly match the A, Z, and B literals
  when used inside character classes (e.g. '[\A]').  Patch by Matthew Barnett.

3314 3315 3316 3317
- Issue #15545: Fix regression in sqlite3's iterdump method where it was
  failing if the connection used a row factory (such as sqlite3.Row) that
  produced unsortable objects. (Regression was introduced by fix for 9750).

3318 3319
- fcntl: add F_DUPFD_CLOEXEC constant, available on Linux 2.6.24+.

3320 3321 3322
- Issue #15972: Fix error messages when os functions expecting a file name or
  file descriptor receive the incorrect type.

3323 3324 3325 3326
- Issue #8109: The ssl module now has support for server-side SNI, thanks
  to a :meth:`SSLContext.set_servername_callback` method.  Patch by Daniel
  Black.

3327 3328 3329
- Issue #16860: In tempfile, use O_CLOEXEC when available to set the
  close-on-exec flag atomically.

3330 3331
- Issue #16674: random.getrandbits() is now 20-40% faster for small integers.

3332 3333
- Issue #16009: JSON error messages now provide more information.

3334 3335
- Issue #16828: Fix error incorrectly raised by bz2.compress(b'') and
  bz2.BZ2Compressor.compress(b''). Initial patch by Martin Packman.
3336

3337 3338 3339 3340
- Issue #16833: In http.client.HTTPConnection, do not concatenate the request
  headers and body when the payload exceeds 16 KB, since it can consume more
  memory for no benefit.  Patch by Benno Leslie.

3341 3342
- Issue #16541: tk_setPalette() now works with keyword arguments.

3343 3344 3345 3346 3347 3348 3349 3350 3351 3352 3353
- Issue #16820: In configparser, `parser.popitem()` no longer raises ValueError.
  This makes `parser.clean()` work correctly.

- Issue #16820: In configparser, ``parser['section'] = {}`` now preserves
  section order within the parser. This makes `parser.update()` preserve section
  order as well.

- Issue #16820: In configparser, ``parser['DEFAULT'] = {}`` now correctly
  clears previous values stored in the default section. Same goes for
  ``parser.update({'DEFAULT': {}})``.

3354 3355
- Issue #9586: Redefine SEM_FAILED on MacOSX to keep compiler happy.

3356 3357 3358 3359
- Issue #16787: Increase asyncore and asynchat default output buffers size, to
  decrease CPU usage and increase throughput.

- Issue #10527: make multiprocessing use poll() instead of select() if available.
3360

3361 3362
- Issue #16688: Now regexes contained backreferences correctly work with
  non-ASCII strings.  Patch by Matthew Barnett.
3363

3364
- Issue #16486: Make aifc files act as context managers.
3365

3366 3367
- Issue #16485: Now file descriptors are closed if file header patching failed
  on closing an aifc file.
3368

3369 3370
- Issue #16640: Run less code under a lock in sched module.

3371 3372
- Issue #16165: sched.scheduler.run() no longer blocks a scheduler for other
  threads.
3373

3374
- Issue #16641: Default values of sched.scheduler.enter() are no longer
3375 3376
  modifiable.

3377 3378 3379
- Issue #16618: Make glob.glob match consistently across strings and bytes
  regarding leading dots.  Patch by Serhiy Storchaka.

3380 3381
- Issue #16788: Add samestat to Lib/ntpath.py

3382 3383 3384
- Issue #16713: Parsing of 'tel' urls using urlparse separates params from
  path.

3385 3386 3387
- Issue #16443: Add docstrings to regular expression match objects.
  Patch by Anton Kasyanov.

3388 3389
- Issue #15701: Fix HTTPError info method call to return the headers information.

3390 3391
- Issue #16752: Add a missing import to modulefinder. Patch by Berker Peksag.

3392 3393 3394
- Issue #16646: ftplib.FTP.makeport() might lose socket error details.
  (patch by Serhiy Storchaka)

3395 3396 3397 3398
- Issue #16626: Fix infinite recursion in glob.glob() on Windows when the
  pattern contains a wildcard in the drive or UNC path.  Patch by Serhiy
  Storchaka.

3399 3400 3401 3402
- Issue #15783: Except for the number methods, the C version of decimal now
  supports all None default values present in decimal.py. These values were
  largely undocumented.

3403 3404 3405
- Issue #11175: argparse.FileType now accepts encoding and errors
  arguments. Patch by Lucas Maystre.

3406 3407 3408
- Issue #16488: epoll() objects now support the `with` statement.  Patch
  by Serhiy Storchaka.

3409 3410 3411 3412
- Issue #16298: In HTTPResponse.read(), close the socket when there is no
  Content-Length and the incoming stream is finished.  Patch by Eran
  Rundstein.

3413 3414 3415
- Issue #16049: Add abc.ABC class to enable the use of inheritance to create
  ABCs, rather than the more cumbersome metaclass=ABCMeta. Patch by Bruno
  Dupuis.
3416

3417 3418 3419
- Expose the TCP_FASTOPEN and MSG_FASTOPEN flags in socket when they're
  available.

3420 3421 3422
- Issue #15701: Add a .headers attribute to urllib.error.HTTPError. Patch
  contributed by Berker Peksag.

3423 3424 3425 3426
- Issue #15872: Fix 3.3 regression introduced by the new fd-based shutil.rmtree
  that caused it to not ignore certain errors when ignore_errors was set.
  Patch by Alessandro Moura and Serhiy Storchaka.

3427 3428 3429
- Issue #16248: Disable code execution from the user's home directory by
  tkinter when the -E flag is passed to Python.  Patch by Zachary Ware.

3430 3431 3432
- Issue #13390: New function :func:`sys.getallocatedblocks()` returns the
  number of memory blocks currently allocated.

3433 3434
- Issue #16628: Fix a memory leak in ctypes.resize().

3435 3436 3437
- Issue #13614: Fix setup.py register failure with invalid rst in description.
  Patch by Julien Courteau and Pierre Paul Lefebvre.

3438 3439 3440
- Issue #13512: Create ~/.pypirc securely (CVE-2011-4944).  Initial patch by
  Philip Jenvey, tested by Mageia and Debian.

3441 3442 3443
- Issue #7719: Make distutils ignore ``.nfs*`` files instead of choking later
  on.  Initial patch by SilentGhost and Jeff Ramnani.

3444 3445 3446
- Issue #13120: Allow to call pdb.set_trace() from thread.
  Patch by Ilya Sandler.

3447 3448 3449
- Issue #16585: Make CJK encoders support error handlers that return bytes per
  PEP 383.

3450 3451 3452
- Issue #10182: The re module doesn't truncate indices to 32 bits anymore.
  Patch by Serhiy Storchaka.

3453 3454
- Issue #16333: use (",", ": ") as default separator in json when indent is
  specified, to avoid trailing whitespace.  Patch by Serhiy Storchaka.
3455

Benjamin Peterson's avatar
Benjamin Peterson committed
3456 3457 3458 3459
- Issue #16573: In 2to3, treat enumerate() like a consuming call, so superfluous
  list() calls aren't added to filter(), map(), and zip() which are directly
  passed enumerate().

3460 3461 3462 3463
- Issue #12848: The pure Python pickle implementation now treats object
  lengths as unsigned 32-bit integers, like the C implementation does.
  Patch by Serhiy Storchaka.

3464 3465 3466
- Issue #16423: urllib.request now has support for ``data:`` URLs.  Patch by
  Mathias Panzenböck.

3467 3468 3469
- Issue #4473: Add a POP3.stls() to switch a clear-text POP3 session into
  an encrypted POP3 session, on supported servers.  Patch by Lorenzo Catucci.

3470 3471 3472
- Issue #4473: Add a POP3.capa() method to query the capabilities advertised
  by the POP3 server.  Patch by Lorenzo Catucci.

3473 3474 3475
- Issue #4473: Ensure the socket is shutdown cleanly in POP3.close().
  Patch by Lorenzo Catucci.

3476 3477
- Issue #16522: added FAIL_FAST flag to doctest.

3478
- Issue #15627: Add the importlib.abc.InspectLoader.source_to_code() method.
3479

3480 3481 3482
- Issue #16408: Fix file descriptors not being closed in error conditions
  in the zipfile module.  Patch by Serhiy Storchaka.

3483 3484 3485
- Issue #14631: Add a new :class:`weakref.WeakMethod` to simulate weak
  references to bound methods.

3486 3487 3488 3489
- Issue #16469: Fix exceptions from float -> Fraction and Decimal -> Fraction
  conversions for special values to be consistent with those for float -> int
  and Decimal -> int.  Patch by Alexey Kachayev.

3490 3491
- Issue #16481: multiprocessing no longer leaks process handles on Windows.

3492 3493 3494
- Issue #12428: Add a pure Python implementation of functools.partial().
  Patch by Brian Thorne.

3495 3496 3497
- Issue #16140: The subprocess module no longer double closes its child
  subprocess.PIPE parent file descriptors on child error prior to exec().

3498 3499 3500
- Remove a bare print to stdout from the subprocess module that could have
  happened if the child process wrote garbage to its pre-exec error pipe.

3501 3502 3503
- The subprocess module now raises its own SubprocessError instead of a
  RuntimeError in various error situations which should not normally happen.

3504 3505 3506
- Issue #16327: The subprocess module no longer leaks file descriptors
  used for stdin/stdout/stderr pipes to the child when fork() fails.

3507 3508 3509
- Issue #14396: Handle the odd rare case of waitpid returning 0 when not
  expected in subprocess.Popen.wait().

3510 3511 3512
- Issue #16411: Fix a bug where zlib.decompressobj().flush() might try to access
  previously-freed memory. Patch by Serhiy Storchaka.

3513 3514 3515
- Issue #16357: fix calling accept() on a SSLSocket created through
  SSLContext.wrap_socket().  Original patch by Jeff McNeil.

3516 3517 3518 3519 3520
- Issue #16409: The reporthook callback made by the legacy
  urllib.request.urlretrieve API now properly supplies a constant non-zero
  block_size as it did in Python 3.2 and 2.7.  This matches the behavior of
  urllib.request.URLopener.retrieve.

3521 3522 3523
- Issue #16431: Use the type information when constructing a Decimal subtype
  from a Decimal argument.

3524 3525 3526
- Issue #15641: Clean up deprecated classes from importlib
  Patch by Taras Lyapun.

3527
- Issue #16350: zlib.decompressobj().decompress() now accumulates data from
3528
  successive calls after EOF in unused_data, instead of only saving the argument
3529 3530 3531
  to the last call. decompressobj().flush() now correctly sets unused_data and
  unconsumed_tail. A bug in the handling of MemoryError when setting the
  unconsumed_tail attribute has also been fixed. Patch by Serhiy Storchaka.
3532

3533 3534 3535
- Issue #12759: sre_parse now raises a proper error when the name of the group
  is missing.  Initial patch by Serhiy Storchaka.

3536 3537 3538
- Issue #16152: fix tokenize to ignore whitespace at the end of the code when
  no newline is found.  Patch by Ned Batchelder.

3539 3540 3541
- Issue #16284: Prevent keeping unnecessary references to worker functions
  in concurrent.futures ThreadPoolExecutor.

3542 3543 3544
- Issue #16230: Fix a crash in select.select() when one the lists changes
  size while iterated on.  Patch by Serhiy Storchaka.

3545 3546 3547
- Issue #16228: Fix a crash in the json module where a list changes size
  while it is being encoded.  Patch by Serhiy Storchaka.

3548 3549 3550
- Issue #16351: New function gc.get_stats() returns per-generation collection
  statistics.

3551 3552 3553
- Issue #14897: Enhance error messages of struct.pack and
  struct.pack_into. Patch by Matti Mäki.

3554 3555 3556
- Issue #16316: mimetypes now recognizes the .xz and .txz (.tar.xz) extensions.
  Patch by Serhiy Storchaka.

3557 3558 3559
- Issue #12890: cgitb no longer prints spurious <p> tags in text
  mode when the logdir option is specified.

3560 3561 3562
- Issue #16307: Fix multiprocessing.Pool.map_async not calling its callbacks.
  Patch by Janne Karila.

3563 3564 3565
- Issue #16305: Fix a segmentation fault occurring when interrupting
  math.factorial.

3566
- Issue #16116: Fix include and library paths to be correct when building C
3567 3568
  extensions in venvs.

3569 3570
- Issue #16245: Fix the value of a few entities in html.entities.html5.

3571 3572 3573
- Issue #16301: Fix the localhost verification in urllib/request.py for file://
  urls.

3574 3575 3576
- Issue #16250: Fix the invocations of URLError which had misplaced filename
  attribute for exception.

3577 3578 3579
- Issue #10836: Fix exception raised when file not found in urlretrieve
  Initial patch by Ezio Melotti.

3580 3581
- Issue #14398: Fix size truncation and overflow bugs in the bz2 module.

3582
- Issue #12692: Fix resource leak in urllib.request when talking to an HTTP
3583
  server that does not include a ``Connection: close`` header in its responses.
3584

3585 3586 3587
- Issue #12034: Fix bogus caching of result in check_GetFinalPathNameByHandle.
  Patch by Atsuo Ishimoto.

3588
- Improve performance of `lzma.LZMAFile` (see also issue #16034).
3589

3590 3591 3592
- Issue #16220: wsgiref now always calls close() on an iterable response.
  Patch by Brent Tubbs.

3593 3594 3595
- Issue #16270: urllib may hang when used for retrieving files via FTP by using
  a context manager.  Patch by Giampaolo Rodola'.

3596 3597 3598
- Issue #16461: Wave library should be able to deal with 4GB wav files,
  and sample rate of 44100 Hz.

3599 3600
- Issue #16176: Properly identify Windows 8 via platform.platform()

3601 3602 3603
- Issue #16088: BaseHTTPRequestHandler's send_error method includes a
  Content-Length header in it's response now. Patch by Antoine Pitrou.

3604 3605 3606
- Issue #16114: The subprocess module no longer provides a misleading error
  message stating that args[0] did not exist when either the cwd or executable
  keyword arguments specified a path that did not exist.
3607

3608 3609
- Issue #16169: Fix ctypes.WinError()'s confusion between errno and winerror.

3610 3611 3612
- Issue #1492704: shutil.copyfile() raises a distinct SameFileError now if
  source and destination are the same file. Patch by Atsuo Ishimoto.

3613 3614 3615
- Issue #13896: Make shelf instances work with 'with' as context managers.
  Original patch by Filip Gruszczyński.

3616 3617
- Issue #15417: Add support for csh and fish in venv activation scripts.

3618 3619 3620 3621
- Issue #14377: ElementTree.write and some of the module-level functions have
  a new parameter - *short_empty_elements*. It controls how elements with no
  contents are emitted.

3622 3623 3624
- Issue #16089: Allow ElementTree.TreeBuilder to work again with a non-Element
  element_factory (fixes a regression in SimpleTAL).

3625 3626 3627
- Issue #9650: List commonly used format codes in time.strftime and
  time.strptime docsttings.  Original patch by Mike Hoy.

Georg Brandl's avatar
Georg Brandl committed
3628 3629
- Issue #16034: Fix performance regressions in the new `bz2.BZ2File`
  implementation.  Initial patch by Serhiy Storchaka.
3630

Georg Brandl's avatar
Georg Brandl committed
3631
- `pty.spawn()` now returns the child process status returned by `os.waitpid()`.
3632

Georg Brandl's avatar
Georg Brandl committed
3633 3634 3635
- Issue #15756: `subprocess.poll()` now properly handles `errno.ECHILD` to
  return a returncode of 0 when the child has already exited or cannot be waited
  on.
3636

Georg Brandl's avatar
Georg Brandl committed
3637
- Issue #15323: Improve failure message of `Mock.assert_called_once_with()`.
3638

Georg Brandl's avatar
Georg Brandl committed
3639
- Issue #16064: ``unittest -m`` claims executable is "python", not "python3".
3640

Georg Brandl's avatar
Georg Brandl committed
3641
- Issue #12376: Pass on parameters in `TextTestResult.__init__()` super call.
3642

Georg Brandl's avatar
Georg Brandl committed
3643
- Issue #15222: Insert blank line after each message in mbox mailboxes.
3644

Georg Brandl's avatar
Georg Brandl committed
3645
- Issue #16013: Fix `csv.Reader` parsing issue with ending quote characters.
3646 3647
  Patch by Serhiy Storchaka.

Georg Brandl's avatar
Georg Brandl committed
3648 3649
- Issue #15421: Fix an OverflowError in `Calendar.itermonthdates()` after
  `datetime.MAXYEAR`.  Patch by Cédric Krier.
3650

3651 3652 3653
- Issue #16112: platform.architecture does not correctly escape argument to
  /usr/bin/file.  Patch by David Benjamin.

Georg Brandl's avatar
Georg Brandl committed
3654
- Issue #15970: `xml.etree.ElementTree` now serializes correctly the empty HTML
3655 3656
  elements 'meta' and 'param'.

Georg Brandl's avatar
Georg Brandl committed
3657 3658
- Issue #15842: The `SocketIO.{readable,writable,seekable}` methods now raise
  ValueError when the file-like object is closed.  Patch by Alessandro Moura.
3659

Georg Brandl's avatar
Georg Brandl committed
3660
- Issue #15876: Fix a refleak in the `curses` module: window.encoding.
3661

Georg Brandl's avatar
Georg Brandl committed
3662 3663
- Issue #15881: Fix `atexit` hook in `multiprocessing`.  Original patch by Chris
  McDonough.
3664

Georg Brandl's avatar
Georg Brandl committed
3665 3666 3667
- Issue #15841: The readable(), writable() and seekable() methods of
  `io.BytesIO` and `io.StringIO` objects now raise ValueError when the object
  has been closed.  Patch by Alessandro Moura.
3668

Georg Brandl's avatar
Georg Brandl committed
3669 3670
- Issue #15447: Use `subprocess.DEVNULL` in webbrowser, instead of opening
  `os.devnull` explicitly and leaving it open.
3671

Georg Brandl's avatar
Georg Brandl committed
3672 3673
- Issue #15509: `webbrowser.UnixBrowser` no longer passes empty arguments to
  Popen when ``%action`` substitutions produce empty strings.
3674

Georg Brandl's avatar
Georg Brandl committed
3675 3676 3677 3678 3679
- Issue #12776, issue #11839: Call `argparse` type function (specified by
  add_argument) only once. Before, the type function was called twice in the
  case where the default was specified and the argument was given as well.  This
  was especially problematic for the FileType type, as a default file would
  always be opened, even if a file argument was specified on the command line.
3680 3681

- Issue #15906: Fix a regression in argparse caused by the preceding change,
Georg Brandl's avatar
Georg Brandl committed
3682
  when ``action='append'``, ``type='str'`` and ``default=[]``.
3683

Christian Heimes's avatar
Christian Heimes committed
3684 3685 3686 3687 3688
- Issue #16113: Added sha3 module based on the Keccak reference implementation
  3.2. The `hashlib` module has four additional hash algorithms: `sha3_224`,
  `sha3_256`, `sha3_384` and `sha3_512`. As part of the patch some common
  code was moved from _hashopenssl.c to hashlib.h.

3689 3690 3691
- ctypes.call_commethod was removed, since its only usage was in the defunct
  samples directory.

3692 3693 3694 3695
- Issue #16692: Added TLSv1.1 and TLSv1.2 support for the ssl modules.

- Issue #16832: add abc.get_cache_token() to expose cache validity checking
  support in ABCMeta.
3696

Benjamin Peterson's avatar
Benjamin Peterson committed
3697 3698 3699
IDLE
----

3700 3701 3702 3703 3704 3705 3706 3707 3708 3709 3710 3711 3712 3713 3714 3715 3716 3717 3718 3719 3720 3721 3722 3723 3724 3725 3726 3727 3728 3729 3730 3731 3732 3733 3734 3735 3736 3737 3738 3739 3740 3741
- Issue #18429: Format / Format Paragraph, now works when comment blocks
  are selected. As with text blocks, this works best when the selection
  only includes complete lines.

- Issue #18226: Add docstrings and unittests for FormatParagraph.py.
  Original patches by Todd Rovito and Phil Webster.

- Issue #18279: Format - Strip trailing whitespace no longer marks a file as
  changed when it has not been changed. This fix followed the addition of a
  test file originally written by Phil Webster (the issue's main goal).

- Issue #7136: In the Idle File menu, "New Window" is renamed "New File".
  Patch by Tal Einat, Roget Serwy, and Todd Rovito.

- Remove dead imports of imp.

- Issue #18196: Avoid displaying spurious SystemExit tracebacks.

- Issue #5492: Avoid traceback when exiting IDLE caused by a race condition.

- Issue #17511: Keep IDLE find dialog open after clicking "Find Next".
  Original patch by Sarah K.

- Issue #18055: Move IDLE off of imp and on to importlib.

- Issue #15392: Create a unittest framework for IDLE.
  Initial patch by Rajagopalasarma Jayakrishnan.
  See Lib/idlelib/idle_test/README.txt for how to run Idle tests.

- Issue #14146: Highlight source line while debugging on Windows.

- Issue #17838: Allow sys.stdin to be reassigned.

- Issue #13495: Avoid loading the color delegator twice in IDLE.

- Issue #17798: Allow IDLE to edit new files when specified on command line.

- Issue #14735: Update IDLE docs to omit "Control-z on Windows".

- Issue #17532: Always include Options menu for IDLE on OS X.
  Patch by Guilherme Simões.

Roger Serwy's avatar
Roger Serwy committed
3742 3743
- Issue #17585: Fixed IDLE regression. Now closes when using exit() or quit().

Roger Serwy's avatar
Roger Serwy committed
3744 3745 3746
- Issue #17657: Show full Tk version in IDLE's about dialog.
  Patch by Todd Rovito.

Roger Serwy's avatar
Roger Serwy committed
3747 3748
- Issue #17613: Prevent traceback when removing syntax colorizer in IDLE.

Roger Serwy's avatar
Roger Serwy committed
3749 3750
- Issue #1207589: Backwards-compatibility patch for right-click menu in IDLE.

Roger Serwy's avatar
Roger Serwy committed
3751 3752
- Issue #16887: IDLE now accepts Cancel in tabify/untabify dialog box.

3753 3754
- Issue #17625: In IDLE, close the replace dialog after it is used.

Benjamin Peterson's avatar
Benjamin Peterson committed
3755 3756 3757 3758 3759 3760
- Issue #14254: IDLE now handles readline correctly across shell restarts.

- Issue #17614: IDLE no longer raises exception when quickly closing a file.

- Issue #6698: IDLE now opens just an editor window when configured to do so.

3761
- Issue #8900: Using keyboard shortcuts in IDLE to open a file no longer
Benjamin Peterson's avatar
Benjamin Peterson committed
3762 3763 3764 3765
  raises an exception.

- Issue #6649: Fixed missing exit status in IDLE. Patch by Guilherme Polo.

3766
- Issue #17114: IDLE now uses non-strict config parser.
Benjamin Peterson's avatar
Benjamin Peterson committed
3767

3768 3769
- Issue #9290: In IDLE the sys.std* streams now implement io.TextIOBase
  interface and support all mandatory methods and properties.
Benjamin Peterson's avatar
Benjamin Peterson committed
3770

3771
- Issue #5066: Update IDLE docs. Patch by Todd Rovito.
Benjamin Peterson's avatar
Benjamin Peterson committed
3772 3773 3774 3775

- Issue #16829: IDLE printing no longer fails if there are spaces or other
  special characters in the file path.

3776
- Issue #16491: IDLE now prints chained exception tracebacks.
Benjamin Peterson's avatar
Benjamin Peterson committed
3777

3778
- Issue #16819: IDLE method completion now correctly works for bytes literals.
Benjamin Peterson's avatar
Benjamin Peterson committed
3779

3780 3781
- Issue #16504: IDLE now catches SyntaxErrors raised by tokenizer. Patch by
  Roger Serwy.
Benjamin Peterson's avatar
Benjamin Peterson committed
3782

3783 3784
- Issue #16511: Use default IDLE width and height if config param is not valid.
  Patch Serhiy Storchaka.
Benjamin Peterson's avatar
Benjamin Peterson committed
3785

3786 3787
- Issue #1207589: Add Cut/Copy/Paste items to IDLE right click Context Menu
  Patch by Todd Rovito.
Benjamin Peterson's avatar
Benjamin Peterson committed
3788

3789 3790
- Issue #16123: IDLE - deprecate running without a subprocess.
  Patch by Roger Serwy.
Benjamin Peterson's avatar
Benjamin Peterson committed
3791

3792 3793 3794
Tests
-----

3795 3796 3797 3798 3799 3800 3801 3802 3803 3804 3805 3806 3807 3808 3809 3810 3811 3812 3813 3814 3815 3816 3817 3818 3819 3820 3821 3822 3823 3824 3825 3826 3827 3828 3829 3830 3831
- Issue #1666318: Add a test that shutil.copytree() retains directory
  permissions.  Patch by Catherine Devlin.

- Issue #18273: move the tests in Lib/test/json_tests to Lib/test/test_json
  and make them discoverable by unittest.  Patch by Zachary Ware.

- Fix a fcntl test case on KFreeBSD, Debian #708653 (Petr Salinger).

- Issue #18396: Fix spurious test failure in test_signal on Windows when
  faulthandler is enabled (Patch by Jeremy Kloth)

- Issue #17046: Fix broken test_executable_without_cwd in test_subprocess.

- Issue #15415: Add new temp_dir() and change_cwd() context managers to
  test.support, and refactor temp_cwd() to use them.  Patch by Chris Jerdonek.

- Issue #15494: test.support is now a package rather than a module (Initial
  patch by Indra Talip)

- Issue #17944: test_zipfile now discoverable and uses subclassing to
  generate tests for different compression types.  Fixed a bug with skipping
  some tests due to use of exhausted iterators.

- Issue #18266: test_largefile now works with unittest test discovery and
  supports running only selected tests.  Patch by Zachary Ware.

- Issue #17767: test_locale now works with unittest test discovery.
  Original patch by Zachary Ware.

- Issue #18375: Assume --randomize when --randseed is used for running the
  testsuite.

- Issue #11185: Fix test_wait4 under AIX.  Patch by Sébastien Sablé.

- Issue #18207: Fix test_ssl for some versions of OpenSSL that ignore seconds
  in ASN1_TIME fields.

R David Murray's avatar
R David Murray committed
3832
- Issue #18094: test_uuid no longer reports skipped tests as passed.
3833 3834 3835 3836 3837 3838 3839 3840 3841 3842 3843 3844 3845 3846 3847 3848 3849 3850 3851 3852 3853 3854 3855 3856 3857 3858 3859 3860 3861 3862 3863 3864 3865 3866 3867 3868 3869 3870 3871 3872 3873 3874 3875 3876 3877 3878 3879

- Issue #17992: Add timeouts to asyncore and asynchat tests so that they won't
  accidentally hang.

- Issue #17833: Fix test_gdb failures seen on machines where debug symbols
  for glibc are available (seen on PPC64 Linux).

- Issue #7855: Add tests for ctypes/winreg for issues found in IronPython.
  Initial patch by Dino Viehland.

- Issue #11078: test___all__ now checks for duplicates in __all__.
  Initial patch by R. David Murray.

- Issue #17712: Fix test_gdb failures on Ubuntu 13.04.

- Issue #17835: Fix test_io when the default OS pipe buffer size is larger
  than one million bytes.

- Issue #17065: Use process-unique key for winreg tests to avoid failures if
  test is run multiple times in parallel (eg: on a buildbot host).

- Issue #12820: add tests for the xml.dom.minicompat module.
  Patch by John Chandler and Phil Connell.

- Issue #17691: test_univnewlines now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17790: test_set now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17789: test_random now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17779: test_osx_env now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17766: test_iterlen now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17690: test_time now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17692: test_sqlite now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #11995: test_pydoc doesn't import all sys.path modules anymore.

3880 3881
- Issue #17448: test_sax now skips if there are no xml parsers available
  instead of raising an ImportError.
3882

Ezio Melotti's avatar
Ezio Melotti committed
3883 3884
- Issue #11420: make test suite pass with -B/DONTWRITEBYTECODE set.
  Initial patch by Thomas Wouters.
3885

3886 3887
- Issue #10652: make tcl/tk tests run after __all__ test, patch by
  Zachary Ware.
3888

Ezio Melotti's avatar
Ezio Melotti committed
3889
- Issue #11963: remove human verification from test_parser and test_subprocess.
3890

3891 3892
- Issue #11732: add a new suppress_crash_popup() context manager to test.support
  that disables crash popups on Windows and use it in test_faulthandler and
3893
  test_capi.
3894

3895
- Issue #13898: test_ssl no longer prints a spurious stack trace on Ubuntu.
3896

3897 3898 3899
- Issue #17283: Share code between `__main__.py` and `regrtest.py` in
  `Lib/test`.

Ezio Melotti's avatar
Ezio Melotti committed
3900
- Issue #17249: convert a test in test_capi to use unittest and reap threads.
3901

3902 3903 3904 3905
- Issue #17107: Test client-side SNI support in urllib.request thanks to
  the new server-side SNI support in the ssl module.  Initial patch by
  Daniel Black.

3906 3907
- Issue #17041: Fix testing when Python is configured with the
  --without-doc-strings.
3908

3909 3910
- Issue #16923: Fix ResourceWarnings in test_ssl.

3911
- Issue #15539: Added regression tests for Tools/scripts/pindent.py.
3912

3913 3914 3915
- Issue #17479: test_io now works with unittest test discovery.
  Patch by Zachary Ware.

3916 3917 3918
- Issue #17066: test_robotparser now works with unittest test discovery.
  Patch by Zachary Ware.

3919 3920
- Issue #17334: test_index now works with unittest test discovery.
  Patch by Zachary Ware.
3921

3922 3923 3924
- Issue #17333: test_imaplib now works with unittest test discovery.
  Patch by Zachary Ware.

3925 3926 3927
- Issue #17082: test_dbm* now work with unittest test discovery.
  Patch by Zachary Ware.

3928 3929 3930
- Issue #17079: test_ctypes now works with unittest test discovery.
  Patch by Zachary Ware.

3931 3932 3933
- Issue #17304: test_hash now works with unittest test discovery.
  Patch by Zachary Ware.

3934 3935 3936
- Issue #17303: test_future* now work with unittest test discovery.
  Patch by Zachary Ware.

3937 3938 3939
- Issue #17163: test_file now works with unittest test discovery.
  Patch by Zachary Ware.

3940 3941 3942
- Issue #16925: test_configparser now works with unittest test discovery.
  Patch by Zachary Ware.

3943 3944 3945
- Issue #16918: test_codecs now works with unittest test discovery.
  Patch by Zachary Ware.

3946 3947 3948
- Issue #16919: test_crypt now works with unittest test discovery.
  Patch by Zachary Ware.

3949 3950 3951
- Issue #16910: test_bytes, test_unicode, and test_userstring now work with
  unittest test discovery.  Patch by Zachary Ware.

3952 3953 3954
- Issue #16905: test_warnings now works with unittest test discovery.
  Initial patch by Berker Peksag.

3955 3956 3957
- Issue #16898: test_bufio now works with unittest test discovery.
  Patch by Zachary Ware.

3958 3959 3960
- Issue #16888: test_array now works with unittest test discovery.
  Patch by Zachary Ware.

3961 3962 3963
- Issue #16896: test_asyncore now works with unittest test discovery.
  Patch by Zachary Ware.

3964 3965 3966
- Issue #16897: test_bisect now works with unittest test discovery.
  Initial patch by Zachary Ware.

3967 3968 3969
- Issue #16852: test_genericpath, test_posixpath, test_ntpath, and test_macpath
  now work with unittest test discovery.  Patch by Zachary Ware.

3970 3971
- Issue #16748: test_heapq now works with unittest test discovery.

Brian Curtin's avatar
Brian Curtin committed
3972 3973 3974
- Issue #10646: Tests rearranged for os.samefile/samestat to check for not
  just symlinks but also hard links.

3975 3976
- Issue #15302: Switch regrtest from using getopt to using argparse.

3977 3978
- Issue #15324: Fix regrtest parsing of --fromfile, --match, and --randomize
  options.
3979

3980 3981 3982
- Issue #16702: test_urllib2_localnet tests now correctly ignores proxies for
  localhost tests.

3983 3984
- Issue #16664: Add regression tests for glob's behaviour concerning entries
  starting with a ".".  Patch by Sebastian Kreft.
3985

3986 3987 3988
- Issue #13390: The ``-R`` option to regrtest now also checks for memory
  allocation leaks, using :func:`sys.getallocatedblocks()`.

Ezio Melotti's avatar
Ezio Melotti committed
3989 3990
- Issue #16559: Add more tests for the json module, including some from the
  official test suite at json.org.  Patch by Serhiy Storchaka.
3991

3992 3993 3994
- Issue #16661: Fix the `os.getgrouplist()` test by not assuming that it gives
  the same output as :command:`id -G`.

3995 3996 3997
- Issue #16115: Add some tests for the executable argument to
  subprocess.Popen().  Initial patch by Kushal Das.

3998 3999 4000
- Issue #16126: PyErr_Format format mismatch in _testcapimodule.c.
  Patch by Serhiy Storchaka.

Georg Brandl's avatar
Georg Brandl committed
4001 4002
- Issue #15304: Fix warning message when `os.chdir()` fails inside
  `test.support.temp_cwd()`.  Patch by Chris Jerdonek.
4003

Georg Brandl's avatar
Georg Brandl committed
4004 4005
- Issue #15802: Fix test logic in `TestMaildir.test_create_tmp()`. Patch by
  Serhiy Storchaka.
4006

Georg Brandl's avatar
Georg Brandl committed
4007 4008
- Issue #15557: Added a test suite for the webbrowser module, thanks to Anton
  Barkovsky.
4009

Ned Deily's avatar
Ned Deily committed
4010 4011
- Issue #16698: Skip posix test_getgroups when built with OS X
  deployment target prior to 10.6.
4012

4013 4014 4015
Build
-----

4016 4017 4018 4019 4020 4021 4022 4023 4024 4025 4026 4027 4028 4029 4030 4031 4032 4033 4034 4035 4036
- Issue #16067: Add description into MSI file to replace installer's
  temporary name.

- Issue #18257: Fix readlink usage in python-config.  Install the python
  version again on Darwin.

- Issue #18481: Add C coverage reporting with gcov and lcov. A new make target
  "coverage-report" creates an instrumented Python build, runs unit tests
  and creates a HTML. The report can be updated with "make coverage-lcov".

- Issue #17845: Clarified the message printed when some module are not built.

- Issue #18256: Compilation fix for recent AIX releases.  Patch by
  David Edelsohn.

- Issue #17547: In configure, explicitly pass -Wformat for the benefit for GCC
  4.8.

- Issue #15172: Document NASM 2.10+ as requirement for building OpenSSL 1.0.1
  on Windows.

4037 4038 4039
- Issue #17591: Use lowercase filenames when including Windows header files.
  Patch by Roumen Petrov.

Benjamin Peterson's avatar
Benjamin Peterson committed
4040 4041
- Issue #17550: Fix the --enable-profiling configure switch.

4042 4043
- Issue #17425: Build with openssl 1.0.1d on Windows.

4044 4045 4046
- Issue #16754: Fix the incorrect shared library extension on linux. Introduce
  two makefile macros SHLIB_SUFFIX and EXT_SUFFIX. SO now has the value of
  SHLIB_SUFFIX again (as in 2.x and 3.1). The SO macro is removed in 3.4.
4047

4048 4049
- Issue #5033: Fix building of the sqlite3 extension module when the
  SQLite library version has "beta" in it. Patch by Andreas Pelme.
4050

4051 4052
- Issue #17228: Fix building without pymalloc.

4053 4054
- Issue #3718: Use AC_ARG_VAR to set MACHDEP in configure.ac.

4055 4056
- Issue #16235: Implement python-config as a shell script.

4057 4058
- Issue #16769: Remove outdated Visual Studio projects.

4059 4060
- Issue #17031: Fix running regen in cross builds.

4061
- Issue #3754: fix typo in pthread AC_CACHE_VAL.
4062

4063 4064 4065
- Issue #15484: Fix _PYTHON_PROJECT_BASE for srcdir != builddir builds;
  use _PYTHON_PROJECT_BASE in distutils/sysconfig.py.

4066
- Drop support for Windows 2000 (changeset e52df05b496a).
4067

4068
- Issue #17029: Let h2py search the multiarch system include directory.
4069

4070 4071
- Issue #16953: Fix socket module compilation on platforms with
  HAVE_BROKEN_POLL. Patch by Jeffrey Armstrong.
4072

4073 4074
- Issue #16320: Remove redundant Makefile dependencies for strings and bytes.

4075 4076 4077
- Cross compiling needs host and build settings. configure no longer
  creates a broken PYTHON_FOR_BUILD variable when --build is missing.

4078 4079 4080
- Fix cross compiling issue in setup.py, ensure that lib_dirs and inc_dirs are
  defined in cross compiling mode, too.

4081 4082
- Issue #16836: Enable IPv6 support even if IPv6 is disabled on the build host.

4083 4084
- Issue #16593: Have BSD 'make -s' do the right thing, thanks to Daniel Shahaf

4085
- Issue #16262: fix out-of-src-tree builds, if mercurial is not installed.
4086

4087 4088 4089
- Issue #15298: ensure _sysconfigdata is generated in build directory, not
  source directory.

4090 4091 4092 4093
- Issue #15833: Fix a regression in 3.3 that resulted in exceptions being
  raised if importlib failed to write byte-compiled files.  This affected
  attempts to build Python out-of-tree from a read-only source directory.

Georg Brandl's avatar
Georg Brandl committed
4094 4095
- Issue #15923: Fix a mistake in ``asdl_c.py`` that resulted in a TypeError
  after 2801bf875a24 (see #15801).
4096

4097 4098
- Issue #16135: Remove OS/2 support.

4099 4100
- Issue #15819: Make sure we can build Python out-of-tree from a read-only
  source directory.  (Somewhat related to issue #9860.)
4101

Ned Deily's avatar
Ned Deily committed
4102 4103 4104
- Issue #15587: Enable Tk high-resolution text rendering on Macs with
  Retina displays.  Applies to Tkinter apps, such as IDLE, on OS X
  framework builds linked with Cocoa Tk 8.5.
4105

4106
- Issue #17161: make install now also installs a python3 man page.
4107

4108 4109
C-API
-----
4110

4111 4112 4113 4114 4115 4116 4117 4118 4119 4120 4121 4122 4123 4124 4125 4126
- Issue #18351: Fix various issues in a function in importlib provided to help
  PyImport_ExecCodeModuleWithPathnames() (and thus by extension
  PyImport_ExecCodeModule() and PyImport_ExecCodeModuleEx()).

- Issue #9369: The types of `char*` arguments of PyObject_CallFunction() and
  PyObject_CallMethod() now changed to `const char*`.  Based on patches by
  Jörg Müller and Lars Buitinck.

- Issue #17206: Py_CLEAR(), Py_DECREF(), Py_XINCREF() and Py_XDECREF() now
  expand their arguments once instead of multiple times.  Patch written by Illia
  Polosukhin.

- Issue #17522: Add the PyGILState_Check() API.

- Issue #17327: Add PyDict_SetDefault.

4127
- Issue #16881: Fix Py_ARRAY_LENGTH macro for GCC < 3.1.
4128

4129 4130 4131 4132 4133 4134 4135 4136 4137 4138
- Issue #16505: Remove unused Py_TPFLAGS_INT_SUBCLASS.

- Issue #16086: PyTypeObject.tp_flags and PyType_Spec.flags are now unsigned
  (unsigned long and unsigned int) to avoid an undefined behaviour with
  Py_TPFLAGS_TYPE_SUBCLASS ((1 << 31). PyType_GetFlags() result type is
  now unsigned too (unsigned long, instead of long).

- Issue #16166: Add PY_LITTLE_ENDIAN and PY_BIG_ENDIAN macros and unified
  endianness detection and handling.

4139 4140 4141
Documentation
-------------

4142 4143 4144 4145 4146 4147 4148 4149 4150 4151 4152 4153 4154 4155 4156
- Issue #17701: Improving strftime documentation.

- Issue #18440: Clarify that `hash()` can truncate the value returned from an
  object's custom `__hash__()` method.

- Issue #17844: Add links to encoders and decoders for bytes-to-bytes codecs.

- Issue #14097: improve the "introduction" page of the tutorial.

- Issue #17977: The documentation for the cadefault argument's default value
  in urllib.request.urlopen() is fixed to match the code.

- Issue #6696: add documentation for the Profile objects, and improve
  profile/cProfile docs.  Patch by Tom Pinckney.

Terry Jan Reedy's avatar
Terry Jan Reedy committed
4157 4158
- Issue #15940: Specify effect of locale on time functions.

4159
- Issue 17538: Document XML vulnerabilties
Barry Warsaw's avatar
Barry Warsaw committed
4160

4161 4162 4163
- Issue #16642: sched.scheduler timefunc initial default is time.monotonic.
  Patch by Ramchandra Apte

4164 4165
- Issue #17047: remove doubled words in docs and docstrings
  reported by Serhiy Storchaka and Matthew Barnett.
4166

4167 4168 4169
- Issue #15465: Document the versioning macros in the C API docs rather than
  the standard library docs. Patch by Kushal Das.

4170
- Issue #16406: Combine the pages for uploading and registering to PyPI.
4171

4172 4173
- Issue #16403: Document how distutils uses the maintainer field in
  PKG-INFO. Patch by Jyrki Pulliainen.
4174

4175 4176
- Issue #16695: Document how glob handles filenames starting with a
  dot. Initial patch by Jyrki Pulliainen.
4177

4178 4179 4180
- Issue #8890: Stop advertising an insecure practice by replacing uses
  of the /tmp directory with better alternatives in the documentation.
  Patch by Geoff Wilson.
4181

4182
- Issue #17203: add long option names to unittest discovery docs.
4183

Ezio Melotti's avatar
Ezio Melotti committed
4184 4185
- Issue #13094: add "Why do lambdas defined in a loop with different values
  all return the same result?" programming FAQ.
4186

Brian Curtin's avatar
Brian Curtin committed
4187 4188
- Issue #14901: Update portions of the Windows FAQ.
  Patch by Ashish Nitin Patil.
4189

4190 4191 4192
- Issue #16267: Better document the 3.3+ approach to combining
  @abstractmethod with @staticmethod, @classmethod and @property

4193 4194 4195
- Issue #15209: Clarify exception chaining description in exceptions module
  documentation

4196
- Issue #15990: Improve argument/parameter documentation.
4197

4198 4199 4200
- Issue #16209: Move the documentation for the str built-in function to a new
  str class entry in the "Text Sequence Type" section.

4201 4202
- Issue #13538: Improve str() and object.__str__() documentation.

Brett Cannon's avatar
Brett Cannon committed
4203 4204
- Issue #16489: Make it clearer that importlib.find_loader() needs parent
  packages to be explicitly imported.
4205

4206 4207
- Issue #16400: Update the description of which versions of a given package
  PyPI displays.
4208

4209 4210
- Issue #15677: Document that zlib and gzip accept a compression level of 0 to
  mean 'no compression'. Patch by Brian Brazil.
4211

4212 4213 4214
- Issue #16197: Update winreg docstrings and documentation to match code.
  Patch by Zachary Ware.

Ezio Melotti's avatar
Ezio Melotti committed
4215 4216
- Issue #8040: added a version switcher to the documentation.  Patch by
  Yury Selivanov.
4217

4218 4219 4220
- Issue #16241: Document -X faulthandler command line option.
  Patch by Marek Šuppa.

4221 4222 4223
- Additional comments and some style changes in the concurrent.futures URL
  retrieval example

4224 4225 4226
- Issue #16115: Improve subprocess.Popen() documentation around args, shell,
  and executable arguments.

Hynek Schlawack's avatar
Hynek Schlawack committed
4227 4228 4229
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.

Georg Brandl's avatar
Georg Brandl committed
4230
- Issue #15533: Clarify docs and add tests for `subprocess.Popen()`'s cwd
4231
  argument.
4232

Ezio Melotti's avatar
Ezio Melotti committed
4233 4234
- Issue #15979: Improve timeit documentation.

Georg Brandl's avatar
Georg Brandl committed
4235
- Issue #16036: Improve documentation of built-in `int()`'s signature and
4236 4237
  arguments.

Georg Brandl's avatar
Georg Brandl committed
4238
- Issue #15935: Clarification of `argparse` docs, re: add_argument() type and
4239 4240 4241 4242 4243
  default arguments.  Patch contributed by Chris Jerdonek.

- Issue #11964: Document a change in v3.2 to the behavior of the indent
  parameter of json encoding operations.

Ned Deily's avatar
Ned Deily committed
4244 4245
- Issue #15116: Remove references to appscript as it is no longer being
  supported.
4246

4247 4248 4249
Tools/Demos
-----------

4250 4251 4252 4253 4254 4255 4256 4257 4258 4259 4260 4261 4262 4263 4264 4265
- Issue #18817: Fix a resource warning in Lib/aifc.py demo.  Patch by
  Vajrasky Kok.

- Issue #18439: Make patchcheck work on Windows for ACKS, NEWS.

- Issue #18448: Fix a typo in Tools/demo/eiffel.py.

- Issue #18457: Fixed saving of formulas and complex numbers in
  Tools/demo/ss1.py.

- Issue #18449: Make Tools/demo/ss1.py work again on Python 3.  Patch by
  Févry Thibault.

- Issue #12990: The "Python Launcher" on OSX could not launch python scripts
  that have paths that include wide characters.

4266 4267
- Issue #15239: Make mkstringprep.py work again on Python 3.

4268
- Issue #17028: Allowed Python arguments to be supplied to the Windows
4269 4270
  launcher.

4271 4272
- Issue #17156: pygettext.py now detects the encoding of source files and
  correctly writes and escapes non-ascii characters.
4273

4274 4275 4276 4277
- Issue #15539: Fix a number of bugs in Tools/scripts/pindent.py.  Now
  pindent.py works with a "with" statement.  pindent.py no longer produces
  improper indentation.  pindent.py now works with continued lines broken after
  "class" or "def" keywords and with continuations at the start of line.
4278

4279 4280
- Issue #11797: Add a 2to3 fixer that maps reload() to imp.reload().

4281 4282
- Issue #10966: Remove the concept of unexpected skipped tests.

4283 4284 4285 4286
- Issue #9893: Removed the Misc/Vim directory.

- Removed the Misc/TextMate directory.

4287 4288 4289
- Issue #16245: Add the Tools/scripts/parse_html5_entities.py script to parse
  the list of HTML5 entities and update the html.entities.html5 dictionary.

4290
- Issue #15378: Fix Tools/unicode/comparecodecs.py.  Patch by Serhiy Storchaka.
Ronald Oussoren's avatar
Ronald Oussoren committed
4291

4292 4293 4294
- Issue #16549: Make json.tool work again on Python 3 and add tests.
  Initial patch by Berker Peksag and Serhiy Storchaka.

4295 4296 4297
- Issue #13301: use ast.literal_eval() instead of eval() in Tools/i18n/msgfmt.py
  Patch by Serhiy Storchaka.

4298 4299 4300 4301 4302 4303
Windows
-------

- Issue #18569: The installer now adds .py to the PATHEXT variable when extensions
  are registered. Patch by Paul Moore.

4304

Georg Brandl's avatar
Georg Brandl committed
4305 4306 4307
What's New in Python 3.3.0?
===========================

Georg Brandl's avatar
Georg Brandl committed
4308
*Release date: 29-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
4309 4310 4311 4312

Core and Builtins
-----------------

4313 4314
- Issue #16046: Fix loading sourceless legacy .pyo files.

4315 4316
- Issue #16060: Fix refcounting bug when `__trunc__()` returns an object whose
  `__int__()` gives a non-integer.  Patch by Serhiy Storchaka.
4317

4318 4319 4320
Extension Modules
-----------------

4321
- Issue #16012: Fix a regression in pyexpat. The parser's `UseForeignDTD()`
4322 4323
  method doesn't require an argument again.

Georg Brandl's avatar
Georg Brandl committed
4324

4325
What's New in Python 3.3.0 Release Candidate 3?
Georg Brandl's avatar
Georg Brandl committed
4326
===============================================
4327

Georg Brandl's avatar
Georg Brandl committed
4328
*Release date: 23-Sep-2012*
4329 4330 4331 4332

Core and Builtins
-----------------

4333
- Issue #15900: Fix reference leak in `PyUnicode_TranslateCharmap()`.
4334

4335 4336
- Issue #15926: Fix crash after multiple reinitializations of the interpreter.

4337
- Issue #15895: Fix FILE pointer leak in one error branch of
4338 4339
  `PyRun_SimpleFileExFlags()` when filename points to a pyc/pyo file, closeit is
  false an and set_main_loader() fails.
4340

4341 4342
- Fixes for a few crash and memory leak regressions found by Coverity.

4343 4344 4345
Library
-------

4346 4347 4348 4349
- Issue #15882: Change `_decimal` to accept any coefficient tuple when
  constructing infinities. This is done for backwards compatibility with
  decimal.py: Infinity coefficients are undefined in _decimal (in accordance
  with the specification).
4350

4351 4352
- Issue #15925: Fix a regression in `email.util` where the `parsedate()` and
  `parsedate_tz()` functions did not return None anymore when the argument could
4353 4354
  not be parsed.

Georg Brandl's avatar
Georg Brandl committed
4355 4356 4357
Extension Modules
-----------------

4358 4359 4360
- Issue #15973: Fix a segmentation fault when comparing datetime timezone
  objects.

Georg Brandl's avatar
Georg Brandl committed
4361 4362 4363
- Issue #15977: Fix memory leak in Modules/_ssl.c when the function
  _set_npn_protocols() is called multiple times, thanks to Daniel Sommermann.

4364
- Issue #15969: `faulthandler` module: rename dump_tracebacks_later() to
4365 4366 4367
  dump_traceback_later() and cancel_dump_tracebacks_later() to
  cancel_dump_traceback_later().

4368
- _decimal module: use only C 89 style comments.
Georg Brandl's avatar
Georg Brandl committed
4369

4370

Georg Brandl's avatar
Georg Brandl committed
4371 4372 4373
What's New in Python 3.3.0 Release Candidate 2?
===============================================

Georg Brandl's avatar
Georg Brandl committed
4374
*Release date: 09-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
4375 4376 4377 4378

Core and Builtins
-----------------

4379
- Issue #13992: The trashcan mechanism is now thread-safe.  This eliminates
4380 4381
  sporadic crashes in multi-thread programs when several long deallocator chains
  ran concurrently and involved subclasses of built-in container types.
4382

4383 4384
- Issue #15784: Modify `OSError`.__str__() to better distinguish between errno
  error numbers and Windows error numbers.
4385

4386 4387
- Issue #15781: Fix two small race conditions in import's module locking.

Georg Brandl's avatar
Georg Brandl committed
4388 4389 4390
Library
-------

4391 4392 4393
- Issue #17158: Add 'symbols' to help() welcome message; clarify
  'modules spam' messages.

4394 4395
- Issue #15847: Fix a regression in argparse, which did not accept tuples as
  argument lists anymore.
4396

4397
- Issue #15828: Restore support for C extensions in `imp.load_module()`.
4398

4399 4400
- Issue #15340: Fix importing the random module when ``/dev/urandom`` cannot be
  opened.  This was a regression caused by the hash randomization patch.
4401

4402
- Issue #10650: Deprecate the watchexp parameter of the `Decimal.quantize()`
4403 4404
  method.

4405 4406 4407 4408
- Issue #15785: Modify `window.get_wch()` API of the curses module: return a
  character for most keys, and an integer for special keys, instead of always
  returning an integer. So it is now possible to distinguish special keys like
  keypad keys.
4409

4410
- Issue #14223: Fix `window.addch()` of the curses module for special characters
4411 4412 4413 4414 4415 4416
  like curses.ACS_HLINE: the Python function addch(int) and addch(bytes) is now
  calling the C function waddch()/mvwaddch() (as it was done in Python 3.2),
  instead of wadd_wch()/mvwadd_wch(). The Python function addch(str) is still
  calling the C function wadd_wch()/mvwadd_wch() if the Python curses is linked
  to libncursesw.

Georg Brandl's avatar
Georg Brandl committed
4417 4418 4419 4420 4421 4422
Build
-----

- Issue #15822: Really ensure 2to3 grammar pickles are properly installed
  (replaces fixes for Issue #15645).

4423 4424 4425
Documentation
-------------

4426 4427 4428 4429
- Issue #15814: The memoryview enhancements in 3.3.0 accidentally permitted the
  hashing of multi-dimensional memorviews and memoryviews with multi-byte item
  formats. The intended restrictions have now been documented - they will be
  correctly enforced in 3.3.1.
4430

Georg Brandl's avatar
Georg Brandl committed
4431

Georg Brandl's avatar
Georg Brandl committed
4432 4433 4434
What's New in Python 3.3.0 Release Candidate 1?
===============================================

Georg Brandl's avatar
Georg Brandl committed
4435
*Release date: 25-Aug-2012*
Georg Brandl's avatar
Georg Brandl committed
4436 4437 4438 4439

Core and Builtins
-----------------

4440
- Issue #15573: memoryview comparisons are now performed by value with full
4441
  support for any valid struct module format definition.
4442

4443
- Issue #15316: When an item in the fromlist for `__import__()` doesn't exist,
4444 4445 4446
  don't raise an error, but if an exception is raised as part of an import do
  let that propagate.

4447 4448
- Issue #15778: Ensure that ``str(ImportError(msg))`` returns a str even when
  msg isn't a str.
4449

4450 4451 4452 4453
- Issue #2051: Source file permission bits are once again correctly copied to
  the cached bytecode file. (The migration to importlib reintroduced this
  problem because these was no regression test. A test has been added as part of
  this patch)
4454

4455
- Issue #15761: Fix crash when ``PYTHONEXECUTABLE`` is set on Mac OS X.
4456

4457 4458
- Issue #15726: Fix incorrect bounds checking in PyState_FindModule.  Patch by
  Robin Schreiber.
4459

4460
- Issue #15604: Update uses of `PyObject_IsTrue()` to check for and handle
4461 4462
  errors correctly.  Patch by Serhiy Storchaka.

4463 4464
- Issue #14846: `importlib.FileFinder` now handles the case where the directory
  being searched is removed after a previous import attempt.
4465

Georg Brandl's avatar
Georg Brandl committed
4466 4467 4468
Library
-------

4469 4470
- Issue #13248: removed deprecated and undocumented difflib.isbjunk, isbpopular.

4471 4472
- Issue #13370: Ensure that ctypes works on Mac OS X when Python is compiled
  using the clang compiler.
4473

4474 4475
- Issue #13072: The array module's 'u' format code is now deprecated and will be
  removed in Python 4.0.
4476

4477 4478
- Issue #15544: Fix Decimal.__float__ to work with payload-carrying NaNs.

4479 4480
- Issue #15776: Allow pyvenv to work in existing directory with --clean.

4481
- Issue #15249: email's BytesGenerator now correctly mangles From lines (when
4482
  requested) even if the body contains undecodable bytes.
4483

Ross Lagerwall's avatar
Ross Lagerwall committed
4484
- Issue #15777: Fix a refleak in _posixsubprocess.
4485

4486
- Issue ##665194: Update `email.utils.localtime` to use datetime.astimezone and
4487 4488
  correctly handle historic changes in UTC offsets.

4489 4490
- Issue #15199: Fix JavaScript's default MIME type to application/javascript.
  Patch by Bohuslav Kabrda.
4491

4492 4493
- Issue #12643: `code.InteractiveConsole` now respects `sys.excepthook` when
  displaying exceptions.  Patch by Aaron Iles.
4494

4495
- Issue #13579: `string.Formatter` now understands the 'a' conversion specifier.
4496

4497 4498
- Issue #15595: Fix ``subprocess.Popen(universal_newlines=True)`` for certain
  locales (utf-16 and utf-32 family). Patch by Chris Jerdonek.
4499

4500 4501
- Issue #15477: In cmath and math modules, add workaround for platforms whose
  system-supplied log1p function doesn't respect signs of zeros.
4502

4503 4504
- Issue #15715: `importlib.__import__()` will silence an ImportError when the
  use of fromlist leads to a failed import.
4505

4506 4507 4508
- Issue #14669: Fix pickling of connections and sockets on Mac OS X by
  sending/receiving an acknowledgment after file descriptor transfer.
  TestPicklingConnection has been reenabled for Mac OS X.
4509

4510
- Issue #11062: Fix adding a message from file to Babyl mailbox.
4511

4512 4513
- Issue #15646: Prevent equivalent of a fork bomb when using `multiprocessing`
  on Windows without the ``if __name__ == '__main__'`` idiom.
4514

4515 4516 4517
IDLE
----

4518 4519
- Issue #15678: Fix IDLE menus when started from OS X command line (3.3.0b2
  regression).
4520

Senthil Kumaran's avatar
Senthil Kumaran committed
4521 4522
Documentation
-------------
4523

4524 4525
- Touched up the Python 2 to 3 porting guide.

4526
- Issue #14674: Add a discussion of the `json` module's standard compliance.
4527
  Patch by Chris Rebert.
4528

4529 4530
- Create a 'Concurrent Execution' section in the docs, and split up the
  'Optional Operating System Services' section to use a more user-centric
4531
  classification scheme (splitting them across the new CE section, IPC and text
4532
  processing). Operating system limitations can be reflected with the Sphinx
4533
  ``:platform:`` tag, it doesn't make sense as part of the Table of Contents.
4534

4535 4536
- Issue #4966: Bring the sequence docs up to date for the Py3k transition and
  the many language enhancements since they were original written.
4537

4538
- The "path importer" misnomer has been replaced with Eric Snow's
4539 4540
  more-awkward-but-at-least-not-wrong suggestion of "path based finder" in the
  import system reference docs.
4541

4542
- Issue #15640: Document `importlib.abc.Finder` as deprecated.
4543

4544
- Issue #15630: Add an example for "continue" stmt in the tutorial.  Patch by
Senthil Kumaran's avatar
Senthil Kumaran committed
4545
  Daniel Ellis.
4546

4547 4548
Tests
-----
4549

4550
- Issue #15747: ZFS always returns EOPNOTSUPP when attempting to set the
4551 4552
  UF_IMMUTABLE flag (via either chflags or lchflags); refactor affected tests in
  test_posix.py to account for this.
4553

4554 4555
- Issue #15285: Refactor the approach for testing connect timeouts using two
  external hosts that have been configured specifically for this type of test.
4556

4557
- Issue #15743: Remove the deprecated method usage in `urllib` tests. Patch by
4558 4559
  Jeff Knupp.

4560 4561
- Issue #15615: Add some tests for the `json` module's handling of invalid input
  data.  Patch by Kushal Das.
4562

4563 4564 4565
Build
-----

4566 4567
- Output lib files for PGO build into PGO directory.

4568 4569
- Pick up 32-bit launcher from PGO directory on 64-bit PGO build.

4570
- Drop ``PC\python_nt.h`` as it's not used.  Add input dependency on custom
4571 4572
  build step.

4573 4574
- Issue #15511: Drop explicit dependency on pythonxy.lib from _decimal amd64
  configuration.
4575

4576 4577
- Add missing PGI/PGO configurations for pywlauncher.

4578 4579
- Issue #15645: Ensure 2to3 grammar pickles are properly installed.

Georg Brandl's avatar
Georg Brandl committed
4580

4581 4582 4583
What's New in Python 3.3.0 Beta 2?
==================================

Georg Brandl's avatar
Georg Brandl committed
4584
*Release date: 12-Aug-2012*
4585

4586 4587 4588
Core and Builtins
-----------------

4589
- Issue #15568: Fix the return value of ``yield from`` when StopIteration is
4590 4591
  raised by a custom iterator.

4592
- Issue #13119: `sys.stdout` and `sys.stderr` are now using "\r\n" newline on
4593 4594
  Windows, as Python 2.

4595 4596
- Issue #15534: Fix the fast-search function for non-ASCII Unicode strings.

4597
- Issue #15508: Fix the docstring for `__import__()` to have the proper default
Georg Brandl's avatar
Georg Brandl committed
4598 4599
  value of 0 for 'level' and to not mention negative levels since they are not
  supported.
4600

4601
- Issue #15425: Eliminated traceback noise from more situations involving
Georg Brandl's avatar
Georg Brandl committed
4602
  importlib.
4603

4604 4605
- Issue #14578: Support modules registered in the Windows registry again.

Georg Brandl's avatar
Georg Brandl committed
4606 4607
- Issue #15466: Stop using TYPE_INT64 in marshal, to make importlib.h (and other
  byte code files) equal between 32-bit and 64-bit systems.
4608

Georg Brandl's avatar
Georg Brandl committed
4609
- Issue #1692335: Move initial exception args assignment to
4610
  `BaseException.__new__()` to help pickling of naive subclasses.
4611

4612
- Issue #12834: Fix `PyBuffer_ToContiguous()` for non-contiguous arrays.
4613

4614
- Issue #15456: Fix code `__sizeof__()` after #12399 change.  Patch by Serhiy
Georg Brandl's avatar
Georg Brandl committed
4615
  Storchaka.
4616

4617 4618
- Issue #15404: Refleak in PyMethodObject repr.

4619 4620
- Issue #15394: An issue in `PyModule_Create()` that caused references to be
  leaked on some error paths has been fixed.  Patch by Julia Lawall.
4621

Georg Brandl's avatar
Georg Brandl committed
4622 4623
- Issue #15368: An issue that caused bytecode generation to be non-deterministic
  has been fixed.
4624

Georg Brandl's avatar
Georg Brandl committed
4625 4626
- Issue #15202: Consistently use the name "follow_symlinks" for new parameters
  in os and shutil functions.
4627

4628
- Issue #15314: ``__main__.__loader__`` is now set correctly during interpreter
Georg Brandl's avatar
Georg Brandl committed
4629
  startup.
4630

4631 4632 4633 4634
- Issue #15111: When a module imported using 'from import' has an ImportError
  inside itself, don't mask that fact behind a generic ImportError for the
  module itself.

4635 4636
- Issue #15293: Add GC support to the AST base node type.

4637 4638 4639
- Issue #15291: Fix a memory leak where AST nodes where not properly
  deallocated.

Georg Brandl's avatar
Georg Brandl committed
4640 4641
- Issue #15110: Fix the tracebacks generated by "import xxx" to not show the
  importlib stack frames.
4642

4643
- Issue #16369: Global PyTypeObjects not initialized with PyType_Ready(...).
Ronald Oussoren's avatar
Ronald Oussoren committed
4644

4645 4646 4647
- Issue #15020: The program name used to search for Python's path is now
  "python3" under Unix, not "python".

4648 4649
- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.
4650

Ezio Melotti's avatar
Ezio Melotti committed
4651
- Issue #15033: Fix the exit status bug when modules invoked using -m switch,
4652 4653
  return the proper failure return value (1). Patch contributed by Jeff Knupp.

4654
- Issue #15229: An `OSError` subclass whose __init__ doesn't call back
Georg Brandl's avatar
Georg Brandl committed
4655 4656
  OSError.__init__ could produce incomplete instances, leading to crashes when
  calling str() on them.
4657

Ezio Melotti's avatar
Ezio Melotti committed
4658
- Issue #15307: Virtual environments now use symlinks with framework builds on
Georg Brandl's avatar
Georg Brandl committed
4659
  Mac OS X, like other POSIX builds.
4660

4661 4662 4663
Library
-------

4664 4665 4666
- Issue #14590: configparser now correctly strips inline comments when delimiter
  occurs earlier without preceding space.

4667
- Issue #15424: Add a `__sizeof__()` implementation for array objects.  Patch by
Georg Brandl's avatar
Georg Brandl committed
4668
  Ludwig Hähne.
4669

4670 4671
- Issue #15576: Allow extension modules to act as a package's __init__ module.

4672 4673
- Issue #15502: Have `importlib.invalidate_caches()` work on `sys.meta_path`
  instead of `sys.path_importer_cache`.
4674

4675 4676
- Issue #15163: Pydoc shouldn't list __loader__ as module data.

4677
- Issue #15471: Do not use mutable objects as defaults for
4678
  `importlib.__import__()`.
4679

4680
- Issue #15559: To avoid a problematic failure mode when passed to the bytes
4681 4682
  constructor, objects in the ipaddress module no longer implement `__index__()`
  (they still implement `__int__()` as appropriate).
4683

4684 4685
- Issue #15546: Fix handling of pathological input data in the peek() and
  read1() methods of the BZ2File, GzipFile and LZMAFile classes.
4686

4687 4688 4689
- Issue #12655: Instead of requiring a custom type, `os.sched_getaffinity()` and
  `os.sched_setaffinity()` now use regular sets of integers to represent the
  CPUs a process is restricted to.
4690

4691 4692
- Issue #15538: Fix compilation of the `socket.getnameinfo()` /
  `socket.getaddrinfo()` emulation code.  Patch by Philipp Hagemeister.
4693

Georg Brandl's avatar
Georg Brandl committed
4694
- Issue #15519: Properly expose WindowsRegistryFinder in importlib (and use the
4695
  correct term for it).  Original patch by Eric Snow.
4696

Georg Brandl's avatar
Georg Brandl committed
4697
- Issue #15502: Bring the importlib ABCs into line with the current state of the
4698
  import protocols given PEP 420.  Original patch by Eric Snow.
4699

Georg Brandl's avatar
Georg Brandl committed
4700 4701
- Issue #15499: Launching a webbrowser in Unix used to sleep for a few seconds.
  Original patch by Anton Barkovsky.
4702

Georg Brandl's avatar
Georg Brandl committed
4703 4704
- Issue #15463: The faulthandler module truncates strings to 500 characters,
  instead of 100, to be able to display long file paths.
4705

4706
- Issue #6056: Make `multiprocessing` use setblocking(True) on the sockets it
Georg Brandl's avatar
Georg Brandl committed
4707
  uses.  Original patch by J Derek Wilson.
4708

Georg Brandl's avatar
Georg Brandl committed
4709
- Issue #15364: Fix sysconfig.get_config_var('srcdir') to be an absolute path.
4710

4711
- Issue #15413: `os.times()` had disappeared under Windows.
4712

4713
- Issue #15402: An issue in the struct module that caused `sys.getsizeof()` to
Georg Brandl's avatar
Georg Brandl committed
4714 4715
  return incorrect results for struct.Struct instances has been fixed.  Initial
  patch by Serhiy Storchaka.
4716

4717 4718 4719
- Issue #15232: When mangle_from is True, `email.Generator` now correctly
  mangles lines that start with 'From ' that occur in a MIME preamble or
  epilogue.
4720

Georg Brandl's avatar
Georg Brandl committed
4721 4722
- Issue #15094: Incorrectly placed #endif in _tkinter.c.  Patch by Serhiy
  Storchaka.
4723

4724
- Issue #13922: `argparse` no longer incorrectly strips '--'s that appear after
Georg Brandl's avatar
Georg Brandl committed
4725
  the first one.
4726

4727
- Issue #12353: `argparse` now correctly handles null argument values.
4728

Georg Brandl's avatar
Georg Brandl committed
4729
- Issue #10017, issue #14998: Fix TypeError using pprint on dictionaries with
4730
  user-defined types as keys or other unorderable keys.
4731

4732 4733
- Issue #15397: `inspect.getmodulename()` is now based directly on importlib via
  a new `importlib.machinery.all_suffixes()` API.
4734

4735
- Issue #14635: `telnetlib` will use poll() rather than select() when possible to
Georg Brandl's avatar
Georg Brandl committed
4736
  avoid failing due to the select() file descriptor limit.
4737

Georg Brandl's avatar
Georg Brandl committed
4738
- Issue #15180: Clarify posixpath.join() error message when mixing str & bytes.
4739

Georg Brandl's avatar
Georg Brandl committed
4740 4741 4742
- Issue #15343: pkgutil now includes an iter_importer_modules implementation for
  importlib.machinery.FileFinder (similar to the way it already handled
  zipimport.zipimporter).
4743

Georg Brandl's avatar
Georg Brandl committed
4744
- Issue #15314: runpy now sets __main__.__loader__ correctly.
4745

Georg Brandl's avatar
Georg Brandl committed
4746 4747
- Issue #15357: The import emulation in pkgutil is now deprecated. pkgutil uses
  importlib internally rather than the emulation.
4748

Georg Brandl's avatar
Georg Brandl committed
4749 4750
- Issue #15233: Python now guarantees that callables registered with the atexit
  module will be called in a deterministic order.
4751

4752
- Issue #15238: `shutil.copystat()` now copies Linux "extended attributes".
4753

Georg Brandl's avatar
Georg Brandl committed
4754 4755
- Issue #15230: runpy.run_path now correctly sets __package__ as described in
  the documentation.
Nick Coghlan's avatar
Nick Coghlan committed
4756

4757 4758
- Issue #15315: Support VS 2010 in distutils cygwincompiler.

Georg Brandl's avatar
Georg Brandl committed
4759 4760
- Issue #15294: Fix a regression in pkgutil.extend_path()'s handling of nested
  namespace packages.
4761

4762 4763
- Issue #15056: `imp.cache_from_source()` and `imp.source_from_cache()` raise
  NotImplementedError when `sys.implementation.cache_tag` is set to None.
4764

4765
- Issue #15256: Grammatical mistake in exception raised by `imp.find_module()`.
4766

4767
- Issue #5931: `wsgiref` environ variable SERVER_SOFTWARE will specify an
Georg Brandl's avatar
Georg Brandl committed
4768
  implementation specific term like CPython, Jython instead of generic "Python".
4769

Georg Brandl's avatar
Georg Brandl committed
4770 4771
- Issue #13248: Remove obsolete argument "max_buffer_size" of BufferedWriter and
  BufferedRWPair, from the io module.
4772

4773
- Issue #13248: Remove obsolete argument "version" of `argparse.ArgumentParser`.
4774

Georg Brandl's avatar
Georg Brandl committed
4775 4776
- Issue #14814: Implement more consistent ordering and sorting behaviour for
  ipaddress objects.
4777

4778
- Issue #14814: `ipaddress` network objects correctly return NotImplemented when
Georg Brandl's avatar
Georg Brandl committed
4779
  compared to arbitrary objects instead of raising TypeError.
4780

Georg Brandl's avatar
Georg Brandl committed
4781
- Issue #14990: Correctly fail with SyntaxError on invalid encoding declaration.
Florent Xicluna's avatar
Florent Xicluna committed
4782

4783
- Issue #14814: `ipaddress` now provides more informative error messages when
4784
  constructing instances directly (changes permitted during beta due to
Georg Brandl's avatar
Georg Brandl committed
4785
  provisional API status).
4786

4787 4788
- Issue #15247: `io.FileIO` now raises an error when given a file descriptor
  pointing to a directory.
4789

4790 4791
- Issue #15261: Stop os.stat(fd) crashing on Windows when fd not open.

4792
- Issue #15166: Implement `imp.get_tag()` using `sys.implementation.cache_tag`.
4793

4794
- Issue #15210: Catch KeyError when `importlib.__init__()` can't find
4795 4796
  _frozen_importlib in sys.modules, not ImportError.

4797
- Issue #15030: `importlib.abc.PyPycLoader` now supports the new source size
4798 4799
  header field in .pyc files.

Georg Brandl's avatar
Georg Brandl committed
4800 4801
- Issue #5346: Preserve permissions of mbox, MMDF and Babyl mailbox files on
  flush().
4802

Georg Brandl's avatar
Georg Brandl committed
4803 4804
- Issue #10571: Fix the "--sign" option of distutils' upload command.  Patch by
  Jakub Wilk.
4805

Georg Brandl's avatar
Georg Brandl committed
4806 4807 4808
- Issue #9559: If messages were only added, a new file is no longer created and
  renamed over the old file when flush() is called on an mbox, MMDF or Babyl
  mailbox.
4809

Ezio Melotti's avatar
Ezio Melotti committed
4810
- Issue #10924: Fixed `crypt.mksalt()` to use a RNG that is suitable for
Georg Brandl's avatar
Georg Brandl committed
4811
  cryptographic purpose.
4812

Georg Brandl's avatar
Georg Brandl committed
4813 4814 4815 4816
- Issue #15184: Ensure consistent results of OS X configuration tailoring for
  universal builds by factoring out common OS X-specific customizations from
  sysconfig, distutils.sysconfig, distutils.util, and distutils.unixccompiler
  into a new module _osx_support.
4817

4818 4819 4820
C API
-----

4821
- Issue #15610: `PyImport_ImportModuleEx()` now uses a 'level' of 0 instead of -1.
4822

4823 4824
- Issue #15169, issue #14599: Strip out the C implementation of
  `imp.source_from_cache()` used by PyImport_ExecCodeModuleWithPathnames() and
4825 4826 4827 4828
  used the Python code instead. Leads to PyImport_ExecCodeModuleObject() to not
  try to infer the source path from the bytecode path as
  PyImport_ExecCodeModuleWithPathnames() does.

4829 4830 4831
Extension Modules
-----------------

4832 4833
- Issue #6493: An issue in ctypes on Windows that caused structure bitfields of
  type `ctypes.c_uint32` and width 32 to incorrectly be set has been fixed.
4834

4835 4836
- Issue #15194: Update libffi to the 3.0.11 release.

4837 4838 4839 4840 4841 4842
IDLE
----

- Issue #13052: Fix IDLE crashing when replace string in Search/Replace dialog
  ended with ``\``.  Patch by Roger Serwy.

4843 4844 4845
Tools/Demos
-----------

Georg Brandl's avatar
Georg Brandl committed
4846 4847
- Issue #15458: python-config gets a new option --configdir to print the $LIBPL
  value.
4848

4849 4850
- Move importlib.test.benchmark to Tools/importbench.

Georg Brandl's avatar
Georg Brandl committed
4851 4852 4853
- Issue #12605: The gdb hooks for debugging CPython (within Tools/gdb) have been
  enhanced to show information on more C frames relevant to CPython within the
  "py-bt" and "py-bt-full" commands:
Georg Brandl's avatar
Georg Brandl committed
4854 4855 4856 4857

  * C frames that are waiting on the GIL
  * C frames that are garbage-collecting
  * C frames that are due to the invocation of a PyCFunction
4858

Terry Jan Reedy's avatar
Terry Jan Reedy committed
4859 4860 4861
Documentation
-------------

4862 4863
- Issue #15041: Update "see also" list in tkinter documentation.

4864 4865
- Issue #15444: Use proper spelling for non-ASCII contributor names.  Patch by
  Serhiy Storchaka.
4866

4867
- Issue #15295: Reorganize and rewrite the documentation on the import system.
Barry Warsaw's avatar
Barry Warsaw committed
4868

Georg Brandl's avatar
Georg Brandl committed
4869 4870
- Issue #15230: Clearly document some of the limitations of the runpy module and
  nudge readers towards importlib when appropriate.
4871

4872 4873 4874
- Issue #15053: Copy Python 3.3 import lock change notice to all relevant
  functions in imp instead of just at the top of the relevant section.

4875 4876 4877 4878 4879
- Issue #15288: Link to the term "loader" in notes in pkgutil about how things
  won't work as expected in Python 3.3 and mark the requisite functions as
  "changed" since they will no longer work with modules directly imported by
  import itself.

4880 4881
- Issue #13557: Clarify effect of giving two different namespaces to `exec()` or
  `execfile()`.
Terry Jan Reedy's avatar
Terry Jan Reedy committed
4882

4883
- Issue #15250: Document that `filecmp.dircmp()` compares files shallowly. Patch
4884
  contributed by Chris Jerdonek.
4885

4886 4887 4888 4889
- Issue #15442: Expose the default list of directories ignored by
  `filecmp.dircmp()` as a module attribute, and expand the list to more modern
  values.

4890 4891 4892
Tests
-----

4893 4894
- Issue #15467: Move helpers for `__sizeof__()` tests into test_support.  Patch
  by Serhiy Storchaka.
4895

Georg Brandl's avatar
Georg Brandl committed
4896 4897
- Issue #15320: Make iterating the list of tests thread-safe when running tests
  in multiprocess mode. Patch by Chris Jerdonek.
4898

4899
- Issue #15168: Move `importlib.test` to `test.test_importlib`.
4900

4901
- Issue #15091: Reactivate a test on UNIX which was failing thanks to a
4902
  forgotten `importlib.invalidate_caches()` call.
4903 4904

- Issue #15230: Adopted a more systematic approach in the runpy tests.
Nick Coghlan's avatar
Nick Coghlan committed
4905

4906 4907 4908 4909
- Issue #15300: Ensure the temporary test working directories are in the same
  parent folder when running tests in multiprocess mode from a Python build.
  Patch by Chris Jerdonek.

4910 4911 4912
- Issue #15284: Skip {send,recv}msg tests in test_socket when IPv6 is not
  enabled. Patch by Brian Brazil.

Georg Brandl's avatar
Georg Brandl committed
4913 4914
- Issue #15277: Fix a resource leak in support.py when IPv6 is disabled.  Patch
  by Brian Brazil.
4915

4916 4917 4918
Build
-----

Georg Brandl's avatar
Georg Brandl committed
4919 4920
- Issue #11715: Fix multiarch detection without having Debian development tools
  (dpkg-dev) installed.
4921

4922 4923 4924 4925
- Issue #15037: Build OS X installers with local copy of ncurses 5.9 libraries
  to avoid curses.unget_wch bug present in older versions of ncurses such as
  those shipped with OS X.

Georg Brandl's avatar
Georg Brandl committed
4926 4927 4928 4929
- Issue #15560: Fix building _sqlite3 extension on OS X with an SDK.  Also, for
  OS X installers, ensure consistent sqlite3 behavior and feature availability
  by building a local copy of libsqlite3 rather than depending on the wide range
  of versions supplied with various OS X releases.
4930

Martin v. Löwis's avatar
Martin v. Löwis committed
4931
- Issue #8847: Disable COMDAT folding in Windows PGO builds.
4932

4933 4934
- Issue #14018: Fix OS X Tcl/Tk framework checking when using OS X SDKs.

Ned Deily's avatar
Ned Deily committed
4935
- Issue #16256: OS X installer now sets correct permissions for doc directory.
4936

Georg Brandl's avatar
Georg Brandl committed
4937 4938
- Issue #15431: Add _freeze_importlib project to regenerate importlib.h on
  Windows. Patch by Kristján Valur Jónsson.
4939

Georg Brandl's avatar
Georg Brandl committed
4940 4941
- Issue #14197: For OS X framework builds, ensure links to the shared library
  are created with the proper ABI suffix.
4942

4943 4944 4945
- Issue #14330: For cross builds, don't use host python, use host search paths
  for host compiler.

4946 4947
- Issue #15235: Allow Berkley DB versions up to 5.3 to build the dbm module.

4948 4949
- Issue #15268: Search curses.h in /usr/include/ncursesw.

4950

4951
What's New in Python 3.3.0 Beta 1?
Georg Brandl's avatar
Georg Brandl committed
4952
==================================
4953

Georg Brandl's avatar
Georg Brandl committed
4954
*Release date: 27-Jun-2012*
4955

Barry Warsaw's avatar
Barry Warsaw committed
4956 4957 4958
Core and Builtins
-----------------

4959 4960 4961
- Fix a (most likely) very rare memory leak when calling main() and not being
  able to decode a command-line argument.

4962 4963 4964
- Issue #14815: Use Py_ssize_t instead of long for the object hash, to
  preserve all 64 bits of hash on Win64.

4965 4966 4967 4968 4969
- Issue #12268: File readline, readlines and read() or readall() methods
  no longer lose data when an underlying read system call is interrupted.
  IOError is no longer raised due to a read system call returning EINTR
  from within these methods.

4970 4971
- Issue #11626: Add _SizeT functions to stable ABI.

4972 4973 4974
- Issue #15142: Fix reference leak when deallocating instances of types
  created using PyType_FromSpec().

4975 4976 4977
- Issue #10053: Don't close FDs when FileIO.__init__ fails. Loosely based on
  the work by Hirokazu Yamamoto.

4978 4979 4980
- Issue #15096: Removed support for ur'' as the raw notation isn't
  compatible with Python 2.x's raw unicode strings.

4981 4982
- Issue #13783: Generator objects now use the identifier APIs internally

4983 4984 4985
- Issue #14874: Restore charmap decoding speed to pre-PEP 393 levels.
  Patch by Serhiy Storchaka.

4986 4987 4988
- Issue #15026: utf-16 encoding is now significantly faster (up to 10x).
  Patch by Serhiy Storchaka.

4989 4990 4991 4992 4993 4994
- Issue #11022: open() and io.TextIOWrapper are now calling
  locale.getpreferredencoding(False) instead of locale.getpreferredencoding()
  in text mode if the encoding is not specified. Don't change temporary the
  locale encoding using locale.setlocale(), use the current locale encoding
  instead of the user preferred encoding.

Barry Warsaw's avatar
Barry Warsaw committed
4995 4996
- Issue #14673: Add Eric Snow's sys.implementation implementation.

4997 4998
- Issue #15038: Optimize python Locks on Windows.

4999 5000 5001
Library
-------

5002 5003
- Issue #12288: Consider '0' and '0.0' as valid initialvalue
  for tkinter SimpleDialog.
5004

5005 5006
- Issue #15512: Add a __sizeof__ implementation for parser.
  Patch by Serhiy Storchaka.
5007

5008 5009
- Issue #15469: Add a __sizeof__ implementation for deque objects.
  Patch by Serhiy Storchaka.
R David Murray's avatar
R David Murray committed
5010

5011 5012
- Issue #15489: Add a __sizeof__ implementation for BytesIO objects.
  Patch by Serhiy Storchaka.
5013

5014 5015
- Issue #15487: Add a __sizeof__ implementation for buffered I/O objects.
  Patch by Serhiy Storchaka.
5016

5017 5018 5019
- Issue #15514: Correct __sizeof__ support for cpu_set.
  Patch by Serhiy Storchaka.

5020 5021
- Issue #15177: Added dir_fd parameter to os.fwalk().

5022 5023 5024 5025
- Issue #15061: Re-implemented hmac.compare_digest() in C to prevent further
  timing analysis and to support all buffer protocol aware objects as well as
  ASCII only str instances safely.

5026 5027
- Issue #15164: Change return value of platform.uname() from a
  plain tuple to a collections.namedtuple.
5028

5029 5030 5031 5032
- Support Mageia Linux in the platform module.

- Issue #11678: Support Arch linux in the platform module.

5033 5034 5035 5036
- Issue #15118: Change return value of os.uname() and os.times() from
  plain tuples to immutable iterable objects with named attributes
  (structseq objects).

5037 5038 5039 5040
- Speed up _decimal by another 10-15% by caching the thread local context
  that was last accessed. In the pi benchmark (64-bit platform, prec=9),
  _decimal is now only 1.5x slower than float.

5041 5042
- Remove the packaging module, which is not ready for prime time.

5043 5044 5045
- Issue #15154: Add "dir_fd" parameter to os.rmdir, remove "rmdir"
  parameter from os.remove / os.unlink.

Hynek Schlawack's avatar
Hynek Schlawack committed
5046
- Issue #4489: Add a shutil.rmtree that isn't susceptible to symlink attacks.
5047 5048 5049
  It is used automatically on platforms supporting the necessary os.openat()
  and os.unlinkat() functions. Main code by Martin von Löwis.

5050 5051
- Issue #15156: HTMLParser now uses the new "html.entities.html5" dictionary.

5052 5053 5054 5055
- Issue #11113: add a new "html5" dictionary containing the named character
  references defined by the HTML5 standard and the equivalent Unicode
  character(s) to the html.entities module.

5056 5057 5058
- Issue #15114: the strict mode of HTMLParser and the HTMLParseError exception
  are deprecated now that the parser is able to parse invalid markup.

5059 5060 5061
- Issue #3665: \u and \U escapes are now supported in unicode regular
  expressions.  Patch by Serhiy Storchaka.

5062 5063 5064
- Issue #15153: Added inspect.getgeneratorlocals to simplify white box
  testing of generator state updates

5065 5066 5067 5068
- Issue #13062: Added inspect.getclosurevars to simplify testing stateful
  closures

- Issue #11024: Fixes and additional tests for Time2Internaldate.
5069

5070 5071
- Issue #14626: Large refactoring of functions / parameters in the os module.
  Many functions now support "dir_fd" and "follow_symlinks" parameters;
Ezio Melotti's avatar
Ezio Melotti committed
5072
  some also support accepting an open file descriptor in place of a path
5073 5074 5075 5076 5077
  string.  Added os.support_* collections as LBYL helpers.  Removed many
  functions only previously seen in 3.3 alpha releases (often starting with
  "f" or "l", or ending with "at").  Originally suggested by Serhiy Storchaka;
  implemented by Larry Hastings.

5078 5079 5080
- Issue #15008: Implement PEP 362 "Signature Objects".
  Patch by Yury Selivanov.

5081 5082
- Issue: #15138: base64.urlsafe_{en,de}code() are now 3-4x faster.

5083 5084 5085 5086
- Issue #444582: Add shutil.which, for finding programs on the system path.
  Original patch by Erik Demaine, with later iterations by Jan Killian
  and Brian Curtin.

5087 5088 5089 5090
- Issue #14837: SSL errors now have ``library`` and ``reason`` attributes
  describing precisely what happened and in which OpenSSL submodule.  The
  str() of a SSLError is also enhanced accordingly.

5091 5092 5093
- Issue #9527: datetime.astimezone() method will now supply a class
  timezone instance corresponding to the system local timezone when
  called with no arguments.
5094

5095 5096
- Issue #14653: email.utils.mktime_tz() no longer relies on system
  mktime() when timezone offest is supplied.
5097

5098 5099 5100
- Issue #14684: zlib.compressobj() and zlib.decompressobj() now support the use
  of predefined compression dictionaries. Original patch by Sam Rushing.

5101
- Fix GzipFile's handling of filenames given as bytes objects.
5102

5103 5104
- Issue #14772: Return destination values from some shutil functions.

5105 5106
- Issue #15064: Implement context manager protocol for multiprocessing types

5107
- Issue #15101: Make pool finalizer avoid joining current thread.
5108

5109 5110 5111
- Issue #14657: The frozen instance of importlib used for bootstrap is now
  also the module imported as importlib._bootstrap.

5112 5113
- Issue #14055: Add __sizeof__ support to _elementtree.

5114 5115 5116 5117
- Issue #15054: A bug in tokenize.tokenize that caused string literals
  with 'b' prefixes to be incorrectly tokenized has been fixed.
  Patch by Serhiy Storchaka.

5118 5119
- Issue #15006: Allow equality comparison between naive and aware
  time or datetime objects.
5120

Petri Lehtinen's avatar
Petri Lehtinen committed
5121 5122 5123
- Issue #15036: Mailbox no longer throws an error if a flush is done
  between operations when removing or changing multiple items in mbox,
  MMDF, or Babyl mailboxes.
5124

5125 5126
- Issue #14059: Implement multiprocessing.Barrier.

5127
- Issue #15061: The inappropriately named hmac.secure_compare has been
Nick Coghlan's avatar
Nick Coghlan committed
5128 5129
  renamed to hmac.compare_digest, restricted to operating on bytes inputs
  only and had its documentation updated to more accurately reflect both its
5130 5131
  intent and its limitations

5132 5133
- Issue #13841: Make child processes exit using sys.exit() on Windows.

5134
- Issue #14936: curses_panel was converted to PEP 3121 and PEP 384 API.
5135 5136
  Patch by Robin Schreiber.

5137 5138 5139 5140 5141
- Issue #1667546: On platforms supporting tm_zone and tm_gmtoff fields
  in struct tm, time.struct_time objects returned by time.gmtime(),
  time.localtime() and time.strptime() functions now have tm_zone and
  tm_gmtoff attributes.  Original patch by Paul Boddie.

5142 5143
- Rename adjusted attribute to adjustable in time.get_clock_info() result.

5144 5145 5146
- Issue #3518: Remove references to non-existent BaseManager.from_address()
  method.

5147 5148 5149
- Issue #13857: Added textwrap.indent() function (initial patch by Ezra
  Berch)

5150 5151
- Issue #2736: Added datetime.timestamp() method.

5152 5153
- Issue #13854: Make multiprocessing properly handle non-integer
  non-string argument to SystemExit.
5154

5155 5156
- Issue #12157: Make pool.map() empty iterables correctly.  Initial
  patch by mouad.
5157

5158 5159
- Issue #11823: disassembly now shows argument counts on calls with keyword args.

5160 5161
- Issue #14711: os.stat_float_times() has been deprecated.

5162 5163
- LZMAFile now accepts the modes "rb"/"wb"/"ab" as synonyms of "r"/"w"/"a".

5164 5165
- The bz2 and lzma modules now each contain an open() function, allowing
  compressed files to readily be opened in text mode as well as binary mode.
5166

5167 5168
- BZ2File.__init__() and LZMAFile.__init__() now accept a file object as their
  first argument, rather than requiring a separate "fileobj" argument.
5169

5170 5171
- gzip.open() now accepts file objects as well as filenames.

5172 5173 5174 5175 5176
- Issue #14992: os.makedirs(path, exist_ok=True) would raise an OSError
  when the path existed and had the S_ISGID mode bit set when it was
  not explicitly asked for.  This is no longer an exception as mkdir
  cannot control if the OS sets that bit for it or not.

5177 5178 5179
- Issue #14989: Make the CGI enable option to http.server available via command
  line.

5180 5181
- Issue #14987: Add a missing import statement to inspect.

5182 5183 5184 5185
- Issue #1079: email.header.decode_header now correctly parses all the examples
  in RFC2047.  There is a necessary visible behavior change: the leading and/or
  trailing whitespace on ASCII parts is now preserved.

5186 5187
- Issue #14969: Better handling of exception chaining in contextlib.ExitStack

5188 5189 5190
- Issue #14963: Convert contextlib.ExitStack.__exit__ to use an iterative
  algorithm (Patch by Alon Horev)

5191 5192 5193
- Issue #14785: Add sys._debugmallocstats() to help debug low-level memory
  allocation issues

5194 5195 5196
- Issue #14443: Ensure that .py files are byte-compiled with the correct Python
  executable within bdist_rpm even on older versions of RPM

5197 5198 5199
C-API
-----

5200 5201 5202 5203 5204
- Issue #15146: Add PyType_FromSpecWithBases. Patch by Robin Schreiber.

- Issue #15042: Add PyState_AddModule and PyState_RemoveModule. Add version
  guard for Py_LIMITED_API additions. Patch by Robin Schreiber.

5205 5206 5207
- Issue #13783: Inadvertent additions to the public C API in the PEP 380
  implementation have either been removed or marked as private interfaces.

5208 5209
Extension Modules
-----------------
5210

5211
- Issue #15000: Support the "unique" x32 architecture in _posixsubprocess.c.
5212

5213 5214 5215 5216 5217 5218 5219 5220 5221
IDLE
----

- Issue #9803: Don't close IDLE on saving if breakpoint is open.
  Patch by Roger Serwy.

- Issue #14962: Update text coloring in IDLE shell window after changing
  options.  Patch by Roger Serwy.

5222 5223 5224
Documentation
-------------

5225 5226 5227 5228 5229 5230 5231
- Issue #15176: Clarified behavior, documentation, and implementation
  of os.listdir().

- Issue #14982: Document that pkgutil's iteration functions require the
  non-standard iter_modules() method to be defined by an importer (something
  the importlib importers do not define).

5232 5233 5234
- Issue #15081: Document PyState_FindModule.
  Patch by Robin Schreiber.

5235 5236
- Issue #14814: Added first draft of ipaddress module API reference

5237 5238 5239
Tests
-----

5240 5241 5242
- Issue #15187: Bugfix: remove temporary directories test_shutil was leaving
  behind.

5243 5244 5245 5246
- Issue #14769: test_capi now has SkipitemTest, which cleverly checks
  for "parity" between PyArg_ParseTuple() and the Python/getargs.c static
  function skipitem() for all possible "format units".

5247 5248 5249
- test_nntplib now tolerates being run from behind NNTP gateways that add
  "X-Antivirus" headers to articles

5250 5251 5252 5253
- Issue #15043: test_gdb is now skipped entirely if gdb security settings
  block loading of the gdb hooks

- Issue #14963: Add test cases for exception handling behaviour
5254
  in contextlib.ExitStack (Initial patch by Alon Horev)
5255

5256 5257 5258
Build
-----

5259 5260 5261 5262 5263 5264 5265 5266 5267 5268 5269 5270 5271 5272 5273
- Issue #13590: Improve support for OS X Xcode 4:
    * Try to avoid building Python or extension modules with problematic
      llvm-gcc compiler.
    * Since Xcode 4 removes ppc support, extension module builds now
      check for ppc compiler support and automatically remove ppc and
      ppc64 archs when not available.
    * Since Xcode 4 no longer install SDKs in default locations,
      extension module builds now revert to using installed headers
      and libs if the SDK used to build the interpreter is not
      available.
    * Update ./configure to use better defaults for universal builds;
      in particular, --enable-universalsdk=yes uses the Xcode default
      SDK and --with-universal-archs now defaults to "intel" if ppc
      not available.

5274 5275
- Issue #14225: Fix Unicode support for curses (#12567) on OS X

5276 5277 5278
- Issue #14928: Fix importlib bootstrap issues by using a custom executable
  (Modules/_freeze_importlib) to build Python/importlib.h.

Georg Brandl's avatar
Georg Brandl committed
5279

5280 5281 5282
What's New in Python 3.3.0 Alpha 4?
===================================

Georg Brandl's avatar
Georg Brandl committed
5283
*Release date: 31-May-2012*
5284 5285 5286 5287

Core and Builtins
-----------------

5288 5289 5290
- Issue #14835: Make plistlib output empty arrays & dicts like OS X.
  Patch by Sidney San Martín.

5291 5292 5293
- Issue #14744: Use the new _PyUnicodeWriter internal API to speed up
  str%args and str.format(args).

5294 5295
- Issue #14930: Make memoryview objects weakrefable.

5296 5297 5298
- Issue #14775: Fix a potential quadratic dict build-up due to the garbage
  collector repeatedly trying to untrack dicts.

5299 5300 5301
- Issue #14857: fix regression in references to PEP 3135 implicit __class__
  closure variable (Reopens issue #12370)

Vinay Sajip's avatar
Vinay Sajip committed
5302 5303
- Issue #14712 (PEP 405): Virtual environments. Implemented by Vinay Sajip.

5304 5305
- Issue #14660 (PEP 420): Namespace packages. Implemented by Eric Smith.

5306 5307 5308 5309
- Issue #14494: Fix __future__.py and its documentation to note that
  absolute imports are the default behavior in 3.0 instead of 2.7.
  Patch by Sven Marnach.

5310 5311 5312 5313
- Issue #9260: A finer-grained import lock.  Most of the import sequence
  now uses per-module locks rather than the global import lock, eliminating
  well-known issues with threads and imports.

5314 5315 5316
- Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs.
  Patch by Serhiy Storchaka.

Martin v. Löwis's avatar
Martin v. Löwis committed
5317 5318
- asdl_seq and asdl_int_seq are now Py_ssize_t sized.

5319 5320 5321
- Issue #14133 (PEP 415): Implement suppression of __context__ display with an
  attribute on BaseException. This replaces the original mechanism of PEP 409.

5322 5323 5324
- Issue #14417: Mutating a dict during lookup now restarts the lookup instead
  of raising a RuntimeError (undoes issue #14205).

5325 5326 5327
- Issue #14738: Speed-up UTF-8 decoding on non-ASCII data.  Patch by Serhiy
  Storchaka.

5328 5329 5330
- Issue #14700: Fix two broken and undefined-behaviour-inducing overflow checks
  in old-style string formatting.

5331 5332 5333
Library
-------

5334 5335 5336
- Issue #14690: Use monotonic clock instead of system clock in the sched,
  subprocess and trace modules.

5337 5338 5339
- Issue #14443: Tell rpmbuild to use the correct version of Python in
  bdist_rpm. Initial patch by Ross Lagerwall.

5340 5341 5342 5343 5344 5345 5346
- Issue #12515: email now registers a defect if it gets to EOF while parsing
  a MIME part without seeing the closing MIME boundary.

- Issue #1672568: email now always decodes base64 payloads, adding padding and
  ignoring non-base64-alphabet characters if needed, and registering defects
  for any such problems.

5347 5348 5349 5350
- Issue #14925: email now registers a defect when the parser decides that there
  is a missing header/body separator line.  MalformedHeaderDefect, which the
  existing code would never actually generate, is deprecated.

5351 5352
- Issue #10365: File open dialog now works instead of crashing even when
  the parent window is closed before the dialog. Patch by Roger Serwy.
5353

5354 5355 5356
- Issue #8739: Updated smtpd to support RFC 5321, and added support for the
  RFC 1870 SIZE extension.

5357 5358 5359
- Issue #665194: Added a localtime function to email.utils to provide an
  aware local datetime for use in setting Date headers.

5360 5361 5362 5363 5364 5365 5366 5367
- Issue #12586: Added new provisional policies that implement convenient
  unicode support for email headers.  See What's New for details.

- Issue #14731: Refactored email Policy framework to support full backward
  compatibility with Python 3.2 by default yet allow for the introduction of
  new features through new policies.  Note that Policy.must_be_7bit is renamed
  to cte_type.

5368 5369
- Issue #14876: Use user-selected font for highlight configuration.

5370 5371 5372
- Issue #14920: Fix the help(urllib.parse) failure on locale C on terminals.
  Have ascii characters in help.

5373 5374 5375
- Issue #14548: Make multiprocessing finalizers check pid before
  running to cope with possibility of gc running just after fork.

5376 5377 5378
- Issue #14036: Add an additional check to validate that port in urlparse does
  not go in illegal range and returns None.

5379 5380
- Issue #14862: Add missing names to os.__all__

5381 5382
- Issue #14875: Use float('inf') instead of float('1e66666') in the json module.

5383 5384
- Issue #13585: Added contextlib.ExitStack

5385 5386
- PEP 3144, Issue #14814: Added the ipaddress module

Senthil Kumaran's avatar
Senthil Kumaran committed
5387 5388 5389
- Issue #14426: Correct the Date format in Expires attribute of Set-Cookie
  Header in Cookie.py.

5390 5391 5392 5393
- Issue #14588: The types module now provide new_class() and prepare_class()
  functions to support PEP 3115 compliant dynamic class creation. Patch by
  Daniel Urban and Nick Coghlan.

5394 5395 5396
- Issue #13152: Allow to specify a custom tabsize for expanding tabs in
  textwrap. Patch by John Feuerstein.

5397 5398 5399
- Issue #14721: Send the correct 'Content-length: 0' header when the body is an
  empty string ''. Initial Patch contributed by Arve Knudsen.

5400 5401 5402
- Issue #14072: Fix parsing of 'tel' URIs in urlparse by making the check for
  ports stricter.

5403 5404 5405
- Issue #9374: Generic parsing of query and fragment portions of url for any
  scheme. Supported both by RFC3986 and RFC2396.

5406 5407 5408 5409
- Issue #14798: Fix the functions in pyclbr to raise an ImportError
  when the first part of a dotted name is not a package. Patch by
  Xavier de Gaye.

5410 5411 5412 5413
- Issue #12098: multiprocessing on Windows now starts child processes
  using the same sys.flags as the current process.  Initial patch by
  Sergey Mezentsev.

5414 5415 5416
- Issue #13031: Small speed-up for tarfile when unzipping tarfiles.
  Patch by Justin Peel.

5417 5418 5419
- Issue #14780: urllib.request.urlopen() now has a ``cadefault`` argument
  to use the default certificate store.  Initial patch by James Oakley.

5420 5421 5422
- Issue #14829: Fix bisect and range() indexing with large indices
  (>= 2 ** 32) under 64-bit Windows.

5423 5424 5425
- Issue #14732: The _csv module now uses PEP 3121 module initialization.
  Patch by Robin Schreiber.

5426 5427 5428
- Issue #14809: Add HTTP status codes introduced by RFC 6585 to http.server
  and http.client. Patch by EungJun Yi.

Ned Deily's avatar
Ned Deily committed
5429 5430 5431 5432 5433
- Issue #14777: tkinter may return undecoded UTF-8 bytes as a string when
  accessing the Tk clipboard.  Modify clipboad_get() to first request type
  UTF8_STRING when no specific type is requested in an X11 windowing
  environment, falling back to the current default type STRING if that fails.
  Original patch by Thomas Kluyver.
5434

5435
- Issue #14773: Fix os.fwalk() failing on dangling symlinks.
5436

5437 5438 5439
- Issue #12541: Be lenient with quotes around Realm field of HTTP Basic
  Authentation in urllib2.

5440
- Issue #14807: move undocumented tarfile.filemode() to stat.filemode() and add
5441 5442
  doc entry. Add tarfile.filemode alias with deprecation warning.

5443 5444
- Issue #13815: TarFile.extractfile() now returns io.BufferedReader objects.

5445
- Issue #14532: Add a secure_compare() helper to the hmac module, to mitigate
5446
  timing attacks. Patch by Jon Oberheide.
5447

5448 5449
- Add importlib.util.resolve_name().

5450 5451 5452
- Issue #14366: Support lzma compression in zip files.
  Patch by Serhiy Storchaka.

5453 5454
- Issue #13959: Introduce importlib.find_loader() and document
  imp.find_module/load_module as deprecated.
5455

5456 5457 5458
- Issue #14082: shutil.copy2() now copies extended attributes, if possible.
  Patch by Hynek Schlawack.

Brett Cannon's avatar
Brett Cannon committed
5459 5460 5461 5462 5463
- Issue #13959: Make importlib.abc.FileLoader.load_module()/get_filename() and
  importlib.machinery.ExtensionFileLoader.load_module() have their single
  argument be optional. Allows for the replacement (and thus deprecation) of
  imp.load_source()/load_package()/load_compiled().

5464 5465 5466 5467 5468
- Issue #13959: imp.get_suffixes() has been deprecated in favour of the new
  attributes on importlib.machinery: SOURCE_SUFFIXES, DEBUG_BYTECODE_SUFFIXES,
  OPTIMIZED_BYTECODE_SUFFIXES, BYTECODE_SUFFIXES, and EXTENSION_SUFFIXES. This
  led to an indirect deprecation of inspect.getmoduleinfo().

5469 5470 5471
- Issue #14662: Prevent shutil failures on OS X when destination does not
  support chflag operations.  Patch by Hynek Schlawack.

5472 5473 5474
- Issue #14157: Fix time.strptime failing without a year on February 29th.
  Patch by Hynek Schlawack.

5475 5476 5477
- Issue #14753: Make multiprocessing's handling of negative timeouts
  the same as it was in Python 3.2.

5478 5479 5480
- Issue #14583: Fix importlib bug when a package's __init__.py would first
  import one of its modules then raise an error.

5481 5482
- Issue #14741: Fix missing support for Ellipsis ('...') in parser module.

5483 5484 5485
- Issue #14697: Fix missing support for set displays and set comprehensions in
  parser module.

5486 5487
- Issue #14701: Fix missing support for 'raise ... from' in parser module.

5488 5489 5490
- Add support for timeouts to the acquire() methods of
  multiprocessing's lock/semaphore/condition proxies.

5491 5492
- Issue #13989: Add support for text mode to gzip.open().

5493
- Issue #14127: The os.stat() result object now provides three additional
Georg Brandl's avatar
Georg Brandl committed
5494 5495 5496 5497
  fields: st_ctime_ns, st_mtime_ns, and st_atime_ns, providing those times as an
  integer with nanosecond resolution.  The functions os.utime(), os.lutimes(),
  and os.futimes() now accept a new parameter, ns, which accepts mtime and atime
  as integers with nanosecond resolution.
5498

Georg Brandl's avatar
Georg Brandl committed
5499 5500
- Issue #14127 and #10148: shutil.copystat now preserves exact mtime and atime
  on filesystems providing nanosecond resolution.
5501

5502 5503 5504 5505 5506 5507 5508 5509 5510 5511 5512 5513 5514 5515 5516
IDLE
----

- Issue #14958: Change IDLE systax highlighting to recognize all string and
  byte literals supported in Python 3.3.

- Issue #10997: Prevent a duplicate entry in IDLE's "Recent Files" menu.

- Issue #14929: Stop IDLE 3.x from closing on Unicode decode errors when
  grepping. Patch by Roger Serwy.

- Issue #12510: Attempting to get invalid tooltip no longer closes IDLE.
  Other tooltipss have been corrected or improved and the number of tests
  has been tripled. Original patch by Roger Serwy.

5517 5518 5519
Tools/Demos
-----------

5520
- Issue #14695: Bring Tools/parser/unparse.py support up to date with
5521 5522
  the Python 3.3 Grammar.

5523 5524 5525
Build
-----

Petri Lehtinen's avatar
Petri Lehtinen committed
5526 5527
- Issue #14472: Update .gitignore. Patch by Matej Cepl.

Martin v. Löwis's avatar
Martin v. Löwis committed
5528 5529
- Upgrade Windows library versions: bzip 1.0.6, OpenSSL 1.0.1c.

5530 5531 5532
- Issue #14693: Under non-Windows platforms, hashlib's fallback modules are
  always compiled, even if OpenSSL is present at build time.

5533 5534
- Issue #13210: Windows build now uses VS2010, ported from VS2008.

5535 5536 5537 5538 5539 5540 5541
C-API
-----

- Issue #14705: The PyArg_Parse() family of functions now support the 'p' format
  unit, which accepts a "boolean predicate" argument.  It converts any Python
  value into an integer--0 if it is "false", and 1 otherwise.

5542 5543 5544
Documentation
-------------

5545 5546 5547
- Issue #14863: Update the documentation of os.fdopen() to reflect the
  fact that it's only a thin wrapper around open() anymore.

5548 5549 5550
- Issue #14588: The language reference now accurately documents the Python 3
  class definition process. Patch by Nick Coghlan.

Brian Curtin's avatar
Brian Curtin committed
5551 5552
- Issue #14943: Correct a default argument value for winreg.OpenKey
  and correctly list the argument names in the function's explanation.
5553

Georg Brandl's avatar
Georg Brandl committed
5554

Georg Brandl's avatar
Georg Brandl committed
5555 5556 5557
What's New in Python 3.3.0 Alpha 3?
===================================

Georg Brandl's avatar
Georg Brandl committed
5558
*Release date: 01-May-2012*
Georg Brandl's avatar
Georg Brandl committed
5559 5560 5561 5562

Core and Builtins
-----------------

5563 5564
- Issue #14699: Fix calling the classmethod descriptor directly.

Georg Brandl's avatar
Georg Brandl committed
5565
- Issue #14433: Prevent msvcrt crash in interactive prompt when stdin is closed.
Georg Brandl's avatar
Georg Brandl committed
5566

Georg Brandl's avatar
Georg Brandl committed
5567 5568
- Issue #14521: Make result of float('nan') and float('-nan') more consistent
  across platforms.
5569

5570 5571
- Issue #14646: __import__() sets __loader__ if the loader did not.

5572 5573 5574
- Issue #14605: No longer have implicit entries in sys.meta_path. If
  sys.meta_path is found to be empty, raise ImportWarning.

5575
- Issue #14605: No longer have implicit entries in sys.path_hooks. If
5576 5577 5578
  sys.path_hooks is found to be empty, a warning will be raised. None is now
  inserted into sys.path_importer_cache if no finder was discovered. This also
  means imp.NullImporter is no longer implicitly used.
5579

5580 5581 5582 5583
- Issue #13903: Implement PEP 412. Individual dictionary instances can now share
  their keys with other dictionaries. Classes take advantage of this to share
  their instance dictionary keys for improved memory and performance.

5584 5585 5586 5587 5588 5589
- Issue #11603 (again): Setting __repr__ to __str__ now raises a RuntimeError
  when repr() or str() is called on such an object.

- Issue #14658: Fix binding a special method to a builtin implementation of a
  special method with a different name.

5590 5591 5592
- Issue #14630: Fix a memory access bug for instances of a subclass of int
  with value 0.

5593 5594 5595
- Issue #14339: Speed improvements to bin, oct and hex functions.  Patch by
  Serhiy Storchaka.

5596 5597 5598 5599 5600
- Issue #14385: It is now possible to use a custom type for the __builtins__
  namespace, instead of a dict. It can be used for sandboxing for example.
  Raise also a NameError instead of ImportError if __build_class__ name if not
  found in __builtins__.

5601 5602 5603 5604
- Issue #12599: Be more strict in accepting None compared to a false-like
  object for importlib.util.module_for_loader and
  importlib.machinery.PathFinder.

5605 5606
- Issue #14612: Fix jumping around with blocks by setting f_lineno.

5607 5608 5609
- Issue #14592: Attempting a relative import w/o __package__ or __name__ set in
  globals raises a KeyError.

Benjamin Peterson's avatar
improve  
Benjamin Peterson committed
5610
- Issue #14607: Fix keyword-only arguments which started with ``__``.
5611

5612 5613 5614 5615
- Issue #10854: The ImportError raised when an extension module on Windows
  fails to import now uses the new path and name attributes from
  Issue #1559549.

5616 5617 5618 5619
- Issue #13889: Check and (if necessary) set FPU control word before calling
  any of the dtoa.c string <-> float conversion functions, on MSVC builds of
  Python.  This fixes issues when embedding Python in a Delphi app.

5620 5621 5622
- __import__() now matches PEP 328 and documentation by defaulting 'index' to 0
  instead of -1 and removing support for negative values.

5623 5624
- Issue #2377: Make importlib the implementation of __import__().

5625 5626 5627 5628
- Issue #1559549: ImportError now has 'name' and 'path' attributes that are set
  using keyword arguments to its constructor. They are currently not set by
  import as they are meant for use by importlib.

5629 5630 5631
- Issue #14474: Save and restore exception state in thread.start_new_thread()
  while writing error message if the thread leaves a unhandled exception.

5632 5633 5634
- Issue #13019: Fix potential reference leaks in bytearray.extend().  Patch
  by Suman Saha.

Georg Brandl's avatar
Georg Brandl committed
5635 5636 5637
Library
-------

5638
- Issue #14768: os.path.expanduser('~/a') doesn't works correctly when HOME is '/'.
5639

Georg Brandl's avatar
Georg Brandl committed
5640
- Issue #14371: Support bzip2 in zipfile module.  Patch by Serhiy Storchaka.
5641

5642 5643 5644
- Issue #13183: Fix pdb skipping frames after hitting a breakpoint and running
  step.  Patch by Xavier de Gaye.

5645 5646
- Issue #14696: Fix parser module to understand 'nonlocal' declarations.

5647 5648 5649
- Issue #10941: Fix imaplib.Internaldate2tuple to produce correct result near
  the DST transition.  Patch by Joe Peterson.

5650
- Issue #9154: Fix parser module to understand function annotations.
5651

5652 5653 5654
- Issue #6085: In http.server.py SimpleHTTPServer.address_string returns the
  client ip address instead client hostname. Patch by Charles-François Natali.

5655 5656 5657
- Issue #14309: Deprecate time.clock(), use time.perf_counter() or
  time.process_time() instead.

5658 5659 5660 5661
- Issue #14428: Implement the PEP 418. Add time.get_clock_info(),
  time.perf_counter() and time.process_time() functions, and rename
  time.steady() to time.monotonic().

5662 5663 5664
- Issue #14646: importlib.util.module_for_loader() now sets __loader__ and
  __package__ (when possible).

5665 5666 5667
- Issue #14664: It is now possible to use @unittest.skip{If,Unless} on a
  test class that doesn't inherit from TestCase (i.e. a mixin).

5668 5669 5670
- Issue #4892: multiprocessing Connections can now be transferred over
  multiprocessing Connections.  Patch by Richard Oudkerk (sbt).

5671 5672 5673
- Issue #14160: TarFile.extractfile() failed to resolve symbolic links when
  the links were not located in an archive subdirectory.

5674 5675 5676
- Issue #14638: pydoc now treats non-string __name__ values as if they
  were missing, instead of raising an error.

Senthil Kumaran's avatar
Senthil Kumaran committed
5677 5678 5679
- Issue #13684: Fix httplib tunnel issue of infinite loops for certain sites
  which send EOF without trailing \r\n.

5680
- Issue #14605: Add importlib.abc.FileLoader, importlib.machinery.(FileFinder,
5681
  SourceFileLoader, SourcelessFileLoader, ExtensionFileLoader).
5682

5683 5684 5685 5686 5687
- Issue #13959: imp.cache_from_source()/source_from_cache() now follow
  os.path.join()/split() semantics for path manipulation instead of its prior,
  custom semantics of caring the right-most path separator forward in path
  joining.

5688 5689
- Issue #2193: Allow ":" character in Cookie NAME values.

5690 5691 5692
- Issue #14629: tokenizer.detect_encoding will specify the filename in the
  SyntaxError exception if found at readline.__self__.name.

5693 5694 5695
- Issue #14629: Raise SyntaxError in tokenizer.detect_encoding if the
  first two lines have non-UTF-8 characters without an encoding declaration.

5696 5697 5698
- Issue #14308: Fix an exception when a "dummy" thread is in the threading
  module's active list after a fork().

5699 5700 5701 5702
- Issue #11750: The Windows API functions scattered in the _subprocess and
  _multiprocessing.win32 modules now live in a single module "_winapi".
  Patch by sbt.

5703 5704
- Issue #14087: multiprocessing: add Condition.wait_for(). Patch by sbt.

5705 5706 5707
- Issue #14538: HTMLParser can now parse correctly start tags that contain
  a bare '/'.

5708 5709
- Issue #14452: SysLogHandler no longer inserts a UTF-8 BOM into the message.

5710 5711
- Issue #14386: Expose the dict_proxy internal type as types.MappingProxyType.

5712 5713 5714
- Issue #13959: Make imp.reload() always use a module's __loader__ to perform
  the reload.

5715 5716 5717
- Issue #13959: Add imp.py and rename the built-in module to _imp, allowing for
  re-implementing parts of the module in pure Python.

5718 5719 5720
- Issue #13496: Fix potential overflow in bisect.bisect algorithm when applied
  to a collection of size > sys.maxsize / 2.

5721 5722 5723
- Have importlib take advantage of ImportError's new 'name' and 'path'
  attributes.

R David Murray's avatar
R David Murray committed
5724 5725
- Issue #14399: zipfile now recognizes that the archive has been modified even
  if only the comment is changed.  In addition, the TypeError that results from
Ezio Melotti's avatar
Ezio Melotti committed
5726
  trying to set a non-binary value as a comment is now raised at the time
R David Murray's avatar
R David Murray committed
5727
  the comment is set rather than at the time the zipfile is written.
5728

5729 5730 5731 5732
- trace.CoverageResults.is_ignored_filename() now ignores any name that starts
  with "<" and ends with ">" instead of special-casing "<string>" and
  "<doctest ".

5733 5734 5735
- Issue #12537: The mailbox module no longer depends on knowledge of internal
  implementation details of the email package Message object.

5736 5737 5738 5739
- Issue #7978: socketserver now restarts the select() call when EINTR is
  returned.  This avoids crashing the server loop when a signal is received.
  Patch by Jerzy Kozera.

5740 5741 5742
- Issue #14522: Avoid duplicating socket handles in multiprocessing.connection.
  Patch by sbt.

5743 5744
- Don't Py_DECREF NULL variable in io.IncrementalNewlineDecoder.

5745 5746
- Issue #3033: Add displayof parameter to tkinter font. Patch by Guilherme Polo.

5747 5748 5749 5750
- Issue #14482: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_UNIX type address under
  Windows.  Patch by Popa Claudiu.

5751 5752
- Issue #802310: Generate always unique tkinter font names if not directly passed.

Georg Brandl's avatar
Merge.  
Georg Brandl committed
5753 5754 5755 5756
- Issue #14151: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_PIPE type address under
  non-Windows platforms.  Patch by Popa Claudiu.

5757
- Issue #14493: Use gvfs-open or xdg-open in webbrowser.
5758

5759 5760 5761 5762 5763 5764
Build
-----

- "make touch" will now touch generated files that are checked into Mercurial,
  after a "hg update" which failed to bring the timestamps into the right order.

5765 5766 5767
Tests
-----

Nick Coghlan's avatar
Nick Coghlan committed
5768 5769 5770
- Issue #14026: In test_cmd_line_script, check that sys.argv is populated
  correctly for the various invocation approaches (Patch by Jason Yeo)

Nick Coghlan's avatar
Nick Coghlan committed
5771 5772 5773
- Issue #14032: Fix incorrect variable name in test_cmd_line_script debugging
  message (Patch by Jason Yeo)

5774 5775 5776
- Issue #14589: Update certificate chain for sha256.tbs-internet.com, fixing
  a test failure in test_ssl.

5777 5778 5779
- Issue #14355: Regrtest now supports the standard unittest test loading, and
  will use it if a test file contains no `test_main` method.

5780 5781 5782 5783 5784 5785 5786 5787 5788
IDLE
----

- Issue #8515: Set __file__ when run file in IDLE.
  Initial patch by Bruce Frederiksen.

- Issue #14496: Fix wrong name in idlelib/tabbedpages.py.
  Patch by Popa Claudiu.

5789 5790 5791
Tools / Demos
-------------

5792 5793 5794
- Issue #3561: The Windows installer now has an option, off by default, for
  placing the Python installation into the system "Path" environment variable.

5795 5796 5797
- Issue #13165: stringbench is now available in the Tools/stringbench folder.
  It used to live in its own SVN project.

5798 5799 5800 5801 5802 5803
C-API
-----

- Issue #14098: New functions PyErr_GetExcInfo and PyErr_SetExcInfo.
  Patch by Stefan Behnel.

Georg Brandl's avatar
Georg Brandl committed
5804

Georg Brandl's avatar
Georg Brandl committed
5805 5806 5807
What's New in Python 3.3.0 Alpha 2?
===================================

Georg Brandl's avatar
Georg Brandl committed
5808
*Release date: 01-Apr-2012*
Georg Brandl's avatar
Georg Brandl committed
5809 5810 5811 5812

Core and Builtins
-----------------

5813 5814 5815
- Issue #1683368: object.__new__ and object.__init__ raise a TypeError if they
  are passed arguments and their complementary method is not overridden.

5816 5817 5818
- Issue #14378: Fix compiling ast.ImportFrom nodes with a "__future__" string as
  the module name that was not interned.

5819 5820
- Issue #14331: Use significantly less stack space when importing modules by
  allocating path buffers on the heap instead of the stack.
5821

5822 5823 5824
- Issue #14334: Prevent in a segfault in type.__getattribute__ when it was not
  passed strings.

5825 5826 5827
- Issue #1469629: Allow cycles through an object's __dict__ slot to be
  collected. (For example if ``x.__dict__ is x``).

5828 5829 5830
- Issue #14205: dict lookup raises a RuntimeError if the dict is modified
  during a lookup.

5831 5832 5833
- Issue #14220: When a generator is delegating to another iterator with the
  yield from syntax, it needs to have its ``gi_running`` flag set to True.

5834 5835 5836
- Issue #14435: Remove dedicated block allocator from floatobject.c and rely
  on the PyObject_Malloc() api like all other objects.

5837 5838
- Issue #14471: Fix a possible buffer overrun in the winreg module.

5839 5840
- Issue #14288: Allow the serialization of builtin iterators

Georg Brandl's avatar
Georg Brandl committed
5841 5842 5843
Library
-------

5844 5845 5846
- Issue #14300: Under Windows, sockets created using socket.dup() now allow
  overlapped I/O.  Patch by sbt.

5847 5848 5849
- Issue #13872: socket.detach() now marks the socket closed (as mirrored
  in the socket repr()).  Patch by Matt Joiner.

5850 5851 5852
- Issue #14406: Fix a race condition when using ``concurrent.futures.wait(
  return_when=ALL_COMPLETED)``.  Patch by Matt Joiner.

Andrew Svetlov's avatar
Andrew Svetlov committed
5853
- Issue #5136: deprecate old, unused functions from tkinter.
5854

5855 5856 5857
- Issue #14416: syslog now defines the LOG_ODELAY and LOG_AUTHPRIV constants
  if they are defined in <syslog.h>.

5858 5859
- Issue #14295: Add unittest.mock

5860 5861 5862
- Issue #7652: Add --with-system-libmpdec option to configure for linking
  the _decimal module against an installed libmpdec.

5863 5864 5865
- Issue #14380: MIMEText now defaults to utf-8 when passed non-ASCII unicode
  with no charset specified.

5866 5867 5868 5869
- Issue #10340: asyncore - properly handle EINVAL in dispatcher constructor on
  OSX; avoid to call handle_connect in case of a disconnected socket which
  was not meant to connect.

5870 5871 5872 5873
- Issue #14204: The ssl module now has support for the Next Protocol
  Negotiation extension, if available in the underlying OpenSSL library.
  Patch by Colin Marc.

Georg Brandl's avatar
Georg Brandl committed
5874
- Issue #3035: Unused functions from tkinter are marked as pending deprecated.
5875

5876 5877 5878
- Issue #12757: Fix the skipping of doctests when python is run with -OO so
  that it works in unittest's verbose mode as well as non-verbose mode.

5879 5880
- Issue #7652: Integrate the decimal floating point libmpdec library to speed
  up the decimal module. Performance gains of the new C implementation are
5881
  between 10x and 100x, depending on the application.
5882

5883 5884 5885
- Issue #14269: SMTPD now conforms to the RFC and requires a HELO command
  before MAIL, RCPT, or DATA.

5886 5887 5888
- Issue #13694: asynchronous connect in asyncore.dispatcher does not set addr
  attribute.

5889 5890
- Issue #14344: fixed the repr of email.policy objects.

R David Murray's avatar
R David Murray committed
5891 5892 5893
- Issue #11686: Added missing entries to email package __all__ lists
  (mostly the new Bytes classes).

5894 5895 5896
- Issue #14335: multiprocessing's custom Pickler subclass now inherits from
  the C-accelerated implementation.  Patch by sbt.

5897 5898
- Issue #10484: Fix the CGIHTTPServer's PATH_INFO handling problem.

5899 5900
- Issue #11199: Fix the with urllib which hangs on particular ftp urls.

5901 5902
- Improve the memory utilization and speed of functools.lru_cache.

5903 5904 5905 5906
- Issue #14222: Use the new time.steady() function instead of time.time() for
  timeout in queue and threading modules to not be affected of system time
  update.

5907 5908
- Issue #13248: Remove lib2to3.pytree.Base.get_prefix/set_prefix.

5909 5910 5911 5912 5913
- Issue #14234: CVE-2012-0876: Randomize hashes of xml attributes in the hash
  table internal to the pyexpat module's copy of the expat library to avoid a
  denial of service due to hash collisions.  Patch by David Malcolm with some
  modifications by the expat project.

5914 5915 5916
- Issue #12818: format address no longer needlessly \ escapes ()s in names when
  the name ends up being quoted.

5917 5918 5919
- Issue #14062: BytesGenerator now correctly folds Header objects,
  including using linesep when folding.

5920 5921 5922 5923
- Issue #13839: When invoked on the command-line, the pstats module now
  accepts several filenames of profile stat files and merges them all.
  Patch by Matt Joiner.

5924 5925 5926
- Issue #14291: Email now defaults to utf-8 for non-ASCII unicode headers
  instead of raising an error.  This fixes a regression relative to 2.7.

5927 5928
- Issue #989712: Support using Tk without a mainloop.

5929 5930
- Issue #3835: Refuse to use unthreaded Tcl in threaded Python.

5931 5932
- Issue #2843: Add new Tk API to Tkinter.

5933 5934 5935
- Issue #14184: Increase the default stack size for secondary threads on
  Mac OS X to avoid interpreter crashes when using threads on 10.7.

5936 5937 5938 5939
- Issue #14180: datetime.date.fromtimestamp(),
  datetime.datetime.fromtimestamp() and datetime.datetime.utcfromtimestamp()
  now raise an OSError instead of ValueError if localtime() or gmtime() failed.

5940 5941 5942 5943 5944 5945 5946 5947 5948
- Issue #14180: time.ctime(), gmtime(), time.localtime(),
  datetime.date.fromtimestamp(), datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now raises an OverflowError, instead of
  a ValueError, if the timestamp does not fit in time_t.

- Issue #14180: datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now round microseconds towards zero
  instead of rounding to nearest with ties going away from zero.

5949 5950
- Issue #10543: Fix unittest test discovery with Jython bytecode files.

5951 5952 5953 5954
- Issue #1178863: Separate initialisation from setting when initializing
  Tkinter.Variables; harmonize exceptions to ValueError; only delete variables
  that have not been deleted; assert that variable names are strings.

5955 5956 5957
- Issue #14104: Implement time.monotonic() on Mac OS X, patch written by
  Nicholas Riley.

5958 5959
- Issue #13394: the aifc module now uses warnings.warn() to signal warnings.

5960 5961 5962
- Issue #14252: Fix subprocess.Popen.terminate() to not raise an error under
  Windows when the child process has already exited.

5963 5964 5965 5966
- Issue #14223: curses.addch() is no more limited to the range 0-255 when the
  Python curses is not linked to libncursesw. It was a regression introduced
  in Python 3.3a1.

5967
- Issue #14168: Check for presence of Element._attrs in minidom before
5968 5969
  accessing it.

5970 5971 5972 5973
- Issue #12328: Fix multiprocessing's use of overlapped I/O on Windows.
  Also, add a multiprocessing.connection.wait(rlist, timeout=None) function
  for polling multiple objects at once.  Patch by sbt.

5974 5975 5976 5977
- Issue #14007: Accept incomplete TreeBuilder objects (missing start, end,
  data or close method) for the Python implementation as well.
  Drop the no-op TreeBuilder().xml() method from the C implementation.

5978 5979 5980
- Issue #14210: pdb now has tab-completion not only for command names, but
  also for their arguments, wherever possible.

5981 5982 5983
- Issue #14310: Sockets can now be with other processes on Windows using
  the api socket.socket.share() and socket.fromshare().

5984 5985 5986
- Issue #10576: The gc module now has a 'callbacks' member that will get
  called when garbage collection takes place.

5987 5988 5989
Build
-----

5990 5991
- Issue #14557: Fix extensions build on HP-UX. Patch by Adi Roiban.

5992 5993
- Issue #14387: Do not include accu.h from Python.h.

5994 5995 5996
- Issue #14359: Only use O_CLOEXEC in _posixmodule.c if it is defined.
  Based on patch from Hervé Coatanhay.

5997
- Issue #14321: Do not run pgen during the build if files are up to date.
5998

5999 6000 6001 6002 6003
Documentation
-------------

- Issue #14034: added the argparse tutorial.

6004 6005
- Issue #14324: Fix configure tests for cross builds.

6006
- Issue #14327: Call AC_CANONICAL_HOST in configure.ac and check in
6007
  config.{guess,sub}. Don't use uname calls for cross builds.
6008

Benjamin Peterson's avatar
Benjamin Peterson committed
6009 6010 6011
Extension Modules
-----------------

6012 6013 6014
- Issue #9041: An issue in ctypes.c_longdouble, ctypes.c_double, and
  ctypes.c_float that caused an incorrect exception to be returned in the
  case of overflow has been fixed.
6015

Benjamin Peterson's avatar
Benjamin Peterson committed
6016 6017 6018
- Issue #14212: The re module didn't retain a reference to buffers it was
  scanning, resulting in segfaults.

6019 6020 6021
- Issue #14259: The finditer() method of re objects did not take any
  keyword arguments, contrary to the documentation.

6022 6023
- Issue #10142: Support for SEEK_HOLE/SEEK_DATA (for example, under ZFS).

6024 6025 6026
Tests
-----

6027 6028
- Issue #14442: Add missing errno import in test_smtplib.

6029 6030
- Issue #8315: (partial fix) python -m unittest test.test_email now works.

Georg Brandl's avatar
Georg Brandl committed
6031

Georg Brandl's avatar
Georg Brandl committed
6032 6033
What's New in Python 3.3.0 Alpha 1?
===================================
Georg Brandl's avatar
Georg Brandl committed
6034

Georg Brandl's avatar
Georg Brandl committed
6035
*Release date: 05-Mar-2012*
Georg Brandl's avatar
Georg Brandl committed
6036

6037 6038 6039
Core and Builtins
-----------------

6040 6041 6042
- Issue #14172: Fix reference leak when marshalling a buffer-like object
  (other than a bytes object).

6043 6044 6045
- Issue #13521: dict.setdefault() now does only one lookup for the given key,
  making it "atomic" for many purposes.  Patch by Filip Gruszczyński.

6046 6047 6048 6049
- PEP 409, Issue #6210: "raise X from None" is now supported as a means of
  suppressing the display of the chained exception context. The chained
  context still remains available as the __context__ attribute.

6050 6051 6052 6053 6054 6055 6056 6057 6058 6059 6060 6061 6062 6063 6064 6065 6066
- Issue #10181: New memoryview implementation fixes multiple ownership
  and lifetime issues of dynamically allocated Py_buffer members (#9990)
  as well as crashes (#8305, #7433). Many new features have been added
  (See whatsnew/3.3), and the documentation has been updated extensively.
  The ndarray test object from _testbuffer.c implements all aspects of
  PEP-3118, so further development towards the complete implementation
  of the PEP can proceed in a test-driven manner.

  Thanks to Nick Coghlan, Antoine Pitrou and Pauli Virtanen for review
  and many ideas.

- Issue #12834: Fix incorrect results of memoryview.tobytes() for
  non-contiguous arrays.

- Issue #5231: Introduce memoryview.cast() method that allows changing
  format and shape without making a copy of the underlying memory.

6067 6068 6069
- Issue #14084: Fix a file descriptor leak when importing a module with a
  bad encoding.

Benjamin Peterson's avatar
Benjamin Peterson committed
6070 6071
- Upgrade Unicode data to Unicode 6.1.

6072 6073 6074
- Issue #14040: Remove rarely used file name suffixes for C extensions
  (under POSIX mainly).

6075 6076 6077
- Issue #14051: Allow arbitrary attributes to be set of classmethod and
  staticmethod.

6078 6079 6080
- Issue #13703: oCERT-2011-003: Randomize hashes of str and bytes to protect
  against denial of service attacks due to hash collisions within the dict and
  set types.  Patch by David Malcolm, based on work by Victor Stinner.
6081

6082 6083 6084
- Issue #13020: Fix a reference leak when allocating a structsequence object
  fails.  Patch by Suman Saha.

6085 6086
- Issue #13908: Ready types returned from PyType_FromSpec.

6087 6088 6089
- Issue #11235: Fix OverflowError when trying to import a source file whose
  modification time doesn't fit in a 32-bit timestamp.

6090 6091 6092
- Issue #12705: A SyntaxError exception is now raised when attempting to
  compile multiple statements as a single interactive statement.

6093 6094 6095
- Fix the builtin module initialization code to store the init function for
  future reinitialization.

6096 6097 6098 6099 6100
- Issue #8052: The posix subprocess module would take a long time closing
  all possible file descriptors in the child process rather than just open
  file descriptors.  It now closes only the open fds if possible for the
  default close_fds=True behavior.

6101 6102 6103
- Issue #13629: Renumber the tokens in token.h so that they match the indexes
  into _PyParser_TokenNames.

6104 6105
- Issue #13752: Add a casefold() method to str.

6106 6107 6108
- Issue #13761: Add a "flush" keyword argument to the print() function,
  used to ensure flushing the output stream.

6109 6110 6111 6112
- Issue #13645: pyc files now contain the size of the corresponding source
  code, to avoid timestamp collisions (especially on filesystems with a low
  timestamp resolution) when checking for freshness of the bytecode.

6113 6114 6115 6116
- PEP 380, Issue #11682: Add "yield from <x>" to support easy delegation to
  subgenerators (initial patch by Greg Ewing, integration into 3.3 by
  Renaud Blanch, Ryan Kelly, Zbigniew Jędrzejewski-Szmek and Nick Coghlan)

6117 6118 6119
- Issue #13748: Raw bytes literals can now be written with the ``rb`` prefix
  as well as ``br``.

6120 6121
- Issue #12736: Use full unicode case mappings for upper, lower, and title case.

6122 6123
- Issue #12760: Add a create mode to open(). Patch by David Townshend.

6124 6125
- Issue #13738: Simplify implementation of bytes.lower() and bytes.upper().

6126 6127 6128
- Issue #13577: Built-in methods and functions now have a __qualname__.
  Patch by sbt.

6129 6130 6131
- Issue #6695: Full garbage collection runs now clear the freelist of set
  objects.  Initial patch by Matthias Troffaes.

6132 6133 6134
- Fix OSError.__init__ and OSError.__new__ so that each of them can be
  overriden and take additional arguments (followup to issue #12555).

6135 6136 6137 6138
- Fix the fix for issue #12149: it was incorrect, although it had the side
  effect of appearing to resolve the issue.  Thanks to Mark Shannon for
  noticing.

6139 6140 6141
- Issue #13505: Pickle bytes objects in a way that is compatible with
  Python 2 when using protocols <= 2.

6142 6143 6144
- Issue #11147: Fix an unused argument in _Py_ANNOTATE_MEMORY_ORDER.  (Fix
  given by Campbell Barton).

6145 6146 6147 6148
- Issue #13503: Use a more efficient reduction format for bytearrays with
  pickle protocol >= 3.  The old reduction format is kept with older protocols
  in order to allow unpickling under Python 2.  Patch by Irmen de Jong.

6149 6150 6151 6152
- Issue #7111: Python can now be run without a stdin, stdout or stderr
  stream.  It was already the case with Python 2.  However, the corresponding
  sys module entries are now set to None (instead of an unusable file object).

6153 6154 6155 6156
- Issue #11849: Ensure that free()d memory arenas are really released
  on POSIX systems supporting anonymous memory mappings.  Patch by
  Charles-François Natali.

6157 6158
- PEP 3155 / issue #13448: Qualified name for classes and functions.

6159 6160 6161
- Issue #13436: Fix a bogus error message when an AST object was passed
  an invalid integer value.

6162 6163 6164
- Issue #13411: memoryview objects are now hashable when the underlying
  object is hashable.

6165 6166 6167 6168
- Issue #13338: Handle all enumerations in _Py_ANNOTATE_MEMORY_ORDER
  to allow compiling extension modules with -Wswitch-enum on gcc.
  Initial patch by Floris Bruynooghe.

6169 6170 6171
- Issue #10227: Add an allocation cache for a single slice object.  Patch by
  Stefan Behnel.

6172 6173 6174
- Issue #13393: BufferedReader.read1() now asks the full requested size to
  the raw stream instead of limiting itself to the buffer size.

6175 6176
- Issue #13392: Writing a pyc file should now be atomic under Windows as well.

6177 6178 6179
- Issue #13333: The UTF-7 decoder now accepts lone surrogates (the encoder
  already accepts them).

6180 6181 6182 6183
- Issue #13389: Full garbage collection passes now clear the freelists for
  list and dict objects.  They already cleared other freelists in the
  interpreter.

6184
- Issue #13327: Remove the need for an explicit None as the second argument
Brian Curtin's avatar
Brian Curtin committed
6185 6186 6187
  to os.utime, os.lutimes, os.futimes, os.futimens, os.futimesat, in
  order to update to the current time. Also added keyword argument
  handling to os.utimensat in order to remove the need for explicit None.
6188

6189 6190 6191
- Issue #13350: Simplify some C code by replacing most usages of
  PyUnicode_Format by PyUnicode_FromFormat.

6192 6193 6194
- Issue #13342: input() used to ignore sys.stdin's and sys.stdout's unicode
  error handler in interactive mode (when calling into PyOS_Readline()).

6195 6196
- Issue #9896: Add start, stop, and step attributes to range objects.

6197
- Issue #13343: Fix a SystemError when a lambda expression uses a global
Georg Brandl's avatar
Georg Brandl committed
6198 6199
  variable in the default value of a keyword-only argument: ``lambda *,
  arg=GLOBAL_NAME: None``
6200

6201 6202 6203
- Issue #12797: Added custom opener parameter to builtin open() and
  FileIO.open().

6204 6205 6206
- Issue #10519: Avoid unnecessary recursive function calls in
  setobject.c.

6207 6208
- Issue #10363: Deallocate global locks in Py_Finalize().

6209 6210 6211
- Issue #13018: Fix reference leaks in error paths in dictobject.c.
  Patch by Suman Saha.

6212 6213 6214 6215
- Issue #13201: Define '==' and '!=' to compare range objects based on
  the sequence of values they define (instead of comparing based on
  object identity).

6216 6217 6218 6219
- Issue #1294232: In a few cases involving metaclass inheritance, the
  interpreter would sometimes invoke the wrong metaclass when building a new
  class object. These cases now behave correctly. Patch by Daniel Urban.

6220
- Issue #12753: Add support for Unicode name aliases and named sequences.
Georg Brandl's avatar
Georg Brandl committed
6221 6222
  Both ``unicodedata.lookup()`` and '\N{...}' now resolve aliases,
  and ``unicodedata.lookup()`` resolves named sequences too.
6223

6224 6225 6226 6227
- Issue #12170: The count(), find(), rfind(), index() and rindex() methods
  of bytes and bytearray objects now accept an integer between 0 and 255
  as their first argument.  Patch by Petri Lehtinen.

6228 6229 6230
- Issue #12604: VTRACE macro expanded to no-op in _sre.c to avoid compiler
  warnings. Patch by Josh Triplett and Petri Lehtinen.

6231 6232 6233 6234
- Issue #12281: Rewrite the MBCS codec to handle correctly replace and ignore
  error handlers on all Windows versions. The MBCS codec is now supporting all
  error handlers, instead of only replace to encode and ignore to decode.

6235 6236 6237 6238
- Issue #13188: When called without an explicit traceback argument,
  generator.throw() now gets the traceback from the passed exception's
  ``__traceback__`` attribute.  Patch by Petri Lehtinen.

6239 6240
- Issue #13146: Writing a pyc file is now atomic under POSIX.

6241 6242 6243 6244
- Issue #7833: Extension modules built using distutils on Windows will no
  longer include a "manifest" to prevent them failing at import time in some
  embedded situations.

6245 6246
- PEP 3151 / issue #12555: reworking the OS and IO exception hierarchy.

6247
- Add internal API for static strings (_Py_identifier et al.).
6248

6249 6250 6251 6252
- Issue #13063: the Windows error ERROR_NO_DATA (numbered 232 and described
  as "The pipe is being closed") is now mapped to POSIX errno EPIPE
  (previously EINVAL).

6253 6254 6255
- Issue #12911: Fix memory consumption when calculating the repr() of huge
  tuples or lists.

Martin v. Löwis's avatar
Martin v. Löwis committed
6256 6257
- PEP 393: flexible string representation. Thanks to Torsten Becker for the
  initial implementation, and Victor Stinner for various bug fixes.
Martin v. Löwis's avatar
Martin v. Löwis committed
6258

6259 6260 6261
- Issue #14081: The 'sep' and 'maxsplit' parameter to str.split, bytes.split,
  and bytearray.split may now be passed as keyword arguments.

6262 6263 6264 6265
- Issue #13012: The 'keepends' parameter to str.splitlines may now be passed
  as a keyword argument:  "my_string.splitlines(keepends=True)".  The same
  change also applies to bytes.splitlines and bytearray.splitlines.

6266 6267 6268 6269
- Issue #7732: Don't open a directory as a file anymore while importing a
  module. Ignore the direcotry if its name matchs the module name (e.g.
  "__init__.py") and raise a ImportError instead.

6270 6271 6272
- Issue #13021: Missing decref on an error path.  Thanks to Suman Saha for
  finding the bug and providing a patch.

6273 6274 6275
- Issue #12973: Fix overflow checks that relied on undefined behaviour in
  list_repeat (listobject.c) and islice_next (itertoolsmodule.c).  These bugs
  caused test failures with recent versions of Clang.
6276

6277 6278 6279
- Issue #12904: os.utime, os.futimes, os.lutimes, and os.futimesat now write
  atime and mtime with nanosecond precision on modern POSIX platforms.

6280 6281 6282
- Issue #12802: the Windows error ERROR_DIRECTORY (numbered 267) is now
  mapped to POSIX errno ENOTDIR (previously EINVAL).

6283 6284 6285
- Issue #9200: The str.is* methods now work with strings that contain non-BMP
  characters even in narrow Unicode builds.

6286 6287 6288
- Issue #12791: Break reference cycles early when a generator exits with
  an exception.

6289 6290
- Issue #12773: Make __doc__ mutable on user-defined classes.

6291
- Issue #12766: Raise a ValueError when creating a class with a class variable
6292 6293
  that conflicts with a name in __slots__.

6294 6295 6296
- Issue #12266: Fix str.capitalize() to correctly uppercase/lowercase
  titlecased and cased non-letter characters.

6297 6298 6299
- Issue #12732: In narrow unicode builds, allow Unicode identifiers which fall
  outside the BMP.

6300 6301
- Issue #12575: Validate user-generated AST before it is compiled.

6302 6303
- Make type(None), type(Ellipsis), and type(NotImplemented) callable. They
  return the respective singleton instances.
6304

Benjamin Peterson's avatar
Benjamin Peterson committed
6305
- Forbid summing bytes with sum().
6306

6307 6308 6309
- Verify the types of AST strings and identifiers provided by the user before
  compiling them.

6310 6311 6312 6313
- Issue #12647: The None object now has a __bool__() method that returns False.
  Formerly, bool(None) returned False only because of special case logic
  in PyObject_IsTrue().

6314 6315 6316 6317
- Issue #12579: str.format_map() now raises a ValueError if used on a
  format string that contains positional fields. Initial patch by
  Julian Berman.

6318 6319
- Issue #10271: Allow warnings.showwarning() be any callable.

6320 6321
- Issue #11627: Fix segfault when __new__ on a exception returns a
  non-exception class.
6322

Georg Brandl's avatar
Georg Brandl committed
6323
- Issue #12149: Update the method cache after a type's dictionary gets
6324 6325 6326 6327 6328
  cleared by the garbage collector.  This fixes a segfault when an instance
  and its type get caught in a reference cycle, and the instance's
  deallocator calls one of the methods on the type (e.g. when subclassing
  IOBase).  Diagnosis and patch by Davide Rizzo.

6329 6330
- Issue #9611, #9015: FileIO.read() clamps the length to INT_MAX on Windows.

6331 6332 6333
- Issue #9642: Uniformize the tests on the availability of the mbcs codec, add
  a new HAVE_MBCS define.

6334 6335 6336 6337 6338
- Issue #9642: Fix filesystem encoding initialization: use the ANSI code page
  on Windows if the mbcs codec is not available, and fail with a fatal error if
  we cannot get the locale encoding (if nl_langinfo(CODESET) is not available)
  instead of using UTF-8.

6339 6340 6341
- When a generator yields, do not retain the caller's exception state on the
  generator.

6342
- Issue #12475: Prevent generators from leaking their exception state into the
Benjamin Peterson's avatar
add '  
Benjamin Peterson committed
6343
  caller's frame as they return for the last time.
6344

6345 6346 6347
- Issue #12291: You can now load multiple marshalled objects from a stream,
  with other data interleaved between marshalled objects.

6348 6349 6350 6351
- Issue #12356: When required positional or keyword-only arguments are not
  given, produce a informative error message which includes the name(s) of the
  missing arguments.

6352
- Issue #12370: Fix super with no arguments when __class__ is overriden in the
6353 6354
  class body.

6355 6356 6357
- Issue #12084: os.stat on Windows now works properly with relative symbolic
  links when called from any directory.

6358 6359 6360
- Loosen type restrictions on the __dir__ method. __dir__ can now return any
  sequence, which will be converted to a list and sorted by dir().

6361 6362 6363
- Issue #12265: Make error messages produced by passing an invalid set of
  arguments to a function more informative.

Benjamin Peterson's avatar
Benjamin Peterson committed
6364 6365 6366
- Issue #12225: Still allow Python to build if Python is not in its hg repo or
  mercurial is not installed.

6367
- Issue #1195: my_fgets() now always clears errors before calling fgets(). Fix
6368 6369 6370
  the following case: sys.stdin.read() stopped with CTRL+d (end of file),
  raw_input() interrupted by CTRL+c.

6371 6372
- Issue #12216: Allow unexpected EOF errors to happen on any line of the file.

6373 6374 6375
- Issue #12199: The TryExcept and TryFinally and AST nodes have been unified
  into a Try node.

6376 6377 6378 6379 6380
- Issue #9670: Increase the default stack size for secondary threads on
  Mac OS X and FreeBSD to reduce the chances of a crash instead of a
  "maximum recursion depth" RuntimeError exception.
  (patch by Ronald Oussoren)

6381 6382 6383
- Issue #12106: The use of the multiple-with shorthand syntax is now reflected
  in the AST.

6384 6385 6386
- Issue #12190: Try to use the same filename object when compiling unmarshalling
  a code objects in the same file.

6387 6388 6389
- Issue #12166: Move implementations of dir() specialized for various types into
  the __dir__() methods of those types.

6390
- Issue #5715: In socketserver, close the server socket in the child process.
6391

Benjamin Peterson's avatar
Benjamin Peterson committed
6392 6393 6394
- Correct lookup of __dir__ on objects. Among other things, this causes errors
  besides AttributeError found on lookup to be propagated.

6395 6396 6397
- Issue #12060: Use sig_atomic_t type and volatile keyword in the signal
  module. Patch written by Charles-François Natali.

6398 6399
- Issue #1746656: Added the if_nameindex, if_indextoname, if_nametoindex
  methods to the socket module.
6400

6401 6402 6403 6404
- Issue #12044: Fixed subprocess.Popen when used as a context manager to
  wait for the process to end when exiting the context to avoid unintentionally
  leaving zombie processes around.

6405 6406 6407
- Issue #1195: Fix input() if it is interrupted by CTRL+d and then CTRL+c,
  clear the end-of-file indicator after CTRL+d.

6408 6409 6410 6411
- Issue #1856: Avoid crashes and lockups when daemon threads run while the
  interpreter is shutting down; instead, these threads are now killed when
  they try to take the GIL.

6412 6413 6414
- Issue #9756: When calling a method descriptor or a slot wrapper descriptor,
  the check of the object type doesn't read the __class__ attribute anymore.
  Fix a crash if a class override its __class__ attribute (e.g. a proxy of the
6415
  str type). Patch written by Andreas Stührk.
6416

6417 6418 6419 6420
- Issue #10517: After fork(), reinitialize the TLS used by the PyGILState_*
  APIs, to avoid a crash with the pthread implementation in RHEL 5.  Patch
  by Charles-François Natali.

6421 6422 6423 6424
- Issue #10914: Initialize correctly the filesystem codec when creating a new
  subinterpreter to fix a bootstrap issue with codecs implemented in Python, as
  the ISO-8859-15 codec.

6425 6426 6427
- Issue #11918: OS/2 and VMS are no more supported because of the lack of
  maintainer.

6428 6429 6430
- Issue #6780: fix starts/endswith error message to mention that tuples are
  accepted too.

6431 6432 6433 6434
- Issue #5057: fix a bug in the peepholer that led to non-portable pyc files
  between narrow and wide builds while optimizing BINARY_SUBSCR on non-BMP
  chars (e.g. "\U00012345"[0]).

6435 6436 6437
- Issue #11845: Fix typo in rangeobject.c that caused a crash in
  compute_slice_indices.  Patch by Daniel Urban.

6438 6439 6440 6441 6442
- Issue #5673: Added a `timeout` keyword argument to subprocess.Popen.wait,
  subprocess.Popen.communicated, subprocess.call, subprocess.check_call, and
  subprocess.check_output.  If the blocking operation takes more than `timeout`
  seconds, the `subprocess.TimeoutExpired` exception is raised.

6443 6444 6445 6446
- Issue #11650: PyOS_StdioReadline() retries fgets() if it was interrupted
  (EINTR), for example if the program is stopped with CTRL+z on Mac OS X. Patch
  written by Charles-Francois Natali.

6447 6448
- Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.

6449 6450
- Issue #10785: Store the filename as Unicode in the Python parser.

6451 6452 6453
- Issue #11619: _PyImport_LoadDynamicModule() doesn't encode the path to bytes
  on Windows.

6454 6455 6456
- Issue #10998: Remove mentions of -Q, sys.flags.division_warning and
  Py_DivisionWarningFlag left over from Python 2.

6457 6458 6459
- Issue #11244: Remove an unnecessary peepholer check that was preventing
  negative zeros from being constant-folded properly.

6460 6461 6462 6463 6464 6465
- Issue #11395: io.FileIO().write() clamps the data length to 32,767 bytes on
  Windows if the file is a TTY to workaround a Windows bug. The Windows console
  returns an error (12: not enough space error) on writing into stdout if
  stdout mode is binary and the length is greater than 66,000 bytes (or less,
  depending on heap usage).

6466
- Issue #11320: fix bogus memory management in Modules/getpath.c, leading to
6467 6468
  a possible crash when calling Py_SetPath().

Gregory P. Smith's avatar
Gregory P. Smith committed
6469 6470 6471 6472
- Issue #11432: A bug was introduced in subprocess.Popen on posix systems with
  3.2.0 where the stdout or stderr file descriptor being the same as the stdin
  file descriptor would raise an exception. webbrowser.open would fail. fixed.

6473 6474 6475 6476
- Issue #9856: Change object.__format__ with a non-empty format string
  to be a DeprecationWarning. In 3.2 it was a PendingDeprecationWarning.
  In 3.4 it will be a TypeError.

6477 6478 6479 6480
- Issue #11244: The peephole optimizer is now able to constant-fold
  arbitrarily complex expressions.  This also fixes a 3.2 regression where
  operations involving negative numbers were not constant-folded.

6481 6482 6483
- Issue #11450: Don't truncate hg version info in Py_GetBuildInfo() when
  there are many tags (e.g. when using mq).  Patch by Nadeem Vawda.

6484 6485 6486
- Issue #11335: Fixed a memory leak in list.sort when the key function
  throws an exception.

6487 6488 6489 6490 6491
- Issue #8923: When a string is encoded to UTF-8 in strict mode, the result is
  cached into the object. Examples: str.encode(), str.encode('utf-8'),
  PyUnicode_AsUTF8String() and PyUnicode_AsEncodedString(unicode, "utf-8",
  NULL).

6492 6493 6494
- Issue #10829: Refactor PyUnicode_FromFormat(), use the same function to parse
  the format string in the 3 steps, fix crashs on invalid format strings.

6495 6496
- Issue #13007: whichdb should recognize gdbm 1.9 magic numbers.

6497 6498 6499
- Issue #11286: Raise a ValueError from calling PyMemoryView_FromBuffer with
  a buffer struct having a NULL data pointer.

6500 6501 6502
- Issue #11272: On Windows, input() strips '\r' (and not only '\n'), and
  sys.stdin uses universal newline (replace '\r\n' by '\n').

6503
- Issue #11828: startswith and endswith now accept None as slice index.
6504 6505
  Patch by Torsten Becker.

6506 6507 6508 6509
- Issue #11168: Remove filename debug variable from PyEval_EvalFrameEx().
  It encoded the Unicode filename to UTF-8, but the encoding fails on
  undecodable filename (on surrogate characters) which raises an unexpected
  UnicodeEncodeError on recursion limit.
6510

6511 6512 6513 6514
- Issue #11187: Remove bootstrap code (use ASCII) of
  PyUnicode_AsEncodedString(), it was replaced by a better fallback (use the
  locale encoding) in PyUnicode_EncodeFSDefault().

6515 6516
- Check for NULL result in PyType_FromSpec.

6517
- Issue #10516: New copy() and clear() methods for lists and bytearrays.
6518

6519 6520 6521
- Issue #11386: bytearray.pop() now throws IndexError when the bytearray is
  empty, instead of OverflowError.

6522 6523 6524
- Issue #12380: The rjust, ljust and center methods of bytes and bytearray
  now accept a bytearray argument.

6525 6526
Library
-------
6527

6528 6529 6530 6531
- Issue #14195: An issue that caused weakref.WeakSet instances to incorrectly
  return True for a WeakSet instance 'a' in both 'a < a' and 'a > a' has been
  fixed.

6532 6533 6534 6535
- Issue #14166: Pickler objects now have an optional ``dispatch_table``
  attribute which allows to set custom per-pickler reduction functions.
  Patch by sbt.

6536 6537 6538
- Issue #14177: marshal.loads() now raises TypeError when given an unicode
  string.  Patch by Guilherme Gonçalves.

6539 6540 6541
- Issue #13550: Remove the debug machinery from the threading module: remove
  verbose arguments from all threading classes and functions.

6542 6543 6544 6545 6546
- Issue #14159: Fix the len() of weak containers (WeakSet, WeakKeyDictionary,
  WeakValueDictionary) to return a better approximation when some objects
  are dead or dying.  Moreover, the implementation is now O(1) rather than
  O(n).

6547 6548 6549
- Issue #11841: Fix comparison bug with 'rc' versions in packaging.version.
  Patch by Filip Gruszczyński.

6550
- Issue #6884: Fix long-standing bugs with MANIFEST.in parsing in distutils
Éric Araujo's avatar
Éric Araujo committed
6551
  on Windows.  Also fixed in packaging.
6552

6553 6554 6555
- Issue #8033: sqlite3: Fix 64-bit integer handling in user functions
  on 32-bit architectures. Initial patch by Philippe Devalkeneer.

6556 6557
- HTMLParser is now able to handle slashes in the start tag.

6558 6559 6560
- Issue #13641: Decoding functions in the base64 module now accept ASCII-only
  unicode strings.  Patch by Catalin Iacob.

6561 6562 6563
- Issue #14043: Speed up importlib's _FileFinder by at least 8x, and add a
  new importlib.invalidate_caches() function.

6564 6565 6566
- Issue #14001: CVE-2012-0845: xmlrpc: Fix an endless loop in
  SimpleXMLRPCServer upon malformed POST request.

6567 6568
- Issue #13961: Move importlib over to using os.replace() for atomic renaming.

6569 6570 6571
- Do away with ambiguous level values (as suggested by PEP 328) in
  importlib.__import__() by raising ValueError when level < 0.

6572 6573
- Issue #2489: pty.spawn could consume 100% cpu when it encountered an EOF.

6574 6575
- Issue #13014: Fix a possible reference leak in SSLSocket.getpeercert().

6576 6577 6578
- Issue #13777: Add PF_SYSTEM sockets on OS X.
  Patch by Michael Goderbauer.

6579 6580 6581
- Issue #13015: Fix a possible reference leak in defaultdict.__repr__.
  Patch by Suman Saha.

6582 6583 6584
- Issue #1326113: distutils' and packaging's build_ext commands option now
  correctly parses multiple values (separated by whitespace or commas) given
  to their --libraries option.
6585

6586 6587 6588 6589
- Issue #10287: nntplib now queries the server's CAPABILITIES first before
  sending MODE READER, and only sends it if not already in READER mode.
  Patch by Hynek Schlawack.

6590 6591 6592
- Issue #13993: HTMLParser is now able to handle broken end tags when
  strict=False.

6593 6594 6595 6596
- Issue #13930: lib2to3 now supports writing converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.

6597 6598 6599 6600
- Issue #9750: Fix sqlite3.Connection.iterdump on tables and fields
  with a name that is a keyword or contains quotes. Patch by Marko
  Kohtala.

6601 6602 6603 6604
- Issue #10287: nntplib now queries the server's CAPABILITIES again after
  authenticating (since the result may change, according to RFC 4643).
  Patch by Hynek Schlawack.

6605 6606 6607 6608 6609 6610 6611 6612 6613 6614 6615 6616 6617
- Issue #13590: On OS X 10.7 and 10.6 with Xcode 4.2, building
  Distutils-based packages with C extension modules may fail because
  Apple has removed gcc-4.2, the version used to build python.org
  64-bit/32-bit Pythons.  If the user does not explicitly override
  the default C compiler by setting the CC environment variable,
  Distutils will now attempt to compile extension modules with clang
  if gcc-4.2 is required but not found. Also as a convenience, if
  the user does explicitly set CC, substitute its value as the default
  compiler in the Distutils LDSHARED configuration variable for OS X.
  (Note, the python.org 32-bit-only Pythons use gcc-4.0 and the 10.4u
  SDK, neither of which are available in Xcode 4.  This change does not
  attempt to override settings to support their use with Xcode 4.)

6618 6619 6620
- Issue #13960: HTMLParser is now able to handle broken comments when
  strict=False.

6621
- When '' is a path (e.g. in sys.path), make sure __file__ uses the current
Brett Cannon's avatar
Brett Cannon committed
6622
  working directory instead of '' in importlib.
6623

6624 6625 6626 6627
- Issue #13609: Add two functions to query the terminal size:
  os.get_terminal_size (low level) and shutil.get_terminal_size (high level).
  Patch by Zbigniew Jędrzejewski-Szmek.

6628 6629 6630
- Issue #13845: On Windows, time.time() now uses GetSystemTimeAsFileTime()
  instead of ftime() to have a resolution of 100 ns instead of 1 ms (the clock
  accuracy is between 0.5 ms and 15 ms).
6631

6632 6633
- Issue #13846: Add time.monotonic(), monotonic clock.

6634 6635 6636 6637 6638
- Issue #8184: multiprocessing: On Windows, don't set SO_REUSEADDR on
  Connection sockets, and set FILE_FLAG_FIRST_PIPE_INSTANCE on named pipes, to
  make sure two listeners can't bind to the same socket/pipe (or any existing
  socket/pipe).

6639 6640 6641
- Issue #10811: Fix recursive usage of cursors. Instead of crashing,
  raise a ProgrammingError now.

6642 6643 6644
- Issue #13734: Add os.fwalk(), a directory walking function yielding file
  descriptors.

6645 6646
- Issue #2945: Make the distutils upload command aware of bdist_rpm products.

6647 6648
- Issue #13712: pysetup create should not convert package_data to extra_files.

6649 6650
- Issue #11805: package_data in setup.cfg should allow more than one value.

6651 6652
- Issue #13676: Handle strings with embedded zeros correctly in sqlite3.

6653 6654 6655
- Issue #8828: Add new function os.replace(), for cross-platform renaming
  with overwriting.

6656 6657 6658
- Issue #13848: open() and the FileIO constructor now check for NUL
  characters in the file name.  Patch by Hynek Schlawack.

6659 6660 6661
- Issue #13806: The size check in audioop decompression functions was too
  strict and could reject valid compressed data.  Patch by Oleg Plakhotnyuk.

6662 6663 6664
- Issue #13812: When a multiprocessing Process child raises an exception,
  flush stderr after printing the exception traceback.

6665 6666 6667
- Issue #13885: CVE-2011-3389: the _ssl module would always disable the CBC
  IV attack countermeasure.

6668 6669
- Issue #13847: time.localtime() and time.gmtime() now raise an OSError instead
  of ValueError on failure. time.ctime() and time.asctime() now raises an
6670 6671
  OSError if localtime() failed. time.clock() now raises a RuntimeError if the
  processor time used is not available or its value cannot be represented
6672

6673 6674 6675 6676
- Issue #13772: In os.symlink() under Windows, do not try to guess the link
  target's type (file or directory).  The detection was buggy and made the
  call non-atomic (therefore prone to race conditions).

6677
- Issue #6631: Disallow relative file paths in urllib urlopen methods.
6678

6679 6680 6681
- Issue #13722: Avoid silencing ImportErrors when initializing the codecs
  registry.

6682 6683 6684
- Issue #13781: Fix GzipFile bug that caused an exception to be raised when
  opening for writing using a fileobj returned by os.fdopen().

6685 6686 6687
- Issue #13803: Under Solaris, distutils doesn't include bitness
  in the directory name.

6688 6689
- Issue #10278: Add time.wallclock() function, monotonic clock.

6690 6691 6692
- Issue #13809: Fix regression where bz2 module wouldn't work when threads are
  disabled. Original patch by Amaury Forgeot d'Arc.

6693 6694 6695
- Issue #13589: Fix some serialization primitives in the aifc module.
  Patch by Oleg Plakhotnyuk.

6696 6697 6698
- Issue #13642: Unquote before b64encoding user:password during Basic
  Authentication. Patch contributed by Joonas Kuorilehto.

6699 6700 6701 6702
- Issue #12364: Fix a hang in concurrent.futures.ProcessPoolExecutor.
  The hang would occur when retrieving the result of a scheduled future after
  the executor had been shut down.

6703 6704 6705
- Issue #13502: threading: Fix a race condition in Event.wait() that made it
  return False when the event was set and cleared right after.

6706 6707 6708 6709 6710
- Issue #9993: When the source and destination are on different filesystems,
  and the source is a symlink, shutil.move() now recreates a symlink on the
  destination instead of copying the file contents.  Patch by Jonathan Niehof
  and Hynek Schlawack.

6711 6712
- Issue #12926: Fix a bug in tarfile's link extraction.

6713 6714
- Issue #13696: Fix the 302 Relative URL Redirection problem.

6715 6716 6717
- Issue #13636: Weak ciphers are now disabled by default in the ssl module
  (except when SSLv2 is explicitly asked for).

6718 6719 6720 6721 6722
- Issue #12715: Add an optional symlinks argument to shutil functions
  (copyfile, copymode, copystat, copy, copy2).  When that parameter is
  true, symlinks aren't dereferenced and the operation instead acts on the
  symlink itself (or creates one, if relevant).  Patch by Hynek Schlawack.

6723 6724
- Add a flags parameter to select.epoll.

6725 6726 6727
- Issue #13626: Add support for SSL Diffie-Hellman key exchange, through the
  SSLContext.load_dh_params() method and the ssl.OP_SINGLE_DH_USE option.

6728 6729
- Issue #11006: Don't issue low level warning in subprocess when pipe2() fails.

6730
- Issue #13620: Support for Chrome browser in webbrowser.  Patch contributed
6731 6732
  by Arnaud Calmettes.

6733 6734 6735
- Issue #11829: Fix code execution holes in inspect.getattr_static for
  metaclasses with metaclasses. Patch by Andreas Stührk.

6736 6737 6738
- Issue #12708: Add starmap() and starmap_async() methods (similar to
  itertools.starmap()) to multiprocessing.Pool.  Patch by Hynek Schlawack.

6739 6740
- Issue #1785: Fix inspect and pydoc with misbehaving descriptors.

6741 6742 6743
- Issue #13637: "a2b" functions in the binascii module now accept ASCII-only
  unicode strings.

6744 6745
- Issue #13634: Add support for querying and disabling SSL compression.

6746 6747 6748 6749
- Issue #13627: Add support for SSL Elliptic Curve-based Diffie-Hellman
  key exchange, through the SSLContext.set_ecdh_curve() method and the
  ssl.OP_SINGLE_ECDH_USE option.

6750 6751 6752 6753
- Issue #13635: Add ssl.OP_CIPHER_SERVER_PREFERENCE, so that SSL servers
  choose the cipher based on their own preferences, rather than on the
  client's.

6754
- Issue #11813: Fix inspect.getattr_static for modules. Patch by Andreas
6755 6756
  Stührk.

6757 6758 6759
- Issue #7502: Fix equality comparison for DocTestCase instances.  Patch by
  Cédric Krier.

6760 6761 6762
- Issue #11870: threading: Properly reinitialize threads internal locks and
  condition variables to avoid deadlocks in child processes.

6763 6764 6765
- Issue #8035: urllib: Fix a bug where the client could remain stuck after a
  redirection or an error.

6766 6767 6768
- Issue #13560: os.strerror() now uses the current locale encoding instead of
  UTF-8.

6769 6770 6771 6772
- Issue #8373: The filesystem path of AF_UNIX sockets now uses the filesystem
  encoding and the surrogateescape error handler, rather than UTF-8.  Patch
  by David Watson.

6773 6774 6775
- Issue #10350: Read and save errno before calling a function which might
  overwrite it.  Original patch by Hallvard B Furuseth.

6776 6777
- Issue #11610: Introduce a more general way to declare abstract properties.

6778 6779 6780
- Issue #13591: A bug in importlib has been fixed that caused import_module
  to load a module twice.

6781 6782 6783 6784
- Issue #13449 sched.scheduler.run() method has a new "blocking" parameter which
  when set to False makes run() execute the scheduled events due to expire
  soonest (if any) and then return.  Patch by Giampaolo Rodolà.

6785
- Issue #8684 sched.scheduler class can be safely used in multi-threaded
6786
  environments.  Patch by Josiah Carlson and Giampaolo Rodolà.
6787

6788 6789
- Alias resource.error to OSError ala PEP 3151.

6790 6791
- Issue #5689: Add support for lzma compression to the tarfile module.

6792 6793 6794 6795 6796
- Issue #13248: Turn 3.2's PendingDeprecationWarning into 3.3's
  DeprecationWarning.  It covers 'cgi.escape', 'importlib.abc.PyLoader',
  'importlib.abc.PyPycLoader', 'nntplib.NNTP.xgtitle', 'nntplib.NNTP.xpath',
  and private attributes of 'smtpd.SMTPChannel'.

6797 6798
- Issue #5905, #13560: time.strftime() is now using the current locale
  encoding, instead of UTF-8, if the wcsftime() function is not available.
6799

6800 6801 6802
- Issue #13464: Add a readinto() method to http.client.HTTPResponse.  Patch
  by Jon Kuhn.

6803 6804 6805
- tarfile.py: Correctly detect bzip2 compressed streams with blocksizes
  other than 900k.

6806 6807
- Issue #13439: Fix many errors in turtle docstrings.

6808
- Issue #6715: Add a module 'lzma' for compression using the LZMA algorithm.
6809
  Thanks to Per Øyvind Karlsen for the initial implementation.
6810

6811 6812 6813
- Issue #13487: Make inspect.getmodule robust against changes done to
  sys.modules while it is iterating over it.

6814 6815 6816
- Issue #12618: Fix a bug that prevented py_compile from creating byte
  compiled files in the current directory.  Initial patch by Sjoerd de Vries.

6817 6818 6819
- Issue #13444: When stdout has been closed explicitly, we should not attempt
  to flush it at shutdown and print an error.

6820 6821 6822 6823
- Issue #12567: The curses module uses Unicode functions for Unicode arguments
  when it is linked to the ncurses library. It encodes also Unicode strings to
  the locale encoding instead of UTF-8.

6824 6825 6826 6827
- Issue #12856: Ensure child processes do not inherit the parent's random
  seed for filename generation in the tempfile module.  Patch by Brian
  Harring.

6828 6829 6830
- Issue #9957: SpooledTemporaryFile.truncate() now accepts an optional size
  parameter, as other file-like objects.  Patch by Ryan Kelly.

6831 6832 6833
- Issue #13458: Fix a memory leak in the ssl module when decoding a
  certificate with a subjectAltName.  Patch by Robert Xiao.

6834 6835
- Issue #13415: os.unsetenv() doesn't ignore errors anymore.

Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
6836 6837 6838
- Issue #13245: sched.scheduler class constructor's timefunc and
  delayfunct parameters are now optional.
  scheduler.enter and scheduler.enterabs methods gained a new kwargs parameter.
6839
  Patch contributed by Chris Clark.
Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
6840

6841 6842 6843 6844
- Issue #12328: Under Windows, refactor handling of Ctrl-C events and
  make _multiprocessing.win32.WaitForMultipleObjects interruptible when
  the wait_flag parameter is false.  Patch by sbt.

6845 6846 6847 6848 6849 6850
- Issue #13322: Fix BufferedWriter.write() to ensure that BlockingIOError is
  raised when the wrapped raw file is non-blocking and the write would block.
  Previous code assumed that the raw write() would raise BlockingIOError, but
  RawIOBase.write() is defined to returned None when the call would block.
  Patch by sbt.

6851 6852
- Issue #13358: HTMLParser now calls handle_data only once for each CDATA.

6853 6854 6855 6856
- Issue #4147: minidom's toprettyxml no longer adds whitespace around a text
  node when it is the only child of an element.  Initial patch by Dan
  Kenigsberg.

6857 6858 6859 6860
- Issue #13374: The Windows bytes API has been deprecated in the os module. Use
  Unicode filenames instead of bytes filenames to not depend on the ANSI code
  page anymore and to support any filename.

6861 6862
- Issue #13297: Use bytes type to send and receive binary data through XMLRPC.

6863 6864 6865
- Issue #6397: Support "/dev/poll" polling objects in select module,
  under Solaris & derivatives.

6866 6867 6868
- Issues #1745761, #755670, #13357, #12629, #1200313: HTMLParser now correctly
  handles non-valid attributes, including adjacent and unquoted attributes.

6869 6870
- Issue #13193: Fix distutils.filelist.FileList and packaging.manifest.Manifest
  under Windows.
Antoine Pitrou's avatar
Antoine Pitrou committed
6871

6872 6873
- Issue #13384: Remove unnecessary __future__ import in Lib/random.py

6874 6875
- Issue #13149: Speed up append-only StringIO objects.

6876 6877 6878
- Issue #13373: multiprocessing.Queue.get() could sometimes block indefinitely
  when called with a timeout.  Patch by Arnaud Ysmal.

6879 6880 6881
- Issue #13254: Fix Maildir initialization so that maildir contents
  are read correctly.

6882
- Issue #3067: locale.setlocale() now raises TypeError if the second
6883 6884
  argument is an invalid iterable. Its documentation and docstring
  were also updated. Initial patch by Jyrki Pulliainen.
6885

6886 6887
- Issue #13140: Fix the daemon_threads attribute of ThreadingMixIn.

6888 6889 6890
- Issue #13339: Fix compile error in posixmodule.c due to missing semicolon.
  Thanks to Robert Xiao.

6891 6892 6893
- Byte compilation in packaging is now isolated from the calling Python -B or
  -O options, instead of being disallowed under -B or buggy under -O.

6894
- Issue #10570: curses.putp() and curses.tparm() are now expecting a byte
6895
  string, instead of a Unicode string.
6896

6897 6898
- Issue #13295: http.server now produces valid HTML 4.01 strict.

6899 6900
- Issue #2892: preserve iterparse events in case of SyntaxError.

6901
- Issue #13287: urllib.request and urllib.error now contains an __all__
Éric Araujo's avatar
Éric Araujo committed
6902
  attribute to expose only relevant classes and functions.  Patch by Florent
6903
  Xicluna.
6904

6905 6906 6907 6908
- Issue #670664: Fix HTMLParser to correctly handle the content of
  ``<script>...</script>`` and ``<style>...</style>``.

- Issue #10817: Fix urlretrieve function to raise ContentTooShortError even
6909 6910
  when reporthook is None. Patch by Jyrki Pulliainen.

6911 6912 6913
- Fix the xmlrpc.client user agent to return something similar to
  urllib.request user agent: "Python-xmlrpc/3.3".

6914 6915 6916
- Issue #13293: Better error message when trying to marshal bytes using
  xmlrpc.client.

6917 6918
- Issue #13291: NameError in xmlrpc package.

6919 6920
- Issue #13258: Use callable() built-in in the standard library.

6921 6922 6923
- Issue #13273: fix a bug that prevented HTMLParser to properly detect some
  tags when strict=False.

6924 6925 6926
- Issue #11183: Add finer-grained exceptions to the ssl module, so that
  you don't have to inspect the exception's attributes in the common case.

6927
- Issue #13216: Add cp65001 codec, the Windows UTF-8 (CP_UTF8).
6928

Victor Stinner's avatar
Victor Stinner committed
6929
- Issue #13226: Add RTLD_xxx constants to the os module. These constants can be
6930 6931
  used with sys.setdlopenflags().

6932 6933 6934 6935
- Issue #10278: Add clock_getres(), clock_gettime() and CLOCK_xxx constants to
  the time module. time.clock_gettime(time.CLOCK_MONOTONIC) provides a
  monotonic clock

6936 6937 6938
- Issue #10332: multiprocessing: fix a race condition when a Pool is closed
  before all tasks have completed.

6939 6940
- Issue #13255: wrong docstrings in array module.

6941 6942
- Issue #8540: Remove deprecated Context._clamp attribute in Decimal module.

R David Murray's avatar
R David Murray committed
6943
- Issue #13235: Added DeprecationWarning to logging.warn() method and function.
6944

6945 6946
- Issue #9168: now smtpd is able to bind privileged port.

6947 6948 6949
- Issue #12529: fix cgi.parse_header issue on strings with double-quotes and
  semicolons together. Patch by Ben Darnell and Petri Lehtinen.

6950 6951 6952
- Issue #13227: functools.lru_cache() now has a option to distinguish
  calls with different argument types.

6953 6954
- Issue #6090: zipfile raises a ValueError when a document with a timestamp
  earlier than 1980 is provided. Patch contributed by Petri Lehtinen.
6955

6956 6957 6958 6959
- Issue #13150: sysconfig no longer parses the Makefile and config.h files
  when imported, instead doing it at build time.  This makes importing
  sysconfig faster and reduces Python startup time by 20%.

Ezio Melotti's avatar
Ezio Melotti committed
6960 6961
- Issue #12448: smtplib now flushes stdout while running ``python -m smtplib``
  in order to display the prompt correctly.
6962

6963
- Issue #12454: The mailbox module is now using ASCII, instead of the locale
R David Murray's avatar
R David Murray committed
6964
  encoding, to read and write .mh_sequences files.
6965

6966 6967
- Issue #13194: zlib.compressobj().copy() and zlib.decompressobj().copy() are
  now available on Windows.
6968

R David Murray's avatar
R David Murray committed
6969
- Issue #1673007: urllib.request now supports HEAD request via new method argument.
6970 6971
  Patch contributions by David Stanek, Patrick Westerhoff and Ezio Melotti.

6972 6973
- Issue #12386: packaging does not fail anymore when writing the RESOURCES
  file.
6974

6975 6976
- Issue #13158: Fix decoding and encoding of GNU tar specific base-256 number
  fields in tarfile.
6977

6978 6979
- Issue #13025: mimetypes is now reading MIME types using the UTF-8 encoding,
  instead of the locale encoding.
6980

6981 6982
- Issue #10653: On Windows, use strftime() instead of wcsftime() because
  wcsftime() doesn't format time zone correctly.
6983

6984 6985 6986
- Issue #13150: The tokenize module doesn't compile large regular expressions
  at startup anymore.

Éric Araujo's avatar
Éric Araujo committed
6987 6988
- Issue #11171: Fix distutils.sysconfig.get_makefile_filename when Python was
  configured with different prefix and exec-prefix.
6989

6990
- Issue #11254: Teach distutils and packaging to compile .pyc and .pyo files in
6991
  PEP 3147-compliant __pycache__ directories.
6992

Ned Deily's avatar
Ned Deily committed
6993 6994
- Issue #7367: Fix pkgutil.walk_paths to skip directories whose
  contents cannot be read.
6995

6996 6997 6998
- Issue #3163: The struct module gets new format characters 'n' and 'N'
  supporting C integer types ``ssize_t`` and ``size_t``, respectively.

6999 7000
- Issue #13099: Fix sqlite3.Cursor.lastrowid under a Turkish locale.
  Reported and diagnosed by Thomas Kluyver.
7001

7002 7003 7004
- Issue #13087: BufferedReader.seek() now always raises UnsupportedOperation
  if the underlying raw stream is unseekable, even if the seek could be
  satisfied using the internal buffer.  Patch by John O'Connor.
7005

7006 7007 7008
- Issue #7689: Allow pickling of dynamically created classes when their
  metaclass is registered with copyreg.  Patch by Nicolas M. Thiéry and Craig
  Citro.
7009

7010 7011 7012
- Issue #13034: When decoding some SSL certificates, the subjectAltName
  extension could be unreported.

7013 7014 7015
- Issue #12306: Expose the runtime version of the zlib C library as a constant,
  ZLIB_RUNTIME_VERSION, in the zlib module. Patch by Torsten Landschoff.

7016
- Issue #12959: Add collections.ChainMap to collections.__all__.
7017

7018 7019 7020
- Issue #8933: distutils' PKG-INFO files and packaging's METADATA files will
  now correctly report Metadata-Version: 1.1 instead of 1.0 if a Classifier or
  Download-URL field is present.
7021

7022 7023 7024
- Issue #12567: Add curses.unget_wch() function. Push a character so the next
  get_wch() will return it.

7025
- Issue #9561: distutils and packaging now writes egg-info files using UTF-8,
7026 7027
  instead of the locale encoding.

7028 7029 7030
- Issue #8286: The distutils command sdist will print a warning message instead
  of crashing when an invalid path is given in the manifest template.

7031 7032 7033 7034 7035
- Issue #12841: tarfile unnecessarily checked the existence of numerical user
  and group ids on extraction. If one of them did not exist the respective id
  of the current user (i.e. root) was used for the file and ownership
  information was lost.

Ezio Melotti's avatar
Ezio Melotti committed
7036 7037 7038
- Issue #12888: Fix a bug in HTMLParser.unescape that prevented it to escape
  more than 128 entities.  Patch by Peter Otten.

7039 7040
- Issue #12878: Expose a __dict__ attribute on io.IOBase and its subclasses.

7041 7042 7043 7044
- Issue #12494: On error, call(), check_call(), check_output() and
  getstatusoutput() functions of the subprocess module now kill the process,
  read its status (to avoid zombis) and close pipes.

Benjamin Peterson's avatar
Benjamin Peterson committed
7045 7046
- Issue #12720: Expose low-level Linux extended file attribute functions in os.

Éric Araujo's avatar
Éric Araujo committed
7047
- Issue #10946: The distutils commands bdist_dumb, bdist_wininst and bdist_msi
7048 7049
  now respect a --skip-build option given to bdist.  The packaging commands
  were fixed too.
Éric Araujo's avatar
Éric Araujo committed
7050

7051 7052 7053
- Issue #12847: Fix a crash with negative PUT and LONG_BINPUT arguments in
  the C pickle implementation.

7054 7055 7056
- Issue #11564: Avoid crashes when trying to pickle huge objects or containers
  (more than 2**31 items).  Instead, in most cases, an OverflowError is raised.

7057 7058 7059
- Issue #12287: Fix a stack corruption in ossaudiodev module when the FD is
  greater than FD_SETSIZE.

7060 7061 7062
- Issue #12839: Fix crash in zlib module due to version mismatch.
  Fix by Richard M. Tew.

7063 7064 7065
- Issue #9923: The mailcap module now correctly uses the platform path
  separator for the MAILCAP environment variable on non-POSIX platforms.

7066 7067 7068 7069
- Issue #12835: Follow up to #6560 that unconditionally prevents use of the
  unencrypted sendmsg/recvmsg APIs on SSL wrapped sockets. Patch by David
  Watson.

7070 7071 7072
- Issue #12803: SSLContext.load_cert_chain() now accepts a password argument
  to be used if the private key is encrypted.  Patch by Adam Simpkins.

7073 7074 7075
- Issue #11657: Fix sending file descriptors over 255 over a multiprocessing
  Pipe.

7076 7077 7078
- Issue #12811: tabnanny.check() now promptly closes checked files. Patch by
  Anthony Briggs.

7079 7080
- Issue #6560: The sendmsg/recvmsg API is now exposed by the socket module
  when provided by the underlying platform, supporting processing of
7081
  ancillary data in pure Python code. Patch by David Watson and Heiko Wundram.
7082

7083 7084 7085 7086
- Issue #12326: On Linux, sys.platform doesn't contain the major version
  anymore. It is now always 'linux', instead of 'linux2' or 'linux3' depending
  on the Linux version used to build Python.

7087 7088 7089
- Issue #12213: Fix a buffering bug with interleaved reads and writes that
  could appear on BufferedRandom streams.

7090 7091 7092
- Issue #12778: Reduce memory consumption when JSON-encoding a large
  container of many small objects.

7093 7094 7095
- Issue #12650: Fix a race condition where a subprocess.Popen could leak
  resources (FD/zombie) when killed at the wrong time.

7096 7097 7098
- Issue #12744: Fix inefficient representation of integers between 2**31 and
  2**63 on systems with a 64-bit C "long".

7099 7100 7101
- Issue #12646: Add an 'eof' attribute to zlib.Decompress, to make it easier to
  detect truncated input streams.

7102 7103 7104
- Issue #11513: Fix exception handling ``tarfile.TarFile.gzopen()`` when
  the file cannot be opened.

7105 7106 7107
- Issue #12687: Fix a possible buffering bug when unpickling text mode
  (protocol 0, mostly) pickles.

Senthil Kumaran's avatar
Senthil Kumaran committed
7108 7109
- Issue #10087: Fix the html output format of the calendar module.

7110 7111 7112
- Issue #13121: add support for inplace math operators to collections.Counter.

- Add support for unary plus and unary minus to collections.Counter.
7113

7114 7115
- Issue #12683: urlparse updated to include svn as schemes that uses relative
  paths. (svn from 1.5 onwards support relative path).
7116

7117 7118 7119 7120 7121
- Issue #12655: Expose functions from sched.h in the os module: sched_yield(),
  sched_setscheduler(), sched_getscheduler(), sched_setparam(),
  sched_get_min_priority(), sched_get_max_priority(), sched_rr_get_interval(),
  sched_getaffinity(), sched_setaffinity().

7122 7123
- Add ThreadError to threading.__all__.

7124 7125
- Issues #11104, #8688: Fix the behavior of distutils' sdist command with
  manually-maintained MANIFEST files.
7126

7127 7128 7129 7130
- Issue #11281: smtplib.STMP gets source_address parameter, which adds the
  ability to bind to specific source address on a machine with multiple
  interfaces. Patch by Paulo Scardine.

7131 7132
- Issue #12464: tempfile.TemporaryDirectory.cleanup() should not follow
  symlinks: fix it. Patch by Petri Lehtinen.
7133

Éric Araujo's avatar
Éric Araujo committed
7134 7135
- Issue #8887: "pydoc somebuiltin.somemethod" (or help('somebuiltin.somemethod')
  in Python code) now finds the doc of the method.
7136

7137
- Issue #10968: Remove indirection in threading.  The public names (Event,
7138
  Condition, etc.) used to be factory functions returning instances of hidden
7139 7140 7141
  classes (_Event, _Condition, etc.), because (if Guido recalls correctly) this
  code pre-dates the ability to subclass extension types.  It is now possible
  to inherit from these classes, without having to import the private
7142 7143
  underscored names like multiprocessing did.

7144 7145 7146
- Issue #9723: Add shlex.quote functions, to escape filenames and command
  lines.

7147 7148
- Issue #12603: Fix pydoc.synopsis() on files with non-negative st_mtime.

7149 7150 7151
- Issue #12514: Use try/finally to assure the timeit module restores garbage
  collections when it is done.

7152 7153 7154
- Issue #12607: In subprocess, fix issue where if stdin, stdout or stderr is
  given as a low fd, it gets overwritten.

7155
- Issue #12576: Fix urlopen behavior on sites which do not send (or obfuscates)
7156
  ``Connection: close`` header.
7157

7158 7159
- Issue #12560: Build libpython.so on OpenBSD. Patch by Stefan Sperling.

7160 7161
- Issue #1813: Fix codec lookup under Turkish locales.

7162 7163 7164
- Issue #12591: Improve support of "universal newlines" in the subprocess
  module: the piped streams can now be properly read from or written to.

7165 7166 7167 7168
- Issue #12591: Allow io.TextIOWrapper to work with raw IO objects (without
  a read1() method), and add a *write_through* parameter to mandate
  unbuffered writes.

7169 7170
- Issue #10883: Fix socket leaks in urllib.request when using FTP.

7171 7172
- Issue #12592: Make Python build on OpenBSD 5 (and future major releases).

7173 7174
- Issue #12372: POSIX semaphores are broken on AIX: don't use them.

7175 7176 7177 7178 7179 7180
- Issue #12551: Provide a get_channel_binding() method on SSL sockets so as
  to get channel binding data for the current SSL session (only the
  "tls-unique" channel binding is implemented).  This allows the implementation
  of certain authentication mechanisms such as SCRAM-SHA-1-PLUS.  Patch by
  Jacek Konieczny.

7181 7182 7183
- Issue #665194: email.utils now has format_datetime and parsedate_to_datetime
  functions, allowing for round tripping of RFC2822 format dates.

7184 7185 7186 7187
- Issue #12571: Add a plat-linux3 directory mirroring the plat-linux2
  directory, so that "import DLFCN" and other similar imports work on
  Linux 3.0.

7188 7189 7190
- Issue #7484: smtplib no longer puts <> around addresses in VRFY and EXPN
  commands; they aren't required and in fact postfix doesn't support that form.

Benjamin Peterson's avatar
Benjamin Peterson committed
7191 7192 7193
- Issue #12273: Remove ast.__version__. AST changes can be accounted for by
  checking sys.version_info or sys._mercurial.

7194 7195 7196
- Silence spurious "broken pipe" tracebacks when shutting down a
  ProcessPoolExecutor.

7197 7198 7199
- Fix potential resource leaks in concurrent.futures.ProcessPoolExecutor
  by joining all queues and processes when shutdown() is called.

7200 7201 7202
- Issue #11603: Fix a crash when __str__ is rebound as __repr__.  Patch by
  Andreas Stührk.

7203 7204 7205
- Issue #11321: Fix a crash with multiple imports of the _pickle module when
  embedding Python.  Patch by Andreas Stührk.

7206 7207 7208
- Issue #6755: Add get_wch() method to curses.window class. Patch by Iñigo
  Serna.

7209 7210
- Add cgi.closelog() function to close the log file.

7211 7212
- Issue #12502: asyncore: fix polling loop with AF_UNIX sockets.

7213 7214 7215
- Issue #4376: ctypes now supports nested structures in a endian different than
  the parent structure. Patch by Vlad Riscutia.

7216 7217 7218
- Raise ValueError when attempting to set the _CHUNK_SIZE attribute of a
  TextIOWrapper to a huge value, not TypeError.

7219 7220 7221
- Issue #12504: Close file handles in a timely manner in packaging.database.
  This fixes a bug with the remove (uninstall) feature on Windows.

7222 7223 7224
- Issues #12169 and #10510: Factor out code used by various packaging commands
  to make HTTP POST requests, and make sure it uses CRLF.

7225 7226 7227 7228
- Issue #12016: Multibyte CJK decoders now resynchronize faster. They only
  ignore the first byte of an invalid byte sequence. For example,
  b'\xff\n'.decode('gb2312', 'replace') gives '\ufffd\n' instead of '\ufffd'.

7229 7230 7231 7232
- Issue #12459: time.sleep() now raises a ValueError if the sleep length is
  negative, instead of an infinite sleep on Windows or raising an IOError on
  Linux for example, to have the same behaviour on all platforms.

7233 7234 7235 7236
- Issue #12451: pydoc: html_getfile() now uses tokenize.open() to support
  Python scripts using a encoding different than UTF-8 (read the coding cookie
  of the script).

7237 7238 7239
- Issue #12493: subprocess: Popen.communicate() now also handles EINTR errors
  if the process has only one pipe.

7240 7241 7242
- Issue #12467: warnings: fix a race condition if a warning is emitted at
  shutdown, if globals()['__file__'] is None.

7243 7244 7245
- Issue #12451: pydoc: importfile() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to avoid encoding issues.

7246 7247 7248 7249
- Issue #12451: runpy: run_path() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to support other encodings
  than UTF-8 (scripts using the coding cookie).

7250 7251 7252
- Issue #12451: xml.dom.pulldom: parse() now opens files in binary mode instead
  of the text mode (using the locale encoding) to avoid encoding issues.

7253 7254 7255
- Issue #12147: Adjust the new-in-3.2 smtplib.send_message method for better
  conformance to the RFCs:  correctly handle Sender and Resent- headers.

7256 7257
- Issue #12352: Fix a deadlock in multiprocessing.Heap when a block is freed by
  the garbage collector while the Heap lock is held.
7258

R David Murray's avatar
R David Murray committed
7259
- Issue #12462: time.sleep() now immediately calls the (Python) signal handler
7260 7261 7262
  if it is interrupted by a signal, instead of having to wait until the next
  instruction.

7263 7264 7265
- Issue #12442: new shutil.disk_usage function, providing total, used and free
  disk space statistics.

7266 7267 7268 7269 7270
- Issue #12451: The XInclude default loader of xml.etree now decodes files from
  UTF-8 instead of the locale encoding if the encoding is not specified. It now
  also opens XML files for the parser in binary mode instead of the text mode
  to avoid encoding issues.

7271 7272 7273
- Issue #12451: doctest.debug_script() doesn't create a temporary file
  anymore to avoid encoding issues.

7274 7275 7276
- Issue #12451: pydoc.synopsis() now reads the encoding cookie if available,
  to read the Python script from the right encoding.

7277 7278 7279
- Issue #12451: distutils now opens the setup script in binary mode to read the
  encoding cookie, instead of opening it in UTF-8.

Ned Deily's avatar
Ned Deily committed
7280 7281 7282 7283
- Issue #9516: On Mac OS X, change Distutils to no longer globally attempt to
  check or set the MACOSX_DEPLOYMENT_TARGET environment variable for the
  interpreter process.  This could cause failures in non-Distutils subprocesses
  and was unreliable since tests or user programs could modify the interpreter
Ezio Melotti's avatar
Ezio Melotti committed
7284
  environment after Distutils set it.  Instead, have Distutils set the
Ned Deily's avatar
Ned Deily committed
7285 7286 7287 7288
  deployment target only in the environment of each build subprocess.  It is
  still possible to globally override the default by setting
  MACOSX_DEPLOYMENT_TARGET before launching the interpreter; its value must be
  greater or equal to the default value, the value with which the interpreter
7289
  was built.  Also, implement the same handling in packaging.
Ned Deily's avatar
Ned Deily committed
7290

7291 7292 7293
- Issue #12422: In the copy module, don't store objects that are their own copy
  in the memo dict.

7294 7295
- Issue #12303: Add sigwaitinfo() and sigtimedwait() to the signal module.

7296 7297 7298
- Issue #12404: Remove C89 incompatible code from mmap module. Patch by Akira
  Kitada.

7299 7300 7301
- Issue #1874: email now detects and reports as a defect the presence of
  any CTE other than 7bit, 8bit, or binary on a multipart.

7302 7303 7304
- Issue #12383: Fix subprocess module with env={}: don't copy the environment
  variables, start with an empty environment.

7305 7306 7307 7308
- Issue #11637: Fix support for importing packaging setup hooks from the
  project directory.

- Issue #6771: Moved the curses.wrapper function from the single-function
7309 7310 7311
  wrapper module into __init__, eliminating the module.  Since __init__ was
  already importing the function to curses.wrapper, there is no API change.

7312
- Issue #11584: email.header.decode_header no longer fails if the header
7313 7314
  passed to it is a Header object, and Header/make_header no longer fail
  if given binary unknown-8bit input.
7315

7316 7317 7318
- Issue #11700: mailbox proxy object close methods can now be called multiple
  times without error.

7319 7320
- Issue #11767: Correct file descriptor leak in mailbox's __getitem__ method.

7321 7322 7323 7324
- Issue #12133: AbstractHTTPHandler.do_open() of urllib.request closes the HTTP
  connection if its getresponse() method fails with a socket error. Patch
  written by Ezio Melotti.

7325 7326 7327
- Issue #12240: Allow multiple setup hooks in packaging's setup.cfg files.
  Original patch by Erik Bray.

7328 7329 7330
- Issue #9284: Allow inspect.findsource() to find the source of doctest
  functions.

7331 7332 7333 7334
- Issue #11595: Fix assorted bugs in packaging.util.cfg_to_args, a
  compatibility helper for the distutils-packaging transition.  Original patch
  by Erik Bray.

7335 7336 7337
- Issue #12287: In ossaudiodev, check that the device isn't closed in several
  methods.

Benjamin Peterson's avatar
Benjamin Peterson committed
7338
- Issue #12009: Fixed regression in netrc file comment handling.
7339

7340 7341 7342 7343
- Issue #12246: Warn and fail when trying to install a third-party project from
  an uninstalled Python (built in a source checkout).  Original patch by
  Tshepang Lekhonkhobe.

7344 7345
- Issue #10694: zipfile now ignores garbage at the end of a zipfile.

7346 7347
- Issue #12283: Fixed regression in smtplib quoting of leading dots in DATA.

7348 7349 7350
- Issue #10424: Argparse now includes the names of the missing required
  arguments in the missing arguments error message.

7351 7352 7353
- Issue #12168: SysLogHandler now allows NUL termination to be controlled using
  a new 'append_nul' attribute on the handler.

7354 7355 7356
- Issue #11583: Speed up os.path.isdir on Windows by using GetFileAttributes
  instead of os.stat.

7357 7358 7359
- Issue #12021: Make mmap's read() method argument optional. Patch by Petri
  Lehtinen.

7360 7361 7362 7363
- Issue #9205: concurrent.futures.ProcessPoolExecutor now detects killed
  children and raises BrokenProcessPool in such a situation.  Previously it
  would reliably freeze/deadlock.

7364
- Issue #12040: Expose a new attribute ``sentinel`` on instances of
Georg Brandl's avatar
Georg Brandl committed
7365 7366
  ``multiprocessing.Process``.  Also, fix Process.join() to not use polling
  anymore, when given a timeout.
7367

7368 7369 7370
- Issue #11893: Remove obsolete internal wrapper class ``SSLFakeFile`` in the
  smtplib module.  Patch by Catalin Iacob.

7371 7372 7373
- Issue #12080: Fix a Decimal.power() case that took an unreasonably long time
  to compute.

7374 7375 7376 7377
- Issue #12221: Remove __version__ attributes from pyexpat, pickle, tarfile,
  pydoc, tkinter, and xml.parsers.expat. This were useless version constants
  left over from the Mercurial transition

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
7378
- Named tuples now work correctly with vars().
7379

7380 7381 7382 7383
- Issue #12085: Fix an attribute error in subprocess.Popen destructor if the
  constructor has failed, e.g. because of an undeclared keyword argument. Patch
  written by Oleg Oshmyan.

7384
- Issue #12028: Make threading._get_ident() public, rename it to
Victor Stinner's avatar
Victor Stinner committed
7385
  threading.get_ident() and document it. This function was already used using
7386 7387
  _thread.get_ident().

7388 7389 7390
- Issue #12171: IncrementalEncoder.reset() of CJK codecs (multibytecodec) calls
  encreset() instead of decreset().

7391 7392
- Issue #12218: Removed wsgiref.egg-info.

7393
- Issue #12196: Add pipe2() to the os module.
7394

7395 7396 7397
- Issue #985064: Make plistlib more resilient to faulty input plists.
  Patch by Mher Movsisyan.

7398 7399 7400
- Issue #1625: BZ2File and bz2.decompress() now support multi-stream files.
  Initial patch by Nir Aides.

7401 7402
- Issue #12175: BufferedReader.read(-1) now calls raw.readall() if available.

7403 7404 7405
- Issue #12175: FileIO.readall() now only reads the file position and size
  once.

7406 7407 7408 7409 7410 7411
- Issue #12175: RawIOBase.readall() now returns None if read() returns None.

- Issue #12175: FileIO.readall() now raises a ValueError instead of an IOError
  if the file is closed.

- Issue #11109: New service_action method for BaseServer, used by ForkingMixin
7412
  class for cleanup. Initial Patch by Justin Warkentin.
7413 7414 7415

- Issue #12045: Avoid duplicate execution of command in
  ctypes.util._get_soname().  Patch by Sijin Joseph.
Senthil Kumaran's avatar
Senthil Kumaran committed
7416

7417 7418 7419
- Issue #10818: Remove the Tk GUI and the serve() function of the pydoc module,
  pydoc -g has been deprecated in Python 3.2 and it has a new enhanced web
  server.
7420

7421 7422 7423
- Issue #1441530: In imaplib, read the data in one chunk to speed up large
  reads and simplify code.

7424 7425 7426
- Issue #12070: Fix the Makefile parser of the sysconfig module to handle
  correctly references to "bogus variable" (e.g. "prefix=$/opt/python").

7427 7428 7429 7430
- Issue #12100: Don't reset incremental encoders of CJK codecs at each call to
  their encode() method anymore, but continue to call the reset() method if the
  final argument is True.

7431 7432 7433
- Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl
  module.

7434 7435 7436
- Issue #6501: os.device_encoding() returns None on Windows if the application
  has no console.

7437 7438
- Issue #12105: Add O_CLOEXEC to the os module.

7439 7440 7441 7442
- Issue #12079: Decimal('Infinity').fma(Decimal('0'), (3.91224318126786e+19+0j))
  now raises TypeError (reflecting the invalid type of the 3rd argument) rather
  than Decimal.InvalidOperation.

7443 7444 7445
- Issue #12124: zipimport doesn't keep a reference to zlib.decompress() anymore
  to be able to unload the module.

7446 7447
- Add the packaging module, an improved fork of distutils (also known as
  distutils2).
7448

7449 7450 7451
- Issue #12065: connect_ex() on an SSL socket now returns the original errno
  when the socket's timeout expires (it used to return None).

7452 7453 7454 7455
- Issue #8809: The SMTP_SSL constructor and SMTP.starttls() now support
  passing a ``context`` argument pointing to an ssl.SSLContext instance.
  Patch by Kasun Herath.

7456 7457 7458
- Issue #9516: Issue #9516: avoid errors in sysconfig when MACOSX_DEPLOYMENT_TARGET
  is set in shell.

7459 7460 7461 7462 7463
- Issue #8650: Make zlib module 64-bit clean. compress(), decompress() and
  their incremental counterparts now raise OverflowError if given an input
  larger than 4GB, instead of silently truncating the input and returning
  an incorrect result.

7464 7465 7466
- Issue #12050: zlib.decompressobj().decompress() now clears the unconsumed_tail
  attribute when called without a max_length argument.

7467 7468 7469 7470 7471
- Issue #12062: Fix a flushing bug when doing a certain type of I/O sequence
  on a file opened in read+write mode (namely: reading, seeking a bit forward,
  writing, then seeking before the previous write but still within buffered
  data, and writing again).

7472 7473 7474
- Issue #9971: Write an optimized implementation of BufferedReader.readinto().
  Patch by John O'Connor.

7475 7476 7477 7478
- Issue #11799: urllib.request Authentication Handlers will raise a ValueError
  when presented with an unsupported Authentication Scheme. Patch contributed
  by Yuval Greenfield.

7479 7480 7481 7482 7483
- Issue #10419, #6011: build_scripts command of distutils handles correctly
  non-ASCII path (path to the Python executable). Open and write the script in
  binary mode, but ensure that the shebang is decodable from UTF-8 and from the
  encoding of the script.

7484 7485 7486
- Issue #8498: In socket.accept(), allow to specify 0 as a backlog value in
  order to accept exactly one connection.  Patch by Daniel Evers.

7487 7488 7489
- Issue #12011: signal.signal() and signal.siginterrupt() raise an OSError,
  instead of a RuntimeError: OSError has an errno attribute.

R David Murray's avatar
R David Murray committed
7490 7491 7492
- Issue #3709: add a flush_headers method to BaseHTTPRequestHandler, which
  manages the sending of headers to output stream and flushing the internal
  headers buffer. Patch contribution by Andrew Schaaf
7493

7494 7495
- Issue #11743: Rewrite multiprocessing connection classes in pure Python.

7496 7497
- Issue #11164: Stop trying to use _xmlplus in the xml module.

7498 7499 7500
- Issue #11888: Add log2 function to math module. Patch written by Mark
  Dickinson.

7501 7502
- Issue #12012: ssl.PROTOCOL_SSLv2 becomes optional.

7503 7504 7505 7506
- Issue #8407: The signal handler writes the signal number as a single byte
  instead of a nul byte into the wakeup file descriptor. So it is possible to
  wait more than one signal and know which signals were raised.

7507 7508 7509
- Issue #8407: Add pthread_kill(), sigpending() and sigwait() functions to the
  signal module.

7510 7511 7512
- Issue #11927: SMTP_SSL now uses port 465 by default as documented.  Patch
  by Kasun Herath.

Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
7513
- Issue #12002: ftplib's abort() method raises TypeError.
7514

Ezio Melotti's avatar
Ezio Melotti committed
7515
- Issue #11916: Add a number of MacOSX specific definitions to the errno module.
7516 7517
  Patch by Pierre Carrier.

7518
- Issue #11999: fixed sporadic sync failure mailbox.Maildir due to its trying to
7519 7520 7521
  detect mtime changes by comparing to the system clock instead of to the
  previous value of the mtime.

7522 7523
- Issue #11072: added MLSD command (RFC-3659) support to ftplib.

7524 7525 7526 7527
- Issue #8808: The IMAP4_SSL constructor now allows passing an SSLContext
  parameter to control parameters of the secure channel.  Patch by Sijin
  Joseph.

7528 7529 7530
- ntpath.samefile failed to notice that "a.txt" and "A.TXT" refer to the same
  file on Windows XP. As noticed in issue #10684.

7531 7532 7533 7534
- Issue #12000: When a SSL certificate has a subjectAltName without any
  dNSName entry, ssl.match_hostname() should use the subject's commonName.
  Patch by Nicolas Bareil.

7535 7536 7537 7538
- Issue #10775: assertRaises, assertRaisesRegex, assertWarns, and
  assertWarnsRegex now accept a keyword argument 'msg' when used as context
  managers.  Initial patch by Winston Ewert.

Ronald Oussoren's avatar
Ronald Oussoren committed
7539 7540 7541 7542
- Issue #10684: shutil.move used to delete a folder on case insensitive
  filesystems when the source and destination name where the same except
  for the case.

7543 7544 7545 7546
- Issue #11647: objects created using contextlib.contextmanager now support
  more than one call to the function when used as a decorator. Initial patch
  by Ysj Ray.

7547 7548 7549
- Issue #11930: Removed deprecated time.accept2dyear variable.
  Removed year >= 1000 restriction from datetime.strftime.

7550 7551
- logging: don't define QueueListener if Python has no thread support.

7552 7553
- functools.cmp_to_key() now works with collections.Hashable().

7554 7555 7556
- Issue #11277: mmap.mmap() calls fcntl(fd, F_FULLFSYNC) on Mac OS X to get
  around a mmap bug with sparse files. Patch written by Steffen Daode Nurpmeso.

7557 7558 7559
- Issue #8407: Add signal.pthread_sigmask() function to fetch and/or change the
  signal mask of the calling thread.

7560 7561 7562 7563 7564
- Issue #11858: configparser.ExtendedInterpolation expected lower-case section
  names.

- Issue #11324: ConfigParser(interpolation=None) now works correctly.

7565 7566 7567
- Issue #11811: ssl.get_server_certificate() is now IPv6-compatible.  Patch
  by Charles-François Natali.

7568 7569 7570
- Issue #11763: don't use difflib in TestCase.assertMultiLineEqual if the
  strings are too long.

7571 7572
- Issue #11236: getpass.getpass responds to ctrl-c or ctrl-z on terminal.

7573 7574
- Issue #11856: Speed up parsing of JSON numbers.

7575
- Issue #11005: threading.RLock()._release_save() raises a RuntimeError if the
7576 7577
  lock was not acquired.

7578 7579 7580
- Issue #11258: Speed up ctypes.util.find_library() under Linux by a factor
  of 5 to 10.  Initial patch by Jonas H.

7581 7582 7583
- Issue #11382: Trivial system calls, such as dup() or pipe(), needn't
  release the GIL.  Patch by Charles-François Natali.

7584 7585 7586
- Issue #11223: Add threading._info() function providing informations about
  the thread implementation.

7587 7588 7589
- Issue #11731: simplify/enhance email parser/generator API by introducing
  policy objects.

7590 7591 7592 7593
- Issue #11768: The signal handler of the signal module only calls
  Py_AddPendingCall() for the first signal to fix a deadlock on reentrant or
  parallel calls. PyErr_SetInterrupt() writes also into the wake up file.

7594 7595
- Issue #11492: fix several issues with header folding in the email package.

7596 7597
- Issue #11852: Add missing imports and update tests.

7598 7599 7600
- Issue #11875: collections.OrderedDict's __reduce__ was temporarily
  mutating the object instead of just working on a copy.

7601
- Issue #11467: Fix urlparse behavior when handling urls which contains scheme
7602 7603
  specific part only digits. Patch by Santoso Wijaya.

7604 7605
- collections.Counter().copy() now works correctly for subclasses.

7606 7607 7608
- Issue #11474: Fix the bug with url2pathname() handling of '/C|/' on Windows.
  Patch by Santoso Wijaya.

7609 7610
- Issue #11684: complete email.parser bytes API by adding BytesHeaderParser.

7611 7612
- The bz2 module now handles 4GiB+ input buffers correctly.

Ezio Melotti's avatar
Ezio Melotti committed
7613 7614
- Issue #9233: Fix json.loads('{}') to return a dict (instead of a list), when
  _json is not available.
7615

Ezio Melotti's avatar
Ezio Melotti committed
7616
- Issue #11830: Remove unnecessary introspection code in the decimal module.
7617 7618

- Issue #11703: urllib2.geturl() does not return correct url when the original
7619
  url contains #fragment.
7620

7621 7622 7623
- Issue #10019: Fixed regression in json module where an indent of 0 stopped
  adding newlines and acted instead like 'None'.

7624 7625 7626
- Issue #11186: pydoc ignores a module if its name contains a surrogate
  character in the index of modules.

7627 7628 7629
- Issue #11815: Use a light-weight SimpleQueue for the result queue in
  concurrent.futures.ProcessPoolExecutor.

brian.curtin's avatar
brian.curtin committed
7630 7631 7632
- Issue #5162: Treat services like frozen executables to allow child spawning
  from multiprocessing.forking on Windows.

7633 7634 7635 7636
- logging.basicConfig now supports an optional 'handlers' argument taking an
  iterable of handlers to be added to the root logger. Additional parameter
  checks were also added to basicConfig.

7637 7638
- Issue #11814: Fix likely typo in multiprocessing.Pool._terminate().

7639 7640 7641
- Issue #11747: Fix range formatting in difflib.context_diff() and
  difflib.unified_diff().

7642 7643 7644 7645
- Issue #8428: Fix a race condition in multiprocessing.Pool when terminating
  worker processes: new processes would be spawned while the pool is being
  shut down.  Patch by Charles-François Natali.

7646 7647
- Issue #2650: re.escape() no longer escapes the '_'.

7648 7649 7650 7651
- Issue #11757: select.select() now raises ValueError when a negative timeout
  is passed (previously, a select.error with EINVAL would be raised).  Patch
  by Charles-François Natali.

7652 7653
- Issue #7311: fix html.parser to accept non-ASCII attribute values.

Georg Brandl's avatar
Georg Brandl committed
7654
- Issue #11605: email.parser.BytesFeedParser was incorrectly converting
Éric Araujo's avatar
Éric Araujo committed
7655
  multipart subparts with an 8-bit CTE into unicode instead of preserving the
Georg Brandl's avatar
Georg Brandl committed
7656
  bytes.
7657

Éric Araujo's avatar
Éric Araujo committed
7658 7659
- Issue #1690608: email.util.formataddr is now RFC 2047 aware:  it now has a
  charset parameter that defaults to utf-8 and is used as the charset for RFC
7660 7661
  2047 encoding when the realname contains non-ASCII characters.

7662 7663
- Issue #10963: Ensure that subprocess.communicate() never raises EPIPE.

7664 7665 7666
- Issue #10791: Implement missing method GzipFile.read1(), allowing GzipFile
  to be wrapped in a TextIOWrapper.  Patch by Nadeem Vawda.

7667 7668 7669
- Issue #11707: Added a fast C version of functools.cmp_to_key().
  Patch by Filip Gruszczyński.

7670 7671 7672
- Issue #11688: Add sqlite3.Connection.set_trace_callback().  Patch by
  Torsten Landschoff.

7673 7674 7675
- Issue #11746: Fix SSLContext.load_cert_chain() to accept elliptic curve
  private keys.

7676 7677 7678 7679
- Issue #5863: Rewrite BZ2File in pure Python, and allow it to accept
  file-like objects using a new ``fileobj`` constructor argument.  Patch by
  Nadeem Vawda.

7680 7681
- unittest.TestCase.assertSameElements has been removed.

7682 7683 7684
- sys.getfilesystemencoding() raises a RuntimeError if initfsencoding() was not
  called yet: detect bootstrap (startup) issues earlier.

7685 7686
- Issue #11393: Add the new faulthandler module.

7687 7688
- Issue #11618: Fix the timeout logic in threading.Lock.acquire() under Windows.

7689 7690 7691
- Removed the 'strict' argument to email.parser.Parser, which has been
  deprecated since Python 2.4.

7692 7693 7694
- Issue #11256: Fix inspect.getcallargs on functions that take only keyword
  arguments.

7695 7696
- Issue #11696: Fix ID generation in msilib.

7697 7698 7699
- itertools.accumulate now supports an optional *func* argument for
  a user-supplied binary function.

7700 7701
- Issue #11692: Remove unnecessary demo functions in subprocess module.

7702 7703 7704
- Issue #9696: Fix exception incorrectly raised by xdrlib.Packer.pack_int when
  trying to pack a negative (in-range) integer.

7705 7706 7707 7708
- Issue #11675: multiprocessing.[Raw]Array objects created from an integer size
  are now zeroed on creation.  This matches the behaviour specified by the
  documentation.

Martin v. Löwis's avatar
Martin v. Löwis committed
7709
- Issue #7639: Fix short file name generation in bdist_msi
7710

7711 7712 7713
- Issue #11635: Don't use polling in worker threads and processes launched by
  concurrent.futures.

7714 7715 7716
- Issue #5845: Automatically read readline configuration to enable completion
  in interactive mode.

7717 7718 7719 7720
- Issue #6811: Allow importlib to change a code object's co_filename attribute
  to match the path to where the source code currently is, not where the code
  object originally came from.

7721 7722
- Issue #8754: Have importlib use the repr of a module name in error messages.

7723 7724 7725
- Issue #11591: Prevent "import site" from modifying sys.path when python
  was started with -S.

7726 7727 7728 7729 7730
- collections.namedtuple() now adds a _source attribute to the generated
  class.  This make the source more accessible than the outdated
  "verbose" option which prints to stdout but doesn't make the source
  string available.

7731 7732 7733
- Issue #11371: Mark getopt error messages as localizable.  Patch by Filip
  Gruszczyński.

7734 7735
- Issue #11333: Add __slots__ to collections ABCs.

7736
- Issue #11628: cmp_to_key generated class should use __slots__.
7737

7738 7739 7740
- Issue #11666: let help() display named tuple attributes and methods
  that start with a leading underscore.

Guido van Rossum's avatar
Guido van Rossum committed
7741 7742 7743
- Issue #11662: Make urllib and urllib2 ignore redirections if the
  scheme is not HTTP, HTTPS or FTP (CVE-2011-1521).

7744 7745 7746
- Issue #5537: Fix time2isoz() and time2netscape() functions of
  httplib.cookiejar for expiration year greater than 2038 on 32-bit systems.

7747 7748
- Issue #4391: Use proper gettext plural forms in optparse.

7749 7750
- Issue #11127: Raise a TypeError when trying to pickle a socket object.

7751
- Issue #11563: ``Connection: close`` header is sent by requests using URLOpener
Senthil Kumaran's avatar
Senthil Kumaran committed
7752 7753 7754
  class which helps in closing of sockets after connection is over. Patch
  contributions by Jeff McNeil and Nadeem Vawda.

7755 7756 7757
- Issue #11459: A ``bufsize`` value of 0 in subprocess.Popen() really creates
  unbuffered pipes, such that select() works properly on them.

7758 7759
- Issue #5421: Fix misleading error message when one of socket.sendto()'s
  arguments has the wrong type.  Patch by Nikita Vetoshkin.
7760

7761
- Issue #10812: Add some extra posix functions to the os module.
7762 7763 7764 7765

- Issue #10979: unittest stdout buffering now works with class and module
  setup and teardown.

7766 7767 7768
- Issue #11243: fix the parameter querying methods of Message to work if
  the headers contain un-encoded non-ASCII data.

7769 7770 7771
- Issue #11401: fix handling of headers with no value; this fixes a regression
  relative to Python2 and the result is now the same as it was in Python2.

7772 7773 7774 7775
- Issue #9298: base64 bodies weren't being folded to line lengths less than 78,
  which was a regression relative to Python2.  Unlike Python2, the last line
  of the folded body now ends with a carriage return.

Nick Coghlan's avatar
Nick Coghlan committed
7776
- Issue #11560: shutil.unpack_archive now correctly handles the format
Nick Coghlan's avatar
Nick Coghlan committed
7777 7778
  parameter. Patch by Evan Dandrea.

7779 7780
- Issue #5870: Add `subprocess.DEVNULL` constant.

7781
- Issue #11133: fix two cases where inspect.getattr_static can trigger code
Benjamin Peterson's avatar
Benjamin Peterson committed
7782
  execution. Patch by Andreas Stührk.
7783

7784 7785 7786 7787
- Issue #11569: use absolute path to the sysctl command in multiprocessing to
  ensure that it will be found regardless of the shell PATH. This ensures
  that multiprocessing.cpu_count works on default installs of MacOSX.

7788 7789 7790 7791
- Issue #11501: disutils.archive_utils.make_zipfile no longer fails if zlib is
  not installed. Instead, the zipfile.ZIP_STORED compression is used to create
  the ZipFile. Patch by Natalia B. Bidart.

7792
- Issue #11289: `smtp.SMTP` class is now a context manager so it can be used
7793 7794
  in a `with` statement.  Contributed by Giampaolo Rodola.

7795 7796 7797
- Issue #11554: Fixed support for Japanese codecs; previously the body output
  encoding was not done if euc-jp or shift-jis was specified as the charset.

7798 7799 7800
- Issue #11407: `TestCase.run` returns the result object used or created.
  Contributed by Janathan Hartley.

7801
- Issue #11500: Fixed a bug in the OS X proxy bypass code for fully qualified
Antoine Pitrou's avatar
Antoine Pitrou committed
7802
  IP addresses in the proxy exception list.
7803

7804 7805 7806 7807
- Issue #11491: dbm.error is no longer raised when dbm.open is called with
  the "n" as the flag argument and the file exists. The behavior matches
  the documentation and general logic.

Éric Araujo's avatar
Éric Araujo committed
7808
- Issue #1162477: Postel Principle adjustment to email date parsing: handle the
7809 7810
  fact that some non-compliant MUAs use '.' instead of ':' in time specs.

7811 7812 7813
- Issue #11131: Fix sign of zero in decimal.Decimal plus and minus
  operations when the rounding mode is ROUND_FLOOR.

7814 7815
- Issue #9935: Speed up pickling of instances of user-defined classes.

7816 7817 7818
- Issue #5622: Fix curses.wrapper to raise correct exception if curses
  initialization fails.

7819 7820 7821
- Issue #11408: In threading.Lock.acquire(), only call gettimeofday() when
  really necessary.  Patch by Charles-François Natali.

7822 7823 7824 7825
- Issue #11391: Writing to a mmap object created with
  ``mmap.PROT_READ|mmap.PROT_EXEC`` would segfault instead of raising a
  TypeError.  Patch by Charles-François Natali.

7826 7827
- Issue #9795: add context manager protocol support for nntplib.NNTP class.

7828 7829 7830 7831
- Issue #11306: mailbox in certain cases adapts to an inability to open
  certain files in read-write mode.  Previously it detected this by
  checking for EACCES, now it also checks for EROFS.

7832 7833 7834
- Issue #11265: asyncore now correctly handles EPIPE, EBADF and EAGAIN errors
  on accept(), send() and recv().

7835 7836
- Issue #11377: Deprecate platform.popen() and reimplement it with os.popen().

7837 7838
- Issue #8513: On UNIX, subprocess supports bytes command string.

7839 7840
- Issue #10866: Add socket.sethostname().  Initial patch by Ross Lagerwall.

7841 7842
- Issue #11140: Lock.release() now raises a RuntimeError when attempting
  to release an unacquired lock, as claimed in the threading documentation.
Antoine Pitrou's avatar
Antoine Pitrou committed
7843
  The _thread.error exception is now an alias of RuntimeError.  Patch by
7844
  Filip Gruszczyński.  Patch for _dummy_thread by Aymeric Augustin.
7845

7846
- Issue #8594: ftplib now provides a source_address parameter to specify which
7847 7848
  (address, port) to bind to before connecting.

7849 7850 7851
- Issue #11326: Add the missing connect_ex() implementation for SSL sockets,
  and make it work for non-blocking connects.

7852 7853
- Issue #11297: Add collections.ChainMap().

7854
- Issue #10755: Add the posix.flistdir() function.  Patch by Ross Lagerwall.
7855

Georg Brandl's avatar
Georg Brandl committed
7856 7857
- Issue #4761: Add the ``*at()`` family of functions (openat(), etc.) to the
  posix module.  Patch by Ross Lagerwall.
7858

7859 7860 7861
- Issue #7322: Trying to read from a socket's file-like object after a timeout
  occurred now raises an error instead of silently losing data.

7862
- Issue #11291: poplib.POP no longer suppresses errors on quit().
7863

7864
- Issue #11177: asyncore's create_socket() arguments can now be omitted.
7865

7866 7867 7868 7869 7870
- Issue #6064: Add a ``daemon`` keyword argument to the threading.Thread
  and multiprocessing.Process constructors in order to override the
  default behaviour of inheriting the daemonic property from the current
  thread/process.

7871 7872 7873
- Issue #10956: Buffered I/O classes retry reading or writing after a signal
  has arrived and the handler returned successfully.

7874 7875
- Issue #10784: New os.getpriority() and os.setpriority() functions.

7876 7877 7878 7879
- Issue #11114: Fix catastrophic performance of tell() on text files (up
  to 1000x faster in some cases).  It is still one to two order of magnitudes
  slower than binary tell().

7880
- Issue #10882: Add os.sendfile function.
7881

7882 7883 7884
- Issue #10868: Allow usage of the register method of an ABC as a class
  decorator.

7885 7886 7887 7888
- Issue #11224: Fixed a regression in tarfile that affected the file-like
  objects returned by TarFile.extractfile() regarding performance, memory
  consumption and failures with the stream interface.

7889 7890 7891 7892
- Issue #10924: Adding salt and Modular Crypt Format to crypt library.
  Moved old C wrapper to _crypt, and added a Python wrapper with
  enhanced salt generation and simpler API for password generation.

7893 7894
- Issue #11074: Make 'tokenize' so it can be reloaded.

7895 7896 7897 7898 7899
- Issue #11085: Moved collections abstract base classes into a separate
  module called collections.abc, following the pattern used by importlib.abc.
  For backwards compatibility, the names are imported into the collections
  module.

7900 7901 7902 7903
- Issue #4681: Allow mmap() to work on file sizes and offsets larger than
  4GB, even on 32-bit builds.  Initial patch by Ross Lagerwall, adapted for
  32-bit Windows.

7904 7905 7906
- Issue #11169: compileall module uses repr() to format filenames and paths to
  escape surrogate characters and show spaces.

7907
- Issue #11089: Fix performance issue limiting the use of ConfigParser()
7908
  with large config files.
7909

7910 7911 7912
- Issue #10276: Fix the results of zlib.crc32() and zlib.adler32() on buffers
  larger than 4GB.  Patch by Nadeem Vawda.

7913 7914
- Issue #11388: Added a clear() method to MutableSequence

7915 7916 7917
- Issue #11174: Add argparse.MetavarTypeHelpFormatter, which uses type names
  for the names of optional and positional arguments in help messages.

7918 7919
- Issue #9348: Raise an early error if argparse nargs and metavar don't match.

7920 7921
- Issue #9026: Fix order of argparse sub-commands in help messages.

7922 7923
- Issue #9347: Fix formatting for tuples in argparse type= error messages.

7924 7925 7926
- Issue #12191: Added shutil.chown() to change user and/or group owner of a
  given path also specifying their names.

7927 7928 7929
- Issue #13988: The _elementtree accelerator is used whenever available.
  Now xml.etree.cElementTree becomes a deprecated alias to ElementTree.

7930 7931 7932
Build
-----

Martin v. Löwis's avatar
Martin v. Löwis committed
7933 7934
- Issue #6807: Run msisupport.mak earlier.

Martin v. Löwis's avatar
Martin v. Löwis committed
7935 7936
- Issue #10580: Minor grammar change in Windows installer.

7937 7938
- Issue #13326: Clean __pycache__ directories correctly on OpenBSD.

7939 7940
- PEP 393: the configure option --with-wide-unicode is removed.

7941 7942 7943
- Issue #12852: Set _XOPEN_SOURCE to 700, instead of 600, to get POSIX 2008
  functions on OpenBSD (e.g. fdopendir).

7944 7945 7946 7947
- Issue #11863: Remove support for legacy systems deprecated in Python 3.2
  (following PEP 11).  These systems are systems using Mach C Threads,
  SunOS lightweight processes, GNU pth threads and IRIX threads.

7948 7949
- Issue #8746: Correct faulty configure checks so that os.chflags() and
  os.lchflags() are once again built on systems that support these
Georg Brandl's avatar
Georg Brandl committed
7950
  functions (BSD and OS X).  Also add new stat file flags for OS X
7951 7952
  (UF_HIDDEN and UF_COMPRESSED).

7953
- Issue #10645: Installing Python no longer creates a
7954 7955
  Python-X.Y.Z-pyX.Y.egg-info file in the lib-dynload directory.

7956 7957 7958
- Do not accidentally include the directory containing sqlite.h twice when
  building sqlite3.

7959 7960 7961 7962
- Issue #11217: For 64-bit/32-bit Mac OS X universal framework builds,
  ensure "make install" creates symlinks in --prefix bin for the "-32"
  files in the framework bin directory like the installer does.

7963
- Issue #11347: Use --no-as-needed when linking libpython3.so.
7964

Thomas Wouters's avatar
Thomas Wouters committed
7965
- Issue #11411: Fix 'make DESTDIR=' with a relative destination.
Georg Brandl's avatar
Georg Brandl committed
7966

7967 7968
- Issue #11268: Prevent Mac OS X Installer failure if Documentation
  package had previously been installed.
7969

7970
- Issue #11495: OSF support is eliminated. It was deprecated in Python 3.2.
7971

7972 7973 7974
IDLE
----

7975 7976 7977 7978 7979 7980 7981 7982 7983 7984 7985 7986 7987 7988 7989 7990 7991 7992 7993 7994 7995 7996 7997 7998 7999 8000 8001 8002 8003 8004 8005 8006 8007 8008 8009 8010 8011 8012 8013 8014 8015 8016 8017 8018 8019 8020 8021 8022 8023 8024 8025 8026
- Issue #14409: IDLE now properly executes commands in the Shell window
  when it cannot read the normal config files on startup and
  has to use the built-in default key bindings.
  There was previously a bug in one of the defaults.

- IDLE can be launched as python -m idlelib

- Issue #3573: IDLE hangs when passing invalid command line args
  (directory(ies) instead of file(s)) (Patch by Guilherme Polo)

- Issue #14200: IDLE shell crash on printing non-BMP unicode character.

- Issue #5219: Prevent event handler cascade in IDLE.

- Issue #964437: Make IDLE help window non-modal.
  Patch by Guilherme Polo and Roger Serwy.

- Issue #13933: IDLE auto-complete did not work with some imported
  module, like hashlib.  (Patch by Roger Serwy)

- Issue #13506: Add '' to path for IDLE Shell when started and restarted with Restart Shell.
  Original patches by Marco Scataglini and Roger Serwy.

- Issue #4625: If IDLE cannot write to its recent file or breakpoint files,
  display a message popup and continue rather than crash.  Original patch by
  Roger Serwy.

- Issue #8641: Update IDLE 3 syntax coloring to recognize b".." and not u"..".
  Patch by Tal Einat.

- Issue #13296: Fix IDLE to clear compile __future__ flags on shell restart.
  (Patch by Roger Serwy)

- Issue #9871: Prevent IDLE 3 crash when given byte stings
  with invalid hex escape sequences, like b'\x0'.
  (Original patch by Claudiu Popa.)

- Issue #12636: IDLE reads the coding cookie when executing a Python script.

- Issue #12540: Prevent zombie IDLE processes on Windows due to changes
  in os.kill().

- Issue #12590: IDLE editor window now always displays the first line
  when opening a long file.  With Tk 8.5, the first line was hidden.

- Issue #11088: don't crash when using F5 to run a script in IDLE on MacOSX
  with Tk 8.5.

- Issue #1028: Tk returns invalid Unicode null in %A: UnicodeDecodeError.
  With Tk < 8.5 _tkinter.c:PythonCmd() raised UnicodeDecodeError, caused
  IDLE to exit.  Converted to valid Unicode null in PythonCmd().

8027 8028
- Issue #11718: IDLE's open module dialog couldn't find the __init__.py
  file in a package.
8029

8030 8031 8032
Tools/Demos
-----------

8033 8034 8035
- Issue #14053: patchcheck.py ("make patchcheck") now works with MQ patches.
  Patch by Francisco Martín Brugué.

8036 8037 8038 8039 8040
- Issue #13930: 2to3 is now able to write its converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.  See its new -o, -W and --add-suffix options.  This makes it more
  useful in many automated code translation workflows.

8041 8042 8043
- Issue #13628: python-gdb.py is now able to retrieve more frames in the Python
  traceback if Python is optimized.

8044 8045 8046
- Issue #11996: libpython (gdb), replace "py-bt" command by "py-bt-full" and
  add a smarter "py-bt" command printing a classic Python traceback.

8047 8048
- Issue #11179: Make ccbench work under Python 3.1 and 2.7 again.

8049 8050
- Issue #10639: reindent.py no longer converts newlines and will raise
  an error if attempting to convert a file with mixed newlines.
8051
  "--newline" option added to specify new line character.
8052

Ezio Melotti's avatar
Ezio Melotti committed
8053 8054
Extension Modules
-----------------
8055

8056 8057 8058 8059
- Issue #16847: Fixed improper use of _PyUnicode_CheckConsistency() in
  non-pydebug builds. Several extension modules now compile cleanly when
  assert()s are enabled in standard builds (-DDEBUG flag).

8060 8061 8062
- Issue #13840: The error message produced by ctypes.create_string_buffer
  when given a Unicode string has been fixed.

8063 8064 8065
- Issue #9975: socket: Fix incorrect use of flowinfo and scope_id. Patch by
  Vilmos Nebehaj.

8066 8067
- Issue #7777: socket: Add Reliable Datagram Sockets (PF_RDS) support.

8068 8069 8070
- Issue #13159: FileIO and BZ2Compressor/BZ2Decompressor now use a linear-time
  buffer growth strategy instead of a quadratic-time one.

8071 8072 8073
- Issue #10141: socket: Add SocketCAN (PF_CAN) support. Initial patch by
  Matthias Fuchs, updated by Tiago Gonçalves.

8074 8075 8076 8077
- Issue #13070: Fix a crash when a TextIOWrapper caught in a reference cycle
  would be finalized after the reference to its underlying BufferedRWPair's
  writer got cleared by the GC.

8078 8079
- Issue #12881: ctypes: Fix segfault with large structure field names.

8080 8081 8082
- Issue #13058: ossaudiodev: fix a file descriptor leak on error. Patch by
  Thomas Jarosch.

8083 8084 8085
- Issue #13013: ctypes: Fix a reference leak in PyCArrayType_from_ctype.
  Thanks to Suman Saha for finding the bug and providing a patch.

8086 8087 8088
- Issue #13022: Fix: _multiprocessing.recvfd() doesn't check that
  file descriptor was actually received.

8089 8090 8091
- Issue #1172711: Add 'long long' support to the array module.
  Initial patch by Oren Tirosh and Hirokazu Yamamoto.

8092 8093 8094
- Issue #12483: ctypes: Fix a crash when the destruction of a callback
  object triggers the garbage collector.

Jesus Cea's avatar
NEWS  
Jesus Cea committed
8095 8096 8097
- Issue #12950: Fix passing file descriptors in multiprocessing, under
  OpenIndiana/Illumos.

8098 8099 8100
- Issue #12764: Fix a crash in ctypes when the name of a Structure field is not
  a string.

Amaury Forgeot d'Arc's avatar
Amaury Forgeot d'Arc committed
8101 8102 8103 8104 8105
- Issue #11241: subclasses of ctypes.Array can now be subclassed.

- Issue #9651: Fix a crash when ctypes.create_string_buffer(0) was passed to
  some functions like file.write().

8106 8107 8108 8109
- Issue #10309: Define _GNU_SOURCE so that mremap() gets the proper
  signature.  Without this, architectures where sizeof void* != sizeof int are
  broken.  Patch given by Hallvard B Furuseth.

Ezio Melotti's avatar
Ezio Melotti committed
8110 8111
- Issue #12051: Fix segfault in json.dumps() while encoding highly-nested
  objects using the C accelerations.
8112

Ezio Melotti's avatar
Ezio Melotti committed
8113 8114
- Issue #12017: Fix segfault in json.loads() while decoding highly-nested
  objects using the C accelerations.
8115

Benjamin Peterson's avatar
Benjamin Peterson committed
8116 8117
- Issue #1838: Prevent segfault in ctypes, when _as_parameter_ on a class is set
  to an instance of the class.
8118

8119
Tests
8120
-----
8121

8122 8123 8124 8125 8126 8127 8128 8129 8130 8131 8132 8133 8134 8135 8136 8137 8138 8139 8140 8141 8142 8143 8144 8145 8146 8147 8148
- Issue #13125: Silence spurious test_lib2to3 output when in non-verbose mode.
  Patch by Mikhail Novikov.

- Issue #13447: Add a test file to host regression tests for bugs in the
  scripts found in the Tools directory.

- Issue #10881: Fix test_site failure with OS X framework builds.

- Issue #13901: Prevent test_distutils failures on OS X with --enable-shared.

- Issue #13862: Fix spurious failure in test_zlib due to runtime/compile time
  minor versions not matching.

- Issue #12804: Fix test_socket and test_urllib2net failures when running tests
  on a system without internet access.

- Issue #13726: Fix the ambiguous -S flag in regrtest. It is -o/--slow for slow
  tests.

- Issue #11659: Fix ResourceWarning in test_subprocess introduced by #11459.
  Patch by Ben Hayden.

- Issue #11577: fix ResourceWarning triggered by improved binhex test coverage

- Issue #11509: Significantly increase test coverage of fileinput.
  Patch by Denver Coneybeare at PyCon 2011 Sprints.

Petri Lehtinen's avatar
Petri Lehtinen committed
8149 8150
- Issue #11689: Fix a variable scoping error in an sqlite3 test

8151 8152
- Issue #13786: Remove unimplemented 'trace' long option from regrtest.py.

Meador Inge's avatar
Meador Inge committed
8153 8154 8155
- Issue #13725: Fix regrtest to recognize the documented -d flag.
  Patch by Erno Tukia.

8156 8157 8158
- Issue #13304: Skip test case if user site-packages disabled (-s or
  PYTHONNOUSERSITE).  (Patch by Carl Meyer)

8159 8160 8161
- Issue #5661: Add a test for ECONNRESET/EPIPE handling to test_asyncore. Patch
  by Xavier de Gaye.

8162 8163
- Issue #13218: Fix test_ssl failures on Debian/Ubuntu.

8164 8165 8166
- Re-enable lib2to3's test_parser.py tests, though with an expected failure
  (see issue 13125).

8167 8168
- Issue #12656: Add tests for IPv6 and Unix sockets to test_asyncore.

8169 8170
- Issue #6484: Add unit tests for mailcap module (patch by Gregory Nofi)

8171 8172 8173 8174 8175
- Issue #11651: Improve the Makefile test targets to run more of the test suite
  more quickly. The --multiprocess option is now enabled by default, reducing
  the amount of time needed to run the tests. "make test" and "make quicktest"
  now include some resource-intensive tests, but no longer run the test suite
  twice to check for bugs in .pyc generation. Tools/scripts/run_test.py provides
Éric Araujo's avatar
Éric Araujo committed
8176
  an easy platform-independent way to run test suite with sensible defaults.
8177

8178 8179 8180
- Issue #12331: The test suite for the packaging module can now run from an
  installed Python.

8181 8182 8183
- Issue #12331: The test suite for lib2to3 can now run from an installed
  Python.

8184 8185 8186 8187 8188
- Issue #12626: In regrtest, allow to filter tests using a glob filter
  with the ``-m`` (or ``--match``) option.  This works with all test cases
  using the unittest module.  This is useful with long test suites
  such as test_io or test_subprocess.

8189 8190 8191 8192 8193
- Issue #12624: It is now possible to fail after the first failure when
  running in verbose mode (``-v`` or ``-W``), by using the ``--failfast``
  (or ``-G``) option to regrtest.  This is useful with long test suites
  such as test_io or test_subprocess.

8194 8195 8196
- Issue #12587: Correct faulty test file and reference in test_tokenize.
  (Patch by Robert Xiao)

8197 8198
- Issue #12573: Add resource checks for dangling Thread and Process objects.

8199 8200 8201
- Issue #12549: Correct test_platform to not fail when OS X returns 'x86_64'
  as the processor type on some Mac systems.

8202 8203 8204
- Skip network tests when getaddrinfo() returns EAI_AGAIN, meaning a temporary
  failure in name resolution.

8205 8206 8207
- Issue #11812: Solve transient socket failure to connect to 'localhost'
  in test_telnetlib.py.

8208 8209
- Solved a potential deadlock in test_telnetlib.py. Related to issue #11812.

8210 8211 8212 8213
- Avoid failing in test_robotparser when mueblesmoraleda.com is flaky and
  an overzealous DNS service (e.g. OpenDNS) redirects to a placeholder
  Web site.

8214 8215 8216 8217
- Avoid failing in test_urllibnet.test_bad_address when some overzealous
  DNS service (e.g. OpenDNS) resolves a non-existent domain name.  The test
  is now skipped instead.

8218 8219 8220 8221
- Issue #12440: When testing whether some bits in SSLContext.options can be
  reset, check the version of the OpenSSL headers Python was compiled against,
  rather than the runtime version of the OpenSSL library.

8222 8223
- Issue #11512: Add a test suite for the cgitb module. Patch by Robbie Clemons.

8224 8225 8226 8227
- Issue #12497: Install test/data to prevent failures of the various codecmaps
  tests.

- Issue #12496: Install test/capath directory to prevent test_connect_capath
8228 8229
  testcase failure in test_ssl.

8230 8231 8232 8233
- Issue #12469: Run wakeup and pending signal tests in a subprocess to run the
  test in a fresh process with only one thread and to not change signal
  handling of the parent process.

8234 8235 8236 8237
- Issue #8716: Avoid crashes caused by Aqua Tk on OSX when attempting to run
  test_tk or test_ttk_guionly under a username that is not currently logged
  in to the console windowserver (as may be the case under buildbot or ssh).

8238 8239
- Issue #12407: Explicitly skip test_capi.EmbeddingTest under Windows.

8240 8241 8242 8243
- Issue #12400: regrtest -W doesn't rerun the tests twice anymore, but captures
  the output and displays it on failure instead. regrtest -v doesn't print the
  error twice anymore if there is only one error.

8244 8245 8246 8247 8248
- Issue #12141: Install copies of template C module file so that
  test_build_ext of test_distutils and test_command_build_ext of
  test_packaging are no longer silently skipped when
  run outside of a build directory.

8249 8250 8251
- Issue #8746: Add additional tests for os.chflags() and os.lchflags().
  Patch by Garrett Cooper.

8252 8253 8254
- Issue #10736: Fix test_ttk test_widgets failures with Cocoa Tk 8.5.9
  2.8 +  on Mac OS X.  (Patch by Ronald Oussoren)

8255 8256 8257
- Issue #12057: Add tests for ISO 2022 codecs (iso2022_jp, iso2022_jp_2,
  iso2022_kr).

8258 8259 8260
- Issue #12096: Fix a race condition in test_threading.test_waitfor(). Patch
  written by Charles-François Natali.

8261 8262 8263
- Issue #11614: import __hello__ prints "Hello World!". Patch written by
  Andreas Stührk.

Ezio Melotti's avatar
Ezio Melotti committed
8264 8265
- Issue #5723: Improve json tests to be executed with and without accelerations.

8266 8267
- Issue #12041: Make test_wait3 more robust.

8268 8269 8270
- Issue #11873: Change regex in test_compileall to fix occasional failures when
  when the randomly generated temporary path happened to match the regex.

8271 8272 8273
- Issue #11958: Fix FTP tests for IPv6, bind to "::1" instead of "localhost".
  Patch written by Charles-Francois Natali.

8274 8275 8276 8277
- Issue #8407, #11859: Fix tests of test_io using threads and an alarm: use
  pthread_sigmask() to ensure that the SIGALRM signal is received by the main
  thread.

8278 8279 8280 8281
- Issue #11811: Factor out detection of IPv6 support on the current host
  and make it available as ``test.support.IPV6_ENABLED``.  Patch by
  Charles-François Natali.

Antoine Pitrou's avatar
Antoine Pitrou committed
8282 8283
- Issue #10914: Add a minimal embedding test to test_capi.

8284 8285 8286 8287 8288 8289
- Issue #11223: Skip test_lock_acquire_interruption() and
  test_rlock_acquire_interruption() of test_threadsignals if a thread lock is
  implemented using a POSIX mutex and a POSIX condition variable. A POSIX
  condition variable cannot be interrupted by a signal (e.g. on Linux, the
  futex system call is restarted).

8290 8291
- Issue #11790: Fix sporadic failures in test_multiprocessing.WithProcessesTestCondition.

8292 8293
- Fix possible "file already exists" error when running the tests in parallel.

Ross Lagerwall's avatar
Ross Lagerwall committed
8294 8295
- Issue #11719: Fix message about unexpected test_msilib skip on non-Windows
  platforms. Patch by Nadeem Vawda.
8296

8297 8298
- Issue #11727: Add a --timeout option to regrtest: if a test takes more than
  TIMEOUT seconds, dumps the traceback of all threads and exits.
8299

8300 8301
- Issue #11653: fix -W with -j in regrtest.

8302 8303 8304 8305 8306
- The email test suite now lives in the Lib/test/test_email package.  The test
  harness code has also been modernized to allow use of new unittest features.

- regrtest now discovers test packages as well as test modules.

8307
- Issue #11577: improve test coverage of binhex.py. Patch by Arkady Koplyarov.
8308

8309 8310 8311
- New test_crashers added to exercise the scripts in the Lib/test/crashers
  directory and confirm they fail as expected

Éric Araujo's avatar
Éric Araujo committed
8312
- Issue #11578: added test for the timeit module.  Patch by Michael Henry.
8313

8314 8315
- Issue #11503: improve test coverage of posixpath.py. Patch by Evan Dandrea.

8316 8317
- Issue #11505: improves test coverage of string.py, increases granularity of
  string.Formatter tests. Initial patch by Alicia Arlen.
8318

Nick Coghlan's avatar
Nick Coghlan committed
8319 8320 8321
- Issue #11548: Improve test coverage of the shutil module. Patch by
  Evan Dandrea.

8322 8323
- Issue #11554: Reactivated test_email_codecs.

8324 8325
- Issue #11505: improves test coverage of string.py. Patch by Alicia
  Arlen
8326

8327
- Issue #11490: test_subprocess.test_leaking_fds_on_error no longer gives a
8328 8329
  false positive if the last directory in the path is inaccessible.

8330 8331 8332
- Issue #11223: Fix test_threadsignals to fail, not hang, when the
  non-semaphore implementation of locks is used under POSIX.

8333 8334 8335
- Issue #10911: Add tests on CGI with non-ASCII characters. Patch written by
  Pierre Quentel.

8336 8337 8338
- Issue #9931: Fix hangs in GUI tests under Windows in certain conditions.
  Patch by Hirokazu Yamamoto.

8339 8340
- Issue #10512: Properly close sockets under test.test_cgi.

8341 8342
- Issue #10992: Make tests pass under coverage.

8343 8344 8345
- Issue #10826: Prevent sporadic failure in test_subprocess on Solaris due
  to open door files.

8346 8347
- Issue #10990: Prevent tests from clobbering a set trace function.

8348 8349 8350
C-API
-----

8351 8352 8353 8354 8355 8356 8357 8358 8359 8360 8361 8362 8363 8364 8365 8366 8367
- Issue #13452: PyUnicode_EncodeDecimal() doesn't support error handlers
  different than "strict" anymore. The caller was unable to compute the
  size of the output buffer: it depends on the error handler.

- Issue #13560: Add PyUnicode_DecodeLocale(), PyUnicode_DecodeLocaleAndSize()
  and PyUnicode_EncodeLocale() functions to the C API to decode/encode from/to
  the current locale encoding.

- Issue #10831: PyUnicode_FromFormat() supports %li, %lli and %zi formats.

- Issue #11246: Fix PyUnicode_FromFormat("%V") to decode the byte string from
  UTF-8 (with replace error handler) instead of ISO-8859-1 (in strict mode).
  Patch written by Ray Allen.

- Issue #10830: Fix PyUnicode_FromFormatV("%c") for non-BMP characters on
  narrow build.

8368 8369 8370 8371
- Add PyObject_GenericGetDict and PyObject_GeneriSetDict. They are generic
  implementations for the getter and setter of a ``__dict__`` descriptor of C
  types.

8372 8373 8374 8375
- Issue #13727: Add 3 macros to access PyDateTime_Delta members:
  PyDateTime_DELTA_GET_DAYS, PyDateTime_DELTA_GET_SECONDS,
  PyDateTime_DELTA_GET_MICROSECONDS.

8376 8377 8378 8379
- Issue #10542: Add 4 macros to work with surrogates: Py_UNICODE_IS_SURROGATE,
  Py_UNICODE_IS_HIGH_SURROGATE, Py_UNICODE_IS_LOW_SURROGATE,
  Py_UNICODE_JOIN_SURROGATES.

Brian Curtin's avatar
Brian Curtin committed
8380 8381
- Issue #12724: Add Py_RETURN_NOTIMPLEMENTED macro for returning NotImplemented.

Benjamin Peterson's avatar
Benjamin Peterson committed
8382 8383
- PY_PATCHLEVEL_REVISION has been removed, since it's meaningless with
  Mercurial.
8384

8385
- Issue #12173: The first argument of PyImport_ImportModuleLevel is now `const
Benjamin Peterson's avatar
Benjamin Peterson committed
8386
  char *` instead of `char *`.
8387

8388 8389
- Issue #12380: PyArg_ParseTuple now accepts a bytearray for the 'c' format.

8390 8391 8392
Documentation
-------------

8393 8394 8395 8396 8397 8398 8399 8400 8401 8402 8403 8404 8405 8406 8407
- Issue #13989: Document that GzipFile does not support text mode, and give a
  more helpful error message when opened with an invalid mode string.

- Issue #13921: Undocument and clean up sqlite3.OptimizedUnicode,
  which is obsolete in Python 3.x. It's now aliased to str for
  backwards compatibility.

- Issue #12102: Document that buffered files must be flushed before being used
  with mmap. Patch by Steffen Daode Nurpmeso.

- Issue #8982: Improve the documentation for the argparse Namespace object.

- Issue #9343: Document that argparse parent parsers must be configured before
  their children.

Hynek Schlawack's avatar
Hynek Schlawack committed
8408 8409
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.
8410

Petri Lehtinen's avatar
Petri Lehtinen committed
8411 8412
- Issues #13491 and #13995: Fix many errors in sqlite3 documentation.
  Initial patch for #13491 by Johannes Vogel.
Petri Lehtinen's avatar
Petri Lehtinen committed
8413

Petri Lehtinen's avatar
Petri Lehtinen committed
8414 8415
- Issue #13402: Document absoluteness of sys.executable.

8416 8417
- Issue #13883: PYTHONCASEOK also works on OS X.

8418 8419 8420 8421 8422 8423 8424
- Issue #9021: Add an introduction to the copy module documentation.

- Issue #6005: Examples in the socket library documentation use sendall, where
  relevant, instead send method.

- Issue #12798: Updated the mimetypes documentation.

8425 8426 8427
- Issue #12949: Document the kwonlyargcount argument for the PyCode_New
  C API function.

8428 8429 8430
- Issue #13513: Fix io.IOBase documentation to correctly link to the
  io.IOBase.readline method instead of the readline module.

8431 8432 8433
- Issue #13237: Reorganise subprocess documentation to emphasise convenience
  functions and the most commonly needed arguments to Popen.

Florent Xicluna's avatar
Florent Xicluna committed
8434 8435
- Issue #13141: Demonstrate recommended style for socketserver examples.

8436 8437
- Issue #11818: Fix tempfile examples for Python 3.

Georg Brandl's avatar
Georg Brandl committed
8438

8439
**(For information about older versions, consult the HISTORY file.)**