NEWS 321 KB
Newer Older
Georg Brandl's avatar
Georg Brandl committed
1
+++++++++++
2
Python News
3 4
+++++++++++

5 6 7
What's New in Python 3.4.1?
===========================

8 9 10
Core and Builtins
-----------------

11 12 13
- Issue #20731: Properly position in source code files even if they
  are opened in text mode. Patch by Serhiy Storchaka.

14 15 16
- Issue #20637: Key-sharing now also works for instance dictionaries of
  subclasses.  Patch by Peter Ingebretson.

17 18 19
- Issue #20786: Fix signatures for dict.__delitem__ and
  property.__delete__ builtins.

20 21 22
Library
-------

23 24 25
- Issue #20875: Prevent possible gzip "'read' is not defined" NameError.
  Patch by Claudiu Popa.

26 27 28 29
- Issue #11558: ``email.message.Message.attach`` now returns a more
  useful error message if ``attach`` is called on a message for which
  ``is_multipart`` is False.

30 31 32 33
- Issue #20283: RE pattern methods now accept the string keyword parameters
  as documented.  The pattern and source keyword parameters are left as
  deprecated aliases.

34 35 36 37
- Issue #20839: Don't trigger a DeprecationWarning in the still supported
  pkgutil.get_loader() API when __loader__ isn't set on a module (nor
  when pkgutil.find_loader() is called directly).

38 39
- Issue #20778: Fix modulefinder to work with bytecode-only modules.

40 41 42
- Issue #20791: copy.copy() now doesn't make a copy when the input is
  a bytes object.  Initial patch by Peter Otten.

43 44 45
- Issue #19748: On AIX, time.mktime() now raises an OverflowError for year
  outsize range [1902; 2037].

46 47 48 49 50 51
Documentation
-------------

- Issue #20765: Add missing documentation for PurePath.with_name() and
  PurePath.with_suffix().

52 53 54 55 56
Tests
-----

- Issue #20743: Fix a reference leak in test_tcl.

57 58 59
Build
-----

60 61
- Issue #14512: Launch pydoc -b instead of pydocgui.pyw on Windows.

62 63 64
- Issue #20748: Uninstalling pip does not leave behind the pyc of
  the uninstaller anymore.

65 66 67
- Issue #20568: The Windows installer now installs the unversioned ``pip``
  command in addition to the versioned ``pip3`` and ``pip3.4`` commands.

68 69 70 71
- Issue #20757: The ensurepip helper for the Windows uninstaller now skips
  uninstalling pip (rather than failing) if the user has updated pip to a
  different version from the one bundled with ensurepip.

72 73
- Issue #20465: Update OS X and Windows installer builds to use 
  SQLite 3.8.3.1.
74

75 76 77 78 79 80
Tools/Demos
-----------

- Issue #20535: PYTHONWARNING no longer affects the run_tests.py script.
  Patch by Arfrever Frehtes Taifersar Arahesis.

81

82 83 84 85 86 87 88 89
What's New in Python 3.4.0 release candidate 2?
===============================================

Release date: 2014-02-23

Core and Builtins
-----------------

90 91 92
- Issue #20261: In pickle, lookup __getnewargs__ and __getnewargs_ex__ on the
  type of the object.

93 94 95
- Issue #20619: Give the AST nodes of keyword-only arguments a column and line
  number.

96 97 98 99
- Issue #20526: Revert changes of issue #19466 which introduces a regression:
  don't clear anymore the state of Python threads early during the Python
  shutdown.

100 101
- Issue #20595: Make getargs.c C89 compliant.

102 103 104
- Issue #20625: Parameter names in __annotations__ were not mangled properly.
  Discovered by Jonas Wielicki, patch by Yury Selivanov.

105 106
Library
-------
107 108 109

- Issue #20710: The pydoc summary line no longer displays the "self" parameter
  for bound methods.
110

111 112
- Issue #20654: Fixed pydoc for enums with zero value.  Patch by Vajrasky Kok.

113 114 115
- Issue #20635: Fixed grid_columnconfigure() and grid_rowconfigure() methods of
  Tkinter widgets to work in wantobjects=True mode.

116 117 118 119
- Issue #19612: On Windows, subprocess.Popen.communicate() now ignores
  OSError(22, 'Invalid argument') when writing input data into stdin, whereas
  the process already exited.

120 121 122
- Issue #20320: select.select() and select.kqueue.control() now round the
  timeout aways from zero, instead of rounding towards zero.

123 124
- Issue #20616: Add a format() method to tracemalloc.Traceback.

125 126 127 128
- Issue #19744: the ensurepip installation step now just prints a warning to
  stderr rather than failing outright if SSL/TLS is unavailable. This allows
  local installation of POSIX builds without SSL/TLS support.

129 130 131
- Issue #6815: os.path.expandvars() now supports non-ASCII environment
  variables names and values.

132 133 134
- Issue #17671: Fixed a crash when use non-initialized io.BufferedRWPair.
  Based on patch by Stephen Tu.

135
- Issue #8478: Untokenizer.compat processes first token from iterator input.
136
  Patch based on lines from Georg Brandl, Eric Snow, and Gareth Rees.
137

Benjamin Peterson's avatar
Benjamin Peterson committed
138 139
- Issue #20594: Avoid name clash with the libc function posix_close.

Serhiy Storchaka's avatar
Serhiy Storchaka committed
140 141 142
- Issue #19856: shutil.move() failed to move a directory to other directory
  on Windows if source name ends with os.altsep.

143 144 145 146
- Issue #20673: Implement support for UNIX Domain Sockets in asyncio.
  New APIs: loop.create_unix_connection(), loop.create_unix_server(),
  streams.open_unix_connection(), and streams.start_unix_server().

147 148 149 150
- Issue #20681: Add new error handling API in asyncio. New APIs:
  loop.set_exception_handler(), loop.default_exception_handler(), and
  loop.call_exception_handler().

151 152 153 154
- Issue #20684: Fix inspect.getfullargspec() to not to follow __wrapped__
  chains. Make its behaviour consistent with bound methods first argument.
  Patch by Nick Coghlan and Yury Selivanov.

155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173
- Issue #20566: Change asyncio.as_completed() to use a Queue, to
  avoid O(N**2) behavior.

- Issue #20704: Implement new debug API in asyncio. Add new methods
  BaseEventLoop.set_debug() and BaseEventLoop.get_debug().
  Add support for setting 'asyncio.tasks._DEBUG' variable with
  'PYTHONASYNCIODEBUG' environment variable.

- asyncio: Refactoring and fixes: BaseEventLoop.sock_connect() raises an
  error if the address is not resolved; use __slots__ in Handle and
  TimerHandle; as_completed() and wait() raise TypeError if the passed
  list of Futures is a single Future; call_soon() and other 'call_*()'
  functions raise TypeError if the passed callback is a coroutine
  function; _ProactorBasePipeTransport uses _FlowControlMixin;
  WriteTransport.set_write_buffer_size() calls _maybe_pause_protocol()
  to consider pausing receiving if the watermark limits have changed;
  fix _check_resolved_address() for IPv6 address; and other minor
  improvements, along with multiple documentation updates.

174 175 176
Tests
-----

Zachary Ware's avatar
Zachary Ware committed
177 178 179 180
- Issue #20510: Rewrote test_exit in test_sys to match existing comments,
  use modern unittest features, and use helpers from test.script_helper
  instead of using subprocess directly.  Patch by Gareth Rees.

181 182
- Issue #20605: Make test_socket getaddrinfo OS X segfault test more robust.

Zachary Ware's avatar
Zachary Ware committed
183 184 185
Build
-----

186 187 188
- Issue #20641: Run MSI custom actions (pip installation, pyc compilation)
  with the NoImpersonate flag, to support elevated execution (UAC).

189 190 191
- Issue #20221: Removed conflicting (or circular) hypot definition when
  compiled with VS 2010 or above.  Initial patch by Tabrez Mohammed.

Zachary Ware's avatar
Zachary Ware committed
192 193 194
- Issue #20609: Restored the ability to build 64-bit Windows binaries on
  32-bit Windows, which was broken by the change in issue #19788.

195

196 197 198
What's New in Python 3.4.0 release candidate 1?
===============================================

199
Release date: 2014-02-10
200 201 202 203

Core and Builtins
-----------------

204 205 206
- Issue #19255: The builtins module is restored to initial value before
  cleaning other modules.  The sys and builtins modules are cleaned last.

207 208
- Issue #20588: Make Python-ast.c C89 compliant.

209
- Issue #20437: Fixed 22 potential bugs when deleting objects references.
210

211 212 213 214
- Issue #20500: Displaying an exception at interpreter shutdown no longer
  risks triggering an assertion failure in PyObject_Str.

- Issue #20538: UTF-7 incremental decoder produced inconsistent string when
215 216
  input was truncated in BASE64 section.

217 218 219 220 221 222
- Issue #20404: io.TextIOWrapper (and hence the open() builtin) now uses the
  internal codec marking system added for issue #19619 to throw LookupError
  for known non-text encodings at stream construction time. The existing
  output type checks remain in place to deal with unmarked third party
  codecs.

223 224
- Issue #17162: Add PyType_GetSlot.

225 226 227
- Issue #20162: Fix an alignment issue in the siphash24() hash function which
  caused a crash on PowerPC 64-bit (ppc64).

228 229 230
Library
-------

231 232 233
- Issue #20530: The signatures for slot builtins have been updated
  to reflect the fact that they only accept positional-only arguments.

234 235 236
- Issue #20517: Functions in the os module that accept two filenames
  now register both filenames in the exception on failure.

237 238
- Issue #20563: The ipaddress module API is now considered stable.

239 240 241 242
- Issue #14983: email.generator now always adds a line end after each MIME
  boundary marker, instead of doing so only when there is an epilogue.  This
  fixes an RFC compliance bug and solves an issue with signed MIME parts.

243 244 245 246 247
- Issue #20540: Fix a performance regression (vs. Python 3.2) when layering
  a multiprocessing Connection over a TCP socket.  For small payloads, Nagle's
  algorithm would introduce idle delays before the entire transmission of a
  message.

248 249 250
- Issue #16983: the new email header parsing code will now decode encoded words
  that are (incorrectly) surrounded by quotes, and register a defect.

251 252 253
- Issue #19772: email.generator no longer mutates the message object when
  doing a down-transform from 8bit to 7bit CTEs.

254 255 256
- Issue #20536: the statistics module now correctly handle Decimal instances
  with positive exponents

257
- Issue #18805: the netmask/hostmask parsing in ipaddress now more reliably
Nick Coghlan's avatar
Nick Coghlan committed
258
  filters out illegal values and correctly allows any valid prefix length.
259

260 261 262 263 264 265
- Issue #20481: For at least Python 3.4, the statistics module will require
  that all inputs for a single operation be of a single consistent type, or
  else a mixed of ints and a single other consistent type. This avoids
  some interoperability issues that arose with the previous approach of
  coercing to a suitable common type.

266 267 268
- Issue #20478: the statistics module now treats collections.Counter inputs
  like any other iterable.

269 270 271 272
- Issue #17369: get_filename was raising an exception if the filename
  parameter's RFC2231 encoding was broken in certain ways.  This was
  a regression relative to python2.

273 274 275 276
- Issue #20013: Some imap servers disconnect if the current mailbox is
  deleted, and imaplib did not handle that case gracefully.  Now it
  handles the 'bye' correctly.

277 278 279 280
- Issue #20531: Revert 3.4 version of fix for #19063, and apply the 3.3
  version.  That is, do *not* raise an error if unicode is passed to
  email.message.Message.set_payload.

281 282 283 284
- Issue #20476: If a non-compat32 policy is used with any of the email parsers,
  EmailMessage is now used as the factory class.  The factory class should
  really come from the policy; that will get fixed in 3.5.

285 286 287
- Issue #19920: TarFile.list() no longer fails when outputs a listing
  containing non-encodable characters.  Based on patch by Vajrasky Kok.

288 289
- Issue #20515: Fix NULL pointer dereference introduced by issue #20368.

290 291
- Issue #19186: Restore namespacing of expat symbols inside the pyexpat module.

292 293 294
- Issue #20053: ensurepip (and hence venv) are no longer affected by the
  settings in the default pip configuration file.

295 296 297
- Issue #20426: When passing the re.DEBUG flag, re.compile() displays the
  debug output every time it is called, regardless of the compilation cache.

298 299
- Issue #20368: The null character now correctly passed from Tcl to Python.
  Improved error handling in variables-related commands.
300

301 302
- Issue #20435: Fix _pyio.StringIO.getvalue() to take into account newline
  translation settings.
303

304 305
- tracemalloc: Fix slicing traces and fix slicing a traceback.

306 307 308
- Issue #20354: Fix an alignment issue in the tracemalloc module on 64-bit
  platforms. Bug seen on 64-bit Linux when using "make profile-opt".

309 310 311
- Issue #17159: inspect.signature now accepts duck types of functions,
  which adds support for Cython functions. Initial patch by Stefan Behnel.

312 313 314
- Issue #18801: Fix inspect.classify_class_attrs to correctly classify
  object.__new__ and object.__init__.

315 316
- Fixed cmath.isinf's name in its argument parsing code.

317 318 319 320 321
- Issue #20311, #20452: poll and epoll now round the timeout away from zero,
  instead of rounding towards zero, in select and selectors modules:
  select.epoll.poll(), selectors.PollSelector.poll() and
  selectors.EpollSelector.poll(). For example, a timeout of one microsecond
  (1e-6) is now rounded to one millisecondi (1e-3), instead of being rounded to
Guido van Rossum's avatar
Guido van Rossum committed
322 323
  zero.  However, the granularity property and asyncio's resolution feature
  were removed again.
324

Guido van Rossum's avatar
Guido van Rossum committed
325 326 327 328
- asyncio: Some refactoring; various fixes; add write flow control to
  unix pipes; Future.set_exception() instantiates the exception
  argument if it is a class; improved proactor pipe transport; support
  wait_for(f, None); don't log broken/disconnected pipes; use
Guido van Rossum's avatar
Guido van Rossum committed
329
  ValueError instead of assert for forbidden subprocess_{shell,exec}
Guido van Rossum's avatar
Guido van Rossum committed
330 331 332 333
  arguments; added a convenience API for subprocess management; added
  StreamReader.at_eof(); properly handle duplicate coroutines/futures
  in gather(), wait(), as_completed(); use a bytearray for buffering
  in StreamReader; and more.
Guido van Rossum's avatar
Guido van Rossum committed
334

335 336
- Issue #20288: fix handling of invalid numeric charrefs in HTMLParser.

337 338
- Issue #20424: Python implementation of io.StringIO now supports lone surrogates.

339 340 341
- Issue #20308: inspect.signature now works on classes without user-defined
  __init__ or __new__ methods.

342 343 344 345 346 347 348 349 350 351
- Issue #20372: inspect.getfile (and a bunch of other inspect functions that
  use it) doesn't crash with unexpected AttributeError on classes defined in C
  without __module__.

- Issue #20356: inspect.signature formatting uses '/' to separate
  positional-only parameters from others.

- Issue #20223: inspect.signature now supports methods defined with
  functools.partialmethods.

352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370
- Issue #19456: ntpath.join() now joins relative paths correctly when a drive
  is present.

- Issue #19077: tempfile.TemporaryDirectory cleanup no longer fails when
  called during shutdown.  Emitting resource warning in __del__ no longer fails.
  Original patch by Antoine Pitrou.

- Issue #20394: Silence Coverity warning in audioop module.

- Issue #20367: Fix behavior of concurrent.futures.as_completed() for
  duplicate arguments.  Patch by Glenn Langford.

- Issue #8260: The read(), readline() and readlines() methods of
  codecs.StreamReader returned incomplete data when were called after
  readline() or read(size).  Based on patch by Amaury Forgeot d'Arc.

- Issue #20105: the codec exception chaining now correctly sets the
  traceback of the original exception as its __traceback__ attribute.

371 372
- Issue #17481: inspect.getfullargspec() now uses inspect.signature() API.

373 374 375
- Issue #15304: concurrent.futures.wait() can block forever even if
  Futures have completed. Patch by Glenn Langford.

376 377 378 379
- Issue #14455: plistlib: fix serializing integers integers in the range
  of an unsigned long long but outside of the range of signed long long for
  binary plist files.

380 381 382
IDLE
----

383 384 385
- Issue #20406: Use Python application icons for Idle window title bars.
  Patch mostly by Serhiy Storchaka.

386 387 388
- Update the python.gif icon for the Idle classbrowser and pathbowser
  from the old green snake to the new new blue and yellow snakes.

389 390 391 392 393 394
- Issue #17721: Remove non-functional configuration dialog help button until we
  make it actually gives some help when clicked. Patch by Guilherme Simões.

Tests
-----

395 396
- Issue #20532: Tests which use _testcapi now are marked as CPython only.

397 398
- Issue #19920: Added tests for TarFile.list().  Based on patch by Vajrasky Kok.

399 400 401
- Issue #19990: Added tests for the imghdr module.  Based on patch by
  Claudiu Popa.

402 403
- Issue #20474: Fix test_socket "unexpected success" failures on OS X 10.7+.

404 405 406
Tools/Demos
-----------

407 408 409 410 411 412 413
- Issue #20530: Argument Clinic's signature format has been revised again.
  The new syntax is highly human readable while still preventing false
  positives.  The syntax also extends Python syntax to denote "self" and
  positional-only parameters, allowing inspect.Signature objects to be
  totally accurate for all supported builtins in Python 3.4.

- Issue #20456: Argument Clinic now observes the C preprocessor conditional
414 415 416 417
  compilation statements of the C files it parses.  When a Clinic block is
  inside a conditional code, it adjusts its output to match, including
  automatically generating an empty methoddef macro.

418
- Issue #20456: Cloned functions in Argument Clinic now use the correct
419 420 421
  name, not the name of the function they were cloned from, for text
  strings inside generated code.

422
- Issue #20456: Fixed Argument Clinic's test suite and "--converters" feature.
423

424
- Issue #20456: Argument Clinic now allows specifying different names
425 426
  for a parameter in Python and C, using "as" on the parameter line.

427 428 429 430 431 432 433 434 435
- Issue #20326: Argument Clinic now uses a simple, unique signature to
  annotate text signatures in docstrings, resulting in fewer false
  positives.  "self" parameters are also explicitly marked, allowing
  inspect.Signature() to authoritatively detect (and skip) said parameters.

- Issue #20326: Argument Clinic now generates separate checksums for the
  input and output sections of the block, allowing external tools to verify
  that the input has not changed (and thus the output is not out-of-date).

436 437 438 439 440
Build
-----

- Issue #20465: Update SQLite shipped with OS X installer to 3.8.3.

441 442 443 444
C-API
-----

- Issue #20517: Added new functions allowing OSError exceptions to reference
445 446
  two filenames instead of one: PyErr_SetFromErrnoWithFilenameObjects() and
  PyErr_SetExcFromWindowsErrWithFilenameObjects().
447

448 449 450
Documentation
-------------

Brett Cannon's avatar
Brett Cannon committed
451 452 453
- Issue #20488: Change wording to say importlib is *the* implementation of
  import instead of just *an* implementation.

454 455 456 457
- Issue #6386: Clarify in the tutorial that specifying a symlink to execute
  means the directory containing the executed script and not the symlink is
  added to sys.path.

458

459 460
What's New in Python 3.4.0 Beta 3?
==================================
461

Larry Hastings's avatar
Larry Hastings committed
462
Release date: 2014-01-26
463 464 465 466

Core and Builtins
-----------------

467 468 469 470
- Issue #20189: Four additional builtin types (PyTypeObject,
  PyMethodDescr_Type, _PyMethodWrapper_Type, and PyWrapperDescr_Type)
  have been modified to provide introspection information for builtins.

471 472 473
- Issue #17825: Cursor "^" is correctly positioned for SyntaxError and
  IndentationError.

474 475 476 477
- Issue #2382: SyntaxError cursor "^" is now written at correct position in most
  cases when multibyte characters are in line (before "^").  This still not
  works correctly with wide East Asian characters.

478 479 480 481 482 483 484
- Issue #18960: The first line of Python script could be executed twice when
  the source encoding was specified on the second line.  Now the source encoding
  declaration on the second line isn't effective if the first line contains
  anything except a comment.  'python -x' works now again with files with the
  source encoding declarations, and can be used to make Python batch files
  on Windows.

485 486 487
Library
-------

Guido van Rossum's avatar
Guido van Rossum committed
488 489 490 491 492 493 494
- asyncio: Various improvements and small changes not all covered by
  issues listed below.  E.g. wait_for() now cancels the inner task if
  the timeout occcurs; tweaked the set of exported symbols; renamed
  Empty/Full to QueueEmpty/QueueFull; "with (yield from lock)" now
  uses a separate context manager; readexactly() raises if not enough
  data was read; PTY support tweaks.

495 496 497 498 499
- Issue #20311: asyncio: Add a granularity attribute to BaseEventLoop: maximum
  between the resolution of the BaseEventLoop.time() method and the resolution
  of the selector. The granuarility is used in the scheduler to round time and
  deadline.

500 501
- Issue #20311: selectors: Add a resolution attribute to BaseSelector.

502 503 504 505
- Issue #20189: unittest.mock now no longer assumes that any object for
  which it could get an inspect.Signature is a callable written in Python.
  Fix courtesy of Michael Foord.

506 507 508 509 510 511
- Issue #20317: ExitStack.__exit__ could create a self-referential loop if an
  exception raised by a cleanup operation already had its context set
  correctly (for example, by the @contextmanager decorator). The infinite
  loop this caused is now avoided by checking if the expected context is
  already set before trying to fix it.

512 513
- Issue #20374: Fix build with GNU readline >= 6.3.

514 515 516
- Issue #20262: Warnings are raised now when duplicate names are added in the
  ZIP file or too long ZIP file comment is truncated.

517 518 519
- Issue #20165: The unittest module no longer considers tests marked with
  @expectedFailure successful if they pass.

520 521
- Issue #18574: Added missing newline in 100-Continue reply from
  http.server.BaseHTTPRequestHandler. Patch by Nikolaus Rath.
522

523 524
- Issue #20270: urllib.urlparse now supports empty ports.

525 526
- Issue #20243: TarFile no longer raise ReadError when opened in write mode.

527 528 529
- Issue #20238: TarFile opened with external fileobj and "w:gz" mode didn't
  write complete output on close.

530 531 532
- Issue #20245: The open functions in the tarfile module now correctly handle
  empty mode.

533 534 535
- Issue #20242: Fixed basicConfig() format strings for the alternative
  formatting styles. Thanks to kespindler for the bug report and patch.

Benjamin Peterson's avatar
Benjamin Peterson committed
536 537
- Issue #20246: Fix buffer overflow in socket.recvfrom_into.

538 539 540 541
- Issues #20206 and #5803: Fix edge case in email.quoprimime.encode where it
  truncated lines ending in a character needing encoding but no newline by
  using a more efficient algorithm that doesn't have the bug.

542 543 544
- Issue #19082: Working xmlrpc.server and xmlrpc.client examples. Both in
  modules and in documentation. Initial patch contributed by Vajrasky Kok.

545 546 547
- Issue #20138: The wsgiref.application_uri() and wsgiref.request_uri()
  functions now conform to PEP 3333 when handle non-ASCII URLs.

548
- Issue #19097: Raise the correct Exception when cgi.FieldStorage is given an
549
  invalid fileobj.
550

551
- Issue #20152: Ported Python/import.c over to Argument Clinic.
552

553 554 555 556
- Issue #13107: argparse and optparse no longer raises an exception when output
  a help on environment with too small COLUMNS.  Based on patch by
  Elazar Gershuni.

557 558 559
- Issue #20207: Always disable SSLv2 except when PROTOCOL_SSLv2 is explicitly
  asked for.

560 561 562
- Issue #18960: The tokenize module now ignore the source encoding declaration
  on the second line if the first line contains anything except a comment.

563 564 565
- Issue #20078: Reading malformed zipfiles no longer hangs with 100% CPU
  consumption.

566 567 568
- Issue #20113: os.readv() and os.writev() now raise an OSError exception on
  error instead of returning -1.

569 570 571 572
- Issue #19719: Make importlib.abc.MetaPathFinder.find_module(),
  PathEntryFinder.find_loader(), and Loader.load_module() use PEP 451 APIs to
  help with backwards-compatibility.

573 574 575
- Issue #20144: inspect.Signature now supports parsing simple symbolic
  constants as parameter default values in __text_signature__.

576 577
- Issue #20072: Fixed multiple errors in tkinter with wantobjects is False.

578 579
- Issue #20229: Avoid plistlib deprecation warning in platform.mac_ver().

580 581
- Issue #14455: Fix some problems with the new binary plist support in plistlib.

582 583 584
IDLE
----

585
- Issue #17390: Add Python version to Idle editor window title bar.
Terry Jan Reedy's avatar
Terry Jan Reedy committed
586
  Original patches by Edmond Burnett and Kent Johnson.
587

588 589 590
- Issue #18960: IDLE now ignores the source encoding declaration on the second
  line if the first line contains anything except a comment.

591 592 593
Tests
-----

594 595 596
- Issue #20358: Tests for curses.window.overlay and curses.window.overwrite
  no longer specify min{row,col} > max{row,col}.

597 598 599
- Issue #19804: The test_find_mac test in test_uuid is now skipped if the
  ifconfig executable is not available.

600 601
- Issue #19886: Use better estimated memory requirements for bigmem tests.

602 603
Tools/Demos
-----------
604

605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621
- Issue #20390: Argument Clinic's "file" output preset now defaults to
  "{dirname}/clinic/{basename}.h".

- Issue #20390: Argument Clinic's "class" directive syntax has been extended
  with two new required  arguments: "typedef" and "type_object".

- Issue #20390: Argument Clinic: If __new__ or __init__ functions didn't use
  kwargs (or args), the PyArg_NoKeywords (or PyArg_NoPositional) calls
  generated are only run when the type object is an exact match.

- Issue #20390: Argument Clinic now fails if you have required parameters after
  optional parameters.

- Issue #20390: Argument Clinic converters now have a new template they can
  inject code into: "modifiers".  Code put there is run in the parsing
  function after argument parsing but before the call to the impl.

622 623
- Issue #20376: Argument Clinic now escapes backslashes in docstrings.

624 625 626 627
- Issue #20381: Argument Clinic now sanity checks the default argument when
  c_default is also specified, providing a nice failure message for
  disallowed values.

628 629 630 631 632 633 634 635 636 637
- Issue #20189: Argument Clinic now ensures that parser functions for
  __new__ are always of type newfunc, the type of the tp_new slot.
  Similarly, parser functions for __init__ are now always of type initproc,
  the type of tp_init.

- Issue #20189: Argument Clinic now suppresses the docstring for __new__
  and __init__ functions if no docstring is provided in the input.

- Issue #20189: Argument Clinic now suppresses the "self" parameter in the
  impl for @staticmethod functions.
638

639 640 641
- Issue #20294: Argument Clinic now supports argument parsing for __new__ and
  __init__ functions.

642 643 644
- Issue #20299: Argument Clinic custom converters may now change the default
  value of c_default and py_default with a class member.

645 646 647
- Issue #20287: Argument Clinic's output is now configurable, allowing
  delaying its output or even redirecting it to a separate file.

648 649 650
- Issue #20226: Argument Clinic now permits simple expressions
  (e.g. "sys.maxsize - 1") as default values for parameters.

651 652 653 654 655 656
- Issue #19936: Added executable bits or shebang lines to Python scripts which
  requires them.  Disable executable bits and shebang lines in test and
  benchmark files in order to prevent using a random system python, and in
  source files of modules which don't provide command line interface.  Fixed
  shebang lines in the unittestgui and checkpip scripts.

657 658 659
- Issue #20268: Argument Clinic now supports cloning the parameters and
  return converter of existing functions.

660 661 662
- Issue #20228: Argument Clinic now has special support for class special
  methods.

663 664 665
- Issue #20214: Fixed a number of small issues and documentation errors in
  Argument Clinic (see issue for details).

666 667 668 669
- Issue #20196: Fixed a bug where Argument Clinic did not generate correct
  parsing code for functions with positional-only parameters where all arguments
  are optional.

670 671 672 673
- Issue #18960: 2to3 and the findnocoding.py script now ignore the source
  encoding declaration on the second line if the first line contains anything
  except a comment.

674
- Issue #19723: The marker comments Argument Clinic uses have been changed
675 676
  to improve readability.

677 678 679
- Issue #20157: When Argument Clinic renames a parameter because its name
  collides with a C keyword, it no longer exposes that rename to PyArg_Parse.

680 681 682
- Issue #20141: Improved Argument Clinic's support for the PyArg_Parse "O!"
  format unit.

683 684 685
- Issue #20144: Argument Clinic now supports simple symbolic constants
  as parameter default values.

686 687 688
- Issue #20143: The line numbers reported in Argument Clinic errors are
  now more accurate.

689 690
- Issue #20142: Py_buffer variables generated by Argument Clinic are now
  initialized with a default value.
691

692 693 694 695 696 697
Build
-----

- Issue #12837: Silence a tautological comparison warning on OS X under Clang in
  socketmodule.c.

698 699 700 701 702 703 704 705
What's New in Python 3.4.0 Beta 2?
==================================

Release date: 2014-01-05

Core and Builtins
-----------------

706 707
- Issue #17432: Drop UCS2 from names of Unicode functions in python3.def.

708 709 710
- Issue #19526: Exclude all new API from the stable ABI. Exceptions can be
  made if a need is demonstrated.

711 712 713
- Issue #19969: PyBytes_FromFormatV() now raises an OverflowError if "%c"
  argument is not in range [0; 255].

714 715
- Issue #19995: %c, %o, %x, and %X now issue a DeprecationWarning on non-integer
  input; reworded docs to clarify that an integer type should define both __int__
716 717
  and __index__.

718 719 720 721
- Issue #19787: PyThread_set_key_value() now always set the value. In Python
  3.3, the function did nothing if the key already exists (if the current value
  is a non-NULL pointer).

722 723 724 725 726 727
- Issue #14432: Remove the thread state field from the frame structure. Fix a
  crash when a generator is created in a C thread that is destroyed while the
  generator is still used. The issue was that a generator contains a frame, and
  the frame kept a reference to the Python state of the destroyed C thread. The
  crash occurs when a trace function is setup.

728 729 730 731 732
- Issue #19576: PyGILState_Ensure() now initializes threads. At startup, Python
  has no concrete GIL. If PyGILState_Ensure() is called from a new thread for
  the first time and PyEval_InitThreads() was not called yet, a GIL needs to be
  created.

733 734 735
- Issue #17576: Deprecation warning emitted now when __int__() or __index__()
  return not int instance.

736 737
- Issue #19932: Fix typo in import.h, missing whitespaces in function prototypes.

738 739 740
- Issue #19736: Add module-level statvfs constants defined for GNU/glibc
  based systems.

741 742
- Issue #20097: Fix bad use of "self" in importlib's WindowsRegistryFinder.

743 744
- Issue #19729: In str.format(), fix recursive expansion in format spec.

745 746 747
- Issue #19638: Fix possible crash / undefined behaviour from huge (more than 2
  billion characters) input strings in _Py_dg_strtod.

748 749 750
Library
-------

751 752
- Issue #20154: Deadlock in asyncio.StreamReader.readexactly().

753 754
- Issue #16113: Remove sha3 module again.

755 756
- Issue #20111: pathlib.Path.with_suffix() now sanity checks the given suffix.

757 758
- Fix breakage in TestSuite.countTestCases() introduced by issue #11798.

759 760
- Issue #20108: Avoid parameter name clash in inspect.getcallargs().

761 762
- Issue #19918: Fix PurePath.relative_to() under Windows.

763 764 765
- Issue #19422: Explicitly disallow non-SOCK_STREAM sockets in the ssl
  module, rather than silently let them emit clear text data.

766 767 768
- Issue #20046: Locale alias table no longer contains entities which can be
  calculated.  Generalized support of the euro modifier.

769 770
- Issue #20027: Fixed locale aliases for devanagari locales.

771 772
- Issue #20067: Tkinter variables now work when wantobjects is false.

773 774 775
- Issue #19020: Tkinter now uses splitlist() instead of split() in configure
  methods.

776 777 778 779
- Issue #19744: ensurepip now provides a better error message when Python is
  built without SSL/TLS support (pip currently requires that support to run,
  even if only operating with local wheel files)

780 781 782
- Issue #19734: ensurepip now ignores all pip environment variables to avoid
  odd behaviour based on user configuration settings

783 784
- Fix TypeError on "setup.py upload --show-response".

785 786
- Issue #20045: Fix "setup.py register --list-classifiers".

787 788 789
- Issue #18879: When a method is looked up on a temporary file, avoid closing
  the file before the method is possibly called.

790 791 792
- Issue #20037: Avoid crashes when opening a text file late at interpreter
  shutdown.

793 794 795 796 797 798 799 800 801 802 803 804 805 806
- Issue #19967: Thanks to the PEP 442, asyncio.Future now uses a
  destructor to log uncaught exceptions, instead of the dedicated
  _TracebackLogger class.

- Added a Task.current_task() class method to asyncio.

- Issue #19850: Set SA_RESTART in asyncio when registering a signal
  handler to limit EINTR occurrences.

- Implemented write flow control in asyncio for proactor event loop (Windows).

- Change write buffer in asyncio use to avoid O(N**2) behavior.  Make
  write()/sendto() accept bytearray/memoryview.

807 808 809
- Issue #20034: Updated alias mapping to most recent locale.alias file
  from X.org distribution using makelocalealias.py.

810 811 812
- Issue #5815: Fixed support for locales with modifiers.  Fixed support for
  locale encodings with hyphens.

813 814 815
- Issue #20026: Fix the sqlite module to handle correctly invalid isolation
  level (wrong type).

816 817 818
- Issue #18829: csv.Dialect() now checks type for delimiter, escapechar and
  quotechar fields.  Original patch by Vajrasky Kok.

819 820 821 822
- Issue #19855: uuid.getnode() on Unix now looks on the PATH for the
  executables used to find the mac address, with /sbin and /usr/sbin as
  fallbacks.

823 824 825
- Issue #20007: HTTPResponse.read(0) no more prematurely closes connection.
  Original patch by Simon Sapin.

826 827 828 829 830 831
- Issue #19946: multiprocessing now uses runpy to initialize __main__ in
  child processes when necessary, allowing it to correctly handle scripts
  without suffixes and submodules that use explicit relative imports or
  otherwise rely on parent modules being correctly imported prior to
  execution.

832 833 834 835
- Issue #19921: When Path.mkdir() is called with parents=True, any missing
  parent is created with the default permissions, ignoring the mode argument
  (mimicking the POSIX "mkdir -p" command).

836 837 838
- Issue #19887: Improve the Path.resolve() algorithm to support certain
  symlink chains.

839 840
- Issue #19912: Fixed numerous bugs in ntpath.splitunc().

841 842 843
- Issue #19911: ntpath.splitdrive() now correctly processes the 'İ' character
  (U+0130, LATIN CAPITAL LETTER I WITH DOT ABOVE).

844 845 846
- Issue #19532: python -m compileall with no filename/directory arguments now
  respects the -f and -q flags instead of ignoring them.

847 848
- Issue #19623: Fixed writing to unseekable files in the aifc module.

849 850 851
- Issue #19946: multiprocessing.spawn now raises ImportError when the module to
  be used as the main module cannot be imported.

852 853
- Issue #17919: select.poll.register() again works with poll.POLLNVAL on AIX.
  Fixed integer overflow in the eventmask parameter.
854

855 856 857 858 859 860 861
- Issue #19063: if a Charset's body_encoding was set to None, the email
  package would generate a message claiming the Content-Transfer-Encoding
  was 7bit, and produce garbage output for the content.  This now works.
  A couple of other set_payload mishandlings of non-ASCII are also fixed.
  In addition, calling set_payload with a string argument without
  specifying a charset now raises an error (this is a new error in 3.4).

862 863
- Issue #15475: Add __sizeof__ implementations for itertools objects.

864 865 866
- Issue #19944: Fix importlib.find_spec() so it imports parents as needed
  and move the function to importlib.util.

867 868 869
- Issue #19880: Fix a reference leak in unittest.TestCase. Explicitly break
  reference cycles between frames and the _Outcome instance.

870 871 872 873 874 875
- Issue #17429: platform.linux_distribution() now decodes files from the UTF-8
  encoding with the surrogateescape error handler, instead of decoding from the
  locale encoding in strict mode. It fixes the function on Fedora 19 which is
  probably the first major distribution release with a non-ASCII name. Patch
  written by Toshio Kuratomi.

876 877 878
- Issue #19343: Expose FreeBSD-specific APIs in resource module.  Original
  patch by Koobs.

879 880 881 882
- Issue #19929: Call os.read with 32768 within subprocess.Popen.communicate
  rather than 4096 for efficiency.  A microbenchmark shows Linux and OS X
  both using ~50% less cpu time this way.

883 884 885
- Issue #19506: Use a memoryview to avoid a data copy when piping data
  to stdin within subprocess.Popen.communicate.  5-10% less cpu usage.

Guido van Rossum's avatar
Guido van Rossum committed
886 887 888
- Issue #19876: selectors unregister() no longer raises ValueError or OSError
  if the FD is closed (as long as it was registered).

889 890
- Issue #19908: pathlib now joins relative Windows paths correctly when a drive
  is present.  Original patch by Antoine Pitrou.
891

892 893
- Issue #19296: Silence compiler warning in dbm_open

894 895 896 897
- Issue #6784: Strings from Python 2 can now be unpickled as bytes
  objects by setting the encoding argument of Unpickler to be 'bytes'.
  Initial patch by Merlijn van Deen.

898
- Issue #19839: Fix regression in bz2 module's handling of non-bzip2 data at
899
  EOF, and analogous bug in lzma module.
900

901 902 903
- Issue #19881: Fix pickling bug where cpickle would emit bad pickle data for
  large bytes string (i.e., with size greater than 2**32-1).

904 905 906 907
- Issue #19138: doctest's IGNORE_EXCEPTION_DETAIL now allows a match when
  no exception detail exists (no colon following the exception's name, or
  a colon does follow but no text follows the colon).

908 909
- Issue #19927: Add __eq__ to path-based loaders in importlib.

910 911 912 913
- Issue #19827: On UNIX, setblocking() and settimeout() methods of
  socket.socket can now avoid a second syscall if the ioctl() function can be
  used, or if the non-blocking flag of the socket is unchanged.

914 915 916
- Issue #19785: smtplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

917 918 919
- Issue #19784: poplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

920 921 922
- Issue #19783: nntplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

923 924 925
- Issue #19782: imaplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

926 927
- Issue 20123: Fix pydoc.synopsis() for "binary" modules.

928 929
- Issue #19834: Support unpickling of exceptions pickled by Python 2.

930 931 932
- Issue #19781: ftplib now supports SSLContext.check_hostname and server name
  indication for TLS/SSL connections.

933 934 935
- Issue #19509: Add SSLContext.check_hostname to match the peer's certificate
  with server_hostname on handshake.

936 937 938
- Issue #15798: Fixed subprocess.Popen() to no longer fail if file
  descriptor 0, 1 or 2 is closed.

939 940
- Issue #17897: Optimized unpickle prefetching.

941 942 943 944
- Issue #3693: Make the error message more helpful when the array.array()
  constructor is given a str. Move the array module typecode documentation to
  the docstring of the constructor.

945 946 947
- Issue #19088: Fixed incorrect caching of the copyreg module in
  object.__reduce__() and object.__reduce_ex__().

948 949 950
- Issue #19698: Removed exec_module() methods from
  importlib.machinery.BuiltinImporter and ExtensionFileLoader.

951 952
- Issue #18864: Added a setter for ModuleSpec.has_location.

953 954 955
- Fixed _pickle.Unpickler to not fail when loading empty strings as
  persistent IDs.

956 957 958
- Issue #11480: Fixed copy.copy to work with classes with custom metaclasses.
  Patch by Daniel Urban.

959 960 961
- Issue #6477: Added support for pickling the types of built-in singletons
  (i.e., Ellipsis, NotImplemented, None).

962 963
- Issue #19713: Add remaining PEP 451-related deprecations and move away
  from using find_module/find_loaer/load_module.
964

965 966
- Issue #19708: Update pkgutil to use the new importer APIs.

967 968
- Issue #19703: Update pydoc to use the new importer APIs.

969 970
- Issue #19851: Fixed a regression in reloading sub-modules.

971 972
- ssl.create_default_context() sets OP_NO_COMPRESSION to prevent CRIME.

973 974
- Issue #19802: Add socket.SO_PRIORITY.

975 976 977
- Issue #11508: Fixed uuid.getnode() and uuid.uuid1() on environment with
  virtual interface.  Original patch by Kent Frazier.

978 979
- Issue #11489: JSON decoder now accepts lone surrogates.

980 981 982
- Issue #19545: Avoid chained exceptions while passing stray % to
  time.strptime().  Initial patch by Claudiu Popa.

983 984 985
IDLE
----

986 987
- Issue #20058: sys.stdin.readline() in IDLE now always returns only one line.

988 989 990 991
- Issue #19481: print() of string subclass instance in IDLE no longer hangs.

- Issue #18270: Prevent possible IDLE AttributeError on OS X when no initial
  shell window is present.
992

Zachary Ware's avatar
Zachary Ware committed
993 994
Tests
-----
995

996 997 998
- Issue #20055: Fix test_shutil under Windows with symlink privileges held.
  Patch by Vajrasky Kok.

999 1000 1001
- Issue #20070: Don't run test_urllib2net when network resources are not
  enabled.

1002 1003 1004
- Issue #19938: Re-enabled test_bug_1333982 in test_dis, which had been
  disabled since 3.0 due to the changes in listcomp handling.

1005 1006
- Issue #19320: test_tcl no longer fails when wantobjects is false.

1007
- Issue #19919: Fix flaky SSL test. connect_ex() sometimes returns
1008 1009
  EWOULDBLOCK on Windows or VMs hosted on Windows.

1010 1011
- Issue #19912: Added tests for ntpath.splitunc().

1012 1013
- Issue #19828: Fixed test_site when the whole suite is run with -S.

1014 1015
- Issue #19928: Implemented a test for repr() of cell objects.

1016 1017
- Issue #19535: Fixed test_docxmlrpc, test_functools, test_inspect, and
  test_statistics when python is run with -OO.
1018

1019 1020 1021
- Issue #19926: Removed unneeded test_main from test_abstract_numbers.
  Patch by Vajrasky Kok.

1022
- Issue #19572: More skipped tests explicitly marked as skipped.
1023

1024
- Issue #19595, #19987: Re-enabled a long-disabled test in test_winsound.
1025

Zachary Ware's avatar
Zachary Ware committed
1026 1027
- Issue #19588: Fixed tests in test_random that were silently skipped most
  of the time.  Patch by Julian Gindi.
1028

1029 1030
Build
-----
1031

1032 1033
- Issue #19728: Enable pip installation by default on Windows.

1034 1035
- Issue #16136: Remove VMS support

1036 1037 1038
- Issue #18215: Add script Tools/ssl/test_multiple_versions.py to compile and
  run Python's unit tests with multiple versions of OpenSSL.

1039 1040 1041
- Issue #19922: define _INCLUDE__STDC_A1_SOURCE in HP-UX to include mbstate_t
  for mbrtowc().

1042 1043 1044
- Issue #19788: kill_python(_d).exe is now run as a PreBuildEvent on the
  pythoncore sub-project.  This should prevent build errors due a previous
  build's python(_d).exe still running.
1045

1046 1047
Documentation
-------------
Tim Golden's avatar
Tim Golden committed
1048

1049 1050
- Issue #20265: Updated some parts of the Using Windows document.

1051 1052 1053
- Issue #20266: Updated some parts of the Windows FAQ.

- Issue #20255: Updated the about and bugs pages.
1054

1055 1056 1057
- Issue #20253: Fixed a typo in the ipaddress docs that advertised an
  illegal attribute name.  Found by INADA Naoki.

1058
- Issue #18840: Introduce the json module in the tutorial, and de-emphasize
1059
  the pickle module.
1060

1061
- Issue #19845: Updated the Compiling Python on Windows section.
1062

1063
- Issue #19795: Improved markup of True/False constants.
1064

1065 1066 1067
Tools/Demos
-----------

1068 1069
- Issue #19659: Added documentation for Argument Clinic.

1070 1071
- Issue #19976: Argument Clinic METH_NOARGS functions now always
  take two parameters.
1072

1073
What's New in Python 3.4.0 Beta 1?
1074
==================================
1075

1076
Release date: 2013-11-24
1077 1078 1079

Core and Builtins
-----------------
1080

1081 1082
- Use the repr of a module name in more places in import, especially
  exceptions.
1083

1084 1085 1086 1087 1088 1089
- Issue #19619: str.encode, bytes.decode and bytearray.decode now use an
  internal API to throw LookupError for known non-text encodings, rather
  than attempting the encoding or decoding operation and then throwing a
  TypeError for an unexpected output type. (The latter mechanism remains
  in place for third party non-text encodings)

1090 1091 1092
- Issue #19183: Implement PEP 456 'secure and interchangeable hash algorithm'.
  Python now uses SipHash24 on all major platforms.

1093 1094 1095 1096 1097 1098
- Issue #12892: The utf-16* and utf-32* encoders no longer allow surrogate code
  points (U+D800-U+DFFF) to be encoded.  The utf-32* decoders no longer decode
  byte sequences that correspond to surrogate code points.  The surrogatepass
  error handler now works with the utf-16* and utf-32* codecs.  Based on
  patches by Victor Stinner and Kang-Hao (Kenny) Lu.

1099 1100 1101
- Issue #17806: Added keyword-argument support for "tabsize" to
  str/bytes.expandtabs().

1102 1103 1104 1105 1106 1107 1108 1109 1110
- Issue #17828: Output type errors in str.encode(), bytes.decode() and
  bytearray.decode() now direct users to codecs.encode() or codecs.decode()
  as appropriate.

- Issue #17828: The interpreter now attempts to chain errors that occur in
  codec processing with a replacement exception of the same type that
  includes the codec name in the error message. It ensures it only does this
  when the creation of the replacement exception won't lose any information.

1111 1112 1113 1114
- Issue #19466: Clear the frames of daemon threads earlier during the
  Python shutdown to call objects destructors. So "unclosed file" resource
  warnings are now corretly emitted for daemon threads.

1115
- Issue #19514: Deduplicate some _Py_IDENTIFIER declarations.
1116 1117
  Patch by Andrei Dorian Duma.

1118 1119 1120
- Issue #17936: Fix O(n**2) behaviour when adding or removing many subclasses
  of a given type.

1121 1122 1123
- Issue #19428: zipimport now handles errors when reading truncated or invalid
  ZIP archive.

1124 1125 1126 1127
- Issue #18408: Add a new PyFrame_FastToLocalsWithError() function to handle
  exceptions when merging fast locals into f_locals of a frame.
  PyEval_GetLocals() now raises an exception and return NULL on failure.

1128 1129
- Issue #19369: Optimized the usage of __length_hint__().

1130 1131 1132
- Issue #18603: Ensure that PyOS_mystricmp and PyOS_mystrnicmp are in the
  Python executable and not removed by the linker's optimizer.

1133
- Issue #19306: Add extra hints to the faulthandler module's stack
1134 1135
  dumps that these are "upside down".

1136 1137
Library
-------
1138

1139 1140 1141
- Issue #3158: doctest can now find doctests in functions and methods
  written in C.

1142 1143 1144
- Issue #13477: Added command line interface to the tarfile module.
  Original patch by Berker Peksag.

1145 1146 1147
- Issue #19674: inspect.signature() now produces a correct signature
  for some builtins.

1148 1149
- Issue #19722: Added opcode.stack_effect(), which
  computes the stack effect of bytecode instructions.
1150

1151 1152 1153 1154
- Issue #19735: Implement private function ssl._create_stdlib_context() to
  create SSLContext objects in Python's stdlib module. It provides a single
  configuration point and makes use of SSLContext.load_default_certs().

1155 1156 1157 1158
- Issue #16203: Add re.fullmatch() function and regex.fullmatch() method,
  which anchor the pattern at both ends of the string to match.
  Original patch by Matthew Barnett.

1159 1160 1161
- Issue #13592: Improved the repr for regular expression pattern objects.
  Based on patch by Hugo Lopes Tavares.

1162 1163 1164
- Issue #19641: Added the audioop.byteswap() function to convert big-endian
  samples to little-endian and vice versa.

1165 1166
- Issue #15204: Deprecated the 'U' mode in file-like objects.

1167 1168
- Issue #17810: Implement PEP 3154, pickle protocol 4.

1169 1170
- Issue #19668: Added support for the cp1125 encoding.

1171 1172 1173
- Issue #19689: Add ssl.create_default_context() factory function. It creates
  a new SSLContext object with secure default settings.

1174 1175 1176
- Issue #19727: os.utime(..., None) is now potentially more precise
  under Windows.

1177 1178 1179
- Issue #17201: ZIP64 extensions now are enabled by default.  Patch by
  William Mallard.

1180 1181 1182 1183
- Issue #19292: Add SSLContext.load_default_certs() to load default root CA
  certificates from default stores or system stores. By default the method
  loads CA certs for authentication of server certs.

1184 1185
- Issue #19673: Add pathlib to the stdlib as a provisional module (PEP 428).

1186 1187 1188 1189
- Issue #16596: pdb in a generator now properly skips over yield and
  yield from rather than stepping out of the generator into its
  caller.  (This is essential for stepping through asyncio coroutines.)

1190 1191 1192 1193
- Issue #17916: Added dis.Bytecode.from_traceback() and
  dis.Bytecode.current_offset to easily display "current instruction"
  markers in the new disassembly API (Patch by Claudiu Popa).

1194 1195
- Issue #19552: venv now supports bootstrapping pip into virtual environments

1196 1197 1198 1199
- Issue #17134: Finalize interface to Windows' certificate store. Cert and
  CRL enumeration are now two functions. enum_certificates() also returns
  purpose flags as set of OIDs.

1200 1201
- Issue #19555: Restore sysconfig.get_config_var('SO'), (and the distutils
  equivalent) with a DeprecationWarning pointing people at $EXT_SUFFIX.
1202

1203 1204 1205 1206
- Issue #8813: Add SSLContext.verify_flags to change the verification flags
  of the context in order to enable certification revocation list (CRL)
  checks or strict X509 rules.

1207 1208
- Issue #18294: Fix the zlib module to make it 64-bit safe.

1209 1210 1211
- Issue #19682: Fix compatibility issue with old version of OpenSSL that
  was introduced by Issue #18379.

1212 1213
- Issue #14455: plistlib now supports binary plists and has an updated API.

1214 1215
- Issue #19633: Fixed writing not compressed 16- and 32-bit wave files on
  big-endian platforms.
1216

1217 1218 1219
- Issue #18379: SSLSocket.getpeercert() returns CA issuer AIA fields, OCSP
  and CRL distribution points.

1220 1221 1222 1223
- Issue #18138: Implement cadata argument of SSLContext.load_verify_location()
  to load CA certificates and CRL from memory. It supports PEM and DER
  encoded strings.

1224 1225 1226
- Issue #18775: Add name and block_size attribute to HMAC object. They now
  provide the same API elements as non-keyed cryptographic hash functions.

1227 1228 1229
- Issue #17276: MD5 as default digestmod for HMAC is deprecated. The HMAC
  module supports digestmod names, e.g. hmac.HMAC('sha1').

1230 1231
- Issue #19449: in csv's writerow, handle non-string keys when generating the
  error message that certain keys are not in the 'fieldnames' list.
Georg Brandl's avatar
Georg Brandl committed
1232

1233 1234 1235
- Issue #13633: Added a new convert_charrefs keyword arg to HTMLParser that,
  when True, automatically converts all character references.

1236 1237
- Issue #2927: Added the unescape() function to the html module.

1238 1239
- Issue #8402: Added the escape() function to the glob module.

1240 1241
- Issue #17618: Add Base85 and Ascii85 encoding/decoding to the base64 module.

1242 1243 1244
- Issue #19634: time.strftime("%y") now raises a ValueError on AIX when given a
  year before 1900.

1245 1246 1247
- Fix test.support.bind_port() to not cause an error when Python was compiled
  on a system with SO_REUSEPORT defined in the headers but run on a system
  with an OS kernel that does not support that reasonably new socket option.
1248

1249
- Fix compilation error under gcc of the ctypes module bundled libffi for arm.
Georg Brandl's avatar
Georg Brandl committed
1250

1251 1252 1253
- Issue #19448: Add private API to SSL module to lookup ASN.1 objects by OID,
  NID, short name and long name.

1254 1255 1256
- Issue #19282: dbm.open now supports the context manager protocol. (Inital
  patch by Claudiu Popa)

1257
- Issue #8311: Added support for writing any bytes-like objects in the aifc,
1258 1259
  sunau, and wave modules.

1260 1261
- Issue #5202: Added support for unseekable files in the wave module.

1262 1263 1264 1265
- Issue #19544 and Issue #1180: Restore global option to ignore
  ~/.pydistutils.cfg in Distutils, accidentally removed in backout of
  distutils2 changes.

1266
- Issue #19523: Closed FileHandler leak which occurred when delay was set.
1267

1268 1269 1270
- Issue #19544 and Issue #6516: Restore support for --user and --group
  parameters to sdist command accidentally rolled back as part of the
  distutils2 rollback.
1271

Tim Golden's avatar
Tim Golden committed
1272 1273 1274
- Issue #13674: Prevented time.strftime from crashing on Windows when given
  a year before 1900 and a format of %y.

1275 1276 1277
- Issue #19406: implementation of the ensurepip module (part of PEP 453).
  Patch by Donald Stufft and Nick Coghlan.

1278 1279 1280
- Issue #19544 and Issue #6286: Restore use of urllib over http allowing use
  of http_proxy for Distutils upload command, a feature accidentally lost
  in the rollback of distutils2.
1281

1282 1283 1284
- Issue #19544 and Issue #7457: Restore the read_pkg_file method to
  distutils.dist.DistributionMetadata accidentally removed in the undo of
  distutils2.
1285

1286 1287 1288
- Issue #16685: Added support for any bytes-like objects in the audioop module.
  Removed support for strings.

1289 1290 1291
- Issue #7171: Add Windows implementation of ``inet_ntop`` and ``inet_pton``
  to socket module. Patch by Atsuo Ishimoto.

1292 1293
- Issue #19261: Added support for writing 24-bit samples in the sunau module.

1294 1295 1296
- Issue #1097797: Added CP273 encoding, used on IBM mainframes in
  Germany and Austria.  Mapping provided by Michael Bierenfeld.

1297
- Issue #1575020: Fixed support of 24-bit wave files on big-endian platforms.
1298

1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312
- Issue #19378: Fixed a number of cases in the dis module where the new
  "file" parameter was not being honoured correctly

- Issue #19378: Removed the "dis.Bytecode.show_info" method

- Issue #19378: Renamed the "dis.Bytecode.display_code" method to
  "dis.Bytecode.dis" and converted it to returning a string rather than
  printing output.

- Issue #19378: the "line_offset" parameter in the new "dis.get_instructions"
  API has been renamed to "first_line" (and the default value and usage
  changed accordingly). This should reduce confusion with the more common use
  of "offset" in the dis docs to refer to bytecode offsets.

1313 1314 1315 1316
- Issue #18678: Corrected spwd struct member names in spwd module:
  sp_nam->sp_namp, and sp_pwd->sp_pwdp.  The old names are kept as extra
  structseq members, for backward compatibility.

1317 1318 1319
- Issue #6157: Fixed tkinter.Text.debug().  tkinter.Text.bbox() now raises
  TypeError instead of TclError on wrong number of arguments.  Original patch
  by Guilherme Polo.
1320

1321 1322
- Issue #10197: Rework subprocess.get[status]output to use subprocess
  functionality and thus to work on Windows. Patch by Nick Coghlan
1323

1324 1325
- Issue #6160: The bbox() method of tkinter.Spinbox now returns a tuple of
  integers instead of a string.  Based on patch by Guilherme Polo.
1326

1327 1328
- Issue #19403: contextlib.redirect_stdout is now reentrant

1329 1330
- Issue #19286: Directories in ``package_data`` are no longer added to
  the filelist, preventing failure outlined in the ticket.
1331

Ezio Melotti's avatar
Ezio Melotti committed
1332 1333
- Issue #19480: HTMLParser now accepts all valid start-tag names as defined
  by the HTML5 standard.
1334

1335 1336 1337
- Issue #15114: The html.parser module now raises a DeprecationWarning when the
  strict argument of HTMLParser or the HTMLParser.error method are used.

1338 1339 1340
- Issue #19410: Undo the special-casing removal of '' for
  importlib.machinery.FileFinder.

1341 1342 1343
- Issue #19424: Fix the warnings module to accept filename containing surrogate
  characters.

Benjamin Peterson's avatar
Benjamin Peterson committed
1344
- Issue #19435: Fix directory traversal attack on CGIHttpRequestHandler.
1345

1346 1347 1348
- Issue #19227: Remove pthread_atfork() handler. The handler was added to
  solve #18747 but has caused issues.

1349 1350 1351
- Issue #19420: Fix reference leak in module initalization code of
  _hashopenssl.c

1352 1353
- Issue #19329: Optimized compiling charsets in regular expressions.

1354 1355 1356
- Issue #19227: Try to fix deadlocks caused by re-seeding then OpenSSL
  pseudo-random number generator on fork().

1357 1358 1359
- Issue #16037: HTTPMessage.readheaders() raises an HTTPException when more than
  100 headers are read.  Adapted from patch by Jyrki Pulliainen.

1360 1361 1362 1363
- Issue #16040: CVE-2013-1752: nntplib: Limit maximum line lengths to 2048 to
  prevent readline() calls from consuming too much memory.  Patch by Jyrki
  Pulliainen.

1364 1365 1366 1367
- Issue #16041: CVE-2013-1752: poplib: Limit maximum line lengths to 2048 to
  prevent readline() calls from consuming too much memory.  Patch by Jyrki
  Pulliainen.

1368 1369 1370 1371
- Issue #17997: Change behavior of ``ssl.match_hostname()`` to follow RFC 6125,
  for security reasons.  It now doesn't match multiple wildcards nor wildcards
  inside IDN fragments.

1372 1373 1374
- Issue #16039: CVE-2013-1752: Change use of readline in imaplib module to limit
  line length.  Patch by Emil Lind.

1375 1376 1377 1378 1379
- Issue #19330: the unnecessary wrapper functions have been removed from the
  implementations of the new contextlib.redirect_stdout and
  contextlib.suppress context managers, which also ensures they provide
  reasonable help() output on instances

Benjamin Peterson's avatar
Benjamin Peterson committed
1380 1381
- Issue #19393: Fix symtable.symtable function to not be confused when there are
  functions or classes named "top".
1382

1383 1384
- Issue #18685: Restore re performance to pre-PEP 393 levels.

1385 1386
- Issue #19339: telnetlib module is now using time.monotonic() when available
  to compute timeout.
1387

1388 1389
- Issue #19399: fix sporadic test_subprocess failure.

1390 1391 1392
- Issue #13234: Fix os.listdir to work with extended paths on Windows.
  Patch by Santoso Wijaya.

1393 1394 1395
- Issue #19375: The site module adding a "site-python" directory to sys.path,
  if it exists, is now deprecated.

1396 1397 1398
- Issue #19379: Lazily import linecache in the warnings module, to make
  startup with warnings faster until a warning gets printed.

1399 1400 1401 1402 1403 1404
- Issue #19288: Fixed the "in" operator of dbm.gnu databases for string
  argument.  Original patch by Arfrever Frehtes Taifersar Arahesis.

- Issue #19287: Fixed the "in" operator of dbm.ndbm databases for string
  argument.  Original patch by Arfrever Frehtes Taifersar Arahesis.

1405
- Issue #19327: Fixed the working of regular expressions with too big charset.
1406

1407 1408 1409
- Issue #17400: New 'is_global' attribute for ipaddress to tell if an address
  is allocated by IANA for global or private networks.

1410 1411
- Issue #19350: Increasing the test coverage of macurl2path. Patch by Colin
  Williams.
1412

1413 1414 1415
- Issue #19365: Optimized the parsing of long replacement string in re.sub*()
  functions.

1416 1417
- Issue #19352: Fix unittest discovery when a module can be reached
  through several paths (e.g. under Debian/Ubuntu with virtualenv).
1418

1419 1420
- Issue #15207: Fix mimetypes to read from correct part of Windows registry
  Original patch by Dave Chambers
1421

1422 1423
- Issue #16595: Add prlimit() to resource module.

1424 1425
- Issue #19324: Expose Linux-specific constants in resource module.

1426 1427
- Load SSL's error strings in hashlib.

1428 1429
- Issue #18527: Upgrade internal copy of zlib to 1.2.8.

1430 1431
- Issue #19274: Add a filterfunc parameter to PyZipFile.writepy.

1432 1433 1434
- Issue #8964: fix platform._sys_version to handle IronPython 2.6+.
  Patch by Martin Matusiak.

1435 1436
- Issue #19413: Restore pre-3.3 reload() semantics of re-finding modules.

1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448
- Issue #18958: Improve error message for json.load(s) while passing a string
  that starts with a UTF-8 BOM.

- Issue #19307: Improve error message for json.load(s) while passing objects
  of the wrong type.

- Issue #16038: CVE-2013-1752: ftplib: Limit amount of data read by
  limiting the call to readline().  Original patch by Michał
  Jastrzębski and Giampaolo Rodola.

- Issue #17087: Improved the repr for regular expression match objects.

1449 1450 1451
Tests
-----

1452 1453 1454
- Issue #19664: test_userdict's repr test no longer depends on the order
  of dict elements.

1455 1456 1457 1458
- Issue #19440: Clean up test_capi by removing an unnecessary __future__
  import, converting from test_main to unittest.main, and running the
  _testcapi module tests as subTests of a unittest TestCase method.

1459 1460 1461 1462 1463 1464
- Issue #19378: the main dis module tests are now run with both stdout
  redirection *and* passing an explicit file parameter

- Issue #19378: removed the not-actually-helpful assertInstructionMatches
  and assertBytecodeExactlyMatches helpers from bytecode_helper

1465 1466
- Issue #18702: All skipped tests now reported as skipped.

1467 1468 1469
- Issue #19439: interpreter embedding tests are now executed on Windows
  (Patch by Zachary Ware)

1470 1471
- Issue #19085: Added basic tests for all tkinter widget options.

1472
- Issue #19384: Fix test_py_compile for root user, patch by Claudiu Popa.
1473

Zachary Ware's avatar
Zachary Ware committed
1474 1475
Documentation
-------------
1476

Zachary Ware's avatar
Zachary Ware committed
1477 1478 1479
- Issue #18326: Clarify that list.sort's arguments are keyword-only.  Also,
  attempt to reduce confusion in the glossary by not saying there are
  different "types" of arguments and parameters.
1480

1481 1482
Build
-----
1483

1484 1485 1486
- Issue #19358: "make clinic" now runs the Argument Clinic preprocessor
  over all CPython source files.

Martin v. Löwis's avatar
Martin v. Löwis committed
1487
- Update SQLite to 3.8.1, xz to 5.0.5, and Tcl/Tk to 8.6.1 on Windows.
1488

1489 1490
- Issue #16632: Enable DEP and ASLR on Windows.

1491 1492
- Issue #17791: Drop PREFIX and EXEC_PREFIX definitions from PC/pyconfig.h

1493 1494 1495
- Add workaround for VS 2010 nmake clean issue. VS 2010 doesn't set up PATH
  for nmake.exe correctly.

1496 1497
- Issue #19550: Implement Windows installer changes of PEP 453 (ensurepip).

1498 1499
- Issue #19520: Fix compiler warning in the _sha3 module on 32bit Windows.

1500 1501
- Issue #19356: Avoid using a C variabled named "_self", it's a reserved
  word in some C compilers.
1502

1503 1504
- Issue #15792: Correct build options on Win64. Patch by Jeremy Kloth.

Ned Deily's avatar
Ned Deily committed
1505 1506 1507
- Issue #19373: Apply upstream change to Tk 8.5.15 fixing OS X 10.9
  screen refresh problem for OS X installer build.

1508 1509 1510 1511 1512 1513
- Issue #19649: On OS X, the same set of file names are now installed
  in bin directories for all configurations: non-framework vs framework,
  and single arch vs universal builds.  pythonx.y-32 is now always
  installed for 64-bit/32-bit universal builds.  The obsolete and
  undocumented pythonw* symlinks are no longer installed anywhere.

1514 1515 1516 1517 1518 1519
- Issue #19553: PEP 453 - "make install" and "make altinstall" now install or
  upgrade pip by default, using the bundled pip provided by the new ensurepip
  module.  A new configure option, --with-ensurepip[=upgrade|install|no], is
  available to override the default ensurepip "--upgrade" option.  The option
  can also be set with "make [alt]install ENSUREPIP=[upgrade|install\no]".

1520 1521
- Issue #19551: PEP 453 - the OS X installer now installs pip by default.

R David Murray's avatar
R David Murray committed
1522 1523
- Update third-party libraries for OS X installers: xz 5.0.3 -> 5.0.5,
  SQLite 3.7.13 -> 3.8.1
1524

1525 1526 1527 1528 1529
- Issue #15663: Revert OS X installer built-in Tcl/Tk support for 3.4.0b1.
  Some third-party projects, such as Matplotlib and PIL/Pillow,
  depended on being able to build with Tcl and Tk frameworks in
  /Library/Frameworks.

1530 1531
Tools/Demos
-----------
1532

1533 1534 1535
- Issue #19730: Argument Clinic now supports all the existing PyArg
  "format units" as legacy converters, as well as two new features:
  "self converters" and the "version" directive.
1536

1537 1538 1539
- Issue #19552: pyvenv now bootstraps pip into virtual environments by
  default (pass --without-pip to request the old behaviour)

1540 1541
- Issue #19390: Argument Clinic no longer accepts malformed Python
  and C ids.
1542

Larry Hastings's avatar
Larry Hastings committed
1543
What's New in Python 3.4.0 Alpha 4?
1544
===================================
Larry Hastings's avatar
Larry Hastings committed
1545

Larry Hastings's avatar
Larry Hastings committed
1546
Release date: 2013-10-20
Larry Hastings's avatar
Larry Hastings committed
1547 1548 1549 1550

Core and Builtins
-----------------

1551 1552 1553
- Issue #19301: Give classes and functions that are explicitly marked global a
  global qualname.

Andrew Kuchling's avatar
Andrew Kuchling committed
1554
- Issue #19279: UTF-7 decoder no longer produces illegal strings.
1555

1556 1557 1558
- Issue #16612: Add "Argument Clinic", a compile-time preprocessor for
  C files to generate argument parsing code.  (See PEP 436.)

Brett Cannon's avatar
Brett Cannon committed
1559 1560 1561 1562 1563
- Issue #18810: Shift stat calls in importlib.machinery.FileFinder such that
  the code is optimistic that if something exists in a directory named exactly
  like the possible package being searched for that it's in actuality a
  directory.

1564 1565 1566 1567 1568 1569 1570
- Issue #18416: importlib.machinery.PathFinder now treats '' as the cwd and
  importlib.machinery.FileFinder no longer special-cases '' to '.'. This leads
  to modules imported from cwd to now possess an absolute file path for
  __file__ (this does not affect modules specified by path on the CLI but it
  does affect -m/runpy). It also allows FileFinder to be more consistent by not
  having an edge case.

1571 1572 1573
- Issue #4555: All exported C symbols are now prefixed with either
  "Py" or "_Py".

1574 1575 1576
- Issue #19219: Speed up marshal.loads(), and make pyc files slightly
  (5% to 10%) smaller.

1577 1578
- Issue #19221: Upgrade Unicode database to version 6.3.0.

1579 1580 1581 1582 1583
- Issue #16742: The result of the C callback PyOS_ReadlineFunctionPointer must
  now be a string allocated by PyMem_RawMalloc() or PyMem_RawRealloc() (or NULL
  if an error occurred), instead of a string allocated by PyMem_Malloc() or
  PyMem_Realloc().

1584 1585
- Issue #19199: Remove ``PyThreadState.tick_counter`` field

1586 1587 1588
- Fix macro expansion of _PyErr_OCCURRED(), and make sure to use it in at
  least one place so as to avoid regressions.

1589 1590 1591
- Issue #19087: Improve bytearray allocation in order to allow cheap popping
  of data at the front (slice deletion).

1592 1593
- Issue #19014: memoryview.cast() is now allowed on zero-length views.

1594 1595 1596
- Issue #18690: memoryview is now automatically registered with
  collections.abc.Sequence

1597 1598 1599
- Issue #19078: memoryview now correctly supports the reversed builtin
  (Patch by Claudiu Popa)

Larry Hastings's avatar
Larry Hastings committed
1600 1601 1602
Library
-------

1603 1604 1605
- Issue #17457: unittest test discovery now works with namespace packages.
  Patch by Claudiu Popa.

1606 1607
- Issue #18235: Fix the sysconfig variables LDSHARED and BLDSHARED under AIX.
  Patch by David Edelsohn.
1608

1609 1610 1611
- Issue #18606: Add the new "statistics" module (PEP 450).  Contributed
  by Steven D'Aprano.

1612 1613
- Issue #12866: The audioop module now supports 24-bit samples.

Christian Heimes's avatar
Christian Heimes committed
1614
- Issue #19254: Provide an optimized Python implementation of pbkdf2_hmac.
1615

1616 1617 1618
- Issues #19201, Issue #19222, Issue #19223: Add "x" mode (exclusive creation)
  in opening file to bz2, gzip and lzma modules. Patches by Tim Heaney and
  Vajrasky Kok.
1619

Brett Cannon's avatar
Brett Cannon committed
1620 1621
- Fix a reference count leak in _sre.

1622 1623 1624 1625 1626
- Issue #19262: Initial check in of the 'asyncio' package (a.k.a. Tulip,
  a.k.a. PEP 3156).  There are no docs yet, and the PEP is slightly
  out of date with the code.  This module will have *provisional* status
  in Python 3.4.

1627
- Issue #19276: Fixed the wave module on 64-bit big-endian platforms.
1628

1629 1630 1631
- Issue #19266: Rename the new-in-3.4 ``contextlib.ignore`` context manager
  to ``contextlib.suppress`` in order to be more consistent with existing
  descriptions of that operation elsewhere in the language and standard
1632
  library documentation (Patch by Zero Piraeus).
1633

1634 1635 1636
- Issue #18891: Completed the new email package (provisional) API additions
  by adding new classes EmailMessage, MIMEPart, and ContentManager.

Ethan Furman's avatar
Ethan Furman committed
1637 1638
- Issue #18281: Unused stat constants removed from `tarfile`.

1639 1640 1641 1642
- Issue #18468: The re.split, re.findall, and re.sub functions and the group()
  and groups() methods of match object now always return a string or a bytes
  object.

1643 1644
- Issue #18725: The textwrap module now supports truncating multiline text.

1645 1646 1647
- Issue #18776: atexit callbacks now display their full traceback when they
  raise an exception.

1648 1649 1650
- Issue #17827: Add the missing documentation for ``codecs.encode`` and
  ``codecs.decode``.

1651 1652 1653
- Issue #19218: Rename collections.abc to _collections_abc in order to
  speed up interpreter start.

1654 1655 1656
- Issue #18582: Add 'pbkdf2_hmac' to the hashlib module. It implements PKCS#5
  password-based key derivation functions with HMAC as pseudorandom function.

1657 1658
- Issue #19131: The aifc module now correctly reads and writes sampwidth of
  compressed streams.
1659

1660 1661 1662 1663
- Issue #19209: Remove import of copyreg from the os module to speed up
  interpreter startup. stat_result and statvfs_result are now hard-coded to
  reside in the os module.

1664 1665 1666
- Issue #19205: Don't import the 're' module in site and sysconfig module to
  to speed up interpreter start.

1667 1668 1669
- Issue #9548: Add a minimal "_bootlocale" module that is imported by the
  _io module instead of the full locale module.

1670 1671 1672
- Issue #18764: remove the 'print' alias for the PDB 'p' command so that it no
  longer shadows the print function.

Tim Peters's avatar
Tim Peters committed
1673 1674
- Issue #19158:  a rare race in BoundedSemaphore could allow .release() too
  often.
1675

1676 1677
- Issue #15805: Add contextlib.redirect_stdout().

1678 1679
- Issue #18716: Deprecate the formatter module.

1680 1681 1682
- Issue #10712: 2to3 has a new "asserts" fixer that replaces deprecated names
  of unittest methods (e.g. failUnlessEqual -> assertEqual).

1683
- Issue #18037: 2to3 now escapes '\u' and '\U' in native strings.
1684

1685 1686 1687 1688
- Issue #17839: base64.decodebytes and base64.encodebytes now accept any
  object that exports a 1 dimensional array of bytes (this means the same
  is now also true for base64_codec)

1689 1690
- Issue #19132: The pprint module now supports compact mode.

1691 1692
- Issue #19137: The pprint module now correctly formats instances of set and
  frozenset subclasses.
1693

1694 1695 1696 1697
- Issue #10042: functools.total_ordering now correctly handles
  NotImplemented being returned by the underlying comparison function (Patch
  by Katie Miller)

Nick Coghlan's avatar
Nick Coghlan committed
1698 1699 1700
- Issue #19092: contextlib.ExitStack now correctly reraises exceptions
  from the __exit__ callbacks of inner context managers (Patch by Hrvoje
  Nikšić)
1701

1702 1703
- Issue #12641: Avoid passing "-mno-cygwin" to the mingw32 compiler, except
  when necessary.  Patch by Oscar Benjamin.
1704

1705 1706 1707 1708
- Issue #5845: In site.py, only load readline history from ~/.python_history
  if no history has been read already.  This avoids double writes to the
  history file at shutdown.

1709 1710
- Properly initialize all fields of a SSL object after allocation.

1711 1712 1713
- Issue #19095: SSLSocket.getpeercert() now raises ValueError when the
  SSL handshake hasn't been done.

1714 1715 1716
- Issue #4366: Fix building extensions on all platforms when --enable-shared
  is used.

1717 1718 1719 1720 1721
- Issue #19030: Fixed `inspect.getmembers` and `inspect.classify_class_attrs`
  to attempt activating descriptors before falling back to a __dict__ search
  for faulty descriptors.  `inspect.classify_class_attrs` no longer returns
  Attributes whose home class is None.

1722 1723 1724
C API
-----

1725 1726
- Issue #1772673: The type of `char*` arguments now changed to `const char*`.

1727 1728 1729 1730 1731
- Issue #16129: Added a `Py_SetStandardStreamEncoding` pre-initialization API
  to allow embedding applications like Blender to force a particular
  encoding and error handler for the standard IO streams (initial patch by
  Bastien Montagne)

1732 1733 1734
Tests
-----

1735 1736
- Issue #19275: Fix test_site on AMD64 Snow Leopard

1737 1738
- Issue #14407: Fix unittest test discovery in test_concurrent_futures.

1739 1740 1741
- Issue #18919: Unified and extended tests for audio modules: aifc, sunau and
  wave.

1742 1743
- Issue #18714: Added tests for ``pdb.find_function()``.

1744 1745 1746
Documentation
-------------

1747 1748
- Issue #18758: Fixed and improved cross-references.

1749 1750
- Issue #18972: Modernize email examples and use the argparse module in them.

1751 1752 1753 1754 1755
Build
-----

- Issue #19130: Correct PCbuild/readme.txt, Python 3.3 and 3.4 require VS 2010.

1756
- Issue #15663: Update OS X 10.6+ installer to use Tcl/Tk 8.5.15.
Larry Hastings's avatar
Larry Hastings committed
1757

1758 1759 1760 1761 1762 1763
- Issue #14499: Fix several problems with OS X universal build support:
    1. ppc arch detection for extension module builds broke with Xcode 5
    2. ppc arch detection in configure did not work on OS X 10.4
    3. -sysroot and -arch flags were unnecessarily duplicated
    4. there was no obvious way to configure an intel-32 only build.

1764 1765 1766 1767 1768
- Issue #19019: Change the OS X installer build script to use CFLAGS instead
  of OPT for special build options.  By setting OPT, some compiler-specific
  options like -fwrapv were overridden and thus not used, which could result
  in broken interpreters when building with clang.

Larry Hastings's avatar
Larry Hastings committed
1769 1770 1771 1772 1773
What's New in Python 3.4.0 Alpha 3?
===================================

Release date: 2013-09-29

Larry Hastings's avatar
Larry Hastings committed
1774 1775 1776
Core and Builtins
-----------------

1777 1778
- Issue #18818: The "encodingname" part of PYTHONIOENCODING is now optional.

1779
- Issue #19098: Prevent overflow in the compiler when the recursion limit is set
Benjamin Peterson's avatar
Benjamin Peterson committed
1780
  absurdly high.
1781

Larry Hastings's avatar
Larry Hastings committed
1782 1783 1784
Library
-------

Ethan Furman's avatar
Ethan Furman committed
1785 1786 1787
- Issue #18929: `inspect.classify_class_attrs()` now correctly finds class
  attributes returned by `dir()` that are located in the metaclass.

1788 1789 1790 1791 1792 1793 1794
- Issue #18950: Fix miscellaneous bugs in the sunau module.
  Au_read.readframes() now updates current file position and reads correct
  number of frames from multichannel stream.  Au_write.writeframesraw() now
  correctly updates current file position.  Au_read.getnframes() now returns an
  integer (as in Python 2).  Au_read and Au_write now correctly works with file
  object if start file position is not a zero.

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
1795 1796 1797
- Issue #18594: The fast path for collections.Counter() was never taken
  due to an over-restrictive type check.

1798 1799 1800
- Issue #19053: ZipExtFile.read1() with non-zero argument no more returns empty
  bytes until end of data.

1801 1802 1803
- logging: added support for Unix domain sockets to SocketHandler and
  DatagramHandler.

1804 1805 1806
- Issue #18996: TestCase.assertEqual() now more cleverly shorten differing
  strings in error report.

1807 1808
- Issue #19034: repr() for tkinter.Tcl_Obj now exposes string reperesentation.

Jason R. Coombs's avatar
Jason R. Coombs committed
1809 1810 1811
- Issue #18978: ``urllib.request.Request`` now allows the method to be
  indicated on the class and no longer sets it to None in ``__init__``.

1812 1813 1814
- Issue #18626: the inspect module now offers a basic command line
  introspection interface (Initial patch by Claudiu Popa)

1815 1816 1817
- Issue #3015: Fixed tkinter with wantobject=False.  Any Tcl command call
  returned empty string.

1818 1819 1820 1821
- Issue #19037: The mailbox module now makes all changes to maildir files
  before moving them into place, to avoid race conditions with other programs
  that may be accessing the maildir directory.

1822 1823 1824 1825 1826
- Issue #14984: On POSIX systems, when netrc is called without a filename
  argument (and therefore is reading the user's $HOME/.netrc file), it now
  enforces the same security rules as typical ftp clients: the .netrc file must
  be owned by the user that owns the process and must not be readable by any
  other user.
1827

1828 1829
- Issue #18873: The tokenize module now detects Python source code encoding
  only in comment lines.
1830

1831 1832 1833
- Issue #17764: Enable http.server to bind to a user specified network
  interface.  Patch contributed by Malte Swart.

1834 1835
- Issue #18937: Add an assertLogs() context manager to unittest.TestCase
  to ensure that a block of code emits a message using the logging module.
1836

1837 1838
- Issue #17324: Fix http.server's request handling case on trailing '/'. Patch
  contributed by Vajrasky Kok.
1839

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
1840 1841
- Issue #19018: The heapq.merge() function no longer suppresses IndexError
  in the underlying iterables.
1842

R David Murray's avatar
R David Murray committed
1843 1844 1845
- Issue #18784: The uuid module no longer attempts to load libc via ctypes.CDLL
  if all the necessary functions have already been found in libuuid.  Patch by
  Evgeny Sologubov.
1846

1847 1848 1849 1850
- The :envvar:`PYTHONFAULTHANDLER` environment variable now only enables the
  faulthandler module if the variable is non-empty. Same behaviour than other
  variables like :envvar:`PYTHONDONTWRITEBYTECODE`.

1851 1852 1853 1854
- Issue #1565525: New function ``traceback.clear_frames`` will clear
  the local variables of all the stack frames referenced by a traceback
  object.

Nick Coghlan's avatar
Nick Coghlan committed
1855 1856
Tests
-----
1857

Nick Coghlan's avatar
Nick Coghlan committed
1858 1859 1860
- Issue #18952: Fix regression in support data downloads introduced when
  test.support was converted to a package. Regression noticed by Zachary
  Ware.
1861

1862 1863
IDLE
----
1864

1865 1866
- Issue #18873: IDLE now detects Python source code encoding only in comment
  lines.
1867

1868
- Issue #18988: The "Tab" key now works when a word is already autocompleted.
1869

1870 1871 1872 1873 1874 1875
Documentation
-------------

- Issue #17003: Unified the size argument names in the io module with common
  practice.

1876 1877 1878 1879 1880 1881 1882
Build
-----

- Issue #18596: Support the use of address sanity checking in recent versions
  of clang and GCC by appropriately marking known false alarms in the small
  object allocator. Patch contributed by Dhiru Kholia.

1883 1884 1885 1886 1887 1888
Tools/Demos
-----------

- Issue #18873: 2to3 and the findnocoding.py script now detect Python source
  code encoding only in comment lines.

Larry Hastings's avatar
Larry Hastings committed
1889

1890 1891 1892
What's New in Python 3.4.0 Alpha 2?
===================================

Larry Hastings's avatar
Larry Hastings committed
1893
Release date: 2013-09-09
1894 1895 1896 1897

Core and Builtins
-----------------

1898 1899
- Issue #18942: sys._debugmallocstats() output was damaged on Windows.

1900 1901 1902 1903 1904
- Issue #18571: Implementation of the PEP 446: file descriptors and file
  handles are now created non-inheritable; add functions
  os.get/set_inheritable(), os.get/set_handle_inheritable() and
  socket.socket.get/set_inheritable().

1905 1906 1907
- Issue #11619: The parser and the import machinery do not encode Unicode
  filenames anymore on Windows.

1908 1909 1910
- Issue #18808: Non-daemon threads are now automatically joined when
  a sub-interpreter is shutdown (it would previously dump a fatal error).

R David Murray's avatar
R David Murray committed
1911
- Remove support for compiling on systems without getcwd().
1912

1913 1914
- Issue #18774: Remove last bits of GNU PTH thread code and thread_pth.h.

1915 1916 1917 1918
- Issue #18771: Add optimization to set object lookups to reduce the cost
  of hash collisions.  The core idea is to inspect a second key/hash pair
  for each cache line retrieved.

1919 1920 1921 1922
- Issue #16105: When a signal handler fails to write to the file descriptor
  registered with ``signal.set_wakeup_fd()``, report an exception instead
  of ignoring the error.

1923 1924
- Issue #18722: Remove uses of the "register" keyword in C code.

1925 1926
- Issue #18667: Add missing "HAVE_FCHOWNAT" symbol to posix._have_functions.

1927
- Issue #16499: Add command line option for isolated mode.
1928

1929 1930 1931
- Issue #15301: Parsing fd, uid, and gid parameters for builtins
  in Modules/posixmodule.c is now far more robust.

1932
- Issue #18368: PyOS_StdioReadline() no longer leaks memory when realloc()
1933
  fail.
1934

1935 1936 1937
- Issue #17934: Add a clear() method to frame objects, to help clean up
  expensive details (local variables) and break reference cycles.

1938 1939 1940
- Issue #18780: %-formatting codes %d, %i, and %u now treat int-subclasses
  as int (displays value of int-subclass instead of str(int-subclass) ).

1941 1942 1943
Library
-------

1944 1945 1946 1947
- Issue #18808: Thread.join() now waits for the underlying thread state to
  be destroyed before returning.  This prevents unpredictable aborts in
  Py_EndInterpreter() when some non-daemon threads are still running.

1948 1949 1950
- Issue #18458: Prevent crashes with newer versions of libedit.  Its readline
  emulation has changed from 0-based indexing to 1-based like gnu readline.

1951 1952 1953
- Issue #18852: Handle case of ``readline.__doc__`` being ``None`` in the new
  readline activation code in ``site.py``.

1954
- Issue #18672: Fixed format specifiers for Py_ssize_t in debugging output in
Serhiy Storchaka's avatar
Serhiy Storchaka committed
1955
  the _sre module.
1956

R David Murray's avatar
R David Murray committed
1957
- Issue #18830: inspect.getclasstree() no longer produces duplicate entries even
1958 1959
  when input list contains duplicates.

1960 1961 1962
- Issue #18878: sunau.open now supports the context manager protocol.  Based on
  patches by Claudiu Popa and R. David Murray.

1963 1964 1965
- Issue #18909: Fix _tkinter.tkapp.interpaddr() on Windows 64-bit, don't cast
  64-bit pointer to long (32 bits).

1966 1967
- Issue #18876: The FileIO.mode attribute now better reflects the actual mode
  under which the file was opened.  Patch by Erik Bray.
1968

1969 1970
- Issue #16853: Add new selectors module.

1971 1972
- Issue #18882: Add threading.main_thread() function.

1973 1974 1975
- Issue #18901: The sunau getparams method now returns a namedtuple rather than
  a plain tuple.  Patch by Claudiu Popa.

1976 1977 1978
- Issue #17487: The result of the wave getparams method now is pickleable again.
  Patch by Claudiu Popa.

1979 1980 1981 1982
- Issue #18756: os.urandom() now uses a lazily-opened persistent file
  descriptor, so as to avoid using many file descriptors when run in
  parallel from multiple threads.

1983 1984 1985
- Issue #18418: After fork(), reinit all threads states, not only active ones.
  Patch by A. Jesse Jiryu Davis.

1986 1987
- Issue #17974: Switch unittest from using getopt to using argparse.

1988 1989
- Issue #11798: TestSuite now drops references to own tests after execution.

1990 1991 1992
- Issue #16611: http.cookie now correctly parses the 'secure' and 'httponly'
  cookie flags.

1993 1994 1995
- Issue #11973: Fix a problem in kevent. The flags and fflags fields are now
  properly handled as unsigned.

1996 1997 1998
- Issue #18807: ``pyvenv`` now takes a --copies argument allowing copies
  instead of symlinks even where symlinks are available and the default.

1999 2000 2001
- Issue #18538: ``python -m dis`` now uses argparse for argument processing.
  Patch by Michele Orrù.

2002 2003
- Issue #18394: Close cgi.FieldStorage's optional file.

R David Murray's avatar
R David Murray committed
2004
- Issue #17702: On error, os.environb now suppresses the exception context
2005 2006
  when raising a new KeyError with the original key.

2007 2008
- Issue #16809: Fixed some tkinter incompabilities with Tcl/Tk 8.6.

2009 2010 2011
- Issue #16809: Tkinter's splitlist() and split() methods now accept Tcl_Obj
  argument.

2012 2013 2014
- Issue #18324: set_payload now correctly handles binary input.  This also
  supersedes the previous fixes for #14360, #1717, and #16564.

2015 2016 2017
- Issue #18794: Add a fileno() method and a closed attribute to select.devpoll
  objects.

2018 2019 2020
- Issue #17119: Fixed integer overflows when processing large strings and tuples
  in the tkinter module.

2021
- Issue #18747: Re-seed OpenSSL's pseudo-random number generator after fork.
2022
  A pthread_atfork() parent handler is used to seed the PRNG with pid, time
2023 2024
  and some stack data.

2025 2026 2027
- Issue #8865: Concurrent invocation of select.poll.poll() now raises a
  RuntimeError exception.  Patch by Christian Schubert.

2028 2029 2030
- Issue #18777: The ssl module now uses the new CRYPTO_THREADID API of
  OpenSSL 1.0.0+ instead of the deprecated CRYPTO id callback function.

Christian Heimes's avatar
Christian Heimes committed
2031
- Issue #18768: Correct doc string of RAND_edg(). Patch by Vajrasky Kok.
2032

2033 2034 2035
- Issue #18178: Fix ctypes on BSD. dlmalloc.c was compiled twice which broke
  malloc weak symbols.

2036 2037 2038 2039 2040 2041
- Issue #18709: Fix CVE-2013-4238. The SSL module now handles NULL bytes
  inside subjectAltName correctly. Formerly the module has used OpenSSL's
  GENERAL_NAME_print() function to get the string represention of ASN.1
  strings for ``rfc822Name`` (email), ``dNSName`` (DNS) and
  ``uniformResourceIdentifier`` (URI).

2042 2043
- Issue #18701: Remove support of old CPython versions (<3.0) from C code.

2044 2045 2046 2047
- Issue #18756: Improve error reporting in os.urandom() when the failure
  is due to something else than /dev/urandom not existing (for example,
  exhausting the file descriptor limit).

2048 2049 2050
- Issue #18673: Add O_TMPFILE to os module. O_TMPFILE requires Linux kernel
  3.11 or newer. It's only defined on system with 3.11 uapi headers, too.

2051 2052 2053
- Issue #18532: Change the builtin hash algorithms' names to lower case names
  as promised by hashlib's documentation.

2054 2055
- Issue #18405: Improve the entropy of crypt.mksalt().

2056 2057 2058 2059 2060
- Issue #12015: The tempfile module now uses a suffix of 8 random characters
  instead of 6, to reduce the risk of filename collision. The entropy was
  reduced when uppercase letters were removed from the charset used to generate
  random characters.

2061 2062 2063
- Issue #18585: Add :func:`textwrap.shorten` to collapse and truncate a
  piece of text to a given length.

2064 2065 2066
- Issue #18598: Tweak exception message for importlib.import_module() to
  include the module name when a key argument is missing.

Eric Snow's avatar
Eric Snow committed
2067
- Issue #19151: Fix docstring and use of _get_supported_file_loaders() to
2068 2069
  reflect 2-tuples.

2070 2071
- Issue #19152: Add ExtensionFileLoader.get_filename().

Terry Jan Reedy's avatar
Terry Jan Reedy committed
2072 2073 2074
- Issue #18676: Change 'positive' to 'non-negative' in queue.py put and get
  docstrings and ValueError messages. Patch by Zhongyue Luo

2075 2076
- Fix refcounting issue with extension types in tkinter.

2077 2078 2079
- Issue #8112: xlmrpc.server's DocXMLRPCServer server no longer raises an error
  if methods have annotations; it now correctly displays the annotations.

2080 2081 2082
- Issue #18600: Added policy argument to email.message.Message.as_string,
  and as_bytes and __bytes__ methods to Message.

2083 2084
- Issue #18671: Output more information when logging exceptions occur.

2085 2086 2087
- Issue #18621: Prevent the site module's patched builtins from keeping
  too many references alive for too long.

2088 2089 2090 2091
- Issue #4885: Add weakref support to mmap objects.  Patch by Valerie Lambert.

- Issue #8860: Fixed rounding in timedelta constructor.

2092 2093 2094
- Issue #18849: Fixed a Windows-specific tempfile bug where collision with an
  existing directory caused mkstemp and related APIs to fail instead of
  retrying. Report and fix by Vlad Shcherbina.
2095

2096 2097 2098
- Issue #18920: argparse's default destination for the version action (-v,
  --version) has also been changed to stdout, to match the Python executable.

2099 2100 2101
Tests
-----

2102 2103 2104
- Issue #18623: Factor out the _SuppressCoreFiles context manager into
  test.support.  Patch by Valerie Lambert.

2105 2106
- Issue #12037: Fix test_email for desktop Windows.

2107 2108 2109 2110 2111
- Issue #15507: test_subprocess's test_send_signal could fail if the test
  runner were run in an environment where the process inherited an ignore
  setting for SIGINT.  Restore the SIGINT handler to the desired
  KeyboardInterrupt raising one during that test.

2112 2113 2114
- Issue #16799: Switched from getopt to argparse style in regrtest's argument
  parsing.  Added more tests for regrtest's argument parsing.

2115 2116 2117 2118
- Issue #18792: Use "127.0.0.1" or "::1" instead of "localhost" as much as
  possible, since "localhost" goes through a DNS lookup under recent Windows
  versions.

2119 2120 2121 2122 2123
IDLE
----

- Issue #18489: Add tests for SearchEngine. Original patch by Phil Webster.

2124 2125 2126
Documentation
-------------

2127 2128
- Issue #18743: Fix references to non-existant "StringIO" module.

2129 2130 2131
- Issue #18783: Removed existing mentions of Python long type in docstrings,
  error messages and comments.

2132 2133 2134 2135 2136 2137
Build
-----

- Issue #1584: Provide configure options to override default search paths for
  Tcl and Tk when building _tkinter.

2138 2139 2140 2141 2142
- Issue #15663: Tcl/Tk 8.5.14 is now included with the OS X 10.6+ 64-/32-bit
  installer.  It is no longer necessary to install a third-party version of
  Tcl/Tk 8.5 to work around the problems in the Apple-supplied Tcl/Tk 8.5
  shipped in OS X 10.6 and later releases.

2143 2144 2145 2146 2147 2148
Tools/Demos
-----------

- Issue #18922: Now The Lib/smtpd.py and Tools/i18n/msgfmt.py scripts write
  their version strings to stdout, and not to sderr.

Georg Brandl's avatar
Georg Brandl committed
2149 2150
What's New in Python 3.4.0 Alpha 1?
===================================
2151

Larry Hastings's avatar
Larry Hastings committed
2152
Release date: 2013-08-03
2153 2154 2155 2156

Core and Builtins
-----------------

2157 2158
- Issue #16741: Fix an error reporting in int().

2159 2160
- Issue #17899: Fix rare file descriptor leak in os.listdir().

2161 2162 2163
- Issue #10241: Clear extension module dict copies at interpreter shutdown.
  Patch by Neil Schemenauer, minimally modified.

2164 2165 2166
- Issue #9035: ismount now recognises volumes mounted below a drive root
  on Windows. Original patch by Atsuo Ishimoto.

2167 2168 2169
- Issue #18214: Improve finalization of Python modules to avoid setting
  their globals to None, in most cases.

2170 2171
- Issue #18112: PEP 442 implementation (safe object finalization).

2172 2173 2174
- Issue #18552: Check return value of PyArena_AddPyObject() in
  obj2ast_object().

2175 2176
- Issue #18560: Fix potential NULL pointer dereference in sum().

2177 2178 2179 2180
- Issue #18520: Add a new PyStructSequence_InitType2() function, same than
  PyStructSequence_InitType() except that it has a return value (0 on success,
  -1 on error).

2181 2182 2183
- Issue #15905: Fix theoretical buffer overflow in handling of sys.argv[0],
  prefix and exec_prefix if the operation system does not obey MAXPATHLEN.

2184 2185 2186
- Issue #18408: Fix many various bugs in code handling errors, especially
  on memory allocation failure (MemoryError).

2187 2188
- Issue #18344: Fix potential ref-leaks in _bufferedreader_read_all().

2189 2190 2191
- Issue #18342: Use the repr of a module name when an import fails when using
  ``from ... import ...``.

2192 2193 2194
- Issue #17872: Fix a segfault in marshal.load() when input stream returns
  more bytes than requested.

2195 2196 2197
- Issue #18338: `python --version` now prints version string to stdout, and
  not to stderr.  Patch by Berker Peksag and Michael Dickens.

2198 2199 2200
- Issue #18426: Fix NULL pointer dereference in C extension import when
  PyModule_GetDef() returns an error.

2201 2202 2203 2204
- Issue #17206: On Windows, increase the stack size from 2 MB to 4.2 MB to fix
  a stack overflow in the marshal module (fix a crash in test_marshal).
  Patch written by Jeremy Kloth.

2205 2206 2207
- Issue #3329: Implement the PEP 445: Add new APIs to customize Python memory
  allocators.

2208 2209 2210
- Issue #18328: Reorder ops in PyThreadState_Delete*() functions. Now the
  tstate is first removed from TLS and then deallocated.

2211 2212
- Issue #13483: Use VirtualAlloc in obmalloc on Windows.

2213 2214 2215
- Issue #18184: PyUnicode_FromFormat() and PyUnicode_FromFormatV() now raise
  OverflowError when an argument of %c format is out of range.

2216 2217 2218 2219
- Issue #18111: The min() and max() functions now support a default argument
  to be returned instead of raising a ValueError on an empty sequence.
  (Contributed by Julian Berman.)

2220 2221 2222
- Issue #18137: Detect integer overflow on precision in float.__format__()
  and complex.__format__().

2223 2224 2225
- Issue #18183: Fix various unicode operations on strings with large unicode
  codepoints.

2226 2227
- Issue #18180: Fix ref leak in _PyImport_GetDynLoadWindows().

2228 2229 2230
- Issue #18038: SyntaxError raised during compilation sources with illegal
  encoding now always contains an encoding name.

2231 2232
- Issue #17931: Resolve confusion on Windows between pids and process
  handles.
2233

2234 2235 2236
- Tweak the exception message when the magic number or size value in a bytecode
  file is truncated.

2237 2238 2239
- Issue #17932: Fix an integer overflow issue on Windows 64-bit in iterators:
  change the C type of seqiterobject.it_index from long to Py_ssize_t.

2240 2241 2242 2243 2244 2245
- Issue #18065: Don't set __path__ to the package name for frozen packages.

- Issue #18088: When reloading a module, unconditionally reset all relevant
  attributes on the module (e.g. __name__, __loader__, __package__, __file__,
  __cached__).

2246 2247
- Issue #17937: Try harder to collect cyclic garbage at shutdown.

2248 2249 2250
- Issue #12370: Prevent class bodies from interfering with the __class__
  closure.

2251 2252 2253
- Issue #17644: Fix a crash in str.format when curly braces are used in square
  brackets.

2254 2255
- Issue #17237: Fix crash in the ASCII decoder on m68k.

2256 2257 2258
- Issue #17927: Frame objects kept arguments alive if they had been
  copied into a cell, even if the cell was cleared.

2259 2260 2261
- Issue #1545463: At shutdown, defer finalization of codec modules so
  that stderr remains usable.

2262 2263 2264
- Issue #7330: Implement width and precision (ex: "%5.3s") for the format
  string of PyUnicode_FromFormat() function, original patch written by Ysj Ray.

2265 2266 2267
- Issue #1545463: Global variables caught in reference cycles are now
  garbage-collected at shutdown.

2268 2269 2270 2271 2272
- Issue #17094: Clear stale thread states after fork().  Note that this
  is a potentially disruptive change since it may release some system
  resources which would otherwise remain perpetually alive (e.g. database
  connections kept in thread-local storage).

2273 2274 2275
- Issue #17408: Avoid using an obsolete instance of the copyreg module when
  the interpreter is shutdown and then started again.

2276 2277 2278
- Issue #5845: Enable tab-completion in the interactive interpreter by
  default, thanks to a new sys.__interactivehook__.

2279 2280 2281
- Issue #17115,17116: Module initialization now includes setting __package__ and
  __loader__ attributes to None.

2282 2283 2284
- Issue #17853: Ensure locals of a class that shadow free variables always win
  over the closures.

2285 2286 2287
- Issue #17863: In the interactive console, don't loop forever if the encoding
  can't be fetched from stdin.

2288 2289
- Issue #17867: Raise an ImportError if __import__ is not found in __builtins__.

2290 2291
- Issue #18698: Ensure importlib.reload() returns the module out of sys.modules.

2292 2293 2294
- Issue #17857: Prevent build failures with pre-3.5.0 versions of sqlite3,
  such as was shipped with Centos 5 and Mac OS X 10.4.

2295 2296 2297 2298
- Issue #17413: sys.settrace callbacks were being passed a string instead of an
  exception instance for the 'value' element of the arg tuple if the exception
  originated from C code; now an exception instance is always provided.

2299 2300 2301
- Issue #17782: Fix undefined behaviour on platforms where
  ``struct timespec``'s "tv_nsec" member is not a C long.

2302 2303
- Issue #17722: When looking up __round__, resolve descriptors.

2304 2305
- Issue #16061: Speed up str.replace() for replacing 1-character strings.

2306 2307 2308
- Issue #17715: Fix segmentation fault from raising an exception in a __trunc__
  method.

2309 2310
- Issue #17643: Add __callback__ attribute to weakref.ref.

2311 2312 2313
- Issue #16447: Fixed potential segmentation fault when setting __name__ on a
  class.

2314 2315
- Issue #17669: Fix crash involving finalization of generators using yield from.

2316 2317
- Issue #14439: Python now prints the traceback on runpy failure at startup.

2318 2319 2320
- Issue #17469: Fix _Py_GetAllocatedBlocks() and sys.getallocatedblocks()
  when running on valgrind.

2321 2322
- Issue #17619: Make input() check for Ctrl-C correctly on Windows.

Brett Cannon's avatar
merge  
Brett Cannon committed
2323 2324
- Issue #17357: Add missing verbosity messages for -v/-vv that were lost during
  the importlib transition.
2325

2326 2327
- Issue #17610: Don't rely on non-standard behavior of the C qsort() function.

2328 2329 2330
- Issue #17323: The "[X refs, Y blocks]" printed by debug builds has been
  disabled by default.  It can be re-enabled with the `-X showrefcount` option.

2331 2332 2333 2334 2335 2336 2337 2338 2339 2340 2341 2342 2343 2344 2345 2346 2347 2348 2349 2350 2351 2352 2353 2354 2355 2356 2357 2358 2359 2360 2361 2362 2363 2364 2365 2366 2367 2368 2369 2370 2371 2372 2373 2374 2375 2376 2377 2378 2379 2380 2381 2382 2383 2384 2385 2386 2387 2388 2389 2390 2391 2392 2393 2394 2395 2396 2397 2398 2399 2400 2401 2402 2403 2404 2405 2406 2407 2408 2409 2410 2411 2412 2413 2414 2415 2416 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429 2430 2431 2432 2433 2434 2435 2436
- Issue #17328: Fix possible refleak in dict.setdefault.

- Issue #17275: Corrected class name in init error messages of the C version of
  BufferedWriter and BufferedRandom.

- Issue #7963: Fixed misleading error message that issued when object is
  called without arguments.

- Issue #8745: Small speed up zipimport on Windows. Patch by Catalin Iacob.

- Issue #5308: Raise ValueError when marshalling too large object (a sequence
  with size >= 2**31), instead of producing illegal marshal data.

- Issue #12983: Bytes literals with invalid \x escape now raise a SyntaxError
  and a full traceback including line number.

- Issue #16967: In function definition, evaluate positional defaults before
  keyword-only defaults.

- Issue #17173: Remove uses of locale-dependent C functions (isalpha() etc.)
  in the interpreter.

- Issue #17137: When an Unicode string is resized, the internal wide character
  string (wstr) format is now cleared.

- Issue #17043: The unicode-internal decoder no longer read past the end of
  input buffer.

- Issue #17098: All modules now have __loader__ set even if they pre-exist the
  bootstrapping of importlib.

- Issue #16979: Fix error handling bugs in the unicode-escape-decode decoder.

- Issue #16772: The base argument to the int constructor no longer accepts
  floats, or other non-integer objects with an __int__ method.  Objects
  with an __index__ method are now accepted.

- Issue #10156: In the interpreter's initialization phase, unicode globals
  are now initialized dynamically as needed.

- Issue #16980: Fix processing of escaped non-ascii bytes in the
  unicode-escape-decode decoder.

- Issue #16975: Fix error handling bug in the escape-decode bytes decoder.

- Issue #14850: Now a charmap decoder treats U+FFFE as "undefined mapping"
  in any mapping, not only in a string.

- Issue #16730: importlib.machinery.FileFinder now no longers raises an
  exception when trying to populate its cache and it finds out the directory is
  unreadable or has turned into a file. Reported and diagnosed by
  David Pritchard.

- Issue #16906: Fix a logic error that prevented most static strings from being
  cleared.

- Issue #11461: Fix the incremental UTF-16 decoder. Original patch by
  Amaury Forgeot d'Arc.

- Issue #16856: Fix a segmentation fault from calling repr() on a dict with
  a key whose repr raise an exception.

- Issue #16367: Fix FileIO.readall() on Windows for files larger than 2 GB.

- Issue #16761: Calling int() with base argument only now raises TypeError.

- Issue #16759: Support the full DWORD (unsigned long) range in Reg2Py
  when retrieving a REG_DWORD value. This corrects functions like
  winreg.QueryValueEx that may have been returning truncated values.

- Issue #14420: Support the full DWORD (unsigned long) range in Py2Reg
  when passed a REG_DWORD value. Fixes OverflowError in winreg.SetValueEx.

- Issue #11939: Set the st_dev attribute of stat_result to allow Windows to
  take advantage of the os.path.samefile/sameopenfile/samestat implementations
  used by other platforms.

- Issue #16772: The int() constructor's second argument (base) no longer
  accepts non integer values.  Consistent with the behavior in Python 2.

- Issue #14470: Remove w9xpopen support per PEP 11.

- Issue #9856: Replace deprecation warning with raising TypeError
  in object.__format__. Patch by Florent Xicluna.

- Issue #16597: In buffered and text IO, call close() on the underlying stream
  if invoking flush() fails.

- Issue #16722: In the bytes() constructor, try to call __bytes__ on the
  argument before __index__.

- Issue #16421: loading multiple modules from one shared object is now
  handled correctly (previously, the first module loaded from that file
  was silently returned). Patch by Václav Šmilauer.

- Issue #16602: When a weakref's target was part of a long deallocation
  chain, the object could remain reachable through its weakref even though
  its refcount had dropped to zero.

- Issue #16495: Remove extraneous NULL encoding check from bytes_decode().

- Issue #16619: Create NameConstant AST class to represent None, True, and False
  literals. As a result, these constants are never loaded at runtime from
  builtins.

- Issue #16455: On FreeBSD and Solaris, if the locale is C, the
2437
  ASCII/surrogateescape codec is now used (instead of the locale encoding) to
2438
  decode the command line arguments. This change fixes inconsistencies with
2439 2440
  os.fsencode() and os.fsdecode(), because these operating systems announce an
  ASCII locale encoding, but actually use the ISO-8859-1 encoding in practice.
2441 2442 2443 2444 2445 2446 2447 2448 2449 2450 2451 2452 2453 2454 2455 2456 2457 2458 2459 2460 2461 2462 2463 2464 2465 2466 2467 2468 2469 2470 2471 2472 2473 2474 2475 2476 2477 2478 2479 2480 2481 2482 2483 2484 2485 2486 2487 2488 2489 2490 2491 2492 2493 2494 2495 2496 2497 2498 2499 2500 2501 2502 2503 2504 2505 2506 2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561

- Issue #16562: Optimize dict equality testing.  Patch by Serhiy Storchaka.

- Issue #16588: Silence unused-but-set warnings in Python/thread_pthread

- Issue #16592: stringlib_bytes_join doesn't raise MemoryError on allocation
  failure.

- Issue #16546: Fix: ast.YieldFrom argument is now mandatory.

- Issue #16514: Fix regression causing a traceback when sys.path[0] is None
  (actually, any non-string or non-bytes type).

- Issue #16306: Fix multiple error messages when unknown command line
  parameters where passed to the interpreter.  Patch by Hieu Nguyen.

- Issue #16215: Fix potential double memory free in str.replace().  Patch
  by Serhiy Storchaka.

- Issue #16290: A float return value from the __complex__ special method is no
  longer accepted in the complex() constructor.

- Issue #16416: On Mac OS X, operating system data are now always
  encoded/decoded to/from UTF-8/surrogateescape, instead of the locale encoding
  (which may be ASCII if no locale environment variable is set), to avoid
  inconsistencies with os.fsencode() and os.fsdecode() functions which are
  already using UTF-8/surrogateescape.

- Issue #16453: Fix equality testing of dead weakref objects.

- Issue #9535: Fix pending signals that have been received but not yet
  handled by Python to not persist after os.fork() in the child process.

- Issue #14794: Fix slice.indices to return correct results for huge values,
  rather than raising OverflowError.

- Issue #15001: fix segfault on "del sys.modules['__main__']". Patch by Victor
  Stinner.

- Issue #8271: the utf-8 decoder now outputs the correct number of U+FFFD
  characters when used with the 'replace' error handler on invalid utf-8
  sequences.  Patch by Serhiy Storchaka, tests by Ezio Melotti.

- Issue #5765: Apply a hard recursion limit in the compiler instead of
  blowing the stack and segfaulting. Initial patch by Andrea Griffini.

- Issue #16402: When slicing a range, fix shadowing of exceptions from
  __index__.

- Issue #16336: fix input checking in the surrogatepass error handler.
  Patch by Serhiy Storchaka.

- Issue #8401: assigning an int to a bytearray slice (e.g. b[3:4] = 5) now
  raises an error.

- Issue #7317: Display full tracebacks when an error occurs asynchronously.
  Patch by Alon Horev with update by Alexey Kachayev.

- Issue #16309: Make PYTHONPATH="" behavior the same as if PYTHONPATH
  not set at all.

- Issue #10189: Improve the error reporting of SyntaxErrors related to global
  and nonlocal statements.

- Fix segfaults on setting __qualname__ on builtin types and attempting to
  delete it on any type.

- Issue #14625: Rewrite the UTF-32 decoder. It is now 3x to 4x faster. Patch
  written by Serhiy Storchaka.

- Issue #16345: Fix an infinite loop when ``fromkeys`` on a dict subclass
  received a nonempty dict from the constructor.

- Issue #16271: Fix strange bugs that resulted from __qualname__ appearing in a
  class's __dict__ and on type.

- Issue #12805: Make bytes.join and bytearray.join faster when the separator
  is empty.  Patch by Serhiy Storchaka.

- Issue #6074: Ensure cached bytecode files can always be updated by the
  user that created them, even when the source file is read-only.

- Issue #15958: bytes.join and bytearray.join now accept arbitrary buffer
  objects.

- Issue #14783: Improve int() docstring and switch docstrings for str(),
  range(), and slice() to use multi-line signatures.

- Issue #16160: Subclass support now works for types.SimpleNamespace.

- Upgrade Unicode data (UCD) to version 6.2.

- Issue #15379: Fix passing of non-BMP characters as integers for the charmap
  decoder (already working as unicode strings).  Patch by Serhiy Storchaka.

- Issue #15144: Fix possible integer overflow when handling pointers as integer
  values, by using `Py_uintptr_t` instead of `size_t`.  Patch by Serhiy
  Storchaka.

- Issue #15965: Explicitly cast `AT_FDCWD` as (int).  Required on Solaris 10
  (which defines `AT_FDCWD` as ``0xffd19553``), harmless on other platforms.

- Issue #15839: Convert SystemErrors in `super()` to RuntimeErrors.

- Issue #15448: Buffered IO now frees the buffer when closed, instead
  of when deallocating.

- Issue #15846: Fix SystemError which happened when using `ast.parse()` in an
  exception handler on code with syntax errors.

- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.

- Issue #15801: Make sure mappings passed to '%' formatting are actually
  subscriptable.

- Issue #15111: __import__ should propagate ImportError when raised as a
  side-effect of a module triggered from using fromlist.

- Issue #15022: Add pickle and comparison support to types.SimpleNamespace.

2562 2563
Library
-------
Terry Jan Reedy's avatar
Terry Jan Reedy committed
2564

2565 2566
- Issue #4331: Added functools.partialmethod (Initial patch by Alon Horev)

2567 2568 2569
- Issue #13461: Fix a crash in the TextIOWrapper.tell method on 64-bit
  platforms.  Patch by Yogesh Chaudhari.

Ezio Melotti's avatar
Ezio Melotti committed
2570
- Issue #18681: Fix a NameError in importlib.reload() (noticed by Weizhao Li).
2571

2572 2573 2574
- Issue #14323: Expanded the number of digits in the coefficients for the
  RGB -- YIQ conversions so that they match the FCC NTSC versions.

2575 2576
- Issue #17998: Fix an internal error in regular expression engine.

2577 2578 2579
- Issue #17557: Fix os.getgroups() to work with the modified behavior of
  getgroups(2) on OS X 10.8.  Original patch by Mateusz Lenik.

2580 2581 2582
- Issue #18608: Avoid keeping a strong reference to the locale module
  inside the _io module.

2583 2584 2585
- Issue #18619: Fix atexit leaking callbacks registered from sub-interpreters,
  and make it GC-aware.

2586 2587 2588 2589
- Issue #15699: The readline module now uses PEP 3121-style module
  initialization, so as to reclaim allocated resources (Python callbacks)
  at shutdown.  Original patch by Robin Schreiber.

2590 2591
- Issue #17616: wave.open now supports the context manager protocol.

2592 2593 2594
- Issue #18599: Fix name attribute of _sha1.sha1() object. It now returns
  'SHA1' instead of 'SHA'.

2595 2596 2597
- Issue #13266: Added inspect.unwrap to easily unravel __wrapped__ chains
  (initial patch by Daniel Urban and Aaron Iles)

2598 2599
- Issue #18561: Skip name in ctypes' _build_callargs() if name is NULL.

2600 2601
- Issue #18559: Fix NULL pointer dereference error in _pickle module

Brett Cannon's avatar
Brett Cannon committed
2602 2603 2604
- Issue #18556: Check the return type of PyUnicode_AsWideChar() in ctype's
  U_set().

2605 2606
- Issue #17818: aifc.getparams now returns a namedtuple.

2607 2608
- Issue #18549: Eliminate dead code in socket_ntohl()

2609 2610 2611
- Issue #18530: Remove additional stat call from posixpath.ismount.
  Patch by Alex Gaynor.

2612 2613
- Issue #18514: Fix unreachable Py_DECREF() call in PyCData_FromBaseObj()

2614 2615 2616
- Issue #9177: Calling read() or write() now raises ValueError, not
  AttributeError, on a closed SSL socket.  Patch by Senko Rasic.

2617 2618 2619
- Issue #18513: Fix behaviour of cmath.rect w.r.t. signed zeros on OS X 10.8 +
  gcc.

2620 2621 2622
- Issue #18479: Changed venv Activate.ps1 to make deactivate a function, and
  removed Deactivate.ps1.

2623 2624
- Issue #18480: Add missing call to PyType_Ready to the _elementtree extension.

2625 2626 2627
- Issue #17778: Fix test discovery for test_multiprocessing. (Patch by
  Zachary Ware.)

2628 2629 2630 2631
- Issue #18393: The private module _gestalt and private functions
  platform._mac_ver_gestalt, platform._mac_ver_lookup and
  platform._bcd2str have been removed. This does not affect the public
  interface of the platform module.
2632

2633 2634 2635 2636
- Issue #17482: functools.update_wrapper (and functools.wraps) now set the
  __wrapped__ attribute correctly even if the underlying function has a
  __wrapped__ attribute set.

2637 2638 2639
- Issue #18431: The new email header parser now decodes RFC2047 encoded words
  in structured headers.

2640 2641 2642
- Issue #18432: The sched module's queue method was incorrectly returning
  an iterator instead of a list.

2643 2644 2645 2646
- Issue #18044: The new email header parser was mis-parsing encoded words where
  an encoded character immediately followed the '?' that follows the CTE
  character, resulting in a decoding failure.  They are now decoded correctly.

2647 2648 2649
- Issue #18101: Tcl.split() now process strings nested in a tuple as it
  do with byte strings.

2650
- Issue #18116: getpass was always getting an error when testing /dev/tty,
2651 2652 2653
  and thus was always falling back to stdin, and would then raise an exception
  if stdin could not be used (such as /dev/null).  It also leaked an open file.
  All of these issues are now fixed.
2654

2655 2656 2657
- Issue #17198: Fix a NameError in the dbm module.  Patch by Valentina
  Mukhamedzhanova.

2658 2659
- Issue #18013: Fix cgi.FieldStorage to parse the W3C sample form.

2660 2661 2662
- Issue #18020: improve html.escape speed by an order of magnitude.
  Patch by Matt Bryant.

2663 2664 2665
- Issue #18347: ElementTree's html serializer now preserves the case of
  closing tags.

2666 2667
- Issue #17261: Ensure multiprocessing's proxies use proper address.

2668 2669 2670 2671
- Issue #18343: faulthandler.register() now keeps the previous signal handler
  when the function is called twice, so faulthandler.unregister() restores
  correctly the original signal handler.

2672 2673
- Issue #17097: Make multiprocessing ignore EINTR.

2674 2675 2676
- Issue #18339: Negative ints keys in unpickler.memo dict no longer cause a
  segfault inside the _pickle C extension.

2677
- Issue #18240: The HMAC module is no longer restricted to bytes and accepts
2678 2679
  any bytes-like object, e.g. memoryview. Original patch by Jonas Borgström.

2680 2681
- Issue #18224: Removed pydoc script from created venv, as it causes problems
  on Windows and adds no value over and above python -m pydoc ...
2682

2683 2684 2685
- Issue #18155: The csv module now correctly handles csv files that use
  a delimter character that has a special meaning in regexes, instead of
  throwing an exception.
2686

R David Murray's avatar
R David Murray committed
2687 2688
- Issue #14360: encode_quopri can now be successfully used as an encoder
  when constructing a MIMEApplication object.
2689

2690 2691 2692
- Issue #11390: Add -o and -f command line options to the doctest CLI to
  specify doctest options (and convert it to using argparse).

2693 2694 2695 2696
- Issue #18135: ssl.SSLSocket.write() now raises an OverflowError if the input
  string in longer than 2 gigabytes, and ssl.SSLContext.load_cert_chain()
  raises a ValueError if the password is longer than 2 gigabytes. The ssl
  module does not support partial write.
2697

2698 2699
- Issue #11016: Add C implementation of the stat module as _stat.

Benjamin Peterson's avatar
Benjamin Peterson committed
2700
- Issue #18248: Fix libffi build on AIX.
2701

2702
- Issue #18259: Declare sethostname in socketmodule.c for AIX
2703

2704 2705 2706 2707
- Issue #18147: Add diagnostic functions to ssl.SSLContext(). get_ca_list()
  lists all loaded CA certificates and cert_store_stats() returns amount of
  loaded X.509 certs, X.509 CA certs and CRLs.

2708
- Issue #18167: cgi.FieldStorage no longer fails to handle multipart/form-data
2709
  when \r\n appears at end of 65535 bytes without other newlines.
2710

2711
- Issue #18076: Introduce importlib.util.decode_source().
2712 2713
- Issue #18357: add tests for dictview set difference.
  Patch by Fraser Tweedale.
2714

2715 2716 2717
- importlib.abc.SourceLoader.get_source() no longer changes SyntaxError or
  UnicodeDecodeError into ImportError.

2718 2719 2720 2721
- Issue #18058, 18057: Make the namespace package loader meet the
  importlib.abc.InspectLoader ABC, allowing for namespace packages to work with
  runpy.

2722 2723
- Issue #17177: The imp module is pending deprecation.

2724 2725 2726
- subprocess: Prevent a possible double close of parent pipe fds when the
  subprocess exec runs into an error.  Prevent a regular multi-close of the
  /dev/null fd when any of stdin, stdout and stderr was set to DEVNULL.
2727

2728 2729 2730 2731
- Issue #18194: Introduce importlib.util.cache_from_source() and
  source_from_cache() while documenting the equivalent functions in imp as
  deprecated.

2732 2733 2734
- Issue #17907: Document imp.new_module() as deprecated in favour of
  types.ModuleType.

2735 2736 2737
- Issue #18192: Introduce importlib.util.MAGIC_NUMBER and document as deprecated
  imp.get_magic().

2738 2739 2740
- Issue #18149: Add filecmp.clear_cache() to manually clear the filecmp cache.
  Patch by Mark Levitt

2741 2742
- Issue #18193: Add importlib.reload().

2743 2744
- Issue #18157: Stop using imp.load_module() in pydoc.

2745
- Issue #16102: Make uuid._netbios_getnode() work again on Python 3.
2746

2747 2748
- Issue #17134: Add ssl.enum_cert_store() as interface to Windows' cert store.

2749 2750 2751
- Issue #18143: Implement ssl.get_default_verify_paths() in order to debug
  the default locations for cafile and capath.

2752 2753
- Issue #17314: Move multiprocessing.forking over to importlib.

2754 2755 2756
- Issue #11959: SMTPServer and SMTPChannel now take an optional map, use of
  which avoids affecting global state.

2757 2758 2759
- Issue #18109: os.uname() now decodes fields from the locale encoding, and
  socket.gethostname() now decodes the hostname from the locale encoding,
  instead of using the UTF-8 encoding in strict mode.
2760

Brett Cannon's avatar
Brett Cannon committed
2761 2762 2763 2764 2765 2766
- Issue #18089: Implement importlib.abc.InspectLoader.load_module.

- Issue #18088: Introduce importlib.abc.Loader.init_module_attrs for setting
  module attributes. Leads to the pending deprecation of
  importlib.util.module_for_loader.

Senthil Kumaran's avatar
Senthil Kumaran committed
2767 2768 2769
- Issue #17403: urllib.parse.robotparser normalizes the urls before adding to
  ruleline. This helps in handling certain types invalid urls in a conservative
  manner. Patch contributed by Mher Movsisyan.
2770

2771 2772 2773
- Issue #18070: Have importlib.util.module_for_loader() set attributes
  unconditionally in order to properly support reloading.

Brett Cannon's avatar
Brett Cannon committed
2774
- Added importlib.util.module_to_load to return a context manager to provide the
2775
  proper module object to load.
2776

2777 2778
- Issue #18025: Fixed a segfault in io.BufferedIOBase.readinto() when raw
  stream's read() returns more bytes than requested.
2779

2780 2781 2782
- Issue #18011: As was originally intended, base64.b32decode() now raises a
  binascii.Error if there are non-b32-alphabet characters present in the input
  string, instead of a TypeError.
2783

Brett Cannon's avatar
Brett Cannon committed
2784 2785 2786
- Issue #18072: Implement importlib.abc.InspectLoader.get_code() and
  importlib.abc.ExecutionLoader.get_code().

2787 2788 2789
- Issue #8240: Set the SSL_MODE_ACCEPT_MOVING_WRITE_BUFFER flag on SSL
  sockets.

2790 2791 2792
- Issue #17269: Workaround for socket.getaddrinfo crash on MacOS X
  with port None or "0" and flags AI_NUMERICSERV.

2793 2794
- Issue #16986: ElementTree now correctly works with string input when the
  internal XML encoding is not UTF-8 or US-ASCII.
2795

2796 2797
- Issue #17996: socket module now exposes AF_LINK constant on BSD and OSX.

2798 2799 2800
- Issue #17900: Allowed pickling of recursive OrderedDicts.  Decreased pickled
  size and pickling time.

2801 2802 2803
- Issue #17914: Add os.cpu_count(). Patch by Yogesh Chaudhari, based on an
  initial patch by Trent Nelson.

2804 2805 2806
- Issue #17812: Fixed quadratic complexity of base64.b32encode().
  Optimize base64.b32encode() and base64.b32decode() (speed up to 3x).

2807 2808 2809
- Issue #17980: Fix possible abuse of ssl.match_hostname() for denial of
  service using certificates with many wildcards (CVE-2013-2099).

2810 2811
- Issue #15758: Fix FileIO.readall() so it no longer has O(n**2) complexity.

2812 2813
- Issue #14596: The struct.Struct() objects now use a more compact
  implementation.
2814

2815 2816
- Issue #17981: logging's SysLogHandler now closes the socket when it catches
  socket OSErrors.
2817

2818 2819 2820
- Issue #17964: Fix os.sysconf(): the return type of the C sysconf() function
  is long, not int.

2821 2822
- Fix typos in the multiprocessing module.

2823 2824
- Issue #17754: Make ctypes.util.find_library() independent of the locale.

2825 2826
- Issue #17968: Fix memory leak in os.listxattr().

2827
- Issue #17606: Fixed support of encoded byte strings in the XMLGenerator
2828
  characters() and ignorableWhitespace() methods.  Original patch by Sebastian
2829 2830
  Ortiz Vasquez.

2831 2832 2833
- Issue #17732: Ignore distutils.cfg options pertaining to install paths if a
  virtual environment is active.

Georg Brandl's avatar
Georg Brandl committed
2834 2835 2836
- Issue #17915: Fix interoperability of xml.sax with file objects returned by
  codecs.open().

2837 2838
- Issue #16601: Restarting iteration over tarfile really restarts rather
  than continuing from where it left off.  Patch by Michael Birtwell.
2839

2840 2841 2842 2843
- Issue #17289: The readline module now plays nicer with external modules
  or applications changing the rl_completer_word_break_characters global
  variable.  Initial patch by Bradley Froehle.

2844 2845 2846
- Issue #12181: select module: Fix struct kevent definition on OpenBSD 64-bit
  platforms. Patch by Federico Schwindt.

2847 2848 2849 2850
- Issue #11816: multiple improvements to the dis module: get_instructions
  generator, ability to redirect output to a file, Bytecode and Instruction
  abstractions. Patch by Nick Coghlan, Ryan Kelly and Thomas Kluyver.

2851
- Issue #13831: Embed stringification of remote traceback in local
2852 2853
  traceback raised when pool task raises an exception.

2854 2855 2856
- Issue #15528: Add weakref.finalize to support finalization using
  weakref callbacks.

2857 2858 2859
- Issue #14173: Avoid crashing when reading a signal handler during
  interpreter shutdown.

2860 2861
- Issue #15902: Fix imp.load_module() accepting None as a file when loading an
  extension module.
2862

2863 2864 2865 2866
- Issue #13721: SSLSocket.getpeercert() and SSLSocket.do_handshake() now
  raise an OSError with ENOTCONN, instead of an AttributeError, when the
  SSLSocket is not connected.

2867 2868
- Issue #14679: add an __all__ (that contains only HTMLParser) to html.parser.

2869 2870 2871
- Issue #17802: Fix an UnboundLocalError in html.parser.  Initial tests by
  Thomas Barlow.

2872 2873 2874
- Issue #17358: Modules loaded by imp.load_source() and load_compiled() (and by
  extention load_module()) now have a better chance of working when reloaded.

2875 2876 2877
- Issue #17804: New function ``struct.iter_unpack`` allows for streaming
  struct unpacking.

2878 2879 2880
- Issue #17830: When keyword.py is used to update a keyword file, it now
  preserves the line endings of the original file.

2881 2882 2883
- Issue #17272: Making the urllib.request's Request.full_url a descriptor.
  Fixes bugs with assignment to full_url. Patch by Demian Brecht.

2884 2885
- Issue #17353: Plistlib emitted empty data tags with deeply nested datastructures

2886 2887 2888
- Issue #11714: Use 'with' statements to assure a Semaphore releases a
  condition variable.  Original patch by Thomas Rachel.

2889 2890 2891 2892
- Issue #16624: `subprocess.check_output` now accepts an `input` argument,
  allowing the subprocess's stdin to be provided as a (byte) string.
  Patch by Zack Weinberg.

2893 2894 2895
- Issue #17795: Reverted backwards-incompatible change in SysLogHandler with
  Unix domain sockets.

2896 2897 2898
- Issue #16694: Add a pure Python implementation of the operator module.
  Patch by Zachary Ware.

2899 2900 2901
- Issue #11182: remove the unused and undocumented pydoc.Scanner class.
  Patch by Martin Morrison.

2902 2903
- Issue #17741: Add ElementTree.XMLPullParser, an event-driven parser for
  non-blocking applications.
2904

2905 2906 2907
- Issue #17555: Fix ForkAwareThreadLock so that size of after fork
  registry does not grow exponentially with generation of process.

2908 2909
- Issue #17707: fix regression in multiprocessing.Queue's get() method where
  it did not block for short timeouts.
2910

2911
- Issue #17720: Fix the Python implementation of pickle.Unpickler to correctly
2912 2913
  process the APPENDS opcode when it is used on non-list objects.

2914 2915
- Issue #17012: shutil.which() no longer falls back to the PATH environment
  variable if an empty path argument is specified.  Patch by Serhiy Storchaka.
2916

2917 2918
- Issue #17710: Fix pickle raising a SystemError on bogus input.

2919 2920 2921
- Issue #17341: Include the invalid name in the error messages from re about
  invalid group names.

2922 2923 2924 2925
- Issue #17702: os.environ now raises KeyError with the original environment
  variable name (str on UNIX), instead of using the encoded name (bytes on
  UNIX).

2926 2927 2928
- Issue #16163: Make the importlib based version of pkgutil.iter_importers
  work for submodules. Initial patch by Berker Peksag.

2929 2930 2931
- Issue #16804: Fix a bug in the 'site' module that caused running
  'python -S -m site' to incorrectly throw an exception.

2932 2933 2934
- Issue #15480: Remove the deprecated and unused TYPE_INT64 code from marshal.
  Initial patch by Daniel Riti.

2935
- Issue #2118: SMTPException is now a subclass of OSError.
2936

2937 2938 2939
- Issue #17016: Get rid of possible pointer wraparounds and integer overflows
  in the re module.  Patch by Nickolai Zeldovich.

2940 2941 2942
- Issue #16658: add missing return to HTTPConnection.send()
  Patch by Jeff Knupp.

2943 2944
- Issue #9556: the logging package now allows specifying a time-of-day for a
  TimedRotatingFileHandler to rotate.
2945

2946 2947 2948
- Issue #14971: unittest test discovery no longer gets confused when a function
  has a different __name__ than its name in the TestCase class dictionary.

2949 2950 2951
- Issue #17487: The wave getparams method now returns a namedtuple rather than
  a plain tuple.

2952 2953
- Issue #17675: socket repr() provides local and remote addresses (if any).
  Patch by Giampaolo Rodola'
2954

2955 2956 2957
- Issue #17093: Make the ABCs in importlib.abc provide default values or raise
  reasonable exceptions for their methods to make them more amenable to super()
  calls.
2958

2959
- Issue #17566: Make importlib.abc.Loader.module_repr() optional instead of an
2960
  abstractmethod; now it raises NotImplementedError so as to be ignored by default.
2961

2962 2963
- Issue #17678: Remove the use of deprecated method in http/cookiejar.py by
  changing the call to get_origin_req_host() to origin_req_host.
Benjamin Peterson's avatar
Benjamin Peterson committed
2964

2965
- Issue #17666: Fix reading gzip files with an extra field.
2966

2967 2968
- Issue #16475: Support object instancing, recursion and interned strings
  in marshal
2969

2970
- Issue #17502: Process DEFAULT values in mock side_effect that returns iterator.
2971

2972 2973 2974
- Issue #16795: On the ast.arguments object, unify vararg with varargannotation
  and kwarg and kwargannotation. Change the column offset of ast.Attribute to be
  at the attribute name.
2975

2976 2977
- Issue #17434: Properly raise a SyntaxError when a string occurs between future
  imports.
2978

2979 2980
- Issue #17117: Import and @importlib.util.set_loader now set __loader__ when
  it has a value of None or the attribute doesn't exist.
2981

2982 2983
- Issue #17032: The "global" in the "NameError: global name 'x' is not defined"
  error message has been removed.  Patch by Ram Rachum.
2984

2985 2986 2987 2988
- Issue #18080: When building a C extension module on OS X, if the compiler
  is overriden with the CC environment variable, use the new compiler as
  the default for linking if LDSHARED is not also overriden.  This restores
  Distutils behavior introduced in 3.2.3 and inadvertently dropped in 3.3.0.
2989

2990 2991
- Issue #18113: Fixed a refcount leak in the curses.panel module's
  set_userptr() method.  Reported by Atsuo Ishimoto.
2992

2993
- Implement PEP 443 "Single-dispatch generic functions".
2994

2995
- Implement PEP 435 "Adding an Enum type to the Python standard library".
2996

2997 2998
- Issue #15596: Faster pickling of unicode strings.

2999
- Issue #17572: Avoid chained exceptions when passing bad directives to
Ezio Melotti's avatar
Ezio Melotti committed
3000 3001
  time.strptime().  Initial patch by Claudiu Popa.

3002 3003 3004
- Issue #17435: threading.Timer's __init__ method no longer uses mutable
  default values for the args and kwargs parameters.

Ezio Melotti's avatar
Ezio Melotti committed
3005 3006 3007
- Issue #17526: fix an IndexError raised while passing code without filename to
  inspect.findsource().  Initial patch by Tyler Doyle.

3008
- Issue #17540: Added style parameter to logging formatter configuration by dict.
3009

3010 3011 3012
- Issue #16692: The ssl module now supports TLS 1.1 and TLS 1.2.  Initial
  patch by Michele Orrù.

3013 3014
- Issue #17025: multiprocessing: Reduce Queue and SimpleQueue contention.

3015 3016 3017
- Issue #17536: Add to webbrowser's browser list: www-browser, x-www-browser,
  iceweasel, iceape.

3018 3019 3020
- Issue #17150: pprint now uses line continuations to wrap long string
  literals.

3021 3022 3023 3024 3025
- Issue #17488: Change the subprocess.Popen bufsize parameter default value
  from unbuffered (0) to buffering (-1) to match the behavior existing code
  expects and match the behavior of the subprocess module in Python 2 to avoid
  introducing hard to track down bugs.

3026 3027 3028
- Issue #17521: Corrected non-enabling of logger following two calls to
  fileConfig().

3029 3030
- Issue #17508: Corrected logging MemoryHandler configuration in dictConfig()
  where the target handler wasn't configured first.
Vinay Sajip's avatar
Vinay Sajip committed
3031

3032
- Issue #17209: curses.window.get_wch() now correctly handles KeyboardInterrupt
3033 3034
  (CTRL+c).

3035 3036 3037 3038
- Issue #5713: smtplib now handles 421 (closing connection) error codes when
  sending mail by closing the socket and reporting the 421 error code via the
  exception appropriate to the command that received the error response.

3039 3040 3041
- Issue #16997: unittest.TestCase now provides a subTest() context manager
  to procedurally generate, in an easy way, small test instances.

3042 3043 3044
- Issue #17485: Also delete the Request Content-Length header if the data
  attribute is deleted.  (Follow on to issue 16464).

3045 3046 3047
- Issue #15927: CVS now correctly parses escaped newlines and carriage
  when parsing with quoting turned off.

3048 3049 3050
- Issue #17467: add readline and readlines support to mock_open in
  unittest.mock.

3051 3052 3053 3054
- Issue #17192: Update the ctypes module's libffi to v3.0.13.  This
  specifically addresses a stack misalignment issue on x86 and issues on
  some more recent platforms.

3055 3056
- Issue #8862: Fixed curses cleanup when getkey is interrputed by a signal.

Gregory P. Smith's avatar
Gregory P. Smith committed
3057
- Issue #17443: imaplib.IMAP4_stream was using the default unbuffered IO
3058 3059 3060
  in subprocess, but the imap code assumes buffered IO.  In Python2 this
  worked by accident.  IMAP4_stream now explicitly uses buffered IO.

3061 3062 3063
- Issue #17476: Fixed regression relative to Python2 in undocumented pydoc
  'allmethods'; it was missing unbound methods on the class.

3064 3065
- Issue #17474: Remove the deprecated methods of Request class.

3066 3067 3068
- Issue #16709: unittest discover order is no-longer filesystem specific. Patch
  by Jeff Ramnani.

3069 3070
- Use the HTTPS PyPI url for upload, overriding any plain HTTP URL in pypirc.

3071 3072 3073
- Issue #5024: sndhdr.whichhdr now returns the frame count for WAV files
  rather than -1.

3074 3075 3076 3077
- Issue #17460: Remove the strict argument of HTTPConnection and removing the
  DeprecationWarning being issued from 3.2 onwards.

- Issue #16880: Do not assume _imp.load_dynamic() is defined in the imp module.
3078

3079
- Issue #16389: Fixed a performance regression relative to Python 3.1 in the
3080 3081
  caching of compiled regular expressions.

3082 3083
- Added missing FeedParser and BytesFeedParser to email.parser.__all__.

3084 3085
- Issue #17431: Fix missing import of BytesFeedParser in email.parser.

3086 3087 3088
- Issue #12921: http.server's send_error takes an explain argument to send more
  information in response. Patch contributed by Karl.

3089 3090
- Issue #17414: Add timeit, repeat, and default_timer to timeit.__all__.

3091 3092 3093
- Issue #1285086: Get rid of the refcounting hack and speed up
  urllib.parse.unquote() and urllib.parse.unquote_to_bytes().

3094 3095 3096
- Issue #17099: Have importlib.find_loader() raise ValueError when __loader__
  is not set, harmonizing with what happens when the attribute is set to None.

Benjamin Peterson's avatar
Benjamin Peterson committed
3097 3098
- Expose the O_PATH constant in the os module if it is available.

3099 3100 3101 3102
- Issue #17368: Fix an off-by-one error in the Python JSON decoder that caused
  a failure while decoding empty object literals when object_pairs_hook was
  specified.

3103
- Issue #17385: Fix quadratic behavior in threading.Condition.  The FIFO
3104 3105
  queue now uses a deque instead of a list.

3106 3107
- Issue #15806: Add contextlib.ignore().  This creates a context manager to
  ignore specified exceptions, replacing the "except SomeException: pass" idiom.
3108

3109 3110 3111 3112 3113
- Issue #14645: The email generator classes now produce output using the
  specified linesep throughout.  Previously if the prolog, epilog, or
  body were stored with a different linesep, that linesep was used.  This
  fix corrects an RFC non-compliance issue with smtplib.send_message.

3114 3115 3116
- Issue #17278: Fix a crash in heapq.heappush() and heapq.heappop() when
  the list is being resized concurrently.

3117 3118 3119
- Issue #16962: Use getdents64 instead of the obsolete getdents syscall
  in the subprocess module on Linux.

3120 3121 3122
- Issue #16935: unittest now counts the module as skipped if it raises SkipTest,
  instead of counting it as an error.  Patch by Zachary Ware.

3123 3124
- Issue #17018: Make Process.join() retry if os.waitpid() fails with EINTR.

3125 3126 3127 3128
- Issue #17223: array module: Fix a crasher when converting an array containing
  invalid characters (outside range [U+0000; U+10ffff]) to Unicode:
  repr(array), str(array) and array.tounicode(). Patch written by Manuel Jacob.

3129 3130 3131
- Issue #17197: profile/cProfile modules refactored so that code of run() and
  runctx() utility functions is not duplicated in both modules.

3132 3133 3134
- Issue #14720: sqlite3: Convert datetime microseconds correctly.
  Patch by Lowe Thiderman.

3135 3136 3137
- Issue #15132: Allow a list for the defaultTest argument of
  unittest.TestProgram. Patch by Jyrki Pulliainen.

3138 3139 3140
- Issue #17225: JSON decoder now counts columns in the first line starting
  with 1, as in other lines.

3141 3142 3143
- Issue #6623: Added explicit DeprecationWarning for ftplib.netrc, which has
  been deprecated and undocumented for a long time.

3144 3145 3146
- Issue #13700: Fix byte/string handling in imaplib authentication when an
  authobject is specified.

3147 3148 3149
- Issue #13153: Tkinter functions now raise TclError instead of ValueError when
  a string argument contains non-BMP character.

3150 3151 3152
- Issue #9669: Protect re against infinite loops on zero-width matching in
  non-greedy repeat.  Patch by Matthew Barnett.

3153 3154 3155 3156
- Issue #13169: The maximal repetition number in a regular expression has been
  increased from 65534 to 2147483647 (on 32-bit platform) or 4294967294 (on
  64-bit).

3157 3158 3159
- Issue #17143: Fix a missing import in the trace module.  Initial patch by
  Berker Peksag.

3160 3161 3162
- Issue #15220: email.feedparser's line splitting algorithm is now simpler and
  faster.

3163 3164
- Issue #16743: Fix mmap overflow check on 32 bit Windows.

3165 3166 3167
- Issue #16996: webbrowser module now uses shutil.which() to find a
  web-browser on the executable search path.

3168 3169 3170
- Issue #16800: tempfile.gettempdir() no longer left temporary files when
  the disk is full.  Original patch by Amir Szekely.

3171 3172
- Issue #17192: Import libffi-3.0.12.

3173 3174 3175
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_7or8bit when used with binary data.

Michael Foord's avatar
Michael Foord committed
3176
- Issue #17052: unittest discovery should use self.testLoader.
3177

3178 3179
- Issue #4591: Uid and gid values larger than 2**31 are supported now.

3180
- Issue #17141: random.vonmisesvariate() no longer hangs for large kappas.
3181

3182 3183 3184
- Issue #17149: Fix random.vonmisesvariate to always return results in
  [0, 2*math.pi].

3185 3186
- Issue #1470548: XMLGenerator now works with binary output streams.

3187 3188 3189
- Issue #6975: os.path.realpath() now correctly resolves multiple nested
  symlinks on POSIX platforms.

3190 3191 3192
- Issue #13773: sqlite3.connect() gets a new `uri` parameter to pass the
  filename as a URI, allowing to pass custom options.

3193 3194 3195
- Issue #16564: Fixed regression relative to Python2 in the operation of
  email.encoders.encode_noop when used with binary data.

3196 3197 3198 3199
- Issue #10355: The mode, name, encoding and newlines properties now work on
  SpooledTemporaryFile objects even when they have not yet rolled over.
  Obsolete method xreadline (which has never worked in Python 3) has been
  removed.
3200

3201 3202 3203 3204 3205 3206
- Issue #16686: Fixed a lot of bugs in audioop module.  Fixed crashes in
  avgpp(), maxpp() and ratecv().  Fixed an integer overflow in add(), bias(),
  and ratecv().  reverse(), lin2lin() and ratecv() no more lose precision for
  32-bit samples.  max() and rms() no more returns a negative result and
  various other functions now work correctly with 32-bit sample -0x80000000.

3207 3208
- Issue #17073: Fix some integer overflows in sqlite3 module.

3209 3210
- Issue #16723: httplib.HTTPResponse no longer marked closed when the connection
  is automatically closed.
3211

3212 3213 3214
- Issue #15359: Add CAN_BCM protocol support to the socket module. Patch by
  Brian Thorne.

3215 3216 3217
- Issue #16948: Fix quoted printable body encoding for non-latin1 character
  sets in the email package.

3218 3219 3220
- Issue #16811: Fix folding of headers with no value in the provisional email
  policies.

3221 3222
- Issue #17132: Update symbol for "yield from" grammar changes.

3223
- Issue #17076: Make copying of xattrs more tolerant of missing FS support.
3224 3225
  Patch by Thomas Wouters.

3226 3227 3228
- Issue #17089: Expat parser now correctly works with string input when the
  internal XML encoding is not UTF-8 or US-ASCII.  It also now accepts bytes
  and strings larger than 2 GiB.
3229

3230 3231 3232
- Issue #6083: Fix multiple segmentation faults occured when PyArg_ParseTuple
  parses nested mutating sequence.

3233 3234
- Issue #5289: Fix ctypes.util.find_library on Solaris.

3235 3236 3237 3238
- Issue #17106: Fix a segmentation fault in io.TextIOWrapper when an underlying
  stream or a decoder produces data of an unexpected type (i.e. when
  io.TextIOWrapper initialized with text stream or use bytes-to-bytes codec).

3239 3240 3241 3242
- Issue #17015: When it has a spec, a Mock object now inspects its signature
  when matching calls, so that arguments can be matched positionally or
  by name.

3243 3244 3245
- Issue #15633: httplib.HTTPResponse is now mark closed when the server
  sends less than the advertised Content-Length.

3246 3247 3248
- Issue #12268: The io module file object write methods no longer abort early
  when one of its write system calls is interrupted (EINTR).

3249 3250 3251
- Issue #6972: The zipfile module no longer overwrites files outside of
  its destination path when extracting malicious zip files.

3252 3253 3254 3255
- Issue #4844: ZipFile now raises BadZipFile when opens a ZIP file with an
  incomplete "End of Central Directory" record.  Original patch by Guilherme
  Polo and Alan McIntyre.

3256 3257 3258
- Issue #17071: Signature.bind() now works when one of the keyword arguments
  is named ``self``.

3259 3260 3261
- Issue #12004: Fix an internal error in PyZipFile when writing an invalid
  Python file.  Patch by Ben Morgan.

3262
- Have py_compile use importlib as much as possible to avoid code duplication.
3263 3264 3265
  Code now raises FileExistsError if the file path to be used for the
  byte-compiled file is a symlink or non-regular file as a warning that import
  will not keep the file path type if it writes to that path.
3266

3267
- Issue #16972: Have site.addpackage() consider already known paths even when
3268 3269
  none are explicitly passed in. Bug report and fix by Kirill.

3270 3271 3272
- Issue #1602133: on Mac OS X a shared library build (``--enable-shared``)
  now fills the ``os.environ`` variable correctly.

3273 3274 3275
- Issue #15505: `unittest.installHandler` no longer assumes SIGINT handler is
  set to a callable object.

3276 3277 3278
- Issue #13454: Fix a crash when deleting an iterator created by itertools.tee()
  if all other iterators were very advanced before.

3279 3280 3281
- Issue #12411: Fix to cgi.parse_multipart to correctly use bytes boundaries
  and bytes data. Patch by Jonas Wagner.

3282 3283 3284 3285
- Issue #16957: shutil.which() no longer searches a bare file name in the
  current directory on Unix and no longer searches a relative file path with
  a directory part in PATH directories.  Patch by Thomas Kluyver.

3286 3287 3288
- Issue #1159051: GzipFile now raises EOFError when reading a corrupted file
  with truncated header or footer.

3289 3290 3291
- Issue #16993: shutil.which() now preserves the case of the path and extension
  on Windows.

3292 3293 3294
- Issue #16992: On Windows in signal.set_wakeup_fd, validate the file
  descriptor argument.

3295 3296
- Issue #16422: For compatibility with the Python version, the C version of
  decimal now uses strings instead of integers for rounding mode constants.
3297

3298 3299 3300
- Issue #15861: tkinter now correctly works with lists and tuples containing
  strings with whitespaces, backslashes or unbalanced braces.

3301 3302 3303
- Issue #9720: zipfile now writes correct local headers for files larger than
  4 GiB.

3304 3305 3306
- Issue #16955: Fix the poll() method for multiprocessing's socket
  connections on Windows.

3307 3308
- SSLContext.load_dh_params() now properly closes the input file.

3309 3310 3311 3312
- Issue #15031: Refactor some .pyc management code to cut down on code
  duplication. Thanks to Ronan Lamy for the report and taking an initial stab
  at the problem.

3313 3314 3315
- Issue #16398: Optimize deque.rotate() so that it only moves pointers
  and doesn't touch the underlying data with increfs and decrefs.

3316 3317
- Issue #16900: Issue a ResourceWarning when an ssl socket is left unclosed.

3318 3319 3320
- Issue #13899: \A, \Z, and \B now correctly match the A, Z, and B literals
  when used inside character classes (e.g. '[\A]').  Patch by Matthew Barnett.

3321 3322 3323 3324
- Issue #15545: Fix regression in sqlite3's iterdump method where it was
  failing if the connection used a row factory (such as sqlite3.Row) that
  produced unsortable objects. (Regression was introduced by fix for 9750).

3325 3326
- fcntl: add F_DUPFD_CLOEXEC constant, available on Linux 2.6.24+.

3327 3328 3329
- Issue #15972: Fix error messages when os functions expecting a file name or
  file descriptor receive the incorrect type.

3330 3331 3332 3333
- Issue #8109: The ssl module now has support for server-side SNI, thanks
  to a :meth:`SSLContext.set_servername_callback` method.  Patch by Daniel
  Black.

3334 3335 3336
- Issue #16860: In tempfile, use O_CLOEXEC when available to set the
  close-on-exec flag atomically.

3337 3338
- Issue #16674: random.getrandbits() is now 20-40% faster for small integers.

3339 3340
- Issue #16009: JSON error messages now provide more information.

3341 3342
- Issue #16828: Fix error incorrectly raised by bz2.compress(b'') and
  bz2.BZ2Compressor.compress(b''). Initial patch by Martin Packman.
3343

3344 3345 3346 3347
- Issue #16833: In http.client.HTTPConnection, do not concatenate the request
  headers and body when the payload exceeds 16 KB, since it can consume more
  memory for no benefit.  Patch by Benno Leslie.

3348 3349
- Issue #16541: tk_setPalette() now works with keyword arguments.

3350 3351 3352 3353 3354 3355 3356 3357 3358 3359 3360
- Issue #16820: In configparser, `parser.popitem()` no longer raises ValueError.
  This makes `parser.clean()` work correctly.

- Issue #16820: In configparser, ``parser['section'] = {}`` now preserves
  section order within the parser. This makes `parser.update()` preserve section
  order as well.

- Issue #16820: In configparser, ``parser['DEFAULT'] = {}`` now correctly
  clears previous values stored in the default section. Same goes for
  ``parser.update({'DEFAULT': {}})``.

3361 3362
- Issue #9586: Redefine SEM_FAILED on MacOSX to keep compiler happy.

3363 3364 3365 3366
- Issue #16787: Increase asyncore and asynchat default output buffers size, to
  decrease CPU usage and increase throughput.

- Issue #10527: make multiprocessing use poll() instead of select() if available.
3367

3368 3369
- Issue #16688: Now regexes contained backreferences correctly work with
  non-ASCII strings.  Patch by Matthew Barnett.
3370

3371
- Issue #16486: Make aifc files act as context managers.
3372

3373 3374
- Issue #16485: Now file descriptors are closed if file header patching failed
  on closing an aifc file.
3375

3376 3377
- Issue #16640: Run less code under a lock in sched module.

3378 3379
- Issue #16165: sched.scheduler.run() no longer blocks a scheduler for other
  threads.
3380

3381
- Issue #16641: Default values of sched.scheduler.enter() are no longer
3382 3383
  modifiable.

3384 3385 3386
- Issue #16618: Make glob.glob match consistently across strings and bytes
  regarding leading dots.  Patch by Serhiy Storchaka.

3387 3388
- Issue #16788: Add samestat to Lib/ntpath.py

3389 3390 3391
- Issue #16713: Parsing of 'tel' urls using urlparse separates params from
  path.

3392 3393 3394
- Issue #16443: Add docstrings to regular expression match objects.
  Patch by Anton Kasyanov.

3395 3396
- Issue #15701: Fix HTTPError info method call to return the headers information.

3397 3398
- Issue #16752: Add a missing import to modulefinder. Patch by Berker Peksag.

3399 3400 3401
- Issue #16646: ftplib.FTP.makeport() might lose socket error details.
  (patch by Serhiy Storchaka)

3402 3403 3404 3405
- Issue #16626: Fix infinite recursion in glob.glob() on Windows when the
  pattern contains a wildcard in the drive or UNC path.  Patch by Serhiy
  Storchaka.

3406 3407 3408 3409
- Issue #15783: Except for the number methods, the C version of decimal now
  supports all None default values present in decimal.py. These values were
  largely undocumented.

3410 3411 3412
- Issue #11175: argparse.FileType now accepts encoding and errors
  arguments. Patch by Lucas Maystre.

3413 3414 3415
- Issue #16488: epoll() objects now support the `with` statement.  Patch
  by Serhiy Storchaka.

3416 3417 3418 3419
- Issue #16298: In HTTPResponse.read(), close the socket when there is no
  Content-Length and the incoming stream is finished.  Patch by Eran
  Rundstein.

3420 3421 3422
- Issue #16049: Add abc.ABC class to enable the use of inheritance to create
  ABCs, rather than the more cumbersome metaclass=ABCMeta. Patch by Bruno
  Dupuis.
3423

3424 3425 3426
- Expose the TCP_FASTOPEN and MSG_FASTOPEN flags in socket when they're
  available.

3427 3428 3429
- Issue #15701: Add a .headers attribute to urllib.error.HTTPError. Patch
  contributed by Berker Peksag.

3430 3431 3432 3433
- Issue #15872: Fix 3.3 regression introduced by the new fd-based shutil.rmtree
  that caused it to not ignore certain errors when ignore_errors was set.
  Patch by Alessandro Moura and Serhiy Storchaka.

3434 3435 3436
- Issue #16248: Disable code execution from the user's home directory by
  tkinter when the -E flag is passed to Python.  Patch by Zachary Ware.

3437 3438 3439
- Issue #13390: New function :func:`sys.getallocatedblocks()` returns the
  number of memory blocks currently allocated.

3440 3441
- Issue #16628: Fix a memory leak in ctypes.resize().

3442 3443 3444
- Issue #13614: Fix setup.py register failure with invalid rst in description.
  Patch by Julien Courteau and Pierre Paul Lefebvre.

3445 3446 3447
- Issue #13512: Create ~/.pypirc securely (CVE-2011-4944).  Initial patch by
  Philip Jenvey, tested by Mageia and Debian.

3448 3449 3450
- Issue #7719: Make distutils ignore ``.nfs*`` files instead of choking later
  on.  Initial patch by SilentGhost and Jeff Ramnani.

3451 3452 3453
- Issue #13120: Allow to call pdb.set_trace() from thread.
  Patch by Ilya Sandler.

3454 3455 3456
- Issue #16585: Make CJK encoders support error handlers that return bytes per
  PEP 383.

3457 3458 3459
- Issue #10182: The re module doesn't truncate indices to 32 bits anymore.
  Patch by Serhiy Storchaka.

3460 3461
- Issue #16333: use (",", ": ") as default separator in json when indent is
  specified, to avoid trailing whitespace.  Patch by Serhiy Storchaka.
3462

Benjamin Peterson's avatar
Benjamin Peterson committed
3463 3464 3465 3466
- Issue #16573: In 2to3, treat enumerate() like a consuming call, so superfluous
  list() calls aren't added to filter(), map(), and zip() which are directly
  passed enumerate().

3467 3468 3469 3470
- Issue #12848: The pure Python pickle implementation now treats object
  lengths as unsigned 32-bit integers, like the C implementation does.
  Patch by Serhiy Storchaka.

3471 3472 3473
- Issue #16423: urllib.request now has support for ``data:`` URLs.  Patch by
  Mathias Panzenböck.

3474 3475 3476
- Issue #4473: Add a POP3.stls() to switch a clear-text POP3 session into
  an encrypted POP3 session, on supported servers.  Patch by Lorenzo Catucci.

3477 3478 3479
- Issue #4473: Add a POP3.capa() method to query the capabilities advertised
  by the POP3 server.  Patch by Lorenzo Catucci.

3480 3481 3482
- Issue #4473: Ensure the socket is shutdown cleanly in POP3.close().
  Patch by Lorenzo Catucci.

3483 3484
- Issue #16522: added FAIL_FAST flag to doctest.

3485
- Issue #15627: Add the importlib.abc.InspectLoader.source_to_code() method.
3486

3487 3488 3489
- Issue #16408: Fix file descriptors not being closed in error conditions
  in the zipfile module.  Patch by Serhiy Storchaka.

3490 3491 3492
- Issue #14631: Add a new :class:`weakref.WeakMethod` to simulate weak
  references to bound methods.

3493 3494 3495 3496
- Issue #16469: Fix exceptions from float -> Fraction and Decimal -> Fraction
  conversions for special values to be consistent with those for float -> int
  and Decimal -> int.  Patch by Alexey Kachayev.

3497 3498
- Issue #16481: multiprocessing no longer leaks process handles on Windows.

3499 3500 3501
- Issue #12428: Add a pure Python implementation of functools.partial().
  Patch by Brian Thorne.

3502 3503 3504
- Issue #16140: The subprocess module no longer double closes its child
  subprocess.PIPE parent file descriptors on child error prior to exec().

3505 3506 3507
- Remove a bare print to stdout from the subprocess module that could have
  happened if the child process wrote garbage to its pre-exec error pipe.

3508 3509 3510
- The subprocess module now raises its own SubprocessError instead of a
  RuntimeError in various error situations which should not normally happen.

3511 3512 3513
- Issue #16327: The subprocess module no longer leaks file descriptors
  used for stdin/stdout/stderr pipes to the child when fork() fails.

3514 3515 3516
- Issue #14396: Handle the odd rare case of waitpid returning 0 when not
  expected in subprocess.Popen.wait().

3517 3518 3519
- Issue #16411: Fix a bug where zlib.decompressobj().flush() might try to access
  previously-freed memory. Patch by Serhiy Storchaka.

3520 3521 3522
- Issue #16357: fix calling accept() on a SSLSocket created through
  SSLContext.wrap_socket().  Original patch by Jeff McNeil.

3523 3524 3525 3526 3527
- Issue #16409: The reporthook callback made by the legacy
  urllib.request.urlretrieve API now properly supplies a constant non-zero
  block_size as it did in Python 3.2 and 2.7.  This matches the behavior of
  urllib.request.URLopener.retrieve.

3528 3529 3530
- Issue #16431: Use the type information when constructing a Decimal subtype
  from a Decimal argument.

3531 3532 3533
- Issue #15641: Clean up deprecated classes from importlib
  Patch by Taras Lyapun.

3534
- Issue #16350: zlib.decompressobj().decompress() now accumulates data from
3535
  successive calls after EOF in unused_data, instead of only saving the argument
3536 3537 3538
  to the last call. decompressobj().flush() now correctly sets unused_data and
  unconsumed_tail. A bug in the handling of MemoryError when setting the
  unconsumed_tail attribute has also been fixed. Patch by Serhiy Storchaka.
3539

3540 3541 3542
- Issue #12759: sre_parse now raises a proper error when the name of the group
  is missing.  Initial patch by Serhiy Storchaka.

3543 3544 3545
- Issue #16152: fix tokenize to ignore whitespace at the end of the code when
  no newline is found.  Patch by Ned Batchelder.

3546 3547 3548
- Issue #16284: Prevent keeping unnecessary references to worker functions
  in concurrent.futures ThreadPoolExecutor.

3549 3550 3551
- Issue #16230: Fix a crash in select.select() when one the lists changes
  size while iterated on.  Patch by Serhiy Storchaka.

3552 3553 3554
- Issue #16228: Fix a crash in the json module where a list changes size
  while it is being encoded.  Patch by Serhiy Storchaka.

3555 3556 3557
- Issue #16351: New function gc.get_stats() returns per-generation collection
  statistics.

3558 3559 3560
- Issue #14897: Enhance error messages of struct.pack and
  struct.pack_into. Patch by Matti Mäki.

3561 3562 3563
- Issue #16316: mimetypes now recognizes the .xz and .txz (.tar.xz) extensions.
  Patch by Serhiy Storchaka.

3564 3565 3566
- Issue #12890: cgitb no longer prints spurious <p> tags in text
  mode when the logdir option is specified.

3567 3568 3569
- Issue #16307: Fix multiprocessing.Pool.map_async not calling its callbacks.
  Patch by Janne Karila.

3570 3571 3572
- Issue #16305: Fix a segmentation fault occurring when interrupting
  math.factorial.

3573
- Issue #16116: Fix include and library paths to be correct when building C
3574 3575
  extensions in venvs.

3576 3577
- Issue #16245: Fix the value of a few entities in html.entities.html5.

3578 3579 3580
- Issue #16301: Fix the localhost verification in urllib/request.py for file://
  urls.

3581 3582 3583
- Issue #16250: Fix the invocations of URLError which had misplaced filename
  attribute for exception.

3584 3585 3586
- Issue #10836: Fix exception raised when file not found in urlretrieve
  Initial patch by Ezio Melotti.

3587 3588
- Issue #14398: Fix size truncation and overflow bugs in the bz2 module.

3589
- Issue #12692: Fix resource leak in urllib.request when talking to an HTTP
3590
  server that does not include a ``Connection: close`` header in its responses.
3591

3592 3593 3594
- Issue #12034: Fix bogus caching of result in check_GetFinalPathNameByHandle.
  Patch by Atsuo Ishimoto.

3595
- Improve performance of `lzma.LZMAFile` (see also issue #16034).
3596

3597 3598 3599
- Issue #16220: wsgiref now always calls close() on an iterable response.
  Patch by Brent Tubbs.

3600 3601 3602
- Issue #16270: urllib may hang when used for retrieving files via FTP by using
  a context manager.  Patch by Giampaolo Rodola'.

3603 3604 3605
- Issue #16461: Wave library should be able to deal with 4GB wav files,
  and sample rate of 44100 Hz.

3606 3607
- Issue #16176: Properly identify Windows 8 via platform.platform()

3608 3609 3610
- Issue #16088: BaseHTTPRequestHandler's send_error method includes a
  Content-Length header in it's response now. Patch by Antoine Pitrou.

3611 3612 3613
- Issue #16114: The subprocess module no longer provides a misleading error
  message stating that args[0] did not exist when either the cwd or executable
  keyword arguments specified a path that did not exist.
3614

3615 3616
- Issue #16169: Fix ctypes.WinError()'s confusion between errno and winerror.

3617 3618 3619
- Issue #1492704: shutil.copyfile() raises a distinct SameFileError now if
  source and destination are the same file. Patch by Atsuo Ishimoto.

3620 3621 3622
- Issue #13896: Make shelf instances work with 'with' as context managers.
  Original patch by Filip Gruszczyński.

3623 3624
- Issue #15417: Add support for csh and fish in venv activation scripts.

3625 3626 3627 3628
- Issue #14377: ElementTree.write and some of the module-level functions have
  a new parameter - *short_empty_elements*. It controls how elements with no
  contents are emitted.

3629 3630 3631
- Issue #16089: Allow ElementTree.TreeBuilder to work again with a non-Element
  element_factory (fixes a regression in SimpleTAL).

3632 3633 3634
- Issue #9650: List commonly used format codes in time.strftime and
  time.strptime docsttings.  Original patch by Mike Hoy.

Georg Brandl's avatar
Georg Brandl committed
3635 3636
- Issue #16034: Fix performance regressions in the new `bz2.BZ2File`
  implementation.  Initial patch by Serhiy Storchaka.
3637

Georg Brandl's avatar
Georg Brandl committed
3638
- `pty.spawn()` now returns the child process status returned by `os.waitpid()`.
3639

Georg Brandl's avatar
Georg Brandl committed
3640 3641 3642
- Issue #15756: `subprocess.poll()` now properly handles `errno.ECHILD` to
  return a returncode of 0 when the child has already exited or cannot be waited
  on.
3643

Georg Brandl's avatar
Georg Brandl committed
3644
- Issue #15323: Improve failure message of `Mock.assert_called_once_with()`.
3645

Georg Brandl's avatar
Georg Brandl committed
3646
- Issue #16064: ``unittest -m`` claims executable is "python", not "python3".
3647

Georg Brandl's avatar
Georg Brandl committed
3648
- Issue #12376: Pass on parameters in `TextTestResult.__init__()` super call.
3649

Georg Brandl's avatar
Georg Brandl committed
3650
- Issue #15222: Insert blank line after each message in mbox mailboxes.
3651

Georg Brandl's avatar
Georg Brandl committed
3652
- Issue #16013: Fix `csv.Reader` parsing issue with ending quote characters.
3653 3654
  Patch by Serhiy Storchaka.

Georg Brandl's avatar
Georg Brandl committed
3655 3656
- Issue #15421: Fix an OverflowError in `Calendar.itermonthdates()` after
  `datetime.MAXYEAR`.  Patch by Cédric Krier.
3657

3658 3659 3660
- Issue #16112: platform.architecture does not correctly escape argument to
  /usr/bin/file.  Patch by David Benjamin.

Georg Brandl's avatar
Georg Brandl committed
3661
- Issue #15970: `xml.etree.ElementTree` now serializes correctly the empty HTML
3662 3663
  elements 'meta' and 'param'.

Georg Brandl's avatar
Georg Brandl committed
3664 3665
- Issue #15842: The `SocketIO.{readable,writable,seekable}` methods now raise
  ValueError when the file-like object is closed.  Patch by Alessandro Moura.
3666

Georg Brandl's avatar
Georg Brandl committed
3667
- Issue #15876: Fix a refleak in the `curses` module: window.encoding.
3668

Georg Brandl's avatar
Georg Brandl committed
3669 3670
- Issue #15881: Fix `atexit` hook in `multiprocessing`.  Original patch by Chris
  McDonough.
3671

Georg Brandl's avatar
Georg Brandl committed
3672 3673 3674
- Issue #15841: The readable(), writable() and seekable() methods of
  `io.BytesIO` and `io.StringIO` objects now raise ValueError when the object
  has been closed.  Patch by Alessandro Moura.
3675

Georg Brandl's avatar
Georg Brandl committed
3676 3677
- Issue #15447: Use `subprocess.DEVNULL` in webbrowser, instead of opening
  `os.devnull` explicitly and leaving it open.
3678

Georg Brandl's avatar
Georg Brandl committed
3679 3680
- Issue #15509: `webbrowser.UnixBrowser` no longer passes empty arguments to
  Popen when ``%action`` substitutions produce empty strings.
3681

Georg Brandl's avatar
Georg Brandl committed
3682 3683 3684 3685 3686
- Issue #12776, issue #11839: Call `argparse` type function (specified by
  add_argument) only once. Before, the type function was called twice in the
  case where the default was specified and the argument was given as well.  This
  was especially problematic for the FileType type, as a default file would
  always be opened, even if a file argument was specified on the command line.
3687 3688

- Issue #15906: Fix a regression in argparse caused by the preceding change,
Georg Brandl's avatar
Georg Brandl committed
3689
  when ``action='append'``, ``type='str'`` and ``default=[]``.
3690

Christian Heimes's avatar
Christian Heimes committed
3691 3692 3693 3694 3695
- Issue #16113: Added sha3 module based on the Keccak reference implementation
  3.2. The `hashlib` module has four additional hash algorithms: `sha3_224`,
  `sha3_256`, `sha3_384` and `sha3_512`. As part of the patch some common
  code was moved from _hashopenssl.c to hashlib.h.

3696 3697 3698
- ctypes.call_commethod was removed, since its only usage was in the defunct
  samples directory.

3699 3700 3701 3702
- Issue #16692: Added TLSv1.1 and TLSv1.2 support for the ssl modules.

- Issue #16832: add abc.get_cache_token() to expose cache validity checking
  support in ABCMeta.
3703

Benjamin Peterson's avatar
Benjamin Peterson committed
3704 3705 3706
IDLE
----

3707 3708 3709 3710 3711 3712 3713 3714 3715 3716 3717 3718 3719 3720 3721 3722 3723 3724 3725 3726 3727 3728 3729 3730 3731 3732 3733 3734 3735 3736 3737 3738 3739 3740 3741 3742 3743 3744 3745 3746 3747 3748
- Issue #18429: Format / Format Paragraph, now works when comment blocks
  are selected. As with text blocks, this works best when the selection
  only includes complete lines.

- Issue #18226: Add docstrings and unittests for FormatParagraph.py.
  Original patches by Todd Rovito and Phil Webster.

- Issue #18279: Format - Strip trailing whitespace no longer marks a file as
  changed when it has not been changed. This fix followed the addition of a
  test file originally written by Phil Webster (the issue's main goal).

- Issue #7136: In the Idle File menu, "New Window" is renamed "New File".
  Patch by Tal Einat, Roget Serwy, and Todd Rovito.

- Remove dead imports of imp.

- Issue #18196: Avoid displaying spurious SystemExit tracebacks.

- Issue #5492: Avoid traceback when exiting IDLE caused by a race condition.

- Issue #17511: Keep IDLE find dialog open after clicking "Find Next".
  Original patch by Sarah K.

- Issue #18055: Move IDLE off of imp and on to importlib.

- Issue #15392: Create a unittest framework for IDLE.
  Initial patch by Rajagopalasarma Jayakrishnan.
  See Lib/idlelib/idle_test/README.txt for how to run Idle tests.

- Issue #14146: Highlight source line while debugging on Windows.

- Issue #17838: Allow sys.stdin to be reassigned.

- Issue #13495: Avoid loading the color delegator twice in IDLE.

- Issue #17798: Allow IDLE to edit new files when specified on command line.

- Issue #14735: Update IDLE docs to omit "Control-z on Windows".

- Issue #17532: Always include Options menu for IDLE on OS X.
  Patch by Guilherme Simões.

Roger Serwy's avatar
Roger Serwy committed
3749 3750
- Issue #17585: Fixed IDLE regression. Now closes when using exit() or quit().

Roger Serwy's avatar
Roger Serwy committed
3751 3752 3753
- Issue #17657: Show full Tk version in IDLE's about dialog.
  Patch by Todd Rovito.

Roger Serwy's avatar
Roger Serwy committed
3754 3755
- Issue #17613: Prevent traceback when removing syntax colorizer in IDLE.

Roger Serwy's avatar
Roger Serwy committed
3756 3757
- Issue #1207589: Backwards-compatibility patch for right-click menu in IDLE.

Roger Serwy's avatar
Roger Serwy committed
3758 3759
- Issue #16887: IDLE now accepts Cancel in tabify/untabify dialog box.

3760 3761
- Issue #17625: In IDLE, close the replace dialog after it is used.

Benjamin Peterson's avatar
Benjamin Peterson committed
3762 3763 3764 3765 3766 3767
- Issue #14254: IDLE now handles readline correctly across shell restarts.

- Issue #17614: IDLE no longer raises exception when quickly closing a file.

- Issue #6698: IDLE now opens just an editor window when configured to do so.

3768
- Issue #8900: Using keyboard shortcuts in IDLE to open a file no longer
Benjamin Peterson's avatar
Benjamin Peterson committed
3769 3770 3771 3772
  raises an exception.

- Issue #6649: Fixed missing exit status in IDLE. Patch by Guilherme Polo.

3773
- Issue #17114: IDLE now uses non-strict config parser.
Benjamin Peterson's avatar
Benjamin Peterson committed
3774

3775 3776
- Issue #9290: In IDLE the sys.std* streams now implement io.TextIOBase
  interface and support all mandatory methods and properties.
Benjamin Peterson's avatar
Benjamin Peterson committed
3777

3778
- Issue #5066: Update IDLE docs. Patch by Todd Rovito.
Benjamin Peterson's avatar
Benjamin Peterson committed
3779 3780 3781 3782

- Issue #16829: IDLE printing no longer fails if there are spaces or other
  special characters in the file path.

3783
- Issue #16491: IDLE now prints chained exception tracebacks.
Benjamin Peterson's avatar
Benjamin Peterson committed
3784

3785
- Issue #16819: IDLE method completion now correctly works for bytes literals.
Benjamin Peterson's avatar
Benjamin Peterson committed
3786

3787 3788
- Issue #16504: IDLE now catches SyntaxErrors raised by tokenizer. Patch by
  Roger Serwy.
Benjamin Peterson's avatar
Benjamin Peterson committed
3789

3790 3791
- Issue #16511: Use default IDLE width and height if config param is not valid.
  Patch Serhiy Storchaka.
Benjamin Peterson's avatar
Benjamin Peterson committed
3792

3793 3794
- Issue #1207589: Add Cut/Copy/Paste items to IDLE right click Context Menu
  Patch by Todd Rovito.
Benjamin Peterson's avatar
Benjamin Peterson committed
3795

3796 3797
- Issue #16123: IDLE - deprecate running without a subprocess.
  Patch by Roger Serwy.
Benjamin Peterson's avatar
Benjamin Peterson committed
3798

3799 3800 3801
Tests
-----

3802 3803 3804 3805 3806 3807 3808 3809 3810 3811 3812 3813 3814 3815 3816 3817 3818 3819 3820 3821 3822 3823 3824 3825 3826 3827 3828 3829 3830 3831 3832 3833 3834 3835 3836 3837 3838
- Issue #1666318: Add a test that shutil.copytree() retains directory
  permissions.  Patch by Catherine Devlin.

- Issue #18273: move the tests in Lib/test/json_tests to Lib/test/test_json
  and make them discoverable by unittest.  Patch by Zachary Ware.

- Fix a fcntl test case on KFreeBSD, Debian #708653 (Petr Salinger).

- Issue #18396: Fix spurious test failure in test_signal on Windows when
  faulthandler is enabled (Patch by Jeremy Kloth)

- Issue #17046: Fix broken test_executable_without_cwd in test_subprocess.

- Issue #15415: Add new temp_dir() and change_cwd() context managers to
  test.support, and refactor temp_cwd() to use them.  Patch by Chris Jerdonek.

- Issue #15494: test.support is now a package rather than a module (Initial
  patch by Indra Talip)

- Issue #17944: test_zipfile now discoverable and uses subclassing to
  generate tests for different compression types.  Fixed a bug with skipping
  some tests due to use of exhausted iterators.

- Issue #18266: test_largefile now works with unittest test discovery and
  supports running only selected tests.  Patch by Zachary Ware.

- Issue #17767: test_locale now works with unittest test discovery.
  Original patch by Zachary Ware.

- Issue #18375: Assume --randomize when --randseed is used for running the
  testsuite.

- Issue #11185: Fix test_wait4 under AIX.  Patch by Sébastien Sablé.

- Issue #18207: Fix test_ssl for some versions of OpenSSL that ignore seconds
  in ASN1_TIME fields.

R David Murray's avatar
R David Murray committed
3839
- Issue #18094: test_uuid no longer reports skipped tests as passed.
3840 3841 3842 3843 3844 3845 3846 3847 3848 3849 3850 3851 3852 3853 3854 3855 3856 3857 3858 3859 3860 3861 3862 3863 3864 3865 3866 3867 3868 3869 3870 3871 3872 3873 3874 3875 3876 3877 3878 3879 3880 3881 3882 3883 3884 3885 3886

- Issue #17992: Add timeouts to asyncore and asynchat tests so that they won't
  accidentally hang.

- Issue #17833: Fix test_gdb failures seen on machines where debug symbols
  for glibc are available (seen on PPC64 Linux).

- Issue #7855: Add tests for ctypes/winreg for issues found in IronPython.
  Initial patch by Dino Viehland.

- Issue #11078: test___all__ now checks for duplicates in __all__.
  Initial patch by R. David Murray.

- Issue #17712: Fix test_gdb failures on Ubuntu 13.04.

- Issue #17835: Fix test_io when the default OS pipe buffer size is larger
  than one million bytes.

- Issue #17065: Use process-unique key for winreg tests to avoid failures if
  test is run multiple times in parallel (eg: on a buildbot host).

- Issue #12820: add tests for the xml.dom.minicompat module.
  Patch by John Chandler and Phil Connell.

- Issue #17691: test_univnewlines now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17790: test_set now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17789: test_random now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17779: test_osx_env now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17766: test_iterlen now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17690: test_time now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #17692: test_sqlite now works with unittest test discovery.
  Patch by Zachary Ware.

- Issue #11995: test_pydoc doesn't import all sys.path modules anymore.

3887 3888
- Issue #17448: test_sax now skips if there are no xml parsers available
  instead of raising an ImportError.
3889

Ezio Melotti's avatar
Ezio Melotti committed
3890 3891
- Issue #11420: make test suite pass with -B/DONTWRITEBYTECODE set.
  Initial patch by Thomas Wouters.
3892

3893 3894
- Issue #10652: make tcl/tk tests run after __all__ test, patch by
  Zachary Ware.
3895

Ezio Melotti's avatar
Ezio Melotti committed
3896
- Issue #11963: remove human verification from test_parser and test_subprocess.
3897

3898 3899
- Issue #11732: add a new suppress_crash_popup() context manager to test.support
  that disables crash popups on Windows and use it in test_faulthandler and
3900
  test_capi.
3901

3902
- Issue #13898: test_ssl no longer prints a spurious stack trace on Ubuntu.
3903

3904 3905 3906
- Issue #17283: Share code between `__main__.py` and `regrtest.py` in
  `Lib/test`.

Ezio Melotti's avatar
Ezio Melotti committed
3907
- Issue #17249: convert a test in test_capi to use unittest and reap threads.
3908

3909 3910 3911 3912
- Issue #17107: Test client-side SNI support in urllib.request thanks to
  the new server-side SNI support in the ssl module.  Initial patch by
  Daniel Black.

3913 3914
- Issue #17041: Fix testing when Python is configured with the
  --without-doc-strings.
3915

3916 3917
- Issue #16923: Fix ResourceWarnings in test_ssl.

3918
- Issue #15539: Added regression tests for Tools/scripts/pindent.py.
3919

3920 3921 3922
- Issue #17479: test_io now works with unittest test discovery.
  Patch by Zachary Ware.

3923 3924 3925
- Issue #17066: test_robotparser now works with unittest test discovery.
  Patch by Zachary Ware.

3926 3927
- Issue #17334: test_index now works with unittest test discovery.
  Patch by Zachary Ware.
3928

3929 3930 3931
- Issue #17333: test_imaplib now works with unittest test discovery.
  Patch by Zachary Ware.

3932 3933 3934
- Issue #17082: test_dbm* now work with unittest test discovery.
  Patch by Zachary Ware.

3935 3936 3937
- Issue #17079: test_ctypes now works with unittest test discovery.
  Patch by Zachary Ware.

3938 3939 3940
- Issue #17304: test_hash now works with unittest test discovery.
  Patch by Zachary Ware.

3941 3942 3943
- Issue #17303: test_future* now work with unittest test discovery.
  Patch by Zachary Ware.

3944 3945 3946
- Issue #17163: test_file now works with unittest test discovery.
  Patch by Zachary Ware.

3947 3948 3949
- Issue #16925: test_configparser now works with unittest test discovery.
  Patch by Zachary Ware.

3950 3951 3952
- Issue #16918: test_codecs now works with unittest test discovery.
  Patch by Zachary Ware.

3953 3954 3955
- Issue #16919: test_crypt now works with unittest test discovery.
  Patch by Zachary Ware.

3956 3957 3958
- Issue #16910: test_bytes, test_unicode, and test_userstring now work with
  unittest test discovery.  Patch by Zachary Ware.

3959 3960 3961
- Issue #16905: test_warnings now works with unittest test discovery.
  Initial patch by Berker Peksag.

3962 3963 3964
- Issue #16898: test_bufio now works with unittest test discovery.
  Patch by Zachary Ware.

3965 3966 3967
- Issue #16888: test_array now works with unittest test discovery.
  Patch by Zachary Ware.

3968 3969 3970
- Issue #16896: test_asyncore now works with unittest test discovery.
  Patch by Zachary Ware.

3971 3972 3973
- Issue #16897: test_bisect now works with unittest test discovery.
  Initial patch by Zachary Ware.

3974 3975 3976
- Issue #16852: test_genericpath, test_posixpath, test_ntpath, and test_macpath
  now work with unittest test discovery.  Patch by Zachary Ware.

3977 3978
- Issue #16748: test_heapq now works with unittest test discovery.

Brian Curtin's avatar
Brian Curtin committed
3979 3980 3981
- Issue #10646: Tests rearranged for os.samefile/samestat to check for not
  just symlinks but also hard links.

3982 3983
- Issue #15302: Switch regrtest from using getopt to using argparse.

3984 3985
- Issue #15324: Fix regrtest parsing of --fromfile, --match, and --randomize
  options.
3986

3987 3988 3989
- Issue #16702: test_urllib2_localnet tests now correctly ignores proxies for
  localhost tests.

3990 3991
- Issue #16664: Add regression tests for glob's behaviour concerning entries
  starting with a ".".  Patch by Sebastian Kreft.
3992

3993 3994 3995
- Issue #13390: The ``-R`` option to regrtest now also checks for memory
  allocation leaks, using :func:`sys.getallocatedblocks()`.

Ezio Melotti's avatar
Ezio Melotti committed
3996 3997
- Issue #16559: Add more tests for the json module, including some from the
  official test suite at json.org.  Patch by Serhiy Storchaka.
3998

3999 4000 4001
- Issue #16661: Fix the `os.getgrouplist()` test by not assuming that it gives
  the same output as :command:`id -G`.

4002 4003 4004
- Issue #16115: Add some tests for the executable argument to
  subprocess.Popen().  Initial patch by Kushal Das.

4005 4006 4007
- Issue #16126: PyErr_Format format mismatch in _testcapimodule.c.
  Patch by Serhiy Storchaka.

Georg Brandl's avatar
Georg Brandl committed
4008 4009
- Issue #15304: Fix warning message when `os.chdir()` fails inside
  `test.support.temp_cwd()`.  Patch by Chris Jerdonek.
4010

Georg Brandl's avatar
Georg Brandl committed
4011 4012
- Issue #15802: Fix test logic in `TestMaildir.test_create_tmp()`. Patch by
  Serhiy Storchaka.
4013

Georg Brandl's avatar
Georg Brandl committed
4014 4015
- Issue #15557: Added a test suite for the webbrowser module, thanks to Anton
  Barkovsky.
4016

Ned Deily's avatar
Ned Deily committed
4017 4018
- Issue #16698: Skip posix test_getgroups when built with OS X
  deployment target prior to 10.6.
4019

4020 4021 4022
Build
-----

4023 4024 4025 4026 4027 4028 4029 4030 4031 4032 4033 4034 4035 4036 4037 4038 4039 4040 4041 4042 4043
- Issue #16067: Add description into MSI file to replace installer's
  temporary name.

- Issue #18257: Fix readlink usage in python-config.  Install the python
  version again on Darwin.

- Issue #18481: Add C coverage reporting with gcov and lcov. A new make target
  "coverage-report" creates an instrumented Python build, runs unit tests
  and creates a HTML. The report can be updated with "make coverage-lcov".

- Issue #17845: Clarified the message printed when some module are not built.

- Issue #18256: Compilation fix for recent AIX releases.  Patch by
  David Edelsohn.

- Issue #17547: In configure, explicitly pass -Wformat for the benefit for GCC
  4.8.

- Issue #15172: Document NASM 2.10+ as requirement for building OpenSSL 1.0.1
  on Windows.

4044 4045 4046
- Issue #17591: Use lowercase filenames when including Windows header files.
  Patch by Roumen Petrov.

Benjamin Peterson's avatar
Benjamin Peterson committed
4047 4048
- Issue #17550: Fix the --enable-profiling configure switch.

4049 4050
- Issue #17425: Build with openssl 1.0.1d on Windows.

4051 4052 4053
- Issue #16754: Fix the incorrect shared library extension on linux. Introduce
  two makefile macros SHLIB_SUFFIX and EXT_SUFFIX. SO now has the value of
  SHLIB_SUFFIX again (as in 2.x and 3.1). The SO macro is removed in 3.4.
4054

4055 4056
- Issue #5033: Fix building of the sqlite3 extension module when the
  SQLite library version has "beta" in it. Patch by Andreas Pelme.
4057

4058 4059
- Issue #17228: Fix building without pymalloc.

4060 4061
- Issue #3718: Use AC_ARG_VAR to set MACHDEP in configure.ac.

4062 4063
- Issue #16235: Implement python-config as a shell script.

4064 4065
- Issue #16769: Remove outdated Visual Studio projects.

4066 4067
- Issue #17031: Fix running regen in cross builds.

4068
- Issue #3754: fix typo in pthread AC_CACHE_VAL.
4069

4070 4071 4072
- Issue #15484: Fix _PYTHON_PROJECT_BASE for srcdir != builddir builds;
  use _PYTHON_PROJECT_BASE in distutils/sysconfig.py.

4073
- Drop support for Windows 2000 (changeset e52df05b496a).
4074

4075
- Issue #17029: Let h2py search the multiarch system include directory.
4076

4077 4078
- Issue #16953: Fix socket module compilation on platforms with
  HAVE_BROKEN_POLL. Patch by Jeffrey Armstrong.
4079

4080 4081
- Issue #16320: Remove redundant Makefile dependencies for strings and bytes.

4082 4083 4084
- Cross compiling needs host and build settings. configure no longer
  creates a broken PYTHON_FOR_BUILD variable when --build is missing.

4085 4086 4087
- Fix cross compiling issue in setup.py, ensure that lib_dirs and inc_dirs are
  defined in cross compiling mode, too.

4088 4089
- Issue #16836: Enable IPv6 support even if IPv6 is disabled on the build host.

4090 4091
- Issue #16593: Have BSD 'make -s' do the right thing, thanks to Daniel Shahaf

4092
- Issue #16262: fix out-of-src-tree builds, if mercurial is not installed.
4093

4094 4095 4096
- Issue #15298: ensure _sysconfigdata is generated in build directory, not
  source directory.

4097 4098 4099 4100
- Issue #15833: Fix a regression in 3.3 that resulted in exceptions being
  raised if importlib failed to write byte-compiled files.  This affected
  attempts to build Python out-of-tree from a read-only source directory.

Georg Brandl's avatar
Georg Brandl committed
4101 4102
- Issue #15923: Fix a mistake in ``asdl_c.py`` that resulted in a TypeError
  after 2801bf875a24 (see #15801).
4103

4104 4105
- Issue #16135: Remove OS/2 support.

4106 4107
- Issue #15819: Make sure we can build Python out-of-tree from a read-only
  source directory.  (Somewhat related to issue #9860.)
4108

Ned Deily's avatar
Ned Deily committed
4109 4110 4111
- Issue #15587: Enable Tk high-resolution text rendering on Macs with
  Retina displays.  Applies to Tkinter apps, such as IDLE, on OS X
  framework builds linked with Cocoa Tk 8.5.
4112

4113
- Issue #17161: make install now also installs a python3 man page.
4114

4115 4116
C-API
-----
4117

4118 4119 4120 4121 4122 4123 4124 4125 4126 4127 4128 4129 4130 4131 4132 4133
- Issue #18351: Fix various issues in a function in importlib provided to help
  PyImport_ExecCodeModuleWithPathnames() (and thus by extension
  PyImport_ExecCodeModule() and PyImport_ExecCodeModuleEx()).

- Issue #9369: The types of `char*` arguments of PyObject_CallFunction() and
  PyObject_CallMethod() now changed to `const char*`.  Based on patches by
  Jörg Müller and Lars Buitinck.

- Issue #17206: Py_CLEAR(), Py_DECREF(), Py_XINCREF() and Py_XDECREF() now
  expand their arguments once instead of multiple times.  Patch written by Illia
  Polosukhin.

- Issue #17522: Add the PyGILState_Check() API.

- Issue #17327: Add PyDict_SetDefault.

4134
- Issue #16881: Fix Py_ARRAY_LENGTH macro for GCC < 3.1.
4135

4136 4137 4138 4139 4140 4141 4142 4143 4144 4145
- Issue #16505: Remove unused Py_TPFLAGS_INT_SUBCLASS.

- Issue #16086: PyTypeObject.tp_flags and PyType_Spec.flags are now unsigned
  (unsigned long and unsigned int) to avoid an undefined behaviour with
  Py_TPFLAGS_TYPE_SUBCLASS ((1 << 31). PyType_GetFlags() result type is
  now unsigned too (unsigned long, instead of long).

- Issue #16166: Add PY_LITTLE_ENDIAN and PY_BIG_ENDIAN macros and unified
  endianness detection and handling.

4146 4147 4148
Documentation
-------------

4149 4150 4151 4152 4153 4154 4155 4156 4157 4158 4159 4160 4161 4162 4163
- Issue #17701: Improving strftime documentation.

- Issue #18440: Clarify that `hash()` can truncate the value returned from an
  object's custom `__hash__()` method.

- Issue #17844: Add links to encoders and decoders for bytes-to-bytes codecs.

- Issue #14097: improve the "introduction" page of the tutorial.

- Issue #17977: The documentation for the cadefault argument's default value
  in urllib.request.urlopen() is fixed to match the code.

- Issue #6696: add documentation for the Profile objects, and improve
  profile/cProfile docs.  Patch by Tom Pinckney.

Terry Jan Reedy's avatar
Terry Jan Reedy committed
4164 4165
- Issue #15940: Specify effect of locale on time functions.

4166
- Issue 17538: Document XML vulnerabilties
Barry Warsaw's avatar
Barry Warsaw committed
4167

4168 4169 4170
- Issue #16642: sched.scheduler timefunc initial default is time.monotonic.
  Patch by Ramchandra Apte

4171 4172
- Issue #17047: remove doubled words in docs and docstrings
  reported by Serhiy Storchaka and Matthew Barnett.
4173

4174 4175 4176
- Issue #15465: Document the versioning macros in the C API docs rather than
  the standard library docs. Patch by Kushal Das.

4177
- Issue #16406: Combine the pages for uploading and registering to PyPI.
4178

4179 4180
- Issue #16403: Document how distutils uses the maintainer field in
  PKG-INFO. Patch by Jyrki Pulliainen.
4181

4182 4183
- Issue #16695: Document how glob handles filenames starting with a
  dot. Initial patch by Jyrki Pulliainen.
4184

4185 4186 4187
- Issue #8890: Stop advertising an insecure practice by replacing uses
  of the /tmp directory with better alternatives in the documentation.
  Patch by Geoff Wilson.
4188

4189
- Issue #17203: add long option names to unittest discovery docs.
4190

Ezio Melotti's avatar
Ezio Melotti committed
4191 4192
- Issue #13094: add "Why do lambdas defined in a loop with different values
  all return the same result?" programming FAQ.
4193

Brian Curtin's avatar
Brian Curtin committed
4194 4195
- Issue #14901: Update portions of the Windows FAQ.
  Patch by Ashish Nitin Patil.
4196

4197 4198 4199
- Issue #16267: Better document the 3.3+ approach to combining
  @abstractmethod with @staticmethod, @classmethod and @property

4200 4201 4202
- Issue #15209: Clarify exception chaining description in exceptions module
  documentation

4203
- Issue #15990: Improve argument/parameter documentation.
4204

4205 4206 4207
- Issue #16209: Move the documentation for the str built-in function to a new
  str class entry in the "Text Sequence Type" section.

4208 4209
- Issue #13538: Improve str() and object.__str__() documentation.

Brett Cannon's avatar
Brett Cannon committed
4210 4211
- Issue #16489: Make it clearer that importlib.find_loader() needs parent
  packages to be explicitly imported.
4212

4213 4214
- Issue #16400: Update the description of which versions of a given package
  PyPI displays.
4215

4216 4217
- Issue #15677: Document that zlib and gzip accept a compression level of 0 to
  mean 'no compression'. Patch by Brian Brazil.
4218

4219 4220 4221
- Issue #16197: Update winreg docstrings and documentation to match code.
  Patch by Zachary Ware.

Ezio Melotti's avatar
Ezio Melotti committed
4222 4223
- Issue #8040: added a version switcher to the documentation.  Patch by
  Yury Selivanov.
4224

4225 4226 4227
- Issue #16241: Document -X faulthandler command line option.
  Patch by Marek Šuppa.

4228 4229 4230
- Additional comments and some style changes in the concurrent.futures URL
  retrieval example

4231 4232 4233
- Issue #16115: Improve subprocess.Popen() documentation around args, shell,
  and executable arguments.

Hynek Schlawack's avatar
Hynek Schlawack committed
4234 4235 4236
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.

Georg Brandl's avatar
Georg Brandl committed
4237
- Issue #15533: Clarify docs and add tests for `subprocess.Popen()`'s cwd
4238
  argument.
4239

Ezio Melotti's avatar
Ezio Melotti committed
4240 4241
- Issue #15979: Improve timeit documentation.

Georg Brandl's avatar
Georg Brandl committed
4242
- Issue #16036: Improve documentation of built-in `int()`'s signature and
4243 4244
  arguments.

Georg Brandl's avatar
Georg Brandl committed
4245
- Issue #15935: Clarification of `argparse` docs, re: add_argument() type and
4246 4247 4248 4249 4250
  default arguments.  Patch contributed by Chris Jerdonek.

- Issue #11964: Document a change in v3.2 to the behavior of the indent
  parameter of json encoding operations.

Ned Deily's avatar
Ned Deily committed
4251 4252
- Issue #15116: Remove references to appscript as it is no longer being
  supported.
4253

4254 4255 4256
Tools/Demos
-----------

4257 4258 4259 4260 4261 4262 4263 4264 4265 4266 4267 4268 4269 4270 4271 4272
- Issue #18817: Fix a resource warning in Lib/aifc.py demo.  Patch by
  Vajrasky Kok.

- Issue #18439: Make patchcheck work on Windows for ACKS, NEWS.

- Issue #18448: Fix a typo in Tools/demo/eiffel.py.

- Issue #18457: Fixed saving of formulas and complex numbers in
  Tools/demo/ss1.py.

- Issue #18449: Make Tools/demo/ss1.py work again on Python 3.  Patch by
  Févry Thibault.

- Issue #12990: The "Python Launcher" on OSX could not launch python scripts
  that have paths that include wide characters.

4273 4274
- Issue #15239: Make mkstringprep.py work again on Python 3.

4275
- Issue #17028: Allowed Python arguments to be supplied to the Windows
4276 4277
  launcher.

4278 4279
- Issue #17156: pygettext.py now detects the encoding of source files and
  correctly writes and escapes non-ascii characters.
4280

4281 4282 4283 4284
- Issue #15539: Fix a number of bugs in Tools/scripts/pindent.py.  Now
  pindent.py works with a "with" statement.  pindent.py no longer produces
  improper indentation.  pindent.py now works with continued lines broken after
  "class" or "def" keywords and with continuations at the start of line.
4285

4286 4287
- Issue #11797: Add a 2to3 fixer that maps reload() to imp.reload().

4288 4289
- Issue #10966: Remove the concept of unexpected skipped tests.

4290 4291 4292 4293
- Issue #9893: Removed the Misc/Vim directory.

- Removed the Misc/TextMate directory.

4294 4295 4296
- Issue #16245: Add the Tools/scripts/parse_html5_entities.py script to parse
  the list of HTML5 entities and update the html.entities.html5 dictionary.

4297
- Issue #15378: Fix Tools/unicode/comparecodecs.py.  Patch by Serhiy Storchaka.
Ronald Oussoren's avatar
Ronald Oussoren committed
4298

4299 4300 4301
- Issue #16549: Make json.tool work again on Python 3 and add tests.
  Initial patch by Berker Peksag and Serhiy Storchaka.

4302 4303 4304
- Issue #13301: use ast.literal_eval() instead of eval() in Tools/i18n/msgfmt.py
  Patch by Serhiy Storchaka.

4305 4306 4307 4308 4309 4310
Windows
-------

- Issue #18569: The installer now adds .py to the PATHEXT variable when extensions
  are registered. Patch by Paul Moore.

4311

Georg Brandl's avatar
Georg Brandl committed
4312 4313 4314
What's New in Python 3.3.0?
===========================

Georg Brandl's avatar
Georg Brandl committed
4315
*Release date: 29-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
4316 4317 4318 4319

Core and Builtins
-----------------

4320 4321
- Issue #16046: Fix loading sourceless legacy .pyo files.

4322 4323
- Issue #16060: Fix refcounting bug when `__trunc__()` returns an object whose
  `__int__()` gives a non-integer.  Patch by Serhiy Storchaka.
4324

4325 4326 4327
Extension Modules
-----------------

4328
- Issue #16012: Fix a regression in pyexpat. The parser's `UseForeignDTD()`
4329 4330
  method doesn't require an argument again.

Georg Brandl's avatar
Georg Brandl committed
4331

4332
What's New in Python 3.3.0 Release Candidate 3?
Georg Brandl's avatar
Georg Brandl committed
4333
===============================================
4334

Georg Brandl's avatar
Georg Brandl committed
4335
*Release date: 23-Sep-2012*
4336 4337 4338 4339

Core and Builtins
-----------------

4340
- Issue #15900: Fix reference leak in `PyUnicode_TranslateCharmap()`.
4341

4342 4343
- Issue #15926: Fix crash after multiple reinitializations of the interpreter.

4344
- Issue #15895: Fix FILE pointer leak in one error branch of
4345 4346
  `PyRun_SimpleFileExFlags()` when filename points to a pyc/pyo file, closeit is
  false an and set_main_loader() fails.
4347

4348 4349
- Fixes for a few crash and memory leak regressions found by Coverity.

4350 4351 4352
Library
-------

4353 4354 4355 4356
- Issue #15882: Change `_decimal` to accept any coefficient tuple when
  constructing infinities. This is done for backwards compatibility with
  decimal.py: Infinity coefficients are undefined in _decimal (in accordance
  with the specification).
4357

4358 4359
- Issue #15925: Fix a regression in `email.util` where the `parsedate()` and
  `parsedate_tz()` functions did not return None anymore when the argument could
4360 4361
  not be parsed.

Georg Brandl's avatar
Georg Brandl committed
4362 4363 4364
Extension Modules
-----------------

4365 4366 4367
- Issue #15973: Fix a segmentation fault when comparing datetime timezone
  objects.

Georg Brandl's avatar
Georg Brandl committed
4368 4369 4370
- Issue #15977: Fix memory leak in Modules/_ssl.c when the function
  _set_npn_protocols() is called multiple times, thanks to Daniel Sommermann.

4371
- Issue #15969: `faulthandler` module: rename dump_tracebacks_later() to
4372 4373 4374
  dump_traceback_later() and cancel_dump_tracebacks_later() to
  cancel_dump_traceback_later().

4375
- _decimal module: use only C 89 style comments.
Georg Brandl's avatar
Georg Brandl committed
4376

4377

Georg Brandl's avatar
Georg Brandl committed
4378 4379 4380
What's New in Python 3.3.0 Release Candidate 2?
===============================================

Georg Brandl's avatar
Georg Brandl committed
4381
*Release date: 09-Sep-2012*
Georg Brandl's avatar
Georg Brandl committed
4382 4383 4384 4385

Core and Builtins
-----------------

4386
- Issue #13992: The trashcan mechanism is now thread-safe.  This eliminates
4387 4388
  sporadic crashes in multi-thread programs when several long deallocator chains
  ran concurrently and involved subclasses of built-in container types.
4389

4390 4391
- Issue #15784: Modify `OSError`.__str__() to better distinguish between errno
  error numbers and Windows error numbers.
4392

4393 4394
- Issue #15781: Fix two small race conditions in import's module locking.

Georg Brandl's avatar
Georg Brandl committed
4395 4396 4397
Library
-------

4398 4399 4400
- Issue #17158: Add 'symbols' to help() welcome message; clarify
  'modules spam' messages.

4401 4402
- Issue #15847: Fix a regression in argparse, which did not accept tuples as
  argument lists anymore.
4403

4404
- Issue #15828: Restore support for C extensions in `imp.load_module()`.
4405

4406 4407
- Issue #15340: Fix importing the random module when ``/dev/urandom`` cannot be
  opened.  This was a regression caused by the hash randomization patch.
4408

4409
- Issue #10650: Deprecate the watchexp parameter of the `Decimal.quantize()`
4410 4411
  method.

4412 4413 4414 4415
- Issue #15785: Modify `window.get_wch()` API of the curses module: return a
  character for most keys, and an integer for special keys, instead of always
  returning an integer. So it is now possible to distinguish special keys like
  keypad keys.
4416

4417
- Issue #14223: Fix `window.addch()` of the curses module for special characters
4418 4419 4420 4421 4422 4423
  like curses.ACS_HLINE: the Python function addch(int) and addch(bytes) is now
  calling the C function waddch()/mvwaddch() (as it was done in Python 3.2),
  instead of wadd_wch()/mvwadd_wch(). The Python function addch(str) is still
  calling the C function wadd_wch()/mvwadd_wch() if the Python curses is linked
  to libncursesw.

Georg Brandl's avatar
Georg Brandl committed
4424 4425 4426 4427 4428 4429
Build
-----

- Issue #15822: Really ensure 2to3 grammar pickles are properly installed
  (replaces fixes for Issue #15645).

4430 4431 4432
Documentation
-------------

4433 4434 4435 4436
- Issue #15814: The memoryview enhancements in 3.3.0 accidentally permitted the
  hashing of multi-dimensional memorviews and memoryviews with multi-byte item
  formats. The intended restrictions have now been documented - they will be
  correctly enforced in 3.3.1.
4437

Georg Brandl's avatar
Georg Brandl committed
4438

Georg Brandl's avatar
Georg Brandl committed
4439 4440 4441
What's New in Python 3.3.0 Release Candidate 1?
===============================================

Georg Brandl's avatar
Georg Brandl committed
4442
*Release date: 25-Aug-2012*
Georg Brandl's avatar
Georg Brandl committed
4443 4444 4445 4446

Core and Builtins
-----------------

4447
- Issue #15573: memoryview comparisons are now performed by value with full
4448
  support for any valid struct module format definition.
4449

4450
- Issue #15316: When an item in the fromlist for `__import__()` doesn't exist,
4451 4452 4453
  don't raise an error, but if an exception is raised as part of an import do
  let that propagate.

4454 4455
- Issue #15778: Ensure that ``str(ImportError(msg))`` returns a str even when
  msg isn't a str.
4456

4457 4458 4459 4460
- Issue #2051: Source file permission bits are once again correctly copied to
  the cached bytecode file. (The migration to importlib reintroduced this
  problem because these was no regression test. A test has been added as part of
  this patch)
4461

4462
- Issue #15761: Fix crash when ``PYTHONEXECUTABLE`` is set on Mac OS X.
4463

4464 4465
- Issue #15726: Fix incorrect bounds checking in PyState_FindModule.  Patch by
  Robin Schreiber.
4466

4467
- Issue #15604: Update uses of `PyObject_IsTrue()` to check for and handle
4468 4469
  errors correctly.  Patch by Serhiy Storchaka.

4470 4471
- Issue #14846: `importlib.FileFinder` now handles the case where the directory
  being searched is removed after a previous import attempt.
4472

Georg Brandl's avatar
Georg Brandl committed
4473 4474 4475
Library
-------

4476 4477
- Issue #13248: removed deprecated and undocumented difflib.isbjunk, isbpopular.

4478 4479
- Issue #13370: Ensure that ctypes works on Mac OS X when Python is compiled
  using the clang compiler.
4480

4481 4482
- Issue #13072: The array module's 'u' format code is now deprecated and will be
  removed in Python 4.0.
4483

4484 4485
- Issue #15544: Fix Decimal.__float__ to work with payload-carrying NaNs.

4486 4487
- Issue #15776: Allow pyvenv to work in existing directory with --clean.

4488
- Issue #15249: email's BytesGenerator now correctly mangles From lines (when
4489
  requested) even if the body contains undecodable bytes.
4490

Ross Lagerwall's avatar
Ross Lagerwall committed
4491
- Issue #15777: Fix a refleak in _posixsubprocess.
4492

4493
- Issue ##665194: Update `email.utils.localtime` to use datetime.astimezone and
4494 4495
  correctly handle historic changes in UTC offsets.

4496 4497
- Issue #15199: Fix JavaScript's default MIME type to application/javascript.
  Patch by Bohuslav Kabrda.
4498

4499 4500
- Issue #12643: `code.InteractiveConsole` now respects `sys.excepthook` when
  displaying exceptions.  Patch by Aaron Iles.
4501

4502
- Issue #13579: `string.Formatter` now understands the 'a' conversion specifier.
4503

4504 4505
- Issue #15595: Fix ``subprocess.Popen(universal_newlines=True)`` for certain
  locales (utf-16 and utf-32 family). Patch by Chris Jerdonek.
4506

4507 4508
- Issue #15477: In cmath and math modules, add workaround for platforms whose
  system-supplied log1p function doesn't respect signs of zeros.
4509

4510 4511
- Issue #15715: `importlib.__import__()` will silence an ImportError when the
  use of fromlist leads to a failed import.
4512

4513 4514 4515
- Issue #14669: Fix pickling of connections and sockets on Mac OS X by
  sending/receiving an acknowledgment after file descriptor transfer.
  TestPicklingConnection has been reenabled for Mac OS X.
4516

4517
- Issue #11062: Fix adding a message from file to Babyl mailbox.
4518

4519 4520
- Issue #15646: Prevent equivalent of a fork bomb when using `multiprocessing`
  on Windows without the ``if __name__ == '__main__'`` idiom.
4521

4522 4523 4524
IDLE
----

4525 4526
- Issue #15678: Fix IDLE menus when started from OS X command line (3.3.0b2
  regression).
4527

Senthil Kumaran's avatar
Senthil Kumaran committed
4528 4529
Documentation
-------------
4530

4531 4532
- Touched up the Python 2 to 3 porting guide.

4533
- Issue #14674: Add a discussion of the `json` module's standard compliance.
4534
  Patch by Chris Rebert.
4535

4536 4537
- Create a 'Concurrent Execution' section in the docs, and split up the
  'Optional Operating System Services' section to use a more user-centric
4538
  classification scheme (splitting them across the new CE section, IPC and text
4539
  processing). Operating system limitations can be reflected with the Sphinx
4540
  ``:platform:`` tag, it doesn't make sense as part of the Table of Contents.
4541

4542 4543
- Issue #4966: Bring the sequence docs up to date for the Py3k transition and
  the many language enhancements since they were original written.
4544

4545
- The "path importer" misnomer has been replaced with Eric Snow's
4546 4547
  more-awkward-but-at-least-not-wrong suggestion of "path based finder" in the
  import system reference docs.
4548

4549
- Issue #15640: Document `importlib.abc.Finder` as deprecated.
4550

4551
- Issue #15630: Add an example for "continue" stmt in the tutorial.  Patch by
Senthil Kumaran's avatar
Senthil Kumaran committed
4552
  Daniel Ellis.
4553

4554 4555
Tests
-----
4556

4557
- Issue #15747: ZFS always returns EOPNOTSUPP when attempting to set the
4558 4559
  UF_IMMUTABLE flag (via either chflags or lchflags); refactor affected tests in
  test_posix.py to account for this.
4560

4561 4562
- Issue #15285: Refactor the approach for testing connect timeouts using two
  external hosts that have been configured specifically for this type of test.
4563

4564
- Issue #15743: Remove the deprecated method usage in `urllib` tests. Patch by
4565 4566
  Jeff Knupp.

4567 4568
- Issue #15615: Add some tests for the `json` module's handling of invalid input
  data.  Patch by Kushal Das.
4569

4570 4571 4572
Build
-----

4573 4574
- Output lib files for PGO build into PGO directory.

4575 4576
- Pick up 32-bit launcher from PGO directory on 64-bit PGO build.

4577
- Drop ``PC\python_nt.h`` as it's not used.  Add input dependency on custom
4578 4579
  build step.

4580 4581
- Issue #15511: Drop explicit dependency on pythonxy.lib from _decimal amd64
  configuration.
4582

4583 4584
- Add missing PGI/PGO configurations for pywlauncher.

4585 4586
- Issue #15645: Ensure 2to3 grammar pickles are properly installed.

Georg Brandl's avatar
Georg Brandl committed
4587

4588 4589 4590
What's New in Python 3.3.0 Beta 2?
==================================

Georg Brandl's avatar
Georg Brandl committed
4591
*Release date: 12-Aug-2012*
4592

4593 4594 4595
Core and Builtins
-----------------

4596
- Issue #15568: Fix the return value of ``yield from`` when StopIteration is
4597 4598
  raised by a custom iterator.

4599
- Issue #13119: `sys.stdout` and `sys.stderr` are now using "\r\n" newline on
4600 4601
  Windows, as Python 2.

4602 4603
- Issue #15534: Fix the fast-search function for non-ASCII Unicode strings.

4604
- Issue #15508: Fix the docstring for `__import__()` to have the proper default
Georg Brandl's avatar
Georg Brandl committed
4605 4606
  value of 0 for 'level' and to not mention negative levels since they are not
  supported.
4607

4608
- Issue #15425: Eliminated traceback noise from more situations involving
Georg Brandl's avatar
Georg Brandl committed
4609
  importlib.
4610

4611 4612
- Issue #14578: Support modules registered in the Windows registry again.

Georg Brandl's avatar
Georg Brandl committed
4613 4614
- Issue #15466: Stop using TYPE_INT64 in marshal, to make importlib.h (and other
  byte code files) equal between 32-bit and 64-bit systems.
4615

Georg Brandl's avatar
Georg Brandl committed
4616
- Issue #1692335: Move initial exception args assignment to
4617
  `BaseException.__new__()` to help pickling of naive subclasses.
4618

4619
- Issue #12834: Fix `PyBuffer_ToContiguous()` for non-contiguous arrays.
4620

4621
- Issue #15456: Fix code `__sizeof__()` after #12399 change.  Patch by Serhiy
Georg Brandl's avatar
Georg Brandl committed
4622
  Storchaka.
4623

4624 4625
- Issue #15404: Refleak in PyMethodObject repr.

4626 4627
- Issue #15394: An issue in `PyModule_Create()` that caused references to be
  leaked on some error paths has been fixed.  Patch by Julia Lawall.
4628

Georg Brandl's avatar
Georg Brandl committed
4629 4630
- Issue #15368: An issue that caused bytecode generation to be non-deterministic
  has been fixed.
4631

Georg Brandl's avatar
Georg Brandl committed
4632 4633
- Issue #15202: Consistently use the name "follow_symlinks" for new parameters
  in os and shutil functions.
4634

4635
- Issue #15314: ``__main__.__loader__`` is now set correctly during interpreter
Georg Brandl's avatar
Georg Brandl committed
4636
  startup.
4637

4638 4639 4640 4641
- Issue #15111: When a module imported using 'from import' has an ImportError
  inside itself, don't mask that fact behind a generic ImportError for the
  module itself.

4642 4643
- Issue #15293: Add GC support to the AST base node type.

4644 4645 4646
- Issue #15291: Fix a memory leak where AST nodes where not properly
  deallocated.

Georg Brandl's avatar
Georg Brandl committed
4647 4648
- Issue #15110: Fix the tracebacks generated by "import xxx" to not show the
  importlib stack frames.
4649

4650
- Issue #16369: Global PyTypeObjects not initialized with PyType_Ready(...).
Ronald Oussoren's avatar
Ronald Oussoren committed
4651

4652 4653 4654
- Issue #15020: The program name used to search for Python's path is now
  "python3" under Unix, not "python".

4655 4656
- Issue #15897: zipimport.c doesn't check return value of fseek().
  Patch by Felipe Cruz.
4657

Ezio Melotti's avatar
Ezio Melotti committed
4658
- Issue #15033: Fix the exit status bug when modules invoked using -m switch,
4659 4660
  return the proper failure return value (1). Patch contributed by Jeff Knupp.

4661
- Issue #15229: An `OSError` subclass whose __init__ doesn't call back
Georg Brandl's avatar
Georg Brandl committed
4662 4663
  OSError.__init__ could produce incomplete instances, leading to crashes when
  calling str() on them.
4664

Ezio Melotti's avatar
Ezio Melotti committed
4665
- Issue #15307: Virtual environments now use symlinks with framework builds on
Georg Brandl's avatar
Georg Brandl committed
4666
  Mac OS X, like other POSIX builds.
4667

4668 4669 4670
Library
-------

4671 4672 4673
- Issue #14590: configparser now correctly strips inline comments when delimiter
  occurs earlier without preceding space.

4674
- Issue #15424: Add a `__sizeof__()` implementation for array objects.  Patch by
Georg Brandl's avatar
Georg Brandl committed
4675
  Ludwig Hähne.
4676

4677 4678
- Issue #15576: Allow extension modules to act as a package's __init__ module.

4679 4680
- Issue #15502: Have `importlib.invalidate_caches()` work on `sys.meta_path`
  instead of `sys.path_importer_cache`.
4681

4682 4683
- Issue #15163: Pydoc shouldn't list __loader__ as module data.

4684
- Issue #15471: Do not use mutable objects as defaults for
4685
  `importlib.__import__()`.
4686

4687
- Issue #15559: To avoid a problematic failure mode when passed to the bytes
4688 4689
  constructor, objects in the ipaddress module no longer implement `__index__()`
  (they still implement `__int__()` as appropriate).
4690

4691 4692
- Issue #15546: Fix handling of pathological input data in the peek() and
  read1() methods of the BZ2File, GzipFile and LZMAFile classes.
4693

4694 4695 4696
- Issue #12655: Instead of requiring a custom type, `os.sched_getaffinity()` and
  `os.sched_setaffinity()` now use regular sets of integers to represent the
  CPUs a process is restricted to.
4697

4698 4699
- Issue #15538: Fix compilation of the `socket.getnameinfo()` /
  `socket.getaddrinfo()` emulation code.  Patch by Philipp Hagemeister.
4700

Georg Brandl's avatar
Georg Brandl committed
4701
- Issue #15519: Properly expose WindowsRegistryFinder in importlib (and use the
4702
  correct term for it).  Original patch by Eric Snow.
4703

Georg Brandl's avatar
Georg Brandl committed
4704
- Issue #15502: Bring the importlib ABCs into line with the current state of the
4705
  import protocols given PEP 420.  Original patch by Eric Snow.
4706

Georg Brandl's avatar
Georg Brandl committed
4707 4708
- Issue #15499: Launching a webbrowser in Unix used to sleep for a few seconds.
  Original patch by Anton Barkovsky.
4709

Georg Brandl's avatar
Georg Brandl committed
4710 4711
- Issue #15463: The faulthandler module truncates strings to 500 characters,
  instead of 100, to be able to display long file paths.
4712

4713
- Issue #6056: Make `multiprocessing` use setblocking(True) on the sockets it
Georg Brandl's avatar
Georg Brandl committed
4714
  uses.  Original patch by J Derek Wilson.
4715

Georg Brandl's avatar
Georg Brandl committed
4716
- Issue #15364: Fix sysconfig.get_config_var('srcdir') to be an absolute path.
4717

4718
- Issue #15413: `os.times()` had disappeared under Windows.
4719

4720
- Issue #15402: An issue in the struct module that caused `sys.getsizeof()` to
Georg Brandl's avatar
Georg Brandl committed
4721 4722
  return incorrect results for struct.Struct instances has been fixed.  Initial
  patch by Serhiy Storchaka.
4723

4724 4725 4726
- Issue #15232: When mangle_from is True, `email.Generator` now correctly
  mangles lines that start with 'From ' that occur in a MIME preamble or
  epilogue.
4727

Georg Brandl's avatar
Georg Brandl committed
4728 4729
- Issue #15094: Incorrectly placed #endif in _tkinter.c.  Patch by Serhiy
  Storchaka.
4730

4731
- Issue #13922: `argparse` no longer incorrectly strips '--'s that appear after
Georg Brandl's avatar
Georg Brandl committed
4732
  the first one.
4733

4734
- Issue #12353: `argparse` now correctly handles null argument values.
4735

Georg Brandl's avatar
Georg Brandl committed
4736
- Issue #10017, issue #14998: Fix TypeError using pprint on dictionaries with
4737
  user-defined types as keys or other unorderable keys.
4738

4739 4740
- Issue #15397: `inspect.getmodulename()` is now based directly on importlib via
  a new `importlib.machinery.all_suffixes()` API.
4741

4742
- Issue #14635: `telnetlib` will use poll() rather than select() when possible to
Georg Brandl's avatar
Georg Brandl committed
4743
  avoid failing due to the select() file descriptor limit.
4744

Georg Brandl's avatar
Georg Brandl committed
4745
- Issue #15180: Clarify posixpath.join() error message when mixing str & bytes.
4746

Georg Brandl's avatar
Georg Brandl committed
4747 4748 4749
- Issue #15343: pkgutil now includes an iter_importer_modules implementation for
  importlib.machinery.FileFinder (similar to the way it already handled
  zipimport.zipimporter).
4750

Georg Brandl's avatar
Georg Brandl committed
4751
- Issue #15314: runpy now sets __main__.__loader__ correctly.
4752

Georg Brandl's avatar
Georg Brandl committed
4753 4754
- Issue #15357: The import emulation in pkgutil is now deprecated. pkgutil uses
  importlib internally rather than the emulation.
4755

Georg Brandl's avatar
Georg Brandl committed
4756 4757
- Issue #15233: Python now guarantees that callables registered with the atexit
  module will be called in a deterministic order.
4758

4759
- Issue #15238: `shutil.copystat()` now copies Linux "extended attributes".
4760

Georg Brandl's avatar
Georg Brandl committed
4761 4762
- Issue #15230: runpy.run_path now correctly sets __package__ as described in
  the documentation.
Nick Coghlan's avatar
Nick Coghlan committed
4763

4764 4765
- Issue #15315: Support VS 2010 in distutils cygwincompiler.

Georg Brandl's avatar
Georg Brandl committed
4766 4767
- Issue #15294: Fix a regression in pkgutil.extend_path()'s handling of nested
  namespace packages.
4768

4769 4770
- Issue #15056: `imp.cache_from_source()` and `imp.source_from_cache()` raise
  NotImplementedError when `sys.implementation.cache_tag` is set to None.
4771

4772
- Issue #15256: Grammatical mistake in exception raised by `imp.find_module()`.
4773

4774
- Issue #5931: `wsgiref` environ variable SERVER_SOFTWARE will specify an
Georg Brandl's avatar
Georg Brandl committed
4775
  implementation specific term like CPython, Jython instead of generic "Python".
4776

Georg Brandl's avatar
Georg Brandl committed
4777 4778
- Issue #13248: Remove obsolete argument "max_buffer_size" of BufferedWriter and
  BufferedRWPair, from the io module.
4779

4780
- Issue #13248: Remove obsolete argument "version" of `argparse.ArgumentParser`.
4781

Georg Brandl's avatar
Georg Brandl committed
4782 4783
- Issue #14814: Implement more consistent ordering and sorting behaviour for
  ipaddress objects.
4784

4785
- Issue #14814: `ipaddress` network objects correctly return NotImplemented when
Georg Brandl's avatar
Georg Brandl committed
4786
  compared to arbitrary objects instead of raising TypeError.
4787

Georg Brandl's avatar
Georg Brandl committed
4788
- Issue #14990: Correctly fail with SyntaxError on invalid encoding declaration.
Florent Xicluna's avatar
Florent Xicluna committed
4789

4790
- Issue #14814: `ipaddress` now provides more informative error messages when
4791
  constructing instances directly (changes permitted during beta due to
Georg Brandl's avatar
Georg Brandl committed
4792
  provisional API status).
4793

4794 4795
- Issue #15247: `io.FileIO` now raises an error when given a file descriptor
  pointing to a directory.
4796

4797 4798
- Issue #15261: Stop os.stat(fd) crashing on Windows when fd not open.

4799
- Issue #15166: Implement `imp.get_tag()` using `sys.implementation.cache_tag`.
4800

4801
- Issue #15210: Catch KeyError when `importlib.__init__()` can't find
4802 4803
  _frozen_importlib in sys.modules, not ImportError.

4804
- Issue #15030: `importlib.abc.PyPycLoader` now supports the new source size
4805 4806
  header field in .pyc files.

Georg Brandl's avatar
Georg Brandl committed
4807 4808
- Issue #5346: Preserve permissions of mbox, MMDF and Babyl mailbox files on
  flush().
4809

Georg Brandl's avatar
Georg Brandl committed
4810 4811
- Issue #10571: Fix the "--sign" option of distutils' upload command.  Patch by
  Jakub Wilk.
4812

Georg Brandl's avatar
Georg Brandl committed
4813 4814 4815
- Issue #9559: If messages were only added, a new file is no longer created and
  renamed over the old file when flush() is called on an mbox, MMDF or Babyl
  mailbox.
4816

Ezio Melotti's avatar
Ezio Melotti committed
4817
- Issue #10924: Fixed `crypt.mksalt()` to use a RNG that is suitable for
Georg Brandl's avatar
Georg Brandl committed
4818
  cryptographic purpose.
4819

Georg Brandl's avatar
Georg Brandl committed
4820 4821 4822 4823
- Issue #15184: Ensure consistent results of OS X configuration tailoring for
  universal builds by factoring out common OS X-specific customizations from
  sysconfig, distutils.sysconfig, distutils.util, and distutils.unixccompiler
  into a new module _osx_support.
4824

4825 4826 4827
C API
-----

4828
- Issue #15610: `PyImport_ImportModuleEx()` now uses a 'level' of 0 instead of -1.
4829

4830 4831
- Issue #15169, issue #14599: Strip out the C implementation of
  `imp.source_from_cache()` used by PyImport_ExecCodeModuleWithPathnames() and
4832 4833 4834 4835
  used the Python code instead. Leads to PyImport_ExecCodeModuleObject() to not
  try to infer the source path from the bytecode path as
  PyImport_ExecCodeModuleWithPathnames() does.

4836 4837 4838
Extension Modules
-----------------

4839 4840
- Issue #6493: An issue in ctypes on Windows that caused structure bitfields of
  type `ctypes.c_uint32` and width 32 to incorrectly be set has been fixed.
4841

4842 4843
- Issue #15194: Update libffi to the 3.0.11 release.

4844 4845 4846 4847 4848 4849
IDLE
----

- Issue #13052: Fix IDLE crashing when replace string in Search/Replace dialog
  ended with ``\``.  Patch by Roger Serwy.

4850 4851 4852
Tools/Demos
-----------

Georg Brandl's avatar
Georg Brandl committed
4853 4854
- Issue #15458: python-config gets a new option --configdir to print the $LIBPL
  value.
4855

4856 4857
- Move importlib.test.benchmark to Tools/importbench.

Georg Brandl's avatar
Georg Brandl committed
4858 4859 4860
- Issue #12605: The gdb hooks for debugging CPython (within Tools/gdb) have been
  enhanced to show information on more C frames relevant to CPython within the
  "py-bt" and "py-bt-full" commands:
Georg Brandl's avatar
Georg Brandl committed
4861 4862 4863 4864

  * C frames that are waiting on the GIL
  * C frames that are garbage-collecting
  * C frames that are due to the invocation of a PyCFunction
4865

Terry Jan Reedy's avatar
Terry Jan Reedy committed
4866 4867 4868
Documentation
-------------

4869 4870
- Issue #15041: Update "see also" list in tkinter documentation.

4871 4872
- Issue #15444: Use proper spelling for non-ASCII contributor names.  Patch by
  Serhiy Storchaka.
4873

4874
- Issue #15295: Reorganize and rewrite the documentation on the import system.
Barry Warsaw's avatar
Barry Warsaw committed
4875

Georg Brandl's avatar
Georg Brandl committed
4876 4877
- Issue #15230: Clearly document some of the limitations of the runpy module and
  nudge readers towards importlib when appropriate.
4878

4879 4880 4881
- Issue #15053: Copy Python 3.3 import lock change notice to all relevant
  functions in imp instead of just at the top of the relevant section.

4882 4883 4884 4885 4886
- Issue #15288: Link to the term "loader" in notes in pkgutil about how things
  won't work as expected in Python 3.3 and mark the requisite functions as
  "changed" since they will no longer work with modules directly imported by
  import itself.

4887 4888
- Issue #13557: Clarify effect of giving two different namespaces to `exec()` or
  `execfile()`.
Terry Jan Reedy's avatar
Terry Jan Reedy committed
4889

4890
- Issue #15250: Document that `filecmp.dircmp()` compares files shallowly. Patch
4891
  contributed by Chris Jerdonek.
4892

4893 4894 4895 4896
- Issue #15442: Expose the default list of directories ignored by
  `filecmp.dircmp()` as a module attribute, and expand the list to more modern
  values.

4897 4898 4899
Tests
-----

4900 4901
- Issue #15467: Move helpers for `__sizeof__()` tests into test_support.  Patch
  by Serhiy Storchaka.
4902

Georg Brandl's avatar
Georg Brandl committed
4903 4904
- Issue #15320: Make iterating the list of tests thread-safe when running tests
  in multiprocess mode. Patch by Chris Jerdonek.
4905

4906
- Issue #15168: Move `importlib.test` to `test.test_importlib`.
4907

4908
- Issue #15091: Reactivate a test on UNIX which was failing thanks to a
4909
  forgotten `importlib.invalidate_caches()` call.
4910 4911

- Issue #15230: Adopted a more systematic approach in the runpy tests.
Nick Coghlan's avatar
Nick Coghlan committed
4912

4913 4914 4915 4916
- Issue #15300: Ensure the temporary test working directories are in the same
  parent folder when running tests in multiprocess mode from a Python build.
  Patch by Chris Jerdonek.

4917 4918 4919
- Issue #15284: Skip {send,recv}msg tests in test_socket when IPv6 is not
  enabled. Patch by Brian Brazil.

Georg Brandl's avatar
Georg Brandl committed
4920 4921
- Issue #15277: Fix a resource leak in support.py when IPv6 is disabled.  Patch
  by Brian Brazil.
4922

4923 4924 4925
Build
-----

Georg Brandl's avatar
Georg Brandl committed
4926 4927
- Issue #11715: Fix multiarch detection without having Debian development tools
  (dpkg-dev) installed.
4928

4929 4930 4931 4932
- Issue #15037: Build OS X installers with local copy of ncurses 5.9 libraries
  to avoid curses.unget_wch bug present in older versions of ncurses such as
  those shipped with OS X.

Georg Brandl's avatar
Georg Brandl committed
4933 4934 4935 4936
- Issue #15560: Fix building _sqlite3 extension on OS X with an SDK.  Also, for
  OS X installers, ensure consistent sqlite3 behavior and feature availability
  by building a local copy of libsqlite3 rather than depending on the wide range
  of versions supplied with various OS X releases.
4937

Martin v. Löwis's avatar
Martin v. Löwis committed
4938
- Issue #8847: Disable COMDAT folding in Windows PGO builds.
4939

4940 4941
- Issue #14018: Fix OS X Tcl/Tk framework checking when using OS X SDKs.

Ned Deily's avatar
Ned Deily committed
4942
- Issue #16256: OS X installer now sets correct permissions for doc directory.
4943

Georg Brandl's avatar
Georg Brandl committed
4944 4945
- Issue #15431: Add _freeze_importlib project to regenerate importlib.h on
  Windows. Patch by Kristján Valur Jónsson.
4946

Georg Brandl's avatar
Georg Brandl committed
4947 4948
- Issue #14197: For OS X framework builds, ensure links to the shared library
  are created with the proper ABI suffix.
4949

4950 4951 4952
- Issue #14330: For cross builds, don't use host python, use host search paths
  for host compiler.

4953 4954
- Issue #15235: Allow Berkley DB versions up to 5.3 to build the dbm module.

4955 4956
- Issue #15268: Search curses.h in /usr/include/ncursesw.

4957

4958
What's New in Python 3.3.0 Beta 1?
Georg Brandl's avatar
Georg Brandl committed
4959
==================================
4960

Georg Brandl's avatar
Georg Brandl committed
4961
*Release date: 27-Jun-2012*
4962

Barry Warsaw's avatar
Barry Warsaw committed
4963 4964 4965
Core and Builtins
-----------------

4966 4967 4968
- Fix a (most likely) very rare memory leak when calling main() and not being
  able to decode a command-line argument.

4969 4970 4971
- Issue #14815: Use Py_ssize_t instead of long for the object hash, to
  preserve all 64 bits of hash on Win64.

4972 4973 4974 4975 4976
- Issue #12268: File readline, readlines and read() or readall() methods
  no longer lose data when an underlying read system call is interrupted.
  IOError is no longer raised due to a read system call returning EINTR
  from within these methods.

4977 4978
- Issue #11626: Add _SizeT functions to stable ABI.

4979 4980 4981
- Issue #15142: Fix reference leak when deallocating instances of types
  created using PyType_FromSpec().

4982 4983 4984
- Issue #10053: Don't close FDs when FileIO.__init__ fails. Loosely based on
  the work by Hirokazu Yamamoto.

4985 4986 4987
- Issue #15096: Removed support for ur'' as the raw notation isn't
  compatible with Python 2.x's raw unicode strings.

4988 4989
- Issue #13783: Generator objects now use the identifier APIs internally

4990 4991 4992
- Issue #14874: Restore charmap decoding speed to pre-PEP 393 levels.
  Patch by Serhiy Storchaka.

4993 4994 4995
- Issue #15026: utf-16 encoding is now significantly faster (up to 10x).
  Patch by Serhiy Storchaka.

4996 4997 4998 4999 5000 5001
- Issue #11022: open() and io.TextIOWrapper are now calling
  locale.getpreferredencoding(False) instead of locale.getpreferredencoding()
  in text mode if the encoding is not specified. Don't change temporary the
  locale encoding using locale.setlocale(), use the current locale encoding
  instead of the user preferred encoding.

Barry Warsaw's avatar
Barry Warsaw committed
5002 5003
- Issue #14673: Add Eric Snow's sys.implementation implementation.

5004 5005
- Issue #15038: Optimize python Locks on Windows.

5006 5007 5008
Library
-------

5009 5010
- Issue #12288: Consider '0' and '0.0' as valid initialvalue
  for tkinter SimpleDialog.
5011

5012 5013
- Issue #15512: Add a __sizeof__ implementation for parser.
  Patch by Serhiy Storchaka.
5014

5015 5016
- Issue #15469: Add a __sizeof__ implementation for deque objects.
  Patch by Serhiy Storchaka.
R David Murray's avatar
R David Murray committed
5017

5018 5019
- Issue #15489: Add a __sizeof__ implementation for BytesIO objects.
  Patch by Serhiy Storchaka.
5020

5021 5022
- Issue #15487: Add a __sizeof__ implementation for buffered I/O objects.
  Patch by Serhiy Storchaka.
5023

5024 5025 5026
- Issue #15514: Correct __sizeof__ support for cpu_set.
  Patch by Serhiy Storchaka.

5027 5028
- Issue #15177: Added dir_fd parameter to os.fwalk().

5029 5030 5031 5032
- Issue #15061: Re-implemented hmac.compare_digest() in C to prevent further
  timing analysis and to support all buffer protocol aware objects as well as
  ASCII only str instances safely.

5033 5034
- Issue #15164: Change return value of platform.uname() from a
  plain tuple to a collections.namedtuple.
5035

5036 5037 5038 5039
- Support Mageia Linux in the platform module.

- Issue #11678: Support Arch linux in the platform module.

5040 5041 5042 5043
- Issue #15118: Change return value of os.uname() and os.times() from
  plain tuples to immutable iterable objects with named attributes
  (structseq objects).

5044 5045 5046 5047
- Speed up _decimal by another 10-15% by caching the thread local context
  that was last accessed. In the pi benchmark (64-bit platform, prec=9),
  _decimal is now only 1.5x slower than float.

5048 5049
- Remove the packaging module, which is not ready for prime time.

5050 5051 5052
- Issue #15154: Add "dir_fd" parameter to os.rmdir, remove "rmdir"
  parameter from os.remove / os.unlink.

Hynek Schlawack's avatar
Hynek Schlawack committed
5053
- Issue #4489: Add a shutil.rmtree that isn't susceptible to symlink attacks.
5054 5055 5056
  It is used automatically on platforms supporting the necessary os.openat()
  and os.unlinkat() functions. Main code by Martin von Löwis.

5057 5058
- Issue #15156: HTMLParser now uses the new "html.entities.html5" dictionary.

5059 5060 5061 5062
- Issue #11113: add a new "html5" dictionary containing the named character
  references defined by the HTML5 standard and the equivalent Unicode
  character(s) to the html.entities module.

5063 5064 5065
- Issue #15114: the strict mode of HTMLParser and the HTMLParseError exception
  are deprecated now that the parser is able to parse invalid markup.

5066 5067 5068
- Issue #3665: \u and \U escapes are now supported in unicode regular
  expressions.  Patch by Serhiy Storchaka.

5069 5070 5071
- Issue #15153: Added inspect.getgeneratorlocals to simplify white box
  testing of generator state updates

5072 5073 5074 5075
- Issue #13062: Added inspect.getclosurevars to simplify testing stateful
  closures

- Issue #11024: Fixes and additional tests for Time2Internaldate.
5076

5077 5078
- Issue #14626: Large refactoring of functions / parameters in the os module.
  Many functions now support "dir_fd" and "follow_symlinks" parameters;
Ezio Melotti's avatar
Ezio Melotti committed
5079
  some also support accepting an open file descriptor in place of a path
5080 5081 5082 5083 5084
  string.  Added os.support_* collections as LBYL helpers.  Removed many
  functions only previously seen in 3.3 alpha releases (often starting with
  "f" or "l", or ending with "at").  Originally suggested by Serhiy Storchaka;
  implemented by Larry Hastings.

5085 5086 5087
- Issue #15008: Implement PEP 362 "Signature Objects".
  Patch by Yury Selivanov.

5088 5089
- Issue: #15138: base64.urlsafe_{en,de}code() are now 3-4x faster.

5090 5091 5092 5093
- Issue #444582: Add shutil.which, for finding programs on the system path.
  Original patch by Erik Demaine, with later iterations by Jan Killian
  and Brian Curtin.

5094 5095 5096 5097
- Issue #14837: SSL errors now have ``library`` and ``reason`` attributes
  describing precisely what happened and in which OpenSSL submodule.  The
  str() of a SSLError is also enhanced accordingly.

5098 5099 5100
- Issue #9527: datetime.astimezone() method will now supply a class
  timezone instance corresponding to the system local timezone when
  called with no arguments.
5101

5102 5103
- Issue #14653: email.utils.mktime_tz() no longer relies on system
  mktime() when timezone offest is supplied.
5104

5105 5106 5107
- Issue #14684: zlib.compressobj() and zlib.decompressobj() now support the use
  of predefined compression dictionaries. Original patch by Sam Rushing.

5108
- Fix GzipFile's handling of filenames given as bytes objects.
5109

5110 5111
- Issue #14772: Return destination values from some shutil functions.

5112 5113
- Issue #15064: Implement context manager protocol for multiprocessing types

5114
- Issue #15101: Make pool finalizer avoid joining current thread.
5115

5116 5117 5118
- Issue #14657: The frozen instance of importlib used for bootstrap is now
  also the module imported as importlib._bootstrap.

5119 5120
- Issue #14055: Add __sizeof__ support to _elementtree.

5121 5122 5123 5124
- Issue #15054: A bug in tokenize.tokenize that caused string literals
  with 'b' prefixes to be incorrectly tokenized has been fixed.
  Patch by Serhiy Storchaka.

5125 5126
- Issue #15006: Allow equality comparison between naive and aware
  time or datetime objects.
5127

Petri Lehtinen's avatar
Petri Lehtinen committed
5128 5129 5130
- Issue #15036: Mailbox no longer throws an error if a flush is done
  between operations when removing or changing multiple items in mbox,
  MMDF, or Babyl mailboxes.
5131

5132 5133
- Issue #14059: Implement multiprocessing.Barrier.

5134
- Issue #15061: The inappropriately named hmac.secure_compare has been
Nick Coghlan's avatar
Nick Coghlan committed
5135 5136
  renamed to hmac.compare_digest, restricted to operating on bytes inputs
  only and had its documentation updated to more accurately reflect both its
5137 5138
  intent and its limitations

5139 5140
- Issue #13841: Make child processes exit using sys.exit() on Windows.

5141
- Issue #14936: curses_panel was converted to PEP 3121 and PEP 384 API.
5142 5143
  Patch by Robin Schreiber.

5144 5145 5146 5147 5148
- Issue #1667546: On platforms supporting tm_zone and tm_gmtoff fields
  in struct tm, time.struct_time objects returned by time.gmtime(),
  time.localtime() and time.strptime() functions now have tm_zone and
  tm_gmtoff attributes.  Original patch by Paul Boddie.

5149 5150
- Rename adjusted attribute to adjustable in time.get_clock_info() result.

5151 5152 5153
- Issue #3518: Remove references to non-existent BaseManager.from_address()
  method.

5154 5155 5156
- Issue #13857: Added textwrap.indent() function (initial patch by Ezra
  Berch)

5157 5158
- Issue #2736: Added datetime.timestamp() method.

5159 5160
- Issue #13854: Make multiprocessing properly handle non-integer
  non-string argument to SystemExit.
5161

5162 5163
- Issue #12157: Make pool.map() empty iterables correctly.  Initial
  patch by mouad.
5164

5165 5166
- Issue #11823: disassembly now shows argument counts on calls with keyword args.

5167 5168
- Issue #14711: os.stat_float_times() has been deprecated.

5169 5170
- LZMAFile now accepts the modes "rb"/"wb"/"ab" as synonyms of "r"/"w"/"a".

5171 5172
- The bz2 and lzma modules now each contain an open() function, allowing
  compressed files to readily be opened in text mode as well as binary mode.
5173

5174 5175
- BZ2File.__init__() and LZMAFile.__init__() now accept a file object as their
  first argument, rather than requiring a separate "fileobj" argument.
5176

5177 5178
- gzip.open() now accepts file objects as well as filenames.

5179 5180 5181 5182 5183
- Issue #14992: os.makedirs(path, exist_ok=True) would raise an OSError
  when the path existed and had the S_ISGID mode bit set when it was
  not explicitly asked for.  This is no longer an exception as mkdir
  cannot control if the OS sets that bit for it or not.

5184 5185 5186
- Issue #14989: Make the CGI enable option to http.server available via command
  line.

5187 5188
- Issue #14987: Add a missing import statement to inspect.

5189 5190 5191 5192
- Issue #1079: email.header.decode_header now correctly parses all the examples
  in RFC2047.  There is a necessary visible behavior change: the leading and/or
  trailing whitespace on ASCII parts is now preserved.

5193 5194
- Issue #14969: Better handling of exception chaining in contextlib.ExitStack

5195 5196 5197
- Issue #14963: Convert contextlib.ExitStack.__exit__ to use an iterative
  algorithm (Patch by Alon Horev)

5198 5199 5200
- Issue #14785: Add sys._debugmallocstats() to help debug low-level memory
  allocation issues

5201 5202 5203
- Issue #14443: Ensure that .py files are byte-compiled with the correct Python
  executable within bdist_rpm even on older versions of RPM

5204 5205 5206
C-API
-----

5207 5208 5209 5210 5211
- Issue #15146: Add PyType_FromSpecWithBases. Patch by Robin Schreiber.

- Issue #15042: Add PyState_AddModule and PyState_RemoveModule. Add version
  guard for Py_LIMITED_API additions. Patch by Robin Schreiber.

5212 5213 5214
- Issue #13783: Inadvertent additions to the public C API in the PEP 380
  implementation have either been removed or marked as private interfaces.

5215 5216
Extension Modules
-----------------
5217

5218
- Issue #15000: Support the "unique" x32 architecture in _posixsubprocess.c.
5219

5220 5221 5222 5223 5224 5225 5226 5227 5228
IDLE
----

- Issue #9803: Don't close IDLE on saving if breakpoint is open.
  Patch by Roger Serwy.

- Issue #14962: Update text coloring in IDLE shell window after changing
  options.  Patch by Roger Serwy.

5229 5230 5231
Documentation
-------------

5232 5233 5234 5235 5236 5237 5238
- Issue #15176: Clarified behavior, documentation, and implementation
  of os.listdir().

- Issue #14982: Document that pkgutil's iteration functions require the
  non-standard iter_modules() method to be defined by an importer (something
  the importlib importers do not define).

5239 5240 5241
- Issue #15081: Document PyState_FindModule.
  Patch by Robin Schreiber.

5242 5243
- Issue #14814: Added first draft of ipaddress module API reference

5244 5245 5246
Tests
-----

5247 5248 5249
- Issue #15187: Bugfix: remove temporary directories test_shutil was leaving
  behind.

5250 5251 5252 5253
- Issue #14769: test_capi now has SkipitemTest, which cleverly checks
  for "parity" between PyArg_ParseTuple() and the Python/getargs.c static
  function skipitem() for all possible "format units".

5254 5255 5256
- test_nntplib now tolerates being run from behind NNTP gateways that add
  "X-Antivirus" headers to articles

5257 5258 5259 5260
- Issue #15043: test_gdb is now skipped entirely if gdb security settings
  block loading of the gdb hooks

- Issue #14963: Add test cases for exception handling behaviour
5261
  in contextlib.ExitStack (Initial patch by Alon Horev)
5262

5263 5264 5265
Build
-----

5266 5267 5268 5269 5270 5271 5272 5273 5274 5275 5276 5277 5278 5279 5280
- Issue #13590: Improve support for OS X Xcode 4:
    * Try to avoid building Python or extension modules with problematic
      llvm-gcc compiler.
    * Since Xcode 4 removes ppc support, extension module builds now
      check for ppc compiler support and automatically remove ppc and
      ppc64 archs when not available.
    * Since Xcode 4 no longer install SDKs in default locations,
      extension module builds now revert to using installed headers
      and libs if the SDK used to build the interpreter is not
      available.
    * Update ./configure to use better defaults for universal builds;
      in particular, --enable-universalsdk=yes uses the Xcode default
      SDK and --with-universal-archs now defaults to "intel" if ppc
      not available.

5281 5282
- Issue #14225: Fix Unicode support for curses (#12567) on OS X

5283 5284 5285
- Issue #14928: Fix importlib bootstrap issues by using a custom executable
  (Modules/_freeze_importlib) to build Python/importlib.h.

Georg Brandl's avatar
Georg Brandl committed
5286

5287 5288 5289
What's New in Python 3.3.0 Alpha 4?
===================================

Georg Brandl's avatar
Georg Brandl committed
5290
*Release date: 31-May-2012*
5291 5292 5293 5294

Core and Builtins
-----------------

5295 5296 5297
- Issue #14835: Make plistlib output empty arrays & dicts like OS X.
  Patch by Sidney San Martín.

5298 5299 5300
- Issue #14744: Use the new _PyUnicodeWriter internal API to speed up
  str%args and str.format(args).

5301 5302
- Issue #14930: Make memoryview objects weakrefable.

5303 5304 5305
- Issue #14775: Fix a potential quadratic dict build-up due to the garbage
  collector repeatedly trying to untrack dicts.

5306 5307 5308
- Issue #14857: fix regression in references to PEP 3135 implicit __class__
  closure variable (Reopens issue #12370)

Vinay Sajip's avatar
Vinay Sajip committed
5309 5310
- Issue #14712 (PEP 405): Virtual environments. Implemented by Vinay Sajip.

5311 5312
- Issue #14660 (PEP 420): Namespace packages. Implemented by Eric Smith.

5313 5314 5315 5316
- Issue #14494: Fix __future__.py and its documentation to note that
  absolute imports are the default behavior in 3.0 instead of 2.7.
  Patch by Sven Marnach.

5317 5318 5319 5320
- Issue #9260: A finer-grained import lock.  Most of the import sequence
  now uses per-module locks rather than the global import lock, eliminating
  well-known issues with threads and imports.

5321 5322 5323
- Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs.
  Patch by Serhiy Storchaka.

Martin v. Löwis's avatar
Martin v. Löwis committed
5324 5325
- asdl_seq and asdl_int_seq are now Py_ssize_t sized.

5326 5327 5328
- Issue #14133 (PEP 415): Implement suppression of __context__ display with an
  attribute on BaseException. This replaces the original mechanism of PEP 409.

5329 5330 5331
- Issue #14417: Mutating a dict during lookup now restarts the lookup instead
  of raising a RuntimeError (undoes issue #14205).

5332 5333 5334
- Issue #14738: Speed-up UTF-8 decoding on non-ASCII data.  Patch by Serhiy
  Storchaka.

5335 5336 5337
- Issue #14700: Fix two broken and undefined-behaviour-inducing overflow checks
  in old-style string formatting.

5338 5339 5340
Library
-------

5341 5342 5343
- Issue #14690: Use monotonic clock instead of system clock in the sched,
  subprocess and trace modules.

5344 5345 5346
- Issue #14443: Tell rpmbuild to use the correct version of Python in
  bdist_rpm. Initial patch by Ross Lagerwall.

5347 5348 5349 5350 5351 5352 5353
- Issue #12515: email now registers a defect if it gets to EOF while parsing
  a MIME part without seeing the closing MIME boundary.

- Issue #1672568: email now always decodes base64 payloads, adding padding and
  ignoring non-base64-alphabet characters if needed, and registering defects
  for any such problems.

5354 5355 5356 5357
- Issue #14925: email now registers a defect when the parser decides that there
  is a missing header/body separator line.  MalformedHeaderDefect, which the
  existing code would never actually generate, is deprecated.

5358 5359
- Issue #10365: File open dialog now works instead of crashing even when
  the parent window is closed before the dialog. Patch by Roger Serwy.
5360

5361 5362 5363
- Issue #8739: Updated smtpd to support RFC 5321, and added support for the
  RFC 1870 SIZE extension.

5364 5365 5366
- Issue #665194: Added a localtime function to email.utils to provide an
  aware local datetime for use in setting Date headers.

5367 5368 5369 5370 5371 5372 5373 5374
- Issue #12586: Added new provisional policies that implement convenient
  unicode support for email headers.  See What's New for details.

- Issue #14731: Refactored email Policy framework to support full backward
  compatibility with Python 3.2 by default yet allow for the introduction of
  new features through new policies.  Note that Policy.must_be_7bit is renamed
  to cte_type.

5375 5376
- Issue #14876: Use user-selected font for highlight configuration.

5377 5378 5379
- Issue #14920: Fix the help(urllib.parse) failure on locale C on terminals.
  Have ascii characters in help.

5380 5381 5382
- Issue #14548: Make multiprocessing finalizers check pid before
  running to cope with possibility of gc running just after fork.

5383 5384 5385
- Issue #14036: Add an additional check to validate that port in urlparse does
  not go in illegal range and returns None.

5386 5387
- Issue #14862: Add missing names to os.__all__

5388 5389
- Issue #14875: Use float('inf') instead of float('1e66666') in the json module.

5390 5391
- Issue #13585: Added contextlib.ExitStack

5392 5393
- PEP 3144, Issue #14814: Added the ipaddress module

Senthil Kumaran's avatar
Senthil Kumaran committed
5394 5395 5396
- Issue #14426: Correct the Date format in Expires attribute of Set-Cookie
  Header in Cookie.py.

5397 5398 5399 5400
- Issue #14588: The types module now provide new_class() and prepare_class()
  functions to support PEP 3115 compliant dynamic class creation. Patch by
  Daniel Urban and Nick Coghlan.

5401 5402 5403
- Issue #13152: Allow to specify a custom tabsize for expanding tabs in
  textwrap. Patch by John Feuerstein.

5404 5405 5406
- Issue #14721: Send the correct 'Content-length: 0' header when the body is an
  empty string ''. Initial Patch contributed by Arve Knudsen.

5407 5408 5409
- Issue #14072: Fix parsing of 'tel' URIs in urlparse by making the check for
  ports stricter.

5410 5411 5412
- Issue #9374: Generic parsing of query and fragment portions of url for any
  scheme. Supported both by RFC3986 and RFC2396.

5413 5414 5415 5416
- Issue #14798: Fix the functions in pyclbr to raise an ImportError
  when the first part of a dotted name is not a package. Patch by
  Xavier de Gaye.

5417 5418 5419 5420
- Issue #12098: multiprocessing on Windows now starts child processes
  using the same sys.flags as the current process.  Initial patch by
  Sergey Mezentsev.

5421 5422 5423
- Issue #13031: Small speed-up for tarfile when unzipping tarfiles.
  Patch by Justin Peel.

5424 5425 5426
- Issue #14780: urllib.request.urlopen() now has a ``cadefault`` argument
  to use the default certificate store.  Initial patch by James Oakley.

5427 5428 5429
- Issue #14829: Fix bisect and range() indexing with large indices
  (>= 2 ** 32) under 64-bit Windows.

5430 5431 5432
- Issue #14732: The _csv module now uses PEP 3121 module initialization.
  Patch by Robin Schreiber.

5433 5434 5435
- Issue #14809: Add HTTP status codes introduced by RFC 6585 to http.server
  and http.client. Patch by EungJun Yi.

Ned Deily's avatar
Ned Deily committed
5436 5437 5438 5439 5440
- Issue #14777: tkinter may return undecoded UTF-8 bytes as a string when
  accessing the Tk clipboard.  Modify clipboad_get() to first request type
  UTF8_STRING when no specific type is requested in an X11 windowing
  environment, falling back to the current default type STRING if that fails.
  Original patch by Thomas Kluyver.
5441

5442
- Issue #14773: Fix os.fwalk() failing on dangling symlinks.
5443

5444 5445 5446
- Issue #12541: Be lenient with quotes around Realm field of HTTP Basic
  Authentation in urllib2.

5447
- Issue #14807: move undocumented tarfile.filemode() to stat.filemode() and add
5448 5449
  doc entry. Add tarfile.filemode alias with deprecation warning.

5450 5451
- Issue #13815: TarFile.extractfile() now returns io.BufferedReader objects.

5452
- Issue #14532: Add a secure_compare() helper to the hmac module, to mitigate
5453
  timing attacks. Patch by Jon Oberheide.
5454

5455 5456
- Add importlib.util.resolve_name().

5457 5458 5459
- Issue #14366: Support lzma compression in zip files.
  Patch by Serhiy Storchaka.

5460 5461
- Issue #13959: Introduce importlib.find_loader() and document
  imp.find_module/load_module as deprecated.
5462

5463 5464 5465
- Issue #14082: shutil.copy2() now copies extended attributes, if possible.
  Patch by Hynek Schlawack.

Brett Cannon's avatar
Brett Cannon committed
5466 5467 5468 5469 5470
- Issue #13959: Make importlib.abc.FileLoader.load_module()/get_filename() and
  importlib.machinery.ExtensionFileLoader.load_module() have their single
  argument be optional. Allows for the replacement (and thus deprecation) of
  imp.load_source()/load_package()/load_compiled().

5471 5472 5473 5474 5475
- Issue #13959: imp.get_suffixes() has been deprecated in favour of the new
  attributes on importlib.machinery: SOURCE_SUFFIXES, DEBUG_BYTECODE_SUFFIXES,
  OPTIMIZED_BYTECODE_SUFFIXES, BYTECODE_SUFFIXES, and EXTENSION_SUFFIXES. This
  led to an indirect deprecation of inspect.getmoduleinfo().

5476 5477 5478
- Issue #14662: Prevent shutil failures on OS X when destination does not
  support chflag operations.  Patch by Hynek Schlawack.

5479 5480 5481
- Issue #14157: Fix time.strptime failing without a year on February 29th.
  Patch by Hynek Schlawack.

5482 5483 5484
- Issue #14753: Make multiprocessing's handling of negative timeouts
  the same as it was in Python 3.2.

5485 5486 5487
- Issue #14583: Fix importlib bug when a package's __init__.py would first
  import one of its modules then raise an error.

5488 5489
- Issue #14741: Fix missing support for Ellipsis ('...') in parser module.

5490 5491 5492
- Issue #14697: Fix missing support for set displays and set comprehensions in
  parser module.

5493 5494
- Issue #14701: Fix missing support for 'raise ... from' in parser module.

5495 5496 5497
- Add support for timeouts to the acquire() methods of
  multiprocessing's lock/semaphore/condition proxies.

5498 5499
- Issue #13989: Add support for text mode to gzip.open().

5500
- Issue #14127: The os.stat() result object now provides three additional
Georg Brandl's avatar
Georg Brandl committed
5501 5502 5503 5504
  fields: st_ctime_ns, st_mtime_ns, and st_atime_ns, providing those times as an
  integer with nanosecond resolution.  The functions os.utime(), os.lutimes(),
  and os.futimes() now accept a new parameter, ns, which accepts mtime and atime
  as integers with nanosecond resolution.
5505

Georg Brandl's avatar
Georg Brandl committed
5506 5507
- Issue #14127 and #10148: shutil.copystat now preserves exact mtime and atime
  on filesystems providing nanosecond resolution.
5508

5509 5510 5511 5512 5513 5514 5515 5516 5517 5518 5519 5520 5521 5522 5523
IDLE
----

- Issue #14958: Change IDLE systax highlighting to recognize all string and
  byte literals supported in Python 3.3.

- Issue #10997: Prevent a duplicate entry in IDLE's "Recent Files" menu.

- Issue #14929: Stop IDLE 3.x from closing on Unicode decode errors when
  grepping. Patch by Roger Serwy.

- Issue #12510: Attempting to get invalid tooltip no longer closes IDLE.
  Other tooltipss have been corrected or improved and the number of tests
  has been tripled. Original patch by Roger Serwy.

5524 5525 5526
Tools/Demos
-----------

5527
- Issue #14695: Bring Tools/parser/unparse.py support up to date with
5528 5529
  the Python 3.3 Grammar.

5530 5531 5532
Build
-----

Petri Lehtinen's avatar
Petri Lehtinen committed
5533 5534
- Issue #14472: Update .gitignore. Patch by Matej Cepl.

Martin v. Löwis's avatar
Martin v. Löwis committed
5535 5536
- Upgrade Windows library versions: bzip 1.0.6, OpenSSL 1.0.1c.

5537 5538 5539
- Issue #14693: Under non-Windows platforms, hashlib's fallback modules are
  always compiled, even if OpenSSL is present at build time.

5540 5541
- Issue #13210: Windows build now uses VS2010, ported from VS2008.

5542 5543 5544 5545 5546 5547 5548
C-API
-----

- Issue #14705: The PyArg_Parse() family of functions now support the 'p' format
  unit, which accepts a "boolean predicate" argument.  It converts any Python
  value into an integer--0 if it is "false", and 1 otherwise.

5549 5550 5551
Documentation
-------------

5552 5553 5554
- Issue #14863: Update the documentation of os.fdopen() to reflect the
  fact that it's only a thin wrapper around open() anymore.

5555 5556 5557
- Issue #14588: The language reference now accurately documents the Python 3
  class definition process. Patch by Nick Coghlan.

Brian Curtin's avatar
Brian Curtin committed
5558 5559
- Issue #14943: Correct a default argument value for winreg.OpenKey
  and correctly list the argument names in the function's explanation.
5560

Georg Brandl's avatar
Georg Brandl committed
5561

Georg Brandl's avatar
Georg Brandl committed
5562 5563 5564
What's New in Python 3.3.0 Alpha 3?
===================================

Georg Brandl's avatar
Georg Brandl committed
5565
*Release date: 01-May-2012*
Georg Brandl's avatar
Georg Brandl committed
5566 5567 5568 5569

Core and Builtins
-----------------

5570 5571
- Issue #14699: Fix calling the classmethod descriptor directly.

Georg Brandl's avatar
Georg Brandl committed
5572
- Issue #14433: Prevent msvcrt crash in interactive prompt when stdin is closed.
Georg Brandl's avatar
Georg Brandl committed
5573

Georg Brandl's avatar
Georg Brandl committed
5574 5575
- Issue #14521: Make result of float('nan') and float('-nan') more consistent
  across platforms.
5576

5577 5578
- Issue #14646: __import__() sets __loader__ if the loader did not.

5579 5580 5581
- Issue #14605: No longer have implicit entries in sys.meta_path. If
  sys.meta_path is found to be empty, raise ImportWarning.

5582
- Issue #14605: No longer have implicit entries in sys.path_hooks. If
5583 5584 5585
  sys.path_hooks is found to be empty, a warning will be raised. None is now
  inserted into sys.path_importer_cache if no finder was discovered. This also
  means imp.NullImporter is no longer implicitly used.
5586

5587 5588 5589 5590
- Issue #13903: Implement PEP 412. Individual dictionary instances can now share
  their keys with other dictionaries. Classes take advantage of this to share
  their instance dictionary keys for improved memory and performance.

5591 5592 5593 5594 5595 5596
- Issue #11603 (again): Setting __repr__ to __str__ now raises a RuntimeError
  when repr() or str() is called on such an object.

- Issue #14658: Fix binding a special method to a builtin implementation of a
  special method with a different name.

5597 5598 5599
- Issue #14630: Fix a memory access bug for instances of a subclass of int
  with value 0.

5600 5601 5602
- Issue #14339: Speed improvements to bin, oct and hex functions.  Patch by
  Serhiy Storchaka.

5603 5604 5605 5606 5607
- Issue #14385: It is now possible to use a custom type for the __builtins__
  namespace, instead of a dict. It can be used for sandboxing for example.
  Raise also a NameError instead of ImportError if __build_class__ name if not
  found in __builtins__.

5608 5609 5610 5611
- Issue #12599: Be more strict in accepting None compared to a false-like
  object for importlib.util.module_for_loader and
  importlib.machinery.PathFinder.

5612 5613
- Issue #14612: Fix jumping around with blocks by setting f_lineno.

5614 5615 5616
- Issue #14592: Attempting a relative import w/o __package__ or __name__ set in
  globals raises a KeyError.

Benjamin Peterson's avatar
improve  
Benjamin Peterson committed
5617
- Issue #14607: Fix keyword-only arguments which started with ``__``.
5618

5619 5620 5621 5622
- Issue #10854: The ImportError raised when an extension module on Windows
  fails to import now uses the new path and name attributes from
  Issue #1559549.

5623 5624 5625 5626
- Issue #13889: Check and (if necessary) set FPU control word before calling
  any of the dtoa.c string <-> float conversion functions, on MSVC builds of
  Python.  This fixes issues when embedding Python in a Delphi app.

5627 5628 5629
- __import__() now matches PEP 328 and documentation by defaulting 'index' to 0
  instead of -1 and removing support for negative values.

5630 5631
- Issue #2377: Make importlib the implementation of __import__().

5632 5633 5634 5635
- Issue #1559549: ImportError now has 'name' and 'path' attributes that are set
  using keyword arguments to its constructor. They are currently not set by
  import as they are meant for use by importlib.

5636 5637 5638
- Issue #14474: Save and restore exception state in thread.start_new_thread()
  while writing error message if the thread leaves a unhandled exception.

5639 5640 5641
- Issue #13019: Fix potential reference leaks in bytearray.extend().  Patch
  by Suman Saha.

Georg Brandl's avatar
Georg Brandl committed
5642 5643 5644
Library
-------

5645
- Issue #14768: os.path.expanduser('~/a') doesn't works correctly when HOME is '/'.
5646

Georg Brandl's avatar
Georg Brandl committed
5647
- Issue #14371: Support bzip2 in zipfile module.  Patch by Serhiy Storchaka.
5648

5649 5650 5651
- Issue #13183: Fix pdb skipping frames after hitting a breakpoint and running
  step.  Patch by Xavier de Gaye.

5652 5653
- Issue #14696: Fix parser module to understand 'nonlocal' declarations.

5654 5655 5656
- Issue #10941: Fix imaplib.Internaldate2tuple to produce correct result near
  the DST transition.  Patch by Joe Peterson.

5657
- Issue #9154: Fix parser module to understand function annotations.
5658

5659 5660 5661
- Issue #6085: In http.server.py SimpleHTTPServer.address_string returns the
  client ip address instead client hostname. Patch by Charles-François Natali.

5662 5663 5664
- Issue #14309: Deprecate time.clock(), use time.perf_counter() or
  time.process_time() instead.

5665 5666 5667 5668
- Issue #14428: Implement the PEP 418. Add time.get_clock_info(),
  time.perf_counter() and time.process_time() functions, and rename
  time.steady() to time.monotonic().

5669 5670 5671
- Issue #14646: importlib.util.module_for_loader() now sets __loader__ and
  __package__ (when possible).

5672 5673 5674
- Issue #14664: It is now possible to use @unittest.skip{If,Unless} on a
  test class that doesn't inherit from TestCase (i.e. a mixin).

5675 5676 5677
- Issue #4892: multiprocessing Connections can now be transferred over
  multiprocessing Connections.  Patch by Richard Oudkerk (sbt).

5678 5679 5680
- Issue #14160: TarFile.extractfile() failed to resolve symbolic links when
  the links were not located in an archive subdirectory.

5681 5682 5683
- Issue #14638: pydoc now treats non-string __name__ values as if they
  were missing, instead of raising an error.

Senthil Kumaran's avatar
Senthil Kumaran committed
5684 5685 5686
- Issue #13684: Fix httplib tunnel issue of infinite loops for certain sites
  which send EOF without trailing \r\n.

5687
- Issue #14605: Add importlib.abc.FileLoader, importlib.machinery.(FileFinder,
5688
  SourceFileLoader, SourcelessFileLoader, ExtensionFileLoader).
5689

5690 5691 5692 5693 5694
- Issue #13959: imp.cache_from_source()/source_from_cache() now follow
  os.path.join()/split() semantics for path manipulation instead of its prior,
  custom semantics of caring the right-most path separator forward in path
  joining.

5695 5696
- Issue #2193: Allow ":" character in Cookie NAME values.

5697 5698 5699
- Issue #14629: tokenizer.detect_encoding will specify the filename in the
  SyntaxError exception if found at readline.__self__.name.

5700 5701 5702
- Issue #14629: Raise SyntaxError in tokenizer.detect_encoding if the
  first two lines have non-UTF-8 characters without an encoding declaration.

5703 5704 5705
- Issue #14308: Fix an exception when a "dummy" thread is in the threading
  module's active list after a fork().

5706 5707 5708 5709
- Issue #11750: The Windows API functions scattered in the _subprocess and
  _multiprocessing.win32 modules now live in a single module "_winapi".
  Patch by sbt.

5710 5711
- Issue #14087: multiprocessing: add Condition.wait_for(). Patch by sbt.

5712 5713 5714
- Issue #14538: HTMLParser can now parse correctly start tags that contain
  a bare '/'.

5715 5716
- Issue #14452: SysLogHandler no longer inserts a UTF-8 BOM into the message.

5717 5718
- Issue #14386: Expose the dict_proxy internal type as types.MappingProxyType.

5719 5720 5721
- Issue #13959: Make imp.reload() always use a module's __loader__ to perform
  the reload.

5722 5723 5724
- Issue #13959: Add imp.py and rename the built-in module to _imp, allowing for
  re-implementing parts of the module in pure Python.

5725 5726 5727
- Issue #13496: Fix potential overflow in bisect.bisect algorithm when applied
  to a collection of size > sys.maxsize / 2.

5728 5729 5730
- Have importlib take advantage of ImportError's new 'name' and 'path'
  attributes.

R David Murray's avatar
R David Murray committed
5731 5732
- Issue #14399: zipfile now recognizes that the archive has been modified even
  if only the comment is changed.  In addition, the TypeError that results from
Ezio Melotti's avatar
Ezio Melotti committed
5733
  trying to set a non-binary value as a comment is now raised at the time
R David Murray's avatar
R David Murray committed
5734
  the comment is set rather than at the time the zipfile is written.
5735

5736 5737 5738 5739
- trace.CoverageResults.is_ignored_filename() now ignores any name that starts
  with "<" and ends with ">" instead of special-casing "<string>" and
  "<doctest ".

5740 5741 5742
- Issue #12537: The mailbox module no longer depends on knowledge of internal
  implementation details of the email package Message object.

5743 5744 5745 5746
- Issue #7978: socketserver now restarts the select() call when EINTR is
  returned.  This avoids crashing the server loop when a signal is received.
  Patch by Jerzy Kozera.

5747 5748 5749
- Issue #14522: Avoid duplicating socket handles in multiprocessing.connection.
  Patch by sbt.

5750 5751
- Don't Py_DECREF NULL variable in io.IncrementalNewlineDecoder.

5752 5753
- Issue #3033: Add displayof parameter to tkinter font. Patch by Guilherme Polo.

5754 5755 5756 5757
- Issue #14482: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_UNIX type address under
  Windows.  Patch by Popa Claudiu.

5758 5759
- Issue #802310: Generate always unique tkinter font names if not directly passed.

Georg Brandl's avatar
Merge.  
Georg Brandl committed
5760 5761 5762 5763
- Issue #14151: Raise a ValueError, not a NameError, when trying to create
  a multiprocessing Client or Listener with an AF_PIPE type address under
  non-Windows platforms.  Patch by Popa Claudiu.

5764
- Issue #14493: Use gvfs-open or xdg-open in webbrowser.
5765

5766 5767 5768 5769 5770 5771
Build
-----

- "make touch" will now touch generated files that are checked into Mercurial,
  after a "hg update" which failed to bring the timestamps into the right order.

5772 5773 5774
Tests
-----

Nick Coghlan's avatar
Nick Coghlan committed
5775 5776 5777
- Issue #14026: In test_cmd_line_script, check that sys.argv is populated
  correctly for the various invocation approaches (Patch by Jason Yeo)

Nick Coghlan's avatar
Nick Coghlan committed
5778 5779 5780
- Issue #14032: Fix incorrect variable name in test_cmd_line_script debugging
  message (Patch by Jason Yeo)

5781 5782 5783
- Issue #14589: Update certificate chain for sha256.tbs-internet.com, fixing
  a test failure in test_ssl.

5784 5785 5786
- Issue #14355: Regrtest now supports the standard unittest test loading, and
  will use it if a test file contains no `test_main` method.

5787 5788 5789 5790 5791 5792 5793 5794 5795
IDLE
----

- Issue #8515: Set __file__ when run file in IDLE.
  Initial patch by Bruce Frederiksen.

- Issue #14496: Fix wrong name in idlelib/tabbedpages.py.
  Patch by Popa Claudiu.

5796 5797 5798
Tools / Demos
-------------

5799 5800 5801
- Issue #3561: The Windows installer now has an option, off by default, for
  placing the Python installation into the system "Path" environment variable.

5802 5803 5804
- Issue #13165: stringbench is now available in the Tools/stringbench folder.
  It used to live in its own SVN project.

5805 5806 5807 5808 5809 5810
C-API
-----

- Issue #14098: New functions PyErr_GetExcInfo and PyErr_SetExcInfo.
  Patch by Stefan Behnel.

Georg Brandl's avatar
Georg Brandl committed
5811

Georg Brandl's avatar
Georg Brandl committed
5812 5813 5814
What's New in Python 3.3.0 Alpha 2?
===================================

Georg Brandl's avatar
Georg Brandl committed
5815
*Release date: 01-Apr-2012*
Georg Brandl's avatar
Georg Brandl committed
5816 5817 5818 5819

Core and Builtins
-----------------

5820 5821 5822
- Issue #1683368: object.__new__ and object.__init__ raise a TypeError if they
  are passed arguments and their complementary method is not overridden.

5823 5824 5825
- Issue #14378: Fix compiling ast.ImportFrom nodes with a "__future__" string as
  the module name that was not interned.

5826 5827
- Issue #14331: Use significantly less stack space when importing modules by
  allocating path buffers on the heap instead of the stack.
5828

5829 5830 5831
- Issue #14334: Prevent in a segfault in type.__getattribute__ when it was not
  passed strings.

5832 5833 5834
- Issue #1469629: Allow cycles through an object's __dict__ slot to be
  collected. (For example if ``x.__dict__ is x``).

5835 5836 5837
- Issue #14205: dict lookup raises a RuntimeError if the dict is modified
  during a lookup.

5838 5839 5840
- Issue #14220: When a generator is delegating to another iterator with the
  yield from syntax, it needs to have its ``gi_running`` flag set to True.

5841 5842 5843
- Issue #14435: Remove dedicated block allocator from floatobject.c and rely
  on the PyObject_Malloc() api like all other objects.

5844 5845
- Issue #14471: Fix a possible buffer overrun in the winreg module.

5846 5847
- Issue #14288: Allow the serialization of builtin iterators

Georg Brandl's avatar
Georg Brandl committed
5848 5849 5850
Library
-------

5851 5852 5853
- Issue #14300: Under Windows, sockets created using socket.dup() now allow
  overlapped I/O.  Patch by sbt.

5854 5855 5856
- Issue #13872: socket.detach() now marks the socket closed (as mirrored
  in the socket repr()).  Patch by Matt Joiner.

5857 5858 5859
- Issue #14406: Fix a race condition when using ``concurrent.futures.wait(
  return_when=ALL_COMPLETED)``.  Patch by Matt Joiner.

Andrew Svetlov's avatar
Andrew Svetlov committed
5860
- Issue #5136: deprecate old, unused functions from tkinter.
5861

5862 5863 5864
- Issue #14416: syslog now defines the LOG_ODELAY and LOG_AUTHPRIV constants
  if they are defined in <syslog.h>.

5865 5866
- Issue #14295: Add unittest.mock

5867 5868 5869
- Issue #7652: Add --with-system-libmpdec option to configure for linking
  the _decimal module against an installed libmpdec.

5870 5871 5872
- Issue #14380: MIMEText now defaults to utf-8 when passed non-ASCII unicode
  with no charset specified.

5873 5874 5875 5876
- Issue #10340: asyncore - properly handle EINVAL in dispatcher constructor on
  OSX; avoid to call handle_connect in case of a disconnected socket which
  was not meant to connect.

5877 5878 5879 5880
- Issue #14204: The ssl module now has support for the Next Protocol
  Negotiation extension, if available in the underlying OpenSSL library.
  Patch by Colin Marc.

Georg Brandl's avatar
Georg Brandl committed
5881
- Issue #3035: Unused functions from tkinter are marked as pending deprecated.
5882

5883 5884 5885
- Issue #12757: Fix the skipping of doctests when python is run with -OO so
  that it works in unittest's verbose mode as well as non-verbose mode.

5886 5887
- Issue #7652: Integrate the decimal floating point libmpdec library to speed
  up the decimal module. Performance gains of the new C implementation are
5888
  between 10x and 100x, depending on the application.
5889

5890 5891 5892
- Issue #14269: SMTPD now conforms to the RFC and requires a HELO command
  before MAIL, RCPT, or DATA.

5893 5894 5895
- Issue #13694: asynchronous connect in asyncore.dispatcher does not set addr
  attribute.

5896 5897
- Issue #14344: fixed the repr of email.policy objects.

R David Murray's avatar
R David Murray committed
5898 5899 5900
- Issue #11686: Added missing entries to email package __all__ lists
  (mostly the new Bytes classes).

5901 5902 5903
- Issue #14335: multiprocessing's custom Pickler subclass now inherits from
  the C-accelerated implementation.  Patch by sbt.

5904 5905
- Issue #10484: Fix the CGIHTTPServer's PATH_INFO handling problem.

5906 5907
- Issue #11199: Fix the with urllib which hangs on particular ftp urls.

5908 5909
- Improve the memory utilization and speed of functools.lru_cache.

5910 5911 5912 5913
- Issue #14222: Use the new time.steady() function instead of time.time() for
  timeout in queue and threading modules to not be affected of system time
  update.

5914 5915
- Issue #13248: Remove lib2to3.pytree.Base.get_prefix/set_prefix.

5916 5917 5918 5919 5920
- Issue #14234: CVE-2012-0876: Randomize hashes of xml attributes in the hash
  table internal to the pyexpat module's copy of the expat library to avoid a
  denial of service due to hash collisions.  Patch by David Malcolm with some
  modifications by the expat project.

5921 5922 5923
- Issue #12818: format address no longer needlessly \ escapes ()s in names when
  the name ends up being quoted.

5924 5925 5926
- Issue #14062: BytesGenerator now correctly folds Header objects,
  including using linesep when folding.

5927 5928 5929 5930
- Issue #13839: When invoked on the command-line, the pstats module now
  accepts several filenames of profile stat files and merges them all.
  Patch by Matt Joiner.

5931 5932 5933
- Issue #14291: Email now defaults to utf-8 for non-ASCII unicode headers
  instead of raising an error.  This fixes a regression relative to 2.7.

5934 5935
- Issue #989712: Support using Tk without a mainloop.

5936 5937
- Issue #3835: Refuse to use unthreaded Tcl in threaded Python.

5938 5939
- Issue #2843: Add new Tk API to Tkinter.

5940 5941 5942
- Issue #14184: Increase the default stack size for secondary threads on
  Mac OS X to avoid interpreter crashes when using threads on 10.7.

5943 5944 5945 5946
- Issue #14180: datetime.date.fromtimestamp(),
  datetime.datetime.fromtimestamp() and datetime.datetime.utcfromtimestamp()
  now raise an OSError instead of ValueError if localtime() or gmtime() failed.

5947 5948 5949 5950 5951 5952 5953 5954 5955
- Issue #14180: time.ctime(), gmtime(), time.localtime(),
  datetime.date.fromtimestamp(), datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now raises an OverflowError, instead of
  a ValueError, if the timestamp does not fit in time_t.

- Issue #14180: datetime.datetime.fromtimestamp() and
  datetime.datetime.utcfromtimestamp() now round microseconds towards zero
  instead of rounding to nearest with ties going away from zero.

5956 5957
- Issue #10543: Fix unittest test discovery with Jython bytecode files.

5958 5959 5960 5961
- Issue #1178863: Separate initialisation from setting when initializing
  Tkinter.Variables; harmonize exceptions to ValueError; only delete variables
  that have not been deleted; assert that variable names are strings.

5962 5963 5964
- Issue #14104: Implement time.monotonic() on Mac OS X, patch written by
  Nicholas Riley.

5965 5966
- Issue #13394: the aifc module now uses warnings.warn() to signal warnings.

5967 5968 5969
- Issue #14252: Fix subprocess.Popen.terminate() to not raise an error under
  Windows when the child process has already exited.

5970 5971 5972 5973
- Issue #14223: curses.addch() is no more limited to the range 0-255 when the
  Python curses is not linked to libncursesw. It was a regression introduced
  in Python 3.3a1.

5974
- Issue #14168: Check for presence of Element._attrs in minidom before
5975 5976
  accessing it.

5977 5978 5979 5980
- Issue #12328: Fix multiprocessing's use of overlapped I/O on Windows.
  Also, add a multiprocessing.connection.wait(rlist, timeout=None) function
  for polling multiple objects at once.  Patch by sbt.

5981 5982 5983 5984
- Issue #14007: Accept incomplete TreeBuilder objects (missing start, end,
  data or close method) for the Python implementation as well.
  Drop the no-op TreeBuilder().xml() method from the C implementation.

5985 5986 5987
- Issue #14210: pdb now has tab-completion not only for command names, but
  also for their arguments, wherever possible.

5988 5989 5990
- Issue #14310: Sockets can now be with other processes on Windows using
  the api socket.socket.share() and socket.fromshare().

5991 5992 5993
- Issue #10576: The gc module now has a 'callbacks' member that will get
  called when garbage collection takes place.

5994 5995 5996
Build
-----

5997 5998
- Issue #14557: Fix extensions build on HP-UX. Patch by Adi Roiban.

5999 6000
- Issue #14387: Do not include accu.h from Python.h.

6001 6002 6003
- Issue #14359: Only use O_CLOEXEC in _posixmodule.c if it is defined.
  Based on patch from Hervé Coatanhay.

6004
- Issue #14321: Do not run pgen during the build if files are up to date.
6005

6006 6007 6008 6009 6010
Documentation
-------------

- Issue #14034: added the argparse tutorial.

6011 6012
- Issue #14324: Fix configure tests for cross builds.

6013
- Issue #14327: Call AC_CANONICAL_HOST in configure.ac and check in
6014
  config.{guess,sub}. Don't use uname calls for cross builds.
6015

Benjamin Peterson's avatar
Benjamin Peterson committed
6016 6017 6018
Extension Modules
-----------------

6019 6020 6021
- Issue #9041: An issue in ctypes.c_longdouble, ctypes.c_double, and
  ctypes.c_float that caused an incorrect exception to be returned in the
  case of overflow has been fixed.
6022

Benjamin Peterson's avatar
Benjamin Peterson committed
6023 6024 6025
- Issue #14212: The re module didn't retain a reference to buffers it was
  scanning, resulting in segfaults.

6026 6027 6028
- Issue #14259: The finditer() method of re objects did not take any
  keyword arguments, contrary to the documentation.

6029 6030
- Issue #10142: Support for SEEK_HOLE/SEEK_DATA (for example, under ZFS).

6031 6032 6033
Tests
-----

6034 6035
- Issue #14442: Add missing errno import in test_smtplib.

6036 6037
- Issue #8315: (partial fix) python -m unittest test.test_email now works.

Georg Brandl's avatar
Georg Brandl committed
6038

Georg Brandl's avatar
Georg Brandl committed
6039 6040
What's New in Python 3.3.0 Alpha 1?
===================================
Georg Brandl's avatar
Georg Brandl committed
6041

Georg Brandl's avatar
Georg Brandl committed
6042
*Release date: 05-Mar-2012*
Georg Brandl's avatar
Georg Brandl committed
6043

6044 6045 6046
Core and Builtins
-----------------

6047 6048 6049
- Issue #14172: Fix reference leak when marshalling a buffer-like object
  (other than a bytes object).

6050 6051 6052
- Issue #13521: dict.setdefault() now does only one lookup for the given key,
  making it "atomic" for many purposes.  Patch by Filip Gruszczyński.

6053 6054 6055 6056
- PEP 409, Issue #6210: "raise X from None" is now supported as a means of
  suppressing the display of the chained exception context. The chained
  context still remains available as the __context__ attribute.

6057 6058 6059 6060 6061 6062 6063 6064 6065 6066 6067 6068 6069 6070 6071 6072 6073
- Issue #10181: New memoryview implementation fixes multiple ownership
  and lifetime issues of dynamically allocated Py_buffer members (#9990)
  as well as crashes (#8305, #7433). Many new features have been added
  (See whatsnew/3.3), and the documentation has been updated extensively.
  The ndarray test object from _testbuffer.c implements all aspects of
  PEP-3118, so further development towards the complete implementation
  of the PEP can proceed in a test-driven manner.

  Thanks to Nick Coghlan, Antoine Pitrou and Pauli Virtanen for review
  and many ideas.

- Issue #12834: Fix incorrect results of memoryview.tobytes() for
  non-contiguous arrays.

- Issue #5231: Introduce memoryview.cast() method that allows changing
  format and shape without making a copy of the underlying memory.

6074 6075 6076
- Issue #14084: Fix a file descriptor leak when importing a module with a
  bad encoding.

Benjamin Peterson's avatar
Benjamin Peterson committed
6077 6078
- Upgrade Unicode data to Unicode 6.1.

6079 6080 6081
- Issue #14040: Remove rarely used file name suffixes for C extensions
  (under POSIX mainly).

6082 6083 6084
- Issue #14051: Allow arbitrary attributes to be set of classmethod and
  staticmethod.

6085 6086 6087
- Issue #13703: oCERT-2011-003: Randomize hashes of str and bytes to protect
  against denial of service attacks due to hash collisions within the dict and
  set types.  Patch by David Malcolm, based on work by Victor Stinner.
6088

6089 6090 6091
- Issue #13020: Fix a reference leak when allocating a structsequence object
  fails.  Patch by Suman Saha.

6092 6093
- Issue #13908: Ready types returned from PyType_FromSpec.

6094 6095 6096
- Issue #11235: Fix OverflowError when trying to import a source file whose
  modification time doesn't fit in a 32-bit timestamp.

6097 6098 6099
- Issue #12705: A SyntaxError exception is now raised when attempting to
  compile multiple statements as a single interactive statement.

6100 6101 6102
- Fix the builtin module initialization code to store the init function for
  future reinitialization.

6103 6104 6105 6106 6107
- Issue #8052: The posix subprocess module would take a long time closing
  all possible file descriptors in the child process rather than just open
  file descriptors.  It now closes only the open fds if possible for the
  default close_fds=True behavior.

6108 6109 6110
- Issue #13629: Renumber the tokens in token.h so that they match the indexes
  into _PyParser_TokenNames.

6111 6112
- Issue #13752: Add a casefold() method to str.

6113 6114 6115
- Issue #13761: Add a "flush" keyword argument to the print() function,
  used to ensure flushing the output stream.

6116 6117 6118 6119
- Issue #13645: pyc files now contain the size of the corresponding source
  code, to avoid timestamp collisions (especially on filesystems with a low
  timestamp resolution) when checking for freshness of the bytecode.

6120 6121 6122 6123
- PEP 380, Issue #11682: Add "yield from <x>" to support easy delegation to
  subgenerators (initial patch by Greg Ewing, integration into 3.3 by
  Renaud Blanch, Ryan Kelly, Zbigniew Jędrzejewski-Szmek and Nick Coghlan)

6124 6125 6126
- Issue #13748: Raw bytes literals can now be written with the ``rb`` prefix
  as well as ``br``.

6127 6128
- Issue #12736: Use full unicode case mappings for upper, lower, and title case.

6129 6130
- Issue #12760: Add a create mode to open(). Patch by David Townshend.

6131 6132
- Issue #13738: Simplify implementation of bytes.lower() and bytes.upper().

6133 6134 6135
- Issue #13577: Built-in methods and functions now have a __qualname__.
  Patch by sbt.

6136 6137 6138
- Issue #6695: Full garbage collection runs now clear the freelist of set
  objects.  Initial patch by Matthias Troffaes.

6139 6140 6141
- Fix OSError.__init__ and OSError.__new__ so that each of them can be
  overriden and take additional arguments (followup to issue #12555).

6142 6143 6144 6145
- Fix the fix for issue #12149: it was incorrect, although it had the side
  effect of appearing to resolve the issue.  Thanks to Mark Shannon for
  noticing.

6146 6147 6148
- Issue #13505: Pickle bytes objects in a way that is compatible with
  Python 2 when using protocols <= 2.

6149 6150 6151
- Issue #11147: Fix an unused argument in _Py_ANNOTATE_MEMORY_ORDER.  (Fix
  given by Campbell Barton).

6152 6153 6154 6155
- Issue #13503: Use a more efficient reduction format for bytearrays with
  pickle protocol >= 3.  The old reduction format is kept with older protocols
  in order to allow unpickling under Python 2.  Patch by Irmen de Jong.

6156 6157 6158 6159
- Issue #7111: Python can now be run without a stdin, stdout or stderr
  stream.  It was already the case with Python 2.  However, the corresponding
  sys module entries are now set to None (instead of an unusable file object).

6160 6161 6162 6163
- Issue #11849: Ensure that free()d memory arenas are really released
  on POSIX systems supporting anonymous memory mappings.  Patch by
  Charles-François Natali.

6164 6165
- PEP 3155 / issue #13448: Qualified name for classes and functions.

6166 6167 6168
- Issue #13436: Fix a bogus error message when an AST object was passed
  an invalid integer value.

6169 6170 6171
- Issue #13411: memoryview objects are now hashable when the underlying
  object is hashable.

6172 6173 6174 6175
- Issue #13338: Handle all enumerations in _Py_ANNOTATE_MEMORY_ORDER
  to allow compiling extension modules with -Wswitch-enum on gcc.
  Initial patch by Floris Bruynooghe.

6176 6177 6178
- Issue #10227: Add an allocation cache for a single slice object.  Patch by
  Stefan Behnel.

6179 6180 6181
- Issue #13393: BufferedReader.read1() now asks the full requested size to
  the raw stream instead of limiting itself to the buffer size.

6182 6183
- Issue #13392: Writing a pyc file should now be atomic under Windows as well.

6184 6185 6186
- Issue #13333: The UTF-7 decoder now accepts lone surrogates (the encoder
  already accepts them).

6187 6188 6189 6190
- Issue #13389: Full garbage collection passes now clear the freelists for
  list and dict objects.  They already cleared other freelists in the
  interpreter.

6191
- Issue #13327: Remove the need for an explicit None as the second argument
Brian Curtin's avatar
Brian Curtin committed
6192 6193 6194
  to os.utime, os.lutimes, os.futimes, os.futimens, os.futimesat, in
  order to update to the current time. Also added keyword argument
  handling to os.utimensat in order to remove the need for explicit None.
6195

6196 6197 6198
- Issue #13350: Simplify some C code by replacing most usages of
  PyUnicode_Format by PyUnicode_FromFormat.

6199 6200 6201
- Issue #13342: input() used to ignore sys.stdin's and sys.stdout's unicode
  error handler in interactive mode (when calling into PyOS_Readline()).

6202 6203
- Issue #9896: Add start, stop, and step attributes to range objects.

6204
- Issue #13343: Fix a SystemError when a lambda expression uses a global
Georg Brandl's avatar
Georg Brandl committed
6205 6206
  variable in the default value of a keyword-only argument: ``lambda *,
  arg=GLOBAL_NAME: None``
6207

6208 6209 6210
- Issue #12797: Added custom opener parameter to builtin open() and
  FileIO.open().

6211 6212 6213
- Issue #10519: Avoid unnecessary recursive function calls in
  setobject.c.

6214 6215
- Issue #10363: Deallocate global locks in Py_Finalize().

6216 6217 6218
- Issue #13018: Fix reference leaks in error paths in dictobject.c.
  Patch by Suman Saha.

6219 6220 6221 6222
- Issue #13201: Define '==' and '!=' to compare range objects based on
  the sequence of values they define (instead of comparing based on
  object identity).

6223 6224 6225 6226
- Issue #1294232: In a few cases involving metaclass inheritance, the
  interpreter would sometimes invoke the wrong metaclass when building a new
  class object. These cases now behave correctly. Patch by Daniel Urban.

6227
- Issue #12753: Add support for Unicode name aliases and named sequences.
Georg Brandl's avatar
Georg Brandl committed
6228 6229
  Both ``unicodedata.lookup()`` and '\N{...}' now resolve aliases,
  and ``unicodedata.lookup()`` resolves named sequences too.
6230

6231 6232 6233 6234
- Issue #12170: The count(), find(), rfind(), index() and rindex() methods
  of bytes and bytearray objects now accept an integer between 0 and 255
  as their first argument.  Patch by Petri Lehtinen.

6235 6236 6237
- Issue #12604: VTRACE macro expanded to no-op in _sre.c to avoid compiler
  warnings. Patch by Josh Triplett and Petri Lehtinen.

6238 6239 6240 6241
- Issue #12281: Rewrite the MBCS codec to handle correctly replace and ignore
  error handlers on all Windows versions. The MBCS codec is now supporting all
  error handlers, instead of only replace to encode and ignore to decode.

6242 6243 6244 6245
- Issue #13188: When called without an explicit traceback argument,
  generator.throw() now gets the traceback from the passed exception's
  ``__traceback__`` attribute.  Patch by Petri Lehtinen.

6246 6247
- Issue #13146: Writing a pyc file is now atomic under POSIX.

6248 6249 6250 6251
- Issue #7833: Extension modules built using distutils on Windows will no
  longer include a "manifest" to prevent them failing at import time in some
  embedded situations.

6252 6253
- PEP 3151 / issue #12555: reworking the OS and IO exception hierarchy.

6254
- Add internal API for static strings (_Py_identifier et al.).
6255

6256 6257 6258 6259
- Issue #13063: the Windows error ERROR_NO_DATA (numbered 232 and described
  as "The pipe is being closed") is now mapped to POSIX errno EPIPE
  (previously EINVAL).

6260 6261 6262
- Issue #12911: Fix memory consumption when calculating the repr() of huge
  tuples or lists.

Martin v. Löwis's avatar
Martin v. Löwis committed
6263 6264
- PEP 393: flexible string representation. Thanks to Torsten Becker for the
  initial implementation, and Victor Stinner for various bug fixes.
Martin v. Löwis's avatar
Martin v. Löwis committed
6265

6266 6267 6268
- Issue #14081: The 'sep' and 'maxsplit' parameter to str.split, bytes.split,
  and bytearray.split may now be passed as keyword arguments.

6269 6270 6271 6272
- Issue #13012: The 'keepends' parameter to str.splitlines may now be passed
  as a keyword argument:  "my_string.splitlines(keepends=True)".  The same
  change also applies to bytes.splitlines and bytearray.splitlines.

6273 6274 6275 6276
- Issue #7732: Don't open a directory as a file anymore while importing a
  module. Ignore the direcotry if its name matchs the module name (e.g.
  "__init__.py") and raise a ImportError instead.

6277 6278 6279
- Issue #13021: Missing decref on an error path.  Thanks to Suman Saha for
  finding the bug and providing a patch.

6280 6281 6282
- Issue #12973: Fix overflow checks that relied on undefined behaviour in
  list_repeat (listobject.c) and islice_next (itertoolsmodule.c).  These bugs
  caused test failures with recent versions of Clang.
6283

6284 6285 6286
- Issue #12904: os.utime, os.futimes, os.lutimes, and os.futimesat now write
  atime and mtime with nanosecond precision on modern POSIX platforms.

6287 6288 6289
- Issue #12802: the Windows error ERROR_DIRECTORY (numbered 267) is now
  mapped to POSIX errno ENOTDIR (previously EINVAL).

6290 6291 6292
- Issue #9200: The str.is* methods now work with strings that contain non-BMP
  characters even in narrow Unicode builds.

6293 6294 6295
- Issue #12791: Break reference cycles early when a generator exits with
  an exception.

6296 6297
- Issue #12773: Make __doc__ mutable on user-defined classes.

6298
- Issue #12766: Raise a ValueError when creating a class with a class variable
6299 6300
  that conflicts with a name in __slots__.

6301 6302 6303
- Issue #12266: Fix str.capitalize() to correctly uppercase/lowercase
  titlecased and cased non-letter characters.

6304 6305 6306
- Issue #12732: In narrow unicode builds, allow Unicode identifiers which fall
  outside the BMP.

6307 6308
- Issue #12575: Validate user-generated AST before it is compiled.

6309 6310
- Make type(None), type(Ellipsis), and type(NotImplemented) callable. They
  return the respective singleton instances.
6311

Benjamin Peterson's avatar
Benjamin Peterson committed
6312
- Forbid summing bytes with sum().
6313

6314 6315 6316
- Verify the types of AST strings and identifiers provided by the user before
  compiling them.

6317 6318 6319 6320
- Issue #12647: The None object now has a __bool__() method that returns False.
  Formerly, bool(None) returned False only because of special case logic
  in PyObject_IsTrue().

6321 6322 6323 6324
- Issue #12579: str.format_map() now raises a ValueError if used on a
  format string that contains positional fields. Initial patch by
  Julian Berman.

6325 6326
- Issue #10271: Allow warnings.showwarning() be any callable.

6327 6328
- Issue #11627: Fix segfault when __new__ on a exception returns a
  non-exception class.
6329

Georg Brandl's avatar
Georg Brandl committed
6330
- Issue #12149: Update the method cache after a type's dictionary gets
6331 6332 6333 6334 6335
  cleared by the garbage collector.  This fixes a segfault when an instance
  and its type get caught in a reference cycle, and the instance's
  deallocator calls one of the methods on the type (e.g. when subclassing
  IOBase).  Diagnosis and patch by Davide Rizzo.

6336
- Issue #9611, Issue #9015: FileIO.read() clamps the length to INT_MAX on Windows.
6337

6338 6339 6340
- Issue #9642: Uniformize the tests on the availability of the mbcs codec, add
  a new HAVE_MBCS define.

6341 6342 6343 6344 6345
- Issue #9642: Fix filesystem encoding initialization: use the ANSI code page
  on Windows if the mbcs codec is not available, and fail with a fatal error if
  we cannot get the locale encoding (if nl_langinfo(CODESET) is not available)
  instead of using UTF-8.

6346 6347 6348
- When a generator yields, do not retain the caller's exception state on the
  generator.

6349
- Issue #12475: Prevent generators from leaking their exception state into the
Benjamin Peterson's avatar
add '  
Benjamin Peterson committed
6350
  caller's frame as they return for the last time.
6351

6352 6353 6354
- Issue #12291: You can now load multiple marshalled objects from a stream,
  with other data interleaved between marshalled objects.

6355 6356 6357 6358
- Issue #12356: When required positional or keyword-only arguments are not
  given, produce a informative error message which includes the name(s) of the
  missing arguments.

6359
- Issue #12370: Fix super with no arguments when __class__ is overriden in the
6360 6361
  class body.

6362 6363 6364
- Issue #12084: os.stat on Windows now works properly with relative symbolic
  links when called from any directory.

6365 6366 6367
- Loosen type restrictions on the __dir__ method. __dir__ can now return any
  sequence, which will be converted to a list and sorted by dir().

6368 6369 6370
- Issue #12265: Make error messages produced by passing an invalid set of
  arguments to a function more informative.

Benjamin Peterson's avatar
Benjamin Peterson committed
6371 6372 6373
- Issue #12225: Still allow Python to build if Python is not in its hg repo or
  mercurial is not installed.

6374
- Issue #1195: my_fgets() now always clears errors before calling fgets(). Fix
6375 6376 6377
  the following case: sys.stdin.read() stopped with CTRL+d (end of file),
  raw_input() interrupted by CTRL+c.

6378 6379
- Issue #12216: Allow unexpected EOF errors to happen on any line of the file.

6380 6381 6382
- Issue #12199: The TryExcept and TryFinally and AST nodes have been unified
  into a Try node.

6383 6384 6385 6386 6387
- Issue #9670: Increase the default stack size for secondary threads on
  Mac OS X and FreeBSD to reduce the chances of a crash instead of a
  "maximum recursion depth" RuntimeError exception.
  (patch by Ronald Oussoren)

6388 6389 6390
- Issue #12106: The use of the multiple-with shorthand syntax is now reflected
  in the AST.

6391 6392 6393
- Issue #12190: Try to use the same filename object when compiling unmarshalling
  a code objects in the same file.

6394 6395 6396
- Issue #12166: Move implementations of dir() specialized for various types into
  the __dir__() methods of those types.

6397
- Issue #5715: In socketserver, close the server socket in the child process.
6398

Benjamin Peterson's avatar
Benjamin Peterson committed
6399 6400 6401
- Correct lookup of __dir__ on objects. Among other things, this causes errors
  besides AttributeError found on lookup to be propagated.

6402 6403 6404
- Issue #12060: Use sig_atomic_t type and volatile keyword in the signal
  module. Patch written by Charles-François Natali.

6405 6406
- Issue #1746656: Added the if_nameindex, if_indextoname, if_nametoindex
  methods to the socket module.
6407

6408 6409 6410 6411
- Issue #12044: Fixed subprocess.Popen when used as a context manager to
  wait for the process to end when exiting the context to avoid unintentionally
  leaving zombie processes around.

6412 6413 6414
- Issue #1195: Fix input() if it is interrupted by CTRL+d and then CTRL+c,
  clear the end-of-file indicator after CTRL+d.

6415 6416 6417 6418
- Issue #1856: Avoid crashes and lockups when daemon threads run while the
  interpreter is shutting down; instead, these threads are now killed when
  they try to take the GIL.

6419 6420 6421
- Issue #9756: When calling a method descriptor or a slot wrapper descriptor,
  the check of the object type doesn't read the __class__ attribute anymore.
  Fix a crash if a class override its __class__ attribute (e.g. a proxy of the
6422
  str type). Patch written by Andreas Stührk.
6423

6424 6425 6426 6427
- Issue #10517: After fork(), reinitialize the TLS used by the PyGILState_*
  APIs, to avoid a crash with the pthread implementation in RHEL 5.  Patch
  by Charles-François Natali.

6428 6429 6430 6431
- Issue #10914: Initialize correctly the filesystem codec when creating a new
  subinterpreter to fix a bootstrap issue with codecs implemented in Python, as
  the ISO-8859-15 codec.

6432 6433 6434
- Issue #11918: OS/2 and VMS are no more supported because of the lack of
  maintainer.

6435 6436 6437
- Issue #6780: fix starts/endswith error message to mention that tuples are
  accepted too.

6438 6439 6440 6441
- Issue #5057: fix a bug in the peepholer that led to non-portable pyc files
  between narrow and wide builds while optimizing BINARY_SUBSCR on non-BMP
  chars (e.g. "\U00012345"[0]).

6442 6443 6444
- Issue #11845: Fix typo in rangeobject.c that caused a crash in
  compute_slice_indices.  Patch by Daniel Urban.

6445 6446 6447 6448 6449
- Issue #5673: Added a `timeout` keyword argument to subprocess.Popen.wait,
  subprocess.Popen.communicated, subprocess.call, subprocess.check_call, and
  subprocess.check_output.  If the blocking operation takes more than `timeout`
  seconds, the `subprocess.TimeoutExpired` exception is raised.

6450 6451 6452 6453
- Issue #11650: PyOS_StdioReadline() retries fgets() if it was interrupted
  (EINTR), for example if the program is stopped with CTRL+z on Mac OS X. Patch
  written by Charles-Francois Natali.

6454 6455
- Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.

6456 6457
- Issue #10785: Store the filename as Unicode in the Python parser.

6458 6459 6460
- Issue #11619: _PyImport_LoadDynamicModule() doesn't encode the path to bytes
  on Windows.

6461 6462 6463
- Issue #10998: Remove mentions of -Q, sys.flags.division_warning and
  Py_DivisionWarningFlag left over from Python 2.

6464 6465 6466
- Issue #11244: Remove an unnecessary peepholer check that was preventing
  negative zeros from being constant-folded properly.

6467 6468 6469 6470 6471 6472
- Issue #11395: io.FileIO().write() clamps the data length to 32,767 bytes on
  Windows if the file is a TTY to workaround a Windows bug. The Windows console
  returns an error (12: not enough space error) on writing into stdout if
  stdout mode is binary and the length is greater than 66,000 bytes (or less,
  depending on heap usage).

6473
- Issue #11320: fix bogus memory management in Modules/getpath.c, leading to
6474 6475
  a possible crash when calling Py_SetPath().

Gregory P. Smith's avatar
Gregory P. Smith committed
6476 6477 6478 6479
- Issue #11432: A bug was introduced in subprocess.Popen on posix systems with
  3.2.0 where the stdout or stderr file descriptor being the same as the stdin
  file descriptor would raise an exception. webbrowser.open would fail. fixed.

6480 6481 6482 6483
- Issue #9856: Change object.__format__ with a non-empty format string
  to be a DeprecationWarning. In 3.2 it was a PendingDeprecationWarning.
  In 3.4 it will be a TypeError.

6484 6485 6486 6487
- Issue #11244: The peephole optimizer is now able to constant-fold
  arbitrarily complex expressions.  This also fixes a 3.2 regression where
  operations involving negative numbers were not constant-folded.

6488 6489 6490
- Issue #11450: Don't truncate hg version info in Py_GetBuildInfo() when
  there are many tags (e.g. when using mq).  Patch by Nadeem Vawda.

6491 6492 6493
- Issue #11335: Fixed a memory leak in list.sort when the key function
  throws an exception.

6494 6495 6496 6497 6498
- Issue #8923: When a string is encoded to UTF-8 in strict mode, the result is
  cached into the object. Examples: str.encode(), str.encode('utf-8'),
  PyUnicode_AsUTF8String() and PyUnicode_AsEncodedString(unicode, "utf-8",
  NULL).

6499 6500 6501
- Issue #10829: Refactor PyUnicode_FromFormat(), use the same function to parse
  the format string in the 3 steps, fix crashs on invalid format strings.

6502 6503
- Issue #13007: whichdb should recognize gdbm 1.9 magic numbers.

6504 6505 6506
- Issue #11286: Raise a ValueError from calling PyMemoryView_FromBuffer with
  a buffer struct having a NULL data pointer.

6507 6508 6509
- Issue #11272: On Windows, input() strips '\r' (and not only '\n'), and
  sys.stdin uses universal newline (replace '\r\n' by '\n').

6510
- Issue #11828: startswith and endswith now accept None as slice index.
6511 6512
  Patch by Torsten Becker.

6513 6514 6515 6516
- Issue #11168: Remove filename debug variable from PyEval_EvalFrameEx().
  It encoded the Unicode filename to UTF-8, but the encoding fails on
  undecodable filename (on surrogate characters) which raises an unexpected
  UnicodeEncodeError on recursion limit.
6517

6518 6519 6520 6521
- Issue #11187: Remove bootstrap code (use ASCII) of
  PyUnicode_AsEncodedString(), it was replaced by a better fallback (use the
  locale encoding) in PyUnicode_EncodeFSDefault().

6522 6523
- Check for NULL result in PyType_FromSpec.

6524
- Issue #10516: New copy() and clear() methods for lists and bytearrays.
6525

6526 6527 6528
- Issue #11386: bytearray.pop() now throws IndexError when the bytearray is
  empty, instead of OverflowError.

6529 6530 6531
- Issue #12380: The rjust, ljust and center methods of bytes and bytearray
  now accept a bytearray argument.

6532 6533
Library
-------
6534

6535 6536 6537 6538
- Issue #14195: An issue that caused weakref.WeakSet instances to incorrectly
  return True for a WeakSet instance 'a' in both 'a < a' and 'a > a' has been
  fixed.

6539 6540 6541 6542
- Issue #14166: Pickler objects now have an optional ``dispatch_table``
  attribute which allows to set custom per-pickler reduction functions.
  Patch by sbt.

6543 6544 6545
- Issue #14177: marshal.loads() now raises TypeError when given an unicode
  string.  Patch by Guilherme Gonçalves.

6546 6547 6548
- Issue #13550: Remove the debug machinery from the threading module: remove
  verbose arguments from all threading classes and functions.

6549 6550 6551 6552 6553
- Issue #14159: Fix the len() of weak containers (WeakSet, WeakKeyDictionary,
  WeakValueDictionary) to return a better approximation when some objects
  are dead or dying.  Moreover, the implementation is now O(1) rather than
  O(n).

6554 6555 6556
- Issue #11841: Fix comparison bug with 'rc' versions in packaging.version.
  Patch by Filip Gruszczyński.

6557
- Issue #6884: Fix long-standing bugs with MANIFEST.in parsing in distutils
Éric Araujo's avatar
Éric Araujo committed
6558
  on Windows.  Also fixed in packaging.
6559

6560 6561 6562
- Issue #8033: sqlite3: Fix 64-bit integer handling in user functions
  on 32-bit architectures. Initial patch by Philippe Devalkeneer.

6563 6564
- HTMLParser is now able to handle slashes in the start tag.

6565 6566 6567
- Issue #13641: Decoding functions in the base64 module now accept ASCII-only
  unicode strings.  Patch by Catalin Iacob.

6568 6569 6570
- Issue #14043: Speed up importlib's _FileFinder by at least 8x, and add a
  new importlib.invalidate_caches() function.

6571 6572 6573
- Issue #14001: CVE-2012-0845: xmlrpc: Fix an endless loop in
  SimpleXMLRPCServer upon malformed POST request.

6574 6575
- Issue #13961: Move importlib over to using os.replace() for atomic renaming.

6576 6577 6578
- Do away with ambiguous level values (as suggested by PEP 328) in
  importlib.__import__() by raising ValueError when level < 0.

6579 6580
- Issue #2489: pty.spawn could consume 100% cpu when it encountered an EOF.

6581 6582
- Issue #13014: Fix a possible reference leak in SSLSocket.getpeercert().

6583 6584 6585
- Issue #13777: Add PF_SYSTEM sockets on OS X.
  Patch by Michael Goderbauer.

6586 6587 6588
- Issue #13015: Fix a possible reference leak in defaultdict.__repr__.
  Patch by Suman Saha.

6589 6590 6591
- Issue #1326113: distutils' and packaging's build_ext commands option now
  correctly parses multiple values (separated by whitespace or commas) given
  to their --libraries option.
6592

6593 6594 6595 6596
- Issue #10287: nntplib now queries the server's CAPABILITIES first before
  sending MODE READER, and only sends it if not already in READER mode.
  Patch by Hynek Schlawack.

6597 6598 6599
- Issue #13993: HTMLParser is now able to handle broken end tags when
  strict=False.

6600 6601 6602 6603
- Issue #13930: lib2to3 now supports writing converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.

6604 6605 6606 6607
- Issue #9750: Fix sqlite3.Connection.iterdump on tables and fields
  with a name that is a keyword or contains quotes. Patch by Marko
  Kohtala.

6608 6609 6610 6611
- Issue #10287: nntplib now queries the server's CAPABILITIES again after
  authenticating (since the result may change, according to RFC 4643).
  Patch by Hynek Schlawack.

6612 6613 6614 6615 6616 6617 6618 6619 6620 6621 6622 6623 6624
- Issue #13590: On OS X 10.7 and 10.6 with Xcode 4.2, building
  Distutils-based packages with C extension modules may fail because
  Apple has removed gcc-4.2, the version used to build python.org
  64-bit/32-bit Pythons.  If the user does not explicitly override
  the default C compiler by setting the CC environment variable,
  Distutils will now attempt to compile extension modules with clang
  if gcc-4.2 is required but not found. Also as a convenience, if
  the user does explicitly set CC, substitute its value as the default
  compiler in the Distutils LDSHARED configuration variable for OS X.
  (Note, the python.org 32-bit-only Pythons use gcc-4.0 and the 10.4u
  SDK, neither of which are available in Xcode 4.  This change does not
  attempt to override settings to support their use with Xcode 4.)

6625 6626 6627
- Issue #13960: HTMLParser is now able to handle broken comments when
  strict=False.

6628
- When '' is a path (e.g. in sys.path), make sure __file__ uses the current
Brett Cannon's avatar
Brett Cannon committed
6629
  working directory instead of '' in importlib.
6630

6631 6632 6633 6634
- Issue #13609: Add two functions to query the terminal size:
  os.get_terminal_size (low level) and shutil.get_terminal_size (high level).
  Patch by Zbigniew Jędrzejewski-Szmek.

6635 6636 6637
- Issue #13845: On Windows, time.time() now uses GetSystemTimeAsFileTime()
  instead of ftime() to have a resolution of 100 ns instead of 1 ms (the clock
  accuracy is between 0.5 ms and 15 ms).
6638

6639 6640
- Issue #13846: Add time.monotonic(), monotonic clock.

6641 6642 6643 6644 6645
- Issue #8184: multiprocessing: On Windows, don't set SO_REUSEADDR on
  Connection sockets, and set FILE_FLAG_FIRST_PIPE_INSTANCE on named pipes, to
  make sure two listeners can't bind to the same socket/pipe (or any existing
  socket/pipe).

6646 6647 6648
- Issue #10811: Fix recursive usage of cursors. Instead of crashing,
  raise a ProgrammingError now.

6649 6650 6651
- Issue #13734: Add os.fwalk(), a directory walking function yielding file
  descriptors.

6652 6653
- Issue #2945: Make the distutils upload command aware of bdist_rpm products.

6654 6655
- Issue #13712: pysetup create should not convert package_data to extra_files.

6656 6657
- Issue #11805: package_data in setup.cfg should allow more than one value.

6658 6659
- Issue #13676: Handle strings with embedded zeros correctly in sqlite3.

6660 6661 6662
- Issue #8828: Add new function os.replace(), for cross-platform renaming
  with overwriting.

6663 6664 6665
- Issue #13848: open() and the FileIO constructor now check for NUL
  characters in the file name.  Patch by Hynek Schlawack.

6666 6667 6668
- Issue #13806: The size check in audioop decompression functions was too
  strict and could reject valid compressed data.  Patch by Oleg Plakhotnyuk.

6669 6670 6671
- Issue #13812: When a multiprocessing Process child raises an exception,
  flush stderr after printing the exception traceback.

6672 6673 6674
- Issue #13885: CVE-2011-3389: the _ssl module would always disable the CBC
  IV attack countermeasure.

6675 6676
- Issue #13847: time.localtime() and time.gmtime() now raise an OSError instead
  of ValueError on failure. time.ctime() and time.asctime() now raises an
6677 6678
  OSError if localtime() failed. time.clock() now raises a RuntimeError if the
  processor time used is not available or its value cannot be represented
6679

6680 6681 6682 6683
- Issue #13772: In os.symlink() under Windows, do not try to guess the link
  target's type (file or directory).  The detection was buggy and made the
  call non-atomic (therefore prone to race conditions).

6684
- Issue #6631: Disallow relative file paths in urllib urlopen methods.
6685

6686 6687 6688
- Issue #13722: Avoid silencing ImportErrors when initializing the codecs
  registry.

6689 6690 6691
- Issue #13781: Fix GzipFile bug that caused an exception to be raised when
  opening for writing using a fileobj returned by os.fdopen().

6692 6693 6694
- Issue #13803: Under Solaris, distutils doesn't include bitness
  in the directory name.

6695 6696
- Issue #10278: Add time.wallclock() function, monotonic clock.

6697 6698 6699
- Issue #13809: Fix regression where bz2 module wouldn't work when threads are
  disabled. Original patch by Amaury Forgeot d'Arc.

6700 6701 6702
- Issue #13589: Fix some serialization primitives in the aifc module.
  Patch by Oleg Plakhotnyuk.

6703 6704 6705
- Issue #13642: Unquote before b64encoding user:password during Basic
  Authentication. Patch contributed by Joonas Kuorilehto.

6706 6707 6708 6709
- Issue #12364: Fix a hang in concurrent.futures.ProcessPoolExecutor.
  The hang would occur when retrieving the result of a scheduled future after
  the executor had been shut down.

6710 6711 6712
- Issue #13502: threading: Fix a race condition in Event.wait() that made it
  return False when the event was set and cleared right after.

6713 6714 6715 6716 6717
- Issue #9993: When the source and destination are on different filesystems,
  and the source is a symlink, shutil.move() now recreates a symlink on the
  destination instead of copying the file contents.  Patch by Jonathan Niehof
  and Hynek Schlawack.

6718 6719
- Issue #12926: Fix a bug in tarfile's link extraction.

6720 6721
- Issue #13696: Fix the 302 Relative URL Redirection problem.

6722 6723 6724
- Issue #13636: Weak ciphers are now disabled by default in the ssl module
  (except when SSLv2 is explicitly asked for).

6725 6726 6727 6728 6729
- Issue #12715: Add an optional symlinks argument to shutil functions
  (copyfile, copymode, copystat, copy, copy2).  When that parameter is
  true, symlinks aren't dereferenced and the operation instead acts on the
  symlink itself (or creates one, if relevant).  Patch by Hynek Schlawack.

6730 6731
- Add a flags parameter to select.epoll.

6732 6733 6734
- Issue #13626: Add support for SSL Diffie-Hellman key exchange, through the
  SSLContext.load_dh_params() method and the ssl.OP_SINGLE_DH_USE option.

6735 6736
- Issue #11006: Don't issue low level warning in subprocess when pipe2() fails.

6737
- Issue #13620: Support for Chrome browser in webbrowser.  Patch contributed
6738 6739
  by Arnaud Calmettes.

6740 6741 6742
- Issue #11829: Fix code execution holes in inspect.getattr_static for
  metaclasses with metaclasses. Patch by Andreas Stührk.

6743 6744 6745
- Issue #12708: Add starmap() and starmap_async() methods (similar to
  itertools.starmap()) to multiprocessing.Pool.  Patch by Hynek Schlawack.

6746 6747
- Issue #1785: Fix inspect and pydoc with misbehaving descriptors.

6748 6749 6750
- Issue #13637: "a2b" functions in the binascii module now accept ASCII-only
  unicode strings.

6751 6752
- Issue #13634: Add support for querying and disabling SSL compression.

6753 6754 6755 6756
- Issue #13627: Add support for SSL Elliptic Curve-based Diffie-Hellman
  key exchange, through the SSLContext.set_ecdh_curve() method and the
  ssl.OP_SINGLE_ECDH_USE option.

6757 6758 6759 6760
- Issue #13635: Add ssl.OP_CIPHER_SERVER_PREFERENCE, so that SSL servers
  choose the cipher based on their own preferences, rather than on the
  client's.

6761
- Issue #11813: Fix inspect.getattr_static for modules. Patch by Andreas
6762 6763
  Stührk.

6764 6765 6766
- Issue #7502: Fix equality comparison for DocTestCase instances.  Patch by
  Cédric Krier.

6767 6768 6769
- Issue #11870: threading: Properly reinitialize threads internal locks and
  condition variables to avoid deadlocks in child processes.

6770 6771 6772
- Issue #8035: urllib: Fix a bug where the client could remain stuck after a
  redirection or an error.

6773 6774 6775
- Issue #13560: os.strerror() now uses the current locale encoding instead of
  UTF-8.

6776 6777 6778 6779
- Issue #8373: The filesystem path of AF_UNIX sockets now uses the filesystem
  encoding and the surrogateescape error handler, rather than UTF-8.  Patch
  by David Watson.

6780 6781 6782
- Issue #10350: Read and save errno before calling a function which might
  overwrite it.  Original patch by Hallvard B Furuseth.

6783 6784
- Issue #11610: Introduce a more general way to declare abstract properties.

6785 6786 6787
- Issue #13591: A bug in importlib has been fixed that caused import_module
  to load a module twice.

6788 6789 6790 6791
- Issue #13449 sched.scheduler.run() method has a new "blocking" parameter which
  when set to False makes run() execute the scheduled events due to expire
  soonest (if any) and then return.  Patch by Giampaolo Rodolà.

6792
- Issue #8684 sched.scheduler class can be safely used in multi-threaded
6793
  environments.  Patch by Josiah Carlson and Giampaolo Rodolà.
6794

6795 6796
- Alias resource.error to OSError ala PEP 3151.

6797 6798
- Issue #5689: Add support for lzma compression to the tarfile module.

6799 6800 6801 6802 6803
- Issue #13248: Turn 3.2's PendingDeprecationWarning into 3.3's
  DeprecationWarning.  It covers 'cgi.escape', 'importlib.abc.PyLoader',
  'importlib.abc.PyPycLoader', 'nntplib.NNTP.xgtitle', 'nntplib.NNTP.xpath',
  and private attributes of 'smtpd.SMTPChannel'.

6804
- Issue #5905, Issue #13560: time.strftime() is now using the current locale
6805
  encoding, instead of UTF-8, if the wcsftime() function is not available.
6806

6807 6808 6809
- Issue #13464: Add a readinto() method to http.client.HTTPResponse.  Patch
  by Jon Kuhn.

6810 6811 6812
- tarfile.py: Correctly detect bzip2 compressed streams with blocksizes
  other than 900k.

6813 6814
- Issue #13439: Fix many errors in turtle docstrings.

6815
- Issue #6715: Add a module 'lzma' for compression using the LZMA algorithm.
6816
  Thanks to Per Øyvind Karlsen for the initial implementation.
6817

6818 6819 6820
- Issue #13487: Make inspect.getmodule robust against changes done to
  sys.modules while it is iterating over it.

6821 6822 6823
- Issue #12618: Fix a bug that prevented py_compile from creating byte
  compiled files in the current directory.  Initial patch by Sjoerd de Vries.

6824 6825 6826
- Issue #13444: When stdout has been closed explicitly, we should not attempt
  to flush it at shutdown and print an error.

6827 6828 6829 6830
- Issue #12567: The curses module uses Unicode functions for Unicode arguments
  when it is linked to the ncurses library. It encodes also Unicode strings to
  the locale encoding instead of UTF-8.

6831 6832 6833 6834
- Issue #12856: Ensure child processes do not inherit the parent's random
  seed for filename generation in the tempfile module.  Patch by Brian
  Harring.

6835 6836 6837
- Issue #9957: SpooledTemporaryFile.truncate() now accepts an optional size
  parameter, as other file-like objects.  Patch by Ryan Kelly.

6838 6839 6840
- Issue #13458: Fix a memory leak in the ssl module when decoding a
  certificate with a subjectAltName.  Patch by Robert Xiao.

6841 6842
- Issue #13415: os.unsetenv() doesn't ignore errors anymore.

Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
6843 6844 6845
- Issue #13245: sched.scheduler class constructor's timefunc and
  delayfunct parameters are now optional.
  scheduler.enter and scheduler.enterabs methods gained a new kwargs parameter.
6846
  Patch contributed by Chris Clark.
Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
6847

6848 6849 6850 6851
- Issue #12328: Under Windows, refactor handling of Ctrl-C events and
  make _multiprocessing.win32.WaitForMultipleObjects interruptible when
  the wait_flag parameter is false.  Patch by sbt.

6852 6853 6854 6855 6856 6857
- Issue #13322: Fix BufferedWriter.write() to ensure that BlockingIOError is
  raised when the wrapped raw file is non-blocking and the write would block.
  Previous code assumed that the raw write() would raise BlockingIOError, but
  RawIOBase.write() is defined to returned None when the call would block.
  Patch by sbt.

6858 6859
- Issue #13358: HTMLParser now calls handle_data only once for each CDATA.

6860 6861 6862 6863
- Issue #4147: minidom's toprettyxml no longer adds whitespace around a text
  node when it is the only child of an element.  Initial patch by Dan
  Kenigsberg.

6864 6865 6866 6867
- Issue #13374: The Windows bytes API has been deprecated in the os module. Use
  Unicode filenames instead of bytes filenames to not depend on the ANSI code
  page anymore and to support any filename.

6868 6869
- Issue #13297: Use bytes type to send and receive binary data through XMLRPC.

6870 6871 6872
- Issue #6397: Support "/dev/poll" polling objects in select module,
  under Solaris & derivatives.

6873 6874 6875
- Issues #1745761, #755670, #13357, #12629, #1200313: HTMLParser now correctly
  handles non-valid attributes, including adjacent and unquoted attributes.

6876 6877
- Issue #13193: Fix distutils.filelist.FileList and packaging.manifest.Manifest
  under Windows.
Antoine Pitrou's avatar
Antoine Pitrou committed
6878

6879 6880
- Issue #13384: Remove unnecessary __future__ import in Lib/random.py

6881 6882
- Issue #13149: Speed up append-only StringIO objects.

6883 6884 6885
- Issue #13373: multiprocessing.Queue.get() could sometimes block indefinitely
  when called with a timeout.  Patch by Arnaud Ysmal.

6886 6887 6888
- Issue #13254: Fix Maildir initialization so that maildir contents
  are read correctly.

6889
- Issue #3067: locale.setlocale() now raises TypeError if the second
6890 6891
  argument is an invalid iterable. Its documentation and docstring
  were also updated. Initial patch by Jyrki Pulliainen.
6892

6893 6894
- Issue #13140: Fix the daemon_threads attribute of ThreadingMixIn.

6895 6896 6897
- Issue #13339: Fix compile error in posixmodule.c due to missing semicolon.
  Thanks to Robert Xiao.

6898 6899 6900
- Byte compilation in packaging is now isolated from the calling Python -B or
  -O options, instead of being disallowed under -B or buggy under -O.

6901
- Issue #10570: curses.putp() and curses.tparm() are now expecting a byte
6902
  string, instead of a Unicode string.
6903

6904 6905
- Issue #13295: http.server now produces valid HTML 4.01 strict.

6906 6907
- Issue #2892: preserve iterparse events in case of SyntaxError.

6908
- Issue #13287: urllib.request and urllib.error now contains an __all__
Éric Araujo's avatar
Éric Araujo committed
6909
  attribute to expose only relevant classes and functions.  Patch by Florent
6910
  Xicluna.
6911

6912 6913 6914 6915
- Issue #670664: Fix HTMLParser to correctly handle the content of
  ``<script>...</script>`` and ``<style>...</style>``.

- Issue #10817: Fix urlretrieve function to raise ContentTooShortError even
6916 6917
  when reporthook is None. Patch by Jyrki Pulliainen.

6918 6919 6920
- Fix the xmlrpc.client user agent to return something similar to
  urllib.request user agent: "Python-xmlrpc/3.3".

6921 6922 6923
- Issue #13293: Better error message when trying to marshal bytes using
  xmlrpc.client.

6924 6925
- Issue #13291: NameError in xmlrpc package.

6926 6927
- Issue #13258: Use callable() built-in in the standard library.

6928 6929 6930
- Issue #13273: fix a bug that prevented HTMLParser to properly detect some
  tags when strict=False.

6931 6932 6933
- Issue #11183: Add finer-grained exceptions to the ssl module, so that
  you don't have to inspect the exception's attributes in the common case.

6934
- Issue #13216: Add cp65001 codec, the Windows UTF-8 (CP_UTF8).
6935

Victor Stinner's avatar
Victor Stinner committed
6936
- Issue #13226: Add RTLD_xxx constants to the os module. These constants can be
6937 6938
  used with sys.setdlopenflags().

6939 6940 6941 6942
- Issue #10278: Add clock_getres(), clock_gettime() and CLOCK_xxx constants to
  the time module. time.clock_gettime(time.CLOCK_MONOTONIC) provides a
  monotonic clock

6943 6944 6945
- Issue #10332: multiprocessing: fix a race condition when a Pool is closed
  before all tasks have completed.

6946 6947
- Issue #13255: wrong docstrings in array module.

6948 6949
- Issue #8540: Remove deprecated Context._clamp attribute in Decimal module.

R David Murray's avatar
R David Murray committed
6950
- Issue #13235: Added DeprecationWarning to logging.warn() method and function.
6951

6952 6953
- Issue #9168: now smtpd is able to bind privileged port.

6954 6955 6956
- Issue #12529: fix cgi.parse_header issue on strings with double-quotes and
  semicolons together. Patch by Ben Darnell and Petri Lehtinen.

6957 6958 6959
- Issue #13227: functools.lru_cache() now has a option to distinguish
  calls with different argument types.

6960 6961
- Issue #6090: zipfile raises a ValueError when a document with a timestamp
  earlier than 1980 is provided. Patch contributed by Petri Lehtinen.
6962

6963 6964 6965 6966
- Issue #13150: sysconfig no longer parses the Makefile and config.h files
  when imported, instead doing it at build time.  This makes importing
  sysconfig faster and reduces Python startup time by 20%.

Ezio Melotti's avatar
Ezio Melotti committed
6967 6968
- Issue #12448: smtplib now flushes stdout while running ``python -m smtplib``
  in order to display the prompt correctly.
6969

6970
- Issue #12454: The mailbox module is now using ASCII, instead of the locale
R David Murray's avatar
R David Murray committed
6971
  encoding, to read and write .mh_sequences files.
6972

6973 6974
- Issue #13194: zlib.compressobj().copy() and zlib.decompressobj().copy() are
  now available on Windows.
6975

R David Murray's avatar
R David Murray committed
6976
- Issue #1673007: urllib.request now supports HEAD request via new method argument.
6977 6978
  Patch contributions by David Stanek, Patrick Westerhoff and Ezio Melotti.

6979 6980
- Issue #12386: packaging does not fail anymore when writing the RESOURCES
  file.
6981

6982 6983
- Issue #13158: Fix decoding and encoding of GNU tar specific base-256 number
  fields in tarfile.
6984

6985 6986
- Issue #13025: mimetypes is now reading MIME types using the UTF-8 encoding,
  instead of the locale encoding.
6987

6988 6989
- Issue #10653: On Windows, use strftime() instead of wcsftime() because
  wcsftime() doesn't format time zone correctly.
6990

6991 6992 6993
- Issue #13150: The tokenize module doesn't compile large regular expressions
  at startup anymore.

Éric Araujo's avatar
Éric Araujo committed
6994 6995
- Issue #11171: Fix distutils.sysconfig.get_makefile_filename when Python was
  configured with different prefix and exec-prefix.
6996

6997
- Issue #11254: Teach distutils and packaging to compile .pyc and .pyo files in
6998
  PEP 3147-compliant __pycache__ directories.
6999

Ned Deily's avatar
Ned Deily committed
7000 7001
- Issue #7367: Fix pkgutil.walk_paths to skip directories whose
  contents cannot be read.
7002

7003 7004 7005
- Issue #3163: The struct module gets new format characters 'n' and 'N'
  supporting C integer types ``ssize_t`` and ``size_t``, respectively.

7006 7007
- Issue #13099: Fix sqlite3.Cursor.lastrowid under a Turkish locale.
  Reported and diagnosed by Thomas Kluyver.
7008

7009 7010 7011
- Issue #13087: BufferedReader.seek() now always raises UnsupportedOperation
  if the underlying raw stream is unseekable, even if the seek could be
  satisfied using the internal buffer.  Patch by John O'Connor.
7012

7013 7014 7015
- Issue #7689: Allow pickling of dynamically created classes when their
  metaclass is registered with copyreg.  Patch by Nicolas M. Thiéry and Craig
  Citro.
7016

7017 7018 7019
- Issue #13034: When decoding some SSL certificates, the subjectAltName
  extension could be unreported.

7020 7021 7022
- Issue #12306: Expose the runtime version of the zlib C library as a constant,
  ZLIB_RUNTIME_VERSION, in the zlib module. Patch by Torsten Landschoff.

7023
- Issue #12959: Add collections.ChainMap to collections.__all__.
7024

7025 7026 7027
- Issue #8933: distutils' PKG-INFO files and packaging's METADATA files will
  now correctly report Metadata-Version: 1.1 instead of 1.0 if a Classifier or
  Download-URL field is present.
7028

7029 7030 7031
- Issue #12567: Add curses.unget_wch() function. Push a character so the next
  get_wch() will return it.

7032
- Issue #9561: distutils and packaging now writes egg-info files using UTF-8,
7033 7034
  instead of the locale encoding.

7035 7036 7037
- Issue #8286: The distutils command sdist will print a warning message instead
  of crashing when an invalid path is given in the manifest template.

7038 7039 7040 7041 7042
- Issue #12841: tarfile unnecessarily checked the existence of numerical user
  and group ids on extraction. If one of them did not exist the respective id
  of the current user (i.e. root) was used for the file and ownership
  information was lost.

Ezio Melotti's avatar
Ezio Melotti committed
7043 7044 7045
- Issue #12888: Fix a bug in HTMLParser.unescape that prevented it to escape
  more than 128 entities.  Patch by Peter Otten.

7046 7047
- Issue #12878: Expose a __dict__ attribute on io.IOBase and its subclasses.

7048 7049 7050 7051
- Issue #12494: On error, call(), check_call(), check_output() and
  getstatusoutput() functions of the subprocess module now kill the process,
  read its status (to avoid zombis) and close pipes.

Benjamin Peterson's avatar
Benjamin Peterson committed
7052 7053
- Issue #12720: Expose low-level Linux extended file attribute functions in os.

Éric Araujo's avatar
Éric Araujo committed
7054
- Issue #10946: The distutils commands bdist_dumb, bdist_wininst and bdist_msi
7055 7056
  now respect a --skip-build option given to bdist.  The packaging commands
  were fixed too.
Éric Araujo's avatar
Éric Araujo committed
7057

7058 7059 7060
- Issue #12847: Fix a crash with negative PUT and LONG_BINPUT arguments in
  the C pickle implementation.

7061 7062 7063
- Issue #11564: Avoid crashes when trying to pickle huge objects or containers
  (more than 2**31 items).  Instead, in most cases, an OverflowError is raised.

7064 7065 7066
- Issue #12287: Fix a stack corruption in ossaudiodev module when the FD is
  greater than FD_SETSIZE.

7067 7068 7069
- Issue #12839: Fix crash in zlib module due to version mismatch.
  Fix by Richard M. Tew.

7070 7071 7072
- Issue #9923: The mailcap module now correctly uses the platform path
  separator for the MAILCAP environment variable on non-POSIX platforms.

7073 7074 7075 7076
- Issue #12835: Follow up to #6560 that unconditionally prevents use of the
  unencrypted sendmsg/recvmsg APIs on SSL wrapped sockets. Patch by David
  Watson.

7077 7078 7079
- Issue #12803: SSLContext.load_cert_chain() now accepts a password argument
  to be used if the private key is encrypted.  Patch by Adam Simpkins.

7080 7081 7082
- Issue #11657: Fix sending file descriptors over 255 over a multiprocessing
  Pipe.

7083 7084 7085
- Issue #12811: tabnanny.check() now promptly closes checked files. Patch by
  Anthony Briggs.

7086 7087
- Issue #6560: The sendmsg/recvmsg API is now exposed by the socket module
  when provided by the underlying platform, supporting processing of
7088
  ancillary data in pure Python code. Patch by David Watson and Heiko Wundram.
7089

7090 7091 7092 7093
- Issue #12326: On Linux, sys.platform doesn't contain the major version
  anymore. It is now always 'linux', instead of 'linux2' or 'linux3' depending
  on the Linux version used to build Python.

7094 7095 7096
- Issue #12213: Fix a buffering bug with interleaved reads and writes that
  could appear on BufferedRandom streams.

7097 7098 7099
- Issue #12778: Reduce memory consumption when JSON-encoding a large
  container of many small objects.

7100 7101 7102
- Issue #12650: Fix a race condition where a subprocess.Popen could leak
  resources (FD/zombie) when killed at the wrong time.

7103 7104 7105
- Issue #12744: Fix inefficient representation of integers between 2**31 and
  2**63 on systems with a 64-bit C "long".

7106 7107 7108
- Issue #12646: Add an 'eof' attribute to zlib.Decompress, to make it easier to
  detect truncated input streams.

7109 7110 7111
- Issue #11513: Fix exception handling ``tarfile.TarFile.gzopen()`` when
  the file cannot be opened.

7112 7113 7114
- Issue #12687: Fix a possible buffering bug when unpickling text mode
  (protocol 0, mostly) pickles.

Senthil Kumaran's avatar
Senthil Kumaran committed
7115 7116
- Issue #10087: Fix the html output format of the calendar module.

7117 7118 7119
- Issue #13121: add support for inplace math operators to collections.Counter.

- Add support for unary plus and unary minus to collections.Counter.
7120

7121 7122
- Issue #12683: urlparse updated to include svn as schemes that uses relative
  paths. (svn from 1.5 onwards support relative path).
7123

7124 7125 7126 7127 7128
- Issue #12655: Expose functions from sched.h in the os module: sched_yield(),
  sched_setscheduler(), sched_getscheduler(), sched_setparam(),
  sched_get_min_priority(), sched_get_max_priority(), sched_rr_get_interval(),
  sched_getaffinity(), sched_setaffinity().

7129 7130
- Add ThreadError to threading.__all__.

7131 7132
- Issues #11104, #8688: Fix the behavior of distutils' sdist command with
  manually-maintained MANIFEST files.
7133

7134 7135 7136 7137
- Issue #11281: smtplib.STMP gets source_address parameter, which adds the
  ability to bind to specific source address on a machine with multiple
  interfaces. Patch by Paulo Scardine.

7138 7139
- Issue #12464: tempfile.TemporaryDirectory.cleanup() should not follow
  symlinks: fix it. Patch by Petri Lehtinen.
7140

Éric Araujo's avatar
Éric Araujo committed
7141 7142
- Issue #8887: "pydoc somebuiltin.somemethod" (or help('somebuiltin.somemethod')
  in Python code) now finds the doc of the method.
7143

7144
- Issue #10968: Remove indirection in threading.  The public names (Event,
7145
  Condition, etc.) used to be factory functions returning instances of hidden
7146 7147 7148
  classes (_Event, _Condition, etc.), because (if Guido recalls correctly) this
  code pre-dates the ability to subclass extension types.  It is now possible
  to inherit from these classes, without having to import the private
7149 7150
  underscored names like multiprocessing did.

7151 7152 7153
- Issue #9723: Add shlex.quote functions, to escape filenames and command
  lines.

7154 7155
- Issue #12603: Fix pydoc.synopsis() on files with non-negative st_mtime.

7156 7157 7158
- Issue #12514: Use try/finally to assure the timeit module restores garbage
  collections when it is done.

7159 7160 7161
- Issue #12607: In subprocess, fix issue where if stdin, stdout or stderr is
  given as a low fd, it gets overwritten.

7162
- Issue #12576: Fix urlopen behavior on sites which do not send (or obfuscates)
7163
  ``Connection: close`` header.
7164

7165 7166
- Issue #12560: Build libpython.so on OpenBSD. Patch by Stefan Sperling.

7167 7168
- Issue #1813: Fix codec lookup under Turkish locales.

7169 7170 7171
- Issue #12591: Improve support of "universal newlines" in the subprocess
  module: the piped streams can now be properly read from or written to.

7172 7173 7174 7175
- Issue #12591: Allow io.TextIOWrapper to work with raw IO objects (without
  a read1() method), and add a *write_through* parameter to mandate
  unbuffered writes.

7176 7177
- Issue #10883: Fix socket leaks in urllib.request when using FTP.

7178 7179
- Issue #12592: Make Python build on OpenBSD 5 (and future major releases).

7180 7181
- Issue #12372: POSIX semaphores are broken on AIX: don't use them.

7182 7183 7184 7185 7186 7187
- Issue #12551: Provide a get_channel_binding() method on SSL sockets so as
  to get channel binding data for the current SSL session (only the
  "tls-unique" channel binding is implemented).  This allows the implementation
  of certain authentication mechanisms such as SCRAM-SHA-1-PLUS.  Patch by
  Jacek Konieczny.

7188 7189 7190
- Issue #665194: email.utils now has format_datetime and parsedate_to_datetime
  functions, allowing for round tripping of RFC2822 format dates.

7191 7192 7193 7194
- Issue #12571: Add a plat-linux3 directory mirroring the plat-linux2
  directory, so that "import DLFCN" and other similar imports work on
  Linux 3.0.

7195 7196 7197
- Issue #7484: smtplib no longer puts <> around addresses in VRFY and EXPN
  commands; they aren't required and in fact postfix doesn't support that form.

Benjamin Peterson's avatar
Benjamin Peterson committed
7198 7199 7200
- Issue #12273: Remove ast.__version__. AST changes can be accounted for by
  checking sys.version_info or sys._mercurial.

7201 7202 7203
- Silence spurious "broken pipe" tracebacks when shutting down a
  ProcessPoolExecutor.

7204 7205 7206
- Fix potential resource leaks in concurrent.futures.ProcessPoolExecutor
  by joining all queues and processes when shutdown() is called.

7207 7208 7209
- Issue #11603: Fix a crash when __str__ is rebound as __repr__.  Patch by
  Andreas Stührk.

7210 7211 7212
- Issue #11321: Fix a crash with multiple imports of the _pickle module when
  embedding Python.  Patch by Andreas Stührk.

7213 7214 7215
- Issue #6755: Add get_wch() method to curses.window class. Patch by Iñigo
  Serna.

7216 7217
- Add cgi.closelog() function to close the log file.

7218 7219
- Issue #12502: asyncore: fix polling loop with AF_UNIX sockets.

7220 7221 7222
- Issue #4376: ctypes now supports nested structures in a endian different than
  the parent structure. Patch by Vlad Riscutia.

7223 7224 7225
- Raise ValueError when attempting to set the _CHUNK_SIZE attribute of a
  TextIOWrapper to a huge value, not TypeError.

7226 7227 7228
- Issue #12504: Close file handles in a timely manner in packaging.database.
  This fixes a bug with the remove (uninstall) feature on Windows.

7229 7230 7231
- Issues #12169 and #10510: Factor out code used by various packaging commands
  to make HTTP POST requests, and make sure it uses CRLF.

7232 7233 7234 7235
- Issue #12016: Multibyte CJK decoders now resynchronize faster. They only
  ignore the first byte of an invalid byte sequence. For example,
  b'\xff\n'.decode('gb2312', 'replace') gives '\ufffd\n' instead of '\ufffd'.

7236 7237 7238 7239
- Issue #12459: time.sleep() now raises a ValueError if the sleep length is
  negative, instead of an infinite sleep on Windows or raising an IOError on
  Linux for example, to have the same behaviour on all platforms.

7240 7241 7242 7243
- Issue #12451: pydoc: html_getfile() now uses tokenize.open() to support
  Python scripts using a encoding different than UTF-8 (read the coding cookie
  of the script).

7244 7245 7246
- Issue #12493: subprocess: Popen.communicate() now also handles EINTR errors
  if the process has only one pipe.

7247 7248 7249
- Issue #12467: warnings: fix a race condition if a warning is emitted at
  shutdown, if globals()['__file__'] is None.

7250 7251 7252
- Issue #12451: pydoc: importfile() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to avoid encoding issues.

7253 7254 7255 7256
- Issue #12451: runpy: run_path() now opens the Python script in binary mode,
  instead of text mode using the locale encoding, to support other encodings
  than UTF-8 (scripts using the coding cookie).

7257 7258 7259
- Issue #12451: xml.dom.pulldom: parse() now opens files in binary mode instead
  of the text mode (using the locale encoding) to avoid encoding issues.

7260 7261 7262
- Issue #12147: Adjust the new-in-3.2 smtplib.send_message method for better
  conformance to the RFCs:  correctly handle Sender and Resent- headers.

7263 7264
- Issue #12352: Fix a deadlock in multiprocessing.Heap when a block is freed by
  the garbage collector while the Heap lock is held.
7265

R David Murray's avatar
R David Murray committed
7266
- Issue #12462: time.sleep() now immediately calls the (Python) signal handler
7267 7268 7269
  if it is interrupted by a signal, instead of having to wait until the next
  instruction.

7270 7271 7272
- Issue #12442: new shutil.disk_usage function, providing total, used and free
  disk space statistics.

7273 7274 7275 7276 7277
- Issue #12451: The XInclude default loader of xml.etree now decodes files from
  UTF-8 instead of the locale encoding if the encoding is not specified. It now
  also opens XML files for the parser in binary mode instead of the text mode
  to avoid encoding issues.

7278 7279 7280
- Issue #12451: doctest.debug_script() doesn't create a temporary file
  anymore to avoid encoding issues.

7281 7282 7283
- Issue #12451: pydoc.synopsis() now reads the encoding cookie if available,
  to read the Python script from the right encoding.

7284 7285 7286
- Issue #12451: distutils now opens the setup script in binary mode to read the
  encoding cookie, instead of opening it in UTF-8.

Ned Deily's avatar
Ned Deily committed
7287 7288 7289 7290
- Issue #9516: On Mac OS X, change Distutils to no longer globally attempt to
  check or set the MACOSX_DEPLOYMENT_TARGET environment variable for the
  interpreter process.  This could cause failures in non-Distutils subprocesses
  and was unreliable since tests or user programs could modify the interpreter
Ezio Melotti's avatar
Ezio Melotti committed
7291
  environment after Distutils set it.  Instead, have Distutils set the
Ned Deily's avatar
Ned Deily committed
7292 7293 7294 7295
  deployment target only in the environment of each build subprocess.  It is
  still possible to globally override the default by setting
  MACOSX_DEPLOYMENT_TARGET before launching the interpreter; its value must be
  greater or equal to the default value, the value with which the interpreter
7296
  was built.  Also, implement the same handling in packaging.
Ned Deily's avatar
Ned Deily committed
7297

7298 7299 7300
- Issue #12422: In the copy module, don't store objects that are their own copy
  in the memo dict.

7301 7302
- Issue #12303: Add sigwaitinfo() and sigtimedwait() to the signal module.

7303 7304 7305
- Issue #12404: Remove C89 incompatible code from mmap module. Patch by Akira
  Kitada.

7306 7307 7308
- Issue #1874: email now detects and reports as a defect the presence of
  any CTE other than 7bit, 8bit, or binary on a multipart.

7309 7310 7311
- Issue #12383: Fix subprocess module with env={}: don't copy the environment
  variables, start with an empty environment.

7312 7313 7314 7315
- Issue #11637: Fix support for importing packaging setup hooks from the
  project directory.

- Issue #6771: Moved the curses.wrapper function from the single-function
7316 7317 7318
  wrapper module into __init__, eliminating the module.  Since __init__ was
  already importing the function to curses.wrapper, there is no API change.

7319
- Issue #11584: email.header.decode_header no longer fails if the header
7320 7321
  passed to it is a Header object, and Header/make_header no longer fail
  if given binary unknown-8bit input.
7322

7323 7324 7325
- Issue #11700: mailbox proxy object close methods can now be called multiple
  times without error.

7326 7327
- Issue #11767: Correct file descriptor leak in mailbox's __getitem__ method.

7328 7329 7330 7331
- Issue #12133: AbstractHTTPHandler.do_open() of urllib.request closes the HTTP
  connection if its getresponse() method fails with a socket error. Patch
  written by Ezio Melotti.

7332 7333 7334
- Issue #12240: Allow multiple setup hooks in packaging's setup.cfg files.
  Original patch by Erik Bray.

7335 7336 7337
- Issue #9284: Allow inspect.findsource() to find the source of doctest
  functions.

7338 7339 7340 7341
- Issue #11595: Fix assorted bugs in packaging.util.cfg_to_args, a
  compatibility helper for the distutils-packaging transition.  Original patch
  by Erik Bray.

7342 7343 7344
- Issue #12287: In ossaudiodev, check that the device isn't closed in several
  methods.

Benjamin Peterson's avatar
Benjamin Peterson committed
7345
- Issue #12009: Fixed regression in netrc file comment handling.
7346

7347 7348 7349 7350
- Issue #12246: Warn and fail when trying to install a third-party project from
  an uninstalled Python (built in a source checkout).  Original patch by
  Tshepang Lekhonkhobe.

7351 7352
- Issue #10694: zipfile now ignores garbage at the end of a zipfile.

7353 7354
- Issue #12283: Fixed regression in smtplib quoting of leading dots in DATA.

7355 7356 7357
- Issue #10424: Argparse now includes the names of the missing required
  arguments in the missing arguments error message.

7358 7359 7360
- Issue #12168: SysLogHandler now allows NUL termination to be controlled using
  a new 'append_nul' attribute on the handler.

7361 7362 7363
- Issue #11583: Speed up os.path.isdir on Windows by using GetFileAttributes
  instead of os.stat.

7364 7365 7366
- Issue #12021: Make mmap's read() method argument optional. Patch by Petri
  Lehtinen.

7367 7368 7369 7370
- Issue #9205: concurrent.futures.ProcessPoolExecutor now detects killed
  children and raises BrokenProcessPool in such a situation.  Previously it
  would reliably freeze/deadlock.

7371
- Issue #12040: Expose a new attribute ``sentinel`` on instances of
Georg Brandl's avatar
Georg Brandl committed
7372 7373
  ``multiprocessing.Process``.  Also, fix Process.join() to not use polling
  anymore, when given a timeout.
7374

7375 7376 7377
- Issue #11893: Remove obsolete internal wrapper class ``SSLFakeFile`` in the
  smtplib module.  Patch by Catalin Iacob.

7378 7379 7380
- Issue #12080: Fix a Decimal.power() case that took an unreasonably long time
  to compute.

7381 7382 7383 7384
- Issue #12221: Remove __version__ attributes from pyexpat, pickle, tarfile,
  pydoc, tkinter, and xml.parsers.expat. This were useless version constants
  left over from the Mercurial transition

Raymond Hettinger's avatar
merge  
Raymond Hettinger committed
7385
- Named tuples now work correctly with vars().
7386

7387 7388 7389 7390
- Issue #12085: Fix an attribute error in subprocess.Popen destructor if the
  constructor has failed, e.g. because of an undeclared keyword argument. Patch
  written by Oleg Oshmyan.

7391
- Issue #12028: Make threading._get_ident() public, rename it to
Victor Stinner's avatar
Victor Stinner committed
7392
  threading.get_ident() and document it. This function was already used using
7393 7394
  _thread.get_ident().

7395 7396 7397
- Issue #12171: IncrementalEncoder.reset() of CJK codecs (multibytecodec) calls
  encreset() instead of decreset().

7398 7399
- Issue #12218: Removed wsgiref.egg-info.

7400
- Issue #12196: Add pipe2() to the os module.
7401

7402 7403 7404
- Issue #985064: Make plistlib more resilient to faulty input plists.
  Patch by Mher Movsisyan.

7405 7406 7407
- Issue #1625: BZ2File and bz2.decompress() now support multi-stream files.
  Initial patch by Nir Aides.

7408 7409
- Issue #12175: BufferedReader.read(-1) now calls raw.readall() if available.

7410 7411 7412
- Issue #12175: FileIO.readall() now only reads the file position and size
  once.

7413 7414 7415 7416 7417 7418
- Issue #12175: RawIOBase.readall() now returns None if read() returns None.

- Issue #12175: FileIO.readall() now raises a ValueError instead of an IOError
  if the file is closed.

- Issue #11109: New service_action method for BaseServer, used by ForkingMixin
7419
  class for cleanup. Initial Patch by Justin Warkentin.
7420 7421 7422

- Issue #12045: Avoid duplicate execution of command in
  ctypes.util._get_soname().  Patch by Sijin Joseph.
Senthil Kumaran's avatar
Senthil Kumaran committed
7423

7424 7425 7426
- Issue #10818: Remove the Tk GUI and the serve() function of the pydoc module,
  pydoc -g has been deprecated in Python 3.2 and it has a new enhanced web
  server.
7427

7428 7429 7430
- Issue #1441530: In imaplib, read the data in one chunk to speed up large
  reads and simplify code.

7431 7432 7433
- Issue #12070: Fix the Makefile parser of the sysconfig module to handle
  correctly references to "bogus variable" (e.g. "prefix=$/opt/python").

7434 7435 7436 7437
- Issue #12100: Don't reset incremental encoders of CJK codecs at each call to
  their encode() method anymore, but continue to call the reset() method if the
  final argument is True.

7438 7439 7440
- Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl
  module.

7441 7442 7443
- Issue #6501: os.device_encoding() returns None on Windows if the application
  has no console.

7444 7445
- Issue #12105: Add O_CLOEXEC to the os module.

7446 7447 7448 7449
- Issue #12079: Decimal('Infinity').fma(Decimal('0'), (3.91224318126786e+19+0j))
  now raises TypeError (reflecting the invalid type of the 3rd argument) rather
  than Decimal.InvalidOperation.

7450 7451 7452
- Issue #12124: zipimport doesn't keep a reference to zlib.decompress() anymore
  to be able to unload the module.

7453 7454
- Add the packaging module, an improved fork of distutils (also known as
  distutils2).
7455

7456 7457 7458
- Issue #12065: connect_ex() on an SSL socket now returns the original errno
  when the socket's timeout expires (it used to return None).

7459 7460 7461 7462
- Issue #8809: The SMTP_SSL constructor and SMTP.starttls() now support
  passing a ``context`` argument pointing to an ssl.SSLContext instance.
  Patch by Kasun Herath.

7463 7464 7465
- Issue #9516: Issue #9516: avoid errors in sysconfig when MACOSX_DEPLOYMENT_TARGET
  is set in shell.

7466 7467 7468 7469 7470
- Issue #8650: Make zlib module 64-bit clean. compress(), decompress() and
  their incremental counterparts now raise OverflowError if given an input
  larger than 4GB, instead of silently truncating the input and returning
  an incorrect result.

7471 7472 7473
- Issue #12050: zlib.decompressobj().decompress() now clears the unconsumed_tail
  attribute when called without a max_length argument.

7474 7475 7476 7477 7478
- Issue #12062: Fix a flushing bug when doing a certain type of I/O sequence
  on a file opened in read+write mode (namely: reading, seeking a bit forward,
  writing, then seeking before the previous write but still within buffered
  data, and writing again).

7479 7480 7481
- Issue #9971: Write an optimized implementation of BufferedReader.readinto().
  Patch by John O'Connor.

7482 7483 7484 7485
- Issue #11799: urllib.request Authentication Handlers will raise a ValueError
  when presented with an unsupported Authentication Scheme. Patch contributed
  by Yuval Greenfield.

7486 7487 7488 7489 7490
- Issue #10419, #6011: build_scripts command of distutils handles correctly
  non-ASCII path (path to the Python executable). Open and write the script in
  binary mode, but ensure that the shebang is decodable from UTF-8 and from the
  encoding of the script.

7491 7492 7493
- Issue #8498: In socket.accept(), allow to specify 0 as a backlog value in
  order to accept exactly one connection.  Patch by Daniel Evers.

7494 7495 7496
- Issue #12011: signal.signal() and signal.siginterrupt() raise an OSError,
  instead of a RuntimeError: OSError has an errno attribute.

R David Murray's avatar
R David Murray committed
7497 7498 7499
- Issue #3709: add a flush_headers method to BaseHTTPRequestHandler, which
  manages the sending of headers to output stream and flushing the internal
  headers buffer. Patch contribution by Andrew Schaaf
7500

7501 7502
- Issue #11743: Rewrite multiprocessing connection classes in pure Python.

7503 7504
- Issue #11164: Stop trying to use _xmlplus in the xml module.

7505 7506 7507
- Issue #11888: Add log2 function to math module. Patch written by Mark
  Dickinson.

7508 7509
- Issue #12012: ssl.PROTOCOL_SSLv2 becomes optional.

7510 7511 7512 7513
- Issue #8407: The signal handler writes the signal number as a single byte
  instead of a nul byte into the wakeup file descriptor. So it is possible to
  wait more than one signal and know which signals were raised.

7514 7515 7516
- Issue #8407: Add pthread_kill(), sigpending() and sigwait() functions to the
  signal module.

7517 7518 7519
- Issue #11927: SMTP_SSL now uses port 465 by default as documented.  Patch
  by Kasun Herath.

Giampaolo Rodola''s avatar
Giampaolo Rodola' committed
7520
- Issue #12002: ftplib's abort() method raises TypeError.
7521

Ezio Melotti's avatar
Ezio Melotti committed
7522
- Issue #11916: Add a number of MacOSX specific definitions to the errno module.
7523 7524
  Patch by Pierre Carrier.

7525
- Issue #11999: fixed sporadic sync failure mailbox.Maildir due to its trying to
7526 7527 7528
  detect mtime changes by comparing to the system clock instead of to the
  previous value of the mtime.

7529 7530
- Issue #11072: added MLSD command (RFC-3659) support to ftplib.

7531 7532 7533 7534
- Issue #8808: The IMAP4_SSL constructor now allows passing an SSLContext
  parameter to control parameters of the secure channel.  Patch by Sijin
  Joseph.

7535 7536 7537
- ntpath.samefile failed to notice that "a.txt" and "A.TXT" refer to the same
  file on Windows XP. As noticed in issue #10684.

7538 7539 7540 7541
- Issue #12000: When a SSL certificate has a subjectAltName without any
  dNSName entry, ssl.match_hostname() should use the subject's commonName.
  Patch by Nicolas Bareil.

7542 7543 7544 7545
- Issue #10775: assertRaises, assertRaisesRegex, assertWarns, and
  assertWarnsRegex now accept a keyword argument 'msg' when used as context
  managers.  Initial patch by Winston Ewert.

Ronald Oussoren's avatar
Ronald Oussoren committed
7546 7547 7548 7549
- Issue #10684: shutil.move used to delete a folder on case insensitive
  filesystems when the source and destination name where the same except
  for the case.

7550 7551 7552 7553
- Issue #11647: objects created using contextlib.contextmanager now support
  more than one call to the function when used as a decorator. Initial patch
  by Ysj Ray.

7554 7555 7556
- Issue #11930: Removed deprecated time.accept2dyear variable.
  Removed year >= 1000 restriction from datetime.strftime.

7557 7558
- logging: don't define QueueListener if Python has no thread support.

7559 7560
- functools.cmp_to_key() now works with collections.Hashable().

7561 7562 7563
- Issue #11277: mmap.mmap() calls fcntl(fd, F_FULLFSYNC) on Mac OS X to get
  around a mmap bug with sparse files. Patch written by Steffen Daode Nurpmeso.

7564 7565 7566
- Issue #8407: Add signal.pthread_sigmask() function to fetch and/or change the
  signal mask of the calling thread.

7567 7568 7569 7570 7571
- Issue #11858: configparser.ExtendedInterpolation expected lower-case section
  names.

- Issue #11324: ConfigParser(interpolation=None) now works correctly.

7572 7573 7574
- Issue #11811: ssl.get_server_certificate() is now IPv6-compatible.  Patch
  by Charles-François Natali.

7575 7576 7577
- Issue #11763: don't use difflib in TestCase.assertMultiLineEqual if the
  strings are too long.

7578 7579
- Issue #11236: getpass.getpass responds to ctrl-c or ctrl-z on terminal.

7580 7581
- Issue #11856: Speed up parsing of JSON numbers.

7582
- Issue #11005: threading.RLock()._release_save() raises a RuntimeError if the
7583 7584
  lock was not acquired.

7585 7586 7587
- Issue #11258: Speed up ctypes.util.find_library() under Linux by a factor
  of 5 to 10.  Initial patch by Jonas H.

7588 7589 7590
- Issue #11382: Trivial system calls, such as dup() or pipe(), needn't
  release the GIL.  Patch by Charles-François Natali.

7591 7592 7593
- Issue #11223: Add threading._info() function providing informations about
  the thread implementation.

7594 7595 7596
- Issue #11731: simplify/enhance email parser/generator API by introducing
  policy objects.

7597 7598 7599 7600
- Issue #11768: The signal handler of the signal module only calls
  Py_AddPendingCall() for the first signal to fix a deadlock on reentrant or
  parallel calls. PyErr_SetInterrupt() writes also into the wake up file.

7601 7602
- Issue #11492: fix several issues with header folding in the email package.

7603 7604
- Issue #11852: Add missing imports and update tests.

7605 7606 7607
- Issue #11875: collections.OrderedDict's __reduce__ was temporarily
  mutating the object instead of just working on a copy.

7608
- Issue #11467: Fix urlparse behavior when handling urls which contains scheme
7609 7610
  specific part only digits. Patch by Santoso Wijaya.

7611 7612
- collections.Counter().copy() now works correctly for subclasses.

7613 7614 7615
- Issue #11474: Fix the bug with url2pathname() handling of '/C|/' on Windows.
  Patch by Santoso Wijaya.

7616 7617
- Issue #11684: complete email.parser bytes API by adding BytesHeaderParser.

7618 7619
- The bz2 module now handles 4GiB+ input buffers correctly.

Ezio Melotti's avatar
Ezio Melotti committed
7620 7621
- Issue #9233: Fix json.loads('{}') to return a dict (instead of a list), when
  _json is not available.
7622

Ezio Melotti's avatar
Ezio Melotti committed
7623
- Issue #11830: Remove unnecessary introspection code in the decimal module.
7624 7625

- Issue #11703: urllib2.geturl() does not return correct url when the original
7626
  url contains #fragment.
7627

7628 7629 7630
- Issue #10019: Fixed regression in json module where an indent of 0 stopped
  adding newlines and acted instead like 'None'.

7631 7632 7633
- Issue #11186: pydoc ignores a module if its name contains a surrogate
  character in the index of modules.

7634 7635 7636
- Issue #11815: Use a light-weight SimpleQueue for the result queue in
  concurrent.futures.ProcessPoolExecutor.

brian.curtin's avatar
brian.curtin committed
7637 7638 7639
- Issue #5162: Treat services like frozen executables to allow child spawning
  from multiprocessing.forking on Windows.

7640 7641 7642 7643
- logging.basicConfig now supports an optional 'handlers' argument taking an
  iterable of handlers to be added to the root logger. Additional parameter
  checks were also added to basicConfig.

7644 7645
- Issue #11814: Fix likely typo in multiprocessing.Pool._terminate().

7646 7647 7648
- Issue #11747: Fix range formatting in difflib.context_diff() and
  difflib.unified_diff().

7649 7650 7651 7652
- Issue #8428: Fix a race condition in multiprocessing.Pool when terminating
  worker processes: new processes would be spawned while the pool is being
  shut down.  Patch by Charles-François Natali.

7653 7654
- Issue #2650: re.escape() no longer escapes the '_'.

7655 7656 7657 7658
- Issue #11757: select.select() now raises ValueError when a negative timeout
  is passed (previously, a select.error with EINVAL would be raised).  Patch
  by Charles-François Natali.

7659 7660
- Issue #7311: fix html.parser to accept non-ASCII attribute values.

Georg Brandl's avatar
Georg Brandl committed
7661
- Issue #11605: email.parser.BytesFeedParser was incorrectly converting
Éric Araujo's avatar
Éric Araujo committed
7662
  multipart subparts with an 8-bit CTE into unicode instead of preserving the
Georg Brandl's avatar
Georg Brandl committed
7663
  bytes.
7664

Éric Araujo's avatar
Éric Araujo committed
7665 7666
- Issue #1690608: email.util.formataddr is now RFC 2047 aware:  it now has a
  charset parameter that defaults to utf-8 and is used as the charset for RFC
7667 7668
  2047 encoding when the realname contains non-ASCII characters.

7669 7670
- Issue #10963: Ensure that subprocess.communicate() never raises EPIPE.

7671 7672 7673
- Issue #10791: Implement missing method GzipFile.read1(), allowing GzipFile
  to be wrapped in a TextIOWrapper.  Patch by Nadeem Vawda.

7674 7675 7676
- Issue #11707: Added a fast C version of functools.cmp_to_key().
  Patch by Filip Gruszczyński.

7677 7678 7679
- Issue #11688: Add sqlite3.Connection.set_trace_callback().  Patch by
  Torsten Landschoff.

7680 7681 7682
- Issue #11746: Fix SSLContext.load_cert_chain() to accept elliptic curve
  private keys.

7683 7684 7685 7686
- Issue #5863: Rewrite BZ2File in pure Python, and allow it to accept
  file-like objects using a new ``fileobj`` constructor argument.  Patch by
  Nadeem Vawda.

7687 7688
- unittest.TestCase.assertSameElements has been removed.

7689 7690 7691
- sys.getfilesystemencoding() raises a RuntimeError if initfsencoding() was not
  called yet: detect bootstrap (startup) issues earlier.

7692 7693
- Issue #11393: Add the new faulthandler module.

7694 7695
- Issue #11618: Fix the timeout logic in threading.Lock.acquire() under Windows.

7696 7697 7698
- Removed the 'strict' argument to email.parser.Parser, which has been
  deprecated since Python 2.4.

7699 7700 7701
- Issue #11256: Fix inspect.getcallargs on functions that take only keyword
  arguments.

7702 7703
- Issue #11696: Fix ID generation in msilib.

7704 7705 7706
- itertools.accumulate now supports an optional *func* argument for
  a user-supplied binary function.

7707 7708
- Issue #11692: Remove unnecessary demo functions in subprocess module.

7709 7710 7711
- Issue #9696: Fix exception incorrectly raised by xdrlib.Packer.pack_int when
  trying to pack a negative (in-range) integer.

7712 7713 7714 7715
- Issue #11675: multiprocessing.[Raw]Array objects created from an integer size
  are now zeroed on creation.  This matches the behaviour specified by the
  documentation.

Martin v. Löwis's avatar
Martin v. Löwis committed
7716
- Issue #7639: Fix short file name generation in bdist_msi
7717

7718 7719 7720
- Issue #11635: Don't use polling in worker threads and processes launched by
  concurrent.futures.

7721 7722 7723
- Issue #5845: Automatically read readline configuration to enable completion
  in interactive mode.

7724 7725 7726 7727
- Issue #6811: Allow importlib to change a code object's co_filename attribute
  to match the path to where the source code currently is, not where the code
  object originally came from.

7728 7729
- Issue #8754: Have importlib use the repr of a module name in error messages.

7730 7731 7732
- Issue #11591: Prevent "import site" from modifying sys.path when python
  was started with -S.

7733 7734 7735 7736 7737
- collections.namedtuple() now adds a _source attribute to the generated
  class.  This make the source more accessible than the outdated
  "verbose" option which prints to stdout but doesn't make the source
  string available.

7738 7739 7740
- Issue #11371: Mark getopt error messages as localizable.  Patch by Filip
  Gruszczyński.

7741 7742
- Issue #11333: Add __slots__ to collections ABCs.

7743
- Issue #11628: cmp_to_key generated class should use __slots__.
7744

7745 7746 7747
- Issue #11666: let help() display named tuple attributes and methods
  that start with a leading underscore.

Guido van Rossum's avatar
Guido van Rossum committed
7748 7749 7750
- Issue #11662: Make urllib and urllib2 ignore redirections if the
  scheme is not HTTP, HTTPS or FTP (CVE-2011-1521).

7751 7752 7753
- Issue #5537: Fix time2isoz() and time2netscape() functions of
  httplib.cookiejar for expiration year greater than 2038 on 32-bit systems.

7754 7755
- Issue #4391: Use proper gettext plural forms in optparse.

7756 7757
- Issue #11127: Raise a TypeError when trying to pickle a socket object.

7758
- Issue #11563: ``Connection: close`` header is sent by requests using URLOpener
Senthil Kumaran's avatar
Senthil Kumaran committed
7759 7760 7761
  class which helps in closing of sockets after connection is over. Patch
  contributions by Jeff McNeil and Nadeem Vawda.

7762 7763 7764
- Issue #11459: A ``bufsize`` value of 0 in subprocess.Popen() really creates
  unbuffered pipes, such that select() works properly on them.

7765 7766
- Issue #5421: Fix misleading error message when one of socket.sendto()'s
  arguments has the wrong type.  Patch by Nikita Vetoshkin.
7767

7768
- Issue #10812: Add some extra posix functions to the os module.
7769 7770 7771 7772

- Issue #10979: unittest stdout buffering now works with class and module
  setup and teardown.

7773 7774 7775
- Issue #11243: fix the parameter querying methods of Message to work if
  the headers contain un-encoded non-ASCII data.

7776 7777 7778
- Issue #11401: fix handling of headers with no value; this fixes a regression
  relative to Python2 and the result is now the same as it was in Python2.

7779 7780 7781 7782
- Issue #9298: base64 bodies weren't being folded to line lengths less than 78,
  which was a regression relative to Python2.  Unlike Python2, the last line
  of the folded body now ends with a carriage return.

Nick Coghlan's avatar
Nick Coghlan committed
7783
- Issue #11560: shutil.unpack_archive now correctly handles the format
Nick Coghlan's avatar
Nick Coghlan committed
7784 7785
  parameter. Patch by Evan Dandrea.

7786 7787
- Issue #5870: Add `subprocess.DEVNULL` constant.

7788
- Issue #11133: fix two cases where inspect.getattr_static can trigger code
Benjamin Peterson's avatar
Benjamin Peterson committed
7789
  execution. Patch by Andreas Stührk.
7790

7791 7792 7793 7794
- Issue #11569: use absolute path to the sysctl command in multiprocessing to
  ensure that it will be found regardless of the shell PATH. This ensures
  that multiprocessing.cpu_count works on default installs of MacOSX.

7795 7796 7797 7798
- Issue #11501: disutils.archive_utils.make_zipfile no longer fails if zlib is
  not installed. Instead, the zipfile.ZIP_STORED compression is used to create
  the ZipFile. Patch by Natalia B. Bidart.

7799
- Issue #11289: `smtp.SMTP` class is now a context manager so it can be used
7800 7801
  in a `with` statement.  Contributed by Giampaolo Rodola.

7802 7803 7804
- Issue #11554: Fixed support for Japanese codecs; previously the body output
  encoding was not done if euc-jp or shift-jis was specified as the charset.

7805 7806 7807
- Issue #11407: `TestCase.run` returns the result object used or created.
  Contributed by Janathan Hartley.

7808
- Issue #11500: Fixed a bug in the OS X proxy bypass code for fully qualified
Antoine Pitrou's avatar
Antoine Pitrou committed
7809
  IP addresses in the proxy exception list.
7810

7811 7812 7813 7814
- Issue #11491: dbm.error is no longer raised when dbm.open is called with
  the "n" as the flag argument and the file exists. The behavior matches
  the documentation and general logic.

Éric Araujo's avatar
Éric Araujo committed
7815
- Issue #1162477: Postel Principle adjustment to email date parsing: handle the
7816 7817
  fact that some non-compliant MUAs use '.' instead of ':' in time specs.

7818 7819 7820
- Issue #11131: Fix sign of zero in decimal.Decimal plus and minus
  operations when the rounding mode is ROUND_FLOOR.

7821 7822
- Issue #9935: Speed up pickling of instances of user-defined classes.

7823 7824 7825
- Issue #5622: Fix curses.wrapper to raise correct exception if curses
  initialization fails.

7826 7827 7828
- Issue #11408: In threading.Lock.acquire(), only call gettimeofday() when
  really necessary.  Patch by Charles-François Natali.

7829 7830 7831 7832
- Issue #11391: Writing to a mmap object created with
  ``mmap.PROT_READ|mmap.PROT_EXEC`` would segfault instead of raising a
  TypeError.  Patch by Charles-François Natali.

7833 7834
- Issue #9795: add context manager protocol support for nntplib.NNTP class.

7835 7836 7837 7838
- Issue #11306: mailbox in certain cases adapts to an inability to open
  certain files in read-write mode.  Previously it detected this by
  checking for EACCES, now it also checks for EROFS.

7839 7840 7841
- Issue #11265: asyncore now correctly handles EPIPE, EBADF and EAGAIN errors
  on accept(), send() and recv().

7842 7843
- Issue #11377: Deprecate platform.popen() and reimplement it with os.popen().

7844 7845
- Issue #8513: On UNIX, subprocess supports bytes command string.

7846 7847
- Issue #10866: Add socket.sethostname().  Initial patch by Ross Lagerwall.

7848 7849
- Issue #11140: Lock.release() now raises a RuntimeError when attempting
  to release an unacquired lock, as claimed in the threading documentation.
Antoine Pitrou's avatar
Antoine Pitrou committed
7850
  The _thread.error exception is now an alias of RuntimeError.  Patch by
7851
  Filip Gruszczyński.  Patch for _dummy_thread by Aymeric Augustin.
7852

7853
- Issue #8594: ftplib now provides a source_address parameter to specify which
7854 7855
  (address, port) to bind to before connecting.

7856 7857 7858
- Issue #11326: Add the missing connect_ex() implementation for SSL sockets,
  and make it work for non-blocking connects.

7859 7860
- Issue #11297: Add collections.ChainMap().

7861
- Issue #10755: Add the posix.flistdir() function.  Patch by Ross Lagerwall.
7862

Georg Brandl's avatar
Georg Brandl committed
7863 7864
- Issue #4761: Add the ``*at()`` family of functions (openat(), etc.) to the
  posix module.  Patch by Ross Lagerwall.
7865

7866 7867 7868
- Issue #7322: Trying to read from a socket's file-like object after a timeout
  occurred now raises an error instead of silently losing data.

7869
- Issue #11291: poplib.POP no longer suppresses errors on quit().
7870

7871
- Issue #11177: asyncore's create_socket() arguments can now be omitted.
7872

7873 7874 7875 7876 7877
- Issue #6064: Add a ``daemon`` keyword argument to the threading.Thread
  and multiprocessing.Process constructors in order to override the
  default behaviour of inheriting the daemonic property from the current
  thread/process.

7878 7879 7880
- Issue #10956: Buffered I/O classes retry reading or writing after a signal
  has arrived and the handler returned successfully.

7881 7882
- Issue #10784: New os.getpriority() and os.setpriority() functions.

7883 7884 7885 7886
- Issue #11114: Fix catastrophic performance of tell() on text files (up
  to 1000x faster in some cases).  It is still one to two order of magnitudes
  slower than binary tell().

7887
- Issue #10882: Add os.sendfile function.
7888

7889 7890 7891
- Issue #10868: Allow usage of the register method of an ABC as a class
  decorator.

7892 7893 7894 7895
- Issue #11224: Fixed a regression in tarfile that affected the file-like
  objects returned by TarFile.extractfile() regarding performance, memory
  consumption and failures with the stream interface.

7896 7897 7898 7899
- Issue #10924: Adding salt and Modular Crypt Format to crypt library.
  Moved old C wrapper to _crypt, and added a Python wrapper with
  enhanced salt generation and simpler API for password generation.

7900 7901
- Issue #11074: Make 'tokenize' so it can be reloaded.

7902 7903 7904 7905 7906
- Issue #11085: Moved collections abstract base classes into a separate
  module called collections.abc, following the pattern used by importlib.abc.
  For backwards compatibility, the names are imported into the collections
  module.

7907 7908 7909 7910
- Issue #4681: Allow mmap() to work on file sizes and offsets larger than
  4GB, even on 32-bit builds.  Initial patch by Ross Lagerwall, adapted for
  32-bit Windows.

7911 7912 7913
- Issue #11169: compileall module uses repr() to format filenames and paths to
  escape surrogate characters and show spaces.

7914
- Issue #11089: Fix performance issue limiting the use of ConfigParser()
7915
  with large config files.
7916

7917 7918 7919
- Issue #10276: Fix the results of zlib.crc32() and zlib.adler32() on buffers
  larger than 4GB.  Patch by Nadeem Vawda.

7920 7921
- Issue #11388: Added a clear() method to MutableSequence

7922 7923 7924
- Issue #11174: Add argparse.MetavarTypeHelpFormatter, which uses type names
  for the names of optional and positional arguments in help messages.

7925 7926
- Issue #9348: Raise an early error if argparse nargs and metavar don't match.

7927 7928
- Issue #9026: Fix order of argparse sub-commands in help messages.

7929 7930
- Issue #9347: Fix formatting for tuples in argparse type= error messages.

7931 7932 7933
- Issue #12191: Added shutil.chown() to change user and/or group owner of a
  given path also specifying their names.

7934 7935 7936
- Issue #13988: The _elementtree accelerator is used whenever available.
  Now xml.etree.cElementTree becomes a deprecated alias to ElementTree.

7937 7938 7939
Build
-----

Martin v. Löwis's avatar
Martin v. Löwis committed
7940 7941
- Issue #6807: Run msisupport.mak earlier.

Martin v. Löwis's avatar
Martin v. Löwis committed
7942 7943
- Issue #10580: Minor grammar change in Windows installer.

7944 7945
- Issue #13326: Clean __pycache__ directories correctly on OpenBSD.

7946 7947
- PEP 393: the configure option --with-wide-unicode is removed.

7948 7949 7950
- Issue #12852: Set _XOPEN_SOURCE to 700, instead of 600, to get POSIX 2008
  functions on OpenBSD (e.g. fdopendir).

7951 7952 7953 7954
- Issue #11863: Remove support for legacy systems deprecated in Python 3.2
  (following PEP 11).  These systems are systems using Mach C Threads,
  SunOS lightweight processes, GNU pth threads and IRIX threads.

7955 7956
- Issue #8746: Correct faulty configure checks so that os.chflags() and
  os.lchflags() are once again built on systems that support these
Georg Brandl's avatar
Georg Brandl committed
7957
  functions (BSD and OS X).  Also add new stat file flags for OS X
7958 7959
  (UF_HIDDEN and UF_COMPRESSED).

7960
- Issue #10645: Installing Python no longer creates a
7961 7962
  Python-X.Y.Z-pyX.Y.egg-info file in the lib-dynload directory.

7963 7964 7965
- Do not accidentally include the directory containing sqlite.h twice when
  building sqlite3.

7966 7967 7968 7969
- Issue #11217: For 64-bit/32-bit Mac OS X universal framework builds,
  ensure "make install" creates symlinks in --prefix bin for the "-32"
  files in the framework bin directory like the installer does.

7970
- Issue #11347: Use --no-as-needed when linking libpython3.so.
7971

Thomas Wouters's avatar
Thomas Wouters committed
7972
- Issue #11411: Fix 'make DESTDIR=' with a relative destination.
Georg Brandl's avatar
Georg Brandl committed
7973

7974 7975
- Issue #11268: Prevent Mac OS X Installer failure if Documentation
  package had previously been installed.
7976

7977
- Issue #11495: OSF support is eliminated. It was deprecated in Python 3.2.
7978

7979 7980 7981
IDLE
----

7982 7983 7984 7985 7986 7987 7988 7989 7990 7991 7992 7993 7994 7995 7996 7997 7998 7999 8000 8001 8002 8003 8004 8005 8006 8007 8008 8009 8010 8011 8012 8013 8014 8015 8016 8017 8018 8019 8020 8021 8022 8023 8024 8025 8026 8027 8028 8029 8030 8031 8032 8033
- Issue #14409: IDLE now properly executes commands in the Shell window
  when it cannot read the normal config files on startup and
  has to use the built-in default key bindings.
  There was previously a bug in one of the defaults.

- IDLE can be launched as python -m idlelib

- Issue #3573: IDLE hangs when passing invalid command line args
  (directory(ies) instead of file(s)) (Patch by Guilherme Polo)

- Issue #14200: IDLE shell crash on printing non-BMP unicode character.

- Issue #5219: Prevent event handler cascade in IDLE.

- Issue #964437: Make IDLE help window non-modal.
  Patch by Guilherme Polo and Roger Serwy.

- Issue #13933: IDLE auto-complete did not work with some imported
  module, like hashlib.  (Patch by Roger Serwy)

- Issue #13506: Add '' to path for IDLE Shell when started and restarted with Restart Shell.
  Original patches by Marco Scataglini and Roger Serwy.

- Issue #4625: If IDLE cannot write to its recent file or breakpoint files,
  display a message popup and continue rather than crash.  Original patch by
  Roger Serwy.

- Issue #8641: Update IDLE 3 syntax coloring to recognize b".." and not u"..".
  Patch by Tal Einat.

- Issue #13296: Fix IDLE to clear compile __future__ flags on shell restart.
  (Patch by Roger Serwy)

- Issue #9871: Prevent IDLE 3 crash when given byte stings
  with invalid hex escape sequences, like b'\x0'.
  (Original patch by Claudiu Popa.)

- Issue #12636: IDLE reads the coding cookie when executing a Python script.

- Issue #12540: Prevent zombie IDLE processes on Windows due to changes
  in os.kill().

- Issue #12590: IDLE editor window now always displays the first line
  when opening a long file.  With Tk 8.5, the first line was hidden.

- Issue #11088: don't crash when using F5 to run a script in IDLE on MacOSX
  with Tk 8.5.

- Issue #1028: Tk returns invalid Unicode null in %A: UnicodeDecodeError.
  With Tk < 8.5 _tkinter.c:PythonCmd() raised UnicodeDecodeError, caused
  IDLE to exit.  Converted to valid Unicode null in PythonCmd().

8034 8035
- Issue #11718: IDLE's open module dialog couldn't find the __init__.py
  file in a package.
8036

8037 8038 8039
Tools/Demos
-----------

8040 8041 8042
- Issue #14053: patchcheck.py ("make patchcheck") now works with MQ patches.
  Patch by Francisco Martín Brugué.

8043 8044 8045 8046 8047
- Issue #13930: 2to3 is now able to write its converted output files to another
  directory tree as well as copying unchanged files and altering the file
  suffix.  See its new -o, -W and --add-suffix options.  This makes it more
  useful in many automated code translation workflows.

8048 8049 8050
- Issue #13628: python-gdb.py is now able to retrieve more frames in the Python
  traceback if Python is optimized.

8051 8052 8053
- Issue #11996: libpython (gdb), replace "py-bt" command by "py-bt-full" and
  add a smarter "py-bt" command printing a classic Python traceback.

8054 8055
- Issue #11179: Make ccbench work under Python 3.1 and 2.7 again.

8056 8057
- Issue #10639: reindent.py no longer converts newlines and will raise
  an error if attempting to convert a file with mixed newlines.
8058
  "--newline" option added to specify new line character.
8059

Ezio Melotti's avatar
Ezio Melotti committed
8060 8061
Extension Modules
-----------------
8062

8063 8064 8065 8066
- Issue #16847: Fixed improper use of _PyUnicode_CheckConsistency() in
  non-pydebug builds. Several extension modules now compile cleanly when
  assert()s are enabled in standard builds (-DDEBUG flag).

8067 8068 8069
- Issue #13840: The error message produced by ctypes.create_string_buffer
  when given a Unicode string has been fixed.

8070 8071 8072
- Issue #9975: socket: Fix incorrect use of flowinfo and scope_id. Patch by
  Vilmos Nebehaj.

8073 8074
- Issue #7777: socket: Add Reliable Datagram Sockets (PF_RDS) support.

8075 8076 8077
- Issue #13159: FileIO and BZ2Compressor/BZ2Decompressor now use a linear-time
  buffer growth strategy instead of a quadratic-time one.

8078 8079 8080
- Issue #10141: socket: Add SocketCAN (PF_CAN) support. Initial patch by
  Matthias Fuchs, updated by Tiago Gonçalves.

8081 8082 8083 8084
- Issue #13070: Fix a crash when a TextIOWrapper caught in a reference cycle
  would be finalized after the reference to its underlying BufferedRWPair's
  writer got cleared by the GC.

8085 8086
- Issue #12881: ctypes: Fix segfault with large structure field names.

8087 8088 8089
- Issue #13058: ossaudiodev: fix a file descriptor leak on error. Patch by
  Thomas Jarosch.

8090 8091 8092
- Issue #13013: ctypes: Fix a reference leak in PyCArrayType_from_ctype.
  Thanks to Suman Saha for finding the bug and providing a patch.

8093 8094 8095
- Issue #13022: Fix: _multiprocessing.recvfd() doesn't check that
  file descriptor was actually received.

8096 8097 8098
- Issue #1172711: Add 'long long' support to the array module.
  Initial patch by Oren Tirosh and Hirokazu Yamamoto.

8099 8100 8101
- Issue #12483: ctypes: Fix a crash when the destruction of a callback
  object triggers the garbage collector.

Jesus Cea's avatar
NEWS  
Jesus Cea committed
8102 8103 8104
- Issue #12950: Fix passing file descriptors in multiprocessing, under
  OpenIndiana/Illumos.

8105 8106 8107
- Issue #12764: Fix a crash in ctypes when the name of a Structure field is not
  a string.

Amaury Forgeot d'Arc's avatar
Amaury Forgeot d'Arc committed
8108 8109 8110 8111 8112
- Issue #11241: subclasses of ctypes.Array can now be subclassed.

- Issue #9651: Fix a crash when ctypes.create_string_buffer(0) was passed to
  some functions like file.write().

8113 8114 8115 8116
- Issue #10309: Define _GNU_SOURCE so that mremap() gets the proper
  signature.  Without this, architectures where sizeof void* != sizeof int are
  broken.  Patch given by Hallvard B Furuseth.

Ezio Melotti's avatar
Ezio Melotti committed
8117 8118
- Issue #12051: Fix segfault in json.dumps() while encoding highly-nested
  objects using the C accelerations.
8119

Ezio Melotti's avatar
Ezio Melotti committed
8120 8121
- Issue #12017: Fix segfault in json.loads() while decoding highly-nested
  objects using the C accelerations.
8122

Benjamin Peterson's avatar
Benjamin Peterson committed
8123 8124
- Issue #1838: Prevent segfault in ctypes, when _as_parameter_ on a class is set
  to an instance of the class.
8125

8126
Tests
8127
-----
8128

8129 8130 8131 8132 8133 8134 8135 8136 8137 8138 8139 8140 8141 8142 8143 8144 8145 8146 8147 8148 8149 8150 8151 8152 8153 8154 8155
- Issue #13125: Silence spurious test_lib2to3 output when in non-verbose mode.
  Patch by Mikhail Novikov.

- Issue #13447: Add a test file to host regression tests for bugs in the
  scripts found in the Tools directory.

- Issue #10881: Fix test_site failure with OS X framework builds.

- Issue #13901: Prevent test_distutils failures on OS X with --enable-shared.

- Issue #13862: Fix spurious failure in test_zlib due to runtime/compile time
  minor versions not matching.

- Issue #12804: Fix test_socket and test_urllib2net failures when running tests
  on a system without internet access.

- Issue #13726: Fix the ambiguous -S flag in regrtest. It is -o/--slow for slow
  tests.

- Issue #11659: Fix ResourceWarning in test_subprocess introduced by #11459.
  Patch by Ben Hayden.

- Issue #11577: fix ResourceWarning triggered by improved binhex test coverage

- Issue #11509: Significantly increase test coverage of fileinput.
  Patch by Denver Coneybeare at PyCon 2011 Sprints.

Petri Lehtinen's avatar
Petri Lehtinen committed
8156 8157
- Issue #11689: Fix a variable scoping error in an sqlite3 test

8158 8159
- Issue #13786: Remove unimplemented 'trace' long option from regrtest.py.

Meador Inge's avatar
Meador Inge committed
8160 8161 8162
- Issue #13725: Fix regrtest to recognize the documented -d flag.
  Patch by Erno Tukia.

8163 8164 8165
- Issue #13304: Skip test case if user site-packages disabled (-s or
  PYTHONNOUSERSITE).  (Patch by Carl Meyer)

8166 8167 8168
- Issue #5661: Add a test for ECONNRESET/EPIPE handling to test_asyncore. Patch
  by Xavier de Gaye.

8169 8170
- Issue #13218: Fix test_ssl failures on Debian/Ubuntu.

8171 8172 8173
- Re-enable lib2to3's test_parser.py tests, though with an expected failure
  (see issue 13125).

8174 8175
- Issue #12656: Add tests for IPv6 and Unix sockets to test_asyncore.

8176 8177
- Issue #6484: Add unit tests for mailcap module (patch by Gregory Nofi)

8178 8179 8180 8181 8182
- Issue #11651: Improve the Makefile test targets to run more of the test suite
  more quickly. The --multiprocess option is now enabled by default, reducing
  the amount of time needed to run the tests. "make test" and "make quicktest"
  now include some resource-intensive tests, but no longer run the test suite
  twice to check for bugs in .pyc generation. Tools/scripts/run_test.py provides
Éric Araujo's avatar
Éric Araujo committed
8183
  an easy platform-independent way to run test suite with sensible defaults.
8184

8185 8186 8187
- Issue #12331: The test suite for the packaging module can now run from an
  installed Python.

8188 8189 8190
- Issue #12331: The test suite for lib2to3 can now run from an installed
  Python.

8191 8192 8193 8194 8195
- Issue #12626: In regrtest, allow to filter tests using a glob filter
  with the ``-m`` (or ``--match``) option.  This works with all test cases
  using the unittest module.  This is useful with long test suites
  such as test_io or test_subprocess.

8196 8197 8198 8199 8200
- Issue #12624: It is now possible to fail after the first failure when
  running in verbose mode (``-v`` or ``-W``), by using the ``--failfast``
  (or ``-G``) option to regrtest.  This is useful with long test suites
  such as test_io or test_subprocess.

8201 8202 8203
- Issue #12587: Correct faulty test file and reference in test_tokenize.
  (Patch by Robert Xiao)

8204 8205
- Issue #12573: Add resource checks for dangling Thread and Process objects.

8206 8207 8208
- Issue #12549: Correct test_platform to not fail when OS X returns 'x86_64'
  as the processor type on some Mac systems.

8209 8210 8211
- Skip network tests when getaddrinfo() returns EAI_AGAIN, meaning a temporary
  failure in name resolution.

8212 8213 8214
- Issue #11812: Solve transient socket failure to connect to 'localhost'
  in test_telnetlib.py.

8215 8216
- Solved a potential deadlock in test_telnetlib.py. Related to issue #11812.

8217 8218 8219 8220
- Avoid failing in test_robotparser when mueblesmoraleda.com is flaky and
  an overzealous DNS service (e.g. OpenDNS) redirects to a placeholder
  Web site.

8221 8222 8223 8224
- Avoid failing in test_urllibnet.test_bad_address when some overzealous
  DNS service (e.g. OpenDNS) resolves a non-existent domain name.  The test
  is now skipped instead.

8225 8226 8227 8228
- Issue #12440: When testing whether some bits in SSLContext.options can be
  reset, check the version of the OpenSSL headers Python was compiled against,
  rather than the runtime version of the OpenSSL library.

8229 8230
- Issue #11512: Add a test suite for the cgitb module. Patch by Robbie Clemons.

8231 8232 8233 8234
- Issue #12497: Install test/data to prevent failures of the various codecmaps
  tests.

- Issue #12496: Install test/capath directory to prevent test_connect_capath
8235 8236
  testcase failure in test_ssl.

8237 8238 8239 8240
- Issue #12469: Run wakeup and pending signal tests in a subprocess to run the
  test in a fresh process with only one thread and to not change signal
  handling of the parent process.

8241 8242 8243 8244
- Issue #8716: Avoid crashes caused by Aqua Tk on OSX when attempting to run
  test_tk or test_ttk_guionly under a username that is not currently logged
  in to the console windowserver (as may be the case under buildbot or ssh).

8245 8246
- Issue #12407: Explicitly skip test_capi.EmbeddingTest under Windows.

8247 8248 8249 8250
- Issue #12400: regrtest -W doesn't rerun the tests twice anymore, but captures
  the output and displays it on failure instead. regrtest -v doesn't print the
  error twice anymore if there is only one error.

8251 8252 8253 8254 8255
- Issue #12141: Install copies of template C module file so that
  test_build_ext of test_distutils and test_command_build_ext of
  test_packaging are no longer silently skipped when
  run outside of a build directory.

8256 8257 8258
- Issue #8746: Add additional tests for os.chflags() and os.lchflags().
  Patch by Garrett Cooper.

8259 8260 8261
- Issue #10736: Fix test_ttk test_widgets failures with Cocoa Tk 8.5.9
  2.8 +  on Mac OS X.  (Patch by Ronald Oussoren)

8262 8263 8264
- Issue #12057: Add tests for ISO 2022 codecs (iso2022_jp, iso2022_jp_2,
  iso2022_kr).

8265 8266 8267
- Issue #12096: Fix a race condition in test_threading.test_waitfor(). Patch
  written by Charles-François Natali.

8268 8269 8270
- Issue #11614: import __hello__ prints "Hello World!". Patch written by
  Andreas Stührk.

Ezio Melotti's avatar
Ezio Melotti committed
8271 8272
- Issue #5723: Improve json tests to be executed with and without accelerations.

8273 8274
- Issue #12041: Make test_wait3 more robust.

8275 8276 8277
- Issue #11873: Change regex in test_compileall to fix occasional failures when
  when the randomly generated temporary path happened to match the regex.

8278 8279 8280
- Issue #11958: Fix FTP tests for IPv6, bind to "::1" instead of "localhost".
  Patch written by Charles-Francois Natali.

8281 8282 8283 8284
- Issue #8407, #11859: Fix tests of test_io using threads and an alarm: use
  pthread_sigmask() to ensure that the SIGALRM signal is received by the main
  thread.

8285 8286 8287 8288
- Issue #11811: Factor out detection of IPv6 support on the current host
  and make it available as ``test.support.IPV6_ENABLED``.  Patch by
  Charles-François Natali.

Antoine Pitrou's avatar
Antoine Pitrou committed
8289 8290
- Issue #10914: Add a minimal embedding test to test_capi.

8291 8292 8293 8294 8295 8296
- Issue #11223: Skip test_lock_acquire_interruption() and
  test_rlock_acquire_interruption() of test_threadsignals if a thread lock is
  implemented using a POSIX mutex and a POSIX condition variable. A POSIX
  condition variable cannot be interrupted by a signal (e.g. on Linux, the
  futex system call is restarted).

8297 8298
- Issue #11790: Fix sporadic failures in test_multiprocessing.WithProcessesTestCondition.

8299 8300
- Fix possible "file already exists" error when running the tests in parallel.

Ross Lagerwall's avatar
Ross Lagerwall committed
8301 8302
- Issue #11719: Fix message about unexpected test_msilib skip on non-Windows
  platforms. Patch by Nadeem Vawda.
8303

8304 8305
- Issue #11727: Add a --timeout option to regrtest: if a test takes more than
  TIMEOUT seconds, dumps the traceback of all threads and exits.
8306

8307 8308
- Issue #11653: fix -W with -j in regrtest.

8309 8310 8311 8312 8313
- The email test suite now lives in the Lib/test/test_email package.  The test
  harness code has also been modernized to allow use of new unittest features.

- regrtest now discovers test packages as well as test modules.

8314
- Issue #11577: improve test coverage of binhex.py. Patch by Arkady Koplyarov.
8315

8316 8317 8318
- New test_crashers added to exercise the scripts in the Lib/test/crashers
  directory and confirm they fail as expected

Éric Araujo's avatar
Éric Araujo committed
8319
- Issue #11578: added test for the timeit module.  Patch by Michael Henry.
8320

8321 8322
- Issue #11503: improve test coverage of posixpath.py. Patch by Evan Dandrea.

8323 8324
- Issue #11505: improves test coverage of string.py, increases granularity of
  string.Formatter tests. Initial patch by Alicia Arlen.
8325

Nick Coghlan's avatar
Nick Coghlan committed
8326 8327 8328
- Issue #11548: Improve test coverage of the shutil module. Patch by
  Evan Dandrea.

8329 8330
- Issue #11554: Reactivated test_email_codecs.

8331 8332
- Issue #11505: improves test coverage of string.py. Patch by Alicia
  Arlen
8333

8334
- Issue #11490: test_subprocess.test_leaking_fds_on_error no longer gives a
8335 8336
  false positive if the last directory in the path is inaccessible.

8337 8338 8339
- Issue #11223: Fix test_threadsignals to fail, not hang, when the
  non-semaphore implementation of locks is used under POSIX.

8340 8341 8342
- Issue #10911: Add tests on CGI with non-ASCII characters. Patch written by
  Pierre Quentel.

8343 8344 8345
- Issue #9931: Fix hangs in GUI tests under Windows in certain conditions.
  Patch by Hirokazu Yamamoto.

8346 8347
- Issue #10512: Properly close sockets under test.test_cgi.

8348 8349
- Issue #10992: Make tests pass under coverage.

8350 8351 8352
- Issue #10826: Prevent sporadic failure in test_subprocess on Solaris due
  to open door files.

8353 8354
- Issue #10990: Prevent tests from clobbering a set trace function.

8355 8356 8357
C-API
-----

8358 8359 8360 8361 8362 8363 8364 8365 8366 8367 8368 8369 8370 8371 8372 8373 8374
- Issue #13452: PyUnicode_EncodeDecimal() doesn't support error handlers
  different than "strict" anymore. The caller was unable to compute the
  size of the output buffer: it depends on the error handler.

- Issue #13560: Add PyUnicode_DecodeLocale(), PyUnicode_DecodeLocaleAndSize()
  and PyUnicode_EncodeLocale() functions to the C API to decode/encode from/to
  the current locale encoding.

- Issue #10831: PyUnicode_FromFormat() supports %li, %lli and %zi formats.

- Issue #11246: Fix PyUnicode_FromFormat("%V") to decode the byte string from
  UTF-8 (with replace error handler) instead of ISO-8859-1 (in strict mode).
  Patch written by Ray Allen.

- Issue #10830: Fix PyUnicode_FromFormatV("%c") for non-BMP characters on
  narrow build.

8375 8376 8377 8378
- Add PyObject_GenericGetDict and PyObject_GeneriSetDict. They are generic
  implementations for the getter and setter of a ``__dict__`` descriptor of C
  types.

8379 8380 8381 8382
- Issue #13727: Add 3 macros to access PyDateTime_Delta members:
  PyDateTime_DELTA_GET_DAYS, PyDateTime_DELTA_GET_SECONDS,
  PyDateTime_DELTA_GET_MICROSECONDS.

8383 8384 8385 8386
- Issue #10542: Add 4 macros to work with surrogates: Py_UNICODE_IS_SURROGATE,
  Py_UNICODE_IS_HIGH_SURROGATE, Py_UNICODE_IS_LOW_SURROGATE,
  Py_UNICODE_JOIN_SURROGATES.

Brian Curtin's avatar
Brian Curtin committed
8387 8388
- Issue #12724: Add Py_RETURN_NOTIMPLEMENTED macro for returning NotImplemented.

Benjamin Peterson's avatar
Benjamin Peterson committed
8389 8390
- PY_PATCHLEVEL_REVISION has been removed, since it's meaningless with
  Mercurial.
8391

8392
- Issue #12173: The first argument of PyImport_ImportModuleLevel is now `const
Benjamin Peterson's avatar
Benjamin Peterson committed
8393
  char *` instead of `char *`.
8394

8395 8396
- Issue #12380: PyArg_ParseTuple now accepts a bytearray for the 'c' format.

8397 8398 8399
Documentation
-------------

8400 8401 8402 8403 8404 8405 8406 8407 8408 8409 8410 8411 8412 8413 8414
- Issue #13989: Document that GzipFile does not support text mode, and give a
  more helpful error message when opened with an invalid mode string.

- Issue #13921: Undocument and clean up sqlite3.OptimizedUnicode,
  which is obsolete in Python 3.x. It's now aliased to str for
  backwards compatibility.

- Issue #12102: Document that buffered files must be flushed before being used
  with mmap. Patch by Steffen Daode Nurpmeso.

- Issue #8982: Improve the documentation for the argparse Namespace object.

- Issue #9343: Document that argparse parent parsers must be configured before
  their children.

Hynek Schlawack's avatar
Hynek Schlawack committed
8415 8416
- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument.  Done with
  great native-speaker help from R. David Murray.
8417

Petri Lehtinen's avatar
Petri Lehtinen committed
8418 8419
- Issues #13491 and #13995: Fix many errors in sqlite3 documentation.
  Initial patch for #13491 by Johannes Vogel.
Petri Lehtinen's avatar
Petri Lehtinen committed
8420

Petri Lehtinen's avatar
Petri Lehtinen committed
8421 8422
- Issue #13402: Document absoluteness of sys.executable.

8423 8424
- Issue #13883: PYTHONCASEOK also works on OS X.

8425 8426 8427 8428 8429 8430 8431
- Issue #9021: Add an introduction to the copy module documentation.

- Issue #6005: Examples in the socket library documentation use sendall, where
  relevant, instead send method.

- Issue #12798: Updated the mimetypes documentation.

8432 8433 8434
- Issue #12949: Document the kwonlyargcount argument for the PyCode_New
  C API function.

8435 8436 8437
- Issue #13513: Fix io.IOBase documentation to correctly link to the
  io.IOBase.readline method instead of the readline module.

8438 8439 8440
- Issue #13237: Reorganise subprocess documentation to emphasise convenience
  functions and the most commonly needed arguments to Popen.

Florent Xicluna's avatar
Florent Xicluna committed
8441 8442
- Issue #13141: Demonstrate recommended style for socketserver examples.

8443 8444
- Issue #11818: Fix tempfile examples for Python 3.

Georg Brandl's avatar
Georg Brandl committed
8445

8446
**(For information about older versions, consult the HISTORY file.)**