NEWS 61.6 KB
Newer Older
1 2 3 4
+++++++++++
Python News
+++++++++++

Anthony Baxter's avatar
Anthony Baxter committed
5 6
(editors: check NEWS.help for information about editing NEWS using ReST.)

7 8 9 10 11 12 13 14 15 16 17 18 19 20 21
What's New in Python 2.5 beta 2?
================================

*Release date: XX-JUL-2006*

Core and builtins
-----------------


Library
-------

- The compiler module now correctly compiles the new try-except-finally
  statement (bug #1509132).

22 23
- The wsgiref package is now installed properly on Unix.

24 25


26
What's New in Python 2.5 beta 1?
27
================================
28

Anthony Baxter's avatar
Anthony Baxter committed
29
*Release date: 20-JUN-2006*
30 31 32 33

Core and builtins
-----------------

34 35 36 37
- Patch #1507676: Error messages returned by invalid abstract object operations
  (such as iterating over an integer) have been improved and now include the
  type of the offending object to help with debugging.

38 39 40
- Bug #992017: A classic class that defined a __coerce__() method that returned
  its arguments swapped would infinitely recurse and segfault the interpreter.

41 42
- Fix the socket tests so they can be run concurrently.

43 44 45
- Removed 5 integers from C frame objects (PyFrameObject).
	f_nlocals, f_ncells, f_nfreevars, f_stack_size, f_restricted.

46 47 48 49 50 51
- Bug #532646: object.__call__() will continue looking for the __call__
  attribute on objects until one without one is found.  This leads to recursion
  when you take a class and set its __call__ attribute to an instance of the
  class.  Originally fixed for classic classes, but this fix is for new-style.
  Removes the infinite_rec_3 crasher.

52 53 54
- The string and unicode methods startswith() and endswith() now accept
  a tuple of prefixes/suffixes to look for. Implements RFE #1491485.

55 56 57 58 59 60
- Buffer objects, at the C level, never used the char buffer
  implementation even when the char buffer for the wrapped object was
  explicitly requested (originally returned the read or write buffer).
  Now a TypeError is raised if the char buffer is not present but is
  requested.

61 62 63
- Patch #1346214: Statements like "if 0: suite" are now again optimized
  away like they were in Python 2.4.

64 65 66 67
- Builtin exceptions are now full-blown new-style classes instead of
  instances pretending to be classes, which speeds up exception handling
  by about 80% in comparison to 2.5a2.

68 69 70
- Patch #1494554: Update unicodedata.numeric and unicode.isnumeric to
  Unicode 4.1.

71 72 73 74
- Patch #921466: sys.path_importer_cache is now used to cache valid and
  invalid file paths for the built-in import machinery which leads to
  fewer open calls on startup.

75 76 77 78 79 80
- Patch #1442927: ``long(str, base)`` is now up to 6x faster for non-power-
  of-2 bases.  The largest speedup is for inputs with about 1000 decimal
  digits.  Conversion from non-power-of-2 bases remains quadratic-time in
  the number of input digits (it was and remains linear-time for bases
  2, 4, 8, 16 and 32).

81 82 83 84 85
- Bug #1334662: ``int(string, base)`` could deliver a wrong answer
  when ``base`` was not 2, 4, 8, 10, 16 or 32, and ``string`` represented
  an integer close to ``sys.maxint``.  This was repaired by patch
  #1335972, which also gives a nice speedup.

86 87 88 89
- Patch #1337051: reduced size of frame objects.

- PyErr_NewException now accepts a tuple of base classes as its
  "base" parameter.
90

91 92 93
- Patch #876206: function call speedup by retaining allocated frame
  objects.

94 95 96 97
- Bug #1462152: file() now checks more thoroughly for invalid mode
  strings and removes a possible "U" before passing the mode to the
  C library function.

98 99
- Patch #1488312, Fix memory alignment problem on SPARC in unicode

100 101
- Bug #1487966: Fix SystemError with conditional expression in assignment

102 103 104 105 106
- WindowsError now has two error code attributes: errno, which carries
  the error values from errno.h, and winerror, which carries the error
  values from winerror.h. Previous versions put the winerror.h values
  (from GetLastError()) into the errno attribute.

107 108
- Patch #1475845: Raise IndentationError for unexpected indent.

109 110
- Patch #1479181: split open() and file() from being aliases for each other.

111 112 113 114 115 116 117 118 119
- Patch #1497053 & bug #1275608: Exceptions occurring in ``__eq__()``
  methods were always silently ignored by dictionaries when comparing keys.
  They are now passed through (except when using the C API function
  ``PyDict_GetItem()``, whose semantics did not change).

- Bug #1456209: In some obscure cases it was possible for a class with a
  custom ``__eq__()`` method to confuse dict internals when class instances
  were used as a dict's keys and the ``__eq__()`` method mutated the dict.
  No, you don't have any code that did this ;-)
120

121 122 123
Extension Modules
-----------------

124 125 126
- Change binascii.hexlify to accept a read-only buffer instead of only a char
  buffer and actually follow its documentation.

127 128
- Fixed a potentially invalid memory access of CJKCodecs' shift-jis decoder.

129 130 131 132 133
- Patch #1478788 (modified version): The functional extension module has
  been renamed to _functools and a functools Python wrapper module added.
  This provides a home for additional function related utilities that are
  not specifically about functional programming. See PEP 309.

134 135
- Patch #1493701: performance enhancements for struct module.

136 137
- Patch #1490224: time.altzone is now set correctly on Cygwin.

138 139 140
- Patch #1435422: zlib's compress and decompress objects now have a
  copy() method.

141 142 143
- Patch #1454481: thread stack size is now tunable at runtime for thread
  enabled builds on Windows and systems with Posix threads support.

144 145 146 147 148 149
- On Win32, os.listdir now supports arbitrarily-long Unicode path names
  (up to the system limit of 32K characters).

- Use Win32 API to implement os.{access,chdir,chmod,mkdir,remove,rename,rmdir,utime}.
  As a result, these functions now raise WindowsError instead of OSError.

150 151 152 153
- ``time.clock()`` on Win64 should use the high-performance Windows
  ``QueryPerformanceCounter()`` now (as was already the case on 32-bit
  Windows platforms).

154 155 156
- Calling Tk_Init twice is refused if the first call failed as that
  may deadlock.

157 158 159 160 161 162
- bsddb: added the DB_ARCH_REMOVE flag and fixed db.DBEnv.log_archive() to
  accept it without potentially using an uninitialized pointer.

- bsddb: added support for the DBEnv.log_stat() and DBEnv.lsn_reset() methods
  assuming BerkeleyDB >= 4.0 and 4.4 respectively.  [pybsddb project SF
  patch numbers 1494885 and 1494902]
163

164
- bsddb: added an interface for the BerkeleyDB >= 4.3 DBSequence class.
165 166
  [pybsddb project SF patch number 1466734]

167 168 169
- bsddb: fix DBCursor.pget() bug with keyword argument names when no data
  parameter is supplied.  [SF pybsddb bug #1477863]

170 171 172 173
- bsddb: the __len__ method of a DB object has been fixed to return correct
  results.  It could previously incorrectly return 0 in some cases.
  Fixes SF bug 1493322 (pybsddb bug 1184012).

174 175 176 177
- bsddb: the bsddb.dbtables Modify method now raises the proper error and
  aborts the db transaction safely when a modifier callback fails.
  Fixes SF python patch/bug #1408584.

178 179 180 181 182
- bsddb: multithreaded DB access using the simple bsddb module interface
  now works reliably.  It has been updated to use automatic BerkeleyDB 
  deadlock detection and the bsddb.dbutils.DeadlockWrap wrapper to retry
  database calls that would previously deadlock. [SF python bug #775414]

183
- Patch #1446489: add support for the ZIP64 extensions to zipfile. 
184

185 186
- Patch #1506645: add Python wrappers for the curses functions
  is_term_resized, resize_term and resizeterm.
187

188 189 190
Library
-------

191 192 193
- Patch #815924: Restore ability to pass type= and icon= in tkMessageBox
  functions.

194 195
- Patch #812986: Update turtle output even if not tracing.

196 197 198
- Patch #1494750: Destroy master after deleting children in 
  Tkinter.BaseWidget.

199 200
- Patch #1096231: Add ``default`` argument to Tkinter.Wm.wm_iconbitmap.

201 202 203
- Patch #763580: Add name and value arguments to Tkinter variable
  classes.

204 205 206
- Bug #1117556: SimpleHTTPServer now tries to find and use the system's
  mime.types file for determining MIME types.

207 208 209
- Bug #1339007: Shelf objects now don't raise an exception in their
  __del__ method when initialization failed.

210 211 212
- Patch #1455898: The MBCS codec now supports the incremental mode for
  double-byte encodings.

213 214 215 216 217 218
- ``difflib``'s ``SequenceMatcher.get_matching_blocks()`` was changed to
  guarantee that adjacent triples in the return list always describe
  non-adjacent blocks.  Previously, a pair of matching blocks could end
  up being described by multiple adjacent triples that formed a partition
  of the matching pair.

219 220 221
- Bug #1498146: fix optparse to handle Unicode strings in option help,
  description, and epilog.

222 223
- Bug #1366250: minor optparse documentation error.

224 225 226
- Bug #1361643: fix textwrap.dedent() so it handles tabs appropriately;
  clarify docs.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
227 228
- The wsgiref package has been added to the standard library.

229 230 231 232
- The functions update_wrapper() and wraps() have been added to the functools
  module. These make it easier to copy relevant metadata from the original
  function when writing wrapper functions.

Tim Peters's avatar
Tim Peters committed
233 234
- The optional ``isprivate`` argument to ``doctest.testmod()``, and the
  ``doctest.is_private()`` function, both deprecated in 2.4, were removed.
235

236 237 238
- Patch #1359618: Speed up charmap encoder by using a trie structure
  for lookup.

239 240 241 242 243 244
- The functions in the ``pprint`` module now sort dictionaries by key
  before computing the display.  Before 2.5, ``pprint`` sorted a dictionary
  if and only if its display required more than one line, although that
  wasn't documented.  The new behavior increases predictability; e.g.,
  using ``pprint.pprint(a_dict)`` in a doctest is now reliable.

Georg Brandl's avatar
Georg Brandl committed
245 246 247
- Patch #1497027: try HTTP digest auth before basic auth in urllib2
  (thanks for J. J. Lee).

248 249 250
- Patch #1496206: improve urllib2 handling of passwords with respect to
  default HTTP and HTTPS ports.

251 252
- Patch #1080727: add "encoding" parameter to doctest.DocFileSuite.

253 254
- Patch #1281707: speed up gzip.readline.

255 256 257 258
- Patch #1180296: Two new functions were added to the locale module:
  format_string() to get the effect of  "format % items" but locale-aware,
  and currency() to format a monetary number with currency sign.

259 260 261
- Patch #1486962: Several bugs in the turtle Tk demo module were fixed
  and several features added, such as speed and geometry control.

262 263 264
- Patch #1488881: add support for external file objects in bz2 compressed
  tarfiles.

265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283
- Patch #721464: pdb.Pdb instances can now be given explicit stdin and
  stdout arguments, making it possible to redirect input and output
  for remote debugging.

- Patch #1484695: Update the tarfile module to version 0.8. This fixes
  a couple of issues, notably handling of long file names using the
  GNU LONGNAME extension.

- Patch #1478292. ``doctest.register_optionflag(name)`` shouldn't create a
  new flag when ``name`` is already the name of an option flag.

- Bug #1385040: don't allow "def foo(a=1, b): pass" in the compiler
  package.

- Patch #1472854: make the rlcompleter.Completer class usable on non-
  UNIX platforms.

- Patch #1470846: fix urllib2 ProxyBasicAuthHandler.

284 285 286 287
- Bug #1472827: correctly escape newlines and tabs in attribute values in
  the saxutils.XMLGenerator class.


288 289 290
Build
-----

291 292
- Bug #1502728: Correctly link against librt library on HP-UX.

293 294
- OpenBSD 3.9 is supported now.

295 296
- Patch #1492356: Port to Windows CE.

297 298
- Bug/Patch #1481770: Use .so extension for shared libraries on HP-UX for ia64.

299 300 301 302 303 304 305 306 307 308 309 310 311 312
- Patch #1471883: Add --enable-universalsdk.

C API
-----

Tests
-----

Tools
-----

Documentation
-------------

313 314


315 316 317 318 319 320 321 322
What's New in Python 2.5 alpha 2?
=================================

*Release date: 27-APR-2006*

Core and builtins
-----------------

323 324 325 326 327 328 329 330 331
- Bug #1465834: 'bdist_wininst preinstall script support' was fixed
  by converting these apis from macros into exported functions again:

    PyParser_SimpleParseFile PyParser_SimpleParseString PyRun_AnyFile
    PyRun_AnyFileEx PyRun_AnyFileFlags PyRun_File PyRun_FileEx
    PyRun_FileFlags PyRun_InteractiveLoop PyRun_InteractiveOne
    PyRun_SimpleFile PyRun_SimpleFileEx PyRun_SimpleString
    PyRun_String Py_CompileString

332 333
- Under COUNT_ALLOCS, types are not necessarily immortal anymore.

334 335 336 337
- All uses of PyStructSequence_InitType have been changed to initialize
  the type objects only once, even if the interpreter is initialized
  multiple times.

338 339 340 341 342 343 344
- Bug #1454485, array.array('u') could crash the interpreter.  This was
  due to PyArgs_ParseTuple(args, 'u#', ...) trying to convert buffers (strings)
  to unicode when it didn't make sense.  'u#' now requires a unicode string.

- Py_UNICODE is unsigned.  It was always documented as unsigned, but
  due to a bug had a signed value in previous versions.

345 346 347
- Patch #837242: ``id()`` of any Python object always gives a positive
  number now, which might be a long integer. ``PyLong_FromVoidPtr`` and
  ``PyLong_AsVoidPtr`` have been changed accordingly.  Note that it has
Tim Peters's avatar
Tim Peters committed
348
  never been correct to implement a ``__hash()__`` method that returns the
349 350 351 352 353 354 355
  ``id()`` of an object:

      def __hash__(self):
          return id(self)  # WRONG

  because a hash result must be a (short) Python int but it was always
  possible for ``id()`` to return a Python long.  However, because ``id()``
Tim Peters's avatar
Tim Peters committed
356
  could return negative values before, on a 32-bit box an ``id()`` result
357 358 359 360
  was always usable as a hash value before this patch.  That's no longer
  necessarily so.

- Python on OS X 10.3 and above now uses dlopen() (via dynload_shlib.c)
361
  to load extension modules and now provides the dl module. As a result,
362
  sys.setdlopenflags() now works correctly on these systems. (SF patch
363 364
  #1454844)

365 366 367 368 369
- Patch #1463867: enhanced garbage collection to allow cleanup of cycles
  involving generators that have paused outside of any ``try`` or ``with``
  blocks.  (In 2.5a1, a paused generator that was part of a reference
  cycle could not be garbage collected, regardless of whether it was
  paused in a ``try`` or ``with`` block.)
370

371 372 373
Extension Modules
-----------------

374 375 376
- Patch #1191065: Fix preprocessor problems on systems where recvfrom
  is a macro.

377 378 379
- Bug #1467952: os.listdir() now correctly raises an error if readdir()
  fails with an error condition.

380 381 382 383 384 385 386 387 388 389
- Fixed bsddb.db.DBError derived exceptions so they can be unpickled.

- Bug #1117761: bsddb.*open() no longer raises an exception when using
  the cachesize parameter.

- Bug #1149413: bsddb.*open() no longer raises an exception when using
  a temporary db (file=None) with the 'n' flag to truncate on open.

- Bug #1332852: bsddb module minimum BerkeleyDB version raised to 3.3
  as older versions cause excessive test failures.
390

391 392 393
- Patch #1062014: AF_UNIX sockets under Linux have a special
  abstract namespace that is now fully supported.

394 395 396
Library
-------

397 398 399 400
- Patch #1475231: ``doctest`` has a new ``SKIP`` option, which causes
  a doctest to be skipped (the code is not run, and the expected output
  or exception is ignored).

401 402 403
- Fixed contextlib.nested to cope with exceptions being raised and
  caught inside exit handlers.

Greg Ward's avatar
Greg Ward committed
404 405 406 407 408
- Updated optparse module to Optik 1.5.1 (allow numeric constants in
  hex, octal, or binary; add ``append_const`` action; keep going if
  gettext cannot be imported; added ``OptionParser.destroy()`` method;
  added ``epilog`` for better help generation).

409 410 411
- Bug #1473760: ``tempfile.TemporaryFile()`` could hang on Windows, when
  called from a thread spawned as a side effect of importing a module.

412 413 414 415 416 417 418
- The pydoc module now supports documenting packages contained in
  .zip or .egg files.

- The pkgutil module now has several new utility functions, such
  as ``walk_packages()`` to support working with packages that are either
  in the filesystem or zip files.

419 420 421 422
- The mailbox module can now modify and delete messages from
  mailboxes, in addition to simply reading them.  Thanks to Gregory
  K. Johnson for writing the code, and to the 2005 Google Summer of
  Code for funding his work.
423

424 425 426
- The ``__del__`` method of class ``local`` in module ``_threading_local``
  returned before accomplishing any of its intended cleanup.

427 428
- Patch #790710: Add breakpoint command lists in pdb.

429 430
- Patch #1063914: Add Tkinter.Misc.clipboard_get().

431 432
- Patch #1191700: Adjust column alignment in bdb breakpoint lists.

433 434 435
- SimpleXMLRPCServer relied on the fcntl module, which is unavailable on
  Windows. Bug #1469163.

436 437 438 439
- The warnings, linecache, inspect, traceback, site, and doctest modules
  were updated to work correctly with modules imported from zipfiles or
  via other PEP 302 __loader__ objects.

440 441 442
- Patch #1467770: Reduce usage of subprocess._active to processes which
  the application hasn't waited on.

443 444
- Patch #1462222: Fix Tix.Grid.

445 446
- Fix exception when doing glob.glob('anything*/')

447 448 449
- The pstats.Stats class accepts an optional stream keyword argument to
  direct output to an alternate file-like object.

450 451 452
Build
-----

Martin v. Löwis's avatar
Martin v. Löwis committed
453 454 455
- The Makefile now has a reindent target, which runs reindent.py on
  the library.

456 457
- Patch #1470875: Building Python with MS Free Compiler

458
- Patch #1161914: Add a python-config script.
459

460 461
- Patch #1324762:Remove ccpython.cc; replace --with-cxx with
  --with-cxx-main. Link with C++ compiler only if --with-cxx-main was
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
462
  specified. (Can be overridden by explicitly setting LINKCC.) Decouple
463 464
  CXX from --with-cxx-main, see description in README.

465 466
- Patch #1429775: Link extension modules with the shared libpython.

467 468
- Fixed a libffi build problem on MIPS systems.

469 470 471 472
- ``PyString_FromFormat``, ``PyErr_Format``, and ``PyString_FromFormatV``
  now accept formats "%u" for unsigned ints, "%lu" for unsigned longs,
  and "%zu" for unsigned integers of type ``size_t``.

473 474 475
Tests
-----

476 477 478
- test_contextlib now checks contextlib.nested can cope with exceptions
  being raised and caught inside exit handlers.

479 480
- test_cmd_line now checks operation of the -m and -c command switches

481 482 483 484
- The test_contextlib test in 2.5a1 wasn't actually run unless you ran
  it separately and by hand.  It also wasn't cleaning up its changes to
  the current Decimal context.

485 486 487 488 489
- regrtest.py now has a -M option to run tests that test the new limits of
  containers, on 64-bit architectures. Running these tests is only sensible
  on 64-bit machines with more than two gigabytes of memory. The argument
  passed is the maximum amount of memory for the tests to use.

490 491 492 493 494
Tools
-----

- Added the Python benchmark suite pybench to the Tools/ directory;
  contributed by Marc-Andre Lemburg.
495

496 497 498
Documentation
-------------

499 500
- Patch #1473132: Improve docs for ``tp_clear`` and ``tp_traverse``.

501 502 503 504
- PEP 343: Added Context Types section to the library reference
  and attempted to bring other PEP 343 related documentation into
  line with the implementation and/or python-dev discussions.

505 506
- Bug #1337990: clarified that ``doctest`` does not support examples
  requiring both expected output and an exception.
507 508


509 510 511
What's New in Python 2.5 alpha 1?
=================================

Anthony Baxter's avatar
Anthony Baxter committed
512
*Release date: 05-APR-2006*
513

514 515 516
Core and builtins
-----------------

517 518 519
- PEP 338: -m command line switch now delegates to runpy.run_module
  allowing it to support modules in packages and zipfiles

Martin v. Löwis's avatar
Martin v. Löwis committed
520 521 522 523
- On Windows, .DLL is not an accepted file name extension for
  extension modules anymore; extensions are only found if they
  end in .PYD.

524 525 526
- Bug #1421664: sys.stderr.encoding is now set to the same value as
  sys.stdout.encoding.

527 528
- __import__ accepts keyword arguments.

529 530
- Patch #1460496: round() now accepts keyword arguments.

531 532
- Fixed bug #1459029 - unicode reprs were double-escaped.

533 534 535
- Patch #1396919: The system scope threads are reenabled on FreeBSD
  5.4 and later versions.

536 537 538
- Bug #1115379: Compiling a Unicode string with an encoding declaration
  now gives a SyntaxError.

539 540 541 542
- Previously, Python code had no easy way to access the contents of a
  cell object. Now, a ``cell_contents`` attribute has been added
  (closes patch #1170323).

543 544 545 546 547 548 549
- Patch #1123430: Python's small-object allocator now returns an arena to
  the system ``free()`` when all memory within an arena becomes unused
  again.  Prior to Python 2.5, arenas (256KB chunks of memory) were never
  freed.  Some applications will see a drop in virtual memory size now,
  especially long-running applications that, from time to time, temporarily
  use a large number of small objects.  Note that when Python returns an
  arena to the platform C's ``free()``, there's no guarantee that the
550 551
  platform C library will in turn return that memory to the operating system.
  The effect of the patch is to stop making that impossible, and in tests it
552 553 554
  appears to be effective at least on Microsoft C and gcc-based systems.
  Thanks to Evan Jones for hard work and patience.

555 556 557 558
- Patch #1434038: property() now uses the getter's docstring if there is
  no "doc" argument given. This makes it possible to legitimately use
  property() as a decorator to produce a read-only property.

Guido van Rossum's avatar
Guido van Rossum committed
559 560 561 562 563
- PEP 357, patch 1436368: add an __index__ method to int/long and a matching
  nb_index slot to the PyNumberMethods struct.  The slot is consulted instead
  of requiring an int or long in slicing and a few other contexts, enabling
  other objects (e.g. Numeric Python's integers) to be used as slice indices.

Neal Norwitz's avatar
Neal Norwitz committed
564 565
- Fixed various bugs reported by Coverity's Prevent tool.

566 567 568 569 570
- PEP 352, patch #1104669: Make exceptions new-style objects.  Introduced the
  new exception base class, BaseException, which has a new message attribute.
  KeyboardInterrupt and SystemExit to directly inherit from BaseException now.
  Raising a string exception now raises a DeprecationWarning.

571 572 573 574 575 576
- Patch #1438387, PEP 328: relative and absolute imports. Imports can now be
  explicitly relative, using 'from .module import name' to mean 'from the same
  package as this module is in. Imports without dots still default to the
  old relative-then-absolute, unless 'from __future__ import
  absolute_import' is used.

577 578 579 580
- Properly check if 'warnings' raises an exception (usually when a filter set
  to "error" is triggered) when raising a warning for raising string
  exceptions.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
581
- CO_GENERATOR_ALLOWED is no longer defined. This behavior is the default.
582 583
  The name was removed from Include/code.h.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
584
- PEP 308: conditional expressions were added: (x if cond else y).
Neal Norwitz's avatar
Neal Norwitz committed
585

Guido van Rossum's avatar
Guido van Rossum committed
586 587 588 589 590
- Patch 1433928:
  - The copy module now "copies" function objects (as atomic objects).
  - dict.__getitem__ now looks for a __missing__ hook before raising
    KeyError.

Tim Peters's avatar
Tim Peters committed
591 592 593
- PEP 343: with statement implemented. Needs ``from __future__ import
  with_statement``. Use of 'with' as a variable will generate a warning.
  Use of 'as' as a variable will also generate a warning (unless it's
594
  part of an import statement).
595 596 597 598 599 600
  The following objects have __context__ methods:
  - The built-in file type.
  - The thread.LockType type.
  - The following types defined by the threading module:
    Lock, RLock, Condition, Semaphore, BoundedSemaphore.
  - The decimal.Context class.
601

602 603 604 605 606 607
- Fix the encodings package codec search function to only search
  inside its own package. Fixes problem reported in patch #1433198.

  Note: Codec packages should implement and register their own
  codec search function. PEP 100 has the details.

608 609 610 611 612 613 614
- PEP 353: Using ``Py_ssize_t`` as the index type.

- ``PYMALLOC_DEBUG`` builds now add ``4*sizeof(size_t)`` bytes of debugging
  info to each allocated block, since the ``Py_ssize_t`` changes (PEP 353)
  now allow Python to make use of memory blocks exceeding 2**32 bytes for
  some purposes on 64-bit boxes.  A ``PYMALLOC_DEBUG`` build was limited
  to 4-byte allocations before.
Martin v. Löwis's avatar
Martin v. Löwis committed
615

616 617 618 619
- Patch #1400181, fix unicode string formatting to not use the locale.
  This is how string objects work.  u'%f' could use , instead of .
  for the decimal point.  Now both strings and unicode always use periods.

620 621 622
- Bug #1244610, #1392915, fix build problem on OpenBSD 3.7 and 3.8.
  configure would break checking curses.h.

623 624 625
- Bug #959576: The pwd module is now builtin. This allows Python to be
  built on UNIX platforms without $HOME set.

626 627
- Bug #1072182, fix some potential problems if characters are signed.

628 629
- Bug #889500, fix line number on SyntaxWarning for global declarations.

630 631
- Bug #1378022, UTF-8 files with a leading BOM crashed the interpreter.

632 633 634
- Support for converting hex strings to floats no longer works.
  This was not portable.  float('0x3') now raises a ValueError.

635
- Patch #1382163: Expose Subversion revision number to Python.  New C API
636
  function Py_GetBuildNumber().  New attribute sys.subversion.  Build number
637 638
  is now displayed in interactive prompt banner.

Georg Brandl's avatar
Georg Brandl committed
639 640
- Implementation of PEP 341 - Unification of try/except and try/finally.
  "except" clauses can now be written together with a "finally" clause in
641
  one try statement instead of two nested ones.  Patch #1355913.
Georg Brandl's avatar
Georg Brandl committed
642

643 644 645
- Bug #1379994: Builtin unicode_escape and raw_unicode_escape codec
  now encodes backslash correctly.

646 647
- Patch #1350409: Work around signal handling bug in Visual Studio 2005.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
648
- Bug #1281408: Py_BuildValue now works correctly even with unsigned longs
649 650
  and long longs.

651
- SF Bug #1350188, "setdlopenflags" leads to crash upon "import"
652
  It was possible for dlerror() to return a NULL pointer, so
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
653
  it will now use a default error message in this case.
654

655 656 657 658 659 660
- Replaced most Unicode charmap codecs with new ones using the
  new Unicode translate string feature in the builtin charmap
  codec; the codecs were created from the mapping tables available
  at ftp.unicode.org and contain a few updates (e.g. the Mac OS
  encodings now include a mapping for the Apple logo)

661
- Added a few more codecs for Mac OS encodings
662

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
663
- Sped up some Unicode operations.
664

665 666
- A new AST parser implementation was completed. The abstract
  syntax tree is available for read-only (non-compile) access
Martin v. Löwis's avatar
Martin v. Löwis committed
667
  to Python code; an _ast module was added.
668

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
669
- SF bug #1167751: fix incorrect code being produced for generator expressions.
670 671
  The following code now raises a SyntaxError:  foo(a = i for i in range(10))

672 673
- SF Bug #976608: fix SystemError when mtime of an imported file is -1.

674 675 676
- SF Bug #887946: fix segfault when redirecting stdin from a directory.
  Provide a warning when a directory is passed on the command line.

677 678 679 680
- Fix segfault with invalid coding.

- SF bug #772896: unknown encoding results in MemoryError.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
681
- All iterators now have a Boolean value of True.  Formerly, some iterators
682 683 684
  supported a __len__() method which evaluated to False when the iterator
  was empty.

685 686 687
- On 64-bit platforms, when __len__() returns a value that cannot be
  represented as a C int, raise OverflowError.

688
- test__locale is skipped on OS X < 10.4 (only partial locale support is
Walter Dörwald's avatar
Walter Dörwald committed
689
  present).
690

691 692 693
- SF bug #893549: parsing keyword arguments was broken with a few format
  codes.

694 695 696 697
- Changes donated by Elemental Security to make it work on AIX 5.3
  with IBM's 64-bit compiler (SF patch #1284289).  This also closes SF
  bug #105470: test_pwd fails on 64bit system (Opteron).

698 699 700
- Changes donated by Elemental Security to make it work on HP-UX 11 on
  Itanium2 with HP's 64-bit compiler (SF patch #1225212).

Georg Brandl's avatar
typo  
Georg Brandl committed
701
- Disallow keyword arguments for type constructors that don't use them
702 703
  (fixes bug #1119418).

704 705
- Forward UnicodeDecodeError into SyntaxError for source encoding errors.

706 707 708
- SF bug #900092: When tracing (e.g. for hotshot), restore 'return' events for
  exceptions that cause a function to exit.

709 710 711 712
- The implementation of set() and frozenset() was revised to use its
  own internal data structure.  Memory consumption is reduced by 1/3
  and there are modest speed-ups as well.  The API is unchanged.

713 714
- SF bug #1238681:  freed pointer is used in longobject.c:long_pow().

Michael W. Hudson's avatar
Fix:  
Michael W. Hudson committed
715 716 717
- SF bug #1229429: PyObject_CallMethod failed to decrement some
  reference counts in some error exit cases.

718 719 720
- SF bug #1185883:  Python's small-object memory allocator took over
  a block managed by the platform C library whenever a realloc specified
  a small new size.  However, there's no portable way to know then how
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
721
  much of the address space following the pointer is valid, so there's no
722 723 724 725 726
  portable way to copy data from the C-managed block into Python's
  small-object space without risking a memory fault.  Python's small-object
  realloc now leaves such blocks under the control of the platform C
  realloc.

Michael W. Hudson's avatar
Fix bug  
Michael W. Hudson committed
727 728 729
- SF bug #1232517: An overflow error was not detected properly when
  attempting to convert a large float to an int in os.utime().

730 731 732
- SF bug #1224347: hex longs now print with lowercase letters just
  like their int counterparts.

Michael W. Hudson's avatar
Michael W. Hudson committed
733 734 735 736 737 738
- SF bug #1163563: the original fix for bug #1010677 ("thread Module
  Breaks PyGILState_Ensure()") broke badly in the case of multiple
  interpreter states; back out that fix and do a better job (see
  http://mail.python.org/pipermail/python-dev/2005-June/054258.html
  for a longer write-up of the problem).

Michael W. Hudson's avatar
Michael W. Hudson committed
739 740 741
- SF patch #1180995: marshal now uses a binary format by default when
  serializing floats.

742 743 744 745
- SF patch #1181301: on platforms that appear to use IEEE 754 floats,
  the routines that promise to produce IEEE 754 binary representations
  of floats now simply copy bytes around.

746 747 748
- bug #967182: disallow opening files with 'wU' or 'aU' as specified by PEP
  278.

749 750 751 752
- patch #1109424: int, long, float, complex, and unicode now check for the
  proper magic slot for type conversions when subclassed.  Previously the
  magic slot was ignored during conversion.  Semantics now match the way
  subclasses of str always behaved.  int/long/float, conversion of an instance
Walter Dörwald's avatar
Walter Dörwald committed
753
  to the base class has been moved to the proper nb_* magic slot and out of
754
  PyNumber_*().
Neal Norwitz's avatar
Neal Norwitz committed
755
  Thanks Walter D�rwald.
756

757 758 759 760 761
- Descriptors defined in C with a PyGetSetDef structure, where the setter is
  NULL, now raise an AttributeError when attempting to set or delete the
  attribute.  Previously a TypeError was raised, but this was inconsistent
  with the equivalent pure-Python implementation.

Michael W. Hudson's avatar
Fix:  
Michael W. Hudson committed
762 763 764 765 766 767
- It is now safe to call PyGILState_Release() before
  PyEval_InitThreads() (note that if there is reason to believe there
  are multiple threads around you still must call PyEval_InitThreads()
  before using the Python API; this fix is for extension modules that
  have no way of knowing if Python is multi-threaded yet).

768 769 770
- Typing Ctrl-C whilst raw_input() was waiting in a build with threads
  disabled caused a crash.

771 772 773
- Bug #1165306: instancemethod_new allowed the creation of a method
  with im_class == im_self == NULL, which caused a crash when called.

774
- Move exception finalisation later in the shutdown process - this
775 776
  fixes the crash seen in bug #1165761

777 778
- Added two new builtins, any() and all().

779
- Defining a class with empty parentheses is now allowed
780 781 782
  (e.g., ``class C(): pass`` is no longer a syntax error).
  Patch #1176012 added support to the 'parser' module and 'compiler' package
  (thanks to logistix for that added support).
783

784 785
- Patch #1115086: Support PY_LONGLONG in structmember.

786 787 788
- Bug #1155938: new style classes did not check that __init__() was
  returning None.

789
- Patch #802188: Report characters after line continuation character
790 791
  ('\') with a specific error message.

792 793
- Bug #723201: Raise a TypeError for passing bad objects to 'L' format.

Michael W. Hudson's avatar
Michael W. Hudson committed
794 795 796
- Bug #1124295: the __name__ attribute of file objects was
  inadvertently made inaccessible in restricted mode.

797
- Bug #1074011: closing sys.std{out,err} now causes a flush() and
798 799
  an ferror() call.

800 801 802
- min() and max() now support key= arguments with the same meaning as in
  list.sort().

803 804 805
- The peephole optimizer now performs simple constant folding in expressions:
      (2+3) --> (5).

806 807
- set and frozenset objects can now be marshalled.  SF #1098985.

808 809
- Bug #1077106: Poor argument checking could cause memory corruption
  in calls to os.read().
810

811 812 813 814
- The parser did not complain about future statements in illegal
  positions.  It once again reports a syntax error if a future
  statement occurs after anything other than a doc string.

815 816 817 818
- Change the %s format specifier for str objects so that it returns a
  unicode instance if the argument is not an instance of basestring and
  calling __str__ on the argument returns a unicode instance.

819 820 821 822 823 824
- Patch #1413181:  changed ``PyThreadState_Delete()`` to forget about the
  current thread state when the auto-GIL-state machinery knows about
  it (since the thread state is being deleted, continuing to remember it
  can't help, but can hurt if another thread happens to get created with
  the same thread id).

825 826 827
Extension Modules
-----------------

828 829
- Patch #1380952: fix SSL objects timing out on consecutive read()s

830 831
- Patch #1309579: wait3 and wait4 were added to the posix module.

832 833 834
- Patch #1231053: The audioop module now supports encoding/decoding of alaw.
  In addition, the existing ulaw code was updated.

835
- RFE #567972: Socket objects' family, type and proto properties are
836
  now exposed via new attributes.
837

838 839
- Everything under lib-old was removed.  This includes the following modules:
    Para, addpack, cmp, cmpcache, codehack, dircmp, dump, find, fmt, grep,
Tim Peters's avatar
Tim Peters committed
840
    lockfile, newdir, ni, packmail, poly, rand, statcache, tb, tzparse,
841 842 843 844 845
    util, whatsound, whrandom, zmod

- The following modules were removed:  regsub, reconvert, regex, regex_syntax.

- re and sre were swapped, so help(re) provides full help.  importing sre
846 847
  is deprecated.  The undocumented re.engine variable no longer exists.

848 849 850
- Bug #1448490: Fixed a bug that ISO-2022 codecs could not handle
  SS2 (single-shift 2) escape sequences correctly.

851 852 853 854
- The unicodedata module was updated to the 4.1 version of the Unicode
  database. The 3.2 version is still available as unicodedata.db_3_2_0
  for applications that require this specific version (such as IDNA).

855 856 857
- The timing module is no longer built by default.  It was deprecated
  in PEP 4 in Python 2.0 or earlier.

Guido van Rossum's avatar
Guido van Rossum committed
858 859 860
- Patch 1433928: Added a new type, defaultdict, to the collections module.
  This uses the new __missing__ hook behavior added to dict (see above).

861 862 863
- Bug #854823: socketmodule now builds on Sun platforms even when
  INET_ADDRSTRLEN is not defined.

864 865 866
- Patch #1393157: os.startfile() now has an optional argument to specify
  a "command verb" to invoke on the file.

867 868 869
- Bug #876637, prevent stack corruption when socket descriptor
  is larger than FD_SETSIZE.

870 871 872 873
- Patch #1407135, bug #1424041: harmonize mmap behavior of anonymous memory.
  mmap.mmap(-1, size) now returns anonymous memory in both Unix and Windows.
  mmap.mmap(0, size) should not be used on Windows for anonymous memory.

874 875 876
- Patch #1422385: The nis module now supports access to domains other
  than the system default domain.

877 878 879 880
- Use Win32 API to implement os.stat/fstat. As a result, subsecond timestamps
  are reported, the limit on path name lengths is removed, and stat reports
  WindowsError now (instead of OSError).

881 882
- Add bsddb.db.DBEnv.set_tx_timestamp allowing time based database recovery.

883 884 885
- Bug #1413192, fix seg fault in bsddb if a transaction was deleted
  before the env.

886 887
- Patch #1103116: Basic AF_NETLINK support.

888 889
- Bug #1402308, (possible) segfault when using mmap.mmap(-1, ...)

890 891 892 893
- Bug #1400822, _curses over{lay,write} doesn't work when passing 6 ints.
  Also fix ungetmouse() which did not accept arguments properly.
  The code now conforms to the documented signature.

894 895 896
- Bug #1400115, Fix segfault when calling curses.panel.userptr()
  without prior setting of the userptr.

897 898
- Fix 64-bit problems in bsddb.

899 900
- Patch #1365916: fix some unsafe 64-bit mmap methods.

901 902 903
- Bug #1290333: Added a workaround for cjkcodecs' _codecs_cn build
  problem on AIX.

904 905
- Bug #869197: os.setgroups rejects long integer arguments

906 907
- Bug #1346533, select.poll() doesn't raise an error if timeout > sys.maxint

908 909
- Bug #1344508, Fix UNIX mmap leaking file descriptors

910 911 912
- Patch #1338314, Bug #1336623: fix tarfile so it can extract
  REGTYPE directories from tarfiles written by old programs.

913 914 915 916 917 918
- Patch #1407992, fixes broken bsddb module db associate when using
  BerkeleyDB 3.3, 4.0 or 4.1.

- Get bsddb module to build with BerkeleyDB version 4.4

- Get bsddb module to build with BerkeleyDB version 3.2
919

920 921 922
- Patch #1309009, Fix segfault in pyexpat when the XML document is in latin_1,
  but Python incorrectly assumes it is in UTF-8 format

923 924
- Fix parse errors in the readline module when compiling without threads.

925 926 927
- Patch #1288833: Removed thread lock from socket.getaddrinfo on
  FreeBSD 5.3 and later versions which got thread-safe getaddrinfo(3).

928 929 930
- Patches #1298449 and #1298499: Add some missing checks for error
  returns in cStringIO.c.

931 932 933
- Patch #1297028: fix segfault if call type on MultibyteCodec,
  MultibyteStreamReader, or MultibyteStreamWriter

Neal Norwitz's avatar
Neal Norwitz committed
934 935
- Fix memory leak in posix.access().

936 937
- Patch #1213831: Fix typo in unicodedata._getcode.

Georg Brandl's avatar
Georg Brandl committed
938 939 940
- Bug #1007046: os.startfile() did not accept unicode strings encoded in
  the file system encoding.

941 942
- Patch #756021: Special-case socket.inet_aton('255.255.255.255') for
  platforms that don't have inet_aton().
943

944 945 946
- Bug #1215928: Fix bz2.BZ2File.seek() for 64-bit file offsets.

- Bug #1191043: Fix bz2.BZ2File.(x)readlines for files containing one
947 948
  line without newlines.

949 950 951
- Bug #728515: mmap.resize() now resizes the file on Unix as it did
  on Windows.

Walter Dörwald's avatar
Walter Dörwald committed
952
- Patch #1180695: Add nanosecond stat resolution, and st_gen,
953 954
  st_birthtime for FreeBSD.

955 956 957 958
- Patch #1231069: The fcntl.ioctl function now uses the 'I' code for
  the request code argument, which results in more C-like behaviour
  for large or negative values.

959
- Bug #1234979: For the argument of thread.Lock.acquire, the Windows
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
960
  implementation treated all integer values except 1 as false.
961

962 963
- Bug #1194181: bz2.BZ2File didn't handle mode 'U' correctly.

964 965 966
- Patch #1212117: os.stat().st_flags is now accessible as a attribute
  if available on the platform.

967 968 969
- Patch #1103951: Expose O_SHLOCK and O_EXLOCK in the posix module if
  available on the platform.

970 971 972
- Bug #1166660: The readline module could segfault if hook functions
  were set in a different thread than that which called readline.

973 974
- collections.deque objects now support a remove() method.

975 976 977 978
- operator.itemgetter() and operator.attrgetter() now support retrieving
  multiple fields.  This provides direct support for sorting on multiple
  keys (primary, secondary, etc).

979 980
- os.access now supports Unicode path names on non-Win32 systems.

981 982 983
- Patches #925152, #1118602: Avoid reading after the end of the buffer
  in pyexpat.GetInputContext.

984
- Patches #749830, #1144555: allow UNIX mmap size to default to current
985 986
  file size.

987 988
- Added functional.partial().  See PEP309.

989 990 991
- Patch #1093585: raise a ValueError for negative history items in readline.
  {remove_history,replace_history}

Fred Drake's avatar
Fred Drake committed
992 993
- The spwd module has been added, allowing access to the shadow password
  database.
994

995 996
- stat_float_times is now True.

997 998
- array.array objects are now picklable.

999 1000 1001
- the cPickle module no longer accepts the deprecated None option in the
  args tuple returned by __reduce__().

1002 1003 1004 1005
- itertools.islice() now accepts None for the start and step arguments.
  This allows islice() to work more readily with slices:
      islice(s.start, s.stop, s.step)

1006 1007
- datetime.datetime() now has a strptime class method which can be used to
  create datetime object using a string and format.
1008

Matthias Klose's avatar
Matthias Klose committed
1009
- Patch #1117961: Replace the MD5 implementation from RSA Data Security Inc
1010 1011
  with the implementation from http://sourceforge.net/projects/libmd5-rfc/.

1012 1013 1014
Library
-------

1015 1016 1017 1018
- PEP 338: new module runpy defines a run_module function to support
  executing modules which provide access to source code or a code object
  via the PEP 302 import mechanisms.

1019 1020 1021 1022
- The email module's parsedate_tz function now sets the daylight savings
  flag to -1 (unknown) since it can't tell from the date whether it should
  be set.

1023 1024 1025
- Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
  now sport attributes that provide access to the parts of the result.

1026 1027 1028
- Patch #1462498: sgmllib now handles entity and character references
  in attribute values.

1029
- Added the sqlite3 package. This is based on pysqlite2.1.3, and provides
1030
  a DB-API interface in the standard library. You'll need sqlite 3.0.8 or
1031
  later to build this - if you have an earlier version, the C extension
1032 1033
  module will not be built.

1034 1035 1036 1037 1038
- Bug #1460340: ``random.sample(dict)`` failed in various ways.  Dicts
  aren't officially supported here, and trying to use them will probably
  raise an exception some day.  But dicts have been allowed, and "mostly
  worked", so support for them won't go away without warning.

1039 1040 1041
- Bug #1445068: getpass.getpass() can now be given an explicit stream
  argument to specify where to write the prompt.

1042 1043 1044
- Patch #1462313, bug #1443328: the pickle modules now can handle classes
  that have __private names in their __slots__.

1045
- Bug #1250170: mimetools now handles socket.gethostname() failures gracefully.
1046

1047 1048 1049
- patch #1457316: "setup.py upload" now supports --identity to select the
  key to be used for signing the uploaded code.

1050 1051 1052 1053
- Queue.Queue objects now support .task_done() and .join() methods
  to make it easier to monitor when daemon threads have completed
  processing all enqueued tasks.  Patch #1455676.

1054 1055
- popen2.Popen objects now preserve the command in a .cmd attribute.

Thomas Heller's avatar
Thomas Heller committed
1056 1057
- Added the ctypes ffi package.

Barry Warsaw's avatar
Barry Warsaw committed
1058 1059 1060 1061 1062 1063 1064 1065
- email 4.0 package now integrated.  This is largely the same as the email 3.0
  package that was included in Python 2.3, except that PEP 8 module names are
  now used (e.g. mail.message instead of email.Message).  The MIME classes
  have been moved to a subpackage (e.g. email.mime.text instead of
  email.MIMEText).  The old names are still supported for now.  Several
  deprecated Message methods have been removed and lots of bugs have been
  fixed.  More details can be found in the email package documentation.

1066 1067 1068 1069 1070 1071
- Patches #1436130/#1443155: codecs.lookup() now returns a CodecInfo object
  (a subclass of tuple) that provides incremental decoders and encoders
  (a way to use stateful codecs without the stream API). Python functions
  codecs.getincrementaldecoder() and codecs.getincrementalencoder() as well
  as C functions PyCodec_IncrementalEncoder() and PyCodec_IncrementalDecoder()
  have been added.
1072

1073 1074 1075 1076
- Patch #1359365: Calling next() on a closed StringIO.String object raises
  a ValueError instead of a StopIteration now (like file and cString.String do).
  cStringIO.StringIO.isatty() will raise a ValueError now if close() has been
  called before (like file and StringIO.StringIO do).
1077

Martin v. Löwis's avatar
Martin v. Löwis committed
1078 1079
- A regrtest option -w was added to re-run failed tests in verbose mode.

Georg Brandl's avatar
Georg Brandl committed
1080 1081 1082
- Patch #1446372: quit and exit can now be called from the interactive
  interpreter to exit.

1083 1084 1085
- The function get_count() has been added to the gc module, and gc.collect()
  grew an optional 'generation' argument.

Martin v. Löwis's avatar
Martin v. Löwis committed
1086 1087 1088
- A library msilib to generate Windows Installer files, and a distutils
  command bdist_msi have been added.

1089 1090 1091
- PEP 343: new module contextlib.py defines decorator @contextmanager
  and helpful context managers nested() and closing().

Martin v. Löwis's avatar
Martin v. Löwis committed
1092 1093
- The compiler package now supports future imports after the module docstring.

1094 1095 1096
- Bug #1413790: zipfile now sanitizes absolute archive names that are
  not allowed by the specs.

1097 1098 1099
- Patch #1215184: FileInput now can be given an opening hook which can
  be used to control how files are opened.

1100 1101 1102
- Patch #1212287: fileinput.input() now has a mode parameter for
  specifying the file mode input files should be opened with.

1103 1104 1105
- Patch #1215184: fileinput now has a fileno() function for getting the
  current file number.

1106 1107 1108
- Patch #1349274: gettext.install() now optionally installs additional
  translation functions other than _() in the builtin namespace.

1109 1110
- Patch #1337756: fileinput now accepts Unicode filenames.

1111 1112 1113
- Patch #1373643: The chunk module can now read chunks larger than
  two gigabytes.

1114 1115
- Patch #1417555: SimpleHTTPServer now returns Last-Modified headers.

1116 1117 1118
- Bug #1430298: It is now possible to send a mail with an empty
  return address using smtplib.

Georg Brandl's avatar
Georg Brandl committed
1119 1120
- Bug #1432260: The names of lambda functions are now properly displayed
  in pydoc.
1121

1122 1123 1124
- Patch #1412872: zipfile now sets the creator system to 3 (Unix)
  unless the system is Win32.

Tim Peters's avatar
Tim Peters committed
1125
- Patch #1349118: urllib now supports user:pass@ style proxy
1126 1127 1128
  specifications, raises IOErrors when proxies for unsupported protocols
  are defined, and uses the https proxy on https redirections.

1129 1130 1131
- Bug #902075: urllib2 now supports 'host:port' style proxy specifications.

- Bug #1407902: Add support for sftp:// URIs to urlparse.
1132

1133 1134
- Bug #1371247: Update Windows locale identifiers in locale.py.

Neal Norwitz's avatar
Neal Norwitz committed
1135
- Bug #1394565: SimpleHTTPServer now doesn't choke on query parameters
1136
  any more.
1137

1138 1139
- Bug #1403410: The warnings module now doesn't get confused
  when it can't find out the module name it generates a warning for.
1140

1141 1142
- Patch #1177307: Added a new codec utf_8_sig for UTF-8 with a BOM signature.

1143 1144
- Patch #1157027: cookielib mishandles RFC 2109 cookies in Netscape mode

1145 1146 1147 1148
- Patch #1117398: cookielib.LWPCookieJar and .MozillaCookieJar now raise
  LoadError as documented, instead of IOError.  For compatibility,
  LoadError subclasses IOError.

1149
- Added the hashlib module.  It provides secure hash functions for MD5 and
1150 1151 1152 1153 1154 1155 1156 1157 1158 1159
  SHA1, 224, 256, 384, and 512.  Note that recent developments make the
  historic MD5 and SHA1 unsuitable for cryptographic-strength applications.
  In <http://mail.python.org/pipermail/python-dev/2005-December/058850.html>
  Ronald L. Rivest offered this advice for Python:

      "The consensus of researchers in this area (at least as
      expressed at the NIST Hash Function Workshop 10/31/05),
      is that SHA-256 is a good choice for the time being, but
      that research should continue, and other alternatives may
      arise from this research.  The larger SHA's also seem OK."
1160

1161 1162 1163 1164
- Added a subset of Fredrik Lundh's ElementTree package.  Available
  modules are xml.etree.ElementTree, xml.etree.ElementPath, and
  xml.etree.ElementInclude, from ElementTree 1.2.6.

1165 1166
- Patch #1162825: Support non-ASCII characters in IDLE window titles.

1167 1168
- Bug #1365984: urllib now opens "data:" URLs again.

1169 1170 1171 1172
- Patch #1314396: prevent deadlock for threading.Thread.join() when an exception
  is raised within the method itself on a previous call (e.g., passing in an
  illegal argument)

1173 1174 1175
- Bug #1340337: change time.strptime() to always return ValueError when there
  is an error in the format string.

1176 1177
- Patch #754022: Greatly enhanced webbrowser.py (by Oleg Broytmann).

Walter Dörwald's avatar
Walter Dörwald committed
1178
- Bug #729103: pydoc.py: Fix docother() method to accept additional
1179 1180
  "parent" argument.

1181 1182 1183
- Patch #1300515: xdrlib.py: Fix pack_fstring() to really use null bytes
  for padding.

1184 1185 1186
- Bug #1296004: httplib.py: Limit maximal amount of data read from the
  socket to avoid a MemoryError on Windows.

1187 1188 1189 1190 1191 1192
- Patch #1166948: locale.py: Prefer LC_ALL, LC_CTYPE and LANG over LANGUAGE
  to get the correct encoding.

- Patch #1166938: locale.py: Parse LANGUAGE as a colon separated list of
  languages.

1193 1194
- Patch #1268314: Cache lines in StreamReader.readlines for performance.

1195 1196
- Bug #1290505: Fix clearing the regex cache for time.strptime().

1197 1198
- Bug #1167128: Fix size of a symlink in a tarfile to be 0.

1199 1200 1201
- Patch #810023: Fix off-by-one bug in urllib.urlretrieve reporthook
  functionality.

1202 1203
- Bug #1163178: Make IDNA return an empty string when the input is empty.

1204
- Patch #848017: Make Cookie more RFC-compliant. Use CRLF as default output
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1205
  separator and do not output trailing semicolon.
1206

1207 1208 1209 1210
- Patch #1062060: urllib.urlretrieve() now raises a new exception, named
  ContentTooShortException, when the actually downloaded size does not
  match the Content-Length header.

1211 1212
- Bug #1121494: distutils.dir_utils.mkpath now accepts Unicode strings.

1213 1214
- Bug #1178484: Return complete lines from codec stream readers
  even if there is an exception in later lines, resulting in
Walter Dörwald's avatar
Walter Dörwald committed
1215
  correct line numbers for decoding errors in source code.
1216

1217 1218
- Bug #1192315: Disallow negative arguments to clear() in pdb.

1219 1220
- Patch #827386: Support absolute source paths in msvccompiler.py.

1221 1222 1223
- Patch #1105730: Apply the new implementation of commonprefix in posixpath
  to ntpath, macpath, os2emxpath and riscospath.

1224 1225 1226 1227
- Fix a problem in Tkinter introduced by SF patch #869468: delete bogus
  __hasattr__ and __delattr__ methods on class Tk that were breaking
  Tkdnd.

1228 1229 1230
- Bug #1015140: disambiguated the term "article id" in nntplib docs and
  docstrings to either "article number" or "message id".

1231 1232 1233
- Bug #1238170: threading.Thread.__init__ no longer has "kwargs={}" as a
  parameter, but uses the usual "kwargs=None".

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1234
- textwrap now processes text chunks at O(n) speed instead of O(n**2).
1235 1236
  Patch #1209527 (Contributed by Connelly).

1237 1238 1239
- urllib2 has now an attribute 'httpresponses' mapping from HTTP status code
  to W3C name (404 -> 'Not Found'). RFE #1216944.

1240 1241 1242
- Bug #1177468: Don't cache the /dev/urandom file descriptor for os.urandom,
  as this can cause problems with apps closing all file descriptors.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1243
- Bug #839151: Fix an attempt to access sys.argv in the warnings module;
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1244
  it can be missing in embedded interpreters
1245

1246 1247
- Bug #1155638: Fix a bug which affected HTTP 0.9 responses in httplib.

1248 1249 1250
- Bug #1100201: Cross-site scripting was possible on BaseHTTPServer via
  error messages.

1251 1252
- Bug #1108948: Cookie.py produced invalid JavaScript code.

1253 1254 1255
- The tokenize module now detects and reports indentation errors.
  Bug #1224621.

1256
- The tokenize module has a new untokenize() function to support a full
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1257
  roundtrip from lexed tokens back to Python source code.  In addition,
1258 1259 1260
  the generate_tokens() function now accepts a callable argument that
  terminates by raising StopIteration.

1261 1262
- Bug #1196315: fix weakref.WeakValueDictionary constructor.

1263 1264 1265
- Bug #1213894: os.path.realpath didn't resolve symlinks that were the first
  component of the path.

1266 1267 1268 1269 1270
- Patch #1120353: The xmlrpclib module provides better, more transparent,
  support for datetime.{datetime,date,time} objects.  With use_datetime set
  to True, applications shouldn't have to fiddle with the DateTime wrapper
  class at all.

1271 1272 1273
- distutils.commands.upload was added to support uploading distribution
  files to PyPI.

1274 1275 1276
- distutils.commands.register now encodes the data as UTF-8 before posting
  them to PyPI.

1277 1278 1279 1280 1281
- decimal operator and comparison methods now return NotImplemented
  instead of raising a TypeError when interacting with other types.  This
  allows other classes to implement __radd__ style methods and have them
  work as expected.

1282 1283 1284
- Bug #1163325:  Decimal infinities failed to hash.  Attempting to
  hash a NaN raised an InvalidOperation instead of a TypeError.

1285
- Patch #918101: Add tarfile open mode r|* for auto-detection of the
1286 1287
  stream compression; add, for symmetry reasons, r:* as a synonym of r.

1288 1289
- Patch #1043890: Add extractall method to tarfile.

1290 1291 1292
- Patch #1075887: Don't require MSVC in distutils if there is nothing
  to build.

1293 1294 1295
- Patch #1103407: Properly deal with tarfile iterators when untarring
  symbolic links on Windows.

1296
- Patch #645894: Use getrusage for computing the time consumption in
1297 1298
  profile.py if available.

1299 1300
- Patch #1046831: Use get_python_version where appropriate in sysconfig.py.

1301 1302 1303
- Patch #1117454: Remove code to special-case cookies without values
  in LWPCookieJar.

1304 1305
- Patch #1117339: Add cookielib special name tests.

1306 1307
- Patch #1112812: Make bsddb/__init__.py more friendly for modulefinder.

1308 1309
- Patch #1110248: SYNC_FLUSH the zlib buffer for GZipFile.flush.

1310 1311
- Patch #1107973: Allow to iterate over the lines of a tarfile.ExFileObject.

1312 1313
- Patch #1104111: Alter setup.py --help and --help-commands.

1314 1315
- Patch #1121234: Properly cleanup _exit and tkerror commands.

1316 1317
- Patch #1049151: xdrlib now unpacks booleans as True or False.

1318 1319
- Fixed bug in a NameError bug in cookielib.  Patch #1116583.

1320 1321 1322 1323
- Applied a security fix to SimpleXMLRPCserver (PSF-2005-001).  This
  disables recursive traversal through instance attributes, which can
  be exploited in various ways.

1324
- Bug #1222790: in SimpleXMLRPCServer, set the reuse-address and close-on-exec
1325 1326
  flags on the HTTP listening socket.

1327 1328 1329
- Bug #792570: SimpleXMLRPCServer had problems if the request grew too large.
  Fixed by reading the HTTP body in chunks instead of one big socket.read().

1330
- Patches #893642, #1039083: add allow_none, encoding arguments to constructors of
1331 1332
  SimpleXMLRPCServer and CGIXMLRPCRequestHandler.

1333 1334
- Bug #1110478: Revert os.environ.update to do putenv again.

1335 1336
- Bug #1103844: fix distutils.install.dump_dirs() with negated options.

1337 1338
- os.{SEEK_SET, SEEK_CUR, SEEK_END} have been added for convenience.

1339 1340 1341
- Enhancements to the csv module:

  + Dialects are now validated by the underlying C code, better
1342
    reflecting its capabilities, and improving its compliance with
1343
    PEP 305.
1344 1345 1346 1347 1348
  + Dialect parameter parsing has been re-implemented to improve error
    reporting.
  + quotechar=None and quoting=QUOTE_NONE now work the way PEP 305
    dictates.
  + the parser now removes the escapechar prefix from escaped characters.
1349
  + when quoting=QUOTE_NONNUMERIC, the writer now tests for numeric
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1350
    types, rather than any object that can be represented as a numeric.
1351 1352
  + when quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
    to floats.
1353 1354
  + reader now allows \r characters to be quoted (previously it only allowed
    \n to be quoted).
1355
  + writer doublequote handling improved.
1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367
  + Dialect classes passed to the module are no longer instantiated by
    the module before being parsed (the former validation scheme required
    this, but the mechanism was unreliable).
  + The dialect registry now contains instances of the internal
    C-coded dialect type, rather than references to python objects.
  + the internal c-coded dialect type is now immutable.
  + register_dialect now accepts the same keyword dialect specifications
    as the reader and writer, allowing the user to register dialects
    without first creating a dialect class.
  + a configurable limit to the size of parsed fields has been added -
    previously, an unmatched quote character could result in the entire
    file being read into the field buffer before an error was reported.
1368
  + A new module method csv.field_size_limit() has been added that sets
1369 1370
    the parser field size limit (returning the former limit). The initial
    limit is 128kB.
1371 1372 1373 1374
  + A line_num attribute has been added to the reader object, which tracks
    the number of lines read from the source iterator. This is not
    the same as the number of records returned, as records can span
    multiple lines.
1375 1376 1377
  + reader and writer objects were not being registered with the cyclic-GC.
    This has been fixed.

1378 1379 1380 1381 1382
- _DummyThread objects in the threading module now delete self.__block that is
  inherited from _Thread since it uses up a lock allocated by 'thread'.  The
  lock primitives tend to be limited in number and thus should not be wasted on
  a _DummyThread object.  Fixes bug #1089632.

1383 1384
- The imghdr module now detects Exif files.

1385 1386 1387
- StringIO.truncate() now correctly adjusts the size attribute.
  (Bug #951915).

1388 1389 1390
- locale.py now uses an updated locale alias table (built using
  Tools/i18n/makelocalealias.py, a tool to parse the X11 locale
  alias file); the encoding lookup was enhanced to use Python's
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1391
  encoding alias table.
1392

Raymond Hettinger's avatar
Raymond Hettinger committed
1393 1394
- moved deprecated modules to Lib/lib-old:  whrandom, tzparse, statcache.

1395 1396 1397
- the pickle module no longer accepts the deprecated None option in the
  args tuple returned by __reduce__().

1398 1399
- optparse now optionally imports gettext.  This allows its use in setup.py.

1400 1401
- the pickle module no longer uses the deprecated bin parameter.

1402 1403
- the shelve module no longer uses the deprecated binary parameter.

1404 1405
- the pstats module no longer uses the deprecated ignore() method.

1406 1407
- the filecmp module no longer uses the deprecated use_statcache argument.

1408 1409 1410 1411
- unittest.TestCase.run() and unittest.TestSuite.run() can now be successfully
  extended or overridden by subclasses.  Formerly, the subclassed method would
  be ignored by the rest of the module.  (Bug #1078905).

1412
- heapq.nsmallest() and heapq.nlargest() now support key= arguments with
1413
  the same meaning as in list.sort().
1414

1415 1416 1417 1418
- Bug #1076985: ``codecs.StreamReader.readline()`` now calls ``read()`` only
  once when a size argument is given. This prevents a buffer overflow in the
  tokenizer with very long source lines.

Barry Warsaw's avatar
Barry Warsaw committed
1419 1420 1421
- Bug #1083110: ``zlib.decompress.flush()`` would segfault if called
  immediately after creating the object, without any intervening
  ``.decompress()`` calls.
1422

1423 1424
- The reconvert.quote function can now emit triple-quoted strings.  The
  reconvert module now has some simple documentation.
1425

1426 1427 1428
- ``UserString.MutableString`` now supports negative indices in
  ``__setitem__`` and ``__delitem__``

1429 1430 1431
- Bug #1149508: ``textwrap`` now handles hyphenated numbers (eg. "2004-03-05")
  correctly.

1432 1433 1434 1435 1436 1437
- Partial fixes for SF bugs #1163244 and #1175396: If a chunk read by
  ``codecs.StreamReader.readline()`` has a trailing "\r", read one more
  character even if the user has passed a size parameter to get a proper
  line ending. Remove the special handling of a "\r\n" that has been split
  between two lines.

1438 1439 1440 1441
- Bug #1251300: On UCS-4 builds the "unicode-internal" codec will now complain
  about illegal code points. The codec now supports PEP 293 style error
  handlers.

Walter Dörwald's avatar
Walter Dörwald committed
1442
- Bug #1235646: ``codecs.StreamRecoder.next()`` now reencodes the data it reads
1443 1444
  from the input stream, so that the output is a byte string in the correct
  encoding instead of a unicode string.
1445

1446 1447 1448
- Bug #1202493: Fixing SRE parser to handle '{}' as perl does, rather than
  considering it exactly like a '*'.

1449 1450
- Bug #1245379: Add "unicode-1-1-utf-7" as an alias for "utf-7" to
  ``encodings.aliases``.
1451

1452 1453
- ` uu.encode()`` and ``uu.decode()`` now support unicode filenames.

1454 1455 1456
- Patch #1413711: Certain patterns of differences were making difflib
  touch the recursion limit.

1457 1458
- Bug #947906: An object oriented interface has been added to the calendar
  module. It's possible to generate HTML calendar now and the module can be
1459 1460 1461
  called as a script (e.g. via ``python -mcalendar``). Localized month and
  weekday names can be ouput (even if an exotic encoding is used) using
  special classes that use unicode.
1462

1463 1464 1465
Build
-----

1466 1467 1468
- Fix test_float, test_long, and test_struct failures on Tru64 with gcc
  by using -mieee gcc option.

1469 1470
- Patch #1432345: Make python compile on DragonFly.

1471 1472
- Build support for Win64-AMD64 was added.

1473 1474
- Patch #1428494: Prefer linking against ncursesw over ncurses library.

1475 1476
- Patch #881820: look for openpty and forkpty also in libbsd.

1477 1478 1479
- The sources of zlib are now part of the Python distribution (zlib 1.2.3).
  The zlib module is now builtin on Windows.

1480 1481
- Use -xcode=pic32 for CCSHARED on Solaris with SunPro.

1482 1483 1484
- Bug #1189330: configure did not correctly determine the necessary
  value of LINKCC if python was built with GCC 4.0.

1485 1486 1487
- Upgrade Windows build to zlib 1.2.3 which eliminates a potential security
  vulnerability in zlib 1.2.1 and 1.2.2.

1488 1489 1490
- EXTRA_CFLAGS has been introduced as an environment variable to hold compiler
  flags that change binary compatibility.  Changes were also made to
  distutils.sysconfig to also use the environment variable when used during
1491
  compilation of the interpreter and of C extensions through distutils.
1492

1493 1494 1495 1496
- SF patch 1171735: Darwin 8's headers are anal about POSIX compliance,
  and linking has changed (prebinding is now deprecated, and libcc_dynamic
  no longer exists). This configure patch makes things right.

1497 1498
- Bug #1158607: Build with --disable-unicode again.

1499 1500 1501
- spwdmodule.c is built only if either HAVE_GETSPNAM or HAVE_HAVE_GETSPENT is
  defined.  Discovered as a result of not being able to build on OS X.

1502 1503 1504 1505 1506 1507 1508 1509 1510
- setup.py now uses the directories specified in LDFLAGS using the -L option
  and in CPPFLAGS using the -I option for adding library and include
  directories, respectively, for compiling extension modules against.  This has
  led to the core being compiled using the values in CPPFLAGS.  It also removes
  the need for the special-casing of both DarwinPorts and Fink for darwin since
  the proper directories can be specified in LDFLAGS (``-L/sw/lib`` for Fink,
  ``-L/opt/local/lib`` for DarwinPorts) and CPPFLAGS (``-I/sw/include`` for
  Fink, ``-I/opt/local/include`` for DarwinPorts).

1511 1512 1513 1514 1515
- Test in configure.in that checks for tzset no longer dependent on tm->tm_zone
  to exist in the struct (not required by either ISO C nor the UNIX 2 spec).
  Tests for sanity in tzname when HAVE_TZNAME defined were also defined.
  Closes bug #1096244.  Thanks Gregory Bond.

1516 1517 1518
C API
-----

Tim Peters's avatar
Tim Peters committed
1519 1520 1521 1522 1523 1524 1525 1526 1527 1528 1529
- ``PyMem_{Del, DEL}`` and ``PyMem_{Free, FREE}`` no longer map to
  ``PyObject_{Free, FREE}``.  They map to the system ``free()`` now.  If memory
  is obtained via the ``PyObject_`` family, it must be released via the
  ``PyObject_`` family, and likewise for the ``PyMem_`` family.  This has
  always been officially true, but when Python's small-object allocator was
  introduced, an attempt was made to cater to a few extension modules
  discovered at the time that obtained memory via ``PyObject_New`` but
  released it via ``PyMem_DEL``.  It's years later, and if such code still
  exists it will fail now (probably with segfaults, but calling wrong
  low-level memory management functions can yield many symptoms).

1530 1531
- Added a C API for set and frozenset objects.

Raymond Hettinger's avatar
Raymond Hettinger committed
1532 1533
- Removed PyRange_New().

1534 1535 1536 1537 1538
- Patch #1313939: PyUnicode_DecodeCharmap() accepts a unicode string as the
  mapping argument now. This string is used as a mapping table. Byte values
  greater than the length of the string and 0xFFFE are treated as undefined
  mappings.

1539 1540 1541 1542

Tests
-----

1543
- In test_os, st_?time is now truncated before comparing it with ST_?TIME.
1544

1545 1546 1547
- Patch #1276356: New resource "urlfetch" is implemented.  This enables
  even impatient people to run tests that require remote files.

1548 1549 1550 1551

Documentation
-------------

1552 1553
- Bug #1402224: Add warning to dl docs about crashes.

1554 1555 1556
- Bug #1396471: Document that Windows' ftell() can return invalid
  values for text files with UNIX-style line endings.

1557 1558
- Bug #1274828: Document os.path.splitunc().

1559 1560
- Bug #1190204: Clarify which directories are searched by site.py.

1561 1562
- Bug #1193849: Clarify os.path.expanduser() documentation.

1563 1564
- Bug #1243192: re.UNICODE and re.LOCALE affect \d, \D, \s and \S.

1565 1566
- Bug #755617: Document the effects of os.chown() on Windows.

1567 1568 1569 1570 1571 1572 1573 1574
- Patch #1180012: The documentation for modulefinder is now in the library reference.

- Patch #1213031: Document that os.chown() accepts argument values of -1.

- Bug #1190563: Document os.waitpid() return value with WNOHANG flag.

- Bug #1175022: Correct the example code for property().

Georg Brandl's avatar
Georg Brandl committed
1575 1576 1577
- Document the IterableUserDict class in the UserDict module.
  Closes bug #1166582.

1578 1579 1580 1581
- Remove all latent references for "Macintosh" that referred to semantics for
  Mac OS 9 and change to reflect the state for OS X.
  Closes patch #1095802.  Thanks Jack Jansen.

1582 1583 1584 1585
Mac
---


Hye-Shik Chang's avatar
Hye-Shik Chang committed
1586 1587 1588 1589 1590
New platforms
-------------

- FreeBSD 7 support is added.

1591 1592 1593 1594

Tools/Demos
-----------

1595 1596 1597 1598
- Created Misc/Vim/vim_syntax.py to auto-generate a python.vim file in that
  directory for syntax highlighting in Vim.  Vim directory was added and placed
  vimrc to it (was previous up a level).

1599 1600 1601 1602 1603
- Added two new files to Tools/scripts: pysource.py, which recursively
  finds Python source files, and findnocoding.py, which finds Python
  source files that need an encoding declaration.
  Patch #784089, credits to Oleg Broytmann.

1604 1605
- Bug #1072853: pindent.py used an uninitialized variable.

1606
- Patch #1177597: Correct Complex.__init__.
1607

Barry Warsaw's avatar
Barry Warsaw committed
1608 1609
- Fixed a display glitch in Pynche, which could cause the right arrow to
  wiggle over by a pixel.
1610

1611 1612 1613
----

**(For information about older versions, consult the HISTORY file.)**