NEWS 121 KB
Newer Older
1
+++++++++++
2 3 4
Python News
+++++++++++

Anthony Baxter's avatar
Anthony Baxter committed
5 6
(editors: check NEWS.help for information about editing NEWS using ReST.)

7 8
What's New in Python 2.6 alpha 1?
=================================
9

Neal Norwitz's avatar
Neal Norwitz committed
10 11 12 13 14
*Release date: XX-XXX-200X*

Core and builtins
-----------------

Raymond Hettinger's avatar
Raymond Hettinger committed
15 16
- sets and frozensets now have an isdisjoint() method.

17 18
- optimize the performance of builtin.sum().

19 20
- Fix warnings found by the new version of the Coverity checker.

21 22 23 24
- The enumerate() builtin function is no longer bounded to sequences smaller
  than LONG_MAX.  Formerly, it raised an OverflowError.  Now, automatically
  shifts from ints to longs.

25 26 27 28 29 30
- Issue #1686386: Tuple's tp_repr did not take into account the possibility of
  having a self-referential tuple, which is possible from C code.  Nor did
  object's tp_str consider that a type's tp_str could do something that could
  lead to an inifinite recursion.  Py_ReprEnter() and Py_EnterRecursiveCall(),
  respectively, fixed the issues.

31 32 33 34 35
- Issue #1164: It was possible to trigger deadlock when using the 'print'
  statement to write to a file since the GIL was not released as needed.  Now
  PyObject_Print() does the right thing along with various tp_print
  implementations of the built-in types and those in the collections module.

36 37 38
- Issue #1147: Exceptions were directly allowing string exceptions in their
  throw() method even though string exceptions no longer allowed.

39 40 41
- Issue #1096: Prevent a segfault from getting the repr of a very deeply nested
  list by using the recursion counter.

42 43 44 45 46 47
- Issue #1202533: Fix infinite recursion calls triggered by calls to
  PyObject_Call() never calling back out to Python code to trigger recursion
  depth updates/checks.  Required the creation of a static RuntimeError
  instance in case normalizing an exception put the recursion check value past
  its limit.  Fixes crashers infinite_rec_(1|2|4|5).py.

48 49 50
- Patch #1031213: Decode source line in SyntaxErrors back to its original source
  encoding.

51 52
- Py_ssize_t fields work in structmember when HAVE_LONG_LONG is not defined.

53 54 55 56
- PEP 3123: Provide forward compatibility with Python 3.0, while keeping
  backwards compatibility. Add Py_Refcnt, Py_Type, Py_Size, and
  PyVarObject_HEAD_INIT.

57 58 59
- Patch #1673759: add a missing overflow check when formatting floats
  with %G.

60 61
- Patch #1733960: Allow T_LONGLONG to accept ints.

62 63
- T_PYSSIZET can now be used in PyMemberDef lists for Py_ssize_t members.

Neal Norwitz's avatar
Neal Norwitz committed
64 65
- Prevent expandtabs() on string and unicode objects from causing a segfault
  when a large width is passed on 32-bit platforms.
66

67 68
- Bug #1733488: Fix compilation of bufferobject.c on AIX.

Georg Brandl's avatar
Georg Brandl committed
69
- Bug #1722485: remove docstrings again when running with -OO.
70

71 72 73
- Add new attribute names for function objects.  All the func_* become
  __*__ attributes.  (Some already existed, e.g., __doc__ and __name__.)

74 75 76
- Add -3 option to the interpreter to warn about features that are
  deprecated and will be changed/removed in Python 3.0.

77 78 79
- Patch #1686487: you can now pass any mapping after '**' in function
  calls.

80 81 82 83
- except clauses may now be spelled either "except E, target:" or
  "except E as target:". This is to provide forwards compatibility with
  Python 3.0.

84 85
- Deprecate BaseException.message as per PEP 352.

Armin Rigo's avatar
Armin Rigo committed
86 87 88
- Bug #1303614: don't expose object's __dict__ when the dict is
  inherited from a builtin base.

89
- When __slots__ are set to a unicode string, make it work the same as
90 91
  setting a plain string, ie don't expand to single letter identifiers.

92 93
- Request #1191699:  Slices can now be pickled.

94 95 96 97
- Request #1193128:  str.translate() now allows a None argument for
  translations that only remove characters without re-mapping the
  remaining characters.

98 99 100
- Patch #1682205: a TypeError while unpacking an iterable is no longer
  masked by a generic one with the message "unpack non-sequence".

101 102
- Remove unused file Python/fmod.c.

103 104 105 106 107
- Bug #1683368: The object.__init__() and object.__new__() methods are
  now stricter in rejecting excess arguments.  The only time when
  either allows excess arguments is when it is not overridden and the
  other one is.  For backwards compatibility, when both are
  overridden, it is a deprecation warning (for now; maybe a Py3k
108 109
  warning later).  Also, type.__init__() insists on the same signature
  as supported by type.__new__().
110

111 112 113 114 115
- Patch #1675423: PyComplex_AsCComplex() now tries to convert an object
  to complex using its __complex__() method before falling back to the
  __float__() method. Therefore, the functions in the cmath module now
  can operate on objects that define a __complex__() method.

116 117 118
- Patch #1623563: allow __class__ assignment for classes with __slots__.
  The old and the new class are still required to have the same slot names.

119 120 121
- Patch #1642547: Fix an error/crash when encountering syntax errors in
  complex if statements.

122 123 124
- Patch #1462488: Python no longer segfaults when ``object.__reduce_ex__()``
  is called with an object that is faking its type.

125 126 127
- Patch #1680015: Don't modify __slots__ tuple if it contains an unicode
  name.

128 129
- Patch #1444529: the builtin compile() now accepts keyword arguments.

130 131 132
- Bug #1678647: write a newline after printing an exception in any
  case, even when converting the value to a string failed.

Georg Brandl's avatar
Georg Brandl committed
133 134 135 136
- The dir() function has been extended to call the __dir__() method on
  its argument, if it exists. If not, it will work like before. This allows
  customizing the output of dir() in the presence of a __getattr__().

137 138 139
- Patch #922167: Python no longer segfaults when faced with infinitely
  self-recursive reload() calls (as reported by bug #742342).

140 141
- Patch #1675981: remove unreachable code from ``type.__new__()`` method.

142 143 144 145
- Patch #1491866: change the complex() constructor to allow parthensized
  forms. This means complex(repr(x)) now works instead of raising a
  ValueError.

146 147 148 149
- Patch #703779: unset __file__ in __main__ after running a file. This
  makes the filenames the warning module prints much more sensible when
  a PYTHONSTARTUP file is used.

150 151 152 153 154
- Variant of patch #697613: don't exit the interpreter on a SystemExit
  exception if the -i command line option or PYTHONINSPECT environment
  variable is given, but break into the interactive interpreter just like
  on other exceptions or normal program exit.

155 156
- Patch #1638879: don't accept strings with embedded NUL bytes in long().

157 158
- Bug #1674503: close the file opened by execfile() in an error condition.

159 160 161
- Patch #1674228: when assigning a slice (old-style), check for the
  sq_ass_slice instead of the sq_slice slot.

162 163 164
- When printing an unraisable error, don't print exceptions. before the name.
  This duplicates the behavior whening normally printing exceptions.

165 166
- Bug #1653736: Properly discard third argument to slot_nb_inplace_power.

167 168 169
- PEP 352: Raising a string exception now triggers a TypeError.  Attempting to
  catch a string exception raises DeprecationWarning.

170 171 172 173
- Bug #1377858: Fix the segfaulting of the interpreter when an object created
  a weakref on itself during a __del__ call for new-style classes (classic
  classes still have the bug).

174 175 176
- Bug #1579370: Make PyTraceBack_Here use the current thread, not the
  frame's thread state.

177 178
- patch #1630975: Fix crash when replacing sys.stdout in sitecustomize.py

179 180
- Bug #1637022: Prefix AST symbols with _Py_.

181 182 183
- Prevent seg fault on shutdown which could occur if an object
  raised a warning.

184 185 186
- Bug #1566280: Explicitly invoke threading._shutdown from Py_Main,
  to avoid relying on atexit.

187 188
- Bug #1590891: random.randrange don't return correct value for big number

189 190 191
- Patch #1586791: Better exception messages for some operations on strings,
  tuples and lists.

192 193
- Bug #1067760: Deprecate passing floats to file.seek.

Martin v. Löwis's avatar
Martin v. Löwis committed
194 195
- Bug #1591996: Correctly forward exception in instance_contains().

196 197
- Bug #1588287: fix invalid assertion for `1,2` in debug builds.

198 199 200
- Bug #1576657: when setting a KeyError for a tuple key, make sure that
  the tuple isn't used as the "exception arguments tuple".

201 202
- Bug #1565514, SystemError not raised on too many nested blocks.

203 204 205
- Bug #1576174: WindowsError now displays the windows error code
  again, no longer the posix error code.

206 207 208
- Patch #1549049: Support long values in structmember, issue warnings
  if the assigned value for structmember fields gets truncated.

209 210 211
- Update the peephole optimizer to remove more dead code (jumps after returns)
  and inline unconditional jumps to returns.

212 213 214
- Bug #1545497: when given an explicit base, int() did ignore NULs
  embedded in the string to convert.

215 216 217
- Bug #1569998: break inside a try statement (outside a loop) is now
  recognized and rejected.

218 219 220 221 222 223 224 225
- list.pop(x) accepts any object x following the __index__ protocol.

- Fix some leftovers from the conversion from int to Py_ssize_t
  (relevant to strings and sequences of more than 2**31 items).

- A number of places, including integer negation and absolute value,
  were fixed to not rely on undefined behaviour of the C compiler
  anymore.
226

227 228 229
- Bug #1566800: make sure that EnvironmentError can be called with any
  number of arguments, as was the case in Python 2.4.

230 231 232 233
- Patch #1567691: super() and new.instancemethod() now don't accept
  keyword arguments any more (previously they accepted them, but didn't
  use them).

234 235 236 237
- Fix a bug in the parser's future statement handling that led to "with"
  not being recognized as a keyword after, e.g., this statement:
  from __future__ import division, with_statement

238 239
- Bug #1557232: fix seg fault with def f((((x)))) and def f(((x),)).

240 241
- Fix %zd string formatting on Mac OS X so it prints negative numbers.

242 243
- Allow exception instances to be directly sliced again.

244 245 246
- Bug #1551432: Exceptions do not define an explicit __unicode__ method.  This
  allows calling unicode() on exceptions classes directly to succeed.

Georg Brandl's avatar
Georg Brandl committed
247 248 249
- Make _PyGILState_NoteThreadState() static, it was not used anywhere
  outside of pystate.c and should not be necessary.

250 251 252 253
- Bug #1542051: Exceptions now correctly call PyObject_GC_UnTrack.
  Also make sure that every exception class has __module__ set to
  'exceptions'.

254 255 256
- Bug #1550983: emit better error messages for erroneous relative
  imports (if not in package and if beyond toplevel package).

257 258 259
- Overflow checking code in integer division ran afoul of new gcc
  optimizations.  Changed to be more standard-conforming.

260 261
- Patch #1542451: disallow continue anywhere under a finally.

262 263
- Patch #1546288: fix seg fault in dict_equal due to ref counting bug.

264 265 266
- The return tuple from str.rpartition(sep) is (tail, sep, head) where
  head is the original string if sep was not found.

267 268 269 270 271
- Bug #1520864: unpacking singleton tuples in list comprehensions and
  generator expressions (x for x, in ... ) works again.  Fixing this problem
  required changing the .pyc magic number.  This means that .pyc files
  generated before 2.5c2 will be regenerated.

272 273
- with and as are now keywords.

274
- Bug #1664966: Fix crash in exec if Unicode filename can't be decoded.
275 276 277 278

Library
-------

Nick Coghlan's avatar
Nick Coghlan committed
279 280 281
- Issue #1705170: contextlib.contextmanager was still swallowing
  StopIteration in some cases. This should no longer happen.

282 283 284
- Issue #1292: On alpha, arm, ppc, and s390 linux systems the
  --with-system-ffi configure option defaults to "yes".

285 286 287
- IN module for FreeBSD 8 is added and preexisting FreeBSD 6 and 7
  files are updated.

288 289 290
- Issues #1181, #1287: unsetenv() is now called when the os.environ.pop()
  and os.environ.clear() methods are used.

291 292 293
- ctypes will now work correctly on 32-bit systems when Python is
  configured with --with-system-ffi.

294
- Patch #1203: ctypes now does work on OS X when Python is built with
295
  --disable-toolbox-glue.
296

297 298
- collections.deque() now supports a "maxlen" argument.

299 300 301
- itertools.count() is no longer bounded to LONG_MAX.  Formerly, it raised
  an OverflowError.  Now, automatically shifts from ints to longs.

302 303
- Patch #1541463: optimize performance of cgi.FieldStorage operations.

Facundo Batista's avatar
Facundo Batista committed
304 305
- Decimal is fully updated to the latest Decimal Specification (v1.66).

306 307 308
- Bug #1153: repr.repr() now doesn't require set and dictionary items
  to be orderable to properly represent them.

309 310
- A 'c_longdouble' type was added to the ctypes module.

311 312
- Bug #1709599: Run test_1565150 only if the file system is NTFS.

Skip Montanaro's avatar
Skip Montanaro committed
313 314 315
- When encountering a password-protected robots.txt file the RobotFileParser
  no longer prompts interactively for a username and password (bug 813986).

316 317 318
- TarFile.__init__() no longer fails if no name argument is passed and
  the fileobj argument has no usable name attribute (e.g. StringIO).

319 320 321
- The functools module now provides 'reduce', for forward compatibility
  with Python 3000.

322 323
- Server-side SSL support and cert verification added, by Bill Janssen.

324 325
- socket.ssl deprecated; use new ssl module instead.

326 327
- uuid creation is now threadsafe.

328 329 330
- EUC-KR codec now handles the cheot-ga-keut composed make-up hangul
  syllables.

331 332 333
- GB18030 codec now can encode additional two-byte characters that
  are missing in GBK.

334 335
- Add new codecs for UTF-32, UTF-32-LE and UTF-32-BE.

336 337 338
- Bug #1704793: Return UTF-16 pair if unicodedata.lookup cannot
  represent the result in a single character.

339 340
- Bug #978833: Close https sockets by releasing the _ssl object.

341 342
- Change location of the package index to pypi.python.org/pypi

343 344 345 346
- Bug #1701409: Fix a segfault in printing ctypes.c_char_p and
  ctypes.c_wchar_p when they point to an invalid location.  As a
  sideeffect the representation of these instances has changed.

347 348
- tarfile.py: Added "exclude" keyword argument to TarFile.add().

349 350
- Bug #1734723: Fix repr.Repr() so it doesn't ignore the maxtuple attribute.

351 352 353
- The urlopen function of urllib2 now has an optional timeout parameter (note 
  that it actually works with HTTP, HTTPS, FTP and FTPS connections).

354 355 356 357
- In ftplib, the FTP.ntransfercmd method, when in passive mode, now uses
  the socket.create_connection function, using the timeout specified at
  connection time.

358 359 360 361
- Bug #1728403: Fix a bug that CJKCodecs StreamReader hangs when it
  reads a file that ends with incomplete sequence and sizehint argument
  for .read() is specified.

362 363 364
- Bug #1730389: Change time.strptime() to use ``\s+`` instead of ``\s*`` when
  matching spaces in the specified format argument.

365 366 367
- SF 1668596/1720897: distutils now copies data files
  even if package_dir is empty.

368 369
- sha now raises a DeprecationWarning upon import.

370 371
- md5 now raises a DeprecationWarning upon import.

372 373 374
- Issue1385: The hmac module now computes the correct hmac when using hashes
  with a block size other than 64 bytes (such as sha384 and sha512).

375 376
- mimify now raises a DeprecationWarning upon import.

377 378
- MimeWriter now raises a DeprecationWarning upon import.

379 380 381
- tarfile.py: Improved unicode support. Unicode input names are now
  officially supported. Added "errors" argument to the TarFile class.

382 383
- urllib.ftpwrapper class now accepts an optional timeout.

384 385
- shlex.split() now has an optional "posix" parameter.

386 387
- The posixfile module now raises a DeprecationWarning.

388 389 390
- Remove the gopherlib module.  This also leads to the removal of gopher
  support in urllib/urllib2.

391 392 393
- Fix bug in marshal where bad data would cause a segfault due to
  lack of an infinite recursion check.

394 395 396
- Removed plat-freebsd2 and plat-freebsd3 directories (and IN.py in
  the directories).

397 398 399 400
- HTML-escape the plain traceback in cgitb's HTML output, to prevent
  the traceback inadvertently or maliciously closing the comment and
  injecting HTML into the error page.

401 402
- The popen2 module and os.popen* are deprecated.  Use the subprocess module.

403 404 405 406 407 408 409 410 411 412 413
- Added an optional credentials argument to SMTPHandler, for use with SMTP
  servers which require authentication.

- Patch #1695948: Added optional timeout parameter to SocketHandler.

- Bug #1652788: Minor fix for currentframe.

- Patch #1598415: Added WatchedFileHandler to better support external
  log file rotation using e.g. newsyslog or logrotate. This handler is
  only useful in Unix/Linux environments.

414 415 416 417
- Bug #1706381: Specifying the SWIG option "-c++" in the setup.py file
  (as opposed to the command line) will now write file names ending in
  ".cpp" too.

418 419
- As specified in RFC 2616, an HTTP response like 2xx indicates that
  the client's request was successfully received, understood, and accepted.
420
  Now in these cases no error is raised in urllib (issue #1177) and urllib2.
421

422 423 424
- Bug #1290505: time.strptime's internal cache of locale information is now
  properly recreated when the locale is changed.

425 426
- Patch #1685563: remove (don't add) duplicate paths in distutils.MSVCCompiler.

427 428 429 430 431
- Added a timeout parameter to the constructor of other protocols
  (telnetlib, ftplib, smtplib and poplib). This is second part of the
  work started with create_connection() and timeout in httplib, and
  closes patch #723312.

432 433
- Patch #1676823: Added create_connection() to socket.py, which may be
  called with a timeout, and use it from httplib (whose HTTPConnection
434
  and HTTPSConnection now accept an optional timeout).
435

436 437
- Bug #978833: Revert r50844, as it broke _socketobject.dup.

438 439 440
- Bug #1675967: re patterns pickled with Python 2.4 and earlier can
  now be unpickled with Python 2.5 and newer.

441 442
- Patch #1630118: add a SpooledTemporaryFile class to tempfile.py.

443 444 445 446
- Patch #1273829: os.walk() now has a "followlinks" parameter. If set to
  True (which is not the default), it visits symlinks pointing to
  directories.

447 448 449 450 451
- Bug #1681228: the webbrowser module now correctly uses the default
  GNOME or KDE browser, depending on whether there is a session of one
  of those present. Also, it tries the Windows default browser before
  trying Mozilla variants.

452 453
- Patch #1339796: add a relpath() function to os.path.

454 455 456
- Patch #1681153: the wave module now closes a file object it opened if
  initialization failed.

457 458 459 460
- Bug #767111: fix long-standing bug in urllib which caused an
  AttributeError instead of an IOError when the server's response didn't
  contain a valid HTTP status line.

461 462 463 464
- Patch #957650: "%var%" environment variable references are now properly
  expanded in ntpath.expandvars(), also "~user" home directory references
  are recognized and handled on Windows.

465 466 467 468
- Patch #1429539: pdb now correctly initializes the __main__ module for
  the debugged script, which means that imports from __main__ work
  correctly now.

469 470
- The nonobvious commands.getstatus() function is now deprecated.

471 472 473
- Patch #1393667: pdb now has a "run" command which restarts the debugged
  Python program, optionally with different arguments.

474 475
- Patch #1649190: Adding support for _Bool to ctypes as c_bool.

476 477 478
- Patch #1530482: add pydoc.render_doc() which returns the documentation
  for a thing instead of paging it to stdout, which pydoc.doc() does.

479 480 481 482
- Patch #1533909: the timeit module now accepts callables in addition to
  strings for the code to time and the setup code. Also added two
  convenience functions for instantiating a Timer and calling its methods.

483 484 485 486
- Patch #1537850: tempfile.NamedTemporaryFile now has a "delete" parameter
  which can be set to False to prevent the default delete-on-close
  behavior.

487 488 489
- Patch #1581073: add a flag to textwrap that prevents the dropping of
  whitespace while wrapping.

490 491 492 493
- Patch #1603688: ConfigParser.SafeConfigParser now checks values that
  are set for invalid interpolation sequences that would lead to errors
  on reading back those values.

494 495 496
- Added support for the POSIX.1-2001 (pax) format to tarfile.py. Extended
  and cleaned up the test suite. Added a new testtar.tar.

497 498 499
- Patch #1449244: Support Unicode strings in
  email.message.Message.{set_charset,get_content_charset}.

500 501 502
- Patch #1542681: add entries for "with", "as" and "CONTEXTMANAGERS" to
  pydoc's help keywords.

503 504 505
- Patch #1555098: use str.join() instead of repeated string
  concatenation in robotparser.

506 507 508 509
- Patch #1635454: the csv.DictWriter class now includes the offending
  field names in its exception message if you try to write a record with
  a dictionary containing fields not in the CSV field names list.

510 511 512
- Patch #1668100: urllib2 now correctly raises URLError instead of
  OSError if accessing a local file via the file:// protocol fails.

513 514
- Patch #1677862: Require a space or tab after import in .pth files.

515 516 517
- Patch #1192590: Fix pdb's "ignore" and "condition" commands so they trap
  the IndexError caused by passing in an invalid breakpoint number.

518 519 520 521
- Patch #1599845: Add an option to disable the implicit calls to server_bind()
  and server_activate() in the constructors for TCPServer, SimpleXMLRPCServer
  and DocXMLRPCServer.

522
- Bug #1531963: Make SocketServer.TCPServer's server_address always
523 524
  be equal to calling getsockname() on the server's socket. Fixed by
  patch #1545011.
525

526 527 528
- Bug #1651235: When a tuple was passed to a ctypes function call,
  Python would crash instead of raising an error.

529 530 531
- Bug #1646630: ctypes.string_at(buf, 0) and ctypes.wstring_at(buf, 0)
  returned string up to the first NUL character.

532 533
- Patch #957003: Implement smtplib.LMTP.

534 535
- Patch #1481079: add support for HTTP_REFERER to CGIHTTPServer.

536 537 538 539
- Patch #1675424: Added tests for uncovered code in the zipfile module. 
  The KeyError raised by Zipfile.getinfo for nonexistent names now has 
  a descriptive message.

540 541
- Bug #1115886: os.path.splitext('.cshrc') gives now ('.cshrc', '').

542 543 544 545 546 547
- unittest now verifies more of its assumptions. In particular, TestCase
  and TestSuite subclasses (not instances) are no longer accepted in
  TestSuite.addTest(). This should cause no incompatibility since it
  never made sense with ordinary subclasses -- the failure just occurred
  later, with a more cumbersome exception.

548 549 550
- Patch #787789: allow to pass custom TestRunner instances to unittest's
  main() function.

551 552 553
- Patches #1550273, #1550272: fix a few bugs in unittest and add a
  comprehensive test suite for the module.

554 555 556
- Patch #1001604: glob.glob() now returns unicode filenames if it was
  given a unicode argument and os.listdir() returns unicode filenames.

557 558 559
- Patch #1673619: setup.py identifies extension modules it doesn't know how
  to build and those it knows how to build but that fail to build.

560
- Patch #912410: Replace HTML entity references for attribute values
561 562
  in HTMLParser.

563 564 565
- Patch #1663234: you can now run doctest on test files and modules
  using "python -m doctest [-v] filename ...".

566 567
- Patch #1121142: Implement ZipFile.open.

568 569
- Taught setup.py how to locate Berkeley DB on Macs using MacPorts.

570 571
- Added heapq.merge() for merging sorted input streams.

Raymond Hettinger's avatar
Raymond Hettinger committed
572
- Added collections.namedtuple() for assigning field names to tuples.
Raymond Hettinger's avatar
Raymond Hettinger committed
573

574 575
- Added itertools.izip_longest().

576 577 578
- Have the encoding package's search function dynamically import using absolute
  import semantics.

579 580
- Patch #1647484: Renamed GzipFile's filename attribute to name.

581 582 583
- Patch #1517891: Mode 'a' for ZipFile now creates the file if it
  doesn't exist.

584 585
- Patch #698833: Support file decryption in zipfile.

586 587
- Patch #685268: Consider a package's __path__ in imputil.

588 589
- Patch 1463026: Support default namespace in XMLGenerator.

Skip Montanaro's avatar
Skip Montanaro committed
590 591 592
- Patch 1571379: Make trace's --ignore-dir facility work in the face of
  relative directory names.

593 594
- Bug #1600860: Search for shared python library in LIBDIR,
  not lib/python/config, on "linux" and "gnu" systems.
595

596 597 598
- Patch #1652681: tarfile.py: create nonexistent files in append mode and
  allow appending to empty files.

599
- Bug #1124861: Automatically create pipes if GetStdHandle fails in
600
  subprocess.
601

602 603 604
- Patch #1634778: add missing encoding aliases for iso8859_15 and
  iso8859_16.

605 606 607 608
- Patch #1638243: the compiler package is now able to correctly compile
  a with statement; previously, executing code containing a with statement
  compiled by the compiler package crashed the interpreter.

609 610
- Bug #1643943: Fix time.strptime's support for the %U directive.

Lars Gustäbel's avatar
Lars Gustäbel committed
611 612 613
- Patch #1507247: tarfile.py: use current umask for intermediate
  directories.

614 615
- Patch #1627441: close sockets properly in urllib2.

616 617
- Bug #494589: make ntpath.expandvars behave according to its docstring.

618
- Changed platform module API python_version_tuple() to actually
619
  return a tuple (it used to return a list).
620 621

- Added new platform module APIs python_branch(), python_revision(),
622
  python_implementation() and linux_distribution().
623

624
- Added support for IronPython and Jython to the platform module.
625

Brett Cannon's avatar
Brett Cannon committed
626 627 628
- The sets module has been deprecated.  Use the built-in set/frozenset types
  instead.

629 630
- Bug #1610795: make ctypes.util.find_library work on BSD systems.

631 632 633 634
- Fixes for 64-bit Windows: In ctypes.wintypes, correct the
  definitions of HANDLE, WPARAM, LPARAM data types.  Make
  parameterless foreign function calls work.

635 636
- The version number of the ctypes package changed to "1.1.0".

637 638 639 640
- Bug #1627575: logging: Added _open() method to FileHandler which can
  be used to reopen files. The FileHandler instance now saves the
  encoding (which can be None) in an attribute called "encoding".

641 642 643 644 645 646 647 648 649
- Bug #411881: logging.handlers: bare except clause removed from
  SMTPHandler.emit. Now, only ImportError is trapped.

- Bug #411881: logging.handlers: bare except clause removed from
  SocketHandler.createSocket. Now, only socket.error is trapped.

- Bug #411881: logging: bare except clause removed from LogRecord.__init__.
  Now, only ValueError, TypeError and AttributeError are trapped.

650 651
- Patch #1504073: Fix tarfile.open() for mode "r" with a fileobj argument.

652 653
- Patch #1182394 from Shane Holloway: speed up HMAC.hexdigest.

654 655 656
- Patch #1262036: Prevent TarFiles from being added to themselves under
  certain conditions.

657 658 659
- Patch #1230446: tarfile.py: fix ExFileObject so that read() and tell()
  work correctly together with readline().

660 661 662
- Patch #1484695: The tarfile module now raises a HeaderError exception
  if a buffer given to frombuf() is invalid.

663 664 665 666 667 668
- Bug #1503765: Fix a problem in logging.config with spaces in comma-
  separated lists read from logging config files.

- Patch #1604907: Fix problems in logging.handlers caused at logging shutdown
  when syslog handlers fail to initialize because of syslogd problems.

669
- Patch #1608267: fix a race condition in os.makedirs() if the directory
670 671
  to be created is already there.

672 673
- Patch #1610437: fix a tarfile bug with long filename headers.

674 675 676
- Patch #1371075: Make ConfigParser accept optional dict type
  for ordering, sorting, etc.

677 678
- Bug #1563807: _ctypes built on AIX fails with ld ffi error.

679 680
- Bug #1598620: A ctypes Structure cannot contain itself.

681 682 683
- Patch #1070046: Marshal new-style objects like InstanceType
  in xmlrpclib.

684 685 686
- cStringIO.truncate(-1) now raises an IOError, like StringIO and
  regular files.

687 688
- Patch #1472877: Fix Tix subwidget name resolution.

689 690 691
- Patch #1594554: Always close a tkSimpleDialog on ok(), even
  if an exception occurs.

692 693 694
- Patch #1538878: Don't make tkSimpleDialog dialogs transient if
  the parent window is withdrawn.

695 696 697
- Bug #1597824: return the registered function from atexit.register()
  to facilitate usage as a decorator.

698 699 700
- Patch #1360200: Use unmangled_version RPM spec field to deal with
  file name mangling.

701 702 703
- Patch #1359217: Process 2xx response in an ftplib transfer
  that precedes an 1xx response.

704 705
- Patch #1355023: support whence argument for GzipFile.seek.

706
- Patch #1065257: Support passing open files as body in
707 708
  HTTPConnection.request().

709 710 711 712
- Bug #1569790: mailbox.py: Maildir.get_folder() and MH.get_folder()
  weren't passing the message factory on to newly created Maildir/MH
  objects.

713
- Patch #1514543: mailbox.py: In the Maildir class, report errors if there's
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
714
  a filename clash instead of possibly losing a message.  (Patch by David
715 716
  Watson.)

717 718 719 720
- Patch #1514544: Try to ensure that messages/indexes have been physically
  written to disk after calling .flush() or .close(). (Patch by David
  Watson.)

721 722
- Patch #1592250: Add elidge argument to Tkinter.Text.search.

723 724
- Patch #838546: Make terminal become controlling in pty.fork()

725 726
- Patch #1351744: Add askyesnocancel helper for tkMessageBox.

727 728 729
- Patch #1060577: Extract list of RPM files from spec file in
  bdist_rpm

730 731
- Bug #1586613: fix zlib and bz2 codecs' incremental en/decoders.

732 733 734
- Patch #1583880: fix tarfile's problems with long names and posix/
  GNU modes.

735 736 737 738
- Bug #1586448: the compiler module now emits the same bytecode for
  list comprehensions as the builtin compiler, using the LIST_APPEND
  opcode.

739 740 741 742
- Fix codecs.EncodedFile which did not use file_encoding in 2.5.0, and
  fix all codecs file wrappers to work correctly with the "with"
  statement (bug #1586513).

743 744 745
- Lib/modulefinder.py now handles absolute and relative imports
  correctly.

746 747
- Patch #1567274: Support SMTP over TLS.

748 749 750
- Patch #1560695: Add .note.GNU-stack to ctypes' sysv.S so that
  ctypes isn't considered as requiring executable stacks.

751 752 753 754
- ctypes callback functions only support 'fundamental' data types as
  result type.  Raise an error when something else is used.  This is a
  partial fix for Bug #1574584.

755 756 757 758
- Fix turtle so that time.sleep is imported for the entire library.  Allows
  the demo2 function to be executed on its own instead of only when the
  module is run as a script.

759 760 761
- Bug #813342: Start the IDLE subprocess with -Qnew if the parent
  is started with that option.

762 763
- Bug #1565150: Fix subsecond processing for os.utime on Windows.

764 765
- Support for MSVC 8 was added to bdist_wininst.

766 767 768
- Bug #1446043: correctly raise a LookupError if an encoding name given
  to encodings.search_function() contains a dot.

769 770 771
- Bug #1560617: in pyclbr, return full module name not only for classes,
  but also for functions.

772 773 774
- Bug #1457823: cgi.(Sv)FormContentDict's constructor now takes
  keep_blank_values and strict_parsing keyword arguments.

775 776 777
- Bug #1566602: correct failure of posixpath unittest when $HOME ends
  with a slash.

778 779 780
- Bug #1565661: in webbrowser, split() the command for the default
  GNOME browser in case it is a command with args.

781 782 783
- Made the error message for time.strptime when the data data and format do
  match be more clear.

784 785 786 787
- Fix a bug in traceback.format_exception_only() that led to an error
  being raised when print_exc() was called without an exception set.
  In version 2.4, this printed "None", restored that behavior.

788 789 790
- Make webbrowser.BackgroundBrowser usable in Windows (it wasn't because
  the close_fds arg to subprocess.Popen is not supported).

791 792
- Reverted patch #1504333 to sgmllib because it introduced an infinite loop.

793 794 795
- Patch #1553314: Fix the inspect.py slowdown that was hurting IPython & SAGE
  by adding smarter caching in inspect.getmodule()

796 797
- Fix missing import of the types module in logging.config.

798
- Patch #1550886: Fix decimal module context management implementation
799
  to match the localcontext() example from PEP 343.
800

801
- Bug #1545341: The 'classifier' keyword argument to the Distutils setup()
802 803
  function now accepts tuples as well as lists.

804 805 806
- Bug #1541863: uuid.uuid1 failed to generate unique identifiers
  on systems with low clock resolution.

807 808
- Bug #1531862: Do not close standard file descriptors in subprocess.

809 810
- idle: Honor the "Cancel" action in the save dialog (Debian bug #299092).

811 812
- Fix utf-8-sig incremental decoder, which didn't recognise a BOM when the
  first chunk fed to the decoder started with a BOM, but was longer than 3 bytes.
813

814 815 816
- The implementation of UnicodeError objects has been simplified (start and end
  attributes are now stored directly as Py_ssize_t members).

Neal Norwitz's avatar
Neal Norwitz committed
817 818 819
Extension Modules
-----------------

820 821 822 823
- Marshal.dumps() now expects exact type matches for int, long, float, complex,
  tuple, list, dict, set, and frozenset.  Formerly, it would silently miscode
  subclasses of those types.  Now, it raises a ValueError instead.

824 825 826
- Patch #1388440: Add set_completion_display_matches_hook and
  get_completion_type to readline.

827 828 829
- Bug #1649098: Avoid declaration of zero-sized array declaration in
  structure.

830 831
- Removed the rgbimg module; been deprecated since Python 2.5.

832 833
- Bug #1721309: prevent bsddb module from freeing random memory.

Gregory P. Smith's avatar
Gregory P. Smith committed
834 835 836
- Bug #1233: fix bsddb.dbshelve.DBShelf append method to work as
  intended for RECNO databases.

837 838 839 840 841 842 843 844
- pybsddb.sf.net Bug #477182: Load the database flags at database open
  time so that opening a database previously created with the DB_DUP or
  DB_DUPSORT flag set will keep the proper behavior on subsequent opens.
  Specifically: dictionary assignment to a DB object will replace all
  values for a given key when the database allows duplicate values.
  DB users should use DB.put(k, v) when they want to store duplicates; not
  DB[k] = v.

845 846
- Add the bsddb.db.DBEnv.lock_id_free method.

847 848
- Bug #1686475: Support stat'ing open files on Windows again.

849 850 851 852 853
- Patch #1185447: binascii.b2a_qp() now correctly quotes binary characters
  with ASCII value less than 32. Also, it correctly quotes dots only if
  they occur on a single line, as opposed to the previous behavior of
  quoting dots if they are the second character of any line.

854 855 856
- Bug #1622896: fix a rare corner case where the bz2 module raised an
  error in spite of a succesful compression.

857 858 859
- Patch #1654417: make operator.{get,set,del}slice use the full range
  of Py_ssize_t.

860 861 862
- Patch #1646728: datetime.fromtimestamp fails with negative
  fractional times.  With unittest.

863 864 865
- Patch #1490190: posixmodule now includes os.chflags() and os.lchflags()
  functions on platforms where the underlying system calls are available.

866 867
- Patch #1494140: Add documentation for the new struct.Struct object.

868 869
- Patch #1432399: Support the HCI protocol for bluetooth sockets

870 871
- Patch #1657276: Make NETLINK_DNRTMSG conditional.

872 873
- Bug #1653736: Complain about keyword arguments to time.isoformat.

874 875 876
- Bug #1486663: don't reject keyword arguments for subclasses of builtin
  types.

877 878 879
- Patch #1610575: The struct module now supports the 't' code, for
  C99 _Bool.

880 881 882
- Patch #1635058: ensure that htonl and friends never accept or
  return negative numbers, per the underlying C implementation.

883 884 885
- Patch #1544279: Improve thread-safety of the socket module by moving
  the sock_addr_t storage out of the socket object.

886 887
- Speed up function calls into the math module.

888 889 890 891
- Bug #1588217: don't parse "= " as a soft line break in binascii's
  a2b_qp() function, instead leave it in the string as quopri.decode()
  does.

892 893
- Bug #1599782: Fix segfault on bsddb.db.DB().type().

894 895
- Bug #1567666: Emulate GetFileAttributesExA for Win95.

896 897
- Patch #1576166: Support os.utime for directories on Windows NT+.

898 899
- Patch #1572724: fix typo ('=' instead of '==') in _msi.c.

900 901 902
- Bug #1572832: fix a bug in ISO-2022 codecs which may cause segfault
  when encoding non-BMP unicode characters.

903 904 905
- Bug #1556784: allow format strings longer than 127 characters in
  datetime's strftime function.

Jack Diederich's avatar
Jack Diederich committed
906 907
- Fix itertools.count(n) to work with negative numbers again.

908 909
- RLIMIT_SBSIZE was added to the resource module where available.

910 911 912
- Bug #1551427: fix a wrong NULL pointer check in the win32 version
  of os.urandom().

913 914
- Bug #1548092: fix curses.tparm seg fault on invalid input.

915 916
- Bug #1550714: fix SystemError from itertools.tee on negative value for n.

917 918 919 920
- Fixed a few bugs on cjkcodecs:
  - gbk and gb18030 codec now handle U+30FB KATAKANA MIDDLE DOT correctly.
  - iso2022_jp_2 codec now encodes into G0 for KS X 1001, GB2312
    codepoints to conform the standard.
Hye-Shik Chang's avatar
Hye-Shik Chang committed
921
  - iso2022_jp_3 and iso2022_jp_2004 codec can encode JIS X 0213:2
922
    codepoints now.
Neal Norwitz's avatar
Neal Norwitz committed
923

924 925 926 927 928
- Bug #1552726: in readline.c, avoid repeatedly polling in interactive
  mode by only placing a timeout on the select() if an input hook has
  been defined.  This prevents an interactive Python from waking up 10
  times per second.  Patch by Richard Boulton.

929 930 931
- fixed a bug with bsddb.DB.stat: the flags and txn keyword arguments
  were transposed.

932 933
- Added support for linking the bsddb module against BerkeleyDB 4.5.x
  and 4.6.x.
934

Walter Dörwald's avatar
Walter Dörwald committed
935 936
- Bug #1633621: if curses.resizeterm() or curses.resize_term() is called,
  update _curses.LINES, _curses.COLS, curses.LINES and curses.COLS.
937

938 939
- Fix an off-by-one bug in locale.strxfrm().

940 941
- Fix libffi configure for hppa*-*-linux* | parisc*-*-linux*.

942 943
- Build using system ffi library on arm*-linux*.

944

Neal Norwitz's avatar
Neal Norwitz committed
945 946 947
Tests
-----

Brett Cannon's avatar
Brett Cannon committed
948 949 950 951
- Make test_runpy reentrant by fixing _check_module to clear out any module
  being tested.  Was causing an error by __import__ doing a reload on the
  second run and thus suppressing bytecode recreation.

952 953
- Capture socket connection resets and timeouts in test_socket_ssl and
  test_urllib2net and raise test.test_support.ResourceDenied.
954

955 956
- Patch #1559413: Fix test_cmd_line if sys.executable contains a space.

957 958 959 960
- Added test.test_support.TransientResource which is a context manager to
  surround calls to resources that are not guaranteed to work even if
  test.test_support.requires says that the resource should exist.

961 962
- Added a test for slicing of an exception.

963 964 965 966
- Added test.test_support.EnvironmentVarGuard.  It's a class that provides a
  context manager so that one can temporarily set or unset environment
  variables.

967 968
- Added some tests for modulefinder.

969 970
- Converted test_imp to use unittest.

971 972 973
- Fix bsddb test_basics.test06_Transactions to check the version
  number properly.

974 975 976
- test.test_support.catch_warning is a new context manager that can be used
  to catch the warnings issued by the warning framework.

Neal Norwitz's avatar
Neal Norwitz committed
977

978 979 980
Tools
-----

Skip Montanaro's avatar
Skip Montanaro committed
981 982 983
- Tools/18n/pygettext.py was added to the list of scripts installed by
  Tools/scripts/setup.py (tracker item 642309).

984 985 986 987 988 989 990 991 992 993
- Added IronPython and Jython support to pybench (part of which
  was patch #1563844)

- Made some minor changes to pybench output to allow the user
  to see which Python version is running pybench

- Added support for the new platform module feature
  platform.python_implementation(); this will now be saved
  in the benchmark pickle

Neal Norwitz's avatar
Neal Norwitz committed
994 995 996
Documentation
-------------

997 998 999
- Bug #1637365: add subsection about "__name__ == __main__" to the
  Python tutorial.

1000 1001
- Patch #1698768: updated the "using Python on the Mac" intro.

1002 1003 1004
- Bug #1569057: Document that calling file.next() when the file is open for
  writing is undefined.

1005 1006 1007
- Patch #1489771: the syntax rules in Python Reference Manual were
  updated to reflect the current Python syntax.

1008 1009 1010
- Patch #1686451: Fix return type for
  PySequence_{Count,Index,Fast_GET_SIZE}.

1011 1012
- Patch #1679379: add documentation for fnmatch.translate().

1013 1014 1015
- Bug #1629566: clarify the docs on the return values of parsedate()
  and parsedate_tz() in email.utils and rfc822.

1016 1017 1018
- Patch #1671450: add a section about subclassing builtin types to the
  "extending and embedding" tutorial.

1019 1020 1021
- Bug #1629125: fix wrong data type (int -> Py_ssize_t) in PyDict_Next
  docs.

1022 1023
- Bug #1565919: document set types in the Language Reference.

1024 1025 1026
- Bug #1546052: clarify that PyString_FromString(AndSize) copies the
  string pointed to by its parameter.

1027 1028
- Bug #1566663: remove obsolete example from datetime docs.

1029 1030 1031 1032
- Bug #1541682: Fix example in the "Refcount details" API docs.
  Additionally, remove a faulty example showing PySequence_SetItem applied
  to a newly created list object and add notes that this isn't a good idea.

Neal Norwitz's avatar
Neal Norwitz committed
1033

1034 1035 1036 1037
Tools/Demos
-----------

- Patch #1552024: add decorator support to unparse.py demo script.
1038

1039 1040 1041 1042
- Make auto-generated python.vim file list built-ins and exceptions in
  alphatbetical order.  Makes output more deterministic and easier to tell if
  the file is stale or not.

1043 1044 1045 1046
- Bug #1546372: Fixed small bugglet in pybench that caused a missing
  file not to get reported properly.


Neal Norwitz's avatar
Neal Norwitz committed
1047 1048 1049
Build
-----

1050 1051
- Patch #1418: Make the AC_REPLACE_FUNCS object files actually work.

1052 1053 1054 1055 1056
- Add a FAST_LOOPS build option that speeds-up looping by trading away
  periodic threadstate and signal checking in tight loops.  By default,
  this option is turned-off.  It should only be enabled in debugged,
  performance critical applications.

1057 1058 1059
- Patch #786737: Allow building in a tree of symlinks pointing to
  a readonly source.

1060 1061
- Bug #1737210: Change Manufacturer of Windows installer to PSF.

1062 1063
- Bug #1746880: Correctly install DLLs into system32 folder on Win64.

1064 1065
- Define _BSD_SOURCE, to get access to POSIX extensions on OpenBSD 4.1+.

1066 1067
- Stop supporting AtheOS and cause a build error in configure for the platform.

1068 1069 1070 1071
- Bug #1655392: don't add -L/usr/lib/pythonX.Y/config to the LDFLAGS
  returned by python-config if Python was built with --enable-shared
  because that prevented the shared library from being used.

1072 1073 1074
- Patch #1569798: fix a bug in distutils when building Python from a
  directory within sys.exec_prefix.

1075 1076
- Bug #1675511: Use -Kpic instead of -xcode=pic32 on Solaris/x86.

1077 1078
- Disable _XOPEN_SOURCE on NetBSD 1.x.

1079 1080 1081
- configure now checks whether gcc supports the PyArg_ParseTuple format
  attribute.

1082
- Bug #1578513: Cross compilation was broken by a change to configure.
Martin v. Löwis's avatar
Martin v. Löwis committed
1083 1084
  Repair so that it's back to how it was in 2.4.3.

1085 1086 1087
- Patch #1576954: Update VC6 build directory; remove redundant
  files in VC7.

1088 1089
- Bug #1568842: Fix test for uintptr_t.

1090 1091
- Patch #1540470, for OpenBSD 4.0.

1092 1093
- Fix build failure on kfreebsd and on the hurd.

1094 1095
- Fix the build of the library reference in info format.

1096
- Allow Emacs 22 for building the documentation in info format.
Neal Norwitz's avatar
Neal Norwitz committed
1097

1098 1099 1100
- Makefile.pre.in(buildbottest): Run an optional script pybuildbot.identify
  to include some information about the build environment.

Neal Norwitz's avatar
Neal Norwitz committed
1101 1102 1103
C API
-----

1104 1105 1106
- Bug #1542693: remove semi-colon at end of PyImport_ImportModuleEx macro
  so it can be used as an expression.

Neal Norwitz's avatar
Neal Norwitz committed
1107

1108 1109 1110 1111 1112 1113
Windows
-------

- Conditionalize definition of _CRT_SECURE_NO_DEPRECATE
  and _CRT_NONSTDC_NO_DEPRECATE.

1114 1115
- Bug #1216: Restore support for Visual Studio 2002.

1116

Neal Norwitz's avatar
Neal Norwitz committed
1117 1118 1119
Mac
---

1120 1121
- cfmfile now raises a DeprecationWarning.

1122 1123
- buildtools now raises a DeprecationWarning.

1124 1125 1126 1127
- Removed the macfs module.  It had been deprecated since Python 2.5.  This
  lead to the deprecation of macostools.touched() as it relied solely on macfs
  and was a no-op under OS X.

Neal Norwitz's avatar
Neal Norwitz committed
1128

1129 1130
What's New in Python 2.5 release candidate 1?
=============================================
1131

Anthony Baxter's avatar
Anthony Baxter committed
1132
*Release date: 17-AUG-2006*
1133 1134 1135 1136

Core and builtins
-----------------

1137
- Unicode objects will no longer raise an exception when being
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1138 1139
  compared equal or unequal to a string and a UnicodeDecodeError
  exception occurs, e.g. as result of a decoding failure.
1140 1141 1142 1143 1144 1145 1146 1147 1148

  Instead, the equal (==) and unequal (!=) comparison operators will
  now issue a UnicodeWarning and interpret the two objects as
  unequal. The UnicodeWarning can be filtered as desired using
  the warning framework, e.g. silenced completely, turned into an
  exception, logged, etc.

  Note that compare operators other than equal and unequal will still
  raise UnicodeDecodeError exceptions as they've always done.
1149

1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162
- Fix segfault when doing string formatting on subclasses of long.

- Fix bug related to __len__ functions using values > 2**32 on 64-bit machines
  with new-style classes.

- Fix bug related to __len__ functions returning negative values with
  classic classes.

- Patch #1538606, Fix __index__() clipping.  There were some problems
  discovered with the API and how integers that didn't fit into Py_ssize_t
  were handled.  This patch attempts to provide enough alternatives
  to effectively use __index__.

1163 1164 1165
- Bug #1536021: __hash__ may now return long int; the final hash
  value is obtained by invoking hash on the long int.

1166 1167
- Bug #1536786: buffer comparison could emit a RuntimeWarning.

1168 1169 1170
- Bug #1535165: fixed a segfault in input() and raw_input() when
  sys.stdin is closed.

1171 1172 1173
- On Windows, the PyErr_Warn function is now exported from
  the Python dll again.

1174 1175 1176 1177 1178
- Bug #1191458: tracing over for loops now produces a line event
  on each iteration.  Fixing this problem required changing the .pyc
  magic number.  This means that .pyc files generated before 2.5c1
  will be regenerated.

1179 1180 1181 1182
- Bug #1333982: string/number constants were inappropriately stored
  in the byte code and co_consts even if they were not used, ie
  immediately popped off the stack.

1183 1184
- Fixed a reference-counting problem in property().

1185 1186 1187 1188

Library
-------

1189 1190 1191
- Fix a bug in the ``compiler`` package that caused invalid code to be
  generated for generator expressions.

1192 1193 1194 1195 1196
- The distutils version has been changed to 2.5.0. The change to
  keep it programmatically in sync with the Python version running
  the code (introduced in 2.5b3) has been reverted. It will continue
  to be maintained manually as static string literal.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1197
- If the Python part of a ctypes callback function returns None,
1198 1199
  and this cannot be converted to the required C type, an exception is
  printed with PyErr_WriteUnraisable.  Before this change, the C
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1200
  callback returned arbitrary values to the calling code.
1201

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1202
- The __repr__ method of a NULL ctypes.py_object() no longer raises
1203 1204
  an exception.

1205
- uuid.UUID now has a bytes_le attribute. This returns the UUID in
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1206
  little-endian byte order for Windows. In addition, uuid.py gained some
Anthony Baxter's avatar
Anthony Baxter committed
1207 1208 1209
  workarounds for clocks with low resolution, to stop the code yielding
  duplicate UUIDs.

1210 1211 1212
- Patch #1540892: site.py Quitter() class attempts to close sys.stdin
  before raising SystemExit, allowing IDLE to honor quit() and exit().

1213 1214
- Bug #1224621: make tabnanny recognize IndentationErrors raised by tokenize.

1215 1216 1217
- Patch #1536071: trace.py should now find the full module name of a
  file correctly even on Windows.

1218 1219 1220
- logging's atexit hook now runs even if the rest of the module has
  already been cleaned up.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1221
- Bug #1112549, fix DoS attack on cgi.FieldStorage.
1222

1223 1224 1225
- Bug #1531405, format_exception no longer raises an exception if
  str(exception) raised an exception.

1226 1227 1228
- Fix a bug in the ``compiler`` package that caused invalid code to be
  generated for nested functions.

1229 1230 1231 1232

Extension Modules
-----------------

1233 1234
- Patch #1511317: don't crash on invalid hostname (alias) info.

1235 1236 1237
- Patch #1535500: fix segfault in BZ2File.writelines and make sure it
  raises the correct exceptions.

Thomas Heller's avatar
Thomas Heller committed
1238 1239 1240
- Patch # 1536908: enable building ctypes on OpenBSD/AMD64.  The
  '-no-stack-protector' compiler flag for OpenBSD has been removed.

1241 1242 1243 1244
- Patch #1532975 was applied, which fixes Bug #1533481: ctypes now
  uses the _as_parameter_ attribute when objects are passed to foreign
  function calls.  The ctypes version number was changed to 1.0.1.

1245 1246 1247 1248
- Bug #1530559, struct.pack raises TypeError where it used to convert.
  Passing float arguments to struct.pack when integers are expected
  now triggers a DeprecationWarning.

1249 1250 1251 1252

Tests
-----

1253 1254 1255
- test_socketserver should now work on cygwin and not fail sporadically
  on other platforms.

1256 1257
- test_mailbox should now work on cygwin versions 2006-08-10 and later.

1258 1259
- Bug #1535182: really test the xreadlines() method of bz2 objects.

1260 1261 1262
- test_threading now skips testing alternate thread stack sizes on
  platforms that don't support changing thread stack size.

1263

1264 1265 1266 1267 1268 1269
Documentation
-------------

- Patch #1534922: unittest docs were corrected and enhanced.


1270 1271 1272
Build
-----

1273 1274 1275
- Bug #1535502, build _hashlib on Windows, and use masm assembler
  code in OpenSSL.

1276 1277
- Bug #1534738, win32 debug version of _msi should be _msi_d.pyd.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1278
- Bug #1530448, ctypes build failure on Solaris 10 was fixed.
1279

1280

Tim Peters's avatar
Tim Peters committed
1281 1282 1283
C API
-----

1284 1285
- New API for Unicode rich comparisons: PyUnicode_RichCompare()

Tim Peters's avatar
Tim Peters committed
1286 1287 1288 1289 1290 1291
- Bug #1069160.  Internal correctness changes were made to
  ``PyThreadState_SetAsyncExc()``.  A test case was added, and
  the documentation was changed to state that the return value
  is always 1 (normal) or 0 (if the specified thread wasn't found).


Fred Drake's avatar
Fred Drake committed
1292 1293
What's New in Python 2.5 beta 3?
================================
1294

Anthony Baxter's avatar
Anthony Baxter committed
1295
*Release date: 03-AUG-2006*
1296 1297 1298 1299

Core and builtins
-----------------

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1300
- _PyWeakref_GetWeakrefCount() now returns a Py_ssize_t; it previously
1301 1302
  returned a long (see PEP 353).

1303 1304
- Bug #1515471: string.replace() accepts character buffers again.

1305 1306 1307 1308
- Add PyErr_WarnEx() so C code can pass the stacklevel to warnings.warn().
  This provides the proper warning for struct.pack().
  PyErr_Warn() is now deprecated in favor of PyErr_WarnEx().

1309 1310 1311
- Patch #1531113: Fix augmented assignment with yield expressions.
  Also fix a SystemError when trying to assign to yield expressions.

1312 1313 1314 1315 1316
- Bug #1529871: The speed enhancement patch #921466 broke Python's compliance
  with PEP 302.  This was fixed by adding an ``imp.NullImporter`` type that is
  used in ``sys.path_importer_cache`` to cache non-directory paths and avoid
  excessive filesystem operations during imports.

1317 1318 1319 1320 1321
- Bug #1521947: When checking for overflow, ``PyOS_strtol()`` used some
  operations on signed longs that are formally undefined by C.
  Unfortunately, at least one compiler now cares about that, so complicated
  the code to make that compiler happy again.

1322 1323
- Bug #1524310: Properly report errors from FindNextFile in os.listdir.

1324 1325 1326
- Patch #1232023: Stop including current directory in search
  path on Windows.

1327 1328
- Fix some potential crashes found with failmalloc.

1329 1330
- Fix warnings reported by Klocwork's static analysis tool.

1331 1332 1333
- Bug #1512814, Fix incorrect lineno's when code within a function
  had more than 255 blank lines.

1334 1335 1336
- Patch #1521179: Python now accepts the standard options ``--help`` and
  ``--version`` as well as ``/?`` on Windows.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1337
- Bug #1520864: unpacking singleton tuples in a 'for' loop (for x, in) works
1338
  again.  Fixing this problem required changing the .pyc magic number.
1339
  This means that .pyc files generated before 2.5b3 will be regenerated.
1340

1341
- Bug #1524317:  Compiling Python ``--without-threads`` failed.
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1342
  The Python core compiles again, and, in a build without threads, the
1343 1344 1345
  new ``sys._current_frames()`` returns a dictionary with one entry,
  mapping the faux "thread id" 0 to the current frame.

1346
- Bug #1525447: build on MacOS X on a case-sensitive filesystem.
1347

1348

1349 1350 1351
Library
-------

1352 1353 1354
- Correction of patch #1455898: In the mbcs decoder, set final=False
  for stream decoder, but final=True for the decode function.

1355 1356 1357
- os.urandom no longer masks unrelated exceptions like SystemExit or
  KeyboardInterrupt.

Tim Peters's avatar
Tim Peters committed
1358
- Bug #1525866: Don't copy directory stat times in
1359 1360
  shutil.copytree on Windows

1361 1362 1363
- Bug #1002398: The documentation for os.path.sameopenfile now correctly
  refers to file descriptors, not file objects.

1364
- The renaming of the xml package to xmlcore, and the import hackery done
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1365
  to make it appear at both names, has been removed.  Bug #1511497,
Fred Drake's avatar
Fred Drake committed
1366 1367
  #1513611, and probably others.

1368 1369 1370
- Bug #1441397: The compiler module now recognizes module and function
  docstrings correctly as it did in Python 2.4.

1371 1372 1373 1374 1375 1376
- Bug #1529297:  The rewrite of doctest for Python 2.4 unintentionally
  lost that tests are sorted by name before being run.  This rarely
  matters for well-written tests, but can create baffling symptoms if
  side effects from one test to the next affect outcomes.  ``DocTestFinder``
  has been changed to sort the list of tests it returns.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1377
- The distutils version has been changed to 2.5.0, and is now kept
1378
  in sync with sys.version_info[:3].
1379

1380 1381
- Bug #978833: Really close underlying socket in _socketobject.close.

1382 1383
- Bug #1459963: urllib and urllib2 now normalize HTTP header names with
  title().
1384

Georg Brandl's avatar
Georg Brandl committed
1385 1386 1387
- Patch #1525766: In pkgutil.walk_packages, correctly pass the onerror callback
  to recursive calls and call it with the failing package name.

1388 1389
- Bug #1525817: Don't truncate short lines in IDLE's tool tips.

1390 1391 1392
- Patch #1515343: Fix printing of deprecated string exceptions with a
  value in the traceback module.

1393 1394
- Resync optparse with Optik 1.5.3: minor tweaks for/to tests.

1395 1396
- Patch #1524429: Use repr() instead of backticks in Tkinter again.

1397 1398 1399 1400 1401 1402
- Bug #1520914: Change time.strftime() to accept a zero for any position in its
  argument tuple.  For arguments where zero is illegal, the value is forced to
  the minimum value that is correct.  This is to support an undocumented but
  common way people used  to fill in inconsequential information in the time
  tuple pre-2.4.

1403 1404
- Patch #1220874: Update the binhex module for Mach-O.

1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416
- The email package has improved RFC 2231 support, specifically for
  recognizing the difference between encoded (name*0*=<blah>) and non-encoded
  (name*0=<blah>) parameter continuations.  This may change the types of
  values returned from email.message.Message.get_param() and friends.
  Specifically in some cases where non-encoded continuations were used,
  get_param() used to return a 3-tuple of (None, None, string) whereas now it
  will just return the string (since non-encoded continuations don't have
  charset and language parts).

  Also, whereas % values were decoded in all parameter continuations, they are
  now only decoded in encoded parameter parts.

1417 1418 1419 1420 1421
- Bug #1517990: IDLE keybindings on MacOS X now work correctly

- Bug #1517996: IDLE now longer shows the default Tk menu when a
  path browser, class browser or debugger is the frontmost window on MacOS X

1422 1423 1424 1425 1426
- Patch #1520294: Support for getset and member descriptors in types.py,
  inspect.py, and pydoc.py.  Specifically, this allows for querying the type
  of an object against these built-in types and more importantly, for getting
  their docstrings printed in the interactive interpreter's help() function.

1427

1428 1429 1430
Extension Modules
-----------------

1431 1432 1433 1434
- Patch #1519025 and bug #926423: If a KeyboardInterrupt occurs during
  a socket operation on a socket with a timeout, the exception will be
  caught correctly.  Previously, the exception was not caught.

1435 1436 1437
- Patch #1529514: The _ctypes extension is now compiled on more
  openbsd target platforms.

1438 1439 1440
- The ``__reduce__()`` method of the new ``collections.defaultdict`` had
  a memory leak, affecting pickles and deep copies.

1441
- Bug #1471938: Fix curses module build problem on Solaris 8; patch by
1442 1443
  Paul Eggert.

1444 1445
- Patch #1448199: Release interpreter lock in _winreg.ConnectRegistry.

1446 1447 1448 1449
- Patch #1521817: Index range checking on ctypes arrays containing
  exactly one element enabled again.  This allows iterating over these
  arrays, without the need to check the array size before.

Thomas Heller's avatar
Thomas Heller committed
1450
- Bug #1521375: When the code in ctypes.util.find_library was
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1451
  run with root privileges, it could overwrite or delete
1452 1453
  /dev/null in certain cases; this is now fixed.

1454 1455
- Bug #1467450: On Mac OS X 10.3, RTLD_GLOBAL is now used as the
  default mode for loading shared libraries in ctypes.
1456

1457 1458 1459
- Because of a misspelled preprocessor symbol, ctypes was always
  compiled without thread support; this is now fixed.

1460 1461 1462 1463
- pybsddb Bug #1527939: bsddb module DBEnv dbremove and dbrename
  methods now allow their database parameter to be None as the
  sleepycat API allows.

1464 1465 1466
- Bug #1526460: Fix socketmodule compile on NetBSD as it has a different
  bluetooth API compared with Linux and FreeBSD.

1467 1468 1469 1470 1471 1472 1473
Tests
-----

- Bug #1501330: Change test_ossaudiodev to be much more tolerant in terms of
  how long the test file should take to play.  Now accepts taking 2.93 secs
  (exact time) +/- 10% instead of the hard-coded 3.1 sec.

1474 1475 1476
- Patch #1529686: The standard tests ``test_defaultdict``, ``test_iterlen``,
  ``test_uuid`` and ``test_email_codecs`` didn't actually run any tests when
  run via ``regrtest.py``. Now they do.
Tim Peters's avatar
Tim Peters committed
1477

1478 1479 1480 1481 1482
Build
-----

- Bug #1439538: Drop usage of test -e in configure as it is not portable.

1483 1484 1485 1486 1487 1488 1489 1490
Mac
---

- PythonLauncher now works correctly when the path to the script contains
  characters that are treated specially by the shell (such as quotes).

- Bug #1527397: PythonLauncher now launches scripts with the working directory
  set to the directory that contains the script instead of the user home
Tim Peters's avatar
Tim Peters committed
1491
  directory. That latter was an implementation accident and not what users
1492 1493
  expect.

1494

1495 1496 1497
What's New in Python 2.5 beta 2?
================================

Anthony Baxter's avatar
Anthony Baxter committed
1498
*Release date: 11-JUL-2006*
1499 1500 1501 1502

Core and builtins
-----------------

1503 1504 1505
- Bug #1441486: The literal representation of -(sys.maxint - 1)
  again evaluates to a int object, not a long.

1506 1507 1508
- Bug #1501934: The scope of global variables that are locally assigned
  using augmented assignment is now correctly determined.

1509 1510 1511
- Bug #927248: Recursive method-wrapper objects can now safely
  be released.

1512 1513 1514
- Bug #1417699: Reject locale-specific decimal point in float()
  and atof().

1515 1516 1517
- Bug #1511381: codec_getstreamcodec() in codec.c is corrected to
  omit a default "error" argument for NULL pointer.  This allows
  the parser to take a codec from cjkcodecs again.
1518

1519 1520
- Bug #1519018: 'as' is now validated properly in import statements.

1521 1522 1523
- On 64 bit systems, int literals that use less than 64 bits are
  now ints rather than longs.

1524 1525 1526
- Bug #1512814, Fix incorrect lineno's when code at module scope
  started after line 256.

1527 1528 1529 1530 1531 1532 1533
- New function ``sys._current_frames()`` returns a dict mapping thread
  id to topmost thread stack frame.  This is for expert use, and is
  especially useful for debugging application deadlocks.  The functionality
  was previously available in Fazal Majid's ``threadframe`` extension
  module, but it wasn't possible to do this in a wholly threadsafe way from
  an extension.

1534 1535 1536
Library
-------

1537 1538 1539
- Bug #1257728: Mention Cygwin in distutils error message about a missing
  VS 2003.

1540 1541
- Patch #1519566: Update turtle demo, make begin_fill idempotent.

1542
- Bug #1508010: msvccompiler now requires the DISTUTILS_USE_SDK
1543 1544 1545
  environment variable to be set in order to the SDK environment
  for finding the compiler, include files, etc.

1546 1547
- Bug #1515998: Properly generate logical ids for files in bdist_msi.

1548 1549
- warnings.py now ignores ImportWarning by default

1550 1551 1552 1553
- string.Template() now correctly handles tuple-values. Previously,
  multi-value tuples would raise an exception and single-value tuples would
  be treated as the value they contain, instead.

1554 1555 1556
- Bug #822974: Honor timeout in telnetlib.{expect,read_until}
  even if some data are received.

1557 1558 1559
- Bug #1267547: Put proper recursive setup.py call into the
  spec file generated by bdist_rpm.

1560 1561 1562
- Bug #1514693: Update turtle's heading when switching between
  degrees and radians.

1563
- Reimplement turtle.circle using a polyline, to allow correct
1564
  filling of arcs.
1565

1566 1567 1568
- Bug #1514703: Only setup canvas window in turtle when the canvas
  is created.

1569 1570 1571
- Bug #1513223: .close() of a _socketobj now releases the underlying
  socket again, which then gets closed as it becomes unreferenced.

1572 1573 1574 1575 1576 1577
- Bug #1504333: Make sgmllib support angle brackets in quoted
  attribute values.

- Bug #853506: Fix IPv6 address parsing in unquoted attributes in
  sgmllib ('[' and ']' were not accepted).

Georg Brandl's avatar
Georg Brandl committed
1578 1579
- Fix a bug in the turtle module's end_fill function.

1580 1581 1582 1583
- Bug #1510580: The 'warnings' module improperly required that a Warning
  category be either a types.ClassType and a subclass of Warning.  The proper
  check is just that it is a subclass with Warning as the documentation states.

1584 1585 1586
- The compiler module now correctly compiles the new try-except-finally
  statement (bug #1509132).

1587 1588
- The wsgiref package is now installed properly on Unix.

1589 1590 1591
- A bug was fixed in logging.config.fileConfig() which caused a crash on
  shutdown when fileConfig() was called multiple times.

1592 1593 1594 1595
- The sqlite3 module did cut off data from the SQLite database at the first
  null character before sending it to a custom converter. This has been fixed
  now.

1596 1597 1598
Extension Modules
-----------------

1599 1600 1601
- #1494314: Fix a regression with high-numbered sockets in 2.4.3. This
  means that select() on sockets > FD_SETSIZE (typically 1024) work again.
  The patch makes sockets use poll() internally where available.
1602

1603 1604 1605 1606 1607 1608 1609 1610 1611 1612 1613 1614 1615 1616 1617 1618
- Assigning None to pointer type fields in ctypes structures possible
  overwrote the wrong fields, this is fixed now.

- Fixed a segfault in _ctypes when ctypes.wintypes were imported
  on non-Windows platforms.

- Bug #1518190: The ctypes.c_void_p constructor now accepts any
  integer or long, without range checking.

- Patch #1517790: It is now possible to use custom objects in the ctypes
  foreign function argtypes sequence as long as they provide a from_param
  method, no longer is it required that the object is a ctypes type.

- The '_ctypes' extension module now works when Python is configured
  with the --without-threads option.

1619 1620 1621
- Bug #1513646: os.access on Windows now correctly determines write
  access, again.

1622 1623 1624
- Bug #1512695: cPickle.loads could crash if it was interrupted with
  a KeyboardInterrupt.

1625 1626 1627
- Bug #1296433: parsing XML with a non-default encoding and
  a CharacterDataHandler could crash the interpreter in pyexpat.

1628 1629
- Patch #1516912: improve Modules support for OpenVMS.

1630 1631 1632
Build
-----

1633 1634
- Automate Windows build process for the Win64 SSL module.

1635
- 'configure' now detects the zlib library the same way as distutils.
1636 1637 1638
  Previously, the slight difference could cause compilation errors of the
  'zlib' module on systems with more than one version of zlib.

1639 1640 1641
- The MSI compileall step was fixed to also support a TARGETDIR
  with spaces in it.

1642 1643 1644
- Bug #1517388: sqlite3.dll is now installed on Windows independent
  of Tcl/Tk.

1645
- Bug #1513032: 'make install' failed on FreeBSD 5.3 due to lib-old
1646
  trying to be installed even though it's empty.
1647

1648 1649 1650 1651 1652 1653
Tests
-----

- Call os.waitpid() at the end of tests that spawn child processes in order
  to minimize resources (zombies).

1654 1655 1656
Documentation
-------------

1657 1658 1659
- Cover ImportWarning, PendingDeprecationWarning and simplefilter() in the
  documentation for the warnings module.

1660 1661
- Patch #1509163: MS Toolkit Compiler no longer available.

1662
- Patch #1504046: Add documentation for xml.etree.
1663

1664

1665
What's New in Python 2.5 beta 1?
1666
================================
1667

Anthony Baxter's avatar
Anthony Baxter committed
1668
*Release date: 20-JUN-2006*
1669 1670 1671 1672

Core and builtins
-----------------

1673 1674 1675 1676
- Patch #1507676: Error messages returned by invalid abstract object operations
  (such as iterating over an integer) have been improved and now include the
  type of the offending object to help with debugging.

1677 1678 1679
- Bug #992017: A classic class that defined a __coerce__() method that returned
  its arguments swapped would infinitely recurse and segfault the interpreter.

1680 1681
- Fix the socket tests so they can be run concurrently.

1682
- Removed 5 integers from C frame objects (PyFrameObject).
1683
  f_nlocals, f_ncells, f_nfreevars, f_stack_size, f_restricted.
1684

1685 1686 1687 1688 1689 1690
- Bug #532646: object.__call__() will continue looking for the __call__
  attribute on objects until one without one is found.  This leads to recursion
  when you take a class and set its __call__ attribute to an instance of the
  class.  Originally fixed for classic classes, but this fix is for new-style.
  Removes the infinite_rec_3 crasher.

1691 1692 1693
- The string and unicode methods startswith() and endswith() now accept
  a tuple of prefixes/suffixes to look for. Implements RFE #1491485.

1694 1695 1696 1697 1698 1699
- Buffer objects, at the C level, never used the char buffer
  implementation even when the char buffer for the wrapped object was
  explicitly requested (originally returned the read or write buffer).
  Now a TypeError is raised if the char buffer is not present but is
  requested.

1700 1701 1702
- Patch #1346214: Statements like "if 0: suite" are now again optimized
  away like they were in Python 2.4.

1703 1704 1705 1706
- Builtin exceptions are now full-blown new-style classes instead of
  instances pretending to be classes, which speeds up exception handling
  by about 80% in comparison to 2.5a2.

1707 1708 1709
- Patch #1494554: Update unicodedata.numeric and unicode.isnumeric to
  Unicode 4.1.

1710 1711 1712 1713
- Patch #921466: sys.path_importer_cache is now used to cache valid and
  invalid file paths for the built-in import machinery which leads to
  fewer open calls on startup.

1714 1715 1716 1717 1718 1719
- Patch #1442927: ``long(str, base)`` is now up to 6x faster for non-power-
  of-2 bases.  The largest speedup is for inputs with about 1000 decimal
  digits.  Conversion from non-power-of-2 bases remains quadratic-time in
  the number of input digits (it was and remains linear-time for bases
  2, 4, 8, 16 and 32).

1720 1721 1722 1723 1724
- Bug #1334662: ``int(string, base)`` could deliver a wrong answer
  when ``base`` was not 2, 4, 8, 10, 16 or 32, and ``string`` represented
  an integer close to ``sys.maxint``.  This was repaired by patch
  #1335972, which also gives a nice speedup.

1725 1726 1727 1728
- Patch #1337051: reduced size of frame objects.

- PyErr_NewException now accepts a tuple of base classes as its
  "base" parameter.
1729

1730 1731 1732
- Patch #876206: function call speedup by retaining allocated frame
  objects.

1733 1734 1735 1736
- Bug #1462152: file() now checks more thoroughly for invalid mode
  strings and removes a possible "U" before passing the mode to the
  C library function.

1737 1738
- Patch #1488312, Fix memory alignment problem on SPARC in unicode

1739 1740
- Bug #1487966: Fix SystemError with conditional expression in assignment

1741 1742 1743 1744 1745
- WindowsError now has two error code attributes: errno, which carries
  the error values from errno.h, and winerror, which carries the error
  values from winerror.h. Previous versions put the winerror.h values
  (from GetLastError()) into the errno attribute.

1746 1747
- Patch #1475845: Raise IndentationError for unexpected indent.

1748 1749
- Patch #1479181: split open() and file() from being aliases for each other.

1750 1751 1752 1753 1754 1755 1756 1757 1758
- Patch #1497053 & bug #1275608: Exceptions occurring in ``__eq__()``
  methods were always silently ignored by dictionaries when comparing keys.
  They are now passed through (except when using the C API function
  ``PyDict_GetItem()``, whose semantics did not change).

- Bug #1456209: In some obscure cases it was possible for a class with a
  custom ``__eq__()`` method to confuse dict internals when class instances
  were used as a dict's keys and the ``__eq__()`` method mutated the dict.
  No, you don't have any code that did this ;-)
1759

1760 1761 1762
Extension Modules
-----------------

1763 1764 1765 1766
- Bug #1295808: expat symbols should be namespaced in pyexpat

- Patch #1462338: Upgrade pyexpat to expat 2.0.0

1767 1768 1769
- Change binascii.hexlify to accept a read-only buffer instead of only a char
  buffer and actually follow its documentation.

1770 1771
- Fixed a potentially invalid memory access of CJKCodecs' shift-jis decoder.

1772 1773 1774 1775 1776
- Patch #1478788 (modified version): The functional extension module has
  been renamed to _functools and a functools Python wrapper module added.
  This provides a home for additional function related utilities that are
  not specifically about functional programming. See PEP 309.

1777 1778
- Patch #1493701: performance enhancements for struct module.

1779 1780
- Patch #1490224: time.altzone is now set correctly on Cygwin.

1781 1782 1783
- Patch #1435422: zlib's compress and decompress objects now have a
  copy() method.

1784 1785 1786
- Patch #1454481: thread stack size is now tunable at runtime for thread
  enabled builds on Windows and systems with Posix threads support.

1787 1788 1789 1790 1791 1792
- On Win32, os.listdir now supports arbitrarily-long Unicode path names
  (up to the system limit of 32K characters).

- Use Win32 API to implement os.{access,chdir,chmod,mkdir,remove,rename,rmdir,utime}.
  As a result, these functions now raise WindowsError instead of OSError.

1793 1794 1795 1796
- ``time.clock()`` on Win64 should use the high-performance Windows
  ``QueryPerformanceCounter()`` now (as was already the case on 32-bit
  Windows platforms).

1797 1798 1799
- Calling Tk_Init twice is refused if the first call failed as that
  may deadlock.

1800 1801 1802 1803 1804 1805
- bsddb: added the DB_ARCH_REMOVE flag and fixed db.DBEnv.log_archive() to
  accept it without potentially using an uninitialized pointer.

- bsddb: added support for the DBEnv.log_stat() and DBEnv.lsn_reset() methods
  assuming BerkeleyDB >= 4.0 and 4.4 respectively.  [pybsddb project SF
  patch numbers 1494885 and 1494902]
1806

1807
- bsddb: added an interface for the BerkeleyDB >= 4.3 DBSequence class.
1808 1809
  [pybsddb project SF patch number 1466734]

1810 1811 1812
- bsddb: fix DBCursor.pget() bug with keyword argument names when no data
  parameter is supplied.  [SF pybsddb bug #1477863]

1813 1814 1815 1816
- bsddb: the __len__ method of a DB object has been fixed to return correct
  results.  It could previously incorrectly return 0 in some cases.
  Fixes SF bug 1493322 (pybsddb bug 1184012).

1817 1818 1819 1820
- bsddb: the bsddb.dbtables Modify method now raises the proper error and
  aborts the db transaction safely when a modifier callback fails.
  Fixes SF python patch/bug #1408584.

1821
- bsddb: multithreaded DB access using the simple bsddb module interface
1822
  now works reliably.  It has been updated to use automatic BerkeleyDB
1823 1824 1825
  deadlock detection and the bsddb.dbutils.DeadlockWrap wrapper to retry
  database calls that would previously deadlock. [SF python bug #775414]

1826
- Patch #1446489: add support for the ZIP64 extensions to zipfile.
1827

1828 1829
- Patch #1506645: add Python wrappers for the curses functions
  is_term_resized, resize_term and resizeterm.
1830

1831 1832 1833
Library
-------

1834 1835 1836
- Patch #815924: Restore ability to pass type= and icon= in tkMessageBox
  functions.

1837 1838
- Patch #812986: Update turtle output even if not tracing.

1839
- Patch #1494750: Destroy master after deleting children in
1840 1841
  Tkinter.BaseWidget.

1842 1843
- Patch #1096231: Add ``default`` argument to Tkinter.Wm.wm_iconbitmap.

1844 1845 1846
- Patch #763580: Add name and value arguments to Tkinter variable
  classes.

1847 1848 1849
- Bug #1117556: SimpleHTTPServer now tries to find and use the system's
  mime.types file for determining MIME types.

1850 1851 1852
- Bug #1339007: Shelf objects now don't raise an exception in their
  __del__ method when initialization failed.

1853 1854 1855
- Patch #1455898: The MBCS codec now supports the incremental mode for
  double-byte encodings.

1856 1857 1858 1859 1860 1861
- ``difflib``'s ``SequenceMatcher.get_matching_blocks()`` was changed to
  guarantee that adjacent triples in the return list always describe
  non-adjacent blocks.  Previously, a pair of matching blocks could end
  up being described by multiple adjacent triples that formed a partition
  of the matching pair.

1862 1863 1864
- Bug #1498146: fix optparse to handle Unicode strings in option help,
  description, and epilog.

1865 1866
- Bug #1366250: minor optparse documentation error.

1867 1868 1869
- Bug #1361643: fix textwrap.dedent() so it handles tabs appropriately;
  clarify docs.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
1870 1871
- The wsgiref package has been added to the standard library.

1872 1873 1874 1875
- The functions update_wrapper() and wraps() have been added to the functools
  module. These make it easier to copy relevant metadata from the original
  function when writing wrapper functions.

Tim Peters's avatar
Tim Peters committed
1876 1877
- The optional ``isprivate`` argument to ``doctest.testmod()``, and the
  ``doctest.is_private()`` function, both deprecated in 2.4, were removed.
1878

1879 1880 1881
- Patch #1359618: Speed up charmap encoder by using a trie structure
  for lookup.

1882 1883 1884 1885 1886 1887
- The functions in the ``pprint`` module now sort dictionaries by key
  before computing the display.  Before 2.5, ``pprint`` sorted a dictionary
  if and only if its display required more than one line, although that
  wasn't documented.  The new behavior increases predictability; e.g.,
  using ``pprint.pprint(a_dict)`` in a doctest is now reliable.

Georg Brandl's avatar
Georg Brandl committed
1888 1889 1890
- Patch #1497027: try HTTP digest auth before basic auth in urllib2
  (thanks for J. J. Lee).

1891 1892 1893
- Patch #1496206: improve urllib2 handling of passwords with respect to
  default HTTP and HTTPS ports.

1894 1895
- Patch #1080727: add "encoding" parameter to doctest.DocFileSuite.

1896 1897
- Patch #1281707: speed up gzip.readline.

1898 1899 1900 1901
- Patch #1180296: Two new functions were added to the locale module:
  format_string() to get the effect of  "format % items" but locale-aware,
  and currency() to format a monetary number with currency sign.

1902 1903 1904
- Patch #1486962: Several bugs in the turtle Tk demo module were fixed
  and several features added, such as speed and geometry control.

1905 1906 1907
- Patch #1488881: add support for external file objects in bz2 compressed
  tarfiles.

1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926
- Patch #721464: pdb.Pdb instances can now be given explicit stdin and
  stdout arguments, making it possible to redirect input and output
  for remote debugging.

- Patch #1484695: Update the tarfile module to version 0.8. This fixes
  a couple of issues, notably handling of long file names using the
  GNU LONGNAME extension.

- Patch #1478292. ``doctest.register_optionflag(name)`` shouldn't create a
  new flag when ``name`` is already the name of an option flag.

- Bug #1385040: don't allow "def foo(a=1, b): pass" in the compiler
  package.

- Patch #1472854: make the rlcompleter.Completer class usable on non-
  UNIX platforms.

- Patch #1470846: fix urllib2 ProxyBasicAuthHandler.

1927 1928 1929 1930
- Bug #1472827: correctly escape newlines and tabs in attribute values in
  the saxutils.XMLGenerator class.


1931 1932 1933
Build
-----

1934 1935
- Bug #1502728: Correctly link against librt library on HP-UX.

1936 1937
- OpenBSD 3.9 is supported now.

1938 1939
- Patch #1492356: Port to Windows CE.

1940 1941
- Bug/Patch #1481770: Use .so extension for shared libraries on HP-UX for ia64.

1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955
- Patch #1471883: Add --enable-universalsdk.

C API
-----

Tests
-----

Tools
-----

Documentation
-------------

1956 1957


1958 1959 1960 1961 1962 1963 1964 1965
What's New in Python 2.5 alpha 2?
=================================

*Release date: 27-APR-2006*

Core and builtins
-----------------

1966 1967 1968 1969 1970 1971 1972 1973 1974
- Bug #1465834: 'bdist_wininst preinstall script support' was fixed
  by converting these apis from macros into exported functions again:

    PyParser_SimpleParseFile PyParser_SimpleParseString PyRun_AnyFile
    PyRun_AnyFileEx PyRun_AnyFileFlags PyRun_File PyRun_FileEx
    PyRun_FileFlags PyRun_InteractiveLoop PyRun_InteractiveOne
    PyRun_SimpleFile PyRun_SimpleFileEx PyRun_SimpleString
    PyRun_String Py_CompileString

1975 1976
- Under COUNT_ALLOCS, types are not necessarily immortal anymore.

1977 1978 1979 1980
- All uses of PyStructSequence_InitType have been changed to initialize
  the type objects only once, even if the interpreter is initialized
  multiple times.

1981 1982 1983 1984 1985 1986 1987
- Bug #1454485, array.array('u') could crash the interpreter.  This was
  due to PyArgs_ParseTuple(args, 'u#', ...) trying to convert buffers (strings)
  to unicode when it didn't make sense.  'u#' now requires a unicode string.

- Py_UNICODE is unsigned.  It was always documented as unsigned, but
  due to a bug had a signed value in previous versions.

1988 1989 1990
- Patch #837242: ``id()`` of any Python object always gives a positive
  number now, which might be a long integer. ``PyLong_FromVoidPtr`` and
  ``PyLong_AsVoidPtr`` have been changed accordingly.  Note that it has
Tim Peters's avatar
Tim Peters committed
1991
  never been correct to implement a ``__hash()__`` method that returns the
1992 1993 1994 1995 1996 1997 1998
  ``id()`` of an object:

      def __hash__(self):
          return id(self)  # WRONG

  because a hash result must be a (short) Python int but it was always
  possible for ``id()`` to return a Python long.  However, because ``id()``
Tim Peters's avatar
Tim Peters committed
1999
  could return negative values before, on a 32-bit box an ``id()`` result
2000 2001 2002 2003
  was always usable as a hash value before this patch.  That's no longer
  necessarily so.

- Python on OS X 10.3 and above now uses dlopen() (via dynload_shlib.c)
2004
  to load extension modules and now provides the dl module. As a result,
2005
  sys.setdlopenflags() now works correctly on these systems. (SF patch
2006 2007
  #1454844)

2008 2009 2010 2011 2012
- Patch #1463867: enhanced garbage collection to allow cleanup of cycles
  involving generators that have paused outside of any ``try`` or ``with``
  blocks.  (In 2.5a1, a paused generator that was part of a reference
  cycle could not be garbage collected, regardless of whether it was
  paused in a ``try`` or ``with`` block.)
2013

2014 2015 2016
Extension Modules
-----------------

2017 2018 2019
- Patch #1191065: Fix preprocessor problems on systems where recvfrom
  is a macro.

2020 2021 2022
- Bug #1467952: os.listdir() now correctly raises an error if readdir()
  fails with an error condition.

2023 2024 2025 2026 2027 2028 2029 2030 2031 2032
- Fixed bsddb.db.DBError derived exceptions so they can be unpickled.

- Bug #1117761: bsddb.*open() no longer raises an exception when using
  the cachesize parameter.

- Bug #1149413: bsddb.*open() no longer raises an exception when using
  a temporary db (file=None) with the 'n' flag to truncate on open.

- Bug #1332852: bsddb module minimum BerkeleyDB version raised to 3.3
  as older versions cause excessive test failures.
2033

2034 2035 2036
- Patch #1062014: AF_UNIX sockets under Linux have a special
  abstract namespace that is now fully supported.

2037 2038 2039
Library
-------

2040 2041 2042 2043
- Bug #1223937: subprocess.CalledProcessError reports the exit status
  of the process using the returncode attribute, instead of
  abusing errno.

2044 2045 2046 2047
- Patch #1475231: ``doctest`` has a new ``SKIP`` option, which causes
  a doctest to be skipped (the code is not run, and the expected output
  or exception is ignored).

2048 2049 2050
- Fixed contextlib.nested to cope with exceptions being raised and
  caught inside exit handlers.

Greg Ward's avatar
Greg Ward committed
2051 2052 2053 2054 2055
- Updated optparse module to Optik 1.5.1 (allow numeric constants in
  hex, octal, or binary; add ``append_const`` action; keep going if
  gettext cannot be imported; added ``OptionParser.destroy()`` method;
  added ``epilog`` for better help generation).

2056 2057 2058
- Bug #1473760: ``tempfile.TemporaryFile()`` could hang on Windows, when
  called from a thread spawned as a side effect of importing a module.

2059 2060 2061 2062 2063 2064 2065
- The pydoc module now supports documenting packages contained in
  .zip or .egg files.

- The pkgutil module now has several new utility functions, such
  as ``walk_packages()`` to support working with packages that are either
  in the filesystem or zip files.

2066 2067 2068 2069
- The mailbox module can now modify and delete messages from
  mailboxes, in addition to simply reading them.  Thanks to Gregory
  K. Johnson for writing the code, and to the 2005 Google Summer of
  Code for funding his work.
2070

2071 2072 2073
- The ``__del__`` method of class ``local`` in module ``_threading_local``
  returned before accomplishing any of its intended cleanup.

2074 2075
- Patch #790710: Add breakpoint command lists in pdb.

2076 2077
- Patch #1063914: Add Tkinter.Misc.clipboard_get().

2078 2079
- Patch #1191700: Adjust column alignment in bdb breakpoint lists.

2080 2081 2082
- SimpleXMLRPCServer relied on the fcntl module, which is unavailable on
  Windows. Bug #1469163.

2083 2084 2085 2086
- The warnings, linecache, inspect, traceback, site, and doctest modules
  were updated to work correctly with modules imported from zipfiles or
  via other PEP 302 __loader__ objects.

2087 2088 2089
- Patch #1467770: Reduce usage of subprocess._active to processes which
  the application hasn't waited on.

2090 2091
- Patch #1462222: Fix Tix.Grid.

2092 2093
- Fix exception when doing glob.glob('anything*/')

2094 2095 2096
- The pstats.Stats class accepts an optional stream keyword argument to
  direct output to an alternate file-like object.

2097 2098 2099
Build
-----

Martin v. Löwis's avatar
Martin v. Löwis committed
2100 2101 2102
- The Makefile now has a reindent target, which runs reindent.py on
  the library.

2103 2104
- Patch #1470875: Building Python with MS Free Compiler

2105
- Patch #1161914: Add a python-config script.
2106

2107 2108
- Patch #1324762:Remove ccpython.cc; replace --with-cxx with
  --with-cxx-main. Link with C++ compiler only if --with-cxx-main was
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2109
  specified. (Can be overridden by explicitly setting LINKCC.) Decouple
2110 2111
  CXX from --with-cxx-main, see description in README.

2112 2113
- Patch #1429775: Link extension modules with the shared libpython.

2114 2115
- Fixed a libffi build problem on MIPS systems.

2116 2117 2118 2119
- ``PyString_FromFormat``, ``PyErr_Format``, and ``PyString_FromFormatV``
  now accept formats "%u" for unsigned ints, "%lu" for unsigned longs,
  and "%zu" for unsigned integers of type ``size_t``.

2120 2121 2122
Tests
-----

2123 2124 2125
- test_contextlib now checks contextlib.nested can cope with exceptions
  being raised and caught inside exit handlers.

2126 2127
- test_cmd_line now checks operation of the -m and -c command switches

2128 2129 2130 2131
- The test_contextlib test in 2.5a1 wasn't actually run unless you ran
  it separately and by hand.  It also wasn't cleaning up its changes to
  the current Decimal context.

2132 2133 2134 2135 2136
- regrtest.py now has a -M option to run tests that test the new limits of
  containers, on 64-bit architectures. Running these tests is only sensible
  on 64-bit machines with more than two gigabytes of memory. The argument
  passed is the maximum amount of memory for the tests to use.

2137 2138 2139 2140 2141
Tools
-----

- Added the Python benchmark suite pybench to the Tools/ directory;
  contributed by Marc-Andre Lemburg.
2142

2143 2144 2145
Documentation
-------------

2146 2147
- Patch #1473132: Improve docs for ``tp_clear`` and ``tp_traverse``.

2148 2149 2150 2151
- PEP 343: Added Context Types section to the library reference
  and attempted to bring other PEP 343 related documentation into
  line with the implementation and/or python-dev discussions.

2152 2153
- Bug #1337990: clarified that ``doctest`` does not support examples
  requiring both expected output and an exception.
2154 2155


2156 2157 2158
What's New in Python 2.5 alpha 1?
=================================

Anthony Baxter's avatar
Anthony Baxter committed
2159
*Release date: 05-APR-2006*
2160

2161 2162 2163
Core and builtins
-----------------

2164 2165 2166
- PEP 338: -m command line switch now delegates to runpy.run_module
  allowing it to support modules in packages and zipfiles

Martin v. Löwis's avatar
Martin v. Löwis committed
2167 2168 2169 2170
- On Windows, .DLL is not an accepted file name extension for
  extension modules anymore; extensions are only found if they
  end in .PYD.

2171 2172 2173
- Bug #1421664: sys.stderr.encoding is now set to the same value as
  sys.stdout.encoding.

2174 2175
- __import__ accepts keyword arguments.

2176 2177
- Patch #1460496: round() now accepts keyword arguments.

2178 2179
- Fixed bug #1459029 - unicode reprs were double-escaped.

2180 2181 2182
- Patch #1396919: The system scope threads are reenabled on FreeBSD
  5.4 and later versions.

2183 2184 2185
- Bug #1115379: Compiling a Unicode string with an encoding declaration
  now gives a SyntaxError.

2186 2187 2188 2189
- Previously, Python code had no easy way to access the contents of a
  cell object. Now, a ``cell_contents`` attribute has been added
  (closes patch #1170323).

2190 2191 2192 2193 2194 2195 2196
- Patch #1123430: Python's small-object allocator now returns an arena to
  the system ``free()`` when all memory within an arena becomes unused
  again.  Prior to Python 2.5, arenas (256KB chunks of memory) were never
  freed.  Some applications will see a drop in virtual memory size now,
  especially long-running applications that, from time to time, temporarily
  use a large number of small objects.  Note that when Python returns an
  arena to the platform C's ``free()``, there's no guarantee that the
2197 2198
  platform C library will in turn return that memory to the operating system.
  The effect of the patch is to stop making that impossible, and in tests it
2199 2200 2201
  appears to be effective at least on Microsoft C and gcc-based systems.
  Thanks to Evan Jones for hard work and patience.

2202 2203 2204 2205
- Patch #1434038: property() now uses the getter's docstring if there is
  no "doc" argument given. This makes it possible to legitimately use
  property() as a decorator to produce a read-only property.

Guido van Rossum's avatar
Guido van Rossum committed
2206 2207 2208 2209 2210
- PEP 357, patch 1436368: add an __index__ method to int/long and a matching
  nb_index slot to the PyNumberMethods struct.  The slot is consulted instead
  of requiring an int or long in slicing and a few other contexts, enabling
  other objects (e.g. Numeric Python's integers) to be used as slice indices.

Neal Norwitz's avatar
Neal Norwitz committed
2211 2212
- Fixed various bugs reported by Coverity's Prevent tool.

2213 2214 2215 2216 2217
- PEP 352, patch #1104669: Make exceptions new-style objects.  Introduced the
  new exception base class, BaseException, which has a new message attribute.
  KeyboardInterrupt and SystemExit to directly inherit from BaseException now.
  Raising a string exception now raises a DeprecationWarning.

2218 2219 2220 2221 2222 2223
- Patch #1438387, PEP 328: relative and absolute imports. Imports can now be
  explicitly relative, using 'from .module import name' to mean 'from the same
  package as this module is in. Imports without dots still default to the
  old relative-then-absolute, unless 'from __future__ import
  absolute_import' is used.

2224 2225 2226 2227
- Properly check if 'warnings' raises an exception (usually when a filter set
  to "error" is triggered) when raising a warning for raising string
  exceptions.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2228
- CO_GENERATOR_ALLOWED is no longer defined. This behavior is the default.
2229 2230
  The name was removed from Include/code.h.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2231
- PEP 308: conditional expressions were added: (x if cond else y).
Neal Norwitz's avatar
Neal Norwitz committed
2232

Guido van Rossum's avatar
Guido van Rossum committed
2233 2234 2235 2236 2237
- Patch 1433928:
  - The copy module now "copies" function objects (as atomic objects).
  - dict.__getitem__ now looks for a __missing__ hook before raising
    KeyError.

Tim Peters's avatar
Tim Peters committed
2238 2239 2240
- PEP 343: with statement implemented. Needs ``from __future__ import
  with_statement``. Use of 'with' as a variable will generate a warning.
  Use of 'as' as a variable will also generate a warning (unless it's
2241
  part of an import statement).
2242 2243 2244 2245 2246 2247
  The following objects have __context__ methods:
  - The built-in file type.
  - The thread.LockType type.
  - The following types defined by the threading module:
    Lock, RLock, Condition, Semaphore, BoundedSemaphore.
  - The decimal.Context class.
2248

2249 2250 2251 2252 2253 2254
- Fix the encodings package codec search function to only search
  inside its own package. Fixes problem reported in patch #1433198.

  Note: Codec packages should implement and register their own
  codec search function. PEP 100 has the details.

2255 2256 2257 2258 2259 2260 2261
- PEP 353: Using ``Py_ssize_t`` as the index type.

- ``PYMALLOC_DEBUG`` builds now add ``4*sizeof(size_t)`` bytes of debugging
  info to each allocated block, since the ``Py_ssize_t`` changes (PEP 353)
  now allow Python to make use of memory blocks exceeding 2**32 bytes for
  some purposes on 64-bit boxes.  A ``PYMALLOC_DEBUG`` build was limited
  to 4-byte allocations before.
Martin v. Löwis's avatar
Martin v. Löwis committed
2262

2263 2264 2265 2266
- Patch #1400181, fix unicode string formatting to not use the locale.
  This is how string objects work.  u'%f' could use , instead of .
  for the decimal point.  Now both strings and unicode always use periods.

2267 2268 2269
- Bug #1244610, #1392915, fix build problem on OpenBSD 3.7 and 3.8.
  configure would break checking curses.h.

2270 2271 2272
- Bug #959576: The pwd module is now builtin. This allows Python to be
  built on UNIX platforms without $HOME set.

2273 2274
- Bug #1072182, fix some potential problems if characters are signed.

2275 2276
- Bug #889500, fix line number on SyntaxWarning for global declarations.

2277 2278
- Bug #1378022, UTF-8 files with a leading BOM crashed the interpreter.

2279 2280 2281
- Support for converting hex strings to floats no longer works.
  This was not portable.  float('0x3') now raises a ValueError.

2282
- Patch #1382163: Expose Subversion revision number to Python.  New C API
2283
  function Py_GetBuildNumber().  New attribute sys.subversion.  Build number
2284 2285
  is now displayed in interactive prompt banner.

Georg Brandl's avatar
Georg Brandl committed
2286 2287
- Implementation of PEP 341 - Unification of try/except and try/finally.
  "except" clauses can now be written together with a "finally" clause in
2288
  one try statement instead of two nested ones.  Patch #1355913.
Georg Brandl's avatar
Georg Brandl committed
2289

2290 2291 2292
- Bug #1379994: Builtin unicode_escape and raw_unicode_escape codec
  now encodes backslash correctly.

2293 2294
- Patch #1350409: Work around signal handling bug in Visual Studio 2005.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2295
- Bug #1281408: Py_BuildValue now works correctly even with unsigned longs
2296 2297
  and long longs.

2298
- SF Bug #1350188, "setdlopenflags" leads to crash upon "import"
2299
  It was possible for dlerror() to return a NULL pointer, so
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2300
  it will now use a default error message in this case.
2301

2302 2303 2304 2305 2306 2307
- Replaced most Unicode charmap codecs with new ones using the
  new Unicode translate string feature in the builtin charmap
  codec; the codecs were created from the mapping tables available
  at ftp.unicode.org and contain a few updates (e.g. the Mac OS
  encodings now include a mapping for the Apple logo)

2308
- Added a few more codecs for Mac OS encodings
2309

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2310
- Sped up some Unicode operations.
2311

2312 2313
- A new AST parser implementation was completed. The abstract
  syntax tree is available for read-only (non-compile) access
Martin v. Löwis's avatar
Martin v. Löwis committed
2314
  to Python code; an _ast module was added.
2315

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2316
- SF bug #1167751: fix incorrect code being produced for generator expressions.
2317 2318
  The following code now raises a SyntaxError:  foo(a = i for i in range(10))

2319 2320
- SF Bug #976608: fix SystemError when mtime of an imported file is -1.

2321 2322 2323
- SF Bug #887946: fix segfault when redirecting stdin from a directory.
  Provide a warning when a directory is passed on the command line.

2324 2325 2326 2327
- Fix segfault with invalid coding.

- SF bug #772896: unknown encoding results in MemoryError.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2328
- All iterators now have a Boolean value of True.  Formerly, some iterators
2329 2330 2331
  supported a __len__() method which evaluated to False when the iterator
  was empty.

2332 2333 2334
- On 64-bit platforms, when __len__() returns a value that cannot be
  represented as a C int, raise OverflowError.

2335
- test__locale is skipped on OS X < 10.4 (only partial locale support is
Walter Dörwald's avatar
Walter Dörwald committed
2336
  present).
2337

2338 2339 2340
- SF bug #893549: parsing keyword arguments was broken with a few format
  codes.

2341 2342 2343 2344
- Changes donated by Elemental Security to make it work on AIX 5.3
  with IBM's 64-bit compiler (SF patch #1284289).  This also closes SF
  bug #105470: test_pwd fails on 64bit system (Opteron).

2345 2346 2347
- Changes donated by Elemental Security to make it work on HP-UX 11 on
  Itanium2 with HP's 64-bit compiler (SF patch #1225212).

Georg Brandl's avatar
typo  
Georg Brandl committed
2348
- Disallow keyword arguments for type constructors that don't use them
2349 2350
  (fixes bug #1119418).

2351 2352
- Forward UnicodeDecodeError into SyntaxError for source encoding errors.

2353 2354 2355
- SF bug #900092: When tracing (e.g. for hotshot), restore 'return' events for
  exceptions that cause a function to exit.

2356 2357 2358 2359
- The implementation of set() and frozenset() was revised to use its
  own internal data structure.  Memory consumption is reduced by 1/3
  and there are modest speed-ups as well.  The API is unchanged.

2360 2361
- SF bug #1238681:  freed pointer is used in longobject.c:long_pow().

Michael W. Hudson's avatar
Fix:  
Michael W. Hudson committed
2362 2363 2364
- SF bug #1229429: PyObject_CallMethod failed to decrement some
  reference counts in some error exit cases.

2365 2366 2367
- SF bug #1185883:  Python's small-object memory allocator took over
  a block managed by the platform C library whenever a realloc specified
  a small new size.  However, there's no portable way to know then how
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2368
  much of the address space following the pointer is valid, so there's no
2369 2370 2371 2372 2373
  portable way to copy data from the C-managed block into Python's
  small-object space without risking a memory fault.  Python's small-object
  realloc now leaves such blocks under the control of the platform C
  realloc.

Michael W. Hudson's avatar
Fix bug  
Michael W. Hudson committed
2374 2375 2376
- SF bug #1232517: An overflow error was not detected properly when
  attempting to convert a large float to an int in os.utime().

2377 2378 2379
- SF bug #1224347: hex longs now print with lowercase letters just
  like their int counterparts.

Michael W. Hudson's avatar
Michael W. Hudson committed
2380 2381 2382 2383 2384 2385
- SF bug #1163563: the original fix for bug #1010677 ("thread Module
  Breaks PyGILState_Ensure()") broke badly in the case of multiple
  interpreter states; back out that fix and do a better job (see
  http://mail.python.org/pipermail/python-dev/2005-June/054258.html
  for a longer write-up of the problem).

Michael W. Hudson's avatar
Michael W. Hudson committed
2386 2387 2388
- SF patch #1180995: marshal now uses a binary format by default when
  serializing floats.

2389 2390 2391 2392
- SF patch #1181301: on platforms that appear to use IEEE 754 floats,
  the routines that promise to produce IEEE 754 binary representations
  of floats now simply copy bytes around.

2393 2394 2395
- bug #967182: disallow opening files with 'wU' or 'aU' as specified by PEP
  278.

2396 2397 2398 2399
- patch #1109424: int, long, float, complex, and unicode now check for the
  proper magic slot for type conversions when subclassed.  Previously the
  magic slot was ignored during conversion.  Semantics now match the way
  subclasses of str always behaved.  int/long/float, conversion of an instance
Walter Dörwald's avatar
Walter Dörwald committed
2400
  to the base class has been moved to the proper nb_* magic slot and out of
2401
  PyNumber_*().
Neal Norwitz's avatar
Neal Norwitz committed
2402
  Thanks Walter D�rwald.
2403

2404 2405 2406 2407 2408
- Descriptors defined in C with a PyGetSetDef structure, where the setter is
  NULL, now raise an AttributeError when attempting to set or delete the
  attribute.  Previously a TypeError was raised, but this was inconsistent
  with the equivalent pure-Python implementation.

Michael W. Hudson's avatar
Fix:  
Michael W. Hudson committed
2409 2410 2411 2412 2413 2414
- It is now safe to call PyGILState_Release() before
  PyEval_InitThreads() (note that if there is reason to believe there
  are multiple threads around you still must call PyEval_InitThreads()
  before using the Python API; this fix is for extension modules that
  have no way of knowing if Python is multi-threaded yet).

2415 2416 2417
- Typing Ctrl-C whilst raw_input() was waiting in a build with threads
  disabled caused a crash.

2418 2419 2420
- Bug #1165306: instancemethod_new allowed the creation of a method
  with im_class == im_self == NULL, which caused a crash when called.

2421
- Move exception finalisation later in the shutdown process - this
2422 2423
  fixes the crash seen in bug #1165761

2424 2425
- Added two new builtins, any() and all().

2426
- Defining a class with empty parentheses is now allowed
2427 2428 2429
  (e.g., ``class C(): pass`` is no longer a syntax error).
  Patch #1176012 added support to the 'parser' module and 'compiler' package
  (thanks to logistix for that added support).
2430

2431 2432
- Patch #1115086: Support PY_LONGLONG in structmember.

2433 2434 2435
- Bug #1155938: new style classes did not check that __init__() was
  returning None.

2436
- Patch #802188: Report characters after line continuation character
2437 2438
  ('\') with a specific error message.

2439 2440
- Bug #723201: Raise a TypeError for passing bad objects to 'L' format.

Michael W. Hudson's avatar
Michael W. Hudson committed
2441 2442 2443
- Bug #1124295: the __name__ attribute of file objects was
  inadvertently made inaccessible in restricted mode.

2444
- Bug #1074011: closing sys.std{out,err} now causes a flush() and
2445 2446
  an ferror() call.

2447 2448 2449
- min() and max() now support key= arguments with the same meaning as in
  list.sort().

2450 2451 2452
- The peephole optimizer now performs simple constant folding in expressions:
      (2+3) --> (5).

2453 2454
- set and frozenset objects can now be marshalled.  SF #1098985.

2455 2456
- Bug #1077106: Poor argument checking could cause memory corruption
  in calls to os.read().
2457

2458 2459 2460 2461
- The parser did not complain about future statements in illegal
  positions.  It once again reports a syntax error if a future
  statement occurs after anything other than a doc string.

2462 2463 2464 2465
- Change the %s format specifier for str objects so that it returns a
  unicode instance if the argument is not an instance of basestring and
  calling __str__ on the argument returns a unicode instance.

2466 2467 2468 2469 2470 2471
- Patch #1413181:  changed ``PyThreadState_Delete()`` to forget about the
  current thread state when the auto-GIL-state machinery knows about
  it (since the thread state is being deleted, continuing to remember it
  can't help, but can hurt if another thread happens to get created with
  the same thread id).

2472 2473 2474
Extension Modules
-----------------

2475 2476
- Patch #1380952: fix SSL objects timing out on consecutive read()s

2477 2478
- Patch #1309579: wait3 and wait4 were added to the posix module.

2479 2480 2481
- Patch #1231053: The audioop module now supports encoding/decoding of alaw.
  In addition, the existing ulaw code was updated.

2482
- RFE #567972: Socket objects' family, type and proto properties are
2483
  now exposed via new attributes.
2484

2485 2486
- Everything under lib-old was removed.  This includes the following modules:
    Para, addpack, cmp, cmpcache, codehack, dircmp, dump, find, fmt, grep,
Tim Peters's avatar
Tim Peters committed
2487
    lockfile, newdir, ni, packmail, poly, rand, statcache, tb, tzparse,
2488 2489 2490 2491 2492
    util, whatsound, whrandom, zmod

- The following modules were removed:  regsub, reconvert, regex, regex_syntax.

- re and sre were swapped, so help(re) provides full help.  importing sre
2493 2494
  is deprecated.  The undocumented re.engine variable no longer exists.

2495 2496 2497
- Bug #1448490: Fixed a bug that ISO-2022 codecs could not handle
  SS2 (single-shift 2) escape sequences correctly.

2498 2499 2500 2501
- The unicodedata module was updated to the 4.1 version of the Unicode
  database. The 3.2 version is still available as unicodedata.db_3_2_0
  for applications that require this specific version (such as IDNA).

2502 2503 2504
- The timing module is no longer built by default.  It was deprecated
  in PEP 4 in Python 2.0 or earlier.

Guido van Rossum's avatar
Guido van Rossum committed
2505 2506 2507
- Patch 1433928: Added a new type, defaultdict, to the collections module.
  This uses the new __missing__ hook behavior added to dict (see above).

2508 2509 2510
- Bug #854823: socketmodule now builds on Sun platforms even when
  INET_ADDRSTRLEN is not defined.

2511 2512 2513
- Patch #1393157: os.startfile() now has an optional argument to specify
  a "command verb" to invoke on the file.

2514 2515 2516
- Bug #876637, prevent stack corruption when socket descriptor
  is larger than FD_SETSIZE.

2517 2518 2519 2520
- Patch #1407135, bug #1424041: harmonize mmap behavior of anonymous memory.
  mmap.mmap(-1, size) now returns anonymous memory in both Unix and Windows.
  mmap.mmap(0, size) should not be used on Windows for anonymous memory.

2521 2522 2523
- Patch #1422385: The nis module now supports access to domains other
  than the system default domain.

2524 2525 2526 2527
- Use Win32 API to implement os.stat/fstat. As a result, subsecond timestamps
  are reported, the limit on path name lengths is removed, and stat reports
  WindowsError now (instead of OSError).

2528 2529
- Add bsddb.db.DBEnv.set_tx_timestamp allowing time based database recovery.

2530 2531 2532
- Bug #1413192, fix seg fault in bsddb if a transaction was deleted
  before the env.

2533 2534
- Patch #1103116: Basic AF_NETLINK support.

2535 2536
- Bug #1402308, (possible) segfault when using mmap.mmap(-1, ...)

2537 2538 2539 2540
- Bug #1400822, _curses over{lay,write} doesn't work when passing 6 ints.
  Also fix ungetmouse() which did not accept arguments properly.
  The code now conforms to the documented signature.

2541 2542 2543
- Bug #1400115, Fix segfault when calling curses.panel.userptr()
  without prior setting of the userptr.

2544 2545
- Fix 64-bit problems in bsddb.

2546 2547
- Patch #1365916: fix some unsafe 64-bit mmap methods.

2548 2549 2550
- Bug #1290333: Added a workaround for cjkcodecs' _codecs_cn build
  problem on AIX.

2551 2552
- Bug #869197: os.setgroups rejects long integer arguments

2553 2554
- Bug #1346533, select.poll() doesn't raise an error if timeout > sys.maxint

2555 2556
- Bug #1344508, Fix UNIX mmap leaking file descriptors

2557 2558 2559
- Patch #1338314, Bug #1336623: fix tarfile so it can extract
  REGTYPE directories from tarfiles written by old programs.

2560 2561 2562 2563 2564 2565
- Patch #1407992, fixes broken bsddb module db associate when using
  BerkeleyDB 3.3, 4.0 or 4.1.

- Get bsddb module to build with BerkeleyDB version 4.4

- Get bsddb module to build with BerkeleyDB version 3.2
2566

2567 2568 2569
- Patch #1309009, Fix segfault in pyexpat when the XML document is in latin_1,
  but Python incorrectly assumes it is in UTF-8 format

2570 2571
- Fix parse errors in the readline module when compiling without threads.

2572 2573 2574
- Patch #1288833: Removed thread lock from socket.getaddrinfo on
  FreeBSD 5.3 and later versions which got thread-safe getaddrinfo(3).

2575 2576 2577
- Patches #1298449 and #1298499: Add some missing checks for error
  returns in cStringIO.c.

2578 2579 2580
- Patch #1297028: fix segfault if call type on MultibyteCodec,
  MultibyteStreamReader, or MultibyteStreamWriter

Neal Norwitz's avatar
Neal Norwitz committed
2581 2582
- Fix memory leak in posix.access().

2583 2584
- Patch #1213831: Fix typo in unicodedata._getcode.

Georg Brandl's avatar
Georg Brandl committed
2585 2586 2587
- Bug #1007046: os.startfile() did not accept unicode strings encoded in
  the file system encoding.

2588 2589
- Patch #756021: Special-case socket.inet_aton('255.255.255.255') for
  platforms that don't have inet_aton().
2590

2591 2592 2593
- Bug #1215928: Fix bz2.BZ2File.seek() for 64-bit file offsets.

- Bug #1191043: Fix bz2.BZ2File.(x)readlines for files containing one
2594 2595
  line without newlines.

2596 2597 2598
- Bug #728515: mmap.resize() now resizes the file on Unix as it did
  on Windows.

Walter Dörwald's avatar
Walter Dörwald committed
2599
- Patch #1180695: Add nanosecond stat resolution, and st_gen,
2600 2601
  st_birthtime for FreeBSD.

2602 2603 2604 2605
- Patch #1231069: The fcntl.ioctl function now uses the 'I' code for
  the request code argument, which results in more C-like behaviour
  for large or negative values.

2606
- Bug #1234979: For the argument of thread.Lock.acquire, the Windows
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2607
  implementation treated all integer values except 1 as false.
2608

2609 2610
- Bug #1194181: bz2.BZ2File didn't handle mode 'U' correctly.

2611 2612 2613
- Patch #1212117: os.stat().st_flags is now accessible as a attribute
  if available on the platform.

2614 2615 2616
- Patch #1103951: Expose O_SHLOCK and O_EXLOCK in the posix module if
  available on the platform.

2617 2618 2619
- Bug #1166660: The readline module could segfault if hook functions
  were set in a different thread than that which called readline.

2620 2621
- collections.deque objects now support a remove() method.

2622 2623 2624 2625
- operator.itemgetter() and operator.attrgetter() now support retrieving
  multiple fields.  This provides direct support for sorting on multiple
  keys (primary, secondary, etc).

2626 2627
- os.access now supports Unicode path names on non-Win32 systems.

2628 2629 2630
- Patches #925152, #1118602: Avoid reading after the end of the buffer
  in pyexpat.GetInputContext.

2631
- Patches #749830, #1144555: allow UNIX mmap size to default to current
2632 2633
  file size.

2634 2635
- Added functional.partial().  See PEP309.

2636 2637 2638
- Patch #1093585: raise a ValueError for negative history items in readline.
  {remove_history,replace_history}

Fred Drake's avatar
Fred Drake committed
2639 2640
- The spwd module has been added, allowing access to the shadow password
  database.
2641

2642 2643
- stat_float_times is now True.

2644 2645
- array.array objects are now picklable.

2646 2647 2648
- the cPickle module no longer accepts the deprecated None option in the
  args tuple returned by __reduce__().

2649 2650 2651 2652
- itertools.islice() now accepts None for the start and step arguments.
  This allows islice() to work more readily with slices:
      islice(s.start, s.stop, s.step)

2653 2654
- datetime.datetime() now has a strptime class method which can be used to
  create datetime object using a string and format.
2655

Matthias Klose's avatar
Matthias Klose committed
2656
- Patch #1117961: Replace the MD5 implementation from RSA Data Security Inc
2657 2658
  with the implementation from http://sourceforge.net/projects/libmd5-rfc/.

2659 2660
Library
-------
2661

2662 2663 2664
- Patch #1388073: Numerous __-prefixed attributes of unittest.TestCase have
  been renamed to have only a single underscore prefix.  This was done to
  make subclassing easier.
2665

2666 2667 2668 2669
- PEP 338: new module runpy defines a run_module function to support
  executing modules which provide access to source code or a code object
  via the PEP 302 import mechanisms.

2670 2671 2672 2673
- The email module's parsedate_tz function now sets the daylight savings
  flag to -1 (unknown) since it can't tell from the date whether it should
  be set.

2674 2675 2676
- Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
  now sport attributes that provide access to the parts of the result.

2677 2678 2679
- Patch #1462498: sgmllib now handles entity and character references
  in attribute values.

2680
- Added the sqlite3 package. This is based on pysqlite2.1.3, and provides
2681
  a DB-API interface in the standard library. You'll need sqlite 3.0.8 or
2682
  later to build this - if you have an earlier version, the C extension
2683 2684
  module will not be built.

2685 2686 2687 2688 2689
- Bug #1460340: ``random.sample(dict)`` failed in various ways.  Dicts
  aren't officially supported here, and trying to use them will probably
  raise an exception some day.  But dicts have been allowed, and "mostly
  worked", so support for them won't go away without warning.

2690 2691 2692
- Bug #1445068: getpass.getpass() can now be given an explicit stream
  argument to specify where to write the prompt.

2693 2694 2695
- Patch #1462313, bug #1443328: the pickle modules now can handle classes
  that have __private names in their __slots__.

2696
- Bug #1250170: mimetools now handles socket.gethostname() failures gracefully.
2697

2698 2699 2700
- patch #1457316: "setup.py upload" now supports --identity to select the
  key to be used for signing the uploaded code.

2701 2702 2703 2704
- Queue.Queue objects now support .task_done() and .join() methods
  to make it easier to monitor when daemon threads have completed
  processing all enqueued tasks.  Patch #1455676.

2705 2706
- popen2.Popen objects now preserve the command in a .cmd attribute.

Thomas Heller's avatar
Thomas Heller committed
2707 2708
- Added the ctypes ffi package.

Barry Warsaw's avatar
Barry Warsaw committed
2709 2710 2711 2712 2713 2714 2715 2716
- email 4.0 package now integrated.  This is largely the same as the email 3.0
  package that was included in Python 2.3, except that PEP 8 module names are
  now used (e.g. mail.message instead of email.Message).  The MIME classes
  have been moved to a subpackage (e.g. email.mime.text instead of
  email.MIMEText).  The old names are still supported for now.  Several
  deprecated Message methods have been removed and lots of bugs have been
  fixed.  More details can be found in the email package documentation.

2717 2718 2719 2720 2721 2722
- Patches #1436130/#1443155: codecs.lookup() now returns a CodecInfo object
  (a subclass of tuple) that provides incremental decoders and encoders
  (a way to use stateful codecs without the stream API). Python functions
  codecs.getincrementaldecoder() and codecs.getincrementalencoder() as well
  as C functions PyCodec_IncrementalEncoder() and PyCodec_IncrementalDecoder()
  have been added.
2723

2724 2725 2726 2727
- Patch #1359365: Calling next() on a closed StringIO.String object raises
  a ValueError instead of a StopIteration now (like file and cString.String do).
  cStringIO.StringIO.isatty() will raise a ValueError now if close() has been
  called before (like file and StringIO.StringIO do).
2728

Martin v. Löwis's avatar
Martin v. Löwis committed
2729 2730
- A regrtest option -w was added to re-run failed tests in verbose mode.

Georg Brandl's avatar
Georg Brandl committed
2731 2732 2733
- Patch #1446372: quit and exit can now be called from the interactive
  interpreter to exit.

2734 2735 2736
- The function get_count() has been added to the gc module, and gc.collect()
  grew an optional 'generation' argument.

Martin v. Löwis's avatar
Martin v. Löwis committed
2737 2738 2739
- A library msilib to generate Windows Installer files, and a distutils
  command bdist_msi have been added.

2740 2741 2742
- PEP 343: new module contextlib.py defines decorator @contextmanager
  and helpful context managers nested() and closing().

Martin v. Löwis's avatar
Martin v. Löwis committed
2743 2744
- The compiler package now supports future imports after the module docstring.

2745 2746 2747
- Bug #1413790: zipfile now sanitizes absolute archive names that are
  not allowed by the specs.

2748 2749 2750
- Patch #1215184: FileInput now can be given an opening hook which can
  be used to control how files are opened.

2751 2752 2753
- Patch #1212287: fileinput.input() now has a mode parameter for
  specifying the file mode input files should be opened with.

2754 2755 2756
- Patch #1215184: fileinput now has a fileno() function for getting the
  current file number.

2757 2758 2759
- Patch #1349274: gettext.install() now optionally installs additional
  translation functions other than _() in the builtin namespace.

2760 2761
- Patch #1337756: fileinput now accepts Unicode filenames.

2762 2763 2764
- Patch #1373643: The chunk module can now read chunks larger than
  two gigabytes.

2765 2766
- Patch #1417555: SimpleHTTPServer now returns Last-Modified headers.

2767 2768 2769
- Bug #1430298: It is now possible to send a mail with an empty
  return address using smtplib.

Georg Brandl's avatar
Georg Brandl committed
2770 2771
- Bug #1432260: The names of lambda functions are now properly displayed
  in pydoc.
2772

2773 2774 2775
- Patch #1412872: zipfile now sets the creator system to 3 (Unix)
  unless the system is Win32.

Tim Peters's avatar
Tim Peters committed
2776
- Patch #1349118: urllib now supports user:pass@ style proxy
2777 2778 2779
  specifications, raises IOErrors when proxies for unsupported protocols
  are defined, and uses the https proxy on https redirections.

2780 2781 2782
- Bug #902075: urllib2 now supports 'host:port' style proxy specifications.

- Bug #1407902: Add support for sftp:// URIs to urlparse.
2783

2784 2785
- Bug #1371247: Update Windows locale identifiers in locale.py.

Neal Norwitz's avatar
Neal Norwitz committed
2786
- Bug #1394565: SimpleHTTPServer now doesn't choke on query parameters
2787
  any more.
2788

2789 2790
- Bug #1403410: The warnings module now doesn't get confused
  when it can't find out the module name it generates a warning for.
2791

2792 2793
- Patch #1177307: Added a new codec utf_8_sig for UTF-8 with a BOM signature.

2794 2795
- Patch #1157027: cookielib mishandles RFC 2109 cookies in Netscape mode

2796 2797 2798 2799
- Patch #1117398: cookielib.LWPCookieJar and .MozillaCookieJar now raise
  LoadError as documented, instead of IOError.  For compatibility,
  LoadError subclasses IOError.

2800
- Added the hashlib module.  It provides secure hash functions for MD5 and
2801 2802 2803 2804 2805 2806 2807 2808 2809 2810
  SHA1, 224, 256, 384, and 512.  Note that recent developments make the
  historic MD5 and SHA1 unsuitable for cryptographic-strength applications.
  In <http://mail.python.org/pipermail/python-dev/2005-December/058850.html>
  Ronald L. Rivest offered this advice for Python:

      "The consensus of researchers in this area (at least as
      expressed at the NIST Hash Function Workshop 10/31/05),
      is that SHA-256 is a good choice for the time being, but
      that research should continue, and other alternatives may
      arise from this research.  The larger SHA's also seem OK."
2811

2812 2813 2814 2815
- Added a subset of Fredrik Lundh's ElementTree package.  Available
  modules are xml.etree.ElementTree, xml.etree.ElementPath, and
  xml.etree.ElementInclude, from ElementTree 1.2.6.

2816 2817
- Patch #1162825: Support non-ASCII characters in IDLE window titles.

2818 2819
- Bug #1365984: urllib now opens "data:" URLs again.

2820 2821 2822 2823
- Patch #1314396: prevent deadlock for threading.Thread.join() when an exception
  is raised within the method itself on a previous call (e.g., passing in an
  illegal argument)

2824 2825 2826
- Bug #1340337: change time.strptime() to always return ValueError when there
  is an error in the format string.

2827 2828
- Patch #754022: Greatly enhanced webbrowser.py (by Oleg Broytmann).

Walter Dörwald's avatar
Walter Dörwald committed
2829
- Bug #729103: pydoc.py: Fix docother() method to accept additional
2830 2831
  "parent" argument.

2832 2833 2834
- Patch #1300515: xdrlib.py: Fix pack_fstring() to really use null bytes
  for padding.

2835 2836 2837
- Bug #1296004: httplib.py: Limit maximal amount of data read from the
  socket to avoid a MemoryError on Windows.

2838 2839 2840 2841 2842 2843
- Patch #1166948: locale.py: Prefer LC_ALL, LC_CTYPE and LANG over LANGUAGE
  to get the correct encoding.

- Patch #1166938: locale.py: Parse LANGUAGE as a colon separated list of
  languages.

2844 2845
- Patch #1268314: Cache lines in StreamReader.readlines for performance.

2846 2847
- Bug #1290505: Fix clearing the regex cache for time.strptime().

2848 2849
- Bug #1167128: Fix size of a symlink in a tarfile to be 0.

2850 2851 2852
- Patch #810023: Fix off-by-one bug in urllib.urlretrieve reporthook
  functionality.

2853 2854
- Bug #1163178: Make IDNA return an empty string when the input is empty.

2855
- Patch #848017: Make Cookie more RFC-compliant. Use CRLF as default output
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2856
  separator and do not output trailing semicolon.
2857

2858 2859 2860 2861
- Patch #1062060: urllib.urlretrieve() now raises a new exception, named
  ContentTooShortException, when the actually downloaded size does not
  match the Content-Length header.

2862 2863
- Bug #1121494: distutils.dir_utils.mkpath now accepts Unicode strings.

2864 2865
- Bug #1178484: Return complete lines from codec stream readers
  even if there is an exception in later lines, resulting in
Walter Dörwald's avatar
Walter Dörwald committed
2866
  correct line numbers for decoding errors in source code.
2867

2868 2869
- Bug #1192315: Disallow negative arguments to clear() in pdb.

2870 2871
- Patch #827386: Support absolute source paths in msvccompiler.py.

2872 2873 2874
- Patch #1105730: Apply the new implementation of commonprefix in posixpath
  to ntpath, macpath, os2emxpath and riscospath.

2875 2876 2877 2878
- Fix a problem in Tkinter introduced by SF patch #869468: delete bogus
  __hasattr__ and __delattr__ methods on class Tk that were breaking
  Tkdnd.

2879 2880 2881
- Bug #1015140: disambiguated the term "article id" in nntplib docs and
  docstrings to either "article number" or "message id".

2882 2883 2884
- Bug #1238170: threading.Thread.__init__ no longer has "kwargs={}" as a
  parameter, but uses the usual "kwargs=None".

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2885
- textwrap now processes text chunks at O(n) speed instead of O(n**2).
2886 2887
  Patch #1209527 (Contributed by Connelly).

2888 2889 2890
- urllib2 has now an attribute 'httpresponses' mapping from HTTP status code
  to W3C name (404 -> 'Not Found'). RFE #1216944.

2891 2892 2893
- Bug #1177468: Don't cache the /dev/urandom file descriptor for os.urandom,
  as this can cause problems with apps closing all file descriptors.

Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2894
- Bug #839151: Fix an attempt to access sys.argv in the warnings module;
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2895
  it can be missing in embedded interpreters
2896

2897 2898
- Bug #1155638: Fix a bug which affected HTTP 0.9 responses in httplib.

2899 2900 2901
- Bug #1100201: Cross-site scripting was possible on BaseHTTPServer via
  error messages.

2902 2903
- Bug #1108948: Cookie.py produced invalid JavaScript code.

2904 2905 2906
- The tokenize module now detects and reports indentation errors.
  Bug #1224621.

2907
- The tokenize module has a new untokenize() function to support a full
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
2908
  roundtrip from lexed tokens back to Python source code.  In addition,
2909 2910 2911
  the generate_tokens() function now accepts a callable argument that
  terminates by raising StopIteration.

2912 2913
- Bug #1196315: fix weakref.WeakValueDictionary constructor.

2914 2915 2916
- Bug #1213894: os.path.realpath didn't resolve symlinks that were the first
  component of the path.

2917 2918 2919 2920 2921
- Patch #1120353: The xmlrpclib module provides better, more transparent,
  support for datetime.{datetime,date,time} objects.  With use_datetime set
  to True, applications shouldn't have to fiddle with the DateTime wrapper
  class at all.

2922 2923 2924
- distutils.commands.upload was added to support uploading distribution
  files to PyPI.

2925 2926 2927
- distutils.commands.register now encodes the data as UTF-8 before posting
  them to PyPI.

2928 2929 2930 2931 2932
- decimal operator and comparison methods now return NotImplemented
  instead of raising a TypeError when interacting with other types.  This
  allows other classes to implement __radd__ style methods and have them
  work as expected.

2933 2934 2935
- Bug #1163325:  Decimal infinities failed to hash.  Attempting to
  hash a NaN raised an InvalidOperation instead of a TypeError.

2936
- Patch #918101: Add tarfile open mode r|* for auto-detection of the
2937 2938
  stream compression; add, for symmetry reasons, r:* as a synonym of r.

2939 2940
- Patch #1043890: Add extractall method to tarfile.

2941 2942 2943
- Patch #1075887: Don't require MSVC in distutils if there is nothing
  to build.

2944 2945 2946
- Patch #1103407: Properly deal with tarfile iterators when untarring
  symbolic links on Windows.

2947
- Patch #645894: Use getrusage for computing the time consumption in
2948 2949
  profile.py if available.

2950 2951
- Patch #1046831: Use get_python_version where appropriate in sysconfig.py.

2952 2953 2954
- Patch #1117454: Remove code to special-case cookies without values
  in LWPCookieJar.

2955 2956
- Patch #1117339: Add cookielib special name tests.

2957 2958
- Patch #1112812: Make bsddb/__init__.py more friendly for modulefinder.

2959 2960
- Patch #1110248: SYNC_FLUSH the zlib buffer for GZipFile.flush.

2961 2962
- Patch #1107973: Allow to iterate over the lines of a tarfile.ExFileObject.

2963 2964
- Patch #1104111: Alter setup.py --help and --help-commands.

2965 2966
- Patch #1121234: Properly cleanup _exit and tkerror commands.

2967 2968
- Patch #1049151: xdrlib now unpacks booleans as True or False.

2969 2970
- Fixed bug in a NameError bug in cookielib.  Patch #1116583.

2971 2972 2973 2974
- Applied a security fix to SimpleXMLRPCserver (PSF-2005-001).  This
  disables recursive traversal through instance attributes, which can
  be exploited in various ways.

2975
- Bug #1222790: in SimpleXMLRPCServer, set the reuse-address and close-on-exec
2976 2977
  flags on the HTTP listening socket.

2978 2979 2980
- Bug #792570: SimpleXMLRPCServer had problems if the request grew too large.
  Fixed by reading the HTTP body in chunks instead of one big socket.read().

Fred Drake's avatar
Fred Drake committed
2981 2982
- Patches #893642, #1039083: add allow_none, encoding arguments to
  constructors of SimpleXMLRPCServer and CGIXMLRPCRequestHandler.
2983

2984 2985
- Bug #1110478: Revert os.environ.update to do putenv again.

2986 2987
- Bug #1103844: fix distutils.install.dump_dirs() with negated options.

2988 2989
- os.{SEEK_SET, SEEK_CUR, SEEK_END} have been added for convenience.

2990 2991 2992
- Enhancements to the csv module:

  + Dialects are now validated by the underlying C code, better
2993
    reflecting its capabilities, and improving its compliance with
2994
    PEP 305.
2995 2996 2997 2998 2999
  + Dialect parameter parsing has been re-implemented to improve error
    reporting.
  + quotechar=None and quoting=QUOTE_NONE now work the way PEP 305
    dictates.
  + the parser now removes the escapechar prefix from escaped characters.
3000
  + when quoting=QUOTE_NONNUMERIC, the writer now tests for numeric
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
3001
    types, rather than any object that can be represented as a numeric.
3002 3003
  + when quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
    to floats.
3004 3005
  + reader now allows \r characters to be quoted (previously it only allowed
    \n to be quoted).
3006
  + writer doublequote handling improved.
3007 3008 3009 3010 3011 3012 3013 3014 3015 3016 3017 3018
  + Dialect classes passed to the module are no longer instantiated by
    the module before being parsed (the former validation scheme required
    this, but the mechanism was unreliable).
  + The dialect registry now contains instances of the internal
    C-coded dialect type, rather than references to python objects.
  + the internal c-coded dialect type is now immutable.
  + register_dialect now accepts the same keyword dialect specifications
    as the reader and writer, allowing the user to register dialects
    without first creating a dialect class.
  + a configurable limit to the size of parsed fields has been added -
    previously, an unmatched quote character could result in the entire
    file being read into the field buffer before an error was reported.
3019
  + A new module method csv.field_size_limit() has been added that sets
3020 3021
    the parser field size limit (returning the former limit). The initial
    limit is 128kB.
3022 3023 3024 3025
  + A line_num attribute has been added to the reader object, which tracks
    the number of lines read from the source iterator. This is not
    the same as the number of records returned, as records can span
    multiple lines.
3026 3027 3028
  + reader and writer objects were not being registered with the cyclic-GC.
    This has been fixed.

3029 3030 3031 3032 3033
- _DummyThread objects in the threading module now delete self.__block that is
  inherited from _Thread since it uses up a lock allocated by 'thread'.  The
  lock primitives tend to be limited in number and thus should not be wasted on
  a _DummyThread object.  Fixes bug #1089632.

3034 3035
- The imghdr module now detects Exif files.

3036 3037 3038
- StringIO.truncate() now correctly adjusts the size attribute.
  (Bug #951915).

3039 3040 3041
- locale.py now uses an updated locale alias table (built using
  Tools/i18n/makelocalealias.py, a tool to parse the X11 locale
  alias file); the encoding lookup was enhanced to use Python's
Andrew M. Kuchling's avatar
Andrew M. Kuchling committed
3042
  encoding alias table.
3043

Raymond Hettinger's avatar
Raymond Hettinger committed
3044 3045
- moved deprecated modules to Lib/lib-old:  whrandom, tzparse, statcache.

3046 3047 3048
- the pickle module no longer accepts the deprecated None option in the
  args tuple returned by __reduce__().

3049 3050
- optparse now optionally imports gettext.  This allows its use in setup.py.

3051 3052
- the pickle module no longer uses the deprecated bin parameter.

3053 3054
- the shelve module no longer uses the deprecated binary parameter.

3055 3056
- the pstats module no longer uses the deprecated ignore() method.

3057 3058
- the filecmp module no longer uses the deprecated use_statcache argument.

3059 3060 3061 3062
- unittest.TestCase.run() and unittest.TestSuite.run() can now be successfully
  extended or overridden by subclasses.  Formerly, the subclassed method would
  be ignored by the rest of the module.  (Bug #1078905).

3063
- heapq.nsmallest() and heapq.nlargest() now support key= arguments with
3064
  the same meaning as in list.sort().
3065

3066 3067 3068 3069
- Bug #1076985: ``codecs.StreamReader.readline()`` now calls ``read()`` only
  once when a size argument is given. This prevents a buffer overflow in the
  tokenizer with very long source lines.

Barry Warsaw's avatar
Barry Warsaw committed
3070 3071 3072
- Bug #1083110: ``zlib.decompress.flush()`` would segfault if called
  immediately after creating the object, without any intervening
  ``.decompress()`` calls.
3073

3074 3075
- The reconvert.quote function can now emit triple-quoted strings.  The
  reconvert module now has some simple documentation.
3076

3077 3078 3079
- ``UserString.MutableString`` now supports negative indices in
  ``__setitem__`` and ``__delitem__``

3080 3081 3082
- Bug #1149508: ``textwrap`` now handles hyphenated numbers (eg. "2004-03-05")
  correctly.

3083 3084 3085 3086 3087 3088
- Partial fixes for SF bugs #1163244 and #1175396: If a chunk read by
  ``codecs.StreamReader.readline()`` has a trailing "\r", read one more
  character even if the user has passed a size parameter to get a proper
  line ending. Remove the special handling of a "\r\n" that has been split
  between two lines.

3089 3090 3091 3092
- Bug #1251300: On UCS-4 builds the "unicode-internal" codec will now complain
  about illegal code points. The codec now supports PEP 293 style error
  handlers.

Walter Dörwald's avatar
Walter Dörwald committed
3093
- Bug #1235646: ``codecs.StreamRecoder.next()`` now reencodes the data it reads
3094 3095
  from the input stream, so that the output is a byte string in the correct
  encoding instead of a unicode string.
3096

3097 3098 3099
- Bug #1202493: Fixing SRE parser to handle '{}' as perl does, rather than
  considering it exactly like a '*'.

3100 3101
- Bug #1245379: Add "unicode-1-1-utf-7" as an alias for "utf-7" to
  ``encodings.aliases``.
3102

3103 3104
- ` uu.encode()`` and ``uu.decode()`` now support unicode filenames.

3105 3106 3107
- Patch #1413711: Certain patterns of differences were making difflib
  touch the recursion limit.

3108 3109
- Bug #947906: An object oriented interface has been added to the calendar
  module. It's possible to generate HTML calendar now and the module can be
3110 3111 3112
  called as a script (e.g. via ``python -mcalendar``). Localized month and
  weekday names can be ouput (even if an exotic encoding is used) using
  special classes that use unicode.
3113

3114 3115 3116
Build
-----

3117 3118 3119
- Fix test_float, test_long, and test_struct failures on Tru64 with gcc
  by using -mieee gcc option.

3120 3121
- Patch #1432345: Make python compile on DragonFly.

3122 3123
- Build support for Win64-AMD64 was added.

3124 3125
- Patch #1428494: Prefer linking against ncursesw over ncurses library.

3126 3127
- Patch #881820: look for openpty and forkpty also in libbsd.

3128 3129 3130
- The sources of zlib are now part of the Python distribution (zlib 1.2.3).
  The zlib module is now builtin on Windows.

3131 3132
- Use -xcode=pic32 for CCSHARED on Solaris with SunPro.

3133 3134 3135
- Bug #1189330: configure did not correctly determine the necessary
  value of LINKCC if python was built with GCC 4.0.

3136 3137 3138
- Upgrade Windows build to zlib 1.2.3 which eliminates a potential security
  vulnerability in zlib 1.2.1 and 1.2.2.

3139 3140 3141
- EXTRA_CFLAGS has been introduced as an environment variable to hold compiler
  flags that change binary compatibility.  Changes were also made to
  distutils.sysconfig to also use the environment variable when used during
3142
  compilation of the interpreter and of C extensions through distutils.
3143

3144 3145 3146 3147
- SF patch 1171735: Darwin 8's headers are anal about POSIX compliance,
  and linking has changed (prebinding is now deprecated, and libcc_dynamic
  no longer exists). This configure patch makes things right.

3148 3149
- Bug #1158607: Build with --disable-unicode again.

3150 3151 3152
- spwdmodule.c is built only if either HAVE_GETSPNAM or HAVE_HAVE_GETSPENT is
  defined.  Discovered as a result of not being able to build on OS X.

3153 3154 3155 3156 3157 3158 3159 3160 3161
- setup.py now uses the directories specified in LDFLAGS using the -L option
  and in CPPFLAGS using the -I option for adding library and include
  directories, respectively, for compiling extension modules against.  This has
  led to the core being compiled using the values in CPPFLAGS.  It also removes
  the need for the special-casing of both DarwinPorts and Fink for darwin since
  the proper directories can be specified in LDFLAGS (``-L/sw/lib`` for Fink,
  ``-L/opt/local/lib`` for DarwinPorts) and CPPFLAGS (``-I/sw/include`` for
  Fink, ``-I/opt/local/include`` for DarwinPorts).

3162 3163 3164 3165 3166
- Test in configure.in that checks for tzset no longer dependent on tm->tm_zone
  to exist in the struct (not required by either ISO C nor the UNIX 2 spec).
  Tests for sanity in tzname when HAVE_TZNAME defined were also defined.
  Closes bug #1096244.  Thanks Gregory Bond.

3167 3168 3169
C API
-----

Tim Peters's avatar
Tim Peters committed
3170 3171 3172 3173 3174 3175 3176 3177 3178 3179 3180
- ``PyMem_{Del, DEL}`` and ``PyMem_{Free, FREE}`` no longer map to
  ``PyObject_{Free, FREE}``.  They map to the system ``free()`` now.  If memory
  is obtained via the ``PyObject_`` family, it must be released via the
  ``PyObject_`` family, and likewise for the ``PyMem_`` family.  This has
  always been officially true, but when Python's small-object allocator was
  introduced, an attempt was made to cater to a few extension modules
  discovered at the time that obtained memory via ``PyObject_New`` but
  released it via ``PyMem_DEL``.  It's years later, and if such code still
  exists it will fail now (probably with segfaults, but calling wrong
  low-level memory management functions can yield many symptoms).

3181 3182
- Added a C API for set and frozenset objects.

Raymond Hettinger's avatar
Raymond Hettinger committed
3183 3184
- Removed PyRange_New().

3185 3186 3187 3188 3189
- Patch #1313939: PyUnicode_DecodeCharmap() accepts a unicode string as the
  mapping argument now. This string is used as a mapping table. Byte values
  greater than the length of the string and 0xFFFE are treated as undefined
  mappings.

3190 3191 3192 3193

Tests
-----

3194
- In test_os, st_?time is now truncated before comparing it with ST_?TIME.
3195

3196 3197 3198
- Patch #1276356: New resource "urlfetch" is implemented.  This enables
  even impatient people to run tests that require remote files.

3199 3200 3201 3202

Documentation
-------------

3203 3204
- Bug #1402224: Add warning to dl docs about crashes.

3205 3206 3207
- Bug #1396471: Document that Windows' ftell() can return invalid
  values for text files with UNIX-style line endings.

3208 3209
- Bug #1274828: Document os.path.splitunc().

3210 3211
- Bug #1190204: Clarify which directories are searched by site.py.

3212 3213
- Bug #1193849: Clarify os.path.expanduser() documentation.

3214 3215
- Bug #1243192: re.UNICODE and re.LOCALE affect \d, \D, \s and \S.

3216 3217
- Bug #755617: Document the effects of os.chown() on Windows.

3218 3219 3220 3221 3222 3223 3224 3225
- Patch #1180012: The documentation for modulefinder is now in the library reference.

- Patch #1213031: Document that os.chown() accepts argument values of -1.

- Bug #1190563: Document os.waitpid() return value with WNOHANG flag.

- Bug #1175022: Correct the example code for property().

Georg Brandl's avatar
Georg Brandl committed
3226 3227 3228
- Document the IterableUserDict class in the UserDict module.
  Closes bug #1166582.

3229 3230 3231 3232
- Remove all latent references for "Macintosh" that referred to semantics for
  Mac OS 9 and change to reflect the state for OS X.
  Closes patch #1095802.  Thanks Jack Jansen.

3233 3234 3235 3236
Mac
---


Hye-Shik Chang's avatar
Hye-Shik Chang committed
3237 3238 3239 3240 3241
New platforms
-------------

- FreeBSD 7 support is added.

3242 3243 3244 3245

Tools/Demos
-----------

3246 3247 3248 3249
- Created Misc/Vim/vim_syntax.py to auto-generate a python.vim file in that
  directory for syntax highlighting in Vim.  Vim directory was added and placed
  vimrc to it (was previous up a level).

3250 3251 3252 3253 3254
- Added two new files to Tools/scripts: pysource.py, which recursively
  finds Python source files, and findnocoding.py, which finds Python
  source files that need an encoding declaration.
  Patch #784089, credits to Oleg Broytmann.

3255 3256
- Bug #1072853: pindent.py used an uninitialized variable.

3257
- Patch #1177597: Correct Complex.__init__.
3258

Barry Warsaw's avatar
Barry Warsaw committed
3259 3260
- Fixed a display glitch in Pynche, which could cause the right arrow to
  wiggle over by a pixel.
3261

3262 3263 3264
----

**(For information about older versions, consult the HISTORY file.)**