logging.rst 43.8 KB
Newer Older
1 2 3 4
:mod:`logging` --- Logging facility for Python
==============================================

.. module:: logging
5
   :synopsis: Flexible event logging system for applications.
6 7 8 9 10 11 12 13


.. moduleauthor:: Vinay Sajip <vinay_sajip@red-dove.com>
.. sectionauthor:: Vinay Sajip <vinay_sajip@red-dove.com>


.. index:: pair: Errors; logging

14
.. sidebar:: Important
15

16 17
   This page contains the API reference information. For tutorial
   information and discussion of more advanced topics, see
18

19 20 21
   * :ref:`Basic Tutorial <logging-basic-tutorial>`
   * :ref:`Advanced Tutorial <logging-advanced-tutorial>`
   * :ref:`Logging Cookbook <logging-cookbook>`
22

23 24 25
**Source code:** :source:`Lib/logging/__init__.py`

--------------
26

27
.. versionadded:: 2.3
28

29 30
This module defines functions and classes which implement a flexible event
logging system for applications and libraries.
31 32 33

The key benefit of having the logging API provided by a standard library module
is that all Python modules can participate in logging, so your application log
34 35
can include your own messages integrated with messages from third-party
modules.
36

37 38 39
The module provides a lot of functionality and flexibility.  If you are
unfamiliar with logging, the best way to get to grips with it is to see the
tutorials (see the links on the right).
40

41 42
The basic classes defined by the module, together with their functions, are
listed below.
43

44 45 46 47 48 49
* Loggers expose the interface that application code directly uses.
* Handlers send the log records (created by loggers) to the appropriate
  destination.
* Filters provide a finer grained facility for determining which log records
  to output.
* Formatters specify the layout of log records in the final output.
50 51


52
.. _logger:
53

54 55
Logger Objects
--------------
56

57
Loggers have the following attributes and methods.  Note that Loggers are never
58
instantiated directly, but always through the module-level function
59 60 61 62 63 64 65 66 67 68 69 70 71
``logging.getLogger(name)``.  Multiple calls to :func:`getLogger` with the same
name will always return a reference to the same Logger object.

The ``name`` is potentially a period-separated hierarchical value, like
``foo.bar.baz`` (though it could also be just plain ``foo``, for example).
Loggers that are further down in the hierarchical list are children of loggers
higher up in the list.  For example, given a logger with a name of ``foo``,
loggers with names of ``foo.bar``, ``foo.bar.baz``, and ``foo.bam`` are all
descendants of ``foo``.  The logger name hierarchy is analogous to the Python
package hierarchy, and identical to it if you organise your loggers on a
per-module basis using the recommended construction
``logging.getLogger(__name__)``.  That's because in a module, ``__name__``
is the module's name in the Python package namespace.
72

73

74
.. class:: Logger
75

76
.. attribute:: Logger.propagate
77

78 79 80 81 82
   If this evaluates to true, events logged to this logger will be passed to the
   handlers of higher level (ancestor) loggers, in addition to any handlers
   attached to this logger. Messages are passed directly to the ancestor
   loggers' handlers - neither the level nor filters of the ancestor loggers in
   question are considered.
83 84 85 86

   If this evaluates to false, logging messages are not passed to the handlers
   of ancestor loggers.

Benjamin Peterson's avatar
Benjamin Peterson committed
87
   The constructor sets this attribute to ``True``.
88

89 90 91 92 93 94 95 96
   .. note:: If you attach a handler to a logger *and* one or more of its
      ancestors, it may emit the same record multiple times. In general, you
      should not need to attach a handler to more than one logger - if you just
      attach it to the appropriate logger which is highest in the logger
      hierarchy, then it will see all events logged by all descendant loggers,
      provided that their propagate setting is left set to ``True``. A common
      scenario is to attach handlers only to the root logger, and to let
      propagation take care of the rest.
97

98
.. method:: Logger.setLevel(lvl)
99

100 101 102 103 104
   Sets the threshold for this logger to *lvl*. Logging messages which are less
   severe than *lvl* will be ignored. When a logger is created, the level is set to
   :const:`NOTSET` (which causes all messages to be processed when the logger is
   the root logger, or delegation to the parent when the logger is a non-root
   logger). Note that the root logger is created with level :const:`WARNING`.
105

106 107 108
   The term 'delegation to the parent' means that if a logger has a level of
   NOTSET, its chain of ancestor loggers is traversed until either an ancestor with
   a level other than NOTSET is found, or the root is reached.
109

110 111 112
   If an ancestor is found with a level other than NOTSET, then that ancestor's
   level is treated as the effective level of the logger where the ancestor search
   began, and is used to determine how a logging event is handled.
113

114 115
   If the root is reached, and it has a level of NOTSET, then all messages will be
   processed. Otherwise, the root's level will be used as the effective level.
116 117


118
.. method:: Logger.isEnabledFor(lvl)
119

120 121 122 123
   Indicates if a message of severity *lvl* would be processed by this logger.
   This method checks first the module-level level set by
   ``logging.disable(lvl)`` and then the logger's effective level as determined
   by :meth:`getEffectiveLevel`.
124 125


126
.. method:: Logger.getEffectiveLevel()
127

128 129 130 131
   Indicates the effective level for this logger. If a value other than
   :const:`NOTSET` has been set using :meth:`setLevel`, it is returned. Otherwise,
   the hierarchy is traversed towards the root until a value other than
   :const:`NOTSET` is found, and that value is returned.
132 133


134
.. method:: Logger.getChild(suffix)
135

136 137 138 139 140
   Returns a logger which is a descendant to this logger, as determined by the suffix.
   Thus, ``logging.getLogger('abc').getChild('def.ghi')`` would return the same
   logger as would be returned by ``logging.getLogger('abc.def.ghi')``. This is a
   convenience method, useful when the parent logger is named using e.g. ``__name__``
   rather than a literal string.
141

142
   .. versionadded:: 2.7
143 144


145
.. method:: Logger.debug(msg, *args, **kwargs)
146

147 148 149 150
   Logs a message with level :const:`DEBUG` on this logger. The *msg* is the
   message format string, and the *args* are the arguments which are merged into
   *msg* using the string formatting operator. (Note that this means that you can
   use keywords in the format string, together with a single dictionary argument.)
151

152 153 154 155 156
   There are two keyword arguments in *kwargs* which are inspected: *exc_info*
   which, if it does not evaluate as false, causes exception information to be
   added to the logging message. If an exception tuple (in the format returned by
   :func:`sys.exc_info`) is provided, it is used; otherwise, :func:`sys.exc_info`
   is called to get the exception information.
157

158 159 160 161 162
   The second keyword argument is *extra* which can be used to pass a
   dictionary which is used to populate the __dict__ of the LogRecord created for
   the logging event with user-defined attributes. These custom attributes can then
   be used as you like. For example, they could be incorporated into logged
   messages. For example::
163

164 165
      FORMAT = '%(asctime)-15s %(clientip)s %(user)-8s %(message)s'
      logging.basicConfig(format=FORMAT)
166
      d = {'clientip': '192.168.0.1', 'user': 'fbloggs'}
167 168
      logger = logging.getLogger('tcpserver')
      logger.warning('Protocol problem: %s', 'connection reset', extra=d)
169

170
   would print something like  ::
171

172
      2006-02-08 22:20:02,165 192.168.0.1 fbloggs  Protocol problem: connection reset
173

174 175 176
   The keys in the dictionary passed in *extra* should not clash with the keys used
   by the logging system. (See the :class:`Formatter` documentation for more
   information on which keys are used by the logging system.)
177

178 179 180 181 182 183
   If you choose to use these attributes in logged messages, you need to exercise
   some care. In the above example, for instance, the :class:`Formatter` has been
   set up with a format string which expects 'clientip' and 'user' in the attribute
   dictionary of the LogRecord. If these are missing, the message will not be
   logged because a string formatting exception will occur. So in this case, you
   always need to pass the *extra* dictionary with these keys.
184

185 186 187 188 189 190
   While this might be annoying, this feature is intended for use in specialized
   circumstances, such as multi-threaded servers where the same code executes in
   many contexts, and interesting conditions which arise are dependent on this
   context (such as remote client IP address and authenticated user name, in the
   above example). In such circumstances, it is likely that specialized
   :class:`Formatter`\ s would be used with particular :class:`Handler`\ s.
191

192

193
.. method:: Logger.info(msg, *args, **kwargs)
194

195 196
   Logs a message with level :const:`INFO` on this logger. The arguments are
   interpreted as for :meth:`debug`.
197

198

199
.. method:: Logger.warning(msg, *args, **kwargs)
200

201 202
   Logs a message with level :const:`WARNING` on this logger. The arguments are
   interpreted as for :meth:`debug`.
203

204

205
.. method:: Logger.error(msg, *args, **kwargs)
206

207 208
   Logs a message with level :const:`ERROR` on this logger. The arguments are
   interpreted as for :meth:`debug`.
209 210


211
.. method:: Logger.critical(msg, *args, **kwargs)
212

213 214
   Logs a message with level :const:`CRITICAL` on this logger. The arguments are
   interpreted as for :meth:`debug`.
215 216


217
.. method:: Logger.log(lvl, msg, *args, **kwargs)
218

219 220
   Logs a message with integer level *lvl* on this logger. The other arguments are
   interpreted as for :meth:`debug`.
221 222


223
.. method:: Logger.exception(msg, *args)
224

225 226 227
   Logs a message with level :const:`ERROR` on this logger. The arguments are
   interpreted as for :meth:`debug`. Exception info is added to the logging
   message. This method should only be called from an exception handler.
228

229

230
.. method:: Logger.addFilter(filt)
231

232
   Adds the specified filter *filt* to this logger.
233 234


235
.. method:: Logger.removeFilter(filt)
236

237
   Removes the specified filter *filt* from this logger.
238 239


240
.. method:: Logger.filter(record)
241

242
   Applies this logger's filters to the record and returns a true value if the
243 244 245 246
   record is to be processed. The filters are consulted in turn, until one of
   them returns a false value. If none of them return a false value, the record
   will be processed (passed to handlers). If one returns a false value, no
   further processing of the record occurs.
247 248


249
.. method:: Logger.addHandler(hdlr)
250

251
   Adds the specified handler *hdlr* to this logger.
252 253


254
.. method:: Logger.removeHandler(hdlr)
255

256
   Removes the specified handler *hdlr* from this logger.
257 258


259
.. method:: Logger.findCaller()
260

261 262
   Finds the caller's source filename and line number. Returns the filename, line
   number and function name as a 3-element tuple.
263

264 265 266
   .. versionchanged:: 2.4
      The function name was added. In earlier versions, the filename and line
      number were returned as a 2-element tuple.
267

268
.. method:: Logger.handle(record)
269

270 271 272 273
   Handles a record by passing it to all handlers associated with this logger and
   its ancestors (until a false value of *propagate* is found). This method is used
   for unpickled records received from a socket, as well as those created locally.
   Logger-level filtering is applied using :meth:`~Logger.filter`.
274 275


276
.. method:: Logger.makeRecord(name, lvl, fn, lno, msg, args, exc_info, func=None, extra=None)
277

278 279
   This is a factory method which can be overridden in subclasses to create
   specialized :class:`LogRecord` instances.
280

281 282
   .. versionchanged:: 2.5
      *func* and *extra* were added.
283

284
.. _handler:
285

286 287
Handler Objects
---------------
288

289 290 291 292
Handlers have the following attributes and methods. Note that :class:`Handler`
is never instantiated directly; this class acts as a base for more useful
subclasses. However, the :meth:`__init__` method in subclasses needs to call
:meth:`Handler.__init__`.
293 294


295
.. method:: Handler.__init__(level=NOTSET)
296

297 298 299
   Initializes the :class:`Handler` instance by setting its level, setting the list
   of filters to the empty list and creating a lock (using :meth:`createLock`) for
   serializing access to an I/O mechanism.
300 301


302
.. method:: Handler.createLock()
303

304 305
   Initializes a thread lock which can be used to serialize access to underlying
   I/O functionality which may not be threadsafe.
306 307


308
.. method:: Handler.acquire()
309

310
   Acquires the thread lock created with :meth:`createLock`.
311 312


313
.. method:: Handler.release()
314

315
   Releases the thread lock acquired with :meth:`acquire`.
316 317


318
.. method:: Handler.setLevel(lvl)
319

320 321 322
   Sets the threshold for this handler to *lvl*. Logging messages which are less
   severe than *lvl* will be ignored. When a handler is created, the level is set
   to :const:`NOTSET` (which causes all messages to be processed).
323 324


325
.. method:: Handler.setFormatter(form)
326

327
   Sets the :class:`Formatter` for this handler to *form*.
328 329


330
.. method:: Handler.addFilter(filt)
331

332
   Adds the specified filter *filt* to this handler.
333 334


335
.. method:: Handler.removeFilter(filt)
336

337
   Removes the specified filter *filt* from this handler.
338 339


340
.. method:: Handler.filter(record)
341

342
   Applies this handler's filters to the record and returns a true value if the
343 344 345 346
   record is to be processed. The filters are consulted in turn, until one of
   them returns a false value. If none of them return a false value, the record
   will be emitted. If one returns a false value, the handler will not emit the
   record.
347 348


349
.. method:: Handler.flush()
350 351 352 353 354 355 356

   Ensure all logging output has been flushed. This version does nothing and is
   intended to be implemented by subclasses.


.. method:: Handler.close()

357 358 359 360
   Tidy up any resources used by the handler. This version does no output but
   removes the handler from an internal list of handlers which is closed when
   :func:`shutdown` is called. Subclasses should ensure that this gets called
   from overridden :meth:`close` methods.
361 362 363 364 365 366 367 368 369 370 371 372


.. method:: Handler.handle(record)

   Conditionally emits the specified logging record, depending on filters which may
   have been added to the handler. Wraps the actual emission of the record with
   acquisition/release of the I/O thread lock.


.. method:: Handler.handleError(record)

   This method should be called from handlers when an exception is encountered
373 374 375 376 377 378 379 380
   during an :meth:`emit` call. If the module-level attribute
   ``raiseExceptions`` is ``False``, exceptions get silently ignored. This is
   what is mostly wanted for a logging system - most users will not care about
   errors in the logging system, they are more interested in application
   errors. You could, however, replace this with a custom handler if you wish.
   The specified record is the one which was being processed when the exception
   occurred. (The default value of ``raiseExceptions`` is ``True``, as that is
   more useful during development).
381 382 383 384 385 386 387 388 389 390 391 392 393 394


.. method:: Handler.format(record)

   Do formatting for a record - if a formatter is set, use it. Otherwise, use the
   default formatter for the module.


.. method:: Handler.emit(record)

   Do whatever it takes to actually log the specified logging record. This version
   is intended to be implemented by subclasses and so raises a
   :exc:`NotImplementedError`.

395
For a list of handlers included as standard, see :mod:`logging.handlers`.
396

397
.. _formatter-objects:
398

399 400 401
Formatter Objects
-----------------

402 403
.. currentmodule:: logging

404
:class:`Formatter` objects have the following attributes and methods. They are
405 406 407 408 409 410 411 412 413
responsible for converting a :class:`LogRecord` to (usually) a string which can
be interpreted by either a human or an external system. The base
:class:`Formatter` allows a formatting string to be specified. If none is
supplied, the default value of ``'%(message)s'`` is used.

A Formatter can be initialized with a format string which makes use of knowledge
of the :class:`LogRecord` attributes - such as the default value mentioned above
making use of the fact that the user's message and arguments are pre-formatted
into a :class:`LogRecord`'s *message* attribute.  This format string contains
414
standard Python %-style mapping keys. See section :ref:`string-formatting`
415 416
for more information on string formatting.

417 418
The useful mapping keys in a :class:`LogRecord` are given in the section on
:ref:`logrecord-attributes`.
419

420

421
.. class:: Formatter(fmt=None, datefmt=None)
422

423
   Returns a new instance of the :class:`Formatter` class.  The instance is
424
   initialized with a format string for the message as a whole, as well as a
425 426
   format string for the date/time portion of a message.  If no *fmt* is
   specified, ``'%(message)s'`` is used.  If no *datefmt* is specified, the
427
   ISO8601 date format is used.
428

429
   .. method:: format(record)
430

431 432 433 434 435 436 437 438 439 440 441 442 443 444 445
      The record's attribute dictionary is used as the operand to a string
      formatting operation. Returns the resulting string. Before formatting the
      dictionary, a couple of preparatory steps are carried out. The *message*
      attribute of the record is computed using *msg* % *args*. If the
      formatting string contains ``'(asctime)'``, :meth:`formatTime` is called
      to format the event time. If there is exception information, it is
      formatted using :meth:`formatException` and appended to the message. Note
      that the formatted exception information is cached in attribute
      *exc_text*. This is useful because the exception information can be
      pickled and sent across the wire, but you should be careful if you have
      more than one :class:`Formatter` subclass which customizes the formatting
      of exception information. In this case, you will have to clear the cached
      value after a formatter has done its formatting, so that the next
      formatter to handle the event doesn't use the cached value but
      recalculates it afresh.
446 447


448
   .. method:: formatTime(record, datefmt=None)
449

450 451 452 453 454 455 456
      This method should be called from :meth:`format` by a formatter which
      wants to make use of a formatted time. This method can be overridden in
      formatters to provide for any specific requirement, but the basic behavior
      is as follows: if *datefmt* (a string) is specified, it is used with
      :func:`time.strftime` to format the creation time of the
      record. Otherwise, the ISO8601 format is used.  The resulting string is
      returned.
457

458 459 460 461 462 463 464
      This function uses a user-configurable function to convert the creation
      time to a tuple. By default, :func:`time.localtime` is used; to change
      this for a particular formatter instance, set the ``converter`` attribute
      to a function with the same signature as :func:`time.localtime` or
      :func:`time.gmtime`. To change it for all formatters, for example if you
      want all logging times to be shown in GMT, set the ``converter``
      attribute in the ``Formatter`` class.
465

466
   .. method:: formatException(exc_info)
467

468 469 470 471
      Formats the specified exception information (a standard exception tuple as
      returned by :func:`sys.exc_info`) as a string. This default implementation
      just uses :func:`traceback.print_exception`. The resulting string is
      returned.
472

473
.. _filter:
474 475 476 477

Filter Objects
--------------

478 479 480 481 482 483
``Filters`` can be used by ``Handlers`` and ``Loggers`` for more sophisticated
filtering than is provided by levels. The base filter class only allows events
which are below a certain point in the logger hierarchy. For example, a filter
initialized with 'A.B' will allow events logged by loggers 'A.B', 'A.B.C',
'A.B.C.D', 'A.B.D' etc. but not 'A.BB', 'B.A.B' etc. If initialized with the
empty string, all events are passed.
484 485


486
.. class:: Filter(name='')
487 488 489

   Returns an instance of the :class:`Filter` class. If *name* is specified, it
   names a logger which, together with its children, will have its events allowed
490
   through the filter. If *name* is the empty string, allows every event.
491 492


493
   .. method:: filter(record)
494

495 496 497
      Is the specified record to be logged? Returns zero for no, nonzero for
      yes. If deemed appropriate, the record may be modified in-place by this
      method.
498

499
Note that filters attached to handlers are consulted before an event is
500
emitted by the handler, whereas filters attached to loggers are consulted
501 502 503 504
whenever an event is logged (using :meth:`debug`, :meth:`info`,
etc.), before sending an event to handlers. This means that events which have
been generated by descendant loggers will not be filtered by a logger's filter
setting, unless the filter has also been applied to those descendant loggers.
505

506 507 508
You don't actually need to subclass ``Filter``: you can pass any instance
which has a ``filter`` method with the same semantics.

Vinay Sajip's avatar
Vinay Sajip committed
509 510 511 512 513 514 515 516 517
Although filters are used primarily to filter records based on more
sophisticated criteria than levels, they get to see every record which is
processed by the handler or logger they're attached to: this can be useful if
you want to do things like counting how many records were processed by a
particular logger or handler, or adding, changing or removing attributes in
the LogRecord being processed. Obviously changing the LogRecord needs to be
done with some care, but it does allow the injection of contextual information
into logs (see :ref:`filters-contextual`).

518
.. _log-record:
519 520 521 522

LogRecord Objects
-----------------

523 524 525 526
:class:`LogRecord` instances are created automatically by the :class:`Logger`
every time something is logged, and can be created manually via
:func:`makeLogRecord` (for example, from a pickled event received over the
wire).
527 528


529
.. class:: LogRecord(name, level, pathname, lineno, msg, args, exc_info, func=None)
530

531
   Contains all the information pertinent to the event being logged.
532

533 534 535
   The primary information is passed in :attr:`msg` and :attr:`args`, which
   are combined using ``msg % args`` to create the :attr:`message` field of the
   record.
536

537
   :param name:  The name of the logger used to log the event represented by
538 539 540
                 this LogRecord. Note that this name will always have this
                 value, even though it may be emitted by a handler attached to
                 a different (ancestor) logger.
541
   :param level: The numeric level of the logging event (one of DEBUG, INFO etc.)
542 543 544
                 Note that this is converted to *two* attributes of the LogRecord:
                 ``levelno`` for the numeric value and ``levelname`` for the
                 corresponding level name.
545 546 547 548 549 550 551 552 553 554 555 556
   :param pathname: The full pathname of the source file where the logging call
                    was made.
   :param lineno: The line number in the source file where the logging call was
                  made.
   :param msg: The event description message, possibly a format string with
               placeholders for variable data.
   :param args: Variable data to merge into the *msg* argument to obtain the
                event description.
   :param exc_info: An exception tuple with the current exception information,
                    or *None* if no exception information is available.
   :param func: The name of the function or method from which the logging call
                was invoked.
557

558 559
   .. versionchanged:: 2.5
      *func* was added.
560

561 562 563
   .. method:: getMessage()

      Returns the message for this :class:`LogRecord` instance after merging any
564 565 566 567 568 569
      user-supplied arguments with the message. If the user-supplied message
      argument to the logging call is not a string, :func:`str` is called on it to
      convert it to a string. This allows use of user-defined classes as
      messages, whose ``__str__`` method can return the actual format string to
      be used.

570

571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651
.. _logrecord-attributes:

LogRecord attributes
--------------------

The LogRecord has a number of attributes, most of which are derived from the
parameters to the constructor. (Note that the names do not always correspond
exactly between the LogRecord constructor parameters and the LogRecord
attributes.) These attributes can be used to merge data from the record into
the format string. The following table lists (in alphabetical order) the
attribute names, their meanings and the corresponding placeholder in a %-style
format string.

+----------------+-------------------------+-----------------------------------------------+
| Attribute name | Format                  | Description                                   |
+================+=========================+===============================================+
| args           | You shouldn't need to   | The tuple of arguments merged into ``msg`` to |
|                | format this yourself.   | produce ``message``.                          |
+----------------+-------------------------+-----------------------------------------------+
| asctime        | ``%(asctime)s``         | Human-readable time when the                  |
|                |                         | :class:`LogRecord` was created.  By default   |
|                |                         | this is of the form '2003-07-08 16:49:45,896' |
|                |                         | (the numbers after the comma are millisecond  |
|                |                         | portion of the time).                         |
+----------------+-------------------------+-----------------------------------------------+
| created        | ``%(created)f``         | Time when the :class:`LogRecord` was created  |
|                |                         | (as returned by :func:`time.time`).           |
+----------------+-------------------------+-----------------------------------------------+
| exc_info       | You shouldn't need to   | Exception tuple (à la ``sys.exc_info``) or,   |
|                | format this yourself.   | if no exception has occurred, *None*.         |
+----------------+-------------------------+-----------------------------------------------+
| filename       | ``%(filename)s``        | Filename portion of ``pathname``.             |
+----------------+-------------------------+-----------------------------------------------+
| funcName       | ``%(funcName)s``        | Name of function containing the logging call. |
+----------------+-------------------------+-----------------------------------------------+
| levelname      | ``%(levelname)s``       | Text logging level for the message            |
|                |                         | (``'DEBUG'``, ``'INFO'``, ``'WARNING'``,      |
|                |                         | ``'ERROR'``, ``'CRITICAL'``).                 |
+----------------+-------------------------+-----------------------------------------------+
| levelno        | ``%(levelno)s``         | Numeric logging level for the message         |
|                |                         | (:const:`DEBUG`, :const:`INFO`,               |
|                |                         | :const:`WARNING`, :const:`ERROR`,             |
|                |                         | :const:`CRITICAL`).                           |
+----------------+-------------------------+-----------------------------------------------+
| lineno         | ``%(lineno)d``          | Source line number where the logging call was |
|                |                         | issued (if available).                        |
+----------------+-------------------------+-----------------------------------------------+
| module         | ``%(module)s``          | Module (name portion of ``filename``).        |
+----------------+-------------------------+-----------------------------------------------+
| msecs          | ``%(msecs)d``           | Millisecond portion of the time when the      |
|                |                         | :class:`LogRecord` was created.               |
+----------------+-------------------------+-----------------------------------------------+
| message        | ``%(message)s``         | The logged message, computed as ``msg %       |
|                |                         | args``. This is set when                      |
|                |                         | :meth:`Formatter.format` is invoked.          |
+----------------+-------------------------+-----------------------------------------------+
| msg            | You shouldn't need to   | The format string passed in the original      |
|                | format this yourself.   | logging call. Merged with ``args`` to         |
|                |                         | produce ``message``, or an arbitrary object   |
|                |                         | (see :ref:`arbitrary-object-messages`).       |
+----------------+-------------------------+-----------------------------------------------+
| name           | ``%(name)s``            | Name of the logger used to log the call.      |
+----------------+-------------------------+-----------------------------------------------+
| pathname       | ``%(pathname)s``        | Full pathname of the source file where the    |
|                |                         | logging call was issued (if available).       |
+----------------+-------------------------+-----------------------------------------------+
| process        | ``%(process)d``         | Process ID (if available).                    |
+----------------+-------------------------+-----------------------------------------------+
| processName    | ``%(processName)s``     | Process name (if available).                  |
+----------------+-------------------------+-----------------------------------------------+
| relativeCreated| ``%(relativeCreated)d`` | Time in milliseconds when the LogRecord was   |
|                |                         | created, relative to the time the logging     |
|                |                         | module was loaded.                            |
+----------------+-------------------------+-----------------------------------------------+
| thread         | ``%(thread)d``          | Thread ID (if available).                     |
+----------------+-------------------------+-----------------------------------------------+
| threadName     | ``%(threadName)s``      | Thread name (if available).                   |
+----------------+-------------------------+-----------------------------------------------+

.. versionchanged:: 2.5
   *funcName* was added.
Georg Brandl's avatar
Georg Brandl committed
652

653 654 655
.. versionchanged:: 2.6
   *processName* was added.

656
.. _logger-adapter:
657

658 659 660 661
LoggerAdapter Objects
---------------------

:class:`LoggerAdapter` instances are used to conveniently pass contextual
662
information into logging calls. For a usage example , see the section on
Georg Brandl's avatar
Georg Brandl committed
663
:ref:`adding contextual information to your logging output <context-info>`.
664

665 666
.. versionadded:: 2.6

667 668 669

.. class:: LoggerAdapter(logger, extra)

Georg Brandl's avatar
Georg Brandl committed
670 671
   Returns an instance of :class:`LoggerAdapter` initialized with an
   underlying :class:`Logger` instance and a dict-like object.
672

Georg Brandl's avatar
Georg Brandl committed
673
   .. method:: process(msg, kwargs)
674

Georg Brandl's avatar
Georg Brandl committed
675 676 677 678 679
      Modifies the message and/or keyword arguments passed to a logging call in
      order to insert contextual information. This implementation takes the object
      passed as *extra* to the constructor and adds it to *kwargs* using key
      'extra'. The return value is a (*msg*, *kwargs*) tuple which has the
      (possibly modified) versions of the arguments passed in.
680

681
In addition to the above, :class:`LoggerAdapter` supports the following
682 683 684 685 686
methods of :class:`Logger`: :meth:`~Logger.debug`, :meth:`~Logger.info`,
:meth:`~Logger.warning`, :meth:`~Logger.error`, :meth:`~Logger.exception`,
:meth:`~Logger.critical`, :meth:`~Logger.log` and :meth:`~Logger.isEnabledFor`.
These methods have the same signatures as their counterparts in :class:`Logger`,
so you can use the two types of instances interchangeably for these calls.
687

688
.. versionchanged:: 2.7
689 690
   The :meth:`~Logger.isEnabledFor` method was added to :class:`LoggerAdapter`.
   This method delegates to the underlying logger.
691

692 693 694 695 696 697 698 699 700

Thread Safety
-------------

The logging module is intended to be thread-safe without any special work
needing to be done by its clients. It achieves this though using threading
locks; there is one lock to serialize access to the module's shared data, and
each handler also creates a lock to serialize access to its underlying I/O.

701 702 703 704
If you are implementing asynchronous signal handlers using the :mod:`signal`
module, you may not be able to use logging from within such handlers. This is
because lock implementations in the :mod:`threading` module are not always
re-entrant, and so cannot be invoked from such signal handlers.
705

706

707 708
Module-Level Functions
----------------------
709

710 711
In addition to the classes described above, there are a number of module- level
functions.
712 713


714
.. function:: getLogger([name])
715

716 717 718 719
   Return a logger with the specified name or, if no name is specified, return a
   logger which is the root logger of the hierarchy. If specified, the name is
   typically a dot-separated hierarchical name like *"a"*, *"a.b"* or *"a.b.c.d"*.
   Choice of these names is entirely up to the developer who is using logging.
720

721 722 723
   All calls to this function with a given name return the same logger instance.
   This means that logger instances never need to be passed between different parts
   of an application.
724 725


726 727 728 729
.. function:: getLoggerClass()

   Return either the standard :class:`Logger` class, or the last class passed to
   :func:`setLoggerClass`. This function may be called from within a new class
730 731
   definition, to ensure that installing a customized :class:`Logger` class will
   not undo customizations already applied by other code. For example::
732 733 734

      class MyLogger(logging.getLoggerClass()):
          # ... override behaviour here
735 736


737
.. function:: debug(msg[, *args[, **kwargs]])
738

739 740 741 742
   Logs a message with level :const:`DEBUG` on the root logger. The *msg* is the
   message format string, and the *args* are the arguments which are merged into
   *msg* using the string formatting operator. (Note that this means that you can
   use keywords in the format string, together with a single dictionary argument.)
743

744 745 746 747 748
   There are two keyword arguments in *kwargs* which are inspected: *exc_info*
   which, if it does not evaluate as false, causes exception information to be
   added to the logging message. If an exception tuple (in the format returned by
   :func:`sys.exc_info`) is provided, it is used; otherwise, :func:`sys.exc_info`
   is called to get the exception information.
749

750 751 752 753 754
   The other optional keyword argument is *extra* which can be used to pass a
   dictionary which is used to populate the __dict__ of the LogRecord created for
   the logging event with user-defined attributes. These custom attributes can then
   be used as you like. For example, they could be incorporated into logged
   messages. For example::
755

756 757 758 759
      FORMAT = "%(asctime)-15s %(clientip)s %(user)-8s %(message)s"
      logging.basicConfig(format=FORMAT)
      d = {'clientip': '192.168.0.1', 'user': 'fbloggs'}
      logging.warning("Protocol problem: %s", "connection reset", extra=d)
760

761
   would print something like::
762

763
      2006-02-08 22:20:02,165 192.168.0.1 fbloggs  Protocol problem: connection reset
764

765 766 767
   The keys in the dictionary passed in *extra* should not clash with the keys used
   by the logging system. (See the :class:`Formatter` documentation for more
   information on which keys are used by the logging system.)
768

769 770 771 772 773 774
   If you choose to use these attributes in logged messages, you need to exercise
   some care. In the above example, for instance, the :class:`Formatter` has been
   set up with a format string which expects 'clientip' and 'user' in the attribute
   dictionary of the LogRecord. If these are missing, the message will not be
   logged because a string formatting exception will occur. So in this case, you
   always need to pass the *extra* dictionary with these keys.
775

776 777 778 779 780 781
   While this might be annoying, this feature is intended for use in specialized
   circumstances, such as multi-threaded servers where the same code executes in
   many contexts, and interesting conditions which arise are dependent on this
   context (such as remote client IP address and authenticated user name, in the
   above example). In such circumstances, it is likely that specialized
   :class:`Formatter`\ s would be used with particular :class:`Handler`\ s.
782

783 784
   .. versionchanged:: 2.5
      *extra* was added.
785

786

787
.. function:: info(msg[, *args[, **kwargs]])
788

789 790
   Logs a message with level :const:`INFO` on the root logger. The arguments are
   interpreted as for :func:`debug`.
791 792


793
.. function:: warning(msg[, *args[, **kwargs]])
794

795 796
   Logs a message with level :const:`WARNING` on the root logger. The arguments are
   interpreted as for :func:`debug`.
797

798

799
.. function:: error(msg[, *args[, **kwargs]])
800

801 802
   Logs a message with level :const:`ERROR` on the root logger. The arguments are
   interpreted as for :func:`debug`.
803 804


805
.. function:: critical(msg[, *args[, **kwargs]])
806

807 808
   Logs a message with level :const:`CRITICAL` on the root logger. The arguments
   are interpreted as for :func:`debug`.
809 810


811
.. function:: exception(msg[, *args])
812

813 814 815
   Logs a message with level :const:`ERROR` on the root logger. The arguments are
   interpreted as for :func:`debug`. Exception info is added to the logging
   message. This function should only be called from an exception handler.
816 817


818
.. function:: log(level, msg[, *args[, **kwargs]])
819

820 821
   Logs a message with level *level* on the root logger. The other arguments are
   interpreted as for :func:`debug`.
822

823 824 825 826 827 828 829 830
   .. note:: The above module-level functions which delegate to the root
      logger should *not* be used in threads, in versions of Python earlier
      than 2.7.1 and 3.2, unless at least one handler has been added to the
      root logger *before* the threads are started. These convenience functions
      call :func:`basicConfig` to ensure that at least one handler is
      available; in earlier versions of Python, this can (under rare
      circumstances) lead to handlers being added multiple times to the root
      logger, which can in turn lead to multiple messages for the same event.
831

832
.. function:: disable(lvl)
833

834 835 836 837 838 839
   Provides an overriding level *lvl* for all loggers which takes precedence over
   the logger's own level. When the need arises to temporarily throttle logging
   output down across the whole application, this function can be useful. Its
   effect is to disable all logging calls of severity *lvl* and below, so that
   if you call it with a value of INFO, then all INFO and DEBUG events would be
   discarded, whereas those of severity WARNING and above would be processed
840 841 842 843
   according to the logger's effective level. If
   ``logging.disable(logging.NOTSET)`` is called, it effectively removes this
   overriding level, so that logging output again depends on the effective
   levels of individual loggers.
844

845 846 847 848 849 850 851 852 853 854

.. function:: addLevelName(lvl, levelName)

   Associates level *lvl* with text *levelName* in an internal dictionary, which is
   used to map numeric levels to a textual representation, for example when a
   :class:`Formatter` formats a message. This function can also be used to define
   your own levels. The only constraints are that all levels used must be
   registered using this function, levels should be positive integers and they
   should increase in increasing order of severity.

855 856
   .. note:: If you are thinking of defining your own levels, please see the
      section on :ref:`custom-levels`.
857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890

.. function:: getLevelName(lvl)

   Returns the textual representation of logging level *lvl*. If the level is one
   of the predefined levels :const:`CRITICAL`, :const:`ERROR`, :const:`WARNING`,
   :const:`INFO` or :const:`DEBUG` then you get the corresponding string. If you
   have associated levels with names using :func:`addLevelName` then the name you
   have associated with *lvl* is returned. If a numeric value corresponding to one
   of the defined levels is passed in, the corresponding string representation is
   returned. Otherwise, the string "Level %s" % lvl is returned.


.. function:: makeLogRecord(attrdict)

   Creates and returns a new :class:`LogRecord` instance whose attributes are
   defined by *attrdict*. This function is useful for taking a pickled
   :class:`LogRecord` attribute dictionary, sent over a socket, and reconstituting
   it as a :class:`LogRecord` instance at the receiving end.


.. function:: basicConfig([**kwargs])

   Does basic configuration for the logging system by creating a
   :class:`StreamHandler` with a default :class:`Formatter` and adding it to the
   root logger. The functions :func:`debug`, :func:`info`, :func:`warning`,
   :func:`error` and :func:`critical` will call :func:`basicConfig` automatically
   if no handlers are defined for the root logger.

   This function does nothing if the root logger already has handlers
   configured for it.

   .. versionchanged:: 2.4
      Formerly, :func:`basicConfig` did not take any keyword arguments.

891 892 893 894 895 896
   .. note:: This function should be called from the main thread before other
      threads are started. In versions of Python prior to 2.7.1 and 3.2, if
      this function is called from multiple threads, it is possible (in rare
      circumstances) that a handler will be added to the root logger more than
      once, leading to unexpected results such as messages being duplicated in
      the log.
897 898 899

   The following keyword arguments are supported.

900 901
   .. tabularcolumns:: |l|L|

902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957
   +--------------+---------------------------------------------+
   | Format       | Description                                 |
   +==============+=============================================+
   | ``filename`` | Specifies that a FileHandler be created,    |
   |              | using the specified filename, rather than a |
   |              | StreamHandler.                              |
   +--------------+---------------------------------------------+
   | ``filemode`` | Specifies the mode to open the file, if     |
   |              | filename is specified (if filemode is       |
   |              | unspecified, it defaults to 'a').           |
   +--------------+---------------------------------------------+
   | ``format``   | Use the specified format string for the     |
   |              | handler.                                    |
   +--------------+---------------------------------------------+
   | ``datefmt``  | Use the specified date/time format.         |
   +--------------+---------------------------------------------+
   | ``level``    | Set the root logger level to the specified  |
   |              | level.                                      |
   +--------------+---------------------------------------------+
   | ``stream``   | Use the specified stream to initialize the  |
   |              | StreamHandler. Note that this argument is   |
   |              | incompatible with 'filename' - if both are  |
   |              | present, 'stream' is ignored.               |
   +--------------+---------------------------------------------+


.. function:: shutdown()

   Informs the logging system to perform an orderly shutdown by flushing and
   closing all handlers. This should be called at application exit and no
   further use of the logging system should be made after this call.


.. function:: setLoggerClass(klass)

   Tells the logging system to use the class *klass* when instantiating a logger.
   The class should define :meth:`__init__` such that only a name argument is
   required, and the :meth:`__init__` should call :meth:`Logger.__init__`. This
   function is typically called before any loggers are instantiated by applications
   which need to use custom logger behavior.


Integration with the warnings module
------------------------------------

The :func:`captureWarnings` function can be used to integrate :mod:`logging`
with the :mod:`warnings` module.

.. function:: captureWarnings(capture)

   This function is used to turn the capture of warnings by logging on and
   off.

   If *capture* is ``True``, warnings issued by the :mod:`warnings` module will
   be redirected to the logging system. Specifically, a warning will be
   formatted using :func:`warnings.formatwarning` and the resulting string
958
   logged to a logger named ``'py.warnings'`` with a severity of :const:`WARNING`.
959 960 961

   If *capture* is ``False``, the redirection of warnings to the logging system
   will stop, and warnings will be redirected to their original destinations
962
   (i.e. those in effect before ``captureWarnings(True)`` was called).
963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981


.. seealso::

   Module :mod:`logging.config`
      Configuration API for the logging module.

   Module :mod:`logging.handlers`
      Useful handlers included with the logging module.

   :pep:`282` - A Logging System
      The proposal which described this feature for inclusion in the Python standard
      library.

   `Original Python logging package <http://www.red-dove.com/python_logging.html>`_
      This is the original source for the :mod:`logging` package.  The version of the
      package available from this site is suitable for use with Python 1.5.2, 2.1.x
      and 2.2.x, which do not include the :mod:`logging` package in the standard
      library.
982