Log4j

Apache Log4j is a Java-based logging utility. It was originally written by Ceki Gülcü and is part of the Apache Logging Services project of the Apache Software Foundation. Log4j is one of several Java logging frameworks.

Apache Log4j
Developer(s)Apache Software Foundation
Initial releaseJanuary 8, 2001 (2001-01-08)[1]
Stable release
2.14.0 / November 6, 2020 (2020-11-06)[2]
RepositoryLog4j Repository
Written inJava
Operating systemCross-platform
TypeLogging
LicenseApache License 2.0
Websitelogging.apache.org/log4j/2.x/

Gülcü has since started the SLF4J and Logback[3] projects, with the intention of offering a successor to Log4j.

The Apache Log4j team has created a successor to Log4j 1 with version number 2.[4] Log4j 2 was developed with a focus on the problems of Log4j 1.2, 1.3, java.util.logging and Logback, and addresses issues which appeared in those frameworks.[5] In addition, Log4j 2 offers a plugin architecture which makes it more extensible than its predecessor. Log4j 2 is not backwards compatible with 1.x versions,[6] although an "adapter" is available.

On August 5, 2015 the Apache Logging Services Project Management Committee announced[7] that Log4j 1 had reached end of life and that users of Log4j 1 are recommended to upgrade to Apache Log4j 2.

Apache Log4j 2

Apache Log4j 2 is the successor of Log4j 1 which was released as GA version in July 2014. The framework was rewritten from scratch and has been inspired by existing logging solutions, including Log4j 1 and java.util.logging. The main differences[8][9] from Log4j 1 are:

  • Improved reliability. Messages are not lost while reconfiguring the framework like in Log4j 1 or Logback
  • Extensibility: Log4j 2 supports a plugin system to let users define and configure custom components
  • Simplified configuration syntax
  • Support for xml, json, yaml and properties configurations
  • Improved filters
  • Property lookup support for values defined in the configuration file, system properties, environment variables, the ThreadContext Map, and data present in the event
  • Support for multiple APIs: Log4j 2 can be used with applications using the Log4j 2, Log4j 1.2, SLF4J, Commons Logging and java.util.logging (JUL) APIs.
  • Custom log levels
  • Java 8-style lambda support for "lazy logging"
  • Markers
  • Support for user-defined Message objects
  • "Garbage-free or low garbage" in common configurations
  • Improved speed

One of the most recognized features of Log4j 2 is the performance of the "Asynchronous Loggers".[10] Log4j 2 makes use of the LMAX Disruptor.[11] The library reduces the need for kernel locking and increases the logging performance by a factor of 12. For example, in the same environment Log4j 2 can write more than 18,000,000 messages per second, whereas other frameworks like Logback and Log4j 1 just write < 2,000,000 messages per second.

Log4j log levels

The following table defines the built-in log levels and messages in Log4j, in decreasing order of severity. The left column lists the log level designation in Log4j and the right column provides a brief description of each log level.

Level Description
OFF The highest possible rank and is intended to turn off logging.
FATAL Severe errors that cause premature termination. Expect these to be immediately visible on a status console.
ERROR Other runtime errors or unexpected conditions. Expect these to be immediately visible on a status console.
WARN Use of deprecated APIs, poor use of API, 'almost' errors, other runtime situations that are undesirable or unexpected, but not necessarily "wrong". Expect these to be immediately visible on a status console.
INFO Interesting runtime events (startup/shutdown). Expect these to be immediately visible on a console, so be conservative and keep to a minimum.
DEBUG Detailed information on the flow through the system. Expect these to be written to logs only. Generally speaking, most lines logged by your application should be written as DEBUG.
TRACE Most detailed information. Expect these to be written to logs only. Since version 1.2.12.[12]

Custom log levels

Log4j 2 allows users to define their own log levels.[13] A source code generator tool is provided to create Loggers that support custom log levels identically to the built-in log levels. Custom log levels can either complement or replace the built-in log levels.

Log4j configuration

Log4j can be configured[14] through a configuration file or through Java code. Configuration files can be written in XML, JSON, YAML, or properties file format. Within a configuration you can define three main components: Loggers, Appenders and Layouts. Configuring logging via a file has the advantage that logging can be turned on or off without modifying the application that uses Log4j. The application can be allowed to run with logging off until there's a problem, for example, and then logging can be turned back on simply by modifying the configuration file.

Loggers[15] are named log message destinations. They are the names that are known to the Java application. Each logger is independently configurable as to what level of logging (FATAL, ERROR, etc.) it currently logs. In early versions of Log4j, these were called category and priority, but now they're called logger and level, respectively. A Logger can send log messages to multiple Appenders.

The actual outputs are done by Appenders.[16] There are numerous Appenders available, with descriptive names, such as FileAppender, RollingFileAppender, ConsoleAppender, SocketAppender, SyslogAppender, and SMTPAppender. Log4j 2 added Appenders that write to Apache Flume, the Java Persistence API, Apache Kafka, NoSQL databases, Memory-mapped files, Random Access files[17] and ZeroMQ endpoints. Multiple Appenders can be attached to any Logger, so it's possible to log the same information to multiple outputs; for example to a file locally and to a socket listener on another computer.

Appenders use Layouts[18] to format log entries. A popular way to format one-line-at-a-time log files is PatternLayout, which uses a pattern string, much like the C / C++ function printf. There are also HTMLLayout and XMLLayout formatters for use when HTML or XML formats are more convenient, respectively. Log4j 2 added Layouts for CSV, Graylog Extended Log Format (GELF),[19] JSON, YAML and RFC-5424.[20]

In Log4j 2, Filters[21] can be defined on configuration elements to give more fine-grained control over which log entries should be processed by which Loggers and Appenders. In addition to filtering by log level and regular expression matching on the message string, Log4j 2 added burst filters, time filters, filtering by other log event attributes like Markers or Thread Context Map and JSR 223 script filters.

To debug a misbehaving configuration:

  • In Log4j 2 configurations set the status attribute to TRACE to send internal status logging output to standard out. To enable status logging before the configuration is found, use the Java VM property -Dorg.apache.logging.log4j.simplelog.StatusLogger.level=trace.
  • In Log4j 1, use the Java VM property -Dlog4j.debug.

To find out where a log4j2.xml configuration file was loaded from inspect getClass().getResource("/log4j2.xml").

There is also an implicit "unconfigured" or "default" configuration of Log4j, that of a Log4j-instrumented Java application which lacks any Log4j configuration. This prints to stdout a warning that the program is unconfigured, and the URL to the Log4j web site where details on the warning and configuration may be found. As well as printing this warning, an unconfigured Log4j application will only print ERROR or FATAL log entries to standard out.

Example for Log4j 2

 
<?xml version="1.0" encoding="UTF-8"?>
<Configuration status="trace" monitorInterval="60">
  <Properties>
    <Property name="filename">target/test.log</Property>
  </Properties>
 
  <Appenders>
    <Console name="STDOUT">
      <PatternLayout pattern="%d %p %c{1.} [%t] %m%n"/>
    </Console>

    <File name="file" fileName="${filename}">
      <PatternLayout>
        <pattern>%d %p %c{1.} [%t] %m%n</pattern>
      </PatternLayout>
    </File>
  </Appenders>
 
  <Loggers> 
    <!-- 
         loggers whose name starts with 'org.springframework' will only log messages of level "info" or higher;
         if you retrieve Loggers by using the class name (e.g. Logger.getLogger(AClass.class))
         and if AClass is part of the org.springframework package, it will belong to this category
    -->
    <Logger name="org.springframework" level="info" additivity="false" />

    <!--
        Filter example: for loggers whose name starts with 'com.mycompany.myproduct',
        log entries of level "debug" or higher whose ThreadContextMap data contains
        the key-value pair "test=123", also send these log entries to the "STDOUT" appender.
    -->
    <Logger name="com.mycompany.myproduct" level="debug" additivity="true">
      <ThreadContextMapFilter>
        <KeyValuePair key="test" value="123"/>
      </ThreadContextMapFilter>
      <AppenderRef ref="STDOUT"/>
    </Logger>
 
    <!--
        By default, all log messages of level "trace" or higher will be logged.
        Log messages are sent to the "file" appender and 
        log messages of level "error" and higher will be sent to the "STDOUT" appender.
    -->
    <Root level="trace">
      <AppenderRef ref="file"/>
      <AppenderRef ref="STDOUT" level="error"/>
    </Root>
  </Loggers>
 
</Configuration>

Example for Log4j 1.2

 
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE log4j:configuration PUBLIC "-//LOGGER" "http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/xml/doc-files/log4j.dtd">
<log4j:configuration>
    <!-- 
         an appender is an output destination, such as the console or a file;
         names of appenders are arbitrarily chosen.
    -->
    <appender name="stdout" class="org.apache.log4j.ConsoleAppender">
        <layout class="org.apache.log4j.PatternLayout">
            <param name="ConversionPattern"
                value="%d{ABSOLUTE} %5p %c{1}:%L - %m%n" />
        </layout>
    </appender>
 
    <!-- 
         loggers of category 'org.springframework' will only log messages of level "info" or higher;
         if you retrieve Loggers by using the class name (e.g. Logger.getLogger(AClass.class))
         and if AClass is part of the org.springframework package, it will belong to this category
    -->
    <logger name="org.springframework">
        <level value="info"/>
    </logger>

    <!-- 
         everything of spring was set to "info" but for class 
         PropertyEditorRegistrySupport we want "debug" logging 
    -->
    <logger name="org.springframework.beans.PropertyEditorRegistrySupport">
        <level value="debug"/>
    </logger>
 
    <logger name="org.acegisecurity">
        <level value="info"/>
    </logger>
    
    
    <root>
        <!-- 
            all log messages of level "debug" or higher will be logged, unless defined otherwise 
            all log messages will be logged to the appender "stdout", unless defined otherwise 
        -->
        <level value="debug" />
        <appender-ref ref="stdout" />
    </root>
</log4j:configuration>

TTCC

TTCC is a message format used by log4j.[22] TTCC is an acronym for Time Thread Category Component. It uses the following pattern:

 %r [%t] %-5p %c %x - %m%n

Where

Mnemonic Description
%r Used to output the number of milliseconds elapsed from the construction of the layout until the creation of the logging event.
%t Used to output the name of the thread that generated the logging event.
%p Used to output the priority of the logging event.
%c Used to output the category of the logging event.
%x Used to output the NDC (nested diagnostic context) associated with the thread that generated the logging event.[23]
%X{key} Used to output the MDC (mapped diagnostic context) associated with the thread that generated the logging event for specified key.[24]
%m Used to output the application supplied message associated with the logging event.
%n Used to output the platform-specific newline character or characters.

Example output
467 [main] INFO org.apache.log4j.examples.Sort - Exiting main method.

Ports
  • log4c - A port for C. Log4C is a C-based logging library, released on SourceForge under the LGPL license. For various Unix operating systems the autoconf and automake files are provided. On Windows a Makefile is provided for use with MSVC. Developers may also choose to use their own make system to compile the source, depending on their build engineering requirements. An instance of the log4c library may be configured via three methods: using environment variables, programmatically, or via XML configuration file. log4c has appenders for Files, Streams and memory mapped files. (No Socket Adapter.) Last version is 1.2.4, released in 2013, and the project is no longer actively developed.[25]
  • log4js - A port for JavaScript. Log4js is available under the licence of Apache Software Foundation. One special feature of Log4js is the ability to log the events of the browser remotely on the server. Using Ajax it is possible to send the logging events in several formats (XML, JSON, plain ASCII, etc.) to the server to be evaluated there. The following appenders are implemented for log4js: AjaxAppender, ConsoleAppender, FileAppender, JSConsoleAppender, MetatagAppender, and WindowsEventsAppender. The following Layout classes are provided: BasicLayout, HtmlLayout, JSONLayout, and XMLLayout. Last version is 1.1, released in 2008.[26]
  • log4javascript - Another port for JavaScript. log4javascript is a JavaScript logging framework based on the log4j. The latest version is 1.4.9, released in May 2014.[27]
  • JSNLog - A port for JavaScript. Automatically places messages from JavaScript loggers in server side logs using a .NET server side component that interfaces with Log4Net, NLog, Elmah or Common.Logging. This to provide an integrated log for client and server side events. Request ids correlate events related to a specific user. Configuration is via a server side web.config file. Supports exception logging including stack traces. In July 2014 the latest version was 2.7.1 and updates were made regularly.[28]
  • Apache Log4net - A port to the Microsoft .NET Framework. The initial work was done by Neoworks and was donated to the Apache Software Foundation in February 2004. The framework is similar to the original log4j while taking advantage of new features in the .NET runtime. Provides Nested Diagnostic Context (NDC) and Mapped Diagnostic Context (MDC). The latest version is 2.0.8 which was released in 2017.[29][30]
  • log4perl - A Perl port of the widely popular log4j logging package. Last version is 1.49, released in February 2017.[31]
  • Apache log4php - "A versatile logging framework for PHP. Originally a port of Apache log4j to PHP, it has grown to include various PHP specific features."[32]
  • PL-SQL-Logging-Utility is an adaptation of log4j in PL/SQL.[33]
  • Log4db2 is a logging utility for DB2 for LUW that uses SQL instructions with SQL PL code.[34]
  • Apache Log4cxx - A logging framework for C++ patterned after Apache log4j, which uses Apache Portable Runtime for most platform-specific code and should be usable on any platform supported by APR. It is currently undergoing Incubation, The latest version is 0.10.0, released in 2008.[35]
  • Log4r - A comprehensive and flexible logging library written in Ruby for use in Ruby programs. It was inspired by and provides much of the features of the Apache Log4j project.[36]

See also

References
  1. "Apache Log4j 1.2 Release History". apache.org. Apache Software Foundation. Retrieved 2014-09-02.
  2. "Log4j – Changes - Apache Log4j 2". apache.org. Apache Software Foundation. Retrieved 21 April 2017.
  3. "Logback Home". Logback.qos.ch. Retrieved 2014-07-24.
  4. "Log4j 2 Guide - Apache Log4j 2". Logging.apache.org. 2014-07-12. Retrieved 2014-07-24.
  5. "Home | Ralph Goers | Logging with Log4j 2". Ralph Goers.
  6. "Log4j 2 Guide - Apache Log4j 2: News". Logging.apache.org. 2014-07-12. Retrieved 2014-07-24.
  7. "Apache™ Logging Services™ Project Announces Log4j™ 1 End-Of-Life; Recommends Upgrade to Log4j 2". blogs.apache.org. 2015-08-05. Retrieved 2016-07-03.
  8. "The new log4j 2.0". Grobmeier.de. 2012-12-05. Retrieved 2014-07-24.
  9. "Log4j – Overview - Apache Log4j 2". logging.apache.org. 2016-06-05. Retrieved 2016-07-03.
  10. "Log4j 2 Asynchronous Loggers for Low-Latency Logging - Apache Log4j 2". Logging.apache.org. 2014-07-12. Retrieved 2014-07-24.
  11. "Disruptor by LMAX-Exchange". Lmax-exchange.github.io. Retrieved 2014-07-24.
  12. "Level (Apache Log4j 1.2.17 API)". Logging.apache.org. 2012-06-09. Retrieved 2014-07-24.
  13. "Custom Log Levels". Logging.apache.org. 2014-07-12. Retrieved 2016-07-16.
  14. "Configuration". Logging.apache.org. 2016-07-05. Retrieved 2016-07-16.
  15. "Architecture". Logging.apache.org. 2016-07-05. Retrieved 2016-07-16.
  16. "Appenders". Logging.apache.org. 2016-07-05. Retrieved 2016-07-16.
  17. "RandomAccessFile". docs.oracle.com. 2011-07-28. Retrieved 2016-07-16.
  18. "Layouts". Logging.apache.org. 2016-07-05. Retrieved 2016-07-16.
  19. "GELF". docs.graylog.org. 2016-06-08. Retrieved 2016-07-16.
  20. "RFC 5424 - The Syslog Protocol". tools.ietf.org. 2009-03-01. Retrieved 2016-07-16.
  21. "Filters". Logging.apache.org. 2016-07-05. Retrieved 2016-07-16.
  22. "TTCCLayout (Apache Log4j 1.2.17 API)". Logging.apache.org. 2012-06-09. Retrieved 2014-07-24.
  23. "Class NDC". Archived from the original on 2007-08-20. Retrieved 2014-07-24.
  24. "MDC (Apache Log4j 1.2.17 API)". Logging.apache.org. 2012-06-09. Retrieved 2014-07-24.
  25. "Logging Framework for C | Free System Administration software downloads at". Sourceforge.net. Retrieved 2014-07-24.
  26. "Log4js". Log4js. Retrieved 2017-03-29.
  27. "a JavaScript logging framework". log4javascript. Retrieved 2014-07-24.
  28. "Logging JavaScript errors to your server side log". JSNLog. Retrieved 2014-07-24.
  29. "Apache log4net: Home". Logging.apache.org. 2015-12-05. Retrieved 2016-04-08.
  30. "2.0.8 release has been accepted · apache/logging-log4net@cd20f62". GitHub.
  31. "log4perl - log4j for Perl". Mschilli.github.com. Retrieved 2014-07-24.
  32. "Apache Logging Services". Apache.org. Retrieved 2015-03-11.
  33. "tmuth/Logger-A-PL-SQL-Logging-Utility — GitHub". Github.com. Retrieved 2014-07-24.
  34. "Log4db2 by angoca". Angoca.github.io. Retrieved 2014-07-24.
  35. "log4cxx - Changes". logging.apache.org.
  36. "Log4r Manual". log4r.rubyforge.org. Archived from the original on 2012-12-25. Retrieved 2017-04-13.

Further reading
  • Gülcü, Ceki (February 2010), The Complete Log4j Manual (2nd ed.), QOS.ch, p. 204, ISBN 978-2-9700369-0-6
  • Gupta, Samudra (June 22, 2005), Pro Apache Log4j (2nd ed.), Apress, p. 224, ISBN 978-1-59059-499-5
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.