Apache Flume Apache Software Foundation

Welcome to Apache FlumeΒΆ

Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application.

Agent component diagram

News

January 2nd, 2013 - Apache Flume 1.3.1 Released

The Apache Flume team is pleased to announce the release of Flume version 1.3.1. Apache Flume 1.3.1 is the fifth release under the auspices of Apache of the so-called “NG” codeline, and our third release as a top-level Apache project! Flume 1.3.1 has been put through many stress and regression tests, is stable, production-ready software, and is backwards-compatible with Flume 1.3.0 and Flume 1.2.0.

Apache Flume 1.3.1 is a maintainance release for the 1.3.0 release, and includes several bug fixes and performance enhancements.

This release can be downloaded from the Flume download page at: http://flume.apache.org/download.html

The change log and documentation are available on the 1.3.1 release page: http://flume.apache.org/releases/1.3.1.html

Your help and feedback is more than welcome!

December 2nd, 2012 - Apache Flume 1.3.0 Released

The Apache Flume team is pleased to announce the release of Flume version 1.3.0.

Apache Flume 1.3.0 is the fourth release under the auspices of Apache of the so-called “NG” codeline, and our second release as a top-level Apache project! Flume 1.3.0 has been put through many stress and regression tests, is stable, production-ready software, and is backwards-compatible with Flume 1.2.0.

Four months of very active development went into this release: a whopping 221 patches were committed since 1.2.0, representing many features, enhancements, and bug fixes. While the full change log can be found in the link below, here are a few new feature highlights:

  • New HTTP Post Source
  • New Spool Directory Source
  • New Multi-port Syslog Source
  • New Elastic Search Sink
  • New Regex Extractor Interceptor
  • File Channel Encryption

This release can be downloaded from the Flume download page at: http://flume.apache.org/download.html

The change log and documentation are available on the 1.3.0 release page: http://flume.apache.org/releases/1.3.0.html

Your help and feedback is more than welcome!

July 26, 2012 - Apache Flume 1.2.0 Released

The Apache Flume team is pleased to announce the release of Flume version 1.2.0.

Apache Flume 1.2.0 is the third release under the auspices of Apache of the so-called “NG” codeline, and our first release as a top-level Apache project! Flume 1.2.0 has been put through many stress and regression tests, is stable, production-ready software, and is backwards-compatible with Flume 1.1.0.

Four months of very active development went into this release: a whopping 192 patches were committed since 1.1.0, representing many features, enhancements, and bug fixes. While the full change log can be found in the link below, here are a few new feature highlights:

  • New durable file channel
  • New client API
  • New HBase sinks (two different implementations)
  • New Interceptor interface (a plugin processing API)
  • New JMX-based monitoring support

This release can be downloaded from the Flume download page at: http://flume.apache.org/download.html

The change log and documentation are available on the 1.2.0 release page: http://flume.apache.org/releases/1.2.0.html

Your help and feedback is more than welcome!

July 26, 2012 - Flume Meetup NYC

Strata + Hadoop World (http://strataconf.com/stratany2012) will be held October 23-25 in NYC. A Flume Meetup is being organized around this event. This Meetup will be a good place for users to interact with each other and with Flume developers.

In order to help with organization, a form has been set up with a few questions about what kind of Meetup the community wants, and which evening is best. Please fill out the form. Feel free to post to the User’s mailing list with any questions.