|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
ElasticSearchIndexRequestBuilderFactory
.repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
afterOpenForAppend()
.
Event
to the associated Flume source.
Source
implementation that receives Avro events from Avro sink of
Flume OGEntityParser
that parses Avro serialized bytes from an event.Sink
implementation that can send events to an RPC server (such as
Flume's AvroSource
).Source
implementation that receives Avro events from clients that
implement AvroSourceProtocol
.Channel
semantics, including the
implied thread-local semantics of the Transaction
class,
which is required to extend BasicTransactionSemantics
.Transaction
semantics designed
to work in concert with BasicChannelSemantics
to simplify
creation of robust Channel
implementations.Transaction
to which it belongs.FailurePolicy
Source
to a Sink
.Event
s into
Channel
s.Channel
objects.repeated .ActiveLog activeLogs = 5;
optional sfixed64 backupCheckpointPosition = 6;
optional sfixed64 backupCheckpointWriteOrderID = 7;
required bytes body = 2;
required sfixed64 checkpointPosition = 3;
required sfixed64 checkpointWriteOrderID = 4;
optional sfixed64 checksum = 2;
required string cipherProvider = 1;
required sfixed32 count = 2;
optional .LogFileEncryption encryption = 5;
required .FlumeEvent event = 1;
required sfixed32 fileID = 1;
repeated .FlumeEventHeader headers = 1;
required string key = 1;
required string keyAlias = 2;
required sfixed32 logFileID = 1;
required sfixed32 logFileID = 2;
required sfixed32 offset = 2;
optional bytes parameters = 3;
required sfixed32 queueHead = 4;
required sfixed32 queueSize = 3;
required sfixed64 transactionID = 2;
required sfixed32 type = 1;
required sfixed32 type = 1;
required string value = 2;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed64 writeOrderID = 2;
required sfixed64 writeOrderID = 3;
EventDeserializer.reset()
on the stream and then closes it.
Configurable
s.target
implements Configurable
and, if so, ask
it to configure itself using the supplied context
.
XContentBuilder
IndexRequestBuilder
from the supplied
Client
via delegation to the subclass-hook template methods
AbstractElasticSearchIndexRequestBuilderFactory.getIndexName(String, long)
and
AbstractElasticSearchIndexRequestBuilderFactory.prepareIndexRequest(IndexRequestBuilder, String, String, Event)
Transaction
objects, which must
extend BasicTransactionSemantics
.
Context
prefix
IndexRequestBuilder
instances
from serialized flume events.ElasticSearchSink
configured using the supplied
configuration
EntityParser
s.BucketPath.escapeString(String, Map, TimeZone, boolean, int, int,
boolean)
with the timezone set to the default.
Event
fails to
reach at least one of its intended (next-hop) destinations.Source
that does not need an external driver to poll for
events to ingest; it provides its own event-driven
mechanism to invoke event processing.AvroCLIClient
to
ingest into Flume.ElasticSearchIndexRequestBuilderFactory
.Source
implementation that executes a Unix process and turns each
line of text into an event.RpcClient
which supports failover.FailurePolicy
s.FastDateFormat
to use for index names
in AbstractElasticSearchIndexRequestBuilderFactory.getIndexName(String, long)
Channel
implementation that uses the local file system for
its storage.Source
specified.
ObjectName
within the flume namespace:
org.apache.flume.repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
optional sfixed64 backupCheckpointPosition = 6;
optional sfixed64 backupCheckpointPosition = 6;
optional sfixed64 backupCheckpointPosition = 6;
optional sfixed64 backupCheckpointWriteOrderID = 7;
optional sfixed64 backupCheckpointWriteOrderID = 7;
optional sfixed64 backupCheckpointWriteOrderID = 7;
events
that may be batched
at once by appendBatch()
.
required bytes body = 2;
required bytes body = 2;
required bytes body = 2;
required sfixed64 checkpointPosition = 3;
required sfixed64 checkpointPosition = 3;
required sfixed64 checkpointPosition = 3;
required sfixed64 checkpointWriteOrderID = 4;
required sfixed64 checkpointWriteOrderID = 4;
required sfixed64 checkpointWriteOrderID = 4;
optional sfixed64 checksum = 2;
optional sfixed64 checksum = 2;
optional sfixed64 checksum = 2;
required string cipherProvider = 1;
required string cipherProvider = 1;
required string cipherProvider = 1;
required string cipherProvider = 1;
required string cipherProvider = 1;
required string cipherProvider = 1;
BytesStream
made up of the serialized flume event
required sfixed32 count = 2;
required sfixed32 count = 2;
required sfixed32 count = 2;
RpcClient
connected to the specified
hostname
and port
.
RpcClient
connected to the specified
hostname
and port
with the specified batchSize
.
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required sfixed32 fileID = 1;
required sfixed32 fileID = 1;
required sfixed32 fileID = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
RpcClient
, optionally with failover.
RpcClientFactory.getInstance(Properties props)
, given a File path
to a Properties
file.
required string key = 1;
required string key = 1;
required string key = 1;
required string keyAlias = 2;
required string keyAlias = 2;
required string keyAlias = 2;
required string keyAlias = 2;
required string keyAlias = 2;
required string keyAlias = 2;
required string key = 1;
required string key = 1;
required string key = 1;
ReliableSpoolingFileEventReader.readEvents(int)
call.
required sfixed32 logFileID = 1;
required sfixed32 logFileID = 1;
required sfixed32 logFileID = 1;
required sfixed32 logFileID = 2;
required sfixed32 logFileID = 2;
required sfixed32 logFileID = 2;
required sfixed32 offset = 2;
required sfixed32 offset = 2;
required sfixed32 offset = 2;
optional bytes parameters = 3;
optional bytes parameters = 3;
optional bytes parameters = 3;
required sfixed32 queueHead = 4;
required sfixed32 queueHead = 4;
required sfixed32 queueHead = 4;
required sfixed32 queueSize = 3;
required sfixed32 queueSize = 3;
required sfixed32 queueSize = 3;
createTransaction
if not.
required sfixed64 transactionID = 2;
required sfixed64 transactionID = 2;
required sfixed64 transactionID = 2;
required sfixed32 type = 1;
required sfixed32 type = 1;
required sfixed32 type = 1;
required sfixed32 type = 1;
required sfixed32 type = 1;
required sfixed32 type = 1;
required string value = 2;
required string value = 2;
required string value = 2;
required string value = 2;
required string value = 2;
required string value = 2;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed64 writeOrderID = 2;
required sfixed64 writeOrderID = 2;
required sfixed64 writeOrderID = 2;
required sfixed64 writeOrderID = 3;
required sfixed64 writeOrderID = 3;
required sfixed64 writeOrderID = 3;
optional sfixed64 backupCheckpointPosition = 6;
optional sfixed64 backupCheckpointPosition = 6;
optional sfixed64 backupCheckpointPosition = 6;
optional sfixed64 backupCheckpointWriteOrderID = 7;
optional sfixed64 backupCheckpointWriteOrderID = 7;
optional sfixed64 backupCheckpointWriteOrderID = 7;
required bytes body = 2;
required bytes body = 2;
required bytes body = 2;
required sfixed64 checkpointPosition = 3;
required sfixed64 checkpointPosition = 3;
required sfixed64 checkpointPosition = 3;
required sfixed64 checkpointWriteOrderID = 4;
required sfixed64 checkpointWriteOrderID = 4;
required sfixed64 checkpointWriteOrderID = 4;
optional sfixed64 checksum = 2;
optional sfixed64 checksum = 2;
optional sfixed64 checksum = 2;
required string cipherProvider = 1;
required string cipherProvider = 1;
required string cipherProvider = 1;
required sfixed32 count = 2;
required sfixed32 count = 2;
required sfixed32 count = 2;
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required sfixed32 fileID = 1;
required sfixed32 fileID = 1;
required sfixed32 fileID = 1;
required string key = 1;
required string key = 1;
required string key = 1;
required string keyAlias = 2;
required string keyAlias = 2;
required string keyAlias = 2;
required sfixed32 logFileID = 1;
required sfixed32 logFileID = 1;
required sfixed32 logFileID = 1;
required sfixed32 logFileID = 2;
required sfixed32 logFileID = 2;
required sfixed32 logFileID = 2;
required sfixed32 offset = 2;
required sfixed32 offset = 2;
required sfixed32 offset = 2;
optional bytes parameters = 3;
optional bytes parameters = 3;
optional bytes parameters = 3;
required sfixed32 queueHead = 4;
required sfixed32 queueHead = 4;
required sfixed32 queueHead = 4;
required sfixed32 queueSize = 3;
required sfixed32 queueSize = 3;
required sfixed32 queueSize = 3;
required sfixed64 transactionID = 2;
required sfixed64 transactionID = 2;
required sfixed64 transactionID = 2;
required sfixed32 type = 1;
required sfixed32 type = 1;
required sfixed32 type = 1;
required sfixed32 type = 1;
required sfixed32 type = 1;
required sfixed32 type = 1;
required string value = 2;
required string value = 2;
required string value = 2;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed64 writeOrderID = 2;
required sfixed64 writeOrderID = 2;
required sfixed64 writeOrderID = 2;
required sfixed64 writeOrderID = 3;
required sfixed64 writeOrderID = 3;
required sfixed64 writeOrderID = 3;
Channel
instance.
HostInterceptor.intercept(Event)
in a loop.
Event
.
RegexFilteringInterceptor.intercept(Event)
.
StaticInterceptor.intercept(Event)
in a loop.
TimestampInterceptor.intercept(Event)
in a loop.
true
if this object appears to be in a usable state, and
it returns false
if this object is permanently disabled.
Sink
implementation that logs all events received at the INFO level
to the org.apache.flume.sink.LoggerSink logger.Resettable.reset()
being called.
Resettable.reset()
being called.
optional .LogFileEncryption encryption = 5;
required .FlumeEvent event = 1;
MorphlineHandler
that processes it's events using a morphline Command
chain.Command
chain.Command
chain, and loads them into Apache Solr.RpcClient
.RpcClientFactory
.
Sink
implementation that simply discards all events it receives.ConfigurationConstants.CONFIG_CREATE_FK
instead.
ConfigurationConstants.CONFIG_CREATE_INDEX
instead.
ConfigurationConstants.CONFIG_CREATE_SCHEMA
instead.
ConfigurationConstants.CONFIG_DATABASE_TYPE
instead.
ConfigurationConstants.CONFIG_JDBC_DRIVER_CLASS
instead.
ConfigurationConstants.CONFIG_JDBC_PROPS_FILE
instead.
ConfigurationConstants.CONFIG_JDBC_SYSPROP_PREFIX
instead
ConfigurationConstants.CONFIG_MAX_CAPACITY
instead.
ConfigurationConstants.CONFIG_MAX_CONNECTIONS
instead
ConfigurationConstants.CONFIG_PASSWORD
instead.
ConfigurationConstants.CONFIG_TX_ISOLATION_LEVEL
instead.
ConfigurationConstants.CONFIG_URL
instead.
ConfigurationConstants.CONFIG_USERNAME
instead.
Source
that requires an external driver to poll to determine
whether there are events that are available to ingest
from the source.SourceRunner
that can drive a
PollableSource
.IndexRequestBuilder
instance
ActiveLog
ActiveLog
Checkpoint
Checkpoint
Commit
Commit
FlumeEvent
FlumeEvent
FlumeEventHeader
FlumeEventHeader
LogFileEncryption
LogFileEncryption
LogFileMetaData
LogFileMetaData
Put
Put
Rollback
Rollback
Take
Take
TransactionEventFooter
TransactionEventFooter
TransactionEventHeader
TransactionEventHeader
Channel
implementation that supports in-memory
buffering and delivery of events.put
to the thread's BasicTransactionSemantics
instance.
BasicChannelSemantics
delegates calls
to put
.
put
transactions.
put
transactions.
n
lines associated with the input stream.
RegexExtractorInterceptor
HbaseEventSerializer
which parses columns based on a supplied
regular expression and column name list.ReliableEventReader
which reads log data from files stored
in a spooling directory and renames each file once all of its data has been
read (through EventDeserializer.readEvent()
calls).repeated .ActiveLog activeLogs = 5;
repeated .FlumeEventHeader headers = 1;
EventDeserializer.mark()
was never previously called.
Resettable.mark()
has never been called.
ResettableInputStream.mark()
ResettableFileInputStream.reset()
is dependent on the underlying PositionTracker
instance's durability semantics.mark
ed and reset
with no limit to
the number of bytes which may have been read between the calls.EventDeliveryException
.RPCClient
implementations.LogEntry
from existing
Scribe system.RPCClient
implementations.repeated .ActiveLog activeLogs = 5;
repeated .ActiveLog activeLogs = 5;
optional sfixed64 backupCheckpointPosition = 6;
optional sfixed64 backupCheckpointWriteOrderID = 7;
required bytes body = 2;
required sfixed64 checkpointPosition = 3;
required sfixed64 checkpointWriteOrderID = 4;
optional sfixed64 checksum = 2;
required string cipherProvider = 1;
required string cipherProvider = 1;
required sfixed32 count = 2;
optional .LogFileEncryption encryption = 5;
optional .LogFileEncryption encryption = 5;
required .FlumeEvent event = 1;
required .FlumeEvent event = 1;
required sfixed32 fileID = 1;
repeated .FlumeEventHeader headers = 1;
repeated .FlumeEventHeader headers = 1;
required string key = 1;
required string keyAlias = 2;
required string keyAlias = 2;
required string key = 1;
required sfixed32 logFileID = 1;
required sfixed32 logFileID = 2;
required sfixed32 offset = 2;
optional bytes parameters = 3;
required sfixed32 queueHead = 4;
required sfixed32 queueSize = 3;
required sfixed64 transactionID = 2;
required sfixed32 type = 1;
required sfixed32 type = 1;
required string value = 2;
required string value = 2;
required sfixed32 version = 1;
required sfixed32 version = 1;
required sfixed64 writeOrderID = 2;
required sfixed64 writeOrderID = 3;
EventReader
implementation which delegates to a
BufferedReader
.Channel
.Runnable
that polls a
SinkProcessor
and manages event delivery notification,
BACKOFF
delay handling, etc.ChannelProcessor
to persist those events into the
configured channels.take
to the thread's BasicTransactionSemantics
instance.
BasicChannelSemantics
delegates calls
to take
.
take
transactions.
take
transactions.
Sink
implementation that can send events to an RPC server (such as
Flume's ThriftSource
).Transaction
client
semantics.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |