Review Board 1.6.3

FLUME-699: Add exec source queue size parameter

Review Request #1889 - submitted 2 years, 8 months ago

Jonathan Hsieh Reviewers
flume
flume-699 esammer, nerdynick
None flume
This patch gives better control of queue size and memory usage and was prompted by a user problem.
TestExecNIOSource tests pass.
conf/flume-conf.xml
Revision e22b8bb New Change
... 323 lines hidden [Expand]
324
    <value>10000</value>
324
    <value>10000</value>
325
    <description>Milliseconds with no transmissions before thrift
325
    <description>Milliseconds with no transmissions before thrift
326
    client times out a connection</description>
326
    client times out a connection</description>
327
  </property>
327
  </property>
328

   
328

   
329
  
329
  <!-- ================================================== -->

   
330
  <!-- Exec Source settings ============================= -->

   
331
  <!-- ================================================== -->

   
332
  <property>

   
333
    <name>flume.exec.queuesize</name>

   
334
    <value>1000</value>

   
335
    <description>Max number of events queued up in execsource.  This

   
336
    gives the user some control of over the amount of memory used by

   
337
    the source.  If the max size is reached, the exec source wil

   
338
    block.

   
339
    </description>

   
340
  </property>

   
341

   
330
</configuration>
342
</configuration>
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java
Revision cb4bf71 New Change
 
flume-core/src/main/java/com/cloudera/flume/handlers/exec/ExecNioSource.java
Revision f14f774 New Change
 
flume-core/src/test/java/com/cloudera/flume/handlers/exec/TestExecNioSource.java
Revision c3cc439 New Change
 
  1. conf/flume-conf.xml: Loading...
  2. flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java: Loading...
  3. flume-core/src/main/java/com/cloudera/flume/handlers/exec/ExecNioSource.java: Loading...
  4. flume-core/src/test/java/com/cloudera/flume/handlers/exec/TestExecNioSource.java: Loading...