Configuration of RSYNC for LFMT Collector

This section describes where and how to configure RSYNC for use with LFMT Collector.

Configure RSYNC command-line arguments

Purpose: To impose limits on the number of RSYNC transfer processes that can be run concurrently, and limit the amount of bandwidth that one transfer process uses. To impose these limits, you must edit the RSYNC command-line arguments found in the logpuller.sh script. This script is found in the <LFMT Collector Install Directory>\bin folder.

In the logpuller.sh script, modify one or both of the following parameters, as required:

• OPTION_CONCURRENCY—This parameter defines the maximum number of RSYNC transfer processes that can run concurrently. The default value of zero (0) indicates that there is no limit; an unlimited number of these processes can be spawned and run concurrently. You can set a limit in one of two ways:
  • Modify the value of this parameter in the logpuller.sh file.
  • Append -c <n> to the logpuller.sh file command line, where <n> is the maximum number of concurrent processes.
• OPTION_BANDWIDTH—This parameter sets the bandwidth limit for the RSYNC transfer in kBytes per second. The default value of zero 0 indicates that there is no limit. You can set a limit in one of two ways:
  • Modify the value of this parameter in the logpuller.sh file.
  • Append -b <n> to the logpuller.sh file command line, where <n> is the bandwidth limit in kBytes per second.
• ARCHIVE_SIZE—This parameter sets the number of log puller archives to retain. The default value is 7.
• RSYNC_COMPRESSION—This parameter sets the compression level of the rsync transfer. The default value is 1.
• RSYNC_MAXSIZE—This parameter sets the largest individual file size LFMT Collector will transfer to CLS. The default value is 200MB.
• RSYNC_TIMEOUT—This parameter sets the i/o timeout rsync will wait (in seconds) for log files to be transferred from the application servers. The default value is 60.
  • When transferring a large number of log files this value may need to be increased.