Known Issue: The Buffer overflow error appears in the /var/log/td-agent/td-agent.log file.
Description: When the total size of the files in td-agent buffer /opt/protegrity/td-agent/es_buffer directory reaches the default maximum limit of 64 GB, then the Buffer overflow error appears.
Resolution:
Add the total_limit_size parameter to increase the buffer limit in the OUTPUT.conf file using the following steps.
Log in to the CLI Manager of the ESA node.
Navigate to Administration > OS Console.
Stop the td-agent service using the following command:
/etc/init.d/td-agent stop
Alternatively, stop the service by logging into the ESA Web UI, navigating to System > Services, and stopping the td-agent service under Misc.
Navigate to the /opt/protegrity/td-agent/config.d
directory.
Open the OUTPUT.conf
file.
Add the total_limit_size parameter in the buffer section of the OUTPUT.conf
file.
In this example, the total_limit_size is doubled to 128 GB.
Save the file.
Start the td-agent service using the following command:
/etc/init.d/td-agent start
Alternatively, start the service by logging into the ESA Web UI, navigating to System > Services, and starting the td-agent service under Misc.
Known Issue: The Too many open files error appears in the /var/log/td-agent/td-agent.log file.
Description: When the total number of files in the td-agent buffer /opt/protegrity/td-agent/es_buffer directory reaches the maximum limit, then the Too many open files error appears.
Resolution:
Change the limit for the maximum number of open files for the td-agent service in the /etc/init.d/td-agent file using the following steps.
Log in to the CLI Manager of the ESA node.
Navigate to Administration > OS Console.
Stop the td-agent service using the following command:
/etc/init.d/td-agent stop
Alternatively, stop the service by logging into the ESA Web UI, navigating to System > Services, and stopping the td-agent service under Misc.
Navigate to the /etc/init.d
directory.
Open the td-agent
file.
Change the ulimit.
In this example, the ulimit is increased to 120000.
Save the file.
Start the td-agent service using the following command:
/etc/init.d/td-agent start
Alternatively, start the service by logging into the ESA Web UI, navigating to System > Services, and starting the td-agent service under Misc.