Known Issues for the td-agent

A list of known issues with their solution or workaround are provided here. The steps provided to resolve the known issues ensure that your product does not display errors or crash.
  • Known Issue: The Buffer overflow error appears in the /var/log/td-agent/td-agent.log file.

    Description: When the total size of the files in td-agent buffer /opt/protegrity/td-agent/es_buffer directory reaches the default maximum limit of 64 GB, then the Buffer overflow error appears.

    Resolution:

    Add the total_limit_size parameter to increase the buffer limit in the OUTPUT.conf file using the following steps.

    1. Log in to the CLI Manager of the ESA node.

    2. Navigate to Administration > OS Console.

    3. Stop the td-agent service using the following command:

      /etc/init.d/td-agent stop
      

    Alternatively, stop the service by logging into the ESA Web UI, navigating to System > Services, and stopping the td-agent service under Misc.

    1. Navigate to the /opt/protegrity/td-agent/config.d directory.

    2. Open the OUTPUT.conf file.

    3. Add the total_limit_size parameter in the buffer section of the OUTPUT.conf file.

      In this example, the total_limit_size is doubled to 128 GB.

    4. Save the file.

    5. Start the td-agent service using the following command:

      /etc/init.d/td-agent start
      

    Alternatively, start the service by logging into the ESA Web UI, navigating to System > Services, and starting the td-agent service under Misc.

  • Known Issue: The Too many open files error appears in the /var/log/td-agent/td-agent.log file.

    Description: When the total number of files in the td-agent buffer /opt/protegrity/td-agent/es_buffer directory reaches the maximum limit, then the Too many open files error appears.

    Resolution:

    Change the limit for the maximum number of open files for the td-agent service in the /etc/init.d/td-agent file using the following steps.

    1. Log in to the CLI Manager of the ESA node.

    2. Navigate to Administration > OS Console.

    3. Stop the td-agent service using the following command:

      /etc/init.d/td-agent stop
      

    Alternatively, stop the service by logging into the ESA Web UI, navigating to System > Services, and stopping the td-agent service under Misc.

    1. Navigate to the /etc/init.d directory.

    2. Open the td-agent file.

    3. Change the ulimit.

      In this example, the ulimit is increased to 120000.

    4. Save the file.

    5. Start the td-agent service using the following command:

      /etc/init.d/td-agent start
      

    Alternatively, start the service by logging into the ESA Web UI, navigating to System > Services, and starting the td-agent service under Misc.