Manage OpenSearch® log integration#

Aiven provides a service integration that allows you to send your logs from several services, such as Aiven for Apache Kafka®, PostgreSQL®, Apache Cassandra®, OpenSearch®, Redis®*, InfluxDB®, and Grafana®, to Aiven for OpenSearch®. Making it possible for you to use OpenSearch to gain more insight and control over your logs.

In this article, you will understand how to enable, edit and disable the logs integration feature on Aiven for OpenSearch®.

Tip

Check a short video tutorial for an end-to-end example of how to enable your Aiven for OpenSearch® log integration.

Enable log integration#

Here are the steps needed to enable logs integration. This allows you to send your service’s logs to your Aiven for OpenSearch® from another Aiven service.

  1. On the Services page, click a service name.

  2. On the Logs tab, click on Enable logs integration.

  3. Select an existing OpenSearch instance or create a new one, then select Continue.

    • When creating a new service you will need to select the cloud, region and plan to use. You should also give your service a name. The service overview page shows the nodes rebuilding, and then indicates when they are ready.

    • If you’re already using OpenSearch on Aiven, you can use your running OpenSearch service as a destination for your metrics data. If you are a member of more than one Aiven project with operator or admin access rights, you need to choose the project first then your target OpenSearch service.

  4. Configure your index prefix and index retention limit parameters, then select Enable.

Note

If you want to effectively disable the index retention limit, you can set it to the maximum value which is 10000 days.

Your Aiven service is now sending logs to your OpenSearch service which you can explore further.

Configure log integration#

There are two parameters that you can adjust when integrating logs to your OpenSearch service:

  • index prefix, specifies the prefix part of the index name

  • index retention limit, number of days to preserve the daily indexes

Warning

The service’s logs are sent from the selected service to your OpenSearch cluster. When the index retention limit is reached, those indexes are deleted from the OpenSearch cluster.

You can change the configuration of the index prefix and index retention limit after the integration is enabled.

  1. On the Services page, click a service name.

  2. On the Overview page, scroll down to the Service integrations.

  3. Click on Manage integrations.

  4. On the Enabled service integrations list, find the service to configure.

  5. Click Edit, and edit the parameters.

  6. Once the parameters are chosen, click Edit.

Your log integration parameters should be updated after those steps.

Disable logs integration#

In case, you are no longer interested in sending the logs from your service to OpenSearch, follow those steps to disable the integration:

  1. On the Overview page, scroll down to the Service integrations.

  2. Click on Manage integrations.

  3. On the Enabled service integrations list, find the service to disable the integration.

  4. Click Delete.

Your log integration for OpenSearch should be successfully disabled after those steps.