Aiven for Apache Flink® quickstart guide#
The first step in using Aiven for Apache Flink® is to create a service. You can do this in the Aiven web console or with the Aiven CLI.
This quickstart section provides you with the information you need to get started with Aiven for Apache Flink and build data pipelines to stream to analyze your data. Learn how to set up and configure Aiven for Flink, connect to your desired data sources, and start processing and analyzing your data in real-time.
Create an Apache for Apache Flink® service#
Log in to the Aiven web console.
Follow these instructions to create a new Aiven for Apache Flink service.
Once the service is ready, the status changes to Running. Depending on your selected cloud provider and region, this generally takes a couple of minutes.
Create data service integration#
Aiven for Apache Flink® allows you to build data pipelines that stream across different services. It currently supports integration with Aiven for Apache Kafka®, Aiven for PostgreSQL®, and Aiven for OpenSearch® as sources and targets for Flink applications.
To create your first data service integration:
Open your Aiven for Apache Flink.
In the Overview tab, click the Get Started button.
Choose the service you wish to integrate: Aiven for Apache Kafka®, Aiven for PostgreSQL®, or Aiven for OpenSearch®.
Click the Integrate button to complete the integration process.
For detailed steps, see Create Apache Flink® data service integrations.
Create Aiven for Apache Flink® application#
An Aiven for Apache Flink® application is an abstraction layer on top of Apache Flink SQL that includes all the elements related to a Flink job to help build your data processing pipeline.
Applications are the starting point for running an Apache Flink job within the Aiven managed service and contains the definition of source and sink tables, data processing logic, deployment parameters, and other necessary metadata.
For information on creating Flink applications and integrating data services, see Create an Aiven for Apache Flink® application and Create Apache Flink® data service integrations sections.
Create source and sink data tables to map the data for Apache Kafka®, PostgreSQL® or OpenSearch® services
For details on using the Aiven CLI to create and manage Aiven for Apache Flink® services, see the Aiven CLI documentation and the Flink-specific command reference