Catch the bus - Aiven challenge with ClickHouse®#
Welcome to Aiven’s “Catch the bus” challenge, an easy way for you to explore Aiven for ClickHouse®.
With the launch of Aiven for ClickHouse® we finally have the “C” for our KFC stack, the best combination of tools for real-time alerting and historic analytics. The stack utilises Apache Kafka®, Apache Flink®, and ClickHouse® to build up a robust, scalable architecture for getting the most from your data, whether it be batched ETL or real-time sensors.
For this challenge, we’ll be using real-time data from Digitransit to plot maps and find new insights. Digitransit provides real-time bus information and positioning data for busses in Helsinki. We’ve saved you a few weeks worth of data as a CSV to experiment with.
Let’s dive right in.
The goal is to find the best bus routes between the different KFC restaurants in Helsinki.
Create an Aiven free trial account: sign up for free.
Spin up an Aiven for ClickHouse® service and load the dataset. Please see the Aiven for ClickHouse® docs for help with these steps.
Find the routes and plot them on a map. Here’s a notebook with a few optional queries and a mapping library to get you started. You can also check out the ClickHouse docs for advanced SQL information.
If you find the solution or need help, email us at hacks@Aiven.io.