SQL streaming data pipelines on Aiven with Apache Kafka® and Apache Flink® If data is the new gold then data pipelines must be the mining shafts and SQL the pickaxe: allowing information to travel across the company from the sources to the desired decision-enabling dashboards. But driving the data assets to the right audience is only part of the problem; performing it…

Keep data in sync across technologies with Apache Kafka® and Apache Kafka® Connect Technologies change all the time, and the best platform choice at the start of the project sometimes does not look so great after time has passed or requirements have become clearer. …

Holidays, trips, happy times are always in our minds and a couple months ago we saw how to solve the knapsack problem using PostgreSQL recursive queries. However, blog posts don’t always age like wine. Some weeks after the publication date, PostgreSQL 14 was announced, and it includes a couple of…

Apache Kafka is widely used as a company data backbone with Kafka Connect acting as a bridge. This way Kafka can be integrated with other technologies easily, reliably and scalably. …

The days before a holiday are exciting. You’ve planned a vacation somewhere and can’t wait to hit the road. But first, there’s a whole list of decisions to make: how many underpants should I bring? Are the running shoes necessary? What about the hairdryer? Which jacket should I pack? …

“A picture is worth a thousand words” is a common saying in many languages. Similarly, in the data world, a visualization condenses huge amounts of raw points into an image that can be used to create insightful stories driving business decisions. …

Creating information is just like any creative process. It starts with finding the materials (in this case, datasources) and continues with cleaning, joining and wrangling datasets. By the time you’re finished you’ve built something beautiful and gained new insights to share — and then you start all over again. One…

Apache Kafka is the perfect base for any streaming application: a solid, highly-available, fault-tolerant platform that makes reliable communication between streaming components as easy as writing to a disk. Apache Flink adds the power of stateful data transformations to the picture. It’s able to calculate, persist, recover and process data…

Apache Flink is an open source framework for data processing in both stream and batch mode. It supports a variety of different data platforms, including Apache Kafka and any JDBC database. Flink’s superpowers come in a variety of languages: from the more traditional Java and Scala, all the way to…