Apache Flink Table Store 0.3.0 Release Announcement

January 13, 2023 - Jingsong Lee

The Apache Flink community is pleased to announce the release of the Apache Flink Table Store (0.3.0). We highly recommend all users upgrade to Flink Table Store 0.3.0. 0.3.0 completed 150+ issues, which were completed by nearly 30 contributors. Please check out the full documentation for detailed information and user guides. Flink Table Store 0.3 completes many exciting features, enhances its ability as a data lake storage and greatly improves the availability of its stream pipeline. ...

Continue reading »

Apache Flink Kubernetes Operator 1.3.1 Release Announcement

January 10, 2023 - Gyula Fora (@GyulaFora)

The Apache Flink Community is pleased to announce the first bug fix release of the Flink Kubernetes Operator 1.3 series. The release contains fixes for several critical issues and some major stability improvements for the application upgrade mechanism. We highly recommend all users to upgrade to Flink Kubernetes Operator 1.3.1. Release Notes # Bug # [FLINK-30329] - flink-kubernetes-operator helm chart does not work with dynamic config because of use of volumeMount subPath [FLINK-30361] - Cluster deleted and created back while updating replicas [FLINK-30406] - Jobmanager Deployment error without HA metadata should not lead to unrecoverable error [FLINK-30437] - State incompatibility issue might cause state loss [FLINK-30527] - Last-state suspend followed by flinkVersion change may lead to state loss [FLINK-30528] - Job may be stuck in upgrade loop when last-state fallback is disabled and deployment is missing Improvement # [FLINK-28875] - Add FlinkSessionJobControllerTest [FLINK-30408] - Add unit test for HA metadata check logic Release Resources # The source artifacts and helm chart are available on the Downloads page of the Flink website. ...

Continue reading »

Apache Flink Kubernetes Operator 1.3.0 Release Announcement

December 14, 2022 - Matyas Orhidi (@matyasorhidi) Gyula Fora (@GyulaFora)

The Flink community is happy to announce that the latest Flink Kubernetes Operator version went live today. Beyond the regular operator improvements and fixes the 1.3.0 version also integrates better with some popular infrastructure management tools like OLM and Argo CD. These improvements are clear indicators that the original intentions of the Flink community, namely to provide the de facto standard solution for managing Flink applications on Kubernetes is making steady progress to becoming a reality. ...

Continue reading »

Optimising the throughput of async sinks using a custom RateLimitingStrategy

November 25, 2022 - Hong Liang Teoh

Introduction # When designing a Flink data processing job, one of the key concerns is maximising job throughput. Sink throughput is a crucial factor because it can determine the entire job’s throughput. We generally want the highest possible write rate in the sink without overloading the destination. However, since the factors impacting a destination’s performance are variable over the job’s lifetime, the sink needs to adjust its write rate dynamically. ...

Continue reading »

Apache Flink 1.15.3 Release Announcement

November 10, 2022 - Fabian Paul

The Apache Flink Community is pleased to announce the third bug fix release of the Flink 1.15 series. This release includes 59 bug fixes, vulnerability fixes, and minor improvements for Flink 1.15. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. We highly recommend all users upgrade to Flink 1.15.3. ...

Continue reading »

Announcing the Release of Apache Flink 1.16

October 28, 2022 - Godfrey He (@godfreyhe)

Apache Flink continues to grow at a rapid pace and is one of the most active communities in Apache. Flink 1.16 had over 240 contributors enthusiastically participating, with 19 FLIPs and 1100+ issues completed, bringing a lot of exciting features to the community. Flink has become the leading role and factual standard of stream processing, and the concept of the unification of stream and batch data processing is gradually gaining recognition and is being successfully implemented in more and more companies. ...

Continue reading »

Apache Flink Table Store 0.2.1 Release Announcement

October 13, 2022 - Jingsong Lee

The Apache Flink Community is pleased to announce the first bug fix release of the Flink Table Store 0.2 series. This release includes 13 bug fixes, vulnerability fixes, and minor improvements for Flink Table Store 0.2. Below you will find a list of all bugfixes and improvements. For a complete list of all changes see: JIRA. We highly recommend all users upgrade to Flink Table Store 0.2.1. Release Artifacts # Binaries # You can find the binaries on the updated Downloads page. ...

Continue reading »

Apache Flink Kubernetes Operator 1.2.0 Release Announcement

October 7, 2022 - Gyula Fora (@GyulaFora)

We are proud to announce the latest stable release of the operator. The 1.2.0 release adds support for the Standalone Kubernetes deployment mode and includes several improvements to the core logic. Release Highlights # Standalone deployment mode support Improved upgrade flow Readiness and liveness probes Flexible job jar handling Standalone deployment mode support # Until now the operator relied exclusively on Flink’s built-in Native Kubernetes integration to deploy and manage Flink clusters. ...

Continue reading »

Apache Flink 1.14.6 Release Announcement

September 28, 2022 - Xingbo Huang

The Apache Flink Community is pleased to announce another bug fix release for Flink 1.14. This release includes 34 bug fixes, vulnerability fixes and minor improvements for Flink 1.14. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. We highly recommend all users to upgrade to Flink 1.14.6. Release Artifacts # Maven Dependencies # <dependency> <groupId>org. ...

Continue reading »

Regarding Akka's licensing change

September 8, 2022 - Chesnay Schepler

On September 7th Lightbend announced a license change for the Akka project, the TL;DR being that you will need a commercial license to use future versions of Akka (2.7+) in production if you exceed a certain revenue threshold. Within a few hours of the announcement several people reached out to the Flink project, worrying about the impact this has on Flink, as we use Akka internally. The purpose of this blogpost is to clarify our position on the matter. ...

Continue reading »