Help us stabilize Apache Flink 1.14.0 RC0

August 31, 2021 - Johannes Moser

Hint Update 29th of September: Today Apache Flink 1.14 has been released. For sure we'd still like to hear your feedback. Dear Flink Community, we are excited to announce the first release candidate of Apache Flink 1.14. 🎉 A lot of features and fixes went into this release, including improvements to the unified batch and streaming experience, an increase in fault tolerance by reducing in-flight data, and more developments on connectors and components. ...

Continue reading »

Apache Flink 1.11.4 Released

August 9, 2021 - Xiaoling He

The Apache Flink community released the next bugfix version of the Apache Flink 1.11 series. This release includes 78 fixes and minor improvements for Flink 1.11.4. The list below includes a detailed list of all fixes and improvements. We highly recommend all users to upgrade to Flink 1.11.4. Updated Maven dependencies: <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.11.4</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.11.4</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <version>1.11.4</version> </dependency> You can find the binaries on the updated Downloads page. ...

Continue reading »

Apache Flink 1.12.5 Released

August 6, 2021 - Jingsong Lee

The Apache Flink community released the next bugfix version of the Apache Flink 1.12 series. This release includes 76 fixes and minor improvements for Flink 1.12.4. The list below includes a detailed list of all fixes and improvements. We highly recommend all users to upgrade to Flink 1.12.5. Updated Maven dependencies: <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.12.5</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.12.5</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <version>1.12.5</version> </dependency> You can find the binaries on the updated Downloads page. ...

Continue reading »

Apache Flink 1.13.2 Released

August 6, 2021 - Yun Tang

The Apache Flink community released the second bugfix version of the Apache Flink 1.13 series. This release includes 127 fixes and minor improvements for Flink 1.13.2. The list below includes bugfixes and improvements. For a complete list of all changes see: JIRA. We highly recommend all users to upgrade to Flink 1.13.2. Updated Maven dependencies: <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.13.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.13.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <version>1.13.2</version> </dependency> You can find the binaries on the updated Downloads page. ...

Continue reading »

How to identify the source of backpressure?

July 7, 2021 - Piotr Nowojski (@PiotrNowojski)

Backpressure monitoring in the web UI The backpressure topic was tackled from different angles over the last couple of years. However, when it comes to identifying and analyzing sources of backpressure, things have changed quite a bit in the recent Flink releases (especially with new additions to metrics and the web UI in Flink 1.13). This post will try to clarify some of these changes and go into more detail about how to track down the source of backpressure, but first… ...

Continue reading »

Apache Flink 1.13.1 Released

May 28, 2021 - Dawid Wysakowicz (@dwysakowicz)

The Apache Flink community released the first bugfix version of the Apache Flink 1.13 series. This release includes 82 fixes and minor improvements for Flink 1.13.1. The list below includes bugfixes and improvements. For a complete list of all changes see: JIRA. We highly recommend all users to upgrade to Flink 1.13.1. Updated Maven dependencies: <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.13.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.13.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <version>1.13.1</version> </dependency> You can find the binaries on the updated Downloads page. ...

Continue reading »

Apache Flink 1.12.4 Released

May 21, 2021 - Arvid Heise

The Apache Flink community released the next bugfix version of the Apache Flink 1.12 series. This release includes 21 fixes and minor improvements for Flink 1.12.3. The list below includes a detailed list of all fixes and improvements. We highly recommend all users to upgrade to Flink 1.12.4. Updated Maven dependencies: <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.12.4</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.12.4</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <version>1.12.4</version> </dependency> You can find the binaries on the updated Downloads page. ...

Continue reading »

Scaling Flink automatically with Reactive Mode

May 6, 2021 - Robert Metzger (@rmetzger_)

Introduction # Streaming jobs which run for several days or longer usually experience variations in workload during their lifetime. These variations can originate from seasonal spikes, such as day vs. night, weekdays vs. weekend or holidays vs. non-holidays, sudden events or simply the growing popularity of your product. Although some of these variations are more predictable than others, in all cases there is a change in job resource demand that needs to be addressed if you want to ensure the same quality of service for your customers. ...

Continue reading »

Apache Flink 1.13.0 Release Announcement

May 3, 2021 - Stephan Ewen (@StephanEwen) Dawid Wysakowicz (@dwysakowicz)

The Apache Flink community is excited to announce the release of Flink 1.13.0! More than 200 contributors worked on over 1,000 issues for this new version. The release brings us a big step forward in one of our major efforts: Making Stream Processing Applications as natural and as simple to manage as any other application. The new reactive scaling mode means that scaling streaming applications in and out now works like in any other application by just changing the number of parallel processes. ...

Continue reading »

Apache Flink 1.12.3 Released

April 29, 2021 - Arvid Heise

The Apache Flink community released the next bugfix version of the Apache Flink 1.12 series. This release includes 73 fixes and minor improvements for Flink 1.12.2. The list below includes a detailed list of all fixes and improvements. We highly recommend all users to upgrade to Flink 1.12.3. Updated Maven dependencies: <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.12.3</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.12.3</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <version>1.12.3</version> </dependency> You can find the binaries on the updated Downloads page. ...

Continue reading »