Apache Flink 1.4.1 Released

February 15, 2018 -

The Apache Flink community released the first bugfix version of the Apache Flink 1.4 series. This release includes more than 60 fixes and minor improvements for Flink 1.4.0. The list below includes a detailed list of all fixes. We highly recommend all users to upgrade to Flink 1.4.1. Updated Maven dependencies: <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.4.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.4.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <version>1.4.1</version> </dependency> You can find the binaries on the updated Downloads page. ...

Continue reading »

Managing Large State in Apache Flink: An Intro to Incremental Checkpointing

January 30, 2018 - Stefan Ricther (@StefanRRicther) Chris Ward (@chrischinch)

Apache Flink was purpose-built for stateful stream processing. However, what is state in a stream processing application? I defined state and stateful stream processing in a previous blog post, and in case you need a refresher, state is defined as memory in an application’s operators that stores information about previously-seen events that you can use to influence the processing of future events. State is a fundamental, enabling concept in stream processing required for a majority of complex use cases. ...

Continue reading »

Apache Flink in 2017: Year in Review

December 21, 2017 - Chris Ward (@chrischinch) Mike Winters (@wints)

2017 was another exciting year for the Apache Flink® community, with 3 major version releases (Flink 1.2.0 in February, Flink 1.3.0 in June, and Flink 1.4.0 in December) and the first-ever Flink Forward in San Francisco, giving Flink community members in another corner of the globe an opportunity to connect. Users shared details about their innovative production deployments, redefining what is possible with a modern stream processing framework like Flink. ...

Continue reading »

Apache Flink 1.4.0 Release Announcement

December 12, 2017 - Aljoscha Krettek (@aljoscha) Mike Winters (@wints)

The Apache Flink community is pleased to announce the 1.4.0 release. Over the past 5 months, the Flink community has been working hard to resolve more than 900 issues. See the complete changelog for more detail. This is the fifth major release in the 1.x.y series. It is API-compatible with the other 1.x.y releases for APIs annotated with the @Public annotation. We encourage everyone to download the release and check out the documentation. ...

Continue reading »

Looking Ahead to Apache Flink 1.4.0 and 1.5.0

November 21, 2017 - Stephan Ewen (@StephanEwen) Aljoscha Krettek (@aljoscha) Mike Winters (@wints)

The Apache Flink 1.4.0 release is on track to happen in the next couple of weeks, and for all of the readers out there who haven’t been following the release discussion on Flink’s developer mailing list, we’d like to provide some details on what’s coming in Flink 1.4.0 as well as a preview of what the Flink community will save for 1.5.0. Both releases include ambitious features that we believe will move Flink to an entirely new level in terms of the types of problems it can solve and applications it can support. ...

Continue reading »

Apache Flink 1.3.2 Released

August 5, 2017 -

The Apache Flink community released the second bugfix version of the Apache Flink 1.3 series. This release includes more than 60 fixes and minor improvements for Flink 1.3.1. The list below includes a detailed list of all fixes. We highly recommend all users to upgrade to Flink 1.3.2. Important Notice: A user reported a bug in the FlinkKafkaConsumer (FLINK-7143) that is causing incorrect partition assignment in large Kafka deployments in the presence of inconsistent broker metadata. ...

Continue reading »

A Deep Dive into Rescalable State in Apache Flink

July 4, 2017 -

Apache Flink 1.2.0, released in February 2017, introduced support for rescalable state. This post provides a detailed overview of stateful stream processing and rescalable state in Flink. An Intro to Stateful Stream Processing # At a high level, we can consider state in stream processing as memory in operators that remembers information about past input and can be used to influence the processing of future input. In contrast, operators in stateless stream processing only consider their current inputs, without further context and knowledge about the past. ...

Continue reading »

Apache Flink 1.3.1 Released

June 23, 2017 -

The Apache Flink community released the first bugfix version of the Apache Flink 1.3 series. This release includes 50 fixes and minor improvements for Flink 1.3.0. The list below includes a detailed list of all fixes. We highly recommend all users to upgrade to Flink 1.3.1. <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.3.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.10</artifactId> <version>1.3.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.10</artifactId> <version>1.3.1</version> </dependency> You can find the binaries on the updated Downloads page. ...

Continue reading »

Apache Flink 1.3.0 Release Announcement

June 1, 2017 -

The Apache Flink community is pleased to announce the 1.3.0 release. Over the past 4 months, the Flink community has been working hard to resolve more than 680 issues. See the complete changelog for more detail. This is the fourth major release in the 1.x.y series. It is API compatible with the other 1.x.y releases for APIs annotated with the @Public annotation. Users can expect Flink releases now in a 4 month cycle. ...

Continue reading »

Introducing Docker Images for Apache Flink

May 16, 2017 -

For some time, the Apache Flink community has provided scripts to build a Docker image to run Flink. Now, starting with version 1.2.1, Flink will have a Docker image on the Docker Hub. This image is maintained by the Flink community and curated by the Docker team to ensure it meets the quality standards for container images of the Docker community. A community-maintained way to run Apache Flink on Docker and other container runtimes and orchestrators is part of the ongoing effort by the Flink community to make Flink a first-class citizen of the container world. ...

Continue reading »