From Aligned to Unaligned Checkpoints - Part 1: Checkpoints, Alignment, and Backpressure

15 Oct 2020 Arvid Heise & Stephan Ewen

Apache Flink’s checkpoint-based fault tolerance mechanism is one of its defining features. Because of that design, Flink unifies batch and stream processing, can easily scale to both very small and extremely large scenarios and provides support for many operational features. In this post we recap the original checkpointing process in Flink, its core properties and issues under backpressure.

Continue reading »

Stateful Functions 2.2.0 Release Announcement

28 Sep 2020 Tzu-Li (Gordon) Tai (@tzulitai) & Igal Shilman (@IgalShilman)

The Apache Flink community is happy to announce the release of Stateful Functions (StateFun) 2.2.0! This release introduces major features that extend the SDKs, such as support for asynchronous functions in the Python SDK, new persisted state constructs, and a new SDK that allows embedding StateFun functions within a Flink DataStream job. Moreover, we’ve also included important changes that improve out-of-the-box stability for common workloads, as well as increased observability for operational purposes.

Continue reading »

Flink Community Update - August'20

04 Sep 2020 Marta Paes (@morsapaes)

Ah, so much for a quiet August month. This time around, we bring you some new Flink Improvement Proposals (FLIPs), a preview of the upcoming Flink Stateful Functions 2.2 release and a look into how far Flink has come in comparison to 2019.

Continue reading »

  • Previous
  • Page: 1 of 14