Apache Flink® — Stateful Computations over Data Streams
All streaming use cases
- Event-driven Applications
- Stream & Batch Analytics
- Data Pipelines & ETL
Guaranteed correctness
- Exactly-once state consistency
- Event-time processing
- Sophisticated late data handling
Layered APIs
- SQL on Stream & Batch Data
- DataStream API & DataSet API
- ProcessFunction (Time & State)
Operational Focus
- Flexible deployment
- High-availability setup
- Savepoints
Scales to any use case
- Scale-out architecture
- Support for very large state
- Incremental checkpointing
Excellent Performance
- Low latency
- High throughput
- In-Memory computing
- From Aligned to Unaligned Checkpoints - Part 1: Checkpoints, Alignment, and Backpressure
- Apache Flink’s checkpoint-based fault tolerance mechanism is one of its defining features. Because of that design, Flink unifies batch and stream processing, can easily scale to both very small and extremely large scenarios and provides support for many operational features. In this post we recap the original checkpointing process in Flink, its core properties and issues under backpressure.
- Stateful Functions Internals: Behind the scenes of Stateful Serverless
- This blog post dives deep into the internals of the StateFun runtime, taking a look at how it enables consistent and fault-tolerant stateful serverless applications.
- Stateful Functions 2.2.0 Release Announcement
The Apache Flink community is happy to announce the release of Stateful Functions (StateFun) 2.2.0! This release introduces major features that extend the SDKs, such as support for asynchronous functions in the Python SDK, new persisted state constructs, and a new SDK that allows embedding StateFun functions within a Flink DataStream job. Moreover, we’ve also included important changes that improve out-of-the-box stability for common workloads, as well as increased observability for operational purposes.
- Apache Flink 1.11.2 Released
The Apache Flink community released the second bugfix version of the Apache Flink 1.11 series.
- Flink Community Update - August'20
- Ah, so much for a quiet August month. This time around, we bring you some new Flink Improvement Proposals (FLIPs), a preview of the upcoming Flink Stateful Functions 2.2 release and a look into how far Flink has come in comparison to 2019.