Apache Flink®

Stateful Computations over Data Streams

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. Flink has been designed to run in all common cluster environments, perform computations at in-memory speed and at any scale.

Flink Capabilities
Correctness guarantees

Exactly-once state consistency

Event-time processing

Sophisticated late data handling

Layered APIs

SQL on Stream & Batch Data

DataStream API

ProcessFunction (Time & State)

Operational focus

Flexible deployment

High-availability setup

Savepoints

Scalability

Scale-out architecture

Support for very large state

Incremental Checkpoints

Performance

Low latency

High throughput

In-Memory computing

Use Cases
Event Driven Applications

An event-driven application is a stateful application that ingests events from one or more event streams and reacts to incoming events by triggering computations, state updates, or external actions.

Stream & Batch Analytics

Analytical jobs extract information and insight from raw data. Apache Flink supports traditional batch queries on bounded data sets and real-time, continuous queries from unbounded, live data streams.

Data Pipelines & ETL

Extract-transform-load (ETL) is a common approach to convert and move data between storage systems.

Recent Flink blogs
Apache Flink CDC 3.2.1 Release Announcement

November 27, 2024 - Hang Ruan.

The Apache Flink Community is pleased to announce the first bug fix release of the Flink CDC 3.2 series. The release contains fixes for several critical issues and improves compatibilities with Apache …

Continue reading
Introducing the new Amazon Kinesis Data Stream and Amazon DynamoDB Stream sources

November 25, 2024 - Hong Liang Teoh.

We are pleased to introduce updated versions of the Amazon Kinesis Data Stream and Amazon DynamoDB Stream sources. Built on the FLIP-27 source interface, these newer connectors introduce 7 new …

Continue reading
Apache Flink Kubernetes Operator 1.10.0 Release Announcement

October 25, 2024 - Mate Czagany. Rui Fan.

The Apache Flink community is excited to announce the release of Flink Kubernetes Operator 1.10.0! The release includes several improvements to the autoscaler, and introduces a new Kubernetes custom …

Continue reading