Apache Flink®

Stateful Computations over Data Streams

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. Flink has been designed to run in all common cluster environments, perform computations at in-memory speed and at any scale.

Flink Capabilities
Correctness guarantees

Exactly-once state consistency

Event-time processing

Sophisticated late data handling

Layered APIs

SQL on Stream & Batch Data

DataStream API

ProcessFunction (Time & State)

Operational focus

Flexible deployment

High-availability setup

Savepoints

Scalability

Scale-out architecture

Support for very large state

Incremental Checkpoints

Performance

Low latency

High throughput

In-Memory computing

Use Cases
Event Driven Applications

An event-driven application is a stateful application that ingests events from one or more event streams and reacts to incoming events by triggering computations, state updates, or external actions.

Stream & Batch Analytics

Analytical jobs extract information and insight from raw data. Apache Flink supports traditional batch queries on bounded data sets and real-time, continuous queries from unbounded, live data streams.

Data Pipelines & ETL

Extract-transform-load (ETL) is a common approach to convert and move data between storage systems.

Recent Flink blogs
Introducing the new Prometheus connector

December 5, 2024 - Lorenzo Nicora.

We are excited to announce a new sink connector that enables writing data to Prometheus (FLIP-312). This articles introduces the main features of the connector, and the reasoning behind design …

Continue reading
Apache Flink CDC 3.2.1 Release Announcement

November 27, 2024 - Hang Ruan.

The Apache Flink Community is pleased to announce the first bug fix release of the Flink CDC 3.2 series. The release contains fixes for several critical issues and improves compatibilities with Apache …

Continue reading
Introducing the new Amazon Kinesis Data Stream and Amazon DynamoDB Stream sources

November 25, 2024 - Hong Liang Teoh.

We are pleased to introduce updated versions of the Amazon Kinesis Data Stream and Amazon DynamoDB Stream sources. Built on the FLIP-27 source interface, these newer connectors introduce 7 new …

Continue reading