Apache Flink® — Stateful Computations over Data Streams

All streaming use cases
  • Event-driven Applications
  • Stream & Batch Analytics
  • Data Pipelines & ETL
Learn more
Guaranteed correctness
  • Exactly-once state consistency
  • Event-time processing
  • Sophisticated late data handling
Learn more
Layered APIs
  • SQL on Stream & Batch Data
  • DataStream API & DataSet API
  • ProcessFunction (Time & State)
Learn more
Operational Focus
  • Flexible deployment
  • High-availability setup
  • Savepoints
Learn more
Scales to any use case
  • Scale-out architecture
  • Support for very large state
  • Incremental checkpointing
Learn more
Excellent Performance
  • Low latency
  • High throughput
  • In-Memory computing
Learn more

Accelerating your workload with GPU and other external resources
This post introduces the new External Resource Framework in Flink 1.11 and take GPU as an example to show how to accelerate your workload with external resources.
PyFlink: The integration of Pandas into PyFlink
The Apache Flink community put some great effort into integrating Pandas with PyFlink in the latest Flink version 1.11. Some of the added features include support for Pandas UDF and the conversion between Pandas DataFrame and Table. In this article, we will introduce how these functionalities work and how to use them with a step-by-step example.
Advanced Flink Application Patterns Vol.3: Custom Window Processing
In this series of blog posts you will learn about powerful Flink patterns for building streaming applications.
Flink SQL Demo: Building an End-to-End Streaming Application
Apache Flink 1.11 has released many exciting new features, including many developments in Flink SQL which is evolving at a fast pace. This article takes a closer look at how to quickly build streaming applications with Flink SQL from a practical point of view.
Flink Community Update - July'20
As July draws to an end, we look back at a monthful of activity in the Flink community, including two releases (!) and some work around improving the first-time contribution experience in the project. Also, events are starting to pick up again, so we've put together a list of some great events you can (virtually) attend in August!