Apache Flink® - 数据流上的有状态计算

  • 事件驱动应用
  • 流批分析
  • 数据管道 & ETL
  • Exactly-once 状态一致性
  • 事件时间处理
  • 成熟的迟到数据处理
分层 API
  • SQL on Stream & Batch Data
  • DataStream API & DataSet API
  • ProcessFunction (Time & State)
  • 灵活部署
  • 高可用
  • 保存点
  • 水平扩展架构
  • 支持超大状态
  • 增量检查点机制
  • 低延迟
  • 高吞吐
  • 内存计算

Apache Flink 1.14.0 Release Announcement
The Apache Flink community is excited to announce the release of Flink 1.14.0! More than 200 contributor worked on over 1,000 issues. The release brings exciting new features like a more seamless streaming/batch integration, automatic network memory tuning, a hybrid source to switch data streams between storgage systems (e.g., Kafka/S3), Fine-grained resource management, PyFlink performance and debugging enhancements, and a Pulsar connector.
Implementing a custom source connector for Table API and SQL - Part Two

In part one of this tutorial, you learned how to build a custom source connector for Flink. In part two, you will learn how to integrate the connector with a test email inbox through the IMAP protocol and filter out emails using Flink SQL.

Implementing a Custom Source Connector for Table API and SQL - Part One

Part one of this tutorial will teach you how to build and run a custom source connector to be used with Table API and SQL, two high-level abstractions in Flink. The tutorial comes with a bundled docker-compose setup that lets you easily run the connector. You can then try it out with Flink’s SQL client.

Stateful Functions 3.1.0 Release Announcement

Stateful Functions is a cross-platform stack for building Stateful Serverless applications, making it radically simpler to develop scalable, consistent, and elastic distributed applications. This new release brings various improvements to the StateFun runtime, a leaner way to specify StateFun module components, and a brand new GoLang SDK!

Help us stabilize Apache Flink 1.14.0 RC0

Update 29th of September: Today Apache Flink 1.14 has been released. For sure we'd still like to hear your feedback.