Apache Flink 1.11.2 Released
September 17, 2020 - Zhu Zhu (@zhuzhv)The Apache Flink community released the second bugfix version of the Apache Flink 1.11 series.
This release includes 96 fixes and minor improvements for Flink 1.11.1. The list below includes a detailed list of all fixes and improvements.
We highly recommend all users to upgrade to Flink 1.11.2.
Updated Maven dependencies:
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.11.2</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.11.2</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId>
<version>1.11.2</version>
</dependency>
You can find the binaries on the updated Downloads page.
List of resolved issues:
Sub-task
- [FLINK-16087] - Translate "Detecting Patterns" page of "Streaming Concepts" into Chinese
- [FLINK-18264] - Translate the "External Resource Framework" page into Chinese
- [FLINK-18628] - Invalid error message for overloaded methods with same parameter name
- [FLINK-18801] - Add a "10 minutes to Table API" document under the "Python API" -> "User Guide" -> "Table API" section
- [FLINK-18910] - Create the new document structure for Python documentation according to FLIP-133
- [FLINK-18912] - Add a Table API tutorial link(linked to try-flink/python_table_api.md) under the "Python API" -> "GettingStart" -> "Tutorial" section
- [FLINK-18913] - Add a "TableEnvironment" document under the "Python API" -> "User Guide" -> "Table API" section
- [FLINK-18917] - Add a "Built-in Functions" link (linked to dev/table/functions/systemFunctions.md) under the "Python API" -> "User Guide" -> "Table API" section
- [FLINK-19110] - Flatten current PyFlink documentation structure
Bug
- [FLINK-14087] - throws java.lang.ArrayIndexOutOfBoundsException when emiting the data using RebalancePartitioner.
- [FLINK-15467] - Should wait for the end of the source thread during the Task cancellation
- [FLINK-16510] - Task manager safeguard shutdown may not be reliable
- [FLINK-16827] - StreamExecTemporalSort should require a distribution trait in StreamExecTemporalSortRule
- [FLINK-18081] - Fix broken links in "Kerberos Authentication Setup and Configuration" doc
- [FLINK-18212] - Init lookup join failed when use udf on lookup table
- [FLINK-18341] - Building Flink Walkthrough Table Java 0.1 COMPILATION ERROR
- [FLINK-18421] - Elasticsearch (v6.3.1) sink end-to-end test instable
- [FLINK-18468] - TaskExecutorITCase.testJobReExecutionAfterTaskExecutorTermination fails with DuplicateJobSubmissionException
- [FLINK-18552] - Update migration tests in master to cover migration from release-1.11
- [FLINK-18581] - Cannot find GC cleaner with java version previous jdk8u72(-b01)
- [FLINK-18588] - hive ddl create table should support 'if not exists'
- [FLINK-18595] - Deadlock during job shutdown
- [FLINK-18600] - Kerberized YARN per-job on Docker test failed to download JDK 8u251
- [FLINK-18608] - CustomizedConvertRule#convertCast drops nullability
- [FLINK-18612] - WordCount example failure when setting relative output path
- [FLINK-18632] - RowData's row kind do not assigned from input row data when sink code generate and physical type info is pojo type
- [FLINK-18639] - Error messages from BashJavaUtils are eaten
- [FLINK-18641] - "Failure to finalize checkpoint" error in MasterTriggerRestoreHook
- [FLINK-18646] - Managed memory released check can block RPC thread
- [FLINK-18650] - The description of dispatcher in Flink Architecture document is not accurate
- [FLINK-18655] - Set failOnUnableToExtractRepoInfo to false for git-commit-id-plugin in module flink-runtime
- [FLINK-18656] - Start Delay metric is always zero for unaligned checkpoints
- [FLINK-18659] - FileNotFoundException when writing Hive orc tables
- [FLINK-18663] - RestServerEndpoint may prevent server shutdown
- [FLINK-18665] - Filesystem connector should use TableSchema exclude computed columns
- [FLINK-18672] - Fix Scala code examples for UDF type inference annotations
- [FLINK-18677] - ZooKeeperLeaderRetrievalService does not invalidate leader in case of SUSPENDED connection
- [FLINK-18682] - Vector orc reader cannot read Hive 2.0.0 table
- [FLINK-18697] - Adding flink-table-api-java-bridge_2.11 to a Flink job kills the IDE logging
- [FLINK-18700] - Debezium-json format throws Exception when PG table's IDENTITY config is not FULL
- [FLINK-18705] - Debezium-JSON throws NPE when tombstone message is received
- [FLINK-18708] - The links of the connector sql jar of Kafka 0.10 and 0.11 are extinct
- [FLINK-18710] - ResourceProfileInfo is not serializable
- [FLINK-18748] - Savepoint would be queued unexpected if pendingCheckpoints less than maxConcurrentCheckpoints
- [FLINK-18749] - Correct dependencies in Kubernetes pom
- [FLINK-18750] - SqlValidatorException thrown when select from a view which contains a UDTF call
- [FLINK-18769] - MiniBatch doesn't work with FLIP-95 source
- [FLINK-18821] - Netty client retry mechanism may cause PartitionRequestClientFactory#createPartitionRequestClient to wait infinitely
- [FLINK-18832] - BoundedBlockingSubpartition does not work with StreamTask
- [FLINK-18856] - CheckpointCoordinator ignores checkpointing.min-pause
- [FLINK-18859] - ExecutionGraphNotEnoughResourceTest.testRestartWithSlotSharingAndNotEnoughResources failed with "Condition was not met in given timeout."
- [FLINK-18862] - Fix LISTAGG throws BinaryRawValueData cannot be cast to StringData exception in runtime
- [FLINK-18867] - Generic table stored in Hive catalog is incompatible between 1.10 and 1.11
- [FLINK-18900] - HiveCatalog should error out when listing partitions with an invalid spec
- [FLINK-18902] - Cannot serve results of asynchronous REST operations in per-job mode
- [FLINK-18941] - There are some typos in "Set up JobManager Memory"
- [FLINK-18942] - HiveTableSink shouldn't try to create BulkWriter factory when using MR writer
- [FLINK-18956] - StreamTask.invoke should catch Throwable instead of Exception
- [FLINK-18959] - Fail to archiveExecutionGraph because job is not finished when dispatcher close
- [FLINK-18992] - Table API renameColumns method annotation error
- [FLINK-18993] - Invoke sanityCheckTotalFlinkMemory method incorrectly in JobManagerFlinkMemoryUtils.java
- [FLINK-18994] - There is one typo in "Set up TaskManager Memory"
- [FLINK-19040] - SourceOperator is not closing SourceReader
- [FLINK-19061] - HiveCatalog fails to get partition column stats if partition value contains special characters
- [FLINK-19094] - Revise the description of watermark strategy in Flink Table document
- [FLINK-19108] - Stop expanding the identifiers with scope aliased by the system with 'EXPR$' prefix
- [FLINK-19109] - Split Reader eats chained periodic watermarks
- [FLINK-19121] - Avoid accessing HDFS frequently in HiveBulkWriterFactory
- [FLINK-19133] - User provided kafka partitioners are not initialized correctly
- [FLINK-19148] - Table crashed in Flink Table API & SQL Docs
- [FLINK-19166] - StreamingFileWriter should register Listener before the initialization of buckets
Improvement
- [FLINK-16619] - Misleading SlotManagerImpl logging for slot reports of unknown task manager
- [FLINK-17075] - Add task status reconciliation between TM and JM
- [FLINK-17285] - Translate "Python Table API" page into Chinese
- [FLINK-17503] - Make memory configuration logging more user-friendly
- [FLINK-18598] - Add instructions for asynchronous execute in PyFlink doc
- [FLINK-18618] - Docker e2e tests are failing on CI
- [FLINK-18619] - Update training to use WatermarkStrategy
- [FLINK-18635] - Typo in 'concepts/timely stream processing' part of the website
- [FLINK-18643] - Migrate Jenkins jobs to ci-builds.apache.org
- [FLINK-18644] - Remove obsolete doc for hive connector
- [FLINK-18730] - Remove Beta tag from SQL Client docs
- [FLINK-18772] - Hide submit job web ui elements when running in per-job/application mode
- [FLINK-18793] - Fix Typo for api.common.eventtime.WatermarkStrategy Description
- [FLINK-18797] - docs and examples use deprecated forms of keyBy
- [FLINK-18816] - Correct API usage in Pyflink Dependency Management page
- [FLINK-18831] - Improve the Python documentation about the operations in Table
- [FLINK-18839] - Add documentation about how to use catalog in Python Table API
- [FLINK-18847] - Add documentation about data types in Python Table API
- [FLINK-18849] - Improve the code tabs of the Flink documents
- [FLINK-18881] - Modify the Access Broken Link
- [FLINK-19055] - MemoryManagerSharedResourcesTest contains three tests running extraordinary long
- [FLINK-19105] - Table API Sample Code Error
Task
- [FLINK-18666] - Update japicmp configuration for 1.11.1
- [FLINK-18667] - Data Types documentation misunderstand users
- [FLINK-18678] - Hive connector fails to create vector orc reader if user specifies incorrect hive version