Apache Flink 1.8.1 Released

02 Jul 2019 Jincheng Sun (@sunjincheng121)

The Apache Flink community released the first bugfix version of the Apache Flink 1.8 series.

This release includes more than 40 fixes and minor improvements for Flink 1.8.1. The list below includes a detailed list of all improvements, sub-tasks and bug fixes.

We highly recommend all users to upgrade to Flink 1.8.1.

Updated Maven dependencies:

<dependency>
  <groupId>org.apache.flink</groupId>
  <artifactId>flink-java</artifactId>
  <version>1.8.1</version>
</dependency>
<dependency>
  <groupId>org.apache.flink</groupId>
  <artifactId>flink-streaming-java_2.11</artifactId>
  <version>1.8.1</version>
</dependency>
<dependency>
  <groupId>org.apache.flink</groupId>
  <artifactId>flink-clients_2.11</artifactId>
  <version>1.8.1</version>
</dependency>

You can find the binaries on the updated Downloads page.

List of resolved issues:

Sub-task

  • [FLINK-10921] - Prioritize shard consumers in Kinesis Consumer by event time
  • [FLINK-12617] - StandaloneJobClusterEntrypoint should default to random JobID for non-HA setups

Bug

  • [FLINK-9445] - scala-shell uses plain java command
  • [FLINK-10455] - Potential Kafka producer leak in case of failures
  • [FLINK-10941] - Slots prematurely released which still contain unconsumed data
  • [FLINK-11059] - JobMaster may continue using an invalid slot if releasing idle slot meet a timeout
  • [FLINK-11107] - Avoid memory stateBackend to create arbitrary folders under HA path when no checkpoint path configured
  • [FLINK-11897] - ExecutionGraphSuspendTest does not wait for all tasks to be submitted
  • [FLINK-11915] - DataInputViewStream skip returns wrong value
  • [FLINK-11987] - Kafka producer occasionally throws NullpointerException
  • [FLINK-12009] - Wrong check message about heartbeat interval for HeartbeatServices
  • [FLINK-12042] - RocksDBStateBackend mistakenly uses default filesystem
  • [FLINK-12112] - AbstractTaskManagerProcessFailureRecoveryTest process output logging does not work properly
  • [FLINK-12132] - The example in /docs/ops/deployment/yarn_setup.md should be updated due to the change FLINK-2021
  • [FLINK-12184] - HistoryServerArchiveFetcher isn't compatible with old version
  • [FLINK-12219] - Yarn application can't stop when flink job failed in per-job yarn cluster mode
  • [FLINK-12247] - fix NPE when writing an archive file to a FileSystem
  • [FLINK-12260] - Slot allocation failure by taskmanager registration timeout and race
  • [FLINK-12296] - Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task
  • [FLINK-12297] - Make ClosureCleaner recursive
  • [FLINK-12301] - Scala value classes inside case classes cannot be serialized anymore in Flink 1.8.0
  • [FLINK-12342] - Yarn Resource Manager Acquires Too Many Containers
  • [FLINK-12375] - flink-container job jar does not have read permissions
  • [FLINK-12416] - Docker build script fails on symlink creation ln -s
  • [FLINK-12544] - Deadlock while releasing memory and requesting segment concurrent in SpillableSubpartition
  • [FLINK-12547] - Deadlock when the task thread downloads jars using BlobClient
  • [FLINK-12646] - Use reserved IP as unrouteable IP in RestClientTest
  • [FLINK-12688] - Make serializer lazy initialization thread safe in StateDescriptor
  • [FLINK-12740] - SpillableSubpartitionTest deadlocks on Travis
  • [FLINK-12835] - Time conversion is wrong in ManualClock
  • [FLINK-12863] - Race condition between slot offerings and AllocatedSlotReport
  • [FLINK-12865] - State inconsistency between RM and TM on the slot status
  • [FLINK-12871] - Wrong SSL setup examples in docs
  • [FLINK-12895] - TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure failed on travis
  • [FLINK-12896] - TaskCheckpointStatisticDetailsHandler uses wrong value for JobID when archiving

Improvement

  • [FLINK-11126] - Filter out AMRMToken in the TaskManager credentials
  • [FLINK-12137] - Add more proper explanation on flink streaming connectors
  • [FLINK-12169] - Improve Javadoc of MessageAcknowledgingSourceBase
  • [FLINK-12378] - Consolidate FileSystem Documentation
  • [FLINK-12391] - Add timeout to transfer.sh
  • [FLINK-12539] - StreamingFileSink: Make the class extendable to customize for different usecases

Test

  • [FLINK-12350] - RocksDBStateBackendTest doesn't cover the incremental checkpoint code path

Task

  • [FLINK-12460] - Change taskmanager.tmp.dirs to io.tmp.dirs in configuration docs