Apache Flink 1.5.1 Released

July 12, 2018 -

The Apache Flink community released the first bugfix version of the Apache Flink 1.5 series.

This release includes more than 60 fixes and minor improvements for Flink 1.5.0. The list below includes a detailed list of all fixes.

We highly recommend all users to upgrade to Flink 1.5.1.

Updated Maven dependencies:

<dependency>
  <groupId>org.apache.flink</groupId>
  <artifactId>flink-java</artifactId>
  <version>1.5.1</version>
</dependency>
<dependency>
  <groupId>org.apache.flink</groupId>
  <artifactId>flink-streaming-java_2.11</artifactId>
  <version>1.5.1</version>
</dependency>
<dependency>
  <groupId>org.apache.flink</groupId>
  <artifactId>flink-clients_2.11</artifactId>
  <version>1.5.1</version>
</dependency>

You can find the binaries on the updated Downloads page.

List of resolved issues:

Sub-task

  • [FLINK-8977] - End-to-end test: Manually resume job after terminal failure
  • [FLINK-8982] - End-to-end test: Queryable state
  • [FLINK-8989] - End-to-end test: ElasticSearch connector
  • [FLINK-8996] - Include an operator with broadcast and union state
  • [FLINK-9008] - End-to-end test: Quickstarts
  • [FLINK-9320] - Update `test-ha.sh` end-to-end test to use general purpose DataStream job
  • [FLINK-9322] - Add exception throwing map function that simulates failures to the general purpose DataStream job
  • [FLINK-9394] - Let externalized checkpoint resume e2e also test rescaling

Bug

  • [FLINK-8785] - JobSubmitHandler does not handle JobSubmissionExceptions
  • [FLINK-8795] - Scala shell broken for Flip6
  • [FLINK-8946] - TaskManager stop sending metrics after JobManager failover
  • [FLINK-9174] - The type of state created in ProccessWindowFunction.proccess() is inconsistency
  • [FLINK-9215] - TaskManager Releasing - org.apache.flink.util.FlinkException
  • [FLINK-9257] - End-to-end tests prints "All tests PASS" even if individual test-script returns non-zero exit code
  • [FLINK-9258] - ConcurrentModificationException in ComponentMetricGroup.getAllVariables
  • [FLINK-9326] - TaskManagerOptions.NUM_TASK_SLOTS does not work for local/embedded mode
  • [FLINK-9374] - Flink Kinesis Producer does not backpressure
  • [FLINK-9398] - Flink CLI list running job returns all jobs except in CREATE state
  • [FLINK-9437] - Revert cypher suite update
  • [FLINK-9458] - Unable to recover from job failure on YARN with NPE
  • [FLINK-9467] - No Watermark display on Web UI
  • [FLINK-9468] - Wrong calculation of outputLimit in LimitedConnectionsFileSystem
  • [FLINK-9493] - Forward exception when releasing a TaskManager at the SlotPool
  • [FLINK-9494] - Race condition in Dispatcher with concurrent granting and revoking of leaderhship
  • [FLINK-9500] - FileUploadHandler does not handle EmptyLastHttpContent
  • [FLINK-9524] - NPE from ProcTimeBoundedRangeOver.scala
  • [FLINK-9530] - Task numRecords metrics broken for chains
  • [FLINK-9554] - flink scala shell doesn't work in yarn mode
  • [FLINK-9567] - Flink does not release resource in Yarn Cluster mode
  • [FLINK-9570] - SQL Client merging environments uses AbstractMap
  • [FLINK-9580] - Potentially unclosed ByteBufInputStream in RestClient#readRawResponse
  • [FLINK-9627] - Extending 'KafkaJsonTableSource' according to comments will result in NPE
  • [FLINK-9629] - Datadog metrics reporter does not have shaded dependencies
  • [FLINK-9633] - Flink doesn't use the Savepoint path's filesystem to create the OuptutStream on Task.
  • [FLINK-9634] - Deactivate previous location based scheduling if local recovery is disabled
  • [FLINK-9636] - Network buffer leaks in requesting a batch of segments during canceling
  • [FLINK-9646] - ExecutionGraphCoLocationRestartTest.testConstraintsAfterRestart failed on Travis
  • [FLINK-9654] - Internal error while deserializing custom Scala TypeSerializer instances
  • [FLINK-9655] - Externalized checkpoint E2E test fails on travis
  • [FLINK-9665] - PrometheusReporter does not properly unregister metrics
  • [FLINK-9676] - Deadlock during canceling task and recycling exclusive buffer
  • [FLINK-9677] - RestClient fails for large uploads
  • [FLINK-9684] - HistoryServerArchiveFetcher not working properly with secure hdfs cluster
  • [FLINK-9693] - Possible memory leak in jobmanager retaining archived checkpoints
  • [FLINK-9708] - Network buffer leaks when buffer request fails during buffer redistribution
  • [FLINK-9769] - FileUploads may be shared across requests
  • [FLINK-9770] - UI jar list broken
  • [FLINK-9789] - Watermark metrics for an operator&task shadow each other

New Feature

  • [FLINK-9153] - TaskManagerRunner should support rpc port range
  • [FLINK-9280] - Extend JobSubmitHandler to accept jar files
  • [FLINK-9316] - Expose operator unique ID to the user defined functions in DataStream .
  • [FLINK-9564] - Expose end-to-end module directory to test scripts
  • [FLINK-9599] - Implement generic mechanism to receive files via rest
  • [FLINK-9669] - Introduce task manager assignment store
  • [FLINK-9670] - Introduce slot manager factory
  • [FLINK-9671] - Add configuration to enable task manager isolation.

Improvement

  • [FLINK-4301] - Parameterize Flink version in Quickstart bash script
  • [FLINK-8650] - Add tests and documentation for WINDOW clause
  • [FLINK-8654] - Extend quickstart docs on how to submit jobs
  • [FLINK-9109] - Add flink modify command to documentation
  • [FLINK-9355] - Simplify configuration of local recovery to a simple on/off
  • [FLINK-9372] - Typo on Elasticsearch website link (elastic.io --> elastic.co)
  • [FLINK-9409] - Remove flink-avro and flink-json from /opt
  • [FLINK-9456] - Let ResourceManager notify JobManager about failed/killed TaskManagers
  • [FLINK-9508] - General Spell Check on Flink Docs
  • [FLINK-9517] - Fixing broken links on CLI and Upgrade Docs
  • [FLINK-9518] - SSL setup Docs config example has wrong keys password
  • [FLINK-9549] - Fix FlickCEP Docs broken link and minor style changes
  • [FLINK-9573] - Check for leadership with leader session id
  • [FLINK-9594] - Add documentation for e2e test changes introduced with FLINK-9257
  • [FLINK-9595] - Add instructions to docs about ceased support of KPL version used in Kinesis connector
  • [FLINK-9638] - Add helper script to run single e2e test
  • [FLINK-9672] - Fail fatally if we cannot submit job on added JobGraph signal
  • [FLINK-9707] - LocalFileSystem does not support concurrent directory creations
  • [FLINK-9729] - Duplicate lines for "Weekday name (Sunday .. Saturday)"
  • [FLINK-9734] - Typo 'field-deleimiter' in SQL client docs

Want to contribute translation?

Edit This Page