You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This document lists the new features, enhancements, fixed issues and, removed or deprecated features for Hazelcast Platform 5.4.0 release. The numbers in the square brackets refer to the issues and pull requests in Hazelcast's GitHub repository.
[!CAUTION]
Starting with this release of Hazelcast Platform, the minimum supported Java version is 17.
New Features
EnterpriseUser Code Namespaces: Enable deployment and redeployment of your custom classes. See the User Code Namespaces documentation.
EnterpriseCPMap: Added CPMap as a minimal key-value CP data structure. See CPMap documentation. [#25802]
EnterpriseThread-Per-Core (TPC): TPC is now generally available. You can enable this feature on the clients and cluster members for improved performance. See the Thread-Per-Core (TPC) documentation.
Breaking Changes
The MergingValue interface within the SPI package now requires the getDeserializedValue() method to be defined within implementations, replacing the getValue() definition. [#25942]
Moved the MongoDB connector to the extensions module, that is, its classes and related dependencies relocated;
if you are using Maven to install the connector, you must add <classifier>jar-with-dependencies</classifier> to your pom.xml. Also removed the permissions for MongoDB connector. [#25744], [#25701]
Method names used as parameters in SecurityInterceptor checks were reviewed and unified into a single place - class com.hazelcast.security.SecurityInterceptorConstants. Some client messages have the method name changed to reflect their purpose better. Some client messages are newly covered by SecurityInterceptor checks now. [#25020]
Renamed the service port for Hazelcast clusters deployed in Kubernetes environments to hazelcast.
The previous name, hazelcast-service-port, caused member auto-discovery for embedded deployments to fail. [#24834], [#24705], [#24688]
Fixed an issue where Hazelcast was not failing fast when a member is started with a blank public address. This has been fixed by introducing a configuration validation that might break any existing, but invalid, configuration. [#24729]
Enhancements
SQL/Jet Engine
Removed the beta annotations from the data connection classes. [#26000]
Replaced the user-defined types (UDTs) feature flag with the cyclic UDT feature flag, to prevent querying such type data. [#25977]
Added support for loading and storing a single column as the value using the GenericMapStore. [#25878]
Each Jet engine job was creating a client for connecting to the remote cluster, resulting in an excessive number of clients. This has been fixed by introducing a single data connection, which can be reused for all job instances. [#25754], [#25731]
Added support for resolving fields from Avro schemas in Kafka mappings. [#25935]
Changed the exception type from CancellationException to CancellationByUserException when the user cancels a job before it is initialized. [#25383]
Added nested field support for Avro serialization format. [#25269]
Removed the redundant sort and merge operations in sorted index scans, for the computations where the index order is not needed, for example, aggregations. [#25180]
Updated the data comparator to improve the performance of sorted index operations. [#25196]
Added support for partition pruning for the __key filters. [#25105]
Added support for partitioned edges in Jet engine's partition pruning. [#25062]
Added a new mechanism to compute the required partitions to be scanned, if attribute partitioning strategy is applied. [#25006]
Added the condition type to the EXPLAIN PLAN statement outputs for all physical joins. [#24899]
Added support for nullable types when reading Avro files. [#24840]
Added the ability to pass parameters for JDBC configuration, such as the fetch size for large tables. [#24835]
Added support for partition pruning for SQL queries that have trivial filter predicates. [#24813]
Reflected the change of javax.jms to jakarta.jms in Hazelcast distributions. [#24804]
Added support for member pruning for Platform jobs to optimize a job's performance by picking up only the members required for the job. [#24689]
Added the stream() method to the SQL service to return the stream of result rows. [#24525]
Introduced a new configuration object to control the exact initial partition offsets when consuming records from Kafka via the Jet engine. [#21546]
Aligned the behavior of hashCode() method of KeyedWindowResult with that of Map.Entry. #697
Boxing of partitionId is now avoided in the getPartitionAssignment() method when the partition pruning is not used. #486
Added the ability to limit the creation of objects through reflection. #296
Added the ability to use reusable processor meta supplier for forceTotalParallelismOne () on random members without permissions. #227
Added a comparator for the High-Density Memory Store's index entries. Previously, on-heap entries comparators were used which causes incorrect query outputs. #52
Connectors
Implemented a new SQL mapping option to define the preferred local parallelism for connectors that support this configuration. Currently, only the Kafka connector supports this. See Creating a Kafka Mapping for example configurations. [#26194]
Removed the beta annotations from the MongoDB classes. [#25743]
Added TLS support for MongoDB data connections. [#25301]
Added Oracle database support to the JDBC SQL connector. [#25255]
Added support for inline Avro schemas for Kafka mappings. [#25207]
Added support for DataSerializable serialization to Mongo connector. [#25197]
Check for existing resources for Mongo connector is now done only once; previously, it was performed on every processor. [#24953]
Hazelcast JDBC connector now supports Microsoft SQL server. [#25071]
Added check for negative positions on the collections' getItemAtPositionOrNull() method. [#25672]
Introduced a cluster state check to improve the removal of expired map/cache entries from the cluster. The removal operation is no longer executed if the cluster is in passive state. [#24808]
Added the IMap.localValues() and IMap.localValues(Predicate) methods for a faster access to locally owned values in maps. [#24763]
Added the deleteAsync() for maps to asynchronously remove a provided map entry key. [#23509]
Fixed the Javadoc for caches where it was referring incorrectly to statistics instead of management, for the setManagementEnabled() method. [#22575]
Added the getCPObjectInfos() method to create a snapshot of all existing CP objects for a given service on the group leader. #615
Added the getCPGroupIds() method to the CP Subsystem API to allow listing all data structures within a CP group. #591
The "last update time" record of the map entries recovered from the disk persistence is not used anymore when calculating the entries' expiration times. #233
Enterprise Added the ability to check whether the ADVANCED_CP feature is present in the Hazelcast Platform Enterprise license, to enable CPMap. #157
Enterprise WAN Replication
Improved dead connection handling for WAN replication static IP discovery, by introducing health check to the discovery strategy. [#25364]
Added support for the dynamic adding of WAN replication configurations using Java API. [#25118]
Added support for evicting map and cache entries through WAN replication by introducing two new properties. When enabled, WAN replication events are fired when values are evicted from the map and cache objects. See Replicating IMap/ICache Evictions. [#24941]
Enterprise Security
Added the ability to check map permissions before suggesting a schema. If a client has permission to read a map, then a suggestion with schema is sent. Otherwise a warning that no permissions to read maps have been set is generated. [#26058]
Updated permission checks in CacheCreateConfig and GetSemaphoreType tasks. [#25529]
Improved the permission checks in the file connectors by adding a method that returns the permissions required to resolve field names. [#25348]
Added support for permission subtraction (deny permissions) in client connections. See Deny Permissions. [#25154]
Storage
Improved the hit/miss cache statistics counter performance. [#25146]
Enterprise Tiered Store can now be used with map loaders. [#24827]
Added the ability to configure Tiered Store backed maps dynamically. #670
Enterprise Added the ability to persist namespaces for Hot Restart. #402
Networking
Added the ability to evaluate priorities while picking member addresses; when interfaces are not configured, the first possible IP address is no longer used. Instead, all addresses are evaluated and the one with the highest priority (IPv6 address) is selected. [#25305]
Added the demoteLocalDataMember() method to convert members holding data to lite members, enabling a cluster to be alive while there is no data in it. [#24617]
Improved the duration of joins by the clients to the cluster; the clients can now join instantaneously without waiting by internally delaying the migrations asynchronously. [#17582]
Serialization
Added the ability to use consistent serialization service for ByKey plans. [#25631]
Serialization service is not created anymore for light jobs as it creates overhead and generates garbage. #235, #449
Cloud
Enhanced the warning message shown in the cases of incorrect configurations when deploying a Hazelcast client on Amazon EKS. [#25568]
Added the ability to retry DNS resolutions for the Kubernetes discovery plugin. #445
Metrics and Logs
Disabled the log4j2 shutdown hook for cleaner shutdown logs after a Hazelcast Platform cluster deployed on Kubernetes is shutdown. [#26006]
Enabled faster execution times and more efficient garbage collection by making method probes to use MethodHandle instead of reflection. [#25279]
Improved the naming convention for CP Session, Lock, and Persistence metrics. [#24843], [#24836]
Added status and userCancelled flags to job metrics. [#24716]
Upgraded the Hazelcast Platform's pom.xml to use JDK 17, as it requires at minimum JDK 17. #436
Updated the copyright year to 2024 in the codebase. #396
Enterprise Licensing
License keys are now masked in the license expiration notifications. [#24800]
API Documentation
Detailed the existing partition aware interface description to explain the requirements when calculating the partition ID in case partition aware is implemented. See PartitionAware Javadocs. #875
Fixes
Fixed an issue where sending internal Debezium messages was causing failures when connecting to databases. [#26027]
Fixed an issue where the entry listeners for Replicated Maps were checking the Map permissions instead of the Replicated Map permissions. [#25965]
Fixed an issue where the queries with indexes were producing duplicate results or failing. [#25527]
Fixed an issue where the map entries' metadata, such as time-to-live and expiration, was not replicated correctly over WAN after updating existing entries. [#25481]
Fixed an issue where the loading of compact-serialized generic records by the complex classloaders, such as JetClassLoader, were likely to cause deadlocks. [#25379]
Fixed a memory leak issue happening in Hazelcast members and clients while destroying fenced locks. [#25353]
Fixed an issue where the sorted index scans were hanging or producing duplicate values when there are multiple entries with the same key. [#25328]
Fixed an issue where setting indexes in a different order, while dynamically adding a map configuration, was failing. [#25234]
Fixed an issue where the diagnostic tool was showing the suggestion of enabling it, even it is already enabled. [#25220]
Fixed an issue where clearing an inexistent map was resulting in an exception. [#25202]
Fixed an issue where the mechanism to retrieve partitioning strategy on a client was ignoring the provided Hazelcast cluster properties. [#25162]
Fixed an issue where ClientConfigXmlGenerator didn't support the hazelcast-cloud configuration. [#25155]
Fixed an issue where the cache provider was not able to read the YAML configurations. [#25137]
Fixed an issue where the getDistributedObjects() was returning inconsistent results when multiple members simultaneously join to the cluster. [#25114]
Fixed an issue where zero-config compact serialization was not working on the objects that have a field of type java.util.UUID. [#25073]
Fixed an issue where the retry mechanism for the communications between CP leader and followers was generating too many retries, due to incorrect backoff timeout reset behavior. [#25055]
Fixed an issue where there was a difference between the elapsed clock time and elapsed total time when listening to migration events. [#25028]
Fixed an issue where the transaction in the Kafka producer was not committed when a batch job finished. [#25024]
Fixed an issue where data events were being fired through WAN replication after a split-brain, even when there were no changes in data. [#24928]
Fixed an issue where the lite members were not reporting statistics for map operations. [#24871]
Fixed an issue where the blacklisting was ignored after a split-brain scenario. [#24830]
Fixed an issue where the Kinesis sink might lose data, when retrying on failures, during a terminal snapshot. [#24779]
Fixed an issue where the member list was not updated after a cluster failover scenario. [#24745]
Fixed an issue where the batches produced for write-behind queues did not have the expected size of entries. [#24763]
Fixed an issue where the fused Jet vertex was ignoring the configured local parallelism and using the default parallelism instead. [#24683]
Fixed an issue where Hazelcast was sending empty map interceptor information to the members that are newly joined to the cluster; it was causing eager map initializations. [#24639]
Fixed an issue where the REST calls were failing for Hazelcast clusters with TLS v1.3 configured, and deployed on Kubernetes. [#24616]
Fixed an issue where the predicates did not have managed context injection when the predicate is local or not serialized. [#24463]
Fixed an issue where the results of the stream-to-stream join could not be inserted into the remote table connected via JDBC, causing an exception. [#22459]
Fixed an issue where the combining step of AggregateOperations.maxBy() was not checking if the incoming element is null, which can happen if some members did not have any items to process. In this case, the comparator was invoked with the null value which was invalid. #895
Fixed a race condition occurred when canceling Jet jobs during their initializations. #889
Fixed an issue where the indexes added during the migration of partitions to newly joined members, were not persisted on these new members. Relatedly, the ability to persist dynamically added indexes, when the Hot Restart feature is enabled, has been implemented. #829, #596
Fixed an issue where the merge operations after a split-brain (with no changes in the entry values) were emitting WAN events for offloaded operations. #734
Fixed an issue where replicating over WAN from a cluster to other clusters, when all clusters share the same cluster name, was failing. #728
Fixed a race condition occurred when the execution of registration/deregistration operation for JobStatusListener is offloaded to the event striped executor; now, this offloading is waited to finish. #673
Fixed an issue when querying JSON, elements that appear after an element containing nested JSON was not appearing in the query results. #570
Fixed an issue where data was lost from the ICache data structure with NATIVE entries in a split-brain scenario. #480
Fixed an issue where the ANALYZE INSERT INTO SQL statement did not generate metrics. #444
Fixed an issue where map entries' metadata were replicated incorrectly over WAN after a merge, causing deserialization of values. #225
Fixed an issue where the process of retrieving metrics for job executions was entering an infinite loop when a job execution is completed on a member, but continued on the other members.
Enterprise Fixed an issue where the map entries with time-to-live values were being removed as soon as the cluster with persistence enabled is restarted. #233 With this fix, only the members on which the jobs have not been completed are queried for metrics; for completed jobs, the metrics are already retrieved from the completed jobs context. #194
Fixed an issue where the attribute partitioning strategy was not working with Compact and Portable classes. #127
Removed/Deprecated Features
The connector for Elasticsearch 6 is removed, as the Elasticsearch 6 module is removed from Hazelcast distributions. [#24734]
The evaluation tool for IMDG 3.x users (Hazelcast 3 Connector) is removed. In the upcoming releases, a new tool for migrating data from 3.x versions will be introduced. [#25051]
Transactions have been deprecated, and will be removed as of Hazelcast version 7.0. An improved version of this feature is under consideration. If you are already using transactions, get in touch and share your use case. Your feedback will help us to develop a solution that meets your needs.
Portable Serialization has been deprecated. We recommend you use Compact Serialization as Portable Serialization will be removed as of version 7.0.
The user code deployment API is deprecated, and will be removed in Hazelcast Platform version 6.0. #223
Contributors
We would like to thank the contributors from our open source community who worked on this release:
This document lists the new features, enhancements, fixed issues, and removed or deprecated features for Hazelcast Platform 5.3.8 release. The numbers in the square brackets refer to issues in Hazelcast's public and internal GitHub repositories.
Fixes
Fix memory leak with OpenSSL (with newer versions of netty libraries) #13738
Fix Jet vulnerabilities
** Fix CVE-2022-3171 vulnerabilities in protobuf-java 3.19.4 and hadoop-shaded-protobuf_3_7-1.1.1 [#22541]
** Fix CVE-2023-2976 vulnerability in hadoop-shaded-guava-1.1.1.jar (shaded: com.google.guava:guava:30.1.1-jre) [#24981]
** Fix CVE-2024-36114 vulnerability in aircompressor-0.21 [#26354]
Fix serialization issue with rolling upgrade from 5.2 to 5.3
This document lists the enhancements, fixed issues, and removed or deprecated features for Hazelcast Platform 5.3.7 release. The numbers in the square brackets refer to the issues and pull requests in Hazelcast's GitHub repository.
Enhancements
Improved the time spent on the first partition migration, in case a new member joins a cluster with high partition count. [#1201]
This document lists the enhancements, fixed issues, and removed or deprecated features for Hazelcast Platform 5.3.6 release. The numbers in the square brackets refer to the issues and pull requests in Hazelcast's GitHub repository.
Fixes
Fixed a WAN replication failure - when using maps with WAN replication enabled, and BINARY or NATIVE in-memory formats for the entries, WAN replication was failing when an entry is updated with the same key/value pair, and the cluster members lack serialization information. [#25899]
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
If you want to rebase/retry this PR, check this box
This PR has been generated by Mend Renovate. View repository job log here.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
![renovate[bot]](https://avatars.githubusercontent.com/in/2740?s=60&v=4){kind=small}
![renovate-approve[bot]](https://avatars.githubusercontent.com/in/7394?s=60&v=4){kind=small}
github-actions
bot
added
quarkus
This PR contains the following updates:
5.3.5->5.4.0Warning
Some dependencies could not be looked up. Check the Dependency Dashboard for more information.
Release Notes
hazelcast/hazelcast (com.hazelcast:hazelcast)
v5.4.0This document lists the new features, enhancements, fixed issues and, removed or deprecated features for Hazelcast Platform 5.4.0 release. The numbers in the square brackets refer to the issues and pull requests in Hazelcast's GitHub repository.
New Features
Breaking Changes
MergingValueinterface within the SPI package now requires thegetDeserializedValue()method to be defined within implementations, replacing thegetValue()definition. [#25942]if you are using Maven to install the connector, you must add
<classifier>jar-with-dependencies</classifier>to yourpom.xml. Also removed the permissions for MongoDB connector. [#25744], [#25701]SecurityInterceptorchecks were reviewed and unified into a single place - classcom.hazelcast.security.SecurityInterceptorConstants. Some client messages have the method name changed to reflect their purpose better. Some client messages are newly covered bySecurityInterceptorchecks now. [#25020]hazelcast.The previous name,
hazelcast-service-port, caused member auto-discovery for embedded deployments to fail. [#24834], [#24705], [#24688]Enhancements
SQL/Jet Engine
GenericMapStore. [#25878]CancellationExceptiontoCancellationByUserExceptionwhen the user cancels a job before it is initialized. [#25383]__keyfilters. [#25105]EXPLAIN PLANstatement outputs for all physical joins. [#24899]javax.jmstojakarta.jmsin Hazelcast distributions. [#24804]stream()method to the SQL service to return the stream of result rows. [#24525]hashCode()method ofKeyedWindowResultwith that ofMap.Entry. #697getPartitionAssignment()method when the partition pruning is not used. #486forceTotalParallelismOne ()on random members without permissions. #227Connectors
DataSerializableserialization to Mongo connector. [#25197]Data Structures
getItemAtPositionOrNull()method. [#25672]IMap.localValues()andIMap.localValues(Predicate)methods for a faster access to locally owned values in maps. [#24763]deleteAsync()for maps to asynchronously remove a provided map entry key. [#23509]setManagementEnabled()method. [#22575]getCPObjectInfos()method to create a snapshot of all existing CP objects for a given service on the group leader. #615getCPGroupIds()method to the CP Subsystem API to allow listing all data structures within a CP group. #591ADVANCED_CPfeature is present in the Hazelcast Platform Enterprise license, to enable CPMap. #157Enterprise WAN Replication
IMap/ICacheEvictions. [#24941]Enterprise Security
CacheCreateConfigandGetSemaphoreTypetasks. [#25529]Storage
Networking
demoteLocalDataMember()method to convert members holding data to lite members, enabling a cluster to be alive while there is no data in it. [#24617]Serialization
ByKeyplans. [#25631]Cloud
Metrics and Logs
MethodHandleinstead of reflection. [#25279]statusanduserCancelledflags to job metrics. [#24716]sizeandsizeBytesmetrics for CPMap. See CP Subsystem Metrics. #6807connectionHealthandfailedTransmitCountmetrics to WAN Replication. See WAN Replication Metrics. #848ucn. #745, #625Events and Listeners
onCancel()method to the reliable message listener to trigger a notification when the listener is cancelled for any reason. #286REST API
RestConfigtag under the serverConfig; it allows configuration of the new REST API server. #508Distribution
common.bathas been updated to not include excessive spaces in parameters.hz-cli.batandhz-start.bathave been updated to reference thecommon.batscript with correct paths.hz-start.bathas been updated to remove double quote expansion forCLASSPATH.#165
[#25607], [#25555], [#25576], [#22407]
pom.xmlto use JDK 17, as it requires at minimum JDK 17. #436Enterprise Licensing
API Documentation
Fixes
JetClassLoader, were likely to cause deadlocks. [#25379]ClientConfigXmlGeneratordidn't support thehazelcast-cloudconfiguration. [#25155]getDistributedObjects()was returning inconsistent results when multiple members simultaneously join to the cluster. [#25114]java.util.UUID. [#25073]AggregateOperations.maxBy()was not checking if the incoming element is null, which can happen if some members did not have any items to process. In this case, the comparator was invoked with the null value which was invalid. #895JobStatusListeneris offloaded to the event striped executor; now, this offloading is waited to finish. #673NATIVEentries in a split-brain scenario. #480ANALYZE INSERT INTOSQL statement did not generate metrics. #444Removed/Deprecated Features
Contributors
We would like to thank the contributors from our open source community who worked on this release:
v5.3.8This document lists the new features, enhancements, fixed issues, and removed or deprecated features for Hazelcast Platform 5.3.8 release. The numbers in the square brackets refer to issues in Hazelcast's public and internal GitHub repositories.
Fixes
** Fix CVE-2022-3171 vulnerabilities in protobuf-java 3.19.4 and hadoop-shaded-protobuf_3_7-1.1.1 [#22541]
** Fix CVE-2023-2976 vulnerability in hadoop-shaded-guava-1.1.1.jar (shaded: com.google.guava:guava:30.1.1-jre) [#24981]
** Fix CVE-2024-36114 vulnerability in aircompressor-0.21 [#26354]
v5.3.7This document lists the enhancements, fixed issues, and removed or deprecated features for Hazelcast Platform 5.3.7 release. The numbers in the square brackets refer to the issues and pull requests in Hazelcast's GitHub repository.
Enhancements
[#1207], [#1208], [#1209]
v5.3.6This document lists the enhancements, fixed issues, and removed or deprecated features for Hazelcast Platform 5.3.6 release. The numbers in the square brackets refer to the issues and pull requests in Hazelcast's GitHub repository.
Fixes
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Mend Renovate. View repository job log here.