CHANGELOG.md

CHANGELOG

All notable changes to this project are documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning. See the CONTRIBUTING guide for instructions on how to add changelog entries.

Unreleased 3.0

Added

• Support for HTTP/2 (server-side) (#3847)
• Add getter for path field in NestedQueryBuilder (#4636)
• Allow mmap to use new JDK-19 preview APIs in Apache Lucene 9.4+ (#5151)
• Add events correlation engine plugin (#6854)
• Implement on behalf of token passing for extensions (#8679, #10664)
• Provide service accounts tokens to extensions (#9618)
• GHA to verify checklist items completion in PR descriptions (#10800)
• Allow to pass the list settings through environment variables (like [], ["a", "b", "c"], ...) (#10625)
• [S3 Repository] Add setting to control connection count for sync client (#12028)
• Views, simplify data access and manipulation by providing a virtual layer over one or more indices (#11957)
• Add Remote Store Migration Experimental flag and allow mixed mode clusters under same (#11986)
• Remote reindex: Add support for configurable retry mechanism (#12561)
• [Admission Control] Integrate IO Usage Tracker to the Resource Usage Collector Service and Emit IO Usage Stats (#11880)
• Tracing for deep search path (#12103)
• Add explicit dependency to validatePom and generatePom tasks (#12807)
• Replace configureEach with all for publication iteration (#12876)

Dependencies

• Bump log4j-core from 2.18.0 to 2.19.0
• Bump forbiddenapis from 3.3 to 3.4
• Bump avro from 1.11.1 to 1.11.2
• Bump woodstox-core from 6.3.0 to 6.3.1
• Bump xmlbeans from 5.1.0 to 5.1.1 (#4354)
• Bump reactive-streams from 1.0.3 to 1.0.4 (#4488)
• Bump jempbox from 1.8.16 to 1.8.17 (#4550)
• Update to Gradle 7.6 and JDK-19 (#4973)
• Update Apache Lucene to 9.5.0-snapshot-d5cef1c (#5570)
• Bump maven-model from 3.6.2 to 3.8.6 (#5599)
• Bump maxmind-db from 2.1.0 to 3.0.0 (#5601)
• Bump wiremock-jre8-standalone from 2.33.2 to 2.35.0
• Bump gson from 2.10 to 2.10.1
• Bump com.google.code.gson:gson from 2.10 to 2.10.1
• Bump com.maxmind.geoip2:geoip2 from 4.0.0 to 4.0.1
• Bump com.avast.gradle:gradle-docker-compose-plugin from 0.16.11 to 0.16.12
• Bump org.apache.commons:commons-configuration2 from 2.8.0 to 2.9.0
• Bump com.netflix.nebula:nebula-publishing-plugin from 19.2.0 to 20.3.0
• Bump io.opencensus:opencensus-api from 0.18.0 to 0.31.1 (#7291)
• OpenJDK Update (April 2023 Patch releases) (#7344
• Bump com.google.http-client:google-http-client:1.43.2 from 1.42.0 to 1.43.2 (7928))
• Add Opentelemetry dependencies (#7543)
• Bump org.bouncycastle:bcprov-jdk15on to org.bouncycastle:bcprov-jdk15to18 version 1.75 (#8247)
• Bump org.bouncycastle:bcmail-jdk15on to org.bouncycastle:bcmail-jdk15to18 version 1.75 (#8247)
• Bump org.bouncycastle:bcpkix-jdk15on to org.bouncycastle:bcpkix-jdk15to18 version 1.75 (#8247)
• Bump JNA version from 5.5 to 5.13 (#9963)
• Bump org.eclipse.jgit from 6.5.0 to 6.7.0 (#10147)
• Bump OpenTelemetry from 1.30.1 to 1.31.0 (#10617)
• Bump OpenTelemetry from 1.31.0 to 1.32.0 and OpenTelemetry Semconv from 1.21.0-alpha to 1.23.1-alpha (#11305)
• Bump org.bouncycastle:bcprov-jdk15to18 to org.bouncycastle:bcprov-jdk18on version 1.77 (#12317)
• Bump org.bouncycastle:bcmail-jdk15to18 to org.bouncycastle:bcmail-jdk18on version 1.77 (#12317)
• Bump org.bouncycastle:bcpkix-jdk15to18 to org.bouncycastle:bcpkix-jdk18on version 1.77 (#12317)
• Bump Jackson version from 2.16.1 to 2.16.2 (#12611)
• Bump aws-sdk-java from 2.20.55 to 2.20.86 (#12251)

Changed

• [CCR] Add getHistoryOperationsFromTranslog method to fetch the history snapshot from translogs (#3948)
• Relax visibility of the HTTP_CHANNEL_KEY and HTTP_SERVER_CHANNEL_KEY to make it possible for the plugins to access associated Netty4HttpChannel / Netty4HttpServerChannel instance (#4638)
• Migrate client transports to Apache HttpClient / Core 5.x (#4459)
• Change http code on create index API with bad input raising NotXContentException from 500 to 400 (#4773)
• Improve summary error message for invalid setting updates (#4792)
• Return 409 Conflict HTTP status instead of 503 on failure to concurrently execute snapshots (#8986)
• Add task completion count in search backpressure stats API (#10028)
• Deprecate CamelCase PathHierarchy tokenizer name in favor to lowercase path_hierarchy (#10894)
• Switched to more reliable OpenSearch Lucene snapshot location(#11728)
• Breaking change: Do not request "search_pipelines" metrics by default in NodesInfoRequest (#12497)

Deprecated

Removed

• Remove deprecated code to add node name into log pattern of log4j property file (#4568)
• Unused object and import within TransportClusterAllocationExplainAction (#4639)
• Remove LegacyESVersion.V_7_0_* and V_7_1_* Constants (#2768)
• Remove LegacyESVersion.V_7_2_ and V_7_3_ Constants (#4702)
• Always auto release the flood stage block (#4703)
• Remove LegacyESVersion.V_7_4_ and V_7_5_ Constants (#4704)
• Remove Legacy Version support from Snapshot/Restore Service (#4728)
• Remove deprecated serialization logic from pipeline aggs (#4847)
• Remove unused private methods (#4926)
• Remove LegacyESVersion.V_7_8_ and V_7_9_ Constants (#4855)
• Remove LegacyESVersion.V_7_6_ and V_7_7_ Constants (#4837)
• Remove LegacyESVersion.V_7_10_ Constants (#5018)
• Remove Version.V_1_ Constants (#5021)
• Remove custom Map, List and Set collection classes (#6871)

Fixed

• Fix 'org.apache.hc.core5.http.ParseException: Invalid protocol version' under JDK 16+ (#4827)
• Fix compression support for h2c protocol (#4944)
• Don't over-allocate in HeapBufferedAsyncEntityConsumer in order to consume the response (#9993)
• Update supported version for max_shard_size parameter in Shrink API (#11439)
• Fix typo in API annotation check message (11836)
• Update supported version for must_exist parameter in update aliases API (#11872)
• [Bug] Check phase name before SearchRequestOperationsListener onPhaseStart (#12035)
• Fix Span operation names generated from RestActions (#12005)
• Fix error in RemoteSegmentStoreDirectory when debug logging is enabled (#12328)

Security

Unreleased 2.x

Added

• Constant Keyword Field (#12285)
• Convert ingest processor supports ip type (#12818)
• Add a counter to node stat api to track shard going from idle to non-idle (#12768)
• Allow setting KEYSTORE_PASSWORD through env variable (#12865)
• [Concurrent Segment Search] Perform buildAggregation concurrently and support Composite Aggregations (#12697)
• [Concurrent Segment Search] Disable concurrent segment search for system indices and throttled requests (#12954)
• Derived fields support to derive field values at query time without indexing (#12569)
• Detect breaking changes on pull requests (#9044)
• Add cluster primary balance contraint for rebalancing with buffer (#12656)
• [Remote Store] Make translog transfer timeout configurable (#12704)
• Reject Resize index requests (i.e, split, shrink and clone), While DocRep to SegRep migration is in progress.(#12686)

Dependencies

• Bump org.apache.commons:commons-configuration2 from 2.10.0 to 2.10.1 (#12896)
• Bump asm from 9.6 to 9.7 (#12908)
• Bump net.minidev:json-smart from 2.5.0 to 2.5.1 (#12893)
• Bump netty from 4.1.107.Final to 4.1.108.Final (#12924)
• Bump commons-io:commons-io from 2.15.1 to 2.16.0 (#12996, #12998, #12999)
• Bump org.apache.commons:commons-compress from 1.24.0 to 1.26.1 (#12627)
• Bump org.apache.commons:commonscodec from 1.15 to 1.16.1 (#12627)
• Bump org.apache.commons:commonslang from 3.13.0 to 3.14.0 (#12627)
• Bump Apache Tika from 2.6.0 to 2.9.2 (#12627)

Changed

• [BWC and API enforcement] Enforcing the presence of API annotations at build time (#12872)
• Improve built-in secure transports support (#12907)
• Update links to documentation in rest-api-spec (#13043)

Deprecated

Removed

Fixed

• Fix bulk API ignores ingest pipeline for upsert (#12883)
• Fix issue with feature flags where default value may not be honored (#12849)
• Fix UOE While building Exists query for nested search_as_you_type field (#12048)

Security