v3.6.6

Summary

This release has several small improvements and vulnerability fixes.

Change logs

Improvements

• Improve some toString expressions of Selection Operators (#920)

Bug fixes

• Bump scalar-labs/jre8 from 1.1.12 to 1.1.13 in /server (#881)
• Bump scalar-labs/jre8 from 1.1.12 to 1.1.13 in /schema-loader (#882)
• Bump scalar-labs/jre8 from 1.1.13 to 1.1.14 in /schema-loader (#903)
• Bump scalar-labs/jre8 from 1.1.13 to 1.1.14 in /server (#902)

Documentation

• Change HTML syntax to Markdown for images (3.6) (#876)

v3.5.9

Summary

This release has several small improvements and vulnerability fixes.

Change logs

Improvements

• Improve some toString expressions of Selection Operators (#920)

Bug fixes

• Bump scalar-labs/jre8 from 1.1.12 to 1.1.13 in /server (#881)
• Bump scalar-labs/jre8 from 1.1.12 to 1.1.13 in /schema-loader (#882)
• Bump scalar-labs/jre8 from 1.1.13 to 1.1.14 in /schema-loader (#903)
• Bump scalar-labs/jre8 from 1.1.13 to 1.1.14 in /server (#902)

Documentation

• Change HTML syntax to Markdown for images (3.5) (#875)

v3.9.0

Summary

ScalarDB 3.9 includes many new features, improvements, bug fixes, vulnerability fixes, and documentation updates. Please see the following for a list of detailed changes.

ScalarDB provides a community edition and an enterprise edition. The community edition is available as open-source software that you can use under the Apache 2.0 License. The enterprise edition includes not only the features of the community edition but also many advanced features. Release notes for the enterprise edition are available under the “Enterprise edition” section. To use the features in the enterprise edition, you must have a license agreement with Scalar Inc.

Community edition

New features

• Added SQLite as a database that ScalarDB supports. (#762)

Improvements

• Added slf4j-simple to the sample application for getting started with ScalarDB. (#835)
• Updated the supported Java version when getting started to Java 8 or higher. (#840)
• Added the Decommissioning state to ScalarDB Server to achieve graceful shutdown. (#851)
• Unified the error-handling behavior of the admin API (e.g., an exception is thrown when dropping a namespace but the namespace has some tables). (#856)

Bug fixes

• Upgraded the integrated Java Runtime Environment (JRE) Docker image to 1.1.11 to fix security issues. CVE-2023-0286 (#821)
• Fixed issues where ScalarDB could not handle the write operation correctly when using the columns prefixed with before_ with Consensus Commit. (#844)

Documentation

• Updated the documentation for transaction APIs and exceptions, the Java API guide, and the two-phase commit transaction guide. (#804, #831)
• Updated the Cosmos DB name from Cosmos DB to Cosmos DB for NoSQL in the supported databases document. (#813)
• Updated the steps to create and configure a Cosmos DB for NoSQL account for ScalarDB in the getting-started guide. (#814)
• Updated the links for ScalarDB Server and Schema Loader in the backup and restore guide. (#810)
• Added how to repair stored procedures when using Cosmos DB for NoSQL in the backup and restore guide. (#825)

Enterprise edition

New features

ScalarDB Cluster

• Integrated the ScalarDB GraphQL and ScalarDB SQL interfaces with ScalarDB Cluster. As of ScalarDB 3.9, you no longer need to deploy dedicated components (i.e., containers) to provide GraphQL and SQL interfaces, respectively. In addition, you can more easily manage a ScalarDB Cluster.
• Added the direct-kubernetes client mode into the Client mode.
• Added the dedicated Schema Loader for ScalarDB Cluster.
• Added ScalarDB GraphQL integration to ScalarDB Cluster.

ScalarDB Analytics with PostgreSQL

• Added ScalarDB Analytics with PostgreSQL. As of ScalarDB 3.9, you can perform analytical queries on data in heterogeneous databases (i.e., RDBMS and NoSQL) managed by ScalarDB transparently by using a PostgreSQL foreign data wrapper (FDW). This feature eliminates the need for you to implement join or aggregation operations in applications, and enables you to easily perform routine or ad-hoc analysis by simply issuing SQL to PostgreSQL.

ScalarDB GraphQL

• Added two-phase commit (2PC) support for ScalarDB GraphQL. As of ScalarDB 3.9, you can more easily guarantee data consistency between GraphQL-based microservices. Adding support for 2PC not only reduces system development costs but also facilitates maintenance.
• Added two mechanisms to rebuild the GraphQL schema after a schema metadata change while the server is running.

ScalarDB SQL

• Added two-phase commit (2PC) support for Spring Data JDBC for ScalarDB. As of ScalarDB 3.9, you can more easily guarantee data consistency between Spring Framework–based microservices. Adding support for 2PC not only reduces system development costs but also facilitates maintenance.
• Enabled ScalarDbRepository#findAll() and ScalarDbRepository#count() in Spring Data JDBC for ScalarDB.
• Published JAR files for ScalarDB SQL CLI to the Maven repository.
• Added the default namespace name configuration scalar.db.sql.default_namespace_name. The value of this configuration is used when a namespace name is not specified in a SQL statement.

Improvements

ScalarDB Cluster

• Added logging to cluster nodes for recording detailed information.
• Unified scalar.db.cluster.node_port and scalar.db.cluster.node.port into scalar.db.cluster.node.port.
• Added an expiration time to the cluster node cache to wait for the current requests to finish before invalidating the cache.
• Added the Decommissioning state to gracefully shut down a cluster node.
• Revised to get the IP addresses of initial members when Kubernetes membership starts.
• Removed an unnecessary throws clause from the Membership#getMembersIpAddresses method.

ScalarDB GraphQL

• Revised to abort transactions that execute a CRUD or transaction operation (i.e., abort and commit) and throw an exception, except if transaction.commit() throws an UnknownTransactionStatusException error.

ScalarDB SQL

• Improved the ScalarDB SQL error mapping table and AbstractSqlJdbcStatement#execute error handling.
• Improved the Spring Data fragment repository class for ScalarDB.
• Updated com.scalar.db.sql.springdata.exception.ScalarDb*Exception to always have a transactionId field value.
• Revised the ScalarDB SQL API entirely.
• Added the Decommissioning state to ScalarDB SQL Server.
• Added a mechanism to expire the SqlSessionFactory cache and close the instance in ScalarDB JDBC.
• Updated the exception translator in Spring Data JDBC for ScalarDB.
• Updated the Metadata service interface to make it more intuitive.

Bug fixes

ScalarDB Cluster

• Upgraded gRPC Health Probe to 0.4.15 to fix security issues. CVE-2022-41721
• Upgraded the integrated JRE Docker image to 1.1.11 to fix security issues. CVE-2023-0286

ScalarDB GraphQL

• Upgraded the integrated JRE Docker image to 1.1.11 to fix security issues. CVE-2023-0286
• Upgraded the integrated JRE Docker image to 1.1.12 to fix security issues. CVE-2023-0361
• Upgraded the graphql-java version to 20.2 to fix security issues. CVE-2023-28867

ScalarDB SQL

• Upgraded gRPC Health Probe to 0.4.15 to fix security issues. CVE-2022-41721
• Upgraded the integrated JRE Docker image to 1.1.11 to fix security issues. CVE-2023-0286
• Fixed an incorrect error message when an error occurred while executing the SELECT operation.
• Upgraded the integrated JRE Docker image to 1.1.12 and gRPC Health Probe to 0.4.17 to fix security issues. CVE-2023-0361 CVE-2022-41723
• Revised to set the finished status of the failed transaction to avoid timeout error in the bidirectional streams flow in Server mode.

Documentation

ScalarDB GraphQL

• Added documentation for how to run ScalarDB GraphQL Server.
• Fixed some minor issues, such as typos and unnecessary statements.

ScalarDB SQL

• Updated the Spring Data JDBC for ScalarDB guide to mention users can use other retry libraries.
• Added a link to the Spring Data JDBC for ScalarDB guide to the README.
• Revised a heading for clarification when users are getting started with ScalarDB SQL.
• Revised the name of the "Spring Data integration with ScalarDB" feature to "Spring Data JDBC for ScalarDB".
• Updated the Javadoc files to match the changes in the release.

v3.8.1

Summary

This release has several vulnerability fixes.

Change logs

Bug fixes

• Fix CVE-2023-0361 and CVE-2022-41723 (#834)
• Fix CVE-2022-41721 (#808)
• Fix CVE-2023-0286 (#821)

v3.7.4

Summary

This release has several bug fixes and vulnerability fixes.

Change logs

Bug fixes

• fix: DynamoAdmin.namespaceExists to check full namespace (not prefix) (#782)
• Should care about ScanWithIndex in ScalarDbUtils.copyAndSetTargetToIfNot() (#793)
• Fix CVE-2022-42898 (#794)
• Fix CVE-2023-0286 (#821)
• Fix CVE-2023-0361 and CVE-2022-41723 (#834)
• Fix CVE-2022-41721 (#808)

v3.6.5

Summary

This release has several bug fixes and vulnerability fixes.

Change logs

Bug fixes

• Should care about ScanWithIndex in ScalarDbUtils.copyAndSetTargetToIfNot() (#793)
• Fix CVE-2022-42898 (#794)
• Fix CVE-2023-0286 (#821)
• Fix CVE-2023-0361 and CVE-2022-41723 (#834)
• Fix CVE-2022-41721 (#808)

v3.5.8

Summary

This release has several vulnerability fixes.

Change logs

Bug fixes

• Fix CVE-2022-42898 (#794)
• Fix CVE-2023-0286 (#821)
• Fix CVE-2023-0361 and CVE-2022-41723 (#834)
• Fix CVE-2022-41721 (#808)

v3.8.0

Summary

This release has a lot of enhancements, improvements, bug fixes, vulnerability fixes, and document improvements. Please see Change logs for the details.

Change logs

Enhancements

• Remove suspend() from TwoPhaseCommitTransactionManager (#715)
• Update release workflow to push container to ECR of Marketplace (#699)
• Add resume() to DistributedTransactionManager (#717)
• Add several methods to ActiveExpiringMap (#722)
• Allow to use placeholders in configuration values (#770)
• Add configurations for gRPC (#776)

Improvements

• Refactor server integration tests (#663)
• Use toUpperCase() for valueOf() of enum type (#666)
• Use ServiceLoader to load storage and transaction modules (#661)
• Improve error messages in OperationChecker (#667)
• Add logging for UnknownTransactionStatusException in Scalar DB Server (#669)
• Refactor JdbcAdminTest (#670)
• Refactor CosmosAdminTest (#671)
• Rename endpoint override config in Dynamo (#672)
• Enable EI_EXPOSE_REP and EI_EXPOSE_REP2 in SpotBugs (#668)
• Enable parallel/async commit by default (#676)
• Add more checks for conditions for Dynamo and Cosmos (#675)
• Refactor schema loader integration tests (#673)
• Delete setDriver() for BasicDataSource in JDBC (#682)
• Use DistributedTransactionAdmin for transaction tables in SchemaOperator (#684)
• Delete licenses (#686)
• Suppress exception thrown when deleting scalable target and scaling policy when using DynamoDB local. (#683)
• Upgrade Spotless Gradle Plugin (#694)
• Fix typo in admin integration test classes (#695)
• Move integration test base code to subproject (#697)
• Refactor ServiceLoader related classes (#698)
• Make the ConsensusCommitAdmin only return transaction table (#702)
• Add external Scalar DB property file support to getting-started application (#701)
• Refactor ConsensusCommitAdmin unit test (#704)
• In the Cosmos DB job of the CI, add a step to clean up gradle daemon logs file (#705)
• Disable include metadata tests if external server used in server integration tests (#711)
• Refactor consensus commit specific integration tests (#713)
• Refactor two-phase commit transaction integration tests (#712)
• Small integration test modifications for the resume feature (#724)
• Should throw IllegalStateException when transaction is not found and already exists (#718)
• Add transaction state management (#719)
• Separate active transaction management from AbstractDistributedTransactionManager and AbstractTwoPhaseCommitTransactionManager (#723)
• Fix dependency and spotbugs issues for >JDK 8 (#728)
• Fix two unit tests of OperationChecker (#731)
• Throw an exception when putting an empty value to a secondary index column in Dynamo DB (#729)
• Make JDK11+ use the same google java format version as JDK8 uses (#734)
• Make ParallelExecutor workers daemon thread (#733)
• Move vuln check to a separate daily workflow (#737)
• Conduct daily vulnerability checks on releases not only on main branch (#741)
• Should drop namespace only when no tables are in the namespace in Schema Loader (#740)
• Move common classes (#744)
• Throw TransactionNotFoundException when resuming a transaction but it's not found (#746)
• Post the vulnerability check result to Slack channel (#745)
• Deprecate getPartitionKey() and getClusteringKey() of Result (#750)
• Remove usages of getPartitionKey() and getClusteringKey() of Result from integration tests (#751)
• Validate contact points size in XxxxConfig to avoid "java.lang.ArrayIndexOutOfBoundsException: 0" (#752)
• Make integration test bases for transaction extendable (#754)
• Refactor server integration tests (#755)
• Small modifications for Javadoc and comments (#756)
• Should close admin in afterEach() in the repair integration tests (#767)
• build(fix): bump-up protobufVersion to 3.21.12 (latest) (#760)
• Refactor prepare logic (#771)
• Update Scheduled Vulnerability Check workflow (#749)
• Refactor validation logic (#775)
• Add transaction decorator (#781)
• Revisit commit and abort state logic (#783)
• Should synchronize in active transaction management (#785)
• Allow commit() and rollback() to be called in parallel in all coordinator/participant processes in 2PC transactions (#786)
• Load admins lazily in Schema Loader (#792)
• Rename Scalar DB to ScalarDB (#795)
• DynamoDB supports up to 100 actions per transaction (#796)
• Revert async commit default value (#797)

Bug fixes

• Should support --config= and -c= styles for configuration file option in Schema Loader (#690)
• Fix CVE-2021-3999, CVE-2022-1586 and CVE-2022-1587 (#700)
• Commit/rollback records should always be done for all records even on error (#680)
• Should use partition key and clustering key from result in recovery (#681)
• Fix typo in integration-test/archive.gradle (#706)
• Fix CVE-2022-27664 (#716)
• Should check the value range of BigIntColumn (#720)
• Fix CVE-2022-32149 (#727)
• Fix CVE-2022-42003 and CVE-2022-42004 (#726)
• Fix dependency errors for Maven projects (#735)
• Fix typos in exception messages (#714)
• Update protobuf and grpc to fix CVE-2022-3171 (#738)
• Fix CVE-2022-40151 and CVE-2022-40152 (#743)
• Upgrade docker image version to fix CVE-2021-46848 (#766)
• Fix CVE-2022-21363 and CVE-2021-2471 (#773)
• Fix CVE-2022-41946 (#774)
• fix: DynamoAdmin.namespaceExists to check full namespace (not prefix) (#782)
• Should care about ScanWithIndex in ScalarDbUtils.copyAndSetTargetToIfNot() (#793)
• Fix CVE-2022-42898 (#794)

Documentation

• Remove readthedocs (#664)
• Move Schema Loader document to docs directory (#665)
• Fix Javadoc warnings (#685)
• Update the Scalar DB supported database matrix with Scalar DB 3.7 (#703)
• Add description of limitations of data types (#721)
• Fix the broken link in the backup document (#725)
• Remove unnecessary key definition from API guide (#742)
• Add note for Put/Delete operation in the API guide (#747)
• Add ScalarDB Server's license description in the README (#753)
• docs: Clearer description on when to use online backups (#761)
• Add description how to build docker image of ScalarDB Server (#779)
• Update slides links (#789)

v3.7.3

Summary

This release adds several configurations for gRPC and has several bug fixes.

Change logs

Enhancements

• Add configurations for gRPC (#776)

Bug fixes

• Upgrade docker image version to fix CVE-2021-46848 (#766)
• Fix CVE-2022-21363 and CVE-2021-2471 (#773)
• Fix CVE-2022-41946 (#774)

v3.6.4

Summary

This release adds several configurations for gRPC and has several bug fixes.

Change logs

Enhancements

• Add configurations for gRPC (#776)

Bug fixes

• Upgrade docker image version to fix CVE-2021-46848 (#766)
• Fix CVE-2022-21363 and CVE-2021-2471 (#773)
• Fix CVE-2022-41946 (#774)