Skip to content

v1.1.1-beta release

Compare
Choose a tag to compare
@datasophon datasophon released this 24 Apr 16:10
· 305 commits to dev since this release

#New features:

  1. After restarting the server operating system, the service will start automatically upon startup.
  2. Upgrade hbase to version 2.4.16.
  3. HDFS namenode and Yarn ResourceManager WebUi have added master-slave identities.
  4. The default number of built-in topic replicas in KAFKA has been changed to 3.
  5. HDFS added Block write rate and Rpc processing time trend monitoring chart.
  6. Add heap memory parameter configuration to the namenode and datanode of HDFS.
  7. Host management adds IP condition search.
  8. Added support for integrating Doris high-performance analysis databases.
  9. Kerberos can not be deployed on the same machine as DataSophon Web.
  10. Added support for web front-end and back-end merge deployment, eliminating the need for separate deployment of nginx proxy front-end.

#Bug fix:

  1. Fixed the issue of not updating the configuration after adding a new client instance. The expected result is to continue using the default role group configuration, but the system will automatically add a rolegroup1 role group.
  2. After fixing the cluster machine/service instance scaling, the machine quantity indicator on the overview page was not changed accordingly.
  3. Fix the keytab file acquisition failure of the multi cluster management service, which resulted in the service being unable to start.
  4. Repair the synchronization of deleting corresponding alarms when deleting services.
  5. Fix the issue of incorrect cluster ID parameter transmission in a multi cluster environment.
  6. Fixed a bug in the semi transparent display of background command lists after multiple pages.
  7. Fixed a bug where global variable acquisition failed in a multi cluster environment.
  8. Optimize the DataSophon web service startup script and remove some memory parameters.
  9. Fix the issue of occasional failure to obtain local Actors.

新特性:

1、服务器操作系统重启后服务实现开机自启。

2、hbase升级为2.4.16版本。

3、HDFS namenode、yarn ResourceManager WebUi新增主从标识。

4、 KAFKA内置topic副本数默认改为3。

5、HDFS新增Block写入速率,Rpc处理耗时趋势监控图表。

6、HDFS的namenode、datanode增加堆内存参数配置。

7、主机管理新增ip条件搜索。

8、新增Worker停止时,同时停止Node Exporter。

9、新增支持集成Doris高性能分析数据库。

10、Kerberos可以不和DataSophon Web部署在同一台机器上。

11、新增支持Web前后端合并部署,不需再单独部署nginx代理前端。

Bug修复:

1、修复添加一个新client实例后未更新配置,预期结果是沿用默认角色组配置,但系统会自动新增一个rolegroup1角色组。

2、修复集群机器/服务实例缩容后总览页面机器数量指标未进行相应更改。

3、修复多集群管理服务的keytab文件获取失败导致服务无法启动。

4、修复删除服务时同步删除对应告警。

5、修复多集群环境下cluster id传参不正确问题。

6、修复后台命令列表多页后半透明显示的bug。

7、修复多集群环境下全局变量获取失败的bug。

8、优化DataSophon Web服务启动脚本,移出部分内存参数。

9、修复偶发获取本地Actor失败的问题。

What's Changed

  • Dev 1.1.0 by @hyzhang13 in #158
  • [Feature] Check whether service on the same node. by @WujieRen in #161
  • perf: Remove constant Constants.FRAME_ID, and chagne the query method tp use SFunction. by @WujieRen in #162
  • A pr for issue #153: An odd number of zookpeer nodes must be deployed. by @WujieRen in #163
  • Variable declaration definition changed (var to let) by @zq0757 in #169
  • perf: Remove constant Constants.COMMAND_ID, and use SFunction instead. by @WujieRen in #171
  • datasophon step7.vue remove the extra letter y by @alldatadc in #172
  • perf: Remove constant Constants.SERVICE_ID and Constants.SERVICE_ROLE_TYPE. by @WujieRen in #174
  • [Feature] [.git] Added issue template by @zhu-mingye in #184
  • [Feature][*] Added Apache-License2 protocol header by @zhu-mingye in #179
  • [Feature] [.] Added spotless by @zhu-mingye in #188
  • [Feature-185][common] optimize read hosts file by @chenss-1 in #186
  • sql script character encoding is unified and standardized by @zq0757 in #189
  • fix(datasophon-common): 升级jsch版本 by @zhangdw123 in #182
  • [Improvement-190][MinaUtils] Improve get id_rsa file path to support different user home path on MinaUtils by @chenss-1 in #191
  • [Perf] Remove some constant in class Constants, and use SFunction instead. by @WujieRen in #200
  • A bug fix for querying the list of all service roles by @WujieRen in #202
  • [Bug] Solve the problem that when the namenode fails to format for the first time, subsequent commands cannot be executed by @WujieRen in #205
  • [Feature] Unified Front and back end by @liugddx in #192
  • [improvement] add dependency-review.yml and modify the build process by @gaotingkai in #199
  • fix(datasophon-api): 修复监控将fe配置成了be的问题以及格式化代码 by @zhangdw123 in #212
  • 调整JVM参数适应高版本 JDK,移除内存优化参数,部分JDK不适用,移除 DOLPHINSCHEDULER_LOG_DIR copy by @zhzhenqin in #213
  • [Improvement-214][Service packages] Upgrade Dinky to v0.7.2, DolphinScheduler to v3.1.4 by @leeoo in #215
  • 调整 ui 和 api 的打包结构,增加versions-maven-plugin by @zhzhenqin in #217
  • [#218][feat] Auto-start services when worker restart. by @WujieRen in #231
  • [Bug][Fix]Multiple cluster installation issues by @gmady520 in #244
  • Improvement-238 add dolphinscheduler script control_ds.sh by @chenss-1 in #245
  • 支持优先从worker templates下加载配置模版,其次从component根目录下加载 by @zhzhenqin in #240
  • fix the bug of adding starrocks backend and follower. by @zhangdw123 in #246

New Contributors

Full Changelog: v1.1.0...v1.1.1-beta