2.8.2.6.rc0
Pre-release
Pre-release
Release notes - hops - Version 2.8.2.6
Bug
- [HOPS-369] - wrong vaule for dfs.blockreport.intervalMsec in hdfs-default.xml
- [HOPS-482] - Throttle block reports based on max no of blcok reports
- [HOPS-638] - apply HDFS-6238
- [HOPS-639] - apply HDFS-6194
- [HOPS-640] - apply HDFS-6214
- [HOPS-641] - apply HDFS-6219
- [HOPS-642] - apply HDFS-4909
- [HOPS-643] - apply HDFS-6245
- [HOPS-644] - Inode id will eventually become too big
- [HOPS-656] - apply HDFS-6178
- [HOPS-657] - apply HDFS-6275
- [HOPS-658] - apply HDFS-6217
- [HOPS-659] - apply HDFS-6276
- [HOPS-664] - apply HDFS-6218
- [HOPS-665] - apply HDFS-6288
- [HOPS-666] - apply HDFS-2882
- [HOPS-671] - apply HDFS-6337
- [HOPS-672] - apply HDFS-5381
- [HOPS-673] - apply HDFS-6340
- [HOPS-674] - Use FQDN when authenticating incoming RPCs with CN
- [HOPS-675] - DFSConfigKeys set the same value for misreplicated number of threads and number of batches
- [HOPS-678] - apply HDFS-6294
- [HOPS-679] - apply HDFS-6328
- [HOPS-681] - apply HDFS-6351
- [HOPS-682] - update hdfs-default.xml after HOPS-482
- [HOPS-683] - apply HDFS-6230
- [HOPS-684] - apply HDFS-5522
- [HOPS-685] - CRL validation does not work with new keystore schema
- [HOPS-686] - apply HDFS-6367
- [HOPS-687] - apply HDFS-6305
- [HOPS-688] - INodeUtils.getINodeIdsForBlockIds should not try to get too many blocks at once.
- [HOPS-690] - HopsExceptionHelper.isTransient should be base on the enum and not the string
- [HOPS-691] - ER_GET_TEMPORARY_ERRMSG should be transient in HopsSQLExceptionHelper
- [HOPS-692] - NameNodeResourceMonitor should check the health of the DB instead of QuotaUpdateMonitor
- [HOPS-693] - retry cache cleaner need fixing
- [HOPS-697] - dependency to com.fasterxml.jackson.core 2.2.3 is a security issue
- [HOPS-698] - apply HDFS-6370
- [HOPS-699] - apply HDFS-6326
- [HOPS-700] - apply HDFS-6287
- [HOPS-702] - apply HDFS-6362
- [HOPS-703] - apply HDFS-6402
- [HOPS-704] - apply HDFS-6345
- [HOPS-705] - apply HDFS-6250
- [HOPS-706] - apply HDFS-4913
- [HOPS-707] - apply HDFS-6325
- [HOPS-708] - apply HDFS-6397
- [HOPS-709] - apply HDFS-6421
- [HOPS-710] - apply HDFS-6396
- [HOPS-712] - apply HDFS-6423
- [HOPS-713] - apply HDFS-6227
- [HOPS-716] - apply HDFS-6461
- [HOPS-717] - apply HDFS-6356
- [HOPS-718] - apply HDFS-6404
- [HOPS-719] - apply HDFS-6472
- [HOPS-721] - apply HDFS-6424
- [HOPS-722] - apply HDFS-6268
- [HOPS-723] - apply HDFS-6369
- [HOPS-724] - apply HDFS-6497
- [HOPS-726] - apply HDFS-6257
- [HOPS-727] - apply HDFS-6399
- [HOPS-728] - apply HDFS-6315
- [HOPS-729] - apply HDFS-6379
- [HOPS-731] - apply HDFS-3493
- [HOPS-732] - apply HDFS-6330
- [HOPS-733] - apply HDFS-6529
- [HOPS-734] - apply HDFS-6539
- [HOPS-735] - apply HDFS-6530
- [HOPS-736] - apply HDFS-6559
- [HOPS-737] - apply HDFS-6480
- [HOPS-738] - Calls to concurrentBlkReports fail
- [HOPS-739] - BlockInfo.isReplicatedOnDatanode access the dabase without using the entityManager
- [HOPS-740] - Call to findBlockInfosByStorageId can overload the database
- [HOPS-741] - BlockManager.processReport should parallelize adding blocks for first report
- [HOPS-742] - FSNameSystem.addSafeBlocks can overload the database
- [HOPS-743] - Datanode removal is too slow
- [HOPS-744] - ClassCastException in BlockManager.processReport
- [HOPS-745] - EntityContext logger print too much
- [HOPS-746] - Fix client API to get number of namenodes.
- [HOPS-749] - UnderReplicatedBlockClusterj.removeAll() does not scale
- [HOPS-750] - BlockManager.processOverReplicatedBlocksOnReCommission and BlockManager.isReplicationInProgress are too slow
- [HOPS-751] - apply HDFS-3848
- [HOPS-752] - apply HDFS-6312
- [HOPS-754] - apply HDFS-6535
- [HOPS-755] - apply HDFS-6222
- [HOPS-756] - apply HDFS-6583
- [HOPS-759] - apply HDFS-6562
- [HOPS-760] - apply HDFS-6598
- [HOPS-761] - apply HDFS-6475
- [HOPS-762] - apply HDFS-6558
- [HOPS-763] - apply HDFS-6591
- [HOPS-764] - apply HDFS-6614
- [HOPS-765] - APPLY hdfs-6604
- [HOPS-766] - apply HDFS-6610
- [HOPS-768] - apply HDFS-6493
- [HOPS-769] - Block report hash mismatch when files are deleted.
- [HOPS-772] - apply HDFS-6646
- [HOPS-773] - apply HDFS-6622
- [HOPS-775] - apply HDFS-6631
- [HOPS-776] - apply HDFS-6640
- [HOPS-778] - apply HDFS-6630
- [HOPS-779] - apply HDFS-2976
- [HOPS-781] - apply HDFS-6678
- [HOPS-785] - apply HDFS-6478
- [HOPS-787] - apply HDFS-6599
- [HOPS-788] - apply HDFS-6616
- [HOPS-789] - apply HDFS-6632
- [HOPS-791] - apply HDFS-6723
- [HOPS-792] - apply HDFS-6715
- [HOPS-795] - apply HDFS-6749
- [HOPS-796] - apply HDFS-6739
- [HOPS-798] - apply HDFS-6768
- [HOPS-799] - apply HDFS-6797
- [HOPS-800] - Transaction nested diagnostic contexts is not properly printed.
- [HOPS-801] - apply HDFS-6788
- [HOPS-802] - apply HDFS-6793
- [HOPS-803] - Clean up logs and print containing "GAUTIER"
- [HOPS-804] - clear excessReplicateMap when going out of safemode
- [HOPS-805] - In INFO log level BRLoadBalancingException and setCacheUsed are causing too much logs in the NN
- [HOPS-806] - It is difficult to know when BlockManager.processMisReplicatesAsync will finish looking at the logs
- [HOPS-807] - SetOwner should update the usersgroups cache on all namenodes
- [HOPS-809] - Check if retryCache is enabled before acquiring its lock
- [HOPS-810] - Check if erasureCoding is enabled before taking the lock in appendFileHopsFS
- [HOPS-811] - calling hflush invalidates block hashes
- [HOPS-812] - setOwner shouldn't add the owner user to the owner group
- [HOPS-814] - LightWeightRequestHandler should ensure that the session is returned
- [HOPS-815] - the Slicer should not have its own thread pool
- [HOPS-816] - Improve randomization in HopsRandomStickyFailoverProxyProvider
- [HOPS-817] - Compare NDB Exception using error codes
- [HOPS-818] - manage-disk-table.py script does not work while writing files to non default location
- [HOPS-819] - Close leader NN and other namenode proxies in DFSClient.close
- [HOPS-820] - Startup safe block count is wrong
- [HOPS-821] - Non leader namenode may never properly leave safe mode
- [HOPS-823] - Fix race condition in BPOffersevice and BPOfferActor threads
- [HOPS-824] - Remove temporary files in hadoop-hdfs-project/hadoop-hdfs/build/test/data/temp/decommission
- [HOPS-825] - Yarn quota service does not handle node manager death properly
- [HOPS-827] - FSNamesystem.addSafeBlocks can creat deadlock when called in BlockManager.addStoredBlockImmediateTX
- [HOPS-828] - apply HADOOP-14597
Improvement
- [HOPS-655] - apply HDFS-6265
- [HOPS-660] - apply HDFS-6279
- [HOPS-661] - apply HDFS-5693
- [HOPS-662] - apply HDFS-6273
- [HOPS-663] - apply HDFS-6282
- [HOPS-667] - apply HDFS-6269
- [HOPS-668] - apply HDFS-6304
- [HOPS-669] - apply HDFS-5168
- [HOPS-670] - apply HDFS-6295
- [HOPS-676] - Rewrite the UsersGroups cache
- [HOPS-677] - Parallelize -copyFromLocal for directories
- [HOPS-680] - Change content of application specific keystore
- [HOPS-689] - apply HDFS-6186
- [HOPS-701] - apply HDFS-5683
- [HOPS-714] - apply HDFS-6448
- [HOPS-715] - apply HDFS-6453
- [HOPS-720] - apply HDFS-6109
- [HOPS-725] - apply HDFS-6297
- [HOPS-730] - apply HDFS-6460
- [HOPS-753] - apply HDFS-6403
- [HOPS-757] - apply HDFS-6580
- [HOPS-758] - apply HDFS-6578
- [HOPS-767] - apply HDFS-6613
- [HOPS-770] - apply HDFS-6638
- [HOPS-771] - apply HDFS-6627
- [HOPS-774] - apply HDFS-6643
- [HOPS-777] - apply HDFS-5202
- [HOPS-780] - apply HDFS-3851
- [HOPS-783] - apply HDFS-5910
- [HOPS-784] - apply HDFS-2856
- [HOPS-786] - apply HDFS-6655
- [HOPS-790] - apply HDFS-6701
- [HOPS-793] - apply HDFS-6755
- [HOPS-794] - apply HDFS-6750
- [HOPS-797] - apply HDFS-6570
- [HOPS-808] - Fix performance degradation due to safemode and enable namenode resource monitoring