Skip to content

2.8.2.6.rc0

Pre-release
Pre-release
Compare
Choose a tag to compare
@berthoug berthoug released this 21 Nov 08:55
· 11 commits to 2.8.2.6 since this release
    Release notes - hops - Version 2.8.2.6

Bug

  • [HOPS-369] - wrong vaule for dfs.blockreport.intervalMsec in hdfs-default.xml
  • [HOPS-482] - Throttle block reports based on max no of blcok reports
  • [HOPS-638] - apply HDFS-6238
  • [HOPS-639] - apply HDFS-6194
  • [HOPS-640] - apply HDFS-6214
  • [HOPS-641] - apply HDFS-6219
  • [HOPS-642] - apply HDFS-4909
  • [HOPS-643] - apply HDFS-6245
  • [HOPS-644] - Inode id will eventually become too big
  • [HOPS-656] - apply HDFS-6178
  • [HOPS-657] - apply HDFS-6275
  • [HOPS-658] - apply HDFS-6217
  • [HOPS-659] - apply HDFS-6276
  • [HOPS-664] - apply HDFS-6218
  • [HOPS-665] - apply HDFS-6288
  • [HOPS-666] - apply HDFS-2882
  • [HOPS-671] - apply HDFS-6337
  • [HOPS-672] - apply HDFS-5381
  • [HOPS-673] - apply HDFS-6340
  • [HOPS-674] - Use FQDN when authenticating incoming RPCs with CN
  • [HOPS-675] - DFSConfigKeys set the same value for misreplicated number of threads and number of batches
  • [HOPS-678] - apply HDFS-6294
  • [HOPS-679] - apply HDFS-6328
  • [HOPS-681] - apply HDFS-6351
  • [HOPS-682] - update hdfs-default.xml after HOPS-482
  • [HOPS-683] - apply HDFS-6230
  • [HOPS-684] - apply HDFS-5522
  • [HOPS-685] - CRL validation does not work with new keystore schema
  • [HOPS-686] - apply HDFS-6367
  • [HOPS-687] - apply HDFS-6305
  • [HOPS-688] - INodeUtils.getINodeIdsForBlockIds should not try to get too many blocks at once.
  • [HOPS-690] - HopsExceptionHelper.isTransient should be base on the enum and not the string
  • [HOPS-691] - ER_GET_TEMPORARY_ERRMSG should be transient in HopsSQLExceptionHelper
  • [HOPS-692] - NameNodeResourceMonitor should check the health of the DB instead of QuotaUpdateMonitor
  • [HOPS-693] - retry cache cleaner need fixing
  • [HOPS-697] - dependency to com.fasterxml.jackson.core 2.2.3 is a security issue
  • [HOPS-698] - apply HDFS-6370
  • [HOPS-699] - apply HDFS-6326
  • [HOPS-700] - apply HDFS-6287
  • [HOPS-702] - apply HDFS-6362
  • [HOPS-703] - apply HDFS-6402
  • [HOPS-704] - apply HDFS-6345
  • [HOPS-705] - apply HDFS-6250
  • [HOPS-706] - apply HDFS-4913
  • [HOPS-707] - apply HDFS-6325
  • [HOPS-708] - apply HDFS-6397
  • [HOPS-709] - apply HDFS-6421
  • [HOPS-710] - apply HDFS-6396
  • [HOPS-712] - apply HDFS-6423
  • [HOPS-713] - apply HDFS-6227
  • [HOPS-716] - apply HDFS-6461
  • [HOPS-717] - apply HDFS-6356
  • [HOPS-718] - apply HDFS-6404
  • [HOPS-719] - apply HDFS-6472
  • [HOPS-721] - apply HDFS-6424
  • [HOPS-722] - apply HDFS-6268
  • [HOPS-723] - apply HDFS-6369
  • [HOPS-724] - apply HDFS-6497
  • [HOPS-726] - apply HDFS-6257
  • [HOPS-727] - apply HDFS-6399
  • [HOPS-728] - apply HDFS-6315
  • [HOPS-729] - apply HDFS-6379
  • [HOPS-731] - apply HDFS-3493
  • [HOPS-732] - apply HDFS-6330
  • [HOPS-733] - apply HDFS-6529
  • [HOPS-734] - apply HDFS-6539
  • [HOPS-735] - apply HDFS-6530
  • [HOPS-736] - apply HDFS-6559
  • [HOPS-737] - apply HDFS-6480
  • [HOPS-738] - Calls to concurrentBlkReports fail
  • [HOPS-739] - BlockInfo.isReplicatedOnDatanode access the dabase without using the entityManager
  • [HOPS-740] - Call to findBlockInfosByStorageId can overload the database
  • [HOPS-741] - BlockManager.processReport should parallelize adding blocks for first report
  • [HOPS-742] - FSNameSystem.addSafeBlocks can overload the database
  • [HOPS-743] - Datanode removal is too slow
  • [HOPS-744] - ClassCastException in BlockManager.processReport
  • [HOPS-745] - EntityContext logger print too much
  • [HOPS-746] - Fix client API to get number of namenodes.
  • [HOPS-749] - UnderReplicatedBlockClusterj.removeAll() does not scale
  • [HOPS-750] - BlockManager.processOverReplicatedBlocksOnReCommission and BlockManager.isReplicationInProgress are too slow
  • [HOPS-751] - apply HDFS-3848
  • [HOPS-752] - apply HDFS-6312
  • [HOPS-754] - apply HDFS-6535
  • [HOPS-755] - apply HDFS-6222
  • [HOPS-756] - apply HDFS-6583
  • [HOPS-759] - apply HDFS-6562
  • [HOPS-760] - apply HDFS-6598
  • [HOPS-761] - apply HDFS-6475
  • [HOPS-762] - apply HDFS-6558
  • [HOPS-763] - apply HDFS-6591
  • [HOPS-764] - apply HDFS-6614
  • [HOPS-765] - APPLY hdfs-6604
  • [HOPS-766] - apply HDFS-6610
  • [HOPS-768] - apply HDFS-6493
  • [HOPS-769] - Block report hash mismatch when files are deleted.
  • [HOPS-772] - apply HDFS-6646
  • [HOPS-773] - apply HDFS-6622
  • [HOPS-775] - apply HDFS-6631
  • [HOPS-776] - apply HDFS-6640
  • [HOPS-778] - apply HDFS-6630
  • [HOPS-779] - apply HDFS-2976
  • [HOPS-781] - apply HDFS-6678
  • [HOPS-785] - apply HDFS-6478
  • [HOPS-787] - apply HDFS-6599
  • [HOPS-788] - apply HDFS-6616
  • [HOPS-789] - apply HDFS-6632
  • [HOPS-791] - apply HDFS-6723
  • [HOPS-792] - apply HDFS-6715
  • [HOPS-795] - apply HDFS-6749
  • [HOPS-796] - apply HDFS-6739
  • [HOPS-798] - apply HDFS-6768
  • [HOPS-799] - apply HDFS-6797
  • [HOPS-800] - Transaction nested diagnostic contexts is not properly printed.
  • [HOPS-801] - apply HDFS-6788
  • [HOPS-802] - apply HDFS-6793
  • [HOPS-803] - Clean up logs and print containing "GAUTIER"
  • [HOPS-804] - clear excessReplicateMap when going out of safemode
  • [HOPS-805] - In INFO log level BRLoadBalancingException and setCacheUsed are causing too much logs in the NN
  • [HOPS-806] - It is difficult to know when BlockManager.processMisReplicatesAsync will finish looking at the logs
  • [HOPS-807] - SetOwner should update the usersgroups cache on all namenodes
  • [HOPS-809] - Check if retryCache is enabled before acquiring its lock
  • [HOPS-810] - Check if erasureCoding is enabled before taking the lock in appendFileHopsFS
  • [HOPS-811] - calling hflush invalidates block hashes
  • [HOPS-812] - setOwner shouldn't add the owner user to the owner group
  • [HOPS-814] - LightWeightRequestHandler should ensure that the session is returned
  • [HOPS-815] - the Slicer should not have its own thread pool
  • [HOPS-816] - Improve randomization in HopsRandomStickyFailoverProxyProvider
  • [HOPS-817] - Compare NDB Exception using error codes
  • [HOPS-818] - manage-disk-table.py script does not work while writing files to non default location
  • [HOPS-819] - Close leader NN and other namenode proxies in DFSClient.close
  • [HOPS-820] - Startup safe block count is wrong
  • [HOPS-821] - Non leader namenode may never properly leave safe mode
  • [HOPS-823] - Fix race condition in BPOffersevice and BPOfferActor threads
  • [HOPS-824] - Remove temporary files in hadoop-hdfs-project/hadoop-hdfs/build/test/data/temp/decommission
  • [HOPS-825] - Yarn quota service does not handle node manager death properly
  • [HOPS-827] - FSNamesystem.addSafeBlocks can creat deadlock when called in BlockManager.addStoredBlockImmediateTX
  • [HOPS-828] - apply HADOOP-14597

Improvement