[REQUEST] Annealing schedule of hyperparameters

[peymvn]

Hello,
Thank you for this great work! I’ve been working with an algorithm very similar to CQL, but with a key difference: we require annealing schedules for the hyperparameters (e.g., adjusting the conservative alpha at each step). I didn’t see this feature in your implementation.
I would be grateful if you could let me know whether this has already been implemented. If not, what do you think would be the best approach to add this functionality?
Thank you for your guidance!

[takuseno]

@peymvn Thanks for the issue. Currently, it's not supported by default. However, there is a workaround to anneal learning rates:

d3rlpy/reproductions/offline/iql.py

Line 35 in 3433de5

# workaround for learning scheduler

You can try this in your experiments with the current version of d3rlpy.