Lunar Lander floating problem

[leftluoyi]

I am using Q-Learning to solve the lunar lander v2 problem but facing the same problem as you, i.e., the lander keeps floating on the air. As described in your post , the Monte Carlo RL can solves this problem which Q-Learn cannot. Do you have any idea why it happens?