Experiment on sent140 is not generating the result mentioned in the paper

[mustansarsaeed]

Hi, I hope you are fine and thank you for sharing the reference implementations. I am trying to produce the plots mentioned in the paper for sent140 dataset. The steps I have followed are as follow:

1. git clone https://github.com/TalwalkarLab/leaf.git
2. cd leaf/data/sent140
3. ./preprocess.sh --sf 0.5 -k 10 -s niid -t sample --spltseed 1549775860
4. cd models/sent140
5. ./get_embs.sh
6. cd models
7. python3 main.py -dataset 'sent140' -model 'stacked_lstm' --num-rounds 100 --clients-per-round 10 --metrics-dir 2020-09-21-sent140-exp4_r200

Above command generated the following plot

:

Can you please help out what can be the issue? Is there anything I am missing?

Thank you