Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

After training there is a periodic pattern in the reconstructed melspectrogram #138

Open
krantiparida opened this issue Nov 5, 2022 · 2 comments

Comments

@krantiparida
Copy link

Thanks for making the code public. I used the same architecture and parameters as described in the paper. After training the network I see some periodic lines in the melspectrogram of the reconstruction. I am attaching an image below for reference (the reconstructed melspectrogram is the rightmost one). Can you please suggest me what might be the reason for this? This pattern is consistent across all the predictions.
noise_wR8qIPb8eWw_280

@adiyoss
Copy link
Contributor

adiyoss commented Dec 1, 2022

Hi @krantiparida,
That is strange, we did not observe anything like that in our models. Did you use the same config file as ours? What model version are you using?

@YunyangZeng
Copy link

YunyangZeng commented Feb 17, 2023

We observed similar issue during fine-tuning Demucs. If you are training with only the waveform loss, my experience is this issue can be alleviated by the multi resolution STFT loss. Here is a paper that explains the potential cause of this tonal artifact issue:
https://arxiv.org/abs/2010.14356

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants