Tts melnet can we try

[JRMeyer]

>>> muruganrajenthirean
[August 25, 2019, 10:27am]

MelNet Paper slash
MelNet Pytorch Code slash
MelNet Voice example

Awesome. voice more realistic.

here my questions,

1. how do we build MelNet model like this WaveNet Mol model?
2. if i replace WaveRNN to MelNet code in TTS, which part to start and do stuff?

i am a beginner for all this. my way of understanding i am asking this
sir. slash
continuously i am researching it. i will ask more doubts about MelNet.

[This is an archived TTS discussion thread from discourse.mozilla.org/t/tts-melnet-can-we-try]

[JRMeyer]

>>> alchemi5t
[August 26, 2019, 5:05am]

{.avatar

> how do we build MelNet model like this WaveNet Mol
> model ?

Train your tacotron2 till you have decent o/p. Then use erogol's wavernn
fork to:

First, generate mel specs with the ipynb(ExtractTTSpectrogram.ipynb).

Add the data paths to config.

Train wavernn.

[Archived Post]

[JRMeyer]

>>> erogol
[August 26, 2019, 12:45pm]

I think, we can try the idea that predicts the spectrograms
incrementally in different scales regardless of MelNet.

[Archived Post]

[JRMeyer]

>>> erogol
[August 26, 2019, 12:47pm]

also please correct me if Im wrong, but MelNet uses GL like vocoder.
Therefore, I don't see its gain as an alternative to WaveRNN

[Archived Post]

[JRMeyer]

>>> muruganrajenthirean
[August 27, 2019, 3:44am]

. here the same
way we need to train MelNet by using ExtractTTSpectrogram.ipynb.

Add the data paths to config. slash
that is fine. but that config.json parameters are same? or what we need
to change in MelNet architecture?

sorry, i will start processing. any doubts i will ask here.

[Archived Post]

[JRMeyer]

>>> alchemi5t
[August 27, 2019, 4:28am]

{.avatar

> here the same way we need to train MelNet by using
> ExtractTTSpectrogram.ipynb.

I don't think it's that straight forward.

{.avatar

> that is fine. but that config.json parameters are same?

For training WaveRNN, you can find discussions on the config file
here: slash

{.avatar
processing](https://discourse.mozilla.org/t/query-regarding-post-processing/44070/30)
drop-close='true'
.box}

> I'll start training WaveRNN again with the my new taco2 model, I'll
> really appreciate if you share your intuition of the issue, I mean to
> avoid waste compute. Here's the new config.
> configs.zip
> (3,8 KB)

{.avatar

> or what we need to change in MelNet architecture?

Like erogol said, I don't think it's an alternate vocoder either. slash
Also, config files and any/all implementation of neural networks are not
implicitly connected. You could possibly change everything about it
depending on how you implement the pipeline.

Regardless, if you're looking for a vocoder, Erogol's fork of wavernn
should work well with mozilla TTS's taco2.

Good luck!

P.S. I might be wrong about MelNet. Reading the paper atm.

[Archived Post]

[JRMeyer]

>>> muruganrajenthirean
[August 28, 2019, 4:42am]

![:slight_smile:](

Then i will try to research on pipline different between WaveRNN and
MelNet. like you said that curl-run-all.sh discourse.mozilla.org html-to-markdown.sh ordered-posts ordered-posts~ TTS.cdx tts.commands tts-emails.txt TTS.pages tts-telegram.txt TTS.warc.gz slash 'You could possibly change everything
about it depending on how you implement the pipeline. slash '**

Thanks
![:slight_smile:](

[Archived Post]