Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ultimate dream : bookmarklet to add tts reader for french to dubbing voiceover subtitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) by taking inspiration from open source extensions Voice-over-translation and EasySubs useful to learn languages ​​easily and comfortably and also useful for visually impaired viewers please when we have voice overs from subtitles audio track with dubbed voice convert video into translated audio ! #59

Open
trimechee opened this issue Oct 14, 2024 · 10 comments
Assignees
Labels
enhancement New feature or request

Comments

@trimechee
Copy link

trimechee commented Oct 14, 2024

Feature description

Hello, my request is a bit weird and wacky, but I'm trying my luck haha,

so I've been watching  anime in french-language  since 3 years because I have difficulty understanding spoken English lol, but the problem is that many good anime are not dubbed in French, streaming sites like voir anime, franch-anime.....offer vostfr but I don't like vostfr which tires my eyes in addition after my laptop broke down, I went back to using my old eee pc from 2012 which has a small screen.....

the solution I found is to download the video, then play it with potplayer or allplayer by adding a subtle file in French and potplayer has a native tts reader voice synthesizer with several times and potplayer can read the subtitles in French so no need to read subtitles, I listen to potlayer pronounce the subtitles with tts reader ....

but it's tiring to have to look for subtitles, download the video.....

i prefer to watch the video directly with the web browser that uses tts reader to read the subtitles of the streaming video, there is the famous Russian browser yandex that uses a neural network to give subtitles to the video and to dubbing substitles voiceover  / Subtitle Reader Speaker with natural voices of the famous yandex company : 

""Video translation and dubbing
The browser can translate video:

into russian - from english, french, german, spanish, italian, chinese, japanese and korean;

into kazakh - from russian and english.

Men speak in a male voice and women in a female voice.

To watch the video in russian or kazakh:

Hover your mouse over the video.

Click on Translate and Voice or . The video will continue to be narrated in your language. " developers have developed extension tools to allow the use of Yandex Browser features even if you do not use Yandex Browsers!! ME-EN.md the problem yandex browser and the voice-over-translation extension do not support dubbing in french :( 

I read a news edge browser will perhaps support dubbing substitles feature using AI but I am using windows 7 os and I cannot currently use edge browser :( I tried with the Subtitles extension Reader



https://chromewebstore.google.com/detail/subtitle-reader-for-netfl/mefblbojlnanpbommjbkmpfmplmpfaim


but this extension does not support my favorite streaming sites....

i tried the specialized extension to add subtitles to streaming videos:

https://github.com/plussub/plussub

but this extension does not support dubbing subtitles....

so the ultimate   dream please  is a bookmarklet=  i playback a vostfr video and i download the subtitles and the bookmarklet uses a tts reader voice synthesizer (maybe using an external service) so i watch the vostfr video and the bookmarklet will read the subtitles file with using tts reader or yandex tool to dubbing substitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company and take inspiration from these open source tools that use yandex dubbing substitles service : 



https://github.com/ilyhalight/voice-over-translation/blob/master/README-EN.md

https://github.com/FOSWLY/vot-cli








UPDATE : great news !!

This night I discover open source extension with the incredible option: "Instant word pronunciation improves your listening and speaking skills with correct pronunciations" !!

I have not yet tried this open source extension if it has a tts for french and if it can read the subtitles in french because I am still in shock and we hope please maybe to be inspired by this open source extension to add the ultimate dream: a tts for french please, thank you very much !!!

https://github.com/Nitrino/easysubs

https://easysubs.cc/en/

https://chromewebstore.google.com/detail/easysubs-%E2%80%93-learn-language/ocelmccppkcibiflhhepafdjjomimddf?utm_source=easysubsco&utm_medium=social&utm_campaign=easysubs_co&hl=en



*********************************

i know it's very complicated and i should have yandex browser and the extension voice-over-translation support dubbing in french , or get a new modern laptop to use edge browser which may have added dubbing feature....

but i'll try my luck, are there bookmarlets or is it technically possible for a bookmarlet to dubbing substiles in french while we watch vostfr streaming video please ?

I allow myself to dream lol because the capabilities of web browsers become incredible by reading this announcement: 

https://wasmer.io/posts/clang-in-browser 

about a major revolutionary technological advance:

 "Running C programs in the browser using the WebAssembly runtime "a major step to make any software work with WebAssembly", according to Wasmer" 



"Compiling native Python libraries directly from within WASIX. Imagine able being to have PIP compiling things in Wasm upon install e.g, .: wasmer run py thon --entrypoint pip -- install numpy # This compiles numpy to WASIX, all within Wasmer processes Using py2wasm with a bundled compiler Compiling Static Hermes to WASIX, so we can generate native Wasm files from JS."

Update : even if i didn't test them because I'm in shock and my old eee pc is weak, I found new extensions with realistic voiceover dubbing by using the latest model powered by GPT-4o..... :

https://fluentai.pro/
https://github.com/yazykextension/forum/discussions

https://www.languagereactor.com/

and

https://ai.opensubtitles.com/
https://www.opensubtitles.org/fr

https://app.vivalabs.ai/

and i find also tts api , the unofficial tts api of microsoft edge....i will post all my discovries discoveries and it will be a reference that could help to make a tts bookmarklet :

https://www.opensubtitles.com/fr
https://www.opensubtitles.org/fr

https://easysubs.cc/fr/
[email protected]
https://t.me/easysubs_ext
https://nitrino.dev/
https://github.com/Nitrino/easysubs

https://github.com/ilyhalight/voice-over-translation
https://github.com/sodapng/voice-over-translation
https://github.com/FOSWLY/vot-cli
https://toil.cc/

FluentAI : Sous-titres doubles pour Netflix et plu
https://fluentai.pro/
Yazyk Language Learning with Netflix
https://github.com/yazykextension/forum/discussions
https://chromewebstore.google.com/detail/fluentai-sous-titres-doub/hbghjfaenddmdpbkobgdcgkmcdcdjjko
https://discord.gg/zAmzU4wmQN
https://t.me/+QmmVGxbf-Po0NGI0

https://github.com/plussub/plussub
https://github.com/ste-xx
http://stefan.breitenstein.dev/
https://twitter.com/_____ste_____

https://substital.com/
[email protected]
Substital extension Chat
https://t.me/+H2hYjbBEKnszZWIy
https://www.youtube.com/channel/UCedSumIkKa5tpBg6BmRT2Ig
https://twitter.com/substital

Language Reactor
https://www.languagereactor.com/
[email protected]

Subtitle Reader for Netflix
https://chromewebstore.google.com/detail/subtitle-reader-for-netfl/mefblbojlnanpbommjbkmpfmplmpfaim
Browser Extensions
[email protected]

https://ai.opensubtitles.com/
https://www.opensubtitles.org/fr

https://app.vivalabs.ai/

microsoft edge browser voiceover
https://www.microsoft.com/fr-fr/edge/?form=MA13FJ&ch=1

yandex browser feature
translation and video dubbing voiceover
https://browser.yandex.com/help/ru/search-and-browse/translators-settings#videos
https://browser.yandex.com/

sous-titre substitles media streaming player
https://github.com/vincemann/subtitle-buddy
https://sourceforge.net/projects/subsplayer/

https://www.cross-plus-a.com/balabolka.htm

https://pot-app.com/en/
https://github.com/pot-app/pot-desktop
[email protected]

https://github.com/carsonip/Penguin-Subtitle-Player
https://sourceforge.net/projects/subsplayer/

https://www.softpedia.com/get/Multimedia/Audio/Other-AUDIO-Tools/Titlespeak.shtml
https://alternativeto.net/software/subtospeech/about/

https://github.com/alekssamos/YandexTranslate
[email protected]
https://alekssamos.github.io/
https://t.me/alekssamos
https://vk.com/alekssamos

https://www.nvda.fr/a50

https://github.com/alekssamos/msspeech
https://pypi.org/project/msspeech/
https://github.com/alekssamos/acapela_box
https://github.com/maudoin/ollama-voice
https://github.com/willwade/mms-tts-multilingual-models-onnx
https://pypi.org/project/pyttsx3/
https://github.com/thevickypedia/py3-tts
https://github.com/wannaphong/ttsmms
https://pyttsx3.readthedocs.io/en/latest/#
https://github.com/nateshmbhat/pyttsx3
https://github.com/mediatechlab/tts-wrapper
https://github.com/AceCentre/SpeechBubble
https://github.com/davidacm/NVDA-IBMTTS-Driver
https://github.com/davidacm/PicoTTS-NVDA
https://github.com/ttop32/coqui_tts_korea
[email protected]
Настройка Firefox в Linux
https://habr.com/ru/articles/459880/
https://habr.com/ru/users/grey_rat/publications/articles/

Anything else?

No response

@trimechee trimechee added the enhancement New feature or request label Oct 14, 2024
@trimechee trimechee changed the title Ultimae dream : bookmarlet to dubbing substitles Ultimate dream : bookmarlet to dubbing substitles Oct 14, 2024
@trimechee trimechee changed the title Ultimate dream : bookmarlet to dubbing substitles Ultimate dream : bookmarlet to dubbing substitles / Subtitle Reader Oct 14, 2024
@trimechee trimechee changed the title Ultimate dream : bookmarlet to dubbing substitles / Subtitle Reader Ultimate dream : bookmarlet to dubbing substitles / Subtitle Reader Speaker Oct 14, 2024
@trimechee trimechee changed the title Ultimate dream : bookmarlet to dubbing substitles / Subtitle Reader Speaker Ultimate dream : bookmarklet to dubbing substitles / Subtitle Reader Speaker Oct 15, 2024
@trimechee trimechee changed the title Ultimate dream : bookmarklet to dubbing substitles / Subtitle Reader Speaker Ultimate dream : bookmarklet to dubbing substitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company Oct 15, 2024
@trimechee trimechee changed the title Ultimate dream : bookmarklet to dubbing substitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company Ultimate dream : bookmarklet to dubbing substitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) Oct 15, 2024
@trimechee
Copy link
Author

More informations about this unique
yandex feature

translation and video dubbing :

https://browser.yandex.com/help/ru/search-and-browse/translators-settings#videos

@trimechee trimechee changed the title Ultimate dream : bookmarklet to dubbing substitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) Ultimate dream : bookmarklet to dubbing substitles in french / Subtitle Reader Speaker voiceover with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) Oct 15, 2024
@trimechee trimechee changed the title Ultimate dream : bookmarklet to dubbing substitles in french / Subtitle Reader Speaker voiceover with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) Ultimate dream : bookmarklet to dubbing voiceover substitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) Oct 15, 2024
@trimechee
Copy link
Author

Mr @thomasleplus, sorry for long message, just to be clearer please, what I hope to say, for example I playback a vostfr streaming video in the web browser, and I go to the famous opensubstitle site to look for the subtitle corresponding to the episode of the anime that I am watching, and I click on the boobkmarklet which will detect the online subtitle on the opensubstiles page or why not the bookmarklet activates the subtitle downloaded locally and while I watch the streaming video, the bookmarklet reads speak the subtitle using an external service or the tts voices of windows os or the natural voices of yandex:

Worker proxy-server for voice-over-translation :
https://github.com/FOSWLY/vot-worker

https://github.com/FOSWLY/vot-backend

https://github.com/FOSWLY/media-converter-backend

https://github.com/FOSWLY/translate-backend https://github.com/FOSWLY/vot.js

@trimechee
Copy link
Author

@trimechee
Copy link
Author

Hi, also i find secret rare anime websites that have media player that has rare feature to add with one click native integrated files substitles in almost all languages!!

il will awesome please if the eventual bookmarket can detect this integrated substiles files of the media player of streaming websites and voiceover dubbing read these substitles in french language, thank you!

https://aniwave.se/
https://9animetv.to/
https://movies2watch.tv/

https://hianime.to/home
https://hianime.tv/

https://theindex.moe/

https://kuroiru.co/app
https://kuroiru.co/

https://everythingmoe.com/#section-streaming
https://everythingmoe.com/

https://gogoanimes.mobi/

https://kissanime.com.ru/
https://kissanime.help/
https://kissasian.si/

https://allmanga.to/

https://animefox.sbs/home

https://tv.zoro.se/home
https://zoroxtv.info/

@trimechee trimechee changed the title Ultimate dream : bookmarklet to dubbing voiceover substitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) Ultimate dream : bookmarklet to dubbing voiceover subtitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) Oct 16, 2024
@trimechee
Copy link
Author

Hi, I talk with the developer of Voice-over-translation extension to ask him to support a tts for french in streaming websites with has emedded subtitles comme dans ce site streaming that offers a lot of anime episodes with media player that has integrated embedded subtitles in several languages: we should choose the media player with the acronym notice: S-Dub to test the feature, and we can even change the size and background color of the subtitles:

https://aniwave.se/anime-watch/boruto-naruto -next-generations/ep-1

https://github.com/ilyhalight/voice-over-translation

he replied “Unfortunately, I will not be able to add TTS for French yet because Yandex has disabled it in the api "

so I asked him if Voice-over-translation can use alternative APIs from Google Translator, Papago Naver Translator from the famous Korean company Naver or Bing Translator because these famous translators have TTS for French?

and he replied:

"To do this, you need to develop your own translation logic that will convert video into translated audio. I've tried to do something similar, but so far it's not working out very well. "

so while waiting for Yandex to hopefully add tts for french API, since, if I'm not mistaken, chrome apparently doesn't offer a tts reader, it would be great to have a tts reader bookmarklet to read the news article for example, maybe by sending the article to an external service, or using a windows os tts....

@trimechee
Copy link
Author

UPDATE : great news !!

Hi again Mr @thomasleplus ,this night I discover open source extension with the incredible option: "Instant word pronunciation improves your listening and speaking skills with correct pronunciations" !!

I have not yet tried this open source extension if it has a tts for french and if it can read the subtitles in french because I am still in shock and we hope please maybe to be inspired by this open source extension to add the ultimate dream: a tts for french please, thank you very much !!!

https://github.com/Nitrino/easysubs

https://easysubs.cc/en/

https://chromewebstore.google.com/detail/easysubs-%E2%80%93-learn-language/ocelmccppkcibiflhhepafdjjomimddf?utm_source=easysubsco&utm_medium=social&utm_campaign=easysubs_co&hl=en

@trimechee trimechee changed the title Ultimate dream : bookmarklet to dubbing voiceover subtitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) Ultimate dream : bookmarklet to add tts reader for french to dubbing voiceover subtitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) by taking inspiration from open source extensions Voice-over-translation and EasySubs Oct 18, 2024
@trimechee trimechee changed the title Ultimate dream : bookmarklet to add tts reader for french to dubbing voiceover subtitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) by taking inspiration from open source extensions Voice-over-translation and EasySubs Ultimate dream : bookmarklet to add tts reader for french to dubbing voiceover subtitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) by taking inspiration from open source extensions Voice-over-translation and EasySubs useful to learn languages ​​easily and comfortably and also useful for visually impaired viewers please when we have voice overs from subtitles audio track with dubbed voice convert video into translated audio ! Oct 18, 2024
@thomasleplus
Copy link
Owner

thomasleplus commented Oct 20, 2024

Hi @trimechee,

I apologize for not responding sooner but I am currently traveling for work. I will review your issues after I come back and got some rest. Also I should confess that I am not a Javascript expert so I will do my best to implement the issues that I can.

Cheers,

Tom

@trimechee
Copy link
Author

trimechee commented Oct 20, 2024

Great ! Thank you so much Mr Tom @thomasleplus :) and sorry for my too long messages !

i think my ultimate dream has already come true thanks God by finding 2 days ago the rare easysubs open source extension which allows us to read french subtitles, even if I haven't tried this extension yet because I'm still so incredulous and shocked.....

so voilà, my request now is just a french tts reader to read press articles but if it's going to tire you out too much and it's too complex..... there is no need to make this bookmarklet anymore :) or please just keep this suggestion just for the future if javascript technology becomes mature enough and enough handy, integrable, easy..... thank you :)

@trimechee
Copy link
Author

Update : even if i didn't test them because I'm in shock and my old eee pc is weak, I found new extensions with realistic voiceover dubbing by using the latest model powered by GPT-4o..... :

https://fluentai.pro/
https://github.com/yazykextension/forum/discussions

https://www.languagereactor.com/

and

https://ai.opensubtitles.com/
https://www.opensubtitles.org/fr

https://app.vivalabs.ai/

@trimechee
Copy link
Author

and i find also tts api , the unofficial tts api of microsoft edge....i will post all my discovries discoveries and it will be a reference that could help to make a tts bookmarklet:, i will ad these discoveries in the first post :

https://www.opensubtitles.com/fr
https://www.opensubtitles.org/fr

https://easysubs.cc/fr/
[email protected]
https://t.me/easysubs_ext
https://nitrino.dev/
https://github.com/Nitrino/easysubs

https://github.com/ilyhalight/voice-over-translation
https://github.com/sodapng/voice-over-translation
https://github.com/FOSWLY/vot-cli
https://toil.cc/

FluentAI : Sous-titres doubles pour Netflix et plu
https://fluentai.pro/
Yazyk Language Learning with Netflix
https://github.com/yazykextension/forum/discussions
https://chromewebstore.google.com/detail/fluentai-sous-titres-doub/hbghjfaenddmdpbkobgdcgkmcdcdjjko
https://discord.gg/zAmzU4wmQN
https://t.me/+QmmVGxbf-Po0NGI0

https://github.com/plussub/plussub
https://github.com/ste-xx
http://stefan.breitenstein.dev/
https://twitter.com/_____ste_____

https://substital.com/
[email protected]
Substital extension Chat
https://t.me/+H2hYjbBEKnszZWIy
https://www.youtube.com/channel/UCedSumIkKa5tpBg6BmRT2Ig
https://twitter.com/substital

Language Reactor
https://www.languagereactor.com/
[email protected]

Subtitle Reader for Netflix
https://chromewebstore.google.com/detail/subtitle-reader-for-netfl/mefblbojlnanpbommjbkmpfmplmpfaim
Browser Extensions
[email protected]

https://ai.opensubtitles.com/
https://www.opensubtitles.org/fr

https://app.vivalabs.ai/

microsoft edge browser voiceover
https://www.microsoft.com/fr-fr/edge/?form=MA13FJ&ch=1

yandex browser feature
translation and video dubbing voiceover
https://browser.yandex.com/help/ru/search-and-browse/translators-settings#videos
https://browser.yandex.com/

sous-titre substitles media streaming player
https://github.com/vincemann/subtitle-buddy
https://sourceforge.net/projects/subsplayer/

https://www.cross-plus-a.com/balabolka.htm

https://pot-app.com/en/
https://github.com/pot-app/pot-desktop
[email protected]

https://github.com/carsonip/Penguin-Subtitle-Player
https://sourceforge.net/projects/subsplayer/

https://www.softpedia.com/get/Multimedia/Audio/Other-AUDIO-Tools/Titlespeak.shtml
https://alternativeto.net/software/subtospeech/about/

https://github.com/alekssamos/YandexTranslate
[email protected]
https://alekssamos.github.io/
https://t.me/alekssamos
https://vk.com/alekssamos

https://www.nvda.fr/a50

https://github.com/alekssamos/msspeech
https://pypi.org/project/msspeech/
https://github.com/alekssamos/acapela_box
https://github.com/maudoin/ollama-voice
https://github.com/willwade/mms-tts-multilingual-models-onnx
https://pypi.org/project/pyttsx3/
https://github.com/thevickypedia/py3-tts
https://github.com/wannaphong/ttsmms
https://pyttsx3.readthedocs.io/en/latest/#
https://github.com/nateshmbhat/pyttsx3
https://github.com/mediatechlab/tts-wrapper
https://github.com/AceCentre/SpeechBubble
https://github.com/davidacm/NVDA-IBMTTS-Driver
https://github.com/davidacm/PicoTTS-NVDA
https://github.com/ttop32/coqui_tts_korea
[email protected]
Настройка Firefox в Linux
https://habr.com/ru/articles/459880/
https://habr.com/ru/users/grey_rat/publications/articles/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants