Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Audio Modelling #9

Open
ClashLuke opened this issue Apr 30, 2022 · 0 comments
Open

Audio Modelling #9

ClashLuke opened this issue Apr 30, 2022 · 0 comments
Labels
ML Requires machine-learning knowledge (can be built up on the fly) research Creative project that might fail but could give high returns

Comments

@ClashLuke
Copy link
Member

There are multiple ways we could go about modelling audio. For example, we could tokenise sounds or audio snippets and autoregressively predict the next token. Whether the audio tokens come from a VQGAN or discrete Fourier transformation doesn't matter to the model but could change the performance of our generation a lot. This issue is about finding out how to model sound and develop an end-to-end pipeline to develop a prototype and see how it works.
@ClashLuke ClashLuke added the research Creative project that might fail but could give high returns label Apr 30, 2022
@ClashLuke ClashLuke changed the title Audio Modeling Audio Modelling Apr 30, 2022
@ClashLuke ClashLuke mentioned this issue Apr 30, 2022
Open
@ClashLuke ClashLuke added the ML Requires machine-learning knowledge (can be built up on the fly) label Apr 30, 2022
This was referenced May 15, 2022
Merged
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
ML Requires machine-learning knowledge (can be built up on the fly) research Creative project that might fail but could give high returns
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ClashLuke