Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

comprehensible data preparation scripts #2

Open
3 tasks
mateuszwyszynski opened this issue Jan 27, 2024 · 0 comments
Open
3 tasks

comprehensible data preparation scripts #2

mateuszwyszynski opened this issue Jan 27, 2024 · 0 comments
Assignees
Labels
documentation Improvements or additions to documentation enhancement New feature or request

Comments

@mateuszwyszynski
Copy link
Owner

mateuszwyszynski commented Jan 27, 2024

The current way the data scripts (like data/prepare_data.py) work is very messy. Among many problems:

  • there are hard-coded paths from the original paper author's machine
  • the data files which are nested more than one level are not automatically read by the data/prepare_data.py script. One has to manually move these files. This should be automated

Overall the current data preparation process is extremely unclear. There are unanswered questions like:

  • which datasets from the AMASS should be downloaded
  • how to train a model using a smaller subset of datasets
  • after downloading datasets, how exactly the data should be organised for the scripts to work
@mateuszwyszynski mateuszwyszynski added documentation Improvements or additions to documentation enhancement New feature or request labels Jan 27, 2024
@mateuszwyszynski mateuszwyszynski self-assigned this Jan 27, 2024
@mateuszwyszynski mateuszwyszynski changed the title comprehensible and robust data scripts comprehensible and robust data preparation scripts Feb 17, 2024
@mateuszwyszynski mateuszwyszynski changed the title comprehensible and robust data preparation scripts working data preparation scripts Feb 17, 2024
@mateuszwyszynski mateuszwyszynski changed the title working data preparation scripts comprehensible data preparation scripts Feb 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant