Deep Learning with Methylation
MethylNet is a command line tool and python library that provides classes to handle deep learning tasks for methylation data. It is built off of pythonic MethylationArray data types introduced in (https://github.com/Christensen-Lab-Dartmouth/PyMethylProcess), and uses PyTorch to explore/make predictions on the methylation data.
Please check out our code ocean demo at: https://codeocean.com/capsule/5473199/
Featured in BMC Bioinformatics: https://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-020-3443-8
Help docs: https://christensen-lab-dartmouth.github.io/MethylNet/
What MethylNet can do:
- Extract DNA Methylation Latent Space by training Variational Auto-encoders (VAE) after hyperparameter and neural network topology grid-search.
2. Make classification, single- and multi-output regression predictions on the methylation data such as age, cell type proportions, and disease state. This is done after transfer learning the VAE topology and a hyperparameter and neural network topology grid-search.
3. Find most important CpGs for predictions using SHAP, interpreting predictions on the individual and aggragated class level.
4. Interrogate these extracted CpGs using popular pipelines such as LOLA, gometh, GSEA and overlap CpGs with other known sets of CpGs. In addition, overlap top sets of CpGs with other CpGs of other predictions.
NOTE: Images will be updated to reflect latest set of MethylNet commands.
MethylNet is currently in review, Wiki page in progress. Biorxiv can be accessed at: https://www.biorxiv.org/content/10.1101/692665v1
Help docs: https://christensen-lab-dartmouth.github.io/MethylNet/
Install (Conda highly recommended, though Docker can be used):
- conda create -n methylnet python=3.6
- source activate methylnet
- See install instructions for PyMethylProcess at https://github.com/Christensen-Lab-Dartmouth/PyMethylProcess
- conda install pytorch torchvision -c pytorch
- pip install methylnet
- Alternative install: clone this repository and run python setup.py sdist bdist_wheel && pip install dist/methylnet-0.1.tar.gz
- Run for GSEA collections: download_help_data
- Alternative docker install: docker pull joshualevy44/methylnet:0.1
* If looking to use only CPUs, only core docker or singularity needed, and see singularity website for information on how to pull Docker images
* See https://singularity.lbl.gov/faq#does-singularity-support-containers-that-require-gpus for information on getting Singularity to work with GPUs
* nvidia-docker is also the Docker equivalent to run GPU jobs - GPU usage is also possible through the base install (without Docker, or considering nvidia-docker options), provided that your machine has GPU access.
Running MethylNet:
- source activate methylnet
- Pre-processing pipeline: Instructions available at https://github.com/Christensen-Lab-Dartmouth/PyMethylProcess to go from 450K/850K IDATs to MethylationArray datatypes that can easily be learned from.
- Run embedding hyperparameter scan
- Choose top embedding hyperparameters and train one last time again
- Run prediction hyperparameter scan
- Choose top prediction hyperparameters and train one last time again
- Find top CpGs by running SHAP.
- Interrogate SHAP derived CpGs.
- See help-docs for usage.
Running Test Pipeline:
- docker pull joshualevy44/methylnet:0.1
- Alternative: sh docker_build.sh
- docker run -it joshualevy44/methylnet:0.1
- Alternative: sh run_docker.sh
- methylnet-test test_pipeline
Example of Running Pipeline:
See ./example_scripts for examples on how to explicitly run:
