Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run configuration for snakemake files #25

Open
iromeo opened this issue Jan 11, 2019 · 7 comments
Open

Run configuration for snakemake files #25

iromeo opened this issue Jan 11, 2019 · 7 comments
Milestone

Comments

@iromeo
Copy link
Contributor

iromeo commented Jan 11, 2019

Run configuration for snakemake files

@iromeo iromeo self-assigned this Jan 11, 2019
@iromeo
Copy link
Contributor Author

iromeo commented Jul 2, 2019

Not sure that we really need this feature (i.e. run feature or rule from the context menu). If someone has any thoughts, you are welcome.

@majkelx
Copy link

majkelx commented Nov 28, 2019

I would love it

@iromeo
Copy link
Contributor Author

iromeo commented Nov 28, 2019

Thank you for the feedback, but what for do you need it what is your use case? Is it educational or for real data processing?

@iromeo
Copy link
Contributor Author

iromeo commented Nov 28, 2019

When I run real pipelines they took significant time (e.g. hours or days), so I don't want to keep my IDE opened all this time. Moreover, I often run them on the cluster so I don't such run configurations and I prefer launching snakemake pipelines from a command line.

In PyCharm (and other JetBrains IDEs) there is a terminal window in IDE, so it is quite convenient (for me) to launch the pipeline on test data in that window.

@majkelx
Copy link

majkelx commented Nov 28, 2019

I'm astronomer and using a lot of custom python code for data processing, mostly astronomic calibration/reduction pipelines.
I found snakemake to be great replacement of GNU make, especially we are trying to get rid of preparing shell tools for each task (use run: rather than shell: in snakemake language).
So running and debuging code executed from snakemake workflow in PyCharm would be very helpfull in the pipelines development.
Usually, I have some test data in the project, and run/test/debug the code from unit tests. But in the case of snakemake, the natural way to feed the pipeline code with data is via snakemake. Also some layer of code is now snakemake dependent.
I have seen #142 and #137, I understend that full-fledged debugger for snakemake isn't piece of cake, but... I would love it ;)

@iromeo
Copy link
Contributor Author

iromeo commented Nov 28, 2019

@majkelx Ok, thx for the explanation

@majkelx
Copy link

majkelx commented Nov 28, 2019

Just for setting breakpoints in code called from snakemake and debugging it, I created dummy runner runsnakemake.py:

  from snakemake import main
  main()

And I'm using it in Run/Debug configuration to start snakemake under debuger.

This solves my only "real" problem.

@iromeo iromeo added this to the Backlog milestone Jul 3, 2020
@iromeo iromeo removed their assignment Jul 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants