Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/upload to s3 #181

Closed
wants to merge 20 commits into from

Conversation

rugeli
Copy link
Collaborator

@rugeli rugeli commented Jul 24, 2023

Problem

What is the problem this work solves, including
closing #140

Solution

What I/we did to solve this problem

  • In simularium_helper.py, added functionalities to store results to S3 - cellpack-results/simularium , upload metadata to firebase, and open packing results in simularium app.

with @meganrm @mogres

Type of change

Please delete options that are not relevant.

  • New feature (non-breaking change which adds functionality)

Steps to Verify:

  1. pack a local recipe: pack -r [path-to-a-local-recipe] -c [path-to-a-config-file]
  2. pack a remote recipe: pack -r firebase:recipes/[firebase-recipe-id] -c [path-to-a-config-file](make sure you have the recipe living in your firebase before packing)

Keyfiles (delete if not relevant):

1.simularium_helper.py
2.AWSHandler.py

@rugeli rugeli marked this pull request as draft July 24, 2023 18:02
@codecov-commenter
Copy link

codecov-commenter commented Jul 24, 2023

Codecov Report

Patch coverage: 100.00% and project coverage change: +0.13 🎉

Comparison is base (a8d7fab) 98.39% compared to head (f6533c9) 98.52%.

❗ Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #181      +/-   ##
==========================================
+ Coverage   98.39%   98.52%   +0.13%     
==========================================
  Files          14       15       +1     
  Lines         435      475      +40     
==========================================
+ Hits          428      468      +40     
  Misses          7        7              
Impacted Files Coverage Δ
cellpack/tests/test_comp_doc.py 100.00% <100.00%> (ø)
cellpack/tests/test_db_recipe_handler.py 100.00% <100.00%> (ø)
cellpack/tests/test_gradient_doc.py 100.00% <100.00%> (ø)
cellpack/tests/test_object_doc.py 100.00% <100.00%> (ø)
cellpack/tests/test_recipe_loader.py 100.00% <100.00%> (ø)

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@github-actions
Copy link

Packing analysis report

Analysis for packing results located at cellpack/tests/outputs/test_spheres/spheresSST

Ingredient name Encapsulating radius Average number packed
ext_A 25 236.0

Packing image

Packing image

Distance analysis

Expected minimum distance: 50.00
Actual minimum distance: 50.01

Ingredient key Pairwise distance distribution
ext_A Distance distribution ext_A

def __init__(self, db_handler):
self.db = db_handler
if isinstance(db_handler, FirebaseHandler):
DBHandler.firebase_handler = db_handler
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this shouldn't be in this file. The idea of DBHandler is it's agnostic to what handler is being used. There should be nothing explicitly referencing firebase in this file

@meganrm meganrm changed the base branch from main to feature/firebase-upload-gradients August 15, 2023 18:17
Base automatically changed from feature/firebase-upload-gradients to main August 15, 2023 21:15
@meganrm meganrm changed the base branch from main to feature/run-recipes-from-firebase August 29, 2023 18:22
@rugeli rugeli force-pushed the feature/upload-to-s3 branch from 14042b5 to f6533c9 Compare October 3, 2023 21:44
@rugeli
Copy link
Collaborator Author

rugeli commented Oct 6, 2023

This PR has separated into #189 #198 and #201

@rugeli rugeli closed this Oct 6, 2023
@rugeli rugeli deleted the feature/upload-to-s3 branch April 9, 2024 18:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants