Add post-process labels stage (#4)

* start postprocess labels stage * begin discussion on saving output * only run todo to issue on merge to main * start integration w/ bigquery (broken on non picklable client) * example write to bigquery from beam * messy working impl of write to big query * hack: adjust plotting to show detection in final result plot (todo revert) * finalize decision on output storage (mainly for new PR) * clean output writing for postprocessing (local & cloud) * clean table spec def * add unit tests * add resource * updating naming for model uri and inference url * Apply inline suggestions from code review
pmhalvor · Oct 5, 2024 · 725794e · 725794e
1 parent 27a8429
commit 725794e
Show file tree

Hide file tree

Showing 17 changed files with 650 additions and 72 deletions.
diff --git a/.github/workflows/todo.yml b/.github/workflows/todo.yml
@@ -1,6 +1,8 @@
 name: "Run TODO to Issue"
 on:
   push:
+    branches:
+      - "master"
   workflow_dispatch:
     inputs:
       MANUAL_COMMIT_REF:

diff --git a/data/classifications.tsv b/data/classifications.tsv
diff --git a/data/output.txt b/data/output.txt
diff --git a/data/pipeline-diagram.json b/data/pipeline-diagram.json