Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

📍 Next steps in data migration #3364

Closed
76 of 80 tasks
jadudm opened this issue Feb 7, 2024 · 1 comment
Closed
76 of 80 tasks

📍 Next steps in data migration #3364

jadudm opened this issue Feb 7, 2024 · 1 comment
Milestone
FY24 Q3

Comments

@jadudm
Copy link
Contributor

jadudm commented Feb 7, 2024 •
edited by danswick
Loading

Tasks
Beta Give feedback
  2. Download all public Census data #3391
    eng
    gsa-suk
  3. Run some automatic comparisons between public Census CSVs and our API/historic data #3408
    data eng
  6. Cog/Over: Move this to our own dissemination tables #3390
    5 of 5
    eng
    gsa-suk
  7. Plan next iteration of historic data (the things that were left behind) #3406
    1 of 1
    eng
    gsa-suk phildominguez-gsa
    sambodeme
  8. Crosswalk table? (How do users go from DBKEY/AY to Report ID?) (Computed view in API?) Migration status may serve in this regard? #3831
    eng
    gsa-suk
  11. Create non-tribal and public tribal dataset from 2016-2022 tables for Development #3413
    eng
    gsa-suk
  12. Fix Fiscal Period Start #3506
    eng
    rnovak338
  13. Download Prod backup to GFE and load into local db #3515
    eng prodssh
    asteel-gsa gsa-suk
    phildominguez-gsa
  14. Load Prod Data into Preview #3524
    eng
    asteel-gsa gsa-suk
  15. Create public dataset for non-Prod from Prod backup #3528
    eng
    gsa-suk
  16. Data related helpdesk support #3539
    eng
    gsa-suk
  17. Load public Prod data into Staging #3544
    eng
    gsa-suk
  18. Backup Preview database #3545
    eng
    gsa-suk
  19. Load public Prod data from Preview into Dev #3546
    eng
    gsa-suk
  20. Load public Prod dissemination data into local db #3558
    eng
    gsa-suk
  21. Add data passthrough flag to historic migration commands #3682
  22. Create django models for invalid audit records #3681
    eng
    gsa-suk
  23. Compile errors related to data migration in preview environment #3201
    eng
    gsa-suk phildominguez-gsa
    sambodeme
  24. Address historical awards with repeated references #3696
    eng
    sambodeme
  25. Address historical cluster totals that are incorrect #3686
    phildominguez-gsa
  26. Address historical ACE audits #3700
  27. Address historical audits with missing accounting policies #3687
    eng
    gsa-suk
  28. Address historical audits with invalid EINs #3701
    eng
    sambodeme
  29. Address historical federal program totals that are incorrect #3688
    eng
    sambodeme
  30. Address historical audits with missing auditor EINs #3704
    eng
    sambodeme
  31. Address historical federal awards with empty values for Y/N fields #3689
    phildominguez-gsa
  32. Missing rate usage explanation in Notes #3707
    eng
    gsa-suk
  33. Entity type is blank #3691
    eng
    gsa-suk
  34. Address historical audits that have extraneous CAP workbook references with no findings #3709
    gsa-suk
  35. Address historical audits that have extraneous findings text workbook references #3694
    eng
    gsa-suk
  36. Address historical federal awards with missing program names #3710
    phildominguez-gsa
  37. Address historical findings with missing type of compliance #3692
    phildominguez-gsa
  38. Address historical audits with invalid prior references #3722
    eng
    sambodeme
  39. Note content is blank #3693
    eng
    gsa-suk
  40. Address historical audits with missing UEIs #3724
    eng
    sambodeme
  41. Address historical finding references with invalid formats #3695
    eng
    sambodeme
  42. Address historical audits with empty values for Y/N fields #3723
    eng
    gsa-suk
  43. Address historical federal awards with invalid cluster names #3697
    eng
    gsa-suk
  44. Address historical records with invalid zip codes #3720
    phildominguez-gsa
  45. Address historical audits with invalid reference numbers #3698
    eng
    sambodeme
  46. Address historical audits with missing action planned text #3718
    eng
    sambodeme
  47. Address historical audit error "' should be non-empty" #3699
    eng
    sambodeme
  48. Address historical federal awards with invalid non-empty passthrough numbers #3717
    eng
    sambodeme
  49. Address historical audits with missing major programs #3702
    phildominguez-gsa
  50. Address historical audits with lowercase value for Y/N fields #3716
    phildominguez-gsa
  51. Note title is blank #3703
    eng
    gsa-suk
  52. Address historical audits with missing firm/organization names #3715
    eng
    gsa-suk
  53. Address historical federal awards with extraneous passthrough names #3705
    eng
    sambodeme
  54. Address historic federal awards with unequal number of names and IDs #3713
    eng
    sambodeme
  55. Address historical audits with invalid passthrough amounts #3706
    phildominguez-gsa
  56. Address historical audits with empty audit types #3712
    eng
    gsa-suk
  57. Address historical federal awards with missing additional award identification #3708
    eng
    sambodeme
  58. Address historical secondary auditors with missing firm/organization state #3711
    phildominguez-gsa
  59. Address error "auditor_international_address" is a required property #3732
    eng
    sambodeme
  60. Address error "Invalid Audit Period - 'Audit period months' must be set for 'other' Audit period" #3733
    eng
    gsa-suk
  61. Incorrect policies_content and rate_content values are tracked for notes_to_sefa #3763
    eng
    gsa-suk
  62. Test cases for xform_missing_notes_records_v2 in notes_to_sefa #3772
    eng
    gsa-suk
  63. Address historical audits with missing findings text #3804
    eng
    sambodeme
  64. Correct CLUSTERNAME transformation tracking #3817
    eng
    gsa-suk
  65. Add Helper Class and Methods to Record Invalid Audit Report Sections #3856
    eng
    sambodeme
  66. Document SOP for loading migrated data into production #3865
    eng
    danswick
  67. Handle missing rate_content #3866
    eng
    gsa-suk
  68. Address historical audits that have less findings compared to captexts #3884
    eng
    gsa-suk
  69. Address historical audits that have same number of findings and captexts but non-matching reference numbers #3885
    eng
    gsa-suk
  70. Test migration of a subset of failed audits on GFE #3896
    eng
    gsa-suk
  71. Address historical audit reports with missing values in findings section #3917
    eng
    sambodeme
  72. Address historical audits with blank SP_FRAMEWORK #3927
    eng
    gsa-suk
  73. Address historical Report with Empty Award Boolean Fields #3928
    eng
    sambodeme
  74. Address Historical Report with Invalid Secondary Auditor Phone Contact #3945
    eng
    sambodeme
  75. Address Historical Report With Missing Auditee Contact Title #3951
    eng
    sambodeme
  76. Analysis of Data Discrepancy between Preview and Census S3 #3954
    eng
    gsa-suk
  77. Address historical audits with missing finding reference numbers #3955
    eng
    gsa-suk
  78. Address historical Report Which Failed Validation With No Error Message #3960
    eng
    sambodeme
  79. Address ACE Reports Migration #3980
    eng
    sambodeme
  80. Document procedure to load data to Prod #4008
    eng
    gsa-suk
@jadudm jadudm converted this from a draft issue Feb 7, 2024
@jadudm jadudm changed the title Next steps in data migration Next steps in data migration (draft/notes) Feb 7, 2024
@jadudm jadudm moved this from Later to The Future in FAC Epic Board Feb 13, 2024
@sambodeme
Copy link
Contributor

Link to original epic #2837

@sambodeme sambodeme mentioned this issue Feb 14, 2024
Closed
@github-project-automation github-project-automation bot moved this to Triage in FAC Apr 19, 2024
@sambodeme sambodeme changed the title Next steps in data migration (draft/notes) Next steps in data migration Apr 19, 2024
@gsa-suk gsa-suk moved this from Triage to In Progress in FAC Apr 19, 2024
@jadudm jadudm moved this from The Future to Now in FAC Epic Board May 2, 2024
@jadudm jadudm added this to the FY24 Q3 milestone May 2, 2024
@danswick danswick removed this from FAC May 3, 2024
@github-project-automation github-project-automation bot moved this to Triage in FAC May 7, 2024
@sambodeme sambodeme moved this from Triage to In Progress in FAC May 17, 2024
@danswick danswick removed this from FAC May 17, 2024
@danswick danswick changed the title Next steps in data migration Epic: Next steps in data migration May 17, 2024
@github-project-automation github-project-automation bot moved this to Triage in FAC May 17, 2024
@danswick danswick changed the title Epic: Next steps in data migration 📍 Next steps in data migration May 29, 2024
@danswick danswick removed this from FAC Jun 3, 2024
@github-project-automation github-project-automation bot moved this to Triage in FAC Jun 3, 2024
@danswick danswick removed this from FAC Jun 4, 2024
@danswick danswick added this to FAC Jun 4, 2024
@github-project-automation github-project-automation bot moved this to Triage in FAC Jun 4, 2024
@danswick danswick mentioned this issue Aug 28, 2024
Open
@danswick danswick closed this as completed Sep 6, 2024
@github-project-automation github-project-automation bot moved this from Now to Done in FAC Epic Board Sep 6, 2024
@github-project-automation github-project-automation bot moved this from Triage to Done in FAC Sep 6, 2024
@gsa-suk gsa-suk mentioned this issue Oct 17, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
FAC
Status: Done
FAC Epic Board
Status: Done
Milestone
FY24 Q3
Development

No branches or pull requests
5 participants
@jadudm @danswick @sambodeme @gsa-suk @phildominguez-gsa