Merge branch 'develop' into sprint-93-summary

docs/Sprint-Review/sprint-92-summary.md

@@ -0,0 +1,64 @@
+# Sprint 92 Summary
+
+01/31/2024 - 02/13/2024
+
+Velocity (Dev): 6
+
+## Sprint Goal
+* Dev:
+    * Continue parsing engine development and begin work on enhancement tickets
+        * #2536 Cat 4 validation 
+    * #1858 Secure OFA staff access to Kibana 
+        * Unblocks #1350 when complete 
+* DevOps:
+    * #2790 - Update deployment code to support Kibana and integrate with Standing Elastic instance
+* Design: 
+    * Tie up current documentation work
+    * Continue refinement of research roadmap
+
+
+## Tickets
+### Completed/Merged
+* [#2751 Resource Card updated with latest coding instructions](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2751)
+* [#1858 Spike: Secure Kibana access](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/1858)
+* [#2781 As a developer,  I want to have documentation on django migration best practices](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2781)
+
+### Ready to Merge
+
+
+
+
+
+
+
+### Submitted (QASP Review, OCIO Review)
+* [#2790 Kibana Deployment](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2790)
+* [#2681 Section 1 Validation clean-up](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2681)
+
+
+
+### Closed (not merged)
+* N/A
+
+
+---
+
+## Moved to Next Sprint (In Progress, Blocked, Raft Review)
+### In Progress
+* [#1350 Kibana access from TDP](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/1350)
+* [#2646 - Populate data file summary case aggregates differently per section](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2646)
+* [#2820 [bug] Uncaught exception re: parsing error preventing feedback report generation](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2820)
+* [#2768 Fix production OWASP scan reporting](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2768)
+* [#2799 Generate error mismatching field rpt_month_year w/ header](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2799)
+
+
+
+### Blocked
+* N/A
+
+### Raft Review
+* [#2536 [spike] Cat 4 validation](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2536)
+* [#2592 Deploy celery as a separate cloud.gov app](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2592)
+* [#2746 As an STT, I need to know if there are issues with the DOBs reported in my data files](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2746)
+* [#2813 Reduce dev environment count](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2813)
+* [#2729 As a developer, I want to move migration commands in the pipeline to CircleCI](https://app.zenhub.com/workspaces/sprint-board-5f18ab06dfd91c000f7e682e/issues/gh/raft-tech/tanf-app/2729)

tdrs-backend/tdpservice/email/tasks.py

@@ -0,0 +1,71 @@
+"""Shared celery email tasks for beat."""
+
+from __future__ import absolute_import
+from tdpservice.users.models import User, AccountApprovalStatusChoices
+from django.contrib.auth.models import Group
+from django.conf import settings
+from django.urls import reverse
+from django.utils import timezone
+from celery import shared_task
+from datetime import datetime, timedelta
+import logging
+from tdpservice.email.helpers.account_access_requests import send_num_access_requests_email
+from tdpservice.email.helpers.account_deactivation_warning import send_deactivation_warning_email
+
+
+logger = logging.getLogger(__name__)
+
+
+@shared_task
+def check_for_accounts_needing_deactivation_warning():
+    """Check for accounts that need deactivation warning emails."""
+    deactivate_in_10_days = users_to_deactivate(10)
+    deactivate_in_3_days = users_to_deactivate(3)
+    deactivate_in_1_day = users_to_deactivate(1)
+
+    if deactivate_in_10_days:
+        send_deactivation_warning_email(deactivate_in_10_days, 10)
+    if deactivate_in_3_days:
+        send_deactivation_warning_email(deactivate_in_3_days, 3)
+    if deactivate_in_1_day:
+        send_deactivation_warning_email(deactivate_in_1_day, 1)
+
+def users_to_deactivate(days):
+    """Return a list of users that have not logged in in the last {180 - days} days."""
+    days = 180 - days
+    return User.objects.filter(
+        last_login__lte=datetime.now(tz=timezone.utc) - timedelta(days=days),
+        last_login__gte=datetime.now(tz=timezone.utc) - timedelta(days=days+1),
+        account_approval_status=AccountApprovalStatusChoices.APPROVED,
+        )
+
+def get_ofa_admin_user_emails():
+    """Return a list of OFA System Admin and OFA Admin users."""
+    return User.objects.filter(
+        groups__in=Group.objects.filter(name__in=('OFA Admin', 'OFA System Admin'))
+    ).values_list('email', flat=True).distinct()
+
+def get_num_access_requests():
+    """Return the number of users requesting access."""
+    return User.objects.filter(
+        account_approval_status=AccountApprovalStatusChoices.ACCESS_REQUEST,
+    ).count()
+
+@shared_task
+def email_admin_num_access_requests():
+    """Send all OFA System Admins an email with how many users have requested access."""
+    recipient_email = get_ofa_admin_user_emails()
+    text_message = ''
+    subject = 'Number of Active Access Requests'
+    url = f'{settings.FRONTEND_BASE_URL}{reverse("admin:users_user_changelist")}?o=-2'
+    email_context = {
+        'date': datetime.today(),
+        'num_requests': get_num_access_requests(),
+        'admin_user_pg': url,
+    }
+
+    send_num_access_requests_email(recipient_email,
+                                   text_message,
+                                   subject,
+                                   email_context,
+                                   )