-
Notifications
You must be signed in to change notification settings - Fork 6
VRO Services, Points of Contact, and Issue Escalation Paths
The VRO Services and Points of Contact is a resource for VRO Platform Engineers designed to map out the various services and partner applications that interact with the VRO platform. This document also serves as an escalation guide for troubleshooting, providing links to critical resources for all VRO-related services. The primary goal is to enable the VRO team to understand platform dependencies and streamline issue resolution.
For insights into how VRO dependencies interact, you can reference the VRO Service Architecture Diagram and the VA OCTO Organigram.
Note:
-
Urgent issues refer to
SEV 1
andSEV 2
incidents. -
Non-urgent issues refer to
SEV 3
andSEV 4
and include sprint blockers.
Severity levels are explained here
The VRO Partner Team manages the apps or services below.
- Points of Contact: #benefits-contention-classification Slack Canvas Roster | CC GH Roster
-
Escalation Path
- Urgent: Contact the CC engineers (reference the POC section above) in the #benefits-contention-classification.
- Non-Urgent: Contact the relevant people in the POC section above.
- ABD-VRO Team Domain: Domain CC
- Description: Maps VA.gov disability form contentions to classifications defined in the Benefits Reference Data API.
- Repository: cc-app
- Monitoring: LHDI CC Datadog
- Documentation: See the domain-cc repo README
- Point of Contact: #benefits-employee-experience Slack Canvas Roster | EE GH Roster
-
Escalation Path:
- Urgent: Contact the EE (developers) in #benefits-employee-experience
- Non-Urgent: go through the VRO Delivery Manager for non-urgent issues.
- ABD-VRO Team Domain: Domain EE
- Description: Automatically merges newly established EP400 disability compensation claims into existing pending claims.
- Repository: ee-ep-merge-app
- Monitoring: LHDI EP Merge Datadog | VA.gov EP Merge Datadog
- Documentation: Mural
- Description: Provides an API to retrieve the maximum disability rating for service-connected conditions, as defined by 38 CFR Part 4 Subpart B.
- Repository: ee-max-cfi-app
- Monitoring: VA.gov Max Ratings API Datadog
- Documentation: ee-max-cfi-app README
The below are apps or services managed by VA Teams external of VRO, which VRO has built services to interface with.
- Description: An external VA service that provides gateway access for VRO applications, exposing APIs to retrieve claim information, update statuses, and route claims. BIP claim information is sourced from VBMS and CorpDB and operates as a subset of the BEP team.
- Repository: svc-bip-api
-
Monitoring: # TODO: add VRO dashboard links
The BIP systems team sets up monitoring, and additional monitoring is performed for the BIE Kafka service. If we also wanted to see it, external access to this monitoring would need to be requested.
- The Shared Services team also uses Grafana dashboards to monitor stream processors like the Contention Stream Processor (SP). The team constantly monitors SP logs to detect any issues.
- See this thread for more details.
- Points of Contact: Nathan Jolly ([email protected], lead engineer), Chris Puckett.
-
Escalation Path:
-
Urgent:
- Contact Nathan Jolly and Chris Puckett via #bip-support-ext-vro
-
Non-urgent:
- General questions and support can be accessed in #bep-integration-support2077.
- Non-urgent requests can be submitted via JIRA Service Desk.
- This team can be reached more easily through Microsoft Teams (TODO: Clarify this — what channel?).
-
Urgent:
-
Documentation:
- The BIP VA Microsoft Teams documentation should also be referenced whenever possible
- Focus on Benefits Web Services documentation, the section most relevant to VRO.
- Description: Enables partner teams to create notes on veteran files.
- Repository: svc-bgs-api
- Monitoring: BGS does not share monitoring information with the VRO team.
-
Points of Contact:
- Primary Contact: Jimnay Patel ([email protected])
- Project Manager: Lindsay Tucker ([email protected])
-
Additional Contacts:
- Cory Easley ([email protected])
- John Dell ([email protected])
- Troy Jackson ([email protected]), Project Manager for escalation
- Rama Yadlapalli ([email protected]) handles WebLogic and cert-related issues
-
Escalation Path:
- Urgent: For urgent issues, escalate via BGS' Microsoft Teams channel to Lindsay Tucker. Explain the urgency, and she will handle it from there.
- Non-Urgent: You can email the listed points of contact, notably Jimnay Patel. For non-urgent certs or WebLogic inquiries, you can contact Rama Yadlapalli.
-
Documentation:
The BGS team does not directly provide specific documentation. If you would like more insights, please refer to the VRO Architecture Mural.
- Description: This team provides event streams for claims processing, specifically handling contention changes on disability compensation forms (526). It is also known as the Shared Services Team or BIE Kafka Team.
- Repository: svc-bie-kafka
- Monitoring: The BIE Team does not share monitoring information with the VRO team, so we must use VRO dashboards and alerts (TODO: add links)
- Points of Contact: Darrell Neel and Mohietosh Gill
-
Escalation Path:
- Urgent: For urgent requests and/or to ask questions, use #bip-support-ext-vro.
-
Non-urgent: Submit non-urgent requests through the BIE Request Form
After submitting the form, you'll be prompted to complete a Corp DB application request. The BIE team will provide a link after the initial submission.
- The request is reviewed by their internal review board, which has final approval authority.
- Once VRO receives approval from this team, VRO can proceed with implementing the new API connection.
- Documentation: Benefits Integration Events Documentation
- Description: The Lighthouse Delivery Infrastructure (LHDI) is a cloud-native platform that supports VRO by providing scalable and secure environments for VA application deployment. Using AWS Managed Kubernetes clusters, LHDI enables rapid, secure deployments and automates DevOps processes, allowing VRO's partner teams to focus on application development without handling infrastructure complexities. It integrates key services such as BIP APIs, BEP Services, and IAM for authentication and data management, ensuring smooth and secure operations across the platform.
- Monitoring: See the LHDI docs alerts section and their oncall-operations doc.
- Points of Contact: Tyler Snell is the LHDI Enablement Liaison assigned to VRO.
-
Escalation Path:
- Urgent: #lighthouse-delivery-platform-support.
-
Non-urgent:
- #lighthouse-delivery-platform-support.
- #team-abd-vro is another option recommended when questions are unlikely to be of potential value to the general LHDI community.
- Sprint Blockers: Contact Tyler Snell, tag LHDI and VRO enablement team, VRO Delivery Manager, VRO Product Manager in #lighthouse-delivery-platform-support.
-
Support Requests (From LHDI Enablement):
For support tickets, we ask submitters to provide the urgency of the request based on the impact on their operation:
- Minimal: Quality-of-life or other minor annoyance.
- Moderate: Needed to fulfill a program requirement, but not in the next few sprints.
- High: Workaround or interim solution exists but causes work degradation.
- Critical: The issue causes a work stoppage or threatens data integrity/security. When submitted, the support team will assess it for completeness and understanding. The more details the submitter provides, the more quickly we can prioritize and add the issue to the queue. Based on the issue's scope and scale, queue size, and assessment, the priority will be set at the levels below and will be updated at the given intervals:
- Low: update once a week.
- Medium: update every 72 hours.
- High: daily.
- All: updates as information and progress milestones are made.
- Documentation: