Allow QA to test the Fullstory integration in staging

[anmurali]

Problem: Our FullStory integration is quickly becoming a critical part of New Expensify. If it breaks than we are left blind without the ability to debug issues for users and determine the usability of New Expensify.

Solution: Add a FullStory test case for Applause to test on each staging build to verify that we haven’t added any regressions to the integration. We need to be able to record sessions for specific accounts on staging, but keep the integration turned off for staging to not hit our session limit.

• Identify a specific domain like @fstest.expensify.com that we can use specifically for this purpose
• When this email user is detected in staging, start the Fullstory session. Do not record any other staging sessions for any other domains
• Write down regression tests that utilize this domain for making sure the Fullstory session works as designed
• Train Applause on testing this

Issue Owner

Current Issue Owner: @anmurali

[anmurali]

cc @danieldoglas @AndrewGable

[melvin-bot]

Whoops! This issue is 2 days overdue. Let's get this updated quick!

[melvin-bot]

6 days overdue. This is scarier than being forced to listen to Vogon poetry!

[anmurali]

@danieldoglas I was wondering if this is all simple as adding a user email check to the same place where we make sure to only start a FS session if the environment is production?

[melvin-bot]

Huh... This is 4 days overdue. Who can take care of this?

[anmurali]

Discussed a solution here
@danieldoglas can I assign this to you?

[danieldoglas]

awaiting the decision about the email.

[melvin-bot]

Reviewing label has been removed, please complete the "BugZero Checklist".

[melvin-bot]

The solution for this issue has been 🚀 deployed to production 🚀 in version 9.0.58-2 and is now subject to a 7-day regression period 📆. Here is the list of pull requests that resolve this issue:

• Whitelist QA email for Fullstory on staging environments #52065

If no regressions arise, payment will be issued on 2024-11-14. 🎊

[melvin-bot]

Skipping the payment summary for this issue since all the assignees are employees or vendors. If this is incorrect, please manually add the payment summary SO.

[melvin-bot]

@danieldoglas Eep! 4 days overdue now. Issues have feelings too...

[danieldoglas]

There's no payment on this one.

[danieldoglas]

assigning @anmurali so she can work on writing the tests we want here.

[danieldoglas]

WIP

[melvin-bot]

@danieldoglas, @anmurali Whoops! This issue is 2 days overdue. Let's get this updated quick!

[melvin-bot]

@danieldoglas, @anmurali Eep! 4 days overdue now. Issues have feelings too...

[melvin-bot]

@danieldoglas, @anmurali 8 days overdue is a lot. Should this be a Weekly issue? If so, feel free to change it!

[melvin-bot]

@danieldoglas, @anmurali 10 days overdue. I'm getting more depressed than Marvin.

[anmurali]

Regression test proposal

1. Sign up on www.expensify.com and select Organize my own expenses or Manage expenses for a small team (1-9 employees) with an email like [email protected]
2. Select anything from What do you want to do today or Do you use any accounting software? as the case may be
3. Login to app.fullstory.com
4. Go to Home - Just watch sessions
5. Under "User Filters" -- In the Any user dropdown, select email and enter the email used for sign up
6. Scroll down and verify that a session is found under Session Playlist
7. In Session Playlist click on the email, scroll down and verify that user properties are populated

Repeat the above steps by signing up on new.expensify.com

Repeat the above steps by signing in with a previously signed up [email protected] on www.expensify.com, new.expensify.com). For sign in, verify the additional step below as well:
8. Verify by watching the most recent session in the Session Playlist by clicking on the green play button, that the actions on sign in are in fact recorded.

Repeat the above steps including step 8 with a previously signed up (and redirected to new dot) [email protected] on hybrid app (iOS and Android)

[anmurali]

This is all setup!