Regression playwright autotests #328

tatsiosh · 2024-12-09T14:19:44Z

No description provided.

github-actions · 2024-12-09T14:23:01Z

Successful TWA deployment 🚀🚀🚀

Well done!
Link to test environment:
https://t.me/tonkeeperdevbot

github-actions · 2024-12-09T14:23:03Z

Successful WEB deployment 🚀🚀🚀

Well done!
Link to test environment:
https://dec3a85d.tonkeeper-web.pages.dev

github-actions · 2024-12-09T14:32:53Z

Playwright test results

5 failed
56 passed
4 flaky

Details

65 tests across 35 suites
5 minutes, 2 seconds
157f2aa

Failed tests

chromium › AddBitGet.spec.ts › BITGET
chromium › BuyTon.spec.ts › Buy TON on main screen
chromium › Multisig.spec.ts › Create new multisig
chromium › Multisig.spec.ts › Send request
chromium › TestnetAccounts/Testnet.spec.ts › Add 2 testnets

Flaky tests

chromium › Add2WalletsAndDeleteInABulk/2 wallets & bulk delete.spec.ts › 2 wallets & bulk delete
chromium › ElementsVisibility/FullFlow.spec.ts › Full flow elements
chromium › ElementsVisibility/NavigationSidebarElements.spec.ts › History tab
chromium › ElementsVisibility/NavigationSidebarElements.spec.ts › Swap

KuznetsovNikita · 2024-12-10T12:50:49Z

tests/playwright/tests/AddBitGet.spec.ts

+  await page.getByLabel('1:', { exact: true }).fill(process.env.BITGET_MNEMONIC_24);
+  await page.getByRole('button', { name: 'Continue' }).click();
+  await expect(page.getByText('W5', { exact: true })).toBeVisible();
+  await expect(page.getByText('UQC2…1-Ly · 0 TON')).toBeVisible();


This wallet have a ton amount
Should we just check wallet address and don't check an amount on ton?

Exactly. Because this wallet is in-use one, as soon as TON amount changes - test will fail. Anyway the main point of checking is to ensure that addresses on all stages of the flow are the same.

KuznetsovNikita · 2024-12-10T12:53:21Z

tests/playwright/tests/BuyTon.spec.ts

+  await expect(page.getByText('Mercuryo')).toBeVisible();
+  await expect(page.getByText('Instant one-click purchase up')).toBeVisible();
+  await expect(page.locator('.sc-evBeLY').first()).toBeVisible();
+  await expect(page.locator('div').filter({ hasText: /^NeocryptoInstantly buy with a credit card$/ }).nth(2)).toBeVisible();


The exact items on this list depend of the country,
For test better to check is there something in this list?
and make an exception if list is empty

Agreed. I`ll need help here

KuznetsovNikita · 2024-12-10T13:03:55Z

tests/playwright/tests/Subscription/BuyPro.spec.ts

+  await expect(page.locator('#react-portal-modal-container')).toContainText('Tonkeeper Pro\'s subscription comes with an extended wallet feature, offering a toolset for crypto management.');
+  await expect(page.locator('div').filter({ hasText: /^trust wallet - 12 words mnemonic🤖UQBC…_BrRW5$/ }).nth(2)).toBeVisible();
+  await expect(page.getByText('Yearly Pro Package')).toBeVisible();
+  await expect(page.getByText('8.00 TON')).toBeVisible();


Price could be changed, for my perspective better to not check the amount

Better to check that, list of plan's is not empty

To fix the test (changing the price of the package) is a very quick and easy indeed. I wanna check max possible fields. we can add additional check that, list of plan's is not empty as well

KuznetsovNikita · 2024-12-10T13:17:26Z

tests/playwright/tests/TestnetAccounts/Testnet.spec.ts

+  await page.getByRole('button', { name: 'Testnet Account Import wallet' }).click();
+  await page.getByLabel('1:', { exact: true }).fill(process.env.TON_MNEMONIC_ANANAS);
+  await page.getByRole('button', { name: 'Continue' }).click();
+  await expect(page.getByText('0QBW…lsqP · 0 TON')).toBeVisible();


There the same, amount of ton cloud be changed, better to check only address

KuznetsovNikita · 2024-12-10T13:23:51Z

tests/playwright/tests/ElementsVisibility/NavigationSidebarElements.spec.ts

+  await page.getByRole('link', { name: 'Swap' }).click();
+  await expect(page.getByText('Swap').nth(1)).toBeVisible();
+  await expect(page.locator('#root')).toContainText('Swap');
+  await expect(page.locator('.sc-cDYBfd > button').first()).toBeVisible();


This selector is not stable, let's create an id or test-id for this element

KuznetsovNikita · 2024-12-10T13:24:08Z

tests/playwright/tests/ElementsVisibility/NavigationSidebarElements.spec.ts

+  await page.getByRole('link', { name: 'Multisig Wallets' }).click();
+  await expect(page.getByRole('button', { name: 'New Multisig Wallet' })).toBeVisible();
+  await expect(page.locator('#root')).toContainText('New Multisig Wallet');
+  await expect(page.locator('.sc-kLKjoy > button').first()).toBeVisible();


This selector is not stable, let's create an id or test-id for this element

KuznetsovNikita · 2024-12-10T13:25:59Z

tests/playwright/tests/Multisig.spec.ts

+  await expect(page.getByText('👩‍💼Multisig UQBL…v_kAUQBL…')).toBeVisible();
+
+  await page.locator('.sc-kLKjoy > .sc-bXDltw').first().click();
+  await expect(page.locator('#root')).toContainText('👩‍💼Multisig UQBL…v_kAMultisig');


Three a lot's of Multisigs, butter to clarify selection

Expected string: "👩‍💼Multisig UQBL…v_kAMultisig" Received string: "Multisig UQBv…0IRaUQBv…0IRaMultisig👨‍🍳DashboardDiscover🍍Account 1UQBA…OP8VW5UQDH…TkZ5W5 betaUQD2…GzCiv4R2👨‍🍳Multisig UQBv…0IRaMultisigUQDj…pOuvv3R2UQBW…lnEFv3R1Add WalletPreferencesGet Pro$ 0.57SendReceiveBuyTokensHistoryCollectiblesDomainsSwapRequestsSettingsTokensTON0.09$ 5.79 −10.35%$ 0.57"

I didn`t get it

github-actions · 2024-12-19T14:56:40Z

Successful swap widget deployment 🚀🚀🚀

Well done!
Link to test environment:
https://8e84f663.tonkeeper-swap-widget.pages.dev

github-actions · 2024-12-19T15:05:15Z

Playwright test results

11 failed
52 passed
2 flaky

Details

65 tests across 35 suites
6 minutes, 31 seconds
86a311f

Failed tests

chromium › AddBitGet.spec.ts › BITGET
chromium › Backup.spec.ts › Backup
chromium › BuyTon.spec.ts › Buy TON on main screen
chromium › ElementsVisibility/NavigationSidebarElements.spec.ts › Swap
chromium › ElementsVisibility/NavigationSidebarElements.spec.ts › Multisig
chromium › Multisig.spec.ts › Create new multisig
chromium › Multisig.spec.ts › Send request
chromium › NFT screen.spec.ts › Discover tab
chromium › Subscription/BuyPro.spec.ts › Buy PRO
chromium › TestnetAccounts/Testnet.spec.ts › Add 2 testnets
chromium › TestnetAccounts/TestnetElements.spec.ts › Testnet elements

Flaky tests

chromium › Add2WalletsAndDeleteInABulk/2 wallets & bulk delete.spec.ts › 2 wallets & bulk delete
chromium › PinToken.spec.ts › Pin 2 tokens

tatsiosh added 12 commits November 29, 2024 15:56

Send NFT test

246a8eb

Add elements and versions tests

3918802

Add wallets from other platforms: OKX and Bitget

22acdf1

Elements visibility

1bf32cc

Merge branch 'main' into tests/add_tests_to_playwright

a5f0c98

Buy TON

a94d7d4

Testnet + Preferences +Buy Ton

14d6eb3

Modal windows and send Ton from token screen

e28d15c

Fix tests strucrure

2d5e0aa

Tests for create wallets, buy Pro, receive button

c036d47

Discover tab and nft screen tests

5349d75

Multisend and multisig tests up to payment step

4f62f0c

Add env variables

157f2aa

KuznetsovNikita reviewed Dec 10, 2024

View reviewed changes

KuznetsovNikita force-pushed the tests/add_tests_to_playwright branch from eed6c04 to 157f2aa Compare December 10, 2024 13:11

KuznetsovNikita reviewed Dec 10, 2024

View reviewed changes

Merge branch 'main' into tests/add_tests_to_playwright

86a311f

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Regression playwright autotests #328

Regression playwright autotests #328

tatsiosh commented Dec 9, 2024

github-actions bot commented Dec 9, 2024 •

edited

Loading

github-actions bot commented Dec 9, 2024 •

edited

Loading

github-actions bot commented Dec 9, 2024 •

edited

Loading

KuznetsovNikita Dec 10, 2024

tatsiosh Dec 20, 2024

KuznetsovNikita Dec 10, 2024

tatsiosh Dec 20, 2024

KuznetsovNikita Dec 10, 2024

tatsiosh Dec 20, 2024

KuznetsovNikita Dec 10, 2024

tatsiosh Dec 20, 2024

KuznetsovNikita Dec 10, 2024

KuznetsovNikita Dec 10, 2024

KuznetsovNikita Dec 10, 2024 •

edited

Loading

tatsiosh Dec 20, 2024

github-actions bot commented Dec 19, 2024

github-actions bot commented Dec 19, 2024

Regression playwright autotests #328

Are you sure you want to change the base?

Regression playwright autotests #328

Conversation

tatsiosh commented Dec 9, 2024

github-actions bot commented Dec 9, 2024 • edited Loading

Successful TWA deployment 🚀🚀🚀

github-actions bot commented Dec 9, 2024 • edited Loading

Successful WEB deployment 🚀🚀🚀

github-actions bot commented Dec 9, 2024 • edited Loading

Playwright test results

Details

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

KuznetsovNikita Dec 10, 2024 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

github-actions bot commented Dec 19, 2024

Successful swap widget deployment 🚀🚀🚀

github-actions bot commented Dec 19, 2024

Playwright test results

Details

github-actions bot commented Dec 9, 2024 •

edited

Loading

github-actions bot commented Dec 9, 2024 •

edited

Loading

github-actions bot commented Dec 9, 2024 •

edited

Loading

KuznetsovNikita Dec 10, 2024 •

edited

Loading