Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HybridApp] Fix Not found page on shortcuts #53954

Merged

Conversation

war-in
Copy link
Contributor

@war-in war-in commented Dec 11, 2024

Explanation of Change

This PR fixes the Hmm it's not there... page when clicking on the static shortcuts.
Related OD PR: https://github.com/Expensify/Mobile-Expensify/pull/13327

Fixed Issues

$ #55585

Tests

  1. Open the app through a shortcut (quick action)
  2. Verify that you were redirected to the correct page

Offline tests

QA Steps

  1. Open the app through a shortcut (quick action)
  2. Verify that you were redirected to the correct page

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

Copy link
Contributor

🚧 @Julesssss has triggered a test hybrid app build. You can view the workflow run here.

This comment has been minimized.

@war-in war-in changed the title Fix Not found page on shortcuts [HybridApp] Fix Not found page on shortcuts Dec 13, 2024
@war-in war-in marked this pull request as ready for review December 13, 2024 11:03
@war-in war-in requested a review from a team as a code owner December 13, 2024 11:03
@melvin-bot melvin-bot bot requested review from marcochavezf and removed request for a team December 13, 2024 11:04
Copy link

melvin-bot bot commented Dec 13, 2024

@marcochavezf Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@war-in
Copy link
Contributor Author

war-in commented Dec 13, 2024

This PR requires Mobile-Expensify access so maybe @Julesssss would be the right person to test and review? 🙏

@marcochavezf
Copy link
Contributor

Conflicts

Copy link
Contributor

🧪🧪 Use the links below to test this adhoc build on Android, iOS, Desktop, and Web. Happy testing! 🧪🧪

Android 🤖 iOS 🍎
❌ FAILED ❌ ❌ FAILED ❌
The QR code can't be generated, because the Android build failed The QR code can't be generated, because the iOS build failed
Desktop 💻 Web 🕸️
N/A N/A
N/A N/A

👀 View the workflow run that generated this build 👀

Copy link
Contributor

@Julesssss Julesssss left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see conflicts now

# Conflicts:
#	Mobile-Expensify
#	scripts/run-build.sh
Copy link
Contributor

🚧 @Julesssss has triggered a test build. You can view the workflow run here.

Copy link
Contributor

🚧 @Julesssss has triggered a test hybrid app build. You can view the workflow run here.

Copy link
Contributor

🧪🧪 Use the links below to test this adhoc build on Android, iOS, Desktop, and Web. Happy testing! 🧪🧪

Android 🤖 iOS 🍎
https://ad-hoc-expensify-cash.s3.amazonaws.com/android/53954/index.html ❌ FAILED ❌
Android The QR code can't be generated, because the iOS build failed
Desktop 💻 Web 🕸️
https://ad-hoc-expensify-cash.s3.amazonaws.com/desktop/53954/NewExpensify.dmg https://53954.pr-testing.expensify.com
Desktop Web

👀 View the workflow run that generated this build 👀

Copy link
Contributor

🧪🧪 Use the links below to test this adhoc build on Android, iOS, Desktop, and Web. Happy testing! 🧪🧪

Android 🤖 iOS 🍎
❌ FAILED ❌ ❌ FAILED ❌
The QR code can't be generated, because the Android build failed The QR code can't be generated, because the iOS build failed
Desktop 💻 Web 🕸️
N/A N/A
N/A N/A

👀 View the workflow run that generated this build 👀

Copy link
Contributor

🚧 @marcochavezf has triggered a test build. You can view the workflow run here.

@ishpaul777
Copy link
Contributor

No prob, pulled the PR code and started the build will update soon with test results

@ishpaul777
Copy link
Contributor

works well for IOS now but android still has same problem as in #53954 (comment)

Screen.Recording.2025-01-17.at.2.18.48.AM.mov

Copy link
Contributor

🚧 @mountiny has triggered a test hybrid app build. You can view the workflow run here.

Copy link
Contributor

🧪🧪 Use the links below to test this adhoc build on Android, iOS, Desktop, and Web. Happy testing! 🧪🧪

Android 🤖 iOS 🍎
https://ad-hoc-expensify-cash.s3.amazonaws.com/android/53954/index.html ❌ FAILED ❌
Android The QR code can't be generated, because the iOS build failed
Desktop 💻 Web 🕸️
N/A N/A
N/A N/A

👀 View the workflow run that generated this build 👀

@jnowakow
Copy link
Contributor

jnowakow commented Jan 20, 2025

Hello @ishpaul777
@war-in asked me to test those changes locally and for me it works properly when I'm checked out on both ND and OD

image

It works like on the recordings:

ND
shortcuts-ND.mov
OD
shortcuts-OD.mov

@ishpaul777
Copy link
Contributor

tried again it worked well for me android as well

Screen.Recording.2025-01-20.at.6.12.40.PM.mov

Copy link

melvin-bot bot commented Jan 20, 2025

🎯 @ishpaul777, thanks for reviewing and testing this PR! 🎉

An E/App issue has been created to issue payment here: #55476.

@ishpaul777
Copy link
Contributor

Screen.Recording.2025-01-20.at.6.27.02.PM.mov

i noticed a blink in bootscreen before app starts Do you think this is related @war-in @jnowakow

@war-in
Copy link
Contributor Author

war-in commented Jan 20, 2025

i noticed a blink in bootscreen before app starts Do you think this is related

Hmm, it might be 🤔 I'd not bock on this issue because working shortcuts are more important but we should investigate it more 👍

@marcochavezf
Copy link
Contributor

All yours @Julesssss

@Julesssss Julesssss dismissed their stale review January 21, 2025 23:02

Outdated

@Julesssss
Copy link
Contributor

Okay nice.

So I will merge both App and Mobile-Expensify. In theory, both will then work with the next checklist (when the App changes get placed and the Mobile-Expensify commit is bumped).

@Julesssss Julesssss merged commit faacfaa into Expensify:main Jan 22, 2025
15 checks passed
@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Jan 22, 2025
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
App start time appCreationEnd_To_contentAppeared 569.767 ms → 671.867 ms (+102.100 ms, +17.9%) 🔴
Show details
Name Duration
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 569.767 ms
Stdev: 104.890 ms (18.4%)
Runs: 422 425 436 440 440 444 456 463 464 475 481 483 486 489 489 490 490 493 496 497 502 503 504 504 516 521 529 533 537 537 547 548 548 549 551 551 555 568 568 575 591 628 640 657 670 677 677 706 707 709 711 713 716 727 730 739 753 764 771 795

Current
Mean: 671.867 ms
Stdev: 125.655 ms (18.7%)
Runs: 466 478 481 482 499 499 504 507 513 538 542 544 546 554 560 563 572 575 577 578 579 580 583 587 593 595 599 670 692 695 703 715 717 717 728 729 736 741 754 757 762 767 769 777 780 790 791 799 800 804 805 810 826 831 832 845 850 859 881 886

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 30.379 ms → 24.068 ms (-6.312 ms, -20.8%) 🟢
App start time nativeLaunchEnd_To_appCreationStart 61.150 ms → 76.368 ms (+15.218 ms, +24.9%) 🟡
App start time appCreation 65.200 ms → 70.155 ms (+4.955 ms, +7.6%)
App start time contentAppeared_To_screenTTI 576.402 ms → 520.517 ms (-55.886 ms, -9.7%)
App start time runJsBundle 293.817 ms → 319.833 ms (+26.017 ms, +8.9%)
App start time TTI 1303.286 ms → 1367.033 ms (+63.748 ms, +4.9%)
App start time regularAppStart 0.020 ms → 0.020 ms (-0.000 ms, -0.6%)
App start time (CPU) 144.245 % → 140.261 % (-3.983 %, -2.8%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 348.127 MB → 339.079 MB (-9.048 MB, -2.6%)
App start time (CPU/JS) 0.000 % → 0.000 %
App start time (CPU/UI) 24.956 % → 21.743 % (-3.213 %, -12.9%)
Open search router TTI Load Search Options 185.072 ms → 187.469 ms (+2.397 ms, +1.3%)
Open search router TTI Open Search Router TTI 1261.699 ms → 1259.996 ms (-1.703 ms, ±0.0%)
Open search router TTI (CPU) 148.970 % → 150.790 % (+1.820 %, +1.2%)
Open search router TTI (FPS) 59.914 FPS → 57.226 FPS (-2.688 FPS, +4.5%)
Open search router TTI (RAM) 366.532 MB → 367.042 MB (+0.510 MB, ±0.0%)
Open search router TTI (CPU/JS) 0.000 % → 0.000 %
Open search router TTI (CPU/UI) 25.398 % → 24.387 % (-1.012 %, -4.0%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 451.356 ms → 449.999 ms (-1.356 ms, ±0.0%)
Report typing (CPU) 108.120 % → 108.298 % (+0.179 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 436.808 MB → 435.812 MB (-0.996 MB, ±0.0%)
Report typing (CPU/JS) 0.000 % → 0.000 %
Report typing (CPU/UI) 27.666 % → 27.627 % (-0.038 %, ±0.0%)
Chat opening Chat TTI 342.557 ms → 341.010 ms (-1.548 ms, ±0.0%)
Chat opening (CPU) 165.254 % → 165.826 % (+0.572 %, ±0.0%)
Chat opening (FPS) 60.000 FPS → 60.000 FPS
Chat opening (RAM) 357.476 MB → 357.600 MB (+0.124 MB, ±0.0%)
Chat opening (CPU/JS) 0.000 % → 0.000 %
Chat opening (CPU/UI) 33.650 % → 33.898 % (+0.248 %, +0.7%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 30.379 ms
Stdev: 2.947 ms (9.7%)
Runs: 26 27 27 27 27 27 27 27 27 27 28 28 28 28 28 28 28 28 28 29 29 29 29 29 29 29 29 29 29 29 30 30 30 30 31 31 31 32 32 32 32 32 32 32 33 33 33 33 33 34 34 35 35 35 36 36 37 38

Current
Mean: 24.068 ms
Stdev: 2.635 ms (10.9%)
Runs: 20 21 21 21 21 21 21 22 22 22 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 25 25 25 25 25 26 26 26 26 26 27 27 27 28 28 28 29 29 30 30 31
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 61.150 ms
Stdev: 8.167 ms (13.4%)
Runs: 43 45 48 51 52 52 52 52 54 54 55 55 55 55 56 56 56 56 56 56 57 57 58 58 58 58 58 58 58 59 60 61 61 61 62 62 62 62 63 64 65 65 65 65 66 67 67 68 69 70 70 70 71 72 74 77 77 78 78 79

Current
Mean: 76.368 ms
Stdev: 10.435 ms (13.7%)
Runs: 59 60 61 61 62 63 64 64 65 65 67 67 68 69 70 70 70 70 71 71 71 72 74 74 74 74 74 75 76 76 77 77 77 77 77 78 79 79 79 80 80 81 81 82 85 85 86 87 88 89 90 92 92 97 97 101 103
App start time appCreation Baseline
Mean: 65.200 ms
Stdev: 12.167 ms (18.7%)
Runs: 45 47 49 50 50 50 51 52 52 53 53 54 54 55 56 56 56 57 57 57 57 57 57 57 59 59 61 61 61 66 66 68 68 68 68 68 69 69 69 70 70 71 71 71 71 71 74 76 76 78 78 79 79 80 81 86 87 92 94 95

Current
Mean: 70.155 ms
Stdev: 11.039 ms (15.7%)
Runs: 53 54 56 56 56 57 57 58 58 59 59 61 61 62 63 64 64 64 65 65 65 66 66 66 66 67 67 68 68 68 68 69 69 69 70 70 71 71 71 71 73 73 76 77 78 80 80 82 83 84 85 85 87 88 89 94 97 100
App start time contentAppeared_To_screenTTI Baseline
Mean: 576.402 ms
Stdev: 119.031 ms (20.7%)
Runs: 327.34311700006947 350.4345519999042 364.5789099999238 385.3733850000426 400.6399089999031 401.3360180000309 413.00564599991776 414.0759240000043 415.2120870000217 416.0035939998925 421.4987459999975 422.6736459999811 426.80513700004667 427.40960599994287 435.59277500002645 444.70294200000353 449.04899800010026 456.30071000009775 468.79646100010723 536.5173339999747 543.8612959999591 548.4649050000589 585.2707680000458 611.7908040001057 613.990557000041 623.0014110000338 624.4257650000509 625.1363989999518 625.173283000011 628.5790550000966 629.475892999908 634.9389100000262 639.6756380000152 642.7943869999144 644.4043229999952 647.0994760000613 650.874434000114 651.6814460000023 657.1621789999772 659.0574089998845 663.7272069999017 664.6482629999518 665.4157499999274 667.8185779999476 667.8566870000213 672.6579050000291 673.3484620000236 674.9148250001017 677.8043849999085 678.9412060000468 681.7986969999038 684.0251919999719 685.2494069999084 689.098060999997 692.2909520000685 694.4503019999247 694.7839309999254 699.6328670000657 731.5911459999625 759.8788119999226

Current
Mean: 520.517 ms
Stdev: 120.005 ms (23.1%)
Runs: 383.17015099991113 386.62951899995096 390.2812349998858 390.39781700004824 391.13928000000305 393.09647400001995 394.2349310000427 394.5223620000761 394.6655300001148 397.48338599991985 401.50075399992056 401.7541420001071 402.2238640000578 406.8928050000686 408.68688699998893 408.83279799995944 410.7912119999528 410.8932560000103 411.39222200005315 414.5725960000418 419.2739200000651 422.46505500003695 424.68807399994694 426.9853070001118 429.5966930000577 432.1100369999185 438.1013239999302 439.5856039999053 444.9680319998879 446.44329300010577 452.1004719999619 457.7315869999584 473.26983799994923 570.6751890000887 595.6539660000708 596.8888960001059 603.1750890000258 604.6623299999628 610.676962000085 619.3236050000414 621.3360689999536 625.7676490000449 631.4666510000825 654.8172869998962 659.179259999888 661.9481669999659 663.2136009999085 663.4675890000071 663.6977419999894 664.5039709999692 664.5066209998913 665.810339000076 673.6318069999106 677.5315479999408 679.2128429999575 680.8557519998867 682.51355100004 694.6699129999615 695.6287249999586 705.6975670000538
App start time runJsBundle Baseline
Mean: 293.817 ms
Stdev: 24.211 ms (8.2%)
Runs: 245 245 248 248 250 250 251 251 255 255 256 256 262 262 263 263 265 265 266 266 269 269 271 271 272 272 272 272 274 274 276 276 276 276 277 277 278 278 280 280 280 280 283 283 285 285 286 286 290 290 292 292 293 293 293 293 294 294 295 295 296 296 298 298 299 299 302 302 304 304 304 304 305 305 305 305 308 308 309 309 309 309 309 309 311 311 313 313 314 314 314 314 315 315 316 316 317 317 317 317 319 319 320 320 323 323 323 323 325 325 325 325 329 329 332 332 332 332 339 339

Current
Mean: 319.833 ms
Stdev: 27.013 ms (8.4%)
Runs: 262 262 270 270 276 276 276 276 278 278 279 279 279 279 283 283 284 284 288 288 288 288 294 294 295 295 296 296 298 298 298 298 299 299 300 300 304 304 304 304 307 307 307 307 309 309 314 314 314 314 316 316 317 317 318 318 319 319 319 319 323 323 325 325 327 327 329 329 330 330 332 332 337 337 337 337 339 339 339 339 340 340 340 340 341 341 342 342 342 342 342 342 343 343 346 346 349 349 349 349 350 350 350 350 351 351 352 352 355 355 356 356 357 357 358 358 359 359 359 359
App start time TTI Baseline
Mean: 1303.286 ms
Stdev: 83.754 ms (6.4%)
Runs: 1093.5173339999747 1121.3431170000695 1127.861295999959 1131.464905000059 1157.336018000031 1176.5789099999238 1181.2707680000458 1187.4345519999042 1201.0014110000338 1225.7908040001057 1228.5790550000966 1232.4987459999975 1234.990557000041 1245.874434000114 1252.7839309999254 1253.1363989999518 1255.8051370000467 1259.425765000051 1266.2120870000217 1271.0056459999178 1272.3733850000426 1288.6756380000152 1296.1621789999772 1296.9389100000262 1298.0035939998925 1298.173283000011 1300.0759240000043 1313.673645999981 1319.7943869999144 1321.4157499999274 1322.3484620000236 1324.6399089999031 1326.6482629999518 1327.475892999908 1329.5927750000264 1334.7964610001072 1335.2494069999084 1339.8185779999476 1342.0994760000613 1346.8043849999085 1347.0489980001003 1348.6579050000291 1359.9412060000468 1361.098060999997 1363.0251919999719 1363.7029420000035 1365.6814460000023 1367.4096059999429 1378.3007100000978 1385.8566870000213 1387.4043229999952 1392.7986969999038 1395.7272069999017 1405.5911459999625 1406.0574089998845 1409.2909520000685 1412.9148250001017 1413.4503019999247 1444.8788119999226 1449.6328670000657

Current
Mean: 1367.033 ms
Stdev: 77.317 ms (5.7%)
Runs: 1213.754142000107 1216.6751890000887 1242.1750890000258 1249.6539660000708 1252.5007539999206 1254.3360689999536 1259.7912119999528 1267.3236050000414 1268.139280000003 1272.465055000037 1272.6655300001148 1281.6623299999628 1287.4833859999198 1291.522362000076 1293.2349310000427 1300.888896000106 1301.3978170000482 1306.5725960000418 1314.4666510000825 1315.1100369999185 1322.686886999989 1329.676962000085 1331.2812349998858 1339.767649000045 1350.629518999951 1359.948166999966 1378.1701509999111 1379.8932560000103 1381.810339000076 1386.3922220000532 1387.5066209998913 1387.5856039999053 1387.968031999888 1393.1004719999619 1396.5966930000577 1402.6287249999586 1406.5315479999408 1408.179259999888 1412.6977419999894 1419.8928050000686 1425.2739200000651 1425.688073999947 1426.5039709999692 1430.2238640000578 1430.8557519998867 1431.2136009999085 1431.4675890000071 1435.6318069999106 1436.8327979999594 1441.1013239999302 1446.2698379999492 1446.7315869999584 1451.51355100004 1460.09647400002 1463.8172869998962 1473.2128429999575 1474.6699129999615 1480.9853070001118 1490.6975670000538 1494.4432930001058
App start time regularAppStart Baseline
Mean: 0.020 ms
Stdev: 0.002 ms (10.5%)
Runs: 0.01599099999293685 0.016072999918833375 0.016967999981716275 0.017496000044047832 0.017659999895840883 0.01774100004695356 0.018188000191003084 0.018188999965786934 0.01822899980470538 0.018350999802350998 0.018432999961078167 0.01847400004044175 0.018718000035732985 0.018718000035732985 0.018839000025764108 0.0188400000333786 0.01887999987229705 0.018880000105127692 0.018920999951660633 0.018961000023409724 0.01900299987755716 0.01900299987755716 0.01912399986758828 0.019286999944597483 0.019367999862879515 0.019490999868139625 0.019530999939888716 0.01977499993517995 0.019939000019803643 0.02002000017091632 0.020060000009834766 0.020060000009834766 0.020100999856367707 0.02010100008919835 0.020141999935731292 0.020345000084489584 0.02066999999806285 0.02083300007507205 0.021078000077977777 0.02115899999625981 0.021280999993905425 0.02128100022673607 0.021321000065654516 0.021363000152632594 0.02140299999155104 0.021403000224381685 0.022298000054433942 0.022582999896258116 0.022786000045016408 0.02307200012728572 0.023722000187262893 0.023803999880328774 0.02429199987091124 0.025553999934345484 0.025959999999031425

Current
Mean: 0.020 ms
Stdev: 0.002 ms (11.1%)
Runs: 0.015910000074654818 0.015951000154018402 0.01656099990941584 0.0166830001398921 0.016966999974101782 0.01704900013282895 0.01721199997700751 0.017496999818831682 0.017699999967589974 0.017862999811768532 0.018026000121608377 0.018107999814674258 0.0181470001116395 0.018432000186294317 0.018432999961078167 0.018514000112190843 0.018635999877005816 0.018798999954015017 0.018798999954015017 0.01900299987755716 0.019245999865233898 0.019247000105679035 0.01932699978351593 0.01944999978877604 0.01944999978877604 0.0195720000192523 0.0195720000192523 0.019733999855816364 0.019817000022158027 0.01989799994044006 0.01993800001218915 0.02006100001744926 0.0201409999281168 0.02026399993337691 0.020264000166207552 0.02050799992866814 0.020589999854564667 0.020711000077426434 0.020711000077426434 0.020752000156790018 0.020752000156790018 0.021117999916896224 0.02123999991454184 0.021607000147923827 0.021727999905124307 0.021727999905124307 0.02197199990041554 0.022501999977976084 0.022542000049725175 0.022582999896258116 0.023152000037953258 0.023599999956786633 0.024169000098481774 0.02429199987091124 0.02474000002257526 0.025757000083103776
App start time (CPU) Baseline
Mean: 144.245 %
Stdev: 6.573 % (4.6%)
Runs: 123.75249500998001 132.83975698853314 134.11344415281422 134.52509931383176 134.70546599756645 136.71875 136.74900398406382 137.5664240464717 137.57415821742495 137.8549072211044 138.8164001960183 138.88933244976008 139.05524249640442 139.2480729904043 139.4904028920291 139.76142665901705 140.27983493461548 140.38562562017236 140.48121240528084 141.31052332554762 141.31726907630525 141.9957352708892 142.76095617529884 143.1852268466442 143.75298804780877 144 144.24110671936765 144.5486086357264 144.8173646968828 145.0281255670478 145.37439699626913 145.41066503217897 145.6056560047997 145.71314741035863 146.2777122127792 147.640625 147.68028119731525 147.77276932464625 147.77290836653387 147.93974249739662 148.81404641458187 149.05341446923597 149.4007623089315 150.04861164339627 150.07911487000842 150.12850397465783 150.58262963608425 150.9176056672848 151 151.62920722784247 152.7118912080961 153.72778241679597 155.34817168854477 155.51695043420818 155.7622965515868 156.0267302435388

Current
Mean: 140.261 %
Stdev: 7.162 % (5.1%)
Runs: 125.63157894736841 127.69900032606708 128.35507572349675 129.80694519156057 130.12224448897797 130.73723465289734 130.78443168643452 132.07245263696876 132.3482908009993 132.62425447316107 133.93933587231635 134.19606349403773 134.66003976143145 134.8822355289422 135.03502792767208 135.11637080867854 135.44566042510118 135.62641155326526 136.11807833301177 136.29275208222577 136.7964557345307 136.7999651369169 136.9032886490112 137.77080689882044 138.28780306210552 138.40155945419102 138.8662674650699 138.93481686086096 138.9492131673706 139.32540216866138 139.48306595365415 139.48874123292734 139.76262664494004 139.80507401560027 140.56684798167763 140.74869420750053 140.86427145708586 142.11408334914316 142.57226927512036 142.6346293165903 144.1169671752196 144.73324762976057 144.87824351297405 144.8881577408566 145.54357420616944 145.72111553784865 146.15845864958266 147.7290836653387 147.93132080894864 148.60460220051 148.85211628732603 149.78963472939378 149.83645185793796 149.87225548902205 151.0411762859743 152.3501548551649 152.45395336928513 152.8051181102362 153.75816993464048 154.04461617846476
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 348.127 MB
Stdev: 7.391 MB (2.1%)
Runs: 329.4921875 333.716796875 334.91796875 336.00390625 337.6796875 337.701171875 338.4765625 339.8046875 340.21875 341.296875 342.17578125 342.4375 343.693359375 344.291015625 344.7421875 345.19921875 345.32421875 345.48828125 346.20703125 346.384765625 346.67578125 346.689453125 346.857421875 347.099609375 347.109375 347.181640625 347.189453125 347.43359375 347.486328125 347.59375 347.78515625 347.794921875 347.96875 348.2109375 348.486328125 348.58984375 348.958984375 348.98828125 349.25 350.55859375 351.146484375 353.05859375 353.673828125 353.7109375 353.9453125 355.259765625 356.099609375 356.16796875 356.861328125 357.03125 357.47265625 359.01953125 359.2578125 359.568359375 359.630859375 361.154296875 367.0234375

Current
Mean: 339.079 MB
Stdev: 12.128 MB (3.6%)
Runs: 321.513671875 322.80859375 322.83984375 323.298828125 323.580078125 324.044921875 324.251953125 324.392578125 324.4921875 324.86328125 325.177734375 325.189453125 325.8515625 326.62109375 327.37890625 327.4375 327.94140625 327.98046875 328.576171875 328.83984375 330.109375 331.01953125 331.296875 332.048828125 332.06640625 332.208984375 332.548828125 335.279296875 335.5546875 336.572265625 336.8515625 339.22265625 342.046875 343.822265625 344.15625 345.791015625 348.4453125 348.625 349.548828125 350.115234375 350.322265625 350.556640625 350.66015625 351.421875 351.51171875 351.5546875 351.5625 351.697265625 351.794921875 351.853515625 352.41015625 352.431640625 352.6328125 352.787109375 353.966796875 354.494140625 354.59765625 355.5625 356.37109375 362.16796875
App start time (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
App start time (CPU/UI) Baseline
Mean: 24.956 %
Stdev: 4.983 % (20.0%)
Runs: 11.8 12 18 18 18 19.1 19.9 19.9 20 20 20.8 21.6 21.7 21.8 22 22 22.5 22.5 22.9 23 23 23 23 23 23 23.9 24 24.1 24.6 25 25 25.1 25.8 25.9 26 26.2 27 27 27.8 27.9 27.9 28.4 28.7 28.8 28.9 29.1 30.3 30.7 31.2 31.6 32 32 32.1 32.3 32.7 33 35

Current
Mean: 21.743 %
Stdev: 4.761 % (21.9%)
Runs: 13 15 15 15 15 16 16 17 17 17 17 17 17 18 18 18 18 18 18 18.1 18.8 18.9 18.9 19 20 20 20 20.1 21 21 21 21.1 21.5 21.7 22 22 22 23.9 24 24 24.9 25 25 25.2 25.7 26.3 26.5 26.8 27 27.1 27.5 27.9 28 28 28.8 29 29.7 30.2 30.9 31.1
Open search router TTI Load Search Options Baseline
Mean: 185.072 ms
Stdev: 7.383 ms (4.0%)
Runs: 168.27042600000277 168.62320999987423 172.09895899984986 172.28088299976662 175.02380400011316 175.04329499974847 175.07702699955553 176.32344599999487 176.41243499983102 176.68884299974889 177.41394100012258 177.81669100001454 178.40950600011274 179.3887529997155 180.2921140003018 180.32393399998546 180.66170200007036 181.08528700005263 181.88444000016898 182.45271899970248 182.5838629999198 182.63468499993905 183.15999400010332 183.42875099973753 183.72985900007188 184.07548000011593 184.57527599995956 185.22269700001925 185.71582000004128 185.80521599994972 186.2106119999662 186.3673499999568 186.67110199993476 186.90030900016427 186.95963500021026 186.96704100025818 187.04439300019294 187.17219999991357 188.0920000001788 188.14904800010845 188.25146499974653 188.82267299992964 188.88614900037646 188.95092799980193 189.13488800032064 189.34037200035527 190.71569899981841 190.74170000012964 191.8253179998137 191.86604800028726 192.87687199981883 193.2762039997615 193.5603030002676 193.6363119999878 193.66121400007978 195.01932700024918 195.4685060000047 198.58964099967852 200.4261070000939 202.21630899980664

Current
Mean: 187.469 ms
Stdev: 8.256 ms (4.4%)
Runs: 165.31563299987465 173.8540849997662 174.55065899994224 176.15555799985304 176.7735190000385 177.68074600026011 178.05167600000277 178.90413499996066 178.91654499992728 179.3610439999029 180.49031599983573 180.56197100039572 180.99776199972257 181.01708999974653 181.02388500003144 182.8264560000971 183.15348300011829 183.6703699999489 183.6836749999784 183.69014500034973 183.81461599981412 183.87235500011593 184.18554699979722 185.04431200027466 185.16149899968877 185.29231799999252 185.54410799965262 185.80481000011787 185.8597820000723 186.28202300006524 186.39566999999806 186.5607089996338 187.2117109997198 187.23148600012064 187.68009399995208 187.70625799987465 188.1768789999187 188.48234099987894 189.00154699990526 189.74039799999446 189.97464999975637 190.24723399989307 190.33630400011316 192.32308000000194 194.08679200010374 194.55485000042245 195.18664600001648 195.5044760000892 195.73429300030693 195.92065400024876 196.06160499993712 196.93794800015166 197.09761600010097 197.6826169998385 198.37101300014183 199.61161300027743 203.12365700025111 203.23132300004363 205.19767299992964 207.2170009999536
Open search router TTI Open Search Router TTI Baseline
Mean: 1261.699 ms
Stdev: 125.530 ms (9.9%)
Runs: 1067.9573169997893 1074.803467999678 1085.034423999954 1090.4009199999273 1092.072714000009 1094.5933030000888 1106.8615320003591 1106.8745120000094 1107.635377000086 1109.1740319998935 1110.130981999915 1114.8117690002546 1115.9833580004051 1121.3954270002432 1124.7601319998503 1125.3814710001461 1125.6146650002338 1126.1516120000742 1126.8456629998982 1133.0271819997579 1133.1860360000283 1134.846721000038 1136.0334069998935 1137.523194000125 1141.7984629999846 1142.4037279998884 1143.5078529999591 1144.026489999611 1144.2685150001198 1145.5714520001784 1148.6201169998385 1150.8872890002094 1150.9470220003277 1151.1612150003202 1151.613607000094 1152.2581390002742 1153.4610199998133 1155.2578949998133 1155.5170499999076 1158.282226999756 1159.8490810003132 1160.5873630000278 1161.818808000069 1162.4861659999005 1163.0703130001202 1164.6235360000283 1167.1183690000325 1167.7229010001756 1168.3878990001976 1168.9386809999123 1174.0308440001681 1174.1516109998338 1178.4309899997897 1179.482137999963 1180.3238119999878 1180.3582770000212 1181.1347659998573 1184.5032150000334 1187.1445319997147 1189.136555999983 1300.9570730002597 1304.0739349997602 1310.516764999833 1327.1184080000967 1330.1761479997076 1330.8176280003972 1333.0718189999461 1335.3968919999897 1338.9805509997532 1341.984335000161 1343.2748619997874 1345.8420410002582 1348.7284760000184 1349.0234380001202 1350.1074629998766 1350.21899499977 1352.9981700000353 1354.6559250000864 1356.6667080000043 1360.429444000125 1363.4586600000039 1367.7595629999414 1369.2606609999202 1370.1113289999776 1370.456259000115 1373.5299889999442 1374.1105969999917 1374.6417240002193 1375.681762999855 1377.8357749995776 1379.3661299999803 1385.105022000149 1385.6499440004118 1386.3011069996282 1388.978434999939 1390.7823490002193 1399.3847670000978 1401.906860999763 1402.138469999656 1403.5255539999343 1408.1524669998325 1412.4437269996852 1412.9896650002338 1413.8381760003977 1414.1846529999748 1416.0174969998188 1416.6647959998809 1417.2686780001968 1419.9502770002 1425.2028810000047 1428.4932050001808 1428.7110999999568 1438.0716969999485 1440.9785569999367 1441.3792330003344 1450.3350430000573 1451.7320159999654 1464.018269999884 1492.7501229997724

Current
Mean: 1259.996 ms
Stdev: 127.978 ms (10.2%)
Runs: 1028.9425459997728 1037.1238199998625 1073.8771570003591 1075.4123540003784 1085.7307540001348 1092.392985000275 1100.2134199999273 1100.2595620001666 1100.9267579996958 1107.4411220001057 1107.744425999932 1113.062134000007 1113.7522379998118 1118.3483079997823 1119.23905499978 1119.7236330001615 1120.578980000224 1121.4521490000188 1123.4635010003112 1123.8311769999564 1130.5898029999807 1132.0645759999752 1132.471923999954 1132.9156100000255 1135.618083000183 1140.2229410000145 1141.8273120000958 1143.4653330002911 1145.0109459999949 1145.383424000349 1145.4715990000404 1145.6113289999776 1149.454264999833 1150.5423999996856 1151.2692470001057 1152.7733980002813 1153.5933440001681 1155.730142999906 1157.1686210003681 1157.2333579999395 1159.2383230002597 1159.562989000231 1159.838339000009 1161.7882489999756 1161.9350589998066 1162.8084720000625 1167.3383790003136 1167.4807540001348 1170.2182630002499 1172.926717999857 1173.029908000026 1173.7034920002334 1176.620647000149 1177.1903490000404 1179.002481999807 1179.8541259998456 1193.2312830002047 1194.7395839998499 1201.6580409999005 1206.7676599998958 1245.528523999732 1275.6414799997583 1308.1613779999316 1308.3555910000578 1313.5566000002436 1327.0517989997752 1328.5640870002098 1331.2349860002287 1334.096760999877 1335.4420989998616 1336.1103929998353 1341.394125000108 1345.549682999961 1348.5391040001996 1348.7220460004173 1350.8363450001925 1360.2659109998494 1362.4839679999277 1365.0085050002672 1369.62109400006 1370.3041589995846 1371.797609000001 1376.1588950003497 1377.8514410001226 1378.0439869998954 1380.909384000115 1382.0450450000353 1384.0847579999827 1389.0418710000813 1389.5171320000663 1391.7967129996978 1392.2108970000409 1392.378703000024 1392.3802090003155 1393.731364000123 1396.8728040000424 1398.1555989999324 1400.236856999807 1400.8689790000208 1407.77787300013 1408.028320999816 1409.4844979997724 1412.2614349997602 1412.9331060000695 1413.1312669999897 1414.3247889997438 1417.8043619999662 1420.1317559997551 1422.7502850000747 1424.3308109999634 1428.5503349998035 1428.7922370000742 1431.813152000308 1432.8473310000263 1440.7526859999634 1450.9777019997127 1452.2969160000794 1460.4724540002644 1474.5937919998541
Open search router TTI (CPU) Baseline
Mean: 148.970 %
Stdev: 3.011 % (2.0%)
Runs: 141.68753715651718 142.44652781426313 143.6777555110221 143.70105948283515 144.12393195573645 144.6500458625408 145.66071172533555 145.84755802355042 146.1726354108069 146.21641597347192 146.27049847278224 146.45991374124662 146.50199133981175 146.5842770195975 146.66746504768864 146.6866798646508 146.7953719063163 147.24309204125134 147.7622762443241 147.84172178888974 148.23596850475226 148.26949849747282 148.42593312938482 148.4756530069299 148.4799602898713 148.5134667867784 148.51636739443228 148.60474696872393 148.70564923640342 148.84491260123727 148.856688888385 148.8920924810714 148.89581525804107 149.0578941172317 149.12740179074842 149.3734125940846 149.979923295385 150.0215319000195 150.1602759498276 150.5053962490489 150.74416109728793 150.82891170084102 150.94092029308877 150.95886921517402 151.25962979284068 151.861293010686 151.91172617908518 152.0716643913179 152.3525255782465 152.5559157865311 152.70151837976132 152.93791018383814 153.2093685392634 153.3611019635706 153.47074192304888 153.49438817679695 153.83316122339494 153.88261886776104 153.89799397962906

Current
Mean: 150.790 %
Stdev: 4.178 % (2.8%)
Runs: 140.23413230552535 143.79586433913641 143.90540483596206 144.12390941930374 144.302210724327 145.3041436242813 145.41230547298582 145.59271043574796 146.17316491864065 146.833743690708 146.96644939092894 147.31916009943492 147.35909685785444 147.86229662019105 148.22160762427913 148.41533913479145 148.46214241975326 148.4886210442691 148.50478503963546 148.75313191690603 148.99169075184625 149.04201290318724 149.29042021975656 149.31265196984555 149.35447618470468 149.82906019400215 150.0374003833132 150.1422624929071 150.2903071434662 150.85714999059473 151.08938306665954 151.26987289817453 151.29976043076465 151.36578475793698 151.49213684241008 151.9687055130522 152.12257720921292 152.16733067729086 152.47795579363097 152.49662723082855 152.88194472301524 153.38160279614038 153.62781281339068 153.76861075580518 154.20121012449852 154.28021025550242 154.31037869986483 154.5068060123411 154.73004194647402 154.93290720147263 155.10812057191674 155.29561144201196 155.99242975772773 156.93687263910144 156.99656980605673 157.76098609058187 157.9224670593713 158.94411541399862 160.1106851902557
Open search router TTI (FPS) Baseline
Mean: 59.914 FPS
Stdev: 0.164 FPS (0.3%)
Runs: 59.365632410681556 59.43255191655287 59.47897796867761 59.590141965931025 59.63074429450519 59.67021559215099 59.707021558976464 59.70753959682763 59.72596209840373 59.74872321029742 59.79317139316045 59.898079723242425 59.90868122385111 59.94160119338558 59.94612033756876 59.993542067593545 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 57.226 FPS
Stdev: 1.153 FPS (2.0%)
Runs: 55.01301063772246 55.09196750812812 55.18120999741292 55.236740173917404 55.64488235080489 55.666022754649475 55.67788959533648 55.75231513916708 56.124280587346696 56.265489372642286 56.27540662624565 56.32724791688225 56.33513504089346 56.406529587572344 56.422344800669784 56.434380759006594 56.443856943919194 56.539493979760344 56.58505777566995 56.61627480030978 56.70961315780944 56.75772882095591 56.79664410674341 56.82193050016741 56.98423941614171 57.07027667850471 57.093740781578845 57.13598846386109 57.219469700907304 57.282736121658374 57.38135573684967 57.38835706170645 57.388951739284224 57.44620973097365 57.46780540685192 57.475597081136 57.49489056612738 57.53490590695411 57.6720712068279 57.862088477353474 57.9064687240608 58.034139976551344 58.08818429032025 58.16175805820014 58.25504583851862 58.35601773201887 58.398717776709006 58.43201309411215 58.51387938953893 58.605487580687736 58.6602277907261 58.762106114041714 59.04322139311502 59.13814058858444 59.46612974785169 59.51021436969383 59.51370597210639
Open search router TTI (RAM) Baseline
Mean: 366.532 MB
Stdev: 3.834 MB (1.0%)
Runs: 360.659375 360.915625 361.26171875 361.44140625 361.5984375 361.959375 362.3171875 362.4328125 362.65390625 362.846875 362.9296875 363.37734375 363.43515625 363.49375 363.681640625 363.85390625 364.05078125 364.05234375 364.065625 364.34296875 364.37109375 364.91171875 364.98203125 365.16484375 365.2359375 365.2734375 365.390625 365.50703125 365.5859375 365.77734375 365.91796875 366.20234375 366.265625 366.6015625 366.621875 366.6234375 366.6921875 366.9912109375 367.40546875 367.559375 367.6625 367.96796875 368.109375 368.4640625 368.55546875 368.9015625 369.09375 370.08046875 370.23359375 370.6453125 370.65234375 370.68828125 371.6921875 372.66328125 374.32265625 374.62265625 374.78515625 375.8765625 375.93828125

Current
Mean: 367.042 MB
Stdev: 5.405 MB (1.5%)
Runs: 357.30078125 358.4171875 360.778125 360.98359375 361.0484375 361.15390625 361.2234375 361.2328125 361.24375 361.490625 361.51875 361.725 361.83359375 362.14921875 362.38515625 362.746875 362.98671875 363.534375 363.55625 363.56328125 363.9546875 364.11484375 364.1546875 364.21875 364.3375 364.790625 365.11171875 365.49765625 365.53828125 365.86875 367.353125 367.71484375 367.8427734375 367.93515625 367.95078125 368.00078125 368.103515625 368.20859375 368.440625 369.140625 369.34609375 370.11015625 370.16015625 370.23515625 370.6046875 370.946875 370.996875 371.8875 372.28828125 373.1203125 373.77734375 374.45625 374.91328125 374.9734375 375.06875 375.38125 375.990625 379.236328125 382.8486328125
Open search router TTI (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Open search router TTI (CPU/UI) Baseline
Mean: 25.398 %
Stdev: 1.288 % (5.1%)
Runs: 21.8 23 23 23.4 23.4 23.5 23.9 24 24 24 24.2 24.3 24.3 24.4 24.4 24.6 24.6 24.9 24.9 25 25.1 25.1 25.1 25.1 25.2 25.2 25.3 25.4 25.5 25.5 25.5 25.5 25.6 25.6 25.7 25.7 25.8 25.8 25.9 25.9 25.9 26 26.1 26.2 26.3 26.4 26.6 26.7 26.7 26.8 26.9 26.9 27 27.1 27.1 27.4 27.4 27.8 28.1

Current
Mean: 24.387 %
Stdev: 1.683 % (6.9%)
Runs: 21.1 21.4 21.6 21.9 21.9 22.2 22.3 22.4 22.4 22.5 22.6 22.6 22.7 23 23.1 23.2 23.2 23.2 23.2 23.4 23.5 23.6 23.9 23.9 23.9 24.1 24.3 24.3 24.4 24.5 24.6 24.6 24.6 24.6 24.6 24.6 24.8 24.9 25 25.1 25.3 25.3 25.3 25.5 25.6 25.6 25.6 25.7 26 26.2 26.4 26.4 26.4 26.5 26.7 26.7 26.8 27.1 27.5 28.9
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 451.356 ms
Stdev: 43.400 ms (9.6%)
Runs: 384.8346770000644 389.7491859998554 391.07023200020194 393.43819200014696 394.4641929999925 395.7372229998 399.5701500000432 400.26798600004986 401.17622900009155 404.64579300023615 407.5470789996907 409.7554930001497 409.80533799994737 412.1180419996381 412.978637999855 414.25935899978504 415.2038169996813 415.5603840001859 423.4305830001831 425.8191729998216 428.90930199995637 431.10046399990097 434.6158449999057 435.7260739998892 435.7670900002122 436.44185400009155 436.74536200007424 438.39302600035444 442.53841199958697 446.47660299995914 447.9185390002094 450.03910299995914 450.685262999963 457.796875 461.18558699963614 462.32137099979445 462.5666510001756 464.1647140001878 464.1955980001949 464.79341599997133 465.86604900006205 466.90189599990845 472.2607019999996 472.6769210002385 475.61181600019336 475.8912349999882 480.1538490001112 483.4918619999662 492.2825520001352 495.4927570000291 501.96472200006247 503.8605960002169 505.7730310000479 517.8096110001206 525.8279630001634 528.2203779998235 533.5683189998381 534.6503909998573 545.7887780000456 549.4242350002751

Current
Mean: 449.999 ms
Stdev: 44.506 ms (9.9%)
Runs: 382.56933700013906 390.36543800029904 390.54016100009903 391.7028810000047 393.0770270000212 393.78820799989626 395.0387369999662 395.6943760002032 398.0707189999521 398.1588139999658 403.14392099995166 403.4796959999949 404.883748000022 405.3246250003576 407.4078369997442 410.11340299993753 411.7751870001666 412.0443929997273 417.3485109996982 432.3358569997363 432.7980549996719 433.187336999923 434.28560400009155 434.2952069998719 434.61287500010803 434.61657699989155 435.97908600000665 440.7611090000719 441.8436690000817 442.50870799971744 444.4015299999155 444.62919100001454 449.3863119999878 450.693684999831 457.0461430000141 457.141806000378 466.7534179999493 467.4811200001277 469.45410199975595 470.92216000007465 472.6295989998616 473.3345949999057 474.20141700003296 475.28544100001454 475.3660070002079 476.47672600019723 477.77539099985734 479.42110199993476 479.70088699972257 484.82824699999765 495.7539880000986 513.5138340000995 514.6994640002958 516.9257000000216 520.1010340000503 523.0010170000605 529.2728679999709 536.7418630002066 548.5865070000291 552.6851400001906
Report typing (CPU) Baseline
Mean: 108.120 %
Stdev: 2.623 % (2.4%)
Runs: 103.64993146653637 103.81773291788659 104.48227176497365 104.62763863382487 104.71530728028605 104.76220606220998 104.8982817386242 104.92098816680465 105.15103575182998 105.40143731255515 105.70432687941113 105.78168016748111 105.869477510642 106.00392867338905 106.10017880102413 106.16091286286763 106.19049222253892 106.23004454302107 106.23975765295451 106.28584319136942 106.4360578493989 106.47399797371575 106.48392593632158 106.69906098514689 107.20382434762186 107.21025872525533 107.24437615778514 107.2836434659635 107.65202968488533 107.66610300354026 107.81225309920357 107.93675568786358 107.9533894513959 108.00210781233243 108.51470837013237 108.747384953255 109.06792649339046 109.07234468578764 109.20019386242572 109.27238878475043 109.32436003039277 109.55409412016219 109.63528427114312 109.72423238728273 109.90887802857429 110.11927600073442 110.13274333776853 110.40000277715755 110.703411291812 110.759372377743 111.16446630004273 111.49994155596148 112.16175173524233 112.20253998637712 112.2330843418514 112.24612611627353 112.26040530883066 113.2525973582677 113.343844950798 113.6371413339393

Current
Mean: 108.298 %
Stdev: 2.591 % (2.4%)
Runs: 103.66594562326961 103.7429747276293 104.23296337944399 104.5628306935974 104.815032520986 104.83424561953512 104.93170894296233 105.17063470286527 105.42269557401306 105.48108215513088 105.79130425894762 105.80799589253168 105.81615048422982 105.90553303557458 105.92520099476089 106.16317450848025 106.35251084843505 106.4257001969904 106.49824174961725 106.54586732204284 106.61619892611333 106.9031938842246 106.99433349989036 107.03527192382181 107.3835105756407 107.4186844176575 107.63987154171713 107.96255474194227 108.00100753168377 108.4321344674722 108.43637120922482 108.47492924098061 108.83796816223325 108.92882529384853 109.0204891649059 109.14359428108199 109.1627486293789 109.16277806186528 109.27171965142138 109.33381087717818 109.33565470498716 109.54678263778881 109.72857265696888 110.0425918468264 110.0620390018746 110.40817963963072 110.78377006475114 111.04408057901671 111.14379344490354 111.2241493477049 111.40515812465986 111.45721162658474 111.49145513853104 111.95758391994512 112.238500737316 112.3466710704207 112.35746101551479 112.64410602036575 113.21211016427378 113.22788055326704
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 436.808 MB
Stdev: 4.345 MB (1.0%)
Runs: 428.337890625 428.407958984375 429.71533203125 429.880859375 429.944091796875 430.594482421875 431.004638671875 431.66015625 432.0029296875 432.259033203125 432.642333984375 433.030517578125 433.37109375 433.37255859375 433.466064453125 433.620849609375 433.878173828125 433.91681985294116 434.30517578125 434.56005859375 434.7352941176471 434.770751953125 434.86669921875 434.931396484375 435.31005859375 435.458984375 435.865478515625 435.9951171875 436.1884191176471 436.50146484375 436.610107421875 437.359619140625 437.564208984375 437.76220703125 438.06494140625 438.2421875 438.2861328125 438.426513671875 438.59329044117646 438.6061580882353 439.219970703125 439.498291015625 439.74755859375 439.8625919117647 439.89794921875 440.37353515625 440.432373046875 440.80514705882354 441.133544921875 441.606689453125 441.750732421875 441.78469669117646 441.8187040441176 441.8671875 442.10340073529414 442.129638671875 443.50988051470586 444.906982421875 445.4827665441176 446.456787109375

Current
Mean: 435.812 MB
Stdev: 4.492 MB (1.0%)
Runs: 427.2796415441176 427.4560546875 428.298095703125 428.4423828125 429.276123046875 430.14697265625 430.226806640625 431.050048828125 431.2626953125 431.36474609375 431.639892578125 431.82054227941177 431.9990234375 432.10271139705884 432.24609375 432.354248046875 432.434326171875 432.488525390625 432.70036764705884 432.986083984375 432.987060546875 433.343505859375 434.181884765625 434.9538143382353 435.04345703125 435.211669921875 435.489013671875 435.617431640625 435.7759650735294 435.77783203125 435.87155330882354 435.88717830882354 436.127197265625 436.13717830882354 436.14697265625 436.838623046875 436.950927734375 437.166748046875 437.4873046875 437.63330078125 438.754150390625 438.8857421875 439.03147977941177 439.2841796875 439.355712890625 439.45588235294116 439.7819393382353 439.85500919117646 440.0927734375 440.6904296875 441.337890625 441.673095703125 441.69580078125 442.082763671875 442.1015625 442.6106770833333 442.82444852941177 443.77159926470586 447.40831801470586
Report typing (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Report typing (CPU/UI) Baseline
Mean: 27.666 %
Stdev: 0.585 % (2.1%)
Runs: 26.5 26.6 26.8 26.8 26.8 26.9 26.9 26.9 26.9 27 27 27.1 27.2 27.2 27.2 27.3 27.3 27.4 27.4 27.4 27.4 27.5 27.5 27.5 27.6 27.6 27.6 27.6 27.6 27.7 27.7 27.7 27.8 27.8 27.9 27.9 27.9 27.9 27.9 28 28 28 28 28 28 28.1 28.1 28.2 28.2 28.2 28.2 28.4 28.5 28.6 28.7 28.8 28.9 29

Current
Mean: 27.627 %
Stdev: 0.684 % (2.5%)
Runs: 26.3 26.4 26.4 26.5 26.6 26.6 26.7 26.7 26.7 26.8 26.9 27 27.1 27.1 27.2 27.2 27.2 27.2 27.3 27.3 27.3 27.4 27.5 27.6 27.6 27.6 27.6 27.6 27.6 27.7 27.7 27.8 27.8 27.8 27.8 27.8 27.9 27.9 27.9 27.9 27.9 28 28 28 28 28 28 28.1 28.1 28.3 28.5 28.6 28.6 28.7 28.7 28.7 28.7 28.9 29.2
Chat opening Chat TTI Baseline
Mean: 342.557 ms
Stdev: 22.412 ms (6.5%)
Runs: 295.46732599986717 303.6029059998691 306.2087809997611 307.0712890001014 307.35579400043935 308.16446999972686 311.2322180001065 312.0845539998263 312.32047600019723 313.49711100012064 314.2161860000342 322.118123000022 322.7684729998 324.07816600007936 329.35449300007895 331.19486499996856 331.5251470003277 334.07010899996385 335.3334959996864 335.7097169999033 336.2873129998334 336.77176899975166 337.4631350003183 338.8569740001112 340.7324629998766 340.91890500020236 342.4567060000263 344.8231609999202 345.09240699978545 345.52258299989626 345.9557299995795 345.969768000301 347.7092699999921 348.1496999999508 349.0457770000212 349.1706950003281 350.4143880000338 351.2714030002244 353.16560899978504 354.45577000034973 355.17036899970844 356.86466499976814 357.7007650001906 360.02771000005305 362.1553550004028 362.94185400009155 363.2249350002967 365.9426270001568 366.12719700019807 369.1765140001662 371.2648109998554 372.0013020001352 372.03987699979916 375.16963700018823 381.1402179999277 381.6582839996554 391.5408129999414

Current
Mean: 341.010 ms
Stdev: 24.278 ms (7.1%)
Runs: 292.5984709998593 294.59810400009155 297.2367759998888 297.5514740003273 299.14766399981454 301.0492349998094 304.33569400012493 313.22436599992216 315.3170159999281 316.6742759998888 318.15543600032106 319.50663199974224 321.37788899987936 322.4603679999709 325.1051020002924 325.29467799980193 325.85880600009114 327.30920400004834 327.3995359996334 327.4576820000075 328.24983800016344 329.2183030000888 331.57137000001967 333.7337239999324 334.49194400012493 334.9785969997756 338.64758299989626 339.39522300008684 340.1825769999996 342.16723700007424 344.97587099997327 349.5224609998986 349.9175619999878 350.5706779998727 352.45267699984834 352.71480299998075 354.0201409999281 355.40376800019294 356.778076000046 356.9803059999831 357.04357900004834 358.05696600023657 362.6450609997846 362.9518229998648 363.5375570002943 365.6988929999061 365.9084480004385 366.10306800017133 368.5928960000165 369.34403500007465 369.74003100022674 369.9346920000389 371.01932800002396 372.11059599975124 373.5900070001371 374.7189540001564 375.8528249999508 384.07328299991786
Chat opening (CPU) Baseline
Mean: 165.254 %
Stdev: 3.513 % (2.1%)
Runs: 156.8362969169421 159.2064967198781 159.3317710469271 159.66208606709617 159.77828027840766 159.95714816366794 160.32865728590235 160.61915823884402 161.16564193509709 161.50226007178344 161.57778560357167 161.8213130367749 162.3586428305209 162.52298632062784 162.64053834731902 162.91305880602175 163.32198812923 163.48175465132286 163.86999914661897 163.88557091164967 163.98431465728044 164.0342364804989 164.18703024209697 164.1939109828153 164.61436753150335 164.6653386454184 164.8344062608476 164.8668322939034 164.92760566904423 165.48263989344804 165.58735484348603 165.59355613946664 165.8292292937101 165.89507057409355 165.96333885172814 166.08326930845206 166.41376543684697 166.46910105782996 166.64460377956925 166.7919858072889 166.8039343000745 167.07735696157613 167.2574314230046 167.30617861913686 167.4224732692265 167.54295950863633 168.37124662384264 168.66766747346722 168.68262796356237 168.887118193891 169.28667170812366 169.3471633393467 169.355218473747 169.47234178224141 169.47943643832616 169.5920907189606 170.07687764084403 170.29033029546446 172.4425778698425 174.05268827424516

Current
Mean: 165.826 %
Stdev: 3.586 % (2.2%)
Runs: 157.15840240384387 159.1112216774271 159.8808648389791 160.10470326999516 160.36755702657862 160.65014478611747 160.8241707612826 161.01959427758038 161.18761069670143 161.25471402120124 161.28245498101165 161.48178257921577 161.70085098366593 163.48639273869182 163.58525490374927 163.59877988680284 163.6362341979239 163.8871322640234 164.15050933713218 164.24738432922584 164.89774236387774 165.07919448305174 165.15435266230574 165.52533153520932 165.77151688328425 166.2604913829025 166.4416917467216 166.4513985915356 166.48407365368774 166.53578965205207 166.6076972573366 166.67857991746078 166.76839425958423 167.05739665592102 167.07814375023258 167.21426456466295 167.2739892279701 167.34569329189466 167.41298368004206 167.44281681296394 167.82479507900098 167.89291972727918 167.97090858870834 167.99289423675242 168.02925989672988 168.20873090452048 168.2535030219803 168.3808981033784 168.54283784907355 168.98968041427227 169.7130031732171 169.87055093080292 170.31059018137506 170.58361882474745 170.90842220702984 171.22693666589808 171.29901793424781 171.77413336758377 173.85390114806748
Chat opening (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 357.476 MB
Stdev: 4.267 MB (1.2%)
Runs: 349.68359375 350.5546875 351.0416666666667 351.6666666666667 351.87890625 351.9072265625 352.1106770833333 352.2119140625 352.9228515625 353.169921875 353.2239583333333 353.3580729166667 353.78515625 354.0768229166667 354.0963541666667 354.1494140625 354.2265625 354.43359375 354.72265625 355.2412109375 355.4169921875 355.4309895833333 355.7744140625 355.9544270833333 355.9638671875 356.2265625 356.6357421875 356.7392578125 356.9072265625 356.9765625 356.9833984375 356.986328125 357.4322916666667 357.4947916666667 357.5442708333333 357.6770833333333 358.1875 358.2265625 358.296875 358.34765625 358.4970703125 359.29296875 360.4869791666667 360.6080729166667 360.689453125 360.962890625 361.1494140625 361.51953125 362.1513671875 362.173828125 362.294921875 362.826171875 363.1064453125 363.5185546875 363.8447265625 363.8857421875 365.06640625 365.5068359375 365.9814453125 367.3486328125

Current
Mean: 357.600 MB
Stdev: 4.648 MB (1.3%)
Runs: 347.2330729166667 347.4557291666667 349.2486979166667 350.6184895833333 350.7216796875 351.5638020833333 352.3424479166667 352.6575520833333 353.203125 353.3684895833333 353.427734375 353.9970703125 354.0221354166667 354.0859375 354.2916666666667 354.853515625 354.85546875 354.916015625 355.24609375 355.2799479166667 355.3255208333333 355.61328125 355.8815104166667 356.0068359375 356.0849609375 356.5732421875 356.57421875 356.7708333333333 356.9775390625 357.044921875 357.5322265625 357.6025390625 357.884765625 358.4248046875 358.6494140625 358.7903645833333 358.8372395833333 358.982421875 359.09375 359.5205078125 359.5498046875 360.1240234375 360.234375 360.2705078125 360.3645833333333 360.3984375 360.6380208333333 360.76171875 361.1002604166667 361.16796875 361.79296875 362.4622395833333 363.31640625 364.724609375 365.294921875 365.568359375 365.9462890625 366.4013671875 366.640625 367.6796875
Chat opening (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Chat opening (CPU/UI) Baseline
Mean: 33.650 %
Stdev: 1.576 % (4.7%)
Runs: 30.4 30.5 30.9 31 31.4 31.5 31.8 31.8 31.9 31.9 32.2 32.2 32.3 32.4 32.5 32.5 32.5 32.8 32.9 32.9 32.9 33 33 33 33.1 33.1 33.4 33.5 33.7 33.8 33.8 33.9 33.9 33.9 34 34 34.2 34.4 34.4 34.4 34.5 34.5 34.5 34.7 34.8 34.8 34.9 34.9 35.1 35.1 35.1 35.2 35.2 35.4 35.5 35.9 35.9 36.6 37.1 37.6

Current
Mean: 33.898 %
Stdev: 1.930 % (5.7%)
Runs: 29.2 30.5 30.5 31.4 31.8 31.8 31.8 31.8 32.2 32.2 32.3 32.5 32.5 32.7 32.7 32.8 32.8 32.9 32.9 32.9 33.1 33.2 33.3 33.3 33.3 33.3 33.7 33.8 33.8 33.8 33.8 33.8 33.9 33.9 33.9 33.9 34.2 34.3 34.3 34.4 34.6 34.7 34.7 34.8 35.1 35.2 35.2 35.4 35.7 36 36 36.3 37.3 37.4 37.8 37.9 38.1 38.7

⚠️ Some tests did not pass successfully, so some results are omitted from final report: Linking

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

Copy link
Contributor

🚀 Deployed to staging by https://github.com/Julesssss in version: 9.0.89-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to production by https://github.com/yuwenmemon in version: 9.0.89-8 🚀

platform result
🤖 android 🤖 true ❌
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DeployBlockerCash This issue or pull request should block deployment Ready To Build
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants