Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding a11y test packages #15040

Merged
merged 71 commits into from
Sep 16, 2020
Merged

Adding a11y test packages #15040

merged 71 commits into from
Sep 16, 2020

Conversation

kolaps33
Copy link
Contributor

@kolaps33 kolaps33 commented Sep 15, 2020

Description of changes

Adding packages in order to use them, like in this PR:
https://github.com/microsoft/fluentui/pull/14968/files#diff-59eaeeca946dbf30b4378d6fa44b8905

mituron added 30 commits April 3, 2020 14:52
@codesandbox-ci
Copy link

codesandbox-ci bot commented Sep 15, 2020

This pull request is automatically built and testable in CodeSandbox.

To see build info of the built libraries, click here or the icon next to each commit SHA.

Latest deployment of this branch, based on commit 45fa80d:

Sandbox Source
Fluent UI Button Configuration
microsoft/fluentui: codesandbox-react-template Configuration
microsoft/fluentui: codesandbox-react-next-template Configuration
microsoft/fluentui: codesandbox-react-northstar-template Configuration

@msft-github-bot
Copy link
Contributor

msft-github-bot commented Sep 15, 2020

Perf Analysis

No significant results to display.

All results

Scenario Render type Master Ticks PR Ticks Iterations Status
BaseButton mount 879 888 5000
ButtonNext mount 597 584 5000
Checkbox mount 1560 1605 5000
CheckboxBase mount 1283 1292 5000
CheckboxNext mount 1503 1517 5000
ChoiceGroup mount 4988 4992 5000
ChoiceGroupNext mount 4887 4975 5000
ComboBox mount 902 939 1000
CommandBar mount 7696 7636 1000
ContextualMenu mount 13981 14143 1000
DefaultButton mount 1132 1114 5000
DetailsRow mount 3581 3603 5000
DetailsRowFast mount 3623 3546 5000
DetailsRowNoStyles mount 3402 3381 5000
Dialog mount 1463 1470 1000
DocumentCardTitle mount 1824 1826 1000
Dropdown mount 2530 2571 5000
FocusZone mount 1801 1795 5000
IconButton mount 1739 1723 5000
Label mount 340 344 5000
Link mount 457 442 5000
LinkNext mount 470 466 5000
MenuButton mount 1482 1447 5000
MessageBar mount 2128 2073 5000
MessageBarNext mount 2042 2111 5000
Nav mount 3207 3154 1000
OverflowSet mount 1415 1388 5000
OverflowSetNext mount 1031 1074 5000
Panel mount 1497 1476 1000
Persona mount 834 820 1000
Pivot mount 1414 1434 1000
PivotNext mount 1422 1388 1000
PrimaryButton mount 1294 1244 5000
Rating mount 7676 7509 5000
RatingNext mount 7467 7570 5000
SearchBox mount 1282 1250 5000
SearchBoxNext mount 1310 1358 5000
Shimmer mount 2567 2542 5000
ShimmerNext mount 2581 2544 5000
Slider mount 1471 1489 5000
SliderNext mount 1970 1891 5000
SpinButton mount 4921 4931 5000
SpinButtonNext mount 5026 5025 5000
Spinner mount 437 433 5000
SplitButton mount 3225 3145 5000
Stack mount 544 533 5000
StackWithIntrinsicChildren mount 1942 2001 5000
StackWithTextChildren mount 5079 5044 5000
SwatchColorPicker mount 10265 10294 5000
SwatchColorPickerNext mount 10212 10278 5000
TagPicker mount 2821 2790 5000
TeachingBubble mount 51448 51020 5000
TeachingBubbleNext mount 51127 51090 5000
Text mount 437 433 5000
TextField mount 1344 1415 5000
ThemeProvider mount 4958 4951 5000
ThemeProvider virtual-rerender 563 513 5000
Toggle mount 813 825 5000
ToggleNext mount 799 796 5000
button mount 118 112 5000

Perf Analysis (Fluent)

⚠️ 5 potential perf regressions detected

Potential regressions comparing to master

Scenario Current PR Ticks Baseline Ticks Ratio Regression Analysis
ButtonOverridesMissPerf.default 1704 49 34.78:1 analysis
ButtonUseCssNestingPerf.default 1102 46 23.96:1 analysis
ButtonUseCssPerf.default 847 48 17.65:1 analysis
ChatWithPopoverPerf.default 489 454 1.08:1 analysis
ListCommonPerf.default 652 927 0.7:1 analysis
Perf comparison
Status Scenario Fluent TPI Fabric TPI Ratio Iterations Ticks
🎯 Avatar.Fluent 0.45 0.48 0.94:1 2000 896
🦄 Button.Fluent 0.11 0.19 0.58:1 5000 570
🔧 Checkbox.Fluent 0.64 0.34 1.88:1 1000 636
🎯 Dialog.Fluent 0.16 0.22 0.73:1 5000 785
🔧 Dropdown.Fluent 2.98 0.48 6.21:1 1000 2980
🔧 Icon.Fluent 0.14 0.06 2.33:1 5000 711
🦄 Image.Fluent 0.08 0.12 0.67:1 5000 407
🔧 Slider.Fluent 1.62 0.38 4.26:1 1000 1620
🔧 Text.Fluent 0.08 0.04 2:1 5000 380
🦄 Tooltip.Fluent 0.12 17.34 0.01:1 5000 591

🔧 Needs work     🎯 On target     🦄 Amazing

Perf tests with no regressions
Scenario Current PR Ticks Baseline Ticks Ratio
PortalMinimalPerf.default 169 121 1.4:1
ImageMinimalPerf.default 417 336 1.24:1
DividerMinimalPerf.default 395 327 1.21:1
FormMinimalPerf.default 462 389 1.19:1
RefMinimalPerf.default 251 211 1.19:1
HeaderMinimalPerf.default 396 336 1.18:1
LayoutMinimalPerf.default 428 363 1.18:1
StatusMinimalPerf.default 748 634 1.18:1
AnimationMinimalPerf.default 447 383 1.17:1
BoxMinimalPerf.default 394 337 1.17:1
FlexMinimalPerf.default 316 269 1.17:1
SegmentMinimalPerf.default 376 322 1.17:1
GridMinimalPerf.default 364 315 1.16:1
ReactionMinimalPerf.default 434 375 1.16:1
Image.Fluent 407 350 1.16:1
Text.Fluent 380 329 1.16:1
Tooltip.Fluent 591 509 1.16:1
TextMinimalPerf.default 367 320 1.15:1
LabelMinimalPerf.default 445 392 1.14:1
RadioGroupMinimalPerf.default 449 395 1.14:1
SkeletonMinimalPerf.default 443 388 1.14:1
AttachmentMinimalPerf.default 171 153 1.12:1
ButtonMinimalPerf.default 181 163 1.11:1
CardMinimalPerf.default 595 543 1.1:1
TableMinimalPerf.default 429 391 1.1:1
VideoMinimalPerf.default 668 608 1.1:1
CarouselMinimalPerf.default 475 434 1.09:1
TreeMinimalPerf.default 901 830 1.09:1
Button.Fluent 570 524 1.09:1
ChatMinimalPerf.default 629 582 1.08:1
PopupMinimalPerf.default 711 657 1.08:1
ProviderMinimalPerf.default 1002 930 1.08:1
AlertMinimalPerf.default 307 287 1.07:1
ListMinimalPerf.default 495 462 1.07:1
ToolbarMinimalPerf.default 976 911 1.07:1
TooltipMinimalPerf.default 841 784 1.07:1
Avatar.Fluent 896 838 1.07:1
AvatarMinimalPerf.default 491 462 1.06:1
ChatDuplicateMessagesPerf.default 430 405 1.06:1
LoaderMinimalPerf.default 765 724 1.06:1
MenuButtonMinimalPerf.default 1588 1498 1.06:1
AccordionMinimalPerf.default 157 149 1.05:1
DialogMinimalPerf.default 793 755 1.05:1
HeaderSlotsPerf.default 806 766 1.05:1
Icon.Fluent 711 674 1.05:1
DropdownManyItemsPerf.default 765 734 1.04:1
MenuMinimalPerf.default 888 851 1.04:1
IconMinimalPerf.default 685 656 1.04:1
TextAreaMinimalPerf.default 474 454 1.04:1
Dialog.Fluent 785 754 1.04:1
AttachmentSlotsPerf.default 1140 1105 1.03:1
CheckboxMinimalPerf.default 2919 2832 1.03:1
EmbedMinimalPerf.default 1949 1897 1.03:1
ItemLayoutMinimalPerf.default 1254 1223 1.03:1
SplitButtonMinimalPerf.default 3841 3712 1.03:1
CustomToolbarPrototype.default 3891 3771 1.03:1
ButtonSlotsPerf.default 610 600 1.02:1
ProviderMergeThemesPerf.default 2016 1986 1.02:1
DropdownMinimalPerf.default 2981 2951 1.01:1
InputMinimalPerf.default 1325 1327 1:1
Slider.Fluent 1620 1617 1:1
SliderMinimalPerf.default 1629 1644 0.99:1
Checkbox.Fluent 636 642 0.99:1
Dropdown.Fluent 2980 2999 0.99:1
TableManyItemsPerf.default 2163 2200 0.98:1
TreeWith60ListItems.default 198 212 0.93:1
ListWith60ListItems.default 937 1108 0.85:1
ListNestedPerf.default 594 878 0.68:1

@size-auditor
Copy link

size-auditor bot commented Sep 15, 2020

Asset size changes

Size Auditor did not detect a change in bundle size for any component!

Baseline commit: 7d093f59a06527fc39656c903cab4470650e3acd (build)

packages/a11y-testing/LICENSE Outdated Show resolved Hide resolved
packages/a11y-rules/package.json Show resolved Hide resolved
packages/a11y-rules/package.json Show resolved Hide resolved
packages/a11y-rules/tsconfig.json Outdated Show resolved Hide resolved
packages/a11y-testing/README.md Outdated Show resolved Hide resolved
packages/a11y-testing/package.json Outdated Show resolved Hide resolved
packages/a11y-testing/tsconfig.json Show resolved Hide resolved
},
"devDependencies": {
"@fluentui/eslint-plugin": "^0.54.0",
"jest": "~24.9.0",
Copy link
Contributor Author

@kolaps33 kolaps33 Sep 15, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I let 'jest' here because in the validate.ts file I use "test" keyword in order to generate tests:

 test(rule.stringify(), () => {
          validateSlot(rule, testFacade);
        });

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh I missed that--in that case you should have "jest": "^24.0.0" in peerDependencies as well (plus jest and @types/jest in devDependencies)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you :)
changes applied in the package.json file

@kolaps33 kolaps33 merged commit 52c3d89 into microsoft:master Sep 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants