Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Perf] Linux/x64: 78 Improvements on 1/7/2023 12:45:06 AM #11442

Closed
performanceautofiler bot opened this issue Jan 10, 2023 · 3 comments
Closed

[Perf] Linux/x64: 78 Improvements on 1/7/2023 12:45:06 AM #11442

performanceautofiler bot opened this issue Jan 10, 2023 · 3 comments
Assignees
@dakersnar
Labels
arch-x64 branch-refs/heads/main kind-micro os-linux perf-improvement runtime-coreclr

Comments

@performanceautofiler
Copy link

No description provided.

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS ubuntu 18.04
Baseline c2469455eab98fdcea71997d3cc5004a992fc88f
Compare 58614a0f6da787c9d6d914b99564f066d13f69ed
Diff Diff

Improvements in System.Numerics.Tests.Perf_Matrix4x4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualityOperatorBenchmark - Duration of single invocation 4.99 ns 1.97 ns 0.40 0.34 False
CreateScaleFromScalarBenchmark - Duration of single invocation 4.93 ns 0.34 ns 0.07 0.30 False
CreateFromQuaternionBenchmark - Duration of single invocation 14.03 ns 0.29 ns 0.02 0.08 False
CreateShadowBenchmark - Duration of single invocation 25.30 ns 8.67 ns 0.34 0.07 False
CreateFromAxisAngleBenchmark - Duration of single invocation 16.83 ns 2.25 ns 0.13 0.25 False
CreateFromMatrix3x2 - Duration of single invocation 9.24 ns 5.36 ns 0.58 0.14 False
CreateConstrainedBillboardBenchmark - Duration of single invocation 21.35 ns 14.32 ns 0.67 0.03 False
CreateOrthographicBenchmark - Duration of single invocation 5.79 ns 0.41 ns 0.07 0.35 False
MultiplyByScalarOperatorBenchmark - Duration of single invocation 7.12 ns 0.40 ns 0.06 0.32 False
NegationOperatorBenchmark - Duration of single invocation 8.42 ns 0.39 ns 0.05 0.27 False
DecomposeBenchmark - Duration of single invocation 36.98 ns 31.59 ns 0.85 0.10 False
MultiplyByScalarBenchmark - Duration of single invocation 7.21 ns 0.42 ns 0.06 0.32 False
CreatePerspectiveOffCenterBenchmark - Duration of single invocation 8.81 ns 0.40 ns 0.05 0.10 False
AddBenchmark - Duration of single invocation 8.60 ns 1.91 ns 0.22 0.23 False
CreatePerspectiveBenchmark - Duration of single invocation 8.38 ns 0.32 ns 0.04 0.11 False
CreateRotationYWithCenterBenchmark - Duration of single invocation 5.58 ns 0.63 ns 0.11 0.36 False
CreateWorldBenchmark - Duration of single invocation 15.74 ns 10.89 ns 0.69 0.06 False
CreateScaleFromScalarWithCenterBenchmark - Duration of single invocation 5.13 ns 0.87 ns 0.17 0.18 False
CreateTranslationFromVectorBenchmark - Duration of single invocation 4.89 ns 0.55 ns 0.11 0.37 False
AddOperatorBenchmark - Duration of single invocation 8.84 ns 2.01 ns 0.23 0.18 False
CreateScaleFromVectorWithCenterBenchmark - Duration of single invocation 5.12 ns 0.88 ns 0.17 0.17 False
CreateOrthographicOffCenterBenchmark - Duration of single invocation 5.99 ns 0.32 ns 0.05 0.33 False
MultiplyByMatrixBenchmark - Duration of single invocation 10.04 ns 8.38 ns 0.83 0.27 False
CreateLookAtBenchmark - Duration of single invocation 21.54 ns 14.00 ns 0.65 0.03 False
TransformBenchmark - Duration of single invocation 21.07 ns 12.31 ns 0.58 0.05 False
GetDeterminantBenchmark - Duration of single invocation 6.56 ns 4.71 ns 0.72 0.22 False
InequalityOperatorBenchmark - Duration of single invocation 4.99 ns 2.05 ns 0.41 0.42 False
CreateBillboardBenchmark - Duration of single invocation 14.89 ns 12.61 ns 0.85 0.05 False
CreateRotationZWithCenterBenchmark - Duration of single invocation 5.54 ns 0.55 ns 0.10 0.33 False
CreateScaleFromVectorBenchmark - Duration of single invocation 4.90 ns 0.53 ns 0.11 0.32 False
CreateRotationXWithCenterBenchmark - Duration of single invocation 5.82 ns 0.65 ns 0.11 0.35 False
SubtractBenchmark - Duration of single invocation 9.20 ns 1.96 ns 0.21 0.22 False
CreateRotationZBenchmark - Duration of single invocation 5.61 ns 0.29 ns 0.05 0.37 False
CreatePerspectiveFieldOfViewBenchmark - Duration of single invocation 15.34 ns 0.37 ns 0.02 0.10 False
CreateRotationXBenchmark - Duration of single invocation 5.78 ns 0.29 ns 0.05 0.35 False
CreateTranslationFromScalarXYZ - Duration of single invocation 4.89 ns 0.33 ns 0.07 0.38 False
NegateBenchmark - Duration of single invocation 7.23 ns 0.40 ns 0.06 0.29 False
CreateScaleFromScalarXYZBenchmark - Duration of single invocation 5.15 ns 1.11 ns 0.22 0.19 False
IsIdentityBenchmark - Duration of single invocation 6.32 ns 1.57 ns 0.25 0.18 False
LerpBenchmark - Duration of single invocation 8.39 ns 1.07 ns 0.13 0.28 False
CreateReflectionBenchmark - Duration of single invocation 11.74 ns 6.86 ns 0.58 0.08 False
CreateScaleFromScalarXYZWithCenterBenchmark - Duration of single invocation 5.52 ns 1.11 ns 0.20 0.24 False
InvertBenchmark - Duration of single invocation 16.56 ns 13.74 ns 0.83 0.17 False
SubtractOperatorBenchmark - Duration of single invocation 8.60 ns 1.97 ns 0.23 0.25 False
CreateRotationYBenchmark - Duration of single invocation 5.64 ns 0.29 ns 0.05 0.39 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Matrix4x4.EqualityOperatorBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.9742163644940296 < 4.740288631688389.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 35.873196061851694 (T) = (0 -1.653480265700291) / Math.Sqrt((1.4240970915541487 / (229)) + (0.06608734473690313 / (12))) is greater than 1.9699394059167992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (229) + (12) - 2, .975) and 0.7014341633898487 = (5.538075904710098 - 1.653480265700291) / 5.538075904710098 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.337290789214924 < 4.878801900091115.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 91.5544112176851 (T) = (0 -0.3356239262814316) / Math.Sqrt((0.6941187713050422 / (230)) + (6.24776462759093E-06 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.937449459454949 = (5.365643899427284 - 0.3356239262814316) / 5.365643899427284 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateFromQuaternionBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.29286714946276166 < 13.33346894981293.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 274.12630075654914 (T) = (0 -0.2981223051317565) / Math.Sqrt((0.7376329336635428 / (299)) + (0.0005254271661089222 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9787570956536957 = (14.033971074375291 - 0.2981223051317565) / 14.033971074375291 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateShadowBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.67467201149782 < 24.09204878552763.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 228.46573513427745 (T) = (0 -8.704755332494916) / Math.Sqrt((1.2446768375021773 / (230)) + (0.0004406560444074748 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.6595515552671882 = (25.568497865591713 - 8.704755332494916) / 25.568497865591713 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateFromAxisAngleBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.25085778360613 < 15.568877582277073.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 195.6874896524411 (T) = (0 -2.2609849059495253) / Math.Sqrt((1.5995630282305502 / (299)) + (0.0016754581079664835 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.8650921349099195 = (16.759474360073998 - 2.2609849059495253) / 16.759474360073998 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateFromMatrix3x2

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.356805967984032 < 8.69702052584856.
IsChangePoint: Marked as a change because one of 10/22/2022 11:45:45 AM, 10/23/2022 8:43:59 AM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 38.508655310779005 (T) = (0 -5.251895847550454) / Math.Sqrt((1.9548267142309483 / (230)) + (0.03941989467761539 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.44319572288943065 = (9.43221175455795 - 5.251895847550454) / 9.43221175455795 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateConstrainedBillboardBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.315503621468164 < 19.948158134005027.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 184.49291153249902 (T) = (0 -14.334052653024356) / Math.Sqrt((0.4232819641325531 / (299)) + (0.006517446660638299 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.3629128188211691 = (22.49935813572864 - 14.334052653024356) / 22.49935813572864 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateOrthographicBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.4146071564897881 < 5.292054462651022.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 191.93719930672066 (T) = (0 -0.3476438184697361) / Math.Sqrt((0.16216891031656816 / (299)) + (0.002494497941658362 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9379752583028718 = (5.604921664443342 - 0.3476438184697361) / 5.604921664443342 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.MultiplyByScalarOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.40371488826128793 < 6.65352531837498.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 90.39895440435495 (T) = (0 -0.5357006521818631) / Math.Sqrt((1.5318924879910056 / (299)) + (0.00676862754431402 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9271467563436244 = (7.353147578556483 - 0.5357006521818631) / 7.353147578556483 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.NegationOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.3903994134813739 < 6.738824673814286.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 77.04523284061736 (T) = (0 -0.42621073252266006) / Math.Sqrt((2.373910255364735 / (299)) + (0.0013514299774028888 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9419312168732905 = (7.339756570972784 - 0.42621073252266006) / 7.339756570972784 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.DecomposeBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 31.58628707502176 < 35.01975720967715.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 61.64530229278074 (T) = (0 -31.60305848898936) / Math.Sqrt((1.9685793089900916 / (299)) + (0.006076536760760241 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.14107695153817704 = (36.79381819545391 - 31.60305848898936) / 36.79381819545391 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.MultiplyByScalarBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.4162686414751212 < 6.80021437647237.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 82.90151675571977 (T) = (0 -0.5398394468460164) / Math.Sqrt((1.8312112600972905 / (299)) + (0.006890910414195276 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9263013807015085 = (7.324960114375789 - 0.5398394468460164) / 7.324960114375789 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreatePerspectiveOffCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.4021459626090537 < 8.3726353338581.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 166.19884346513624 (T) = (0 -0.4395565329968196) / Math.Sqrt((0.13215335111095788 / (299)) + (0.02251401437319855 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.947929494460254 = (8.44156453716973 - 0.4395565329968196) / 8.44156453716973 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.910793616751606 < 8.186557359546182.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 8.34706331651388 (T) = (0 -2.733070741084575) / Math.Sqrt((4.4071868588099266 / (299)) + (7.1226333730243505 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.7043156879363099 = (9.243205099416551 - 2.733070741084575) / 9.243205099416551 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreatePerspectiveBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.3211615913156166 < 7.971600797593337.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 305.0680403248479 (T) = (0 -0.39825136547985407) / Math.Sqrt((0.1451641137922111 / (299)) + (0.0020805176920521713 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9516033873561098 = (8.228909911738043 - 0.39825136547985407) / 8.228909911738043 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.6324279653384574 < 5.388722761272985.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 91.87981785354366 (T) = (0 -0.5004780853608558) / Math.Sqrt((0.8892128803424582 / (299)) + (0.006262898420407484 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.915644296780875 = (5.932949003587798 - 0.5004780853608558) / 5.932949003587798 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateWorldBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.893654223804102 < 15.089658840576774.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 153.0511179751633 (T) = (0 -10.936855395139615) / Math.Sqrt((0.34472617097320396 / (299)) + (0.0051172590432323 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.3573851707738129 = (17.019301294850866 - 10.936855395139615) / 17.019301294850866 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.8702124729806562 < 4.8641442909141785.
IsChangePoint: Marked as a change because one of 12/5/2022 3:14:07 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 80.3389446258092 (T) = (0 -1.0611043395459785) / Math.Sqrt((0.47461013422288967 / (230)) + (0.01305991083712621 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.80954573263402 = (5.571439034794337 - 1.0611043395459785) / 5.571439034794337 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateTranslationFromVectorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.5474480305704251 < 4.680227579349503.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 179.23197573599293 (T) = (0 -0.5283176876392129) / Math.Sqrt((0.13291860672302422 / (299)) + (0.0018393863055633799 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.8924133670658237 = (4.910625727663106 - 0.5283176876392129) / 4.910625727663106 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.0142747125163427 < 8.287527529421167.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 68.24577073351405 (T) = (0 -2.011899303614204) / Math.Sqrt((2.3110319479735804 / (229)) + (0.006470124045148463 / (12))) is greater than 1.9699394059167992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (229) + (12) - 2, .975) and 0.7776539490604859 = (9.048504774935312 - 2.011899303614204) / 9.048504774935312 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromVectorWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.8820899515144003 < 4.8682131474632016.
IsChangePoint: Marked as a change because one of 12/5/2022 3:14:07 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 52.98880564586759 (T) = (0 -0.8995663092190336) / Math.Sqrt((2.337015457641563 / (228)) + (0.0020007519153244766 / (12))) is greater than 1.9699815295298084 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (228) + (12) - 2, .975) and 0.8573870769811529 = (6.307747504061401 - 0.8995663092190336) / 6.307747504061401 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateOrthographicOffCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.32396842515583374 < 5.504520033360885.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 125.40714976712155 (T) = (0 -0.3301178235445618) / Math.Sqrt((0.5894904314900846 / (299)) + (2.2748678292094166E-05 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9440585008409257 = (5.901125792246724 - 0.3301178235445618) / 5.901125792246724 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.MultiplyByMatrixBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.380869693412718 < 9.477599697135528.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 21.88646372441308 (T) = (0 -8.48822654154776) / Math.Sqrt((1.7272626470687087 / (299)) + (0.013889349313905648 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.1767602222507122 = (10.310758506779532 - 8.48822654154776) / 10.310758506779532 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateLookAtBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.002442152626 < 20.53833366981695.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 151.70780793746394 (T) = (0 -14.080890166740517) / Math.Sqrt((0.7649121972450824 / (299)) + (0.01677088097009963 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.4039225654141256 = (23.622585506064716 - 14.080890166740517) / 23.622585506064716 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.TransformBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.311249370148536 < 20.022583908826768.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 128.73834355380197 (T) = (0 -12.158775647276405) / Math.Sqrt((1.0006668058983033 / (299)) + (0.021652195106898555 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.4317915390434779 = (21.39844173880889 - 12.158775647276405) / 21.39844173880889 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.GetDeterminantBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.712326750577148 < 6.0631405352509065.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 11/16/2022 11:33:39 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 21.533338965170575 (T) = (0 -4.7435299534885225) / Math.Sqrt((2.844539286861446 / (299)) + (0.014065134845501424 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.3193831309174956 = (6.969456927923295 - 4.7435299534885225) / 6.969456927923295 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.InequalityOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.0500569775173547 < 4.743718111476411.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 30.371605233004683 (T) = (0 -1.6542574681098765) / Math.Sqrt((3.1892920396421336 / (230)) + (0.05658846333755919 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.7145079840304239 = (5.794408864611349 - 1.6542574681098765) / 5.794408864611349 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateBillboardBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.611692250681555 < 14.426083977748267.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 103.13493831985659 (T) = (0 -12.483258739923839) / Math.Sqrt((0.4356923581933677 / (299)) + (0.003707435372176156 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.25772323269012803 = (16.817525874028277 - 12.483258739923839) / 16.817525874028277 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.5501937389023451 < 5.376110827444433.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 192.62314771293813 (T) = (0 -0.5629753483229339) / Math.Sqrt((0.16827359142335815 / (230)) + (0.00019359637602665633 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.9034394741463714 = (5.830284615230043 - 0.5629753483229339) / 5.830284615230043 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromVectorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.5343501408345367 < 4.650668865530696.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 82.83173208612851 (T) = (0 -0.42334058795142426) / Math.Sqrt((0.7435815433584345 / (230)) + (0.004335427201131648 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.9214475532932874 = (5.389273099691346 - 0.42334058795142426) / 5.389273099691346 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationXWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.6456936679583672 < 5.5238524407992795.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 94.1226362101215 (T) = (0 -0.569528334234089) / Math.Sqrt((0.9305853914127973 / (299)) + (0.0021370633845618223 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9045792989406685 = (5.968603541069801 - 0.569528334234089) / 5.968603541069801 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.9576804293719603 < 8.395643058016084.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 53.82472158794576 (T) = (0 -1.9990163564066037) / Math.Sqrt((5.57677046775702 / (299)) + (0.0023385687071729305 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.7870707097874554 = (9.388169915051138 - 1.9990163564066037) / 9.388169915051138 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.2896358229586875 < 5.47113301974182.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 96.49152336887202 (T) = (0 -0.31874302047763087) / Math.Sqrt((0.8654880755198843 / (299)) + (0.0026420809021177587 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9441189712958222 = (5.703957637662468 - 0.31874302047763087) / 5.703957637662468 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreatePerspectiveFieldOfViewBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.37385126187804557 < 14.935909156949789.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 259.34478241872205 (T) = (0 -0.3923852454031049) / Math.Sqrt((0.9128933915203593 / (299)) + (0.0025152377453797037 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.974195883621612 = (15.206304282976525 - 0.3923852454031049) / 15.206304282976525 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationXBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.2909980172833278 < 5.297081140501534.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 101.03835821425088 (T) = (0 -0.3005001801528817) / Math.Sqrt((0.8432234717158016 / (299)) + (0.0006066926156091827 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9474101021214077 = (5.7140285924610295 - 0.3005001801528817) / 5.7140285924610295 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateTranslationFromScalarXYZ

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.3277359814431696 < 4.647130518899783.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 113.99542091813352 (T) = (0 -0.32134156180683193) / Math.Sqrt((0.5523119315100133 / (299)) + (2.4667660315485703E-05 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9384813222218211 = (5.223479655487875 - 0.32134156180683193) / 5.223479655487875 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.40109662524149325 < 6.809959222111765.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 113.72999101189711 (T) = (0 -0.4176069193641346) / Math.Sqrt((1.0438792753412964 / (299)) + (0.0010999088586473825 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.942201134044976 = (7.2251749660468025 - 0.4176069193641346) / 7.2251749660468025 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarXYZBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1122505644724934 < 5.105087885190315.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 64.48644937760837 (T) = (0 -0.8210489122674095) / Math.Sqrt((0.722343198876267 / (229)) + (0.03061392945202573 / (12))) is greater than 1.9699394059167992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (229) + (12) - 2, .975) and 0.8557542987964004 = (5.692016506672299 - 0.8210489122674095) / 5.692016506672299 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.IsIdentityBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.5695390435407346 < 5.995984112298872.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 65.09747046863842 (T) = (0 -1.5719538583063877) / Math.Sqrt((1.3465711633679314 / (230)) + (4.422889380961163E-06 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.7601202546459397 = (6.553091241556046 - 1.5719538583063877) / 6.553091241556046 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.LerpBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.068083908307362 < 7.9732419526458225.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 77.64599303930926 (T) = (0 -1.091771237033836) / Math.Sqrt((2.860374890194014 / (299)) + (0.0017082503676997733 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.8751190000829043 = (8.742492755171936 - 1.091771237033836) / 8.742492755171936 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateReflectionBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.8595282376078375 < 11.160235634520015.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 116.51350147170277 (T) = (0 -6.854108978680888) / Math.Sqrt((0.5792364370367635 / (299)) + (7.803696021832794E-05 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.42839326956900076 = (11.990952194549559 - 6.854108978680888) / 11.990952194549559 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarXYZWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.111056984143516 < 5.2369128701174015.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 58.88507786579657 (T) = (0 -0.9285871185181462) / Math.Sqrt((1.3662979767588441 / (229)) + (0.012439871675739261 / (12))) is greater than 1.9699394059167992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (229) + (12) - 2, .975) and 0.8414387248083437 = (5.856329784152807 - 0.9285871185181462) / 5.856329784152807 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.InvertBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.73926758545756 < 15.711975647455988.
IsChangePoint: Marked as a change because one of 10/31/2022 4:38:04 PM, 11/1/2022 6:58:35 AM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 8.735743225765466 (T) = (0 -14.192132215323655) / Math.Sqrt((4.395286552570402 / (299)) + (1.3634716295768137 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.18066201876734822 = (17.321462620312467 - 14.192132215323655) / 17.321462620312467 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.SubtractOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.9702640969984442 < 8.388815387700387.
IsChangePoint: Marked as a change because one of 1/5/2023 6:34:45 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 60.35309375532164 (T) = (0 -1.9724808669252691) / Math.Sqrt((4.314038869352175 / (299)) + (0.0012854254648006732 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.7867313249971347 = (9.248807247003192 - 1.9724808669252691) / 9.248807247003192 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.29159928574425587 < 5.396769647061664.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 138.7512568761577 (T) = (0 -0.29203272097901745) / Math.Sqrt((0.4488858854158154 / (299)) + (3.8005932520201367E-06 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9484835186987854 = (5.668724136485868 - 0.29203272097901745) / 5.668724136485868 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Jan 10, 2023 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline c2469455eab98fdcea71997d3cc5004a992fc88f
Compare 58614a0f6da787c9d6d914b99564f066d13f69ed
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector3

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
TransformNormalByMatrix4x4Benchmark - Duration of single invocation 2.76 ns 1.68 ns 0.61 0.29 False
TransformByMatrix4x4Benchmark - Duration of single invocation 3.42 ns 2.01 ns 0.59 0.32 False

graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector3*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector3.TransformNormalByMatrix4x4Benchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.6801239421175094 < 2.6219386702329985.
IsChangePoint: Marked as a change because one of 11/22/2022 2:20:42 AM, 12/12/2022 8:16:37 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 41.86761194280721 (T) = (0 -1.6986859670524332) / Math.Sqrt((0.44948210640923836 / (299)) + (8.399666881766995E-05 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.4892338861902222 = (3.325760893537011 - 1.6986859670524332) / 3.325760893537011 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector3.TransformByMatrix4x4Benchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.0081140265705404 < 3.278392627282861.
IsChangePoint: Marked as a change because one of 11/8/2022 8:08:56 PM, 11/9/2022 12:33:05 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 28.16752306962137 (T) = (0 -2.0429269621443304) / Math.Sqrt((1.488363301423786 / (299)) + (0.006629355733990202 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.5062559126362631 = (4.137623142086002 - 2.0429269621443304) / 4.137623142086002 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline c2469455eab98fdcea71997d3cc5004a992fc88f
Compare 58614a0f6da787c9d6d914b99564f066d13f69ed
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
TransformByMatrix4x4Benchmark - Duration of single invocation 5.22 ns 2.46 ns 0.47 0.31 False
TransformVector3ByMatrix4x4Benchmark - Duration of single invocation 4.45 ns 2.46 ns 0.55 0.26 False

graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector4*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector4.TransformByMatrix4x4Benchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.462540503227741 < 4.198821477172816.
IsChangePoint: Marked as a change because one of 11/22/2022 2:20:42 AM, 12/5/2022 8:20:45 AM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 45.865798562235014 (T) = (0 -2.5002750425747453) / Math.Sqrt((0.6520940004870481 / (299)) + (0.0031370724573228943 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.4754994977410541 = (4.766964057815829 - 2.5002750425747453) / 4.766964057815829 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector4.TransformVector3ByMatrix4x4Benchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.4643110302679796 < 4.214926496862531.
IsChangePoint: Marked as a change because one of 11/21/2022 9:59:44 PM, 12/5/2022 8:20:45 AM, 1/6/2023 5:32:27 AM, 1/7/2023 12:45:06 AM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 45.7774170297921 (T) = (0 -2.4782807720261304) / Math.Sqrt((0.733391368394459 / (299)) + (8.697841625295586E-05 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.4781577554831376 = (4.749099556553914 - 2.4782807720261304) / 4.749099556553914 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline c2469455eab98fdcea71997d3cc5004a992fc88f
Compare 58614a0f6da787c9d6d914b99564f066d13f69ed
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
TransformByMatrix3x2Benchmark - Duration of single invocation 1.77 ns 0.72 ns 0.40 0.23 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector2*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.715753339028385 < 1.6842688357391247.
IsChangePoint: Marked as a change because one of 11/19/2022 12:25:45 PM, 11/20/2022 2:44:51 AM, 12/5/2022 8:20:45 AM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 31.56898386747813 (T) = (0 -0.7008868766538795) / Math.Sqrt((0.4538159223813741 / (299)) + (0.0007785901832459108 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.6418172381258167 = (1.9567856168915128 - 0.7008868766538795) / 1.9567856168915128 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Jan 10, 2023 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline c2469455eab98fdcea71997d3cc5004a992fc88f
Compare 58614a0f6da787c9d6d914b99564f066d13f69ed
Diff Diff

Improvements in System.Numerics.Tests.Perf_Matrix3x2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
CreateRotationBenchmark - Duration of single invocation 15.71 ns 12.61 ns 0.80 0.01 False
InvertBenchmark - Duration of single invocation 4.15 ns 0.99 ns 0.24 0.19 False
SubtractBenchmark - Duration of single invocation 6.66 ns 0.97 ns 0.15 0.11 False
AddOperatorBenchmark - Duration of single invocation 6.66 ns 0.95 ns 0.14 0.07 False
NegationOperatorBenchmark - Duration of single invocation 5.93 ns 0.35 ns 0.06 0.10 False
MultiplyByScalarBenchmark - Duration of single invocation 6.16 ns 0.33 ns 0.05 0.09 False
AddBenchmark - Duration of single invocation 6.43 ns 0.97 ns 0.15 0.10 False
CreateScaleFromVectorWithCenterBenchmark - Duration of single invocation 5.56 ns 0.38 ns 0.07 0.04 False
CreateSkewFromScalarXYBenchmark - Duration of single invocation 5.12 ns 0.32 ns 0.06 0.39 False
EqualityOperatorBenchmark - Duration of single invocation 5.70 ns 1.22 ns 0.21 0.11 False
CreateScaleFromScalarWithCenterBenchmark - Duration of single invocation 5.35 ns 0.27 ns 0.05 0.06 False
CreateScaleFromScalarXYWithCenterBenchmark - Duration of single invocation 5.56 ns 0.30 ns 0.05 0.06 False
CreateScaleFromScalarXYBenchmark - Duration of single invocation 5.13 ns 0.09 ns 0.02 0.41 False
CreateSkewFromScalarXYWithCenterBenchmark - Duration of single invocation 5.55 ns 0.56 ns 0.10 0.05 False
NegateBenchmark - Duration of single invocation 5.55 ns 0.33 ns 0.06 0.11 False
CreateScaleFromVectorBenchmark - Duration of single invocation 5.13 ns 0.27 ns 0.05 0.11 False
LerpBenchmark - Duration of single invocation 7.76 ns 1.00 ns 0.13 0.05 False
MultiplyByMatrixOperatorBenchmark - Duration of single invocation 8.40 ns 3.02 ns 0.36 0.07 False
CreateTranslationFromScalarXY - Duration of single invocation 4.46 ns 0.11 ns 0.02 0.12 False
CreateScaleFromScalarBenchmark - Duration of single invocation 5.14 ns 0.26 ns 0.05 0.37 False
SubtractOperatorBenchmark - Duration of single invocation 6.44 ns 0.96 ns 0.15 0.10 False
InequalityOperatorBenchmark - Duration of single invocation 5.72 ns 1.23 ns 0.21 0.09 False
MultiplyByScalarOperatorBenchmark - Duration of single invocation 5.55 ns 0.33 ns 0.06 0.05 False
EqualsBenchmark - Duration of single invocation 8.57 ns 3.81 ns 0.44 0.05 False
IsIdentityBenchmark - Duration of single invocation 5.25 ns 0.82 ns 0.16 0.30 False
MultiplyByMatrixBenchmark - Duration of single invocation 8.40 ns 2.37 ns 0.28 0.08 False
CreateRotationWithCenterBenchmark - Duration of single invocation 15.22 ns 12.83 ns 0.84 0.01 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Matrix3x2.CreateRotationBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.60919003533974 < 15.015903227075736.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 88.07709045890824 (T) = (0 -12.262039767843598) / Math.Sqrt((0.028263350236082622 / (299)) + (0.018813558230909463 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.22652018253400047 = (15.853083029387008 - 12.262039767843598) / 15.853083029387008 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.InvertBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.990780456009416 < 3.9423003583196774.
IsChangePoint: Marked as a change because one of 11/16/2022 6:51:59 PM, 11/17/2022 12:32:52 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 54.34483159186078 (T) = (0 -0.9827309087498715) / Math.Sqrt((1.1832848415936281 / (299)) + (3.224267839340909E-05 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.7767860432914684 = (4.402640960453482 - 0.9827309087498715) / 4.402640960453482 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.9745579705264387 < 6.116634519787774.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 104.03869881463105 (T) = (0 -1.0206234886141976) / Math.Sqrt((0.4896290768068936 / (299)) + (0.014490642704725403 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.8446540119974297 = (6.570002236538678 - 1.0206234886141976) / 6.570002236538678 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.9457730403030572 < 6.223341654600402.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 146.51094097097894 (T) = (0 -0.9825447634453802) / Math.Sqrt((0.3259909782799993 / (228)) + (0.00017332590341067827 / (12))) is greater than 1.9699815295298084 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (228) + (12) - 2, .975) and 0.8500023629652574 = (6.550401612112084 - 0.9825447634453802) / 6.550401612112084 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.3451814342548507 < 5.292741984074705.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 133.6606581215973 (T) = (0 -0.2876861182383719) / Math.Sqrt((0.4607221684007861 / (299)) + (0.0011137821055648386 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9494410301241616 = (5.690110359148237 - 0.2876861182383719) / 5.690110359148237 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.3265857608375166 < 5.281835098932697.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 180.80345520051645 (T) = (0 -0.31289370793401433) / Math.Sqrt((0.2570774735284569 / (299)) + (0.00018599982666599987 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9447381573046241 = (5.662020893128772 - 0.31289370793401433) / 5.662020893128772 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.9736388791677475 < 6.128266942826033.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 190.93841552531123 (T) = (0 -0.9818748110200252) / Math.Sqrt((0.25132900351378884 / (299)) + (6.898812626873211E-05 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.8497871341429287 = (6.536556009485141 - 0.9818748110200252) / 6.536556009485141 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromVectorWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.37611304561825215 < 5.2811454884171845.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 300.4536923068019 (T) = (0 -0.46906189881709043) / Math.Sqrt((0.01025405763232492 / (299)) + (0.003239628145429842 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9178514211907419 = (5.709921043262493 - 0.46906189881709043) / 5.709921043262493 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateSkewFromScalarXYBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.3238392052305236 < 4.868059058177228.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 149.37210188095904 (T) = (0 -0.2902665143159147) / Math.Sqrt((0.32464819077476137 / (299)) + (0.0003811283061586644 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9450640027132079 = (5.283721578778033 - 0.2902665143159147) / 5.283721578778033 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.EqualityOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.223327986298061 < 5.4099561436456325.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 108.61542576247567 (T) = (0 -1.2166232787683149) / Math.Sqrt((0.375639138404305 / (230)) + (2.5883451635151735E-05 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.783094449367036 = (5.609000208699221 - 1.2166232787683149) / 5.609000208699221 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.2661988260188057 < 5.0845357063383.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 161.87835464451524 (T) = (0 -0.2882846282159625) / Math.Sqrt((0.29867223854516084 / (299)) + (0.00016447977293396337 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9470016630164777 = (5.439503286784138 - 0.2882846282159625) / 5.439503286784138 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.2976965388250983 < 5.278347338792097.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 238.599994394533 (T) = (0 -0.27412923632262376) / Math.Sqrt((0.1344431330796495 / (299)) + (0.00019374305544022852 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9494564322166282 = (5.42362259620321 - 0.27412923632262376) / 5.42362259620321 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.08533784879855584 < 5.0492366880857835.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 130.35959682892917 (T) = (0 -0.2178637268788942) / Math.Sqrt((0.2911509483575189 / (299)) + (0.0063105850307113125 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.958628612034407 = (5.2660482906709145 - 0.2178637268788942) / 5.2660482906709145 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateSkewFromScalarXYWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.5584303795094775 < 5.2764457671784.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 154.7225525672645 (T) = (0 -0.5625765973693937) / Math.Sqrt((0.2977304420818314 / (299)) + (9.325422274639944E-06 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.8967150444734668 = (5.446839711567405 - 0.5625765973693937) / 5.446839711567405 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.3271999615465305 < 5.275762211317182.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 99.83172124511586 (T) = (0 -0.31644688072379223) / Math.Sqrt((0.8827254195420912 / (299)) + (3.1056265618877407E-05 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.944900118121436 = (5.743149893156178 - 0.31644688072379223) / 5.743149893156178 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromVectorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.2660178837924037 < 4.878987584202312.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 741.8062908078207 (T) = (0 -0.2880647021674933) / Math.Sqrt((0.008501428769380471 / (299)) + (0.00017511312182318564 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9441070364495254 = (5.153863453802273 - 0.2880647021674933) / 5.153863453802273 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.LerpBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.9951543369661856 < 7.375046616960992.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 205.0302342335792 (T) = (0 -1.0037873287349148) / Math.Sqrt((0.3299424667172524 / (299)) + (2.1321052559277166E-05 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.871640418151757 = (7.820119965190227 - 1.0037873287349148) / 7.820119965190227 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.0158879634210605 < 7.977613176065338.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 59.97572345742399 (T) = (0 -2.447992132406653) / Math.Sqrt((1.7253995848876862 / (229)) + (0.03267500275277837 / (12))) is greater than 1.9699394059167992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (229) + (12) - 2, .975) and 0.7127533980073545 = (8.52226663579237 - 2.447992132406653) / 8.52226663579237 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateTranslationFromScalarXY

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.10861443893716123 < 4.236565269345336.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 149.22549076038186 (T) = (0 -0.21812817906943557) / Math.Sqrt((0.14385202956113582 / (299)) + (0.004306170599262358 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9519857219478541 = (4.542985710053533 - 0.21812817906943557) / 4.542985710053533 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.25541826657524175 < 4.877568596978968.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 169.06669378526306 (T) = (0 -0.14322957886519969) / Math.Sqrt((0.1605105342375486 / (299)) + (0.0045132404302879355 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.9727261158353578 = (5.251528458527467 - 0.14322957886519969) / 5.251528458527467 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.SubtractOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.9584386506467203 < 6.121167505798675.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 447.6359228167208 (T) = (0 -0.9678409966162279) / Math.Sqrt((0.018700139200196603 / (230)) + (0.0008558633047716534 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.8510563872799167 = (6.498036263126881 - 0.9678409966162279) / 6.498036263126881 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.InequalityOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.2252823031205924 < 5.4217315704308495.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 117.18798595848963 (T) = (0 -1.2103370229792458) / Math.Sqrt((0.323340053508086 / (230)) + (0.0003132232734869625 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.785584761148821 = (5.6448274360728385 - 1.2103370229792458) / 5.6448274360728385 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.32767818050874364 < 5.276339265912638.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 652.5023781091514 (T) = (0 -0.31575463747325566) / Math.Sqrt((0.014309835060243747 / (229)) + (4.4173747134512866E-05 / (12))) is greater than 1.9699394059167992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (229) + (12) - 2, .975) and 0.9438509878630394 = (5.623511891946675 - 0.31575463747325566) / 5.623511891946675 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.EqualsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.8129107125714476 < 8.098581773957909.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 12.209113975645886 (T) = (0 -4.029295629874411) / Math.Sqrt((1.2408549978317094 / (299)) + (1.5344447381920574 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.5240294178004352 = (8.465429966814648 - 4.029295629874411) / 8.465429966814648 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.IsIdentityBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.8206435194243158 < 5.149492730880751.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 57.15340436405857 (T) = (0 -0.7963678924167682) / Math.Sqrt((1.629663353162681 / (230)) + (0.00031450279268937955 / (12))) is greater than 1.9698976350765727 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (230) + (12) - 2, .975) and 0.8582007957881838 = (5.616166161462888 - 0.7963678924167682) / 5.616166161462888 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.370396651867136 < 7.976356069577843.
IsChangePoint: Marked as a change because one of 11/12/2022 3:22:24 AM, 11/13/2022 1:28:42 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 95.07286267142102 (T) = (0 -2.397378376083012) / Math.Sqrt((1.2100724605819537 / (299)) + (0.0005541379114245088 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.7172900739381546 = (8.479993643939347 - 2.397378376083012) / 8.479993643939347 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Matrix3x2.CreateRotationWithCenterBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.827915421160482 < 14.705078201457097.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 80.34061406927906 (T) = (0 -12.706187961302412) / Math.Sqrt((0.023402651745494434 / (299)) + (0.013191142276653849 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17828923861524987 = (15.463090613405008 - 12.706187961302412) / 15.463090613405008 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline c2469455eab98fdcea71997d3cc5004a992fc88f
Compare 58614a0f6da787c9d6d914b99564f066d13f69ed
Diff Diff

Improvements in System.Numerics.Tests.Perf_Quaternion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
CreateFromRotationMatrixBenchmark - Duration of single invocation 8.29 ns 7.08 ns 0.85 0.16 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.080732045474673 < 7.83265036914063.
IsChangePoint: Marked as a change because one of 11/15/2022 2:18:08 PM, 11/15/2022 10:02:59 PM, 1/6/2023 6:58:01 PM, 1/9/2023 6:56:09 PM falls between 1/1/2023 3:57:25 AM and 1/9/2023 6:56:09 PM.
IsImprovementStdDev: Marked as improvement because 12.608011043741847 (T) = (0 -7.091760649035476) / Math.Sqrt((4.479241004628388 / (299)) + (0.0009240447962159293 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.17908886908336702 = (8.638889621482882 - 7.091760649035476) / 8.638889621482882 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@EgorBo EgorBo mentioned this issue Jan 10, 2023
Merged
@EgorBo EgorBo removed the untriaged label Jan 10, 2023
@EgorBo EgorBo closed this as completed Jan 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dakersnar dakersnar

Labels
arch-x64 branch-refs/heads/main kind-micro os-linux perf-improvement runtime-coreclr
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@EgorBo @dakersnar