[Perf] Changes at 2/8/2022 9:06:59 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	75589aeb707aad7247a7215ff42bb92d94eb6e22
Compare	205f70e04b5f57b54a97967c1e2c3f198519540d
Diff	Diff

Improvements in System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FixedTimeEquals_256Bit_SameReference - Duration of single invocation	146.79 ns	126.42 ns	0.86	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals*'

Payloads

Baseline
Compare

Histogram

System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_SameReference

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 126.42209267663914 < 139.46453215628057.
IsChangePoint: Marked as a change because one of 1/4/2022 2:24:22 AM, 2/4/2022 6:00:25 PM, 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 5.806487926926761 (T) = (0 -129.13724929782907) / Math.Sqrt((62.30335605476493 / (299)) + (43.41835580804363 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.056278464176189286 = (136.83829858253708 - 129.13724929782907) / 136.83829858253708 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	75589aeb707aad7247a7215ff42bb92d94eb6e22
Compare	205f70e04b5f57b54a97967c1e2c3f198519540d
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Count - Duration of single invocation	2.20 ms	1.73 ms	0.79	0.00	True
Count - Duration of single invocation	343.39 μs	313.92 μs	0.91	0.00	False
Count - Duration of single invocation	117.22 μs	103.19 μs	0.88	0.01	False
Count - Duration of single invocation	169.91 μs	119.75 μs	0.70	0.01	True
Count - Duration of single invocation	69.72 μs	61.91 μs	0.89	0.04	False
Count - Duration of single invocation	23.53 ms	17.09 ms	0.73	0.00	True
Count - Duration of single invocation	70.54 ms	51.47 ms	0.73	0.01	True
Count - Duration of single invocation	279.47 μs	242.53 μs	0.87	0.00	True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)the", Options: None)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.7253120720720723 < 2.0668589913043474.
IsChangePoint: Marked as a change because one of 1/15/2022 8:21:07 PM, 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 95.80434210733675 (T) = (0 -1706843.6208674782) / Math.Sqrt((2101527128.4756129 / (299)) + (328488262.32599777 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.19556880678296942 = (2121801.8834421085 - 1706843.6208674782) / 2121801.8834421085 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: None)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 313.9151454696592 < 322.9285411121259.
IsChangePoint: Marked as a change because one of 1/15/2022 9:05:03 AM, 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 31.58844070534085 (T) = (0 -314036.84748129646) / Math.Sqrt((84114561.73293875 / (299)) + (6354193.800727405 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.06691301266241535 = (336556.8824160228 - 314036.84748129646) / 336556.8824160228 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\s+Holmes", Options: NonBacktracking)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 103.18947015834348 < 115.47961967165007.
IsChangePoint: Marked as a change because one of 1/25/2022 4:50:09 PM, 2/7/2022 9:45:37 AM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 14.869215024189934 (T) = (0 -105754.1073244255) / Math.Sqrt((20999521.772096608 / (299)) + (10587416.91735406 / (38))) is greater than 1.967070609662329 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (38) - 2, .975) and 0.07667666163507386 = (114536.37412837514 - 105754.1073244255) / 114536.37412837514 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.74941722702532 < 163.01445139650139.
IsChangePoint: Marked as a change because one of 1/15/2022 9:05:03 AM, 2/8/2022 3:28:17 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 102.31598517966306 (T) = (0 -120759.03078488672) / Math.Sqrt((19963098.96604583 / (299)) + (3463181.2594861793 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.27477360267810885 = (166512.18327245736 - 120759.03078488672) / 166512.18327245736 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\s+Holmes", Options: Compiled)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 61.91475302419355 < 69.67057249576557.
IsChangePoint: Marked as a change because one of 1/25/2022 4:50:09 PM, 2/7/2022 9:45:37 AM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 8.969580648746504 (T) = (0 -61164.96741688249) / Math.Sqrt((27308863.73945964 / (299)) + (8185363.382480198 / (38))) is greater than 1.967070609662329 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (38) - 2, .975) and 0.07511731192383181 = (66132.67629012566 - 61164.96741688249) / 66132.67629012566 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+", Options: NonBacktracking)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 17.093627564102565 < 22.051730026041668.
IsChangePoint: Marked as a change because one of 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 104.85380857085919 (T) = (0 -16968627.181563478) / Math.Sqrt((189920230027.19662 / (299)) + (83868531425.88603 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.2713086786384621 = (23286440.615016665 - 16968627.181563478) / 23286440.615016665 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{Ll}", Options: NonBacktracking)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 51.473205 < 67.05611303571426.
IsChangePoint: Marked as a change because one of 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 35.984264412682634 (T) = (0 -47769363.98907639) / Math.Sqrt((2268933513760.8853 / (299)) + (11247414713371.885 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.3251994531942473 = (70790345.70318335 - 47769363.98907639) / 70790345.70318335 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: NonBacktracking)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 242.5275848690592 < 265.71205429005494.
IsChangePoint: Marked as a change because one of 1/15/2022 9:05:03 AM, 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 94.94365136376808 (T) = (0 -241057.1991325031) / Math.Sqrt((16262960.850394115 / (299)) + (3204676.3771214155 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.13929701828627955 = (280070.1336627662 - 241057.1991325031) / 280070.1336627662 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	75589aeb707aad7247a7215ff42bb92d94eb6e22
Compare	205f70e04b5f57b54a97967c1e2c3f198519540d
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetHashCodeBenchmark - Duration of single invocation	28.81 ns	25.59 ns	0.89	0.34	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt32>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<UInt32>.GetHashCodeBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.590446005363052 < 27.350956412704864.
IsChangePoint: Marked as a change because one of 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 12.650562501439525 (T) = (0 -25.59367393295179) / Math.Sqrt((0.9715751329478317 / (47)) + (0.25977660445342265 / (28))) is greater than 1.9929971258892505 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (47) + (28) - 2, .975) and 0.07880000773152146 = (27.782972370556273 - 25.59367393295179) / 27.782972370556273 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	75589aeb707aad7247a7215ff42bb92d94eb6e22
Compare	205f70e04b5f57b54a97967c1e2c3f198519540d
Diff	Diff

Improvements in System.Tests.Perf_String

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IndexerCheckPathLength - Duration of single invocation	169.00 ns	118.10 ns	0.70	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_String*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_String.IndexerCheckPathLength

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 118.10011220785988 < 157.0121609880684.
IsChangePoint: Marked as a change because one of 12/27/2021 6:47:12 AM, 1/4/2022 2:24:22 AM, 1/18/2022 7:04:48 PM, 1/24/2022 12:53:54 PM, 1/28/2022 6:30:08 PM, 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 28.70117530949808 (T) = (0 -117.89096535568152) / Math.Sqrt((310.19776129930295 / (299)) + (0.010885486873806485 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.19872989008555728 = (147.13011741854388 - 117.89096535568152) / 147.13011741854388 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	75589aeb707aad7247a7215ff42bb92d94eb6e22
Compare	205f70e04b5f57b54a97967c1e2c3f198519540d
Diff	Diff

Improvements in System.Tests.Perf_Double

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryParse - Duration of single invocation	416.60 ns	123.46 ns	0.30	0.00	True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Double*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Double.TryParse(value: "-1.7976931348623157e+308")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 123.4562990987837 < 395.73729743927896.
IsChangePoint: Marked as a change because one of 2/8/2022 5:20:12 PM, 2/15/2022 10:28:17 AM falls between 2/6/2022 10:04:17 PM and 2/15/2022 10:28:17 AM.
IsImprovementStdDev: Marked as improvement because 1241.7070309293708 (T) = (0 -122.2885939585296) / Math.Sqrt((7.501964745373864 / (299)) + (0.8431263000809553 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.7046372870754009 = (414.0285439135565 - 122.2885939585296) / 414.0285439135565 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository