[Perf] Windows/x64: 5 Improvements on 11/2/2022 4:25:40 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	bdd67af67dbf43c0f5e9151b98dc100b9555898a
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
MultiplyOperatorBenchmark - Duration of single invocation	65.56 ns	57.06 ns	0.87	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Byte>*'

Related Issues

Regressions

• [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

• [Perf] Windows/x86: 3 Improvements on 11/2/2022 4:25:40 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyOperatorBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 57.0646205350053 < 62.22800691785699.
IsChangePoint: Marked as a change because one of 8/29/2022 8:26:03 AM, 9/6/2022 1:06:44 PM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 10/11/2022 8:42:28 PM, 10/17/2022 3:19:47 PM, 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 22.23483013916855 (T) = (0 -51.997623891147924) / Math.Sqrt((13.434420614929758 / (299)) + (3.3120039857433965 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.16984805693129068 = (62.63627318504539 - 51.997623891147924) / 62.63627318504539 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	bdd67af67dbf43c0f5e9151b98dc100b9555898a
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Improvements in System.IO.Tests.Perf_FileStream

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CopyToFileAsync - Duration of single invocation	59.70 ms	52.74 ms	0.88	0.25	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_FileStream*'

Related Issues

Regressions

• [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

• [Perf] Windows/x86: 3 Improvements on 11/2/2022 4:25:40 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.IO.Tests.Perf_FileStream.CopyToFileAsync(fileSize: 104857600, options: None)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 52.7442625 < 54.288206339285715.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 11.00848345269169 (T) = (0 -54072802.16600528) / Math.Sqrt((4948160299630.963 / (299)) + (1173055410061.11 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.05499744657846666 = (57219741.86231141 - 54072802.16600528) / 57219741.86231141 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	bdd67af67dbf43c0f5e9151b98dc100b9555898a
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Improvements in System.Collections.IterateForEach<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	3.08 μs	2.91 μs	0.95	0.44	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<String>*'

Related Issues

Regressions

• [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

• [Perf] Windows/x86: 3 Improvements on 11/2/2022 4:25:40 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.IterateForEach<String>.Dictionary(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.9111980041037118 < 2.915573783570904.
IsChangePoint: Marked as a change because one of 8/29/2022 10:15:14 PM, 9/6/2022 11:34:40 PM, 9/13/2022 8:43:59 AM, 9/23/2022 1:16:35 AM, 10/19/2022 7:27:15 PM, 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 6.579993572607765 (T) = (0 -2774.6133609603276) / Math.Sqrt((67126.55637480615 / (299)) + (19262.459091102886 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.07862054596201445 = (3011.368821825214 - 2774.6133609603276) / 3011.368821825214 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	bdd67af67dbf43c0f5e9151b98dc100b9555898a
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
MultiplyOperatorBenchmark - Duration of single invocation	65.91 ns	59.27 ns	0.90	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'

Related Issues

Regressions

• [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

• [Perf] Windows/x86: 3 Improvements on 11/2/2022 4:25:40 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<SByte>.MultiplyOperatorBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 59.272855077916155 < 62.38066462402477.
IsChangePoint: Marked as a change because one of 8/29/2022 8:26:03 AM, 9/6/2022 1:06:44 PM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 16.39113351937879 (T) = (0 -52.75689997492603) / Math.Sqrt((15.140591857328621 / (299)) + (5.648636596513892 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.15793998279981575 = (62.65218499548358 - 52.75689997492603) / 62.65218499548358 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	bdd67af67dbf43c0f5e9151b98dc100b9555898a
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Improvements in System.Globalization.Tests.StringEquality

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Compare_Same_Upper - Duration of single invocation	1.77 μs	1.56 μs	0.88	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringEquality*'

Related Issues

Regressions

• [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

• [Perf] Windows/x86: 3 Improvements on 11/2/2022 4:25:40 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count: 1024, Options: (en-US, OrdinalIgnoreCase))

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.5588008109814868 < 1.6867380321028294.
IsChangePoint: Marked as a change because one of 9/29/2022 7:42:19 AM, 10/2/2022 11:57:04 PM, 10/17/2022 3:19:47 PM, 10/19/2022 7:27:15 PM, 10/31/2022 10:23:25 PM, 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 7.454846221850489 (T) = (0 -1657.423205001415) / Math.Sqrt((45718.288694118804 / (299)) + (1381.704391777979 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.06381388568952363 = (1770.3992610722999 - 1657.423205001415) / 1770.3992610722999 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository