Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common #84139

performanceautofiler · 2023-03-30T12:03:53Z

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.25094
Queue	AmpereWindows
Baseline	ed3721b092e395ac3576c2d93f4134650a44dc08
Compare	49ae58ace038dbbd3d53147e08c9ac95b24a789f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
OneNodeBacktracking - Duration of single invocation	122.40 ns	164.61 ns	1.34	0.68	False
Date_IsNotMatch - Duration of single invocation	164.35 ns	256.58 ns	1.56	0.67	False
MatchesBoundary - Duration of single invocation	90.07 μs	116.28 μs	1.29	0.68	False
Date_IsNotMatch - Duration of single invocation	160.24 ns	229.89 ns	1.43	0.69	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: IgnoreCase, Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 164.6115591853692 > 128.16264435171163.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -6.617107191652297 (T) = (0 -169.91392838270806) / Math.Sqrt((235.1909776207313 / (33)) + (209.8296589859213 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.3381171503025047 = (126.97985998034332 - 169.91392838270806) / 126.97985998034332 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 256.57922687127774 > 195.53423882709185.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -5.14570226723947 (T) = (0 -234.2572861086484) / Math.Sqrt((269.7910556531369 / (33)) + (532.7844092293163 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.2760148433465498 = (183.58507922546715 - 234.2572861086484) / 183.58507922546715 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 116.27790944881892 > 87.92231415910649.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -4.171627775620777 (T) = (0 -111451.15787095712) / Math.Sqrt((69463319.44438596 / (33)) + (197891679.8426488 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.28487498279439016 = (86740.85756465529 - 111451.15787095712) / 86740.85756465529 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 229.8900564301632 > 182.7610407500009.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -4.8847333688016406 (T) = (0 -230.51488283306733) / Math.Sqrt((270.89459443661065 / (33)) + (589.2266109272932 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.27974589353827445 = (180.12551085101265 - 230.51488283306733) / 180.12551085101265 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.25094
Queue	AmpereWindows
Baseline	ed3721b092e395ac3576c2d93f4134650a44dc08
Compare	49ae58ace038dbbd3d53147e08c9ac95b24a789f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Count - Duration of single invocation	16.39 ms	25.07 ms	1.53	0.63	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\b\w+n\b", Options: Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.0680565 > 17.877188215384614.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -6.246178639405496 (T) = (0 -23257887.666666668) / Math.Sqrt((2752841321800.5527 / (33)) + (4570841801078.966 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.327854499867642 = (17515388.673220575 - 23257887.666666668) / 17515388.673220575 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

The text was updated successfully, but these errors were encountered:

AndyAyersMS · 2023-03-30T16:26:15Z

Possibly #84003

ghost · 2023-03-30T16:27:52Z

Tagging subscribers to this area: @dotnet/area-system-text-regularexpressions
See info in area-owners.md if you want to be subscribed.

Issue Details

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.25094
Queue	AmpereWindows
Baseline	ed3721b092e395ac3576c2d93f4134650a44dc08
Compare	49ae58ace038dbbd3d53147e08c9ac95b24a789f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
OneNodeBacktracking - Duration of single invocation	122.40 ns	164.61 ns	1.34	0.68	False
Date_IsNotMatch - Duration of single invocation	164.35 ns	256.58 ns	1.56	0.67	False
MatchesBoundary - Duration of single invocation	90.07 μs	116.28 μs	1.29	0.68	False
Date_IsNotMatch - Duration of single invocation	160.24 ns	229.89 ns	1.43	0.69	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: IgnoreCase, Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 164.6115591853692 > 128.16264435171163.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -6.617107191652297 (T) = (0 -169.91392838270806) / Math.Sqrt((235.1909776207313 / (33)) + (209.8296589859213 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.3381171503025047 = (126.97985998034332 - 169.91392838270806) / 126.97985998034332 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 256.57922687127774 > 195.53423882709185.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -5.14570226723947 (T) = (0 -234.2572861086484) / Math.Sqrt((269.7910556531369 / (33)) + (532.7844092293163 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.2760148433465498 = (183.58507922546715 - 234.2572861086484) / 183.58507922546715 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 116.27790944881892 > 87.92231415910649.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -4.171627775620777 (T) = (0 -111451.15787095712) / Math.Sqrt((69463319.44438596 / (33)) + (197891679.8426488 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.28487498279439016 = (86740.85756465529 - 111451.15787095712) / 86740.85756465529 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 229.8900564301632 > 182.7610407500009.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -4.8847333688016406 (T) = (0 -230.51488283306733) / Math.Sqrt((270.89459443661065 / (33)) + (589.2266109272932 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.27974589353827445 = (180.12551085101265 - 230.51488283306733) / 180.12551085101265 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.25094
Queue	AmpereWindows
Baseline	ed3721b092e395ac3576c2d93f4134650a44dc08
Compare	49ae58ace038dbbd3d53147e08c9ac95b24a789f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Count - Duration of single invocation	16.39 ms	25.07 ms	1.53	0.63	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\b\w+n\b", Options: Compiled)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.0680565 > 17.877188215384614.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -6.246178639405496 (T) = (0 -23257887.666666668) / Math.Sqrt((2752841321800.5527 / (33)) + (4570841801078.966 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.327854499867642 = (17515388.673220575 - 23257887.666666668) / 17515388.673220575 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Author:	performanceautofiler[bot]
Assignees:	tannergooding
Labels:	`arch-arm64`, `area-System.Text.RegularExpressions`, `os-windows`, `untriaged`, `runtime-coreclr`
Milestone:	-

AndyAyersMS · 2023-03-30T16:29:25Z

Also:

[Perf] Linux/arm64: 7 Regressions on 3/28/2023 10:24:48 AM perf-autofiling-issues#14634
[Perf] Windows/arm64: 12 Regressions on 3/28/2023 10:24:48 AM perf-autofiling-issues#14638
[Perf] Windows/arm64: 5 Regressions on 3/28/2023 10:24:48 AM perf-autofiling-issues#14651
[Perf] Windows/arm64: 5 Regressions on 3/28/2023 10:24:48 AM perf-autofiling-issues#14670
[Perf] Linux/arm64: 13 Regressions on 3/28/2023 10:24:48 AM perf-autofiling-issues#14661
[Perf] Linux/arm64: 3 Regressions on 3/25/2023 7:34:08 PM perf-autofiling-issues#14605
[Perf] Linux/arm64: 5 Regressions on 3/28/2023 10:24:48 AM perf-autofiling-issues#14606
[Perf] Windows/arm64: 12 Regressions on 3/28/2023 10:24:48 AM perf-autofiling-issues#14610
[Perf] Linux/arm64: 4 Regressions on 3/28/2023 2:42:21 AM perf-autofiling-issues#14633

stephentoub · 2023-03-30T22:26:17Z

Possibly #84003

It's much more likely to be #83992. I think what's happening is we're now using IndexOfAny to search for something that in these particular benchmarks is the very next character, and we're doing that repeatedly, so whereas previously we were only doing a single comparison as part of a scalar loop, we're now paying the overhead of the vectorization (at a minimum a non-inlined method call) per operation.

EgorBo · 2023-04-04T16:21:46Z

Same on x64:

[Perf] Alpine/x64: 11 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#14853
[Perf] Alpine/x64: 11 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#14952
[Perf] Windows/x64: 15 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#14973
[Perf] Alpine/x64: 11 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#15087
[Perf] Windows/x64: 9 Regressions on 3/31/2023 4:42:28 AM perf-autofiling-issues#15116
[Perf] Windows/x64: 14 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#14870
[Perf] Linux/x64: 9 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#14961
[Perf] Windows/x64: 13 Regressions on 3/28/2023 7:07:52 AM perf-autofiling-issues#14991
[Perf] Linux/x64: 6 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#15096
[Perf] Windows/x64: 15 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#15112
[Perf] Linux/x64: 10 Regressions on 3/28/2023 7:07:52 AM perf-autofiling-issues#14861
[Perf] Linux/x64: 6 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#14862
[Perf] Windows/x64: 6 Regressions on 3/28/2023 12:51:33 PM perf-autofiling-issues#14992

performanceautofiler bot assigned tannergooding Mar 30, 2023

performanceautofiler bot added arch-arm64 os-windows runtime-coreclr specific to the CoreCLR runtime untriaged New issue has not been triaged by the area owner labels Mar 30, 2023

dotnet-issue-labeler bot added the area-System.Text.RegularExpressions label Mar 30, 2023

AndyAyersMS transferred this issue from dotnet/perf-autofiling-issues Mar 30, 2023

AndyAyersMS changed the title ~~[Perf] Windows/arm64: 5 Regressions on 3/28/2023 10:24:48 AM~~ Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common Mar 30, 2023

AndyAyersMS unassigned tannergooding Mar 30, 2023

stephentoub self-assigned this Mar 30, 2023

buyaa-n added this to the 8.0.0 milestone Mar 30, 2023

ghost removed the untriaged New issue has not been triaged by the area owner label Mar 30, 2023

This was referenced Mar 31, 2023

Avoid blocking negative char sets in regex compiler / source gen #84187

Closed

Improve IndexOfAnyValues throughput for needles with 0 #84184

Merged

stephentoub mentioned this issue Apr 5, 2023

Improve regex compiler / source generator for sets #84370

Merged

ghost added the in-pr There is an active PR which will close this issue when it is merged label Apr 5, 2023

stephentoub closed this as completed in #84370 Apr 10, 2023

ghost removed the in-pr There is an active PR which will close this issue when it is merged label Apr 10, 2023

ghost locked as resolved and limited conversation to collaborators May 10, 2023

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common #84139

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common #84139

Comments

performanceautofiler bot commented Mar 30, 2023

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Repro

Payloads

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: IgnoreCase, Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled)

Description of detection logic

Docs

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Repro

Payloads

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\b\w+n\b", Options: Compiled)

Description of detection logic

Docs

AndyAyersMS commented Mar 30, 2023

ghost commented Mar 30, 2023

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Repro

Payloads

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: IgnoreCase, Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled)

Description of detection logic

Docs

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Repro

Payloads

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\b\w+n\b", Options: Compiled)

Description of detection logic

Docs

AndyAyersMS commented Mar 30, 2023 • edited Loading

stephentoub commented Mar 30, 2023

EgorBo commented Apr 4, 2023 • edited Loading

AndyAyersMS commented Mar 30, 2023 •

edited

Loading

EgorBo commented Apr 4, 2023 •

edited

Loading