Run Information
Improvements in System.Tests.Perf_DateTime


Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTime*'
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_DateTime.ToString(format: "r")
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.981303150609804 < 41.50512604431112.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 36.29166888899447 (T) = (0 -40.16036909885626) / Math.Sqrt((1.1713405748655996 / (299)) + (0.28430136435314896 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.09468239493518969 = (44.360530353302075 - 40.16036909885626) / 44.360530353302075 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_DateTime.ToString(format: "o")
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 59.15730977836239 < 59.77765482236109.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 29.508373577093007 (T) = (0 -59.34759075045974) / Math.Sqrt((5.426373759716075 / (299)) + (0.14561656541042725 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.07012191311419305 = (63.82298022444729 - 59.34759075045974) / 63.82298022444729 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
### Run Information
Improvements in System.Buffers.Text.Tests.Utf8FormatterTests

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'
Payloads
Baseline
Compare
Histogram
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value: 12/30/2017 3:45:22 AM -08:00)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 50.44166211873143 < 52.24600541148548.
IsChangePoint: Marked as a change because one of 1/27/2022 1:01:32 PM, 3/22/2022 5:45:59 AM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 26.906643942999082 (T) = (0 -50.730207326656725) / Math.Sqrt((1.20013010048096 / (299)) + (0.2046317654603463 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.05231985899053291 = (53.53093847953699 - 50.730207326656725) / 53.53093847953699 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Text.Json.Tests.Perf_DateTimes




Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_DateTimes*'
Payloads
Baseline
Compare
Histogram
System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: False)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.200917857142858 < 6.298702244444443.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 61.24538663757575 (T) = (0 -6215026.019708995) / Math.Sqrt((11137868850.468615 / (299)) + (396984014.21865153 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06543545965579915 = (6650183.857200484 - 6215026.019708995) / 6650183.857200484 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: True)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.760618378378378 < 6.805837828492936.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 59.32769606361011 (T) = (0 -6752964.487888988) / Math.Sqrt((17141303087.163496 / (299)) + (111014244.153169 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06422491019350837 = (7216439.678134016 - 6752964.487888988) / 7216439.678134016 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: True)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.066606829268292 < 6.172669538888887.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 54.27570470128932 (T) = (0 -6078059.824731444) / Math.Sqrt((13222326302.87416 / (299)) + (271935491.6702183 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06119604707851864 = (6474258.87568647 - 6078059.824731444) / 6474258.87568647 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: False)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.88327242063492 < 6.941766328431373.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 71.62245964139169 (T) = (0 -6884174.617131325) / Math.Sqrt((20165481962.713093 / (299)) + (56545822.6957605 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.07972071097029151 = (7480527.595475519 - 6884174.617131325) / 7480527.595475519 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Numerics.Tests.Perf_BigInteger



Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 16,16,16 bits)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 97.32370073798015 < 98.13710641413958.
IsChangePoint: Marked as a change because one of 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 80.7935643254002 (T) = (0 -97.14399493813845) / Math.Sqrt((0.4618152457218907 / (299)) + (0.13237717804484092 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.060319620728387376 = (103.37982688692405 - 97.14399493813845) / 103.37982688692405 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 1024,1024 bits)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.960522781240724 < 6.99535459175428.
IsChangePoint: Marked as a change because one of 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 192.91874536294478 (T) = (0 -6950.604882326105) / Math.Sqrt((1084.350393183135 / (299)) + (72.40726726879667 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06385836689456494 = (7424.736425052552 - 6950.604882326105) / 7424.736425052552 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 16,16 bits)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 27.44411484211953 < 27.920073950714553.
IsChangePoint: Marked as a change because one of 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 27.356134350228015 (T) = (0 -27.331001016569118) / Math.Sqrt((0.08559086746722536 / (299)) + (0.12508595735090278 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06262866663288638 = (29.15706939574731 - 27.331001016569118) / 29.15706939574731 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Tests.Perf_Int32

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int32*'
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Int32.TryFormat(value: 2147483647)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.996590360669835 < 14.184456558421294.
IsChangePoint: Marked as a change because one of 1/27/2022 1:01:32 PM, 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 25.751839059322688 (T) = (0 -13.850788461708532) / Math.Sqrt((1.003672801428004 / (299)) + (0.04063770812661736 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.11317363994227758 = (15.6183770414842 - 13.850788461708532) / 15.6183770414842 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Tests.Perf_Int64

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int64*'
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Int64.TryFormat(value: 9223372036854775807)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.130310975456155 < 38.835281120363.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 39.12277141466285 (T) = (0 -37.89893552189278) / Math.Sqrt((1.6011632061682377 / (299)) + (0.06763383797157387 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.08261046640147036 = (41.31171561684528 - 37.89893552189278) / 41.31171561684528 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Tests.Perf_UInt32

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt32*'
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_UInt32.TryFormat(value: 12345)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.791014858456084 < 6.547879325030964.
IsChangePoint: Marked as a change because one of 1/27/2022 1:01:32 PM, 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 12.557364403593331 (T) = (0 -6.135752731438879) / Math.Sqrt((0.6206986597237139 / (299)) + (0.12592863743906582 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.13948991977355685 = (7.130367060690627 - 6.135752731438879) / 7.130367060690627 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Improvements in System.Tests.Perf_UInt64

Test Report
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt64*'
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.203108318814415 < 40.28763334699423.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 25.0079672195691 (T) = (0 -38.87704661735574) / Math.Sqrt((1.8492905697665656 / (299)) + (0.09421387102398832 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.0868961805122205 = (42.57680866910014 - 38.87704661735574) / 42.57680866910014 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository