[Perf] Changes at 7/7/2022 2:16:02 PM #6753
Description
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 889404f6900ffb39bb33a66fa9e624191cab217c |
| Compare | 79d5e091bb1d5c02a4ff992f0e055f650467bc77 |
| Diff | Diff |
Improvements in System.Text.Perf_Utf8Encoding
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| GetBytes - Duration of single invocation | 77.59 μs | 63.22 μs | 0.81 | 0.47 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Perf_Utf8Encoding*'Payloads
Histogram
System.Text.Perf_Utf8Encoding.GetBytes(Input: EnglishAllAscii)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 63.2191727660926 < 71.40381419630653.
IsChangePoint: Marked as a change because one of 5/31/2022 10:47:41 AM, 6/6/2022 8:15:49 PM, 7/7/2022 8:07:51 AM, 7/14/2022 8:56:55 AM falls between 7/5/2022 7:51:46 PM and 7/14/2022 8:56:55 AM.
IsImprovementStdDev: Marked as improvement because 17.540714388948963 (T) = (0 -65942.7673409517) / Math.Sqrt((15947001.086585244 / (299)) + (14299697.736768063 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.1622325066343994 = (78712.49226445501 - 65942.7673409517) / 78712.49226445501 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
| Architecture | arm64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 889404f6900ffb39bb33a66fa9e624191cab217c |
| Compare | 79d5e091bb1d5c02a4ff992f0e055f650467bc77 |
| Diff | Diff |
Improvements in System.Linq.Tests.Perf_Enumerable
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| SequenceEqual - Duration of single invocation | 95.89 ns | 66.21 ns | 0.69 | 0.43 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'Payloads
Histogram
System.Linq.Tests.Perf_Enumerable.SequenceEqual(input1: Array, input2: Array)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 66.21337716965883 < 98.89419872259342.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/7/2022 8:07:51 AM, 7/14/2022 8:56:55 AM falls between 7/5/2022 7:51:46 PM and 7/14/2022 8:56:55 AM.
IsImprovementStdDev: Marked as improvement because 4.204307265268534 (T) = (0 -67.78233030026233) / Math.Sqrt((148.13683025068025 / (299)) + (22.446329417320502 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.0646963804467896 = (72.47093765406531 - 67.78233030026233) / 72.47093765406531 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository