[Perf] Changes at 4/10/2022 3:30:35 PM #4623
Description
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | 93c7c896c70737fb7b81480d11bba108fb0f7660 |
| Compare | 4e61fb11116393b9babdb029412eb37274cddf73 |
| Diff | Diff |
Improvements in StoreBlock.AnyLocation
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| CopyBlock128 - Duration of single invocation | 11.28 ns | 8.38 ns | 0.74 | 0.02 | False | |||||
| InitBlockAllOnes128 - Duration of single invocation | 9.03 ns | 6.79 ns | 0.75 | 0.02 | True | |||||
| InitBlockAllZeros128 - Duration of single invocation | 9.03 ns | 6.80 ns | 0.75 | 0.01 | True |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'StoreBlock.AnyLocation*'Payloads
Histogram
StoreBlock.AnyLocation.CopyBlock128
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.376811265488103 < 10.713009012857508.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/10/2022 4:58:35 AM, 4/14/2022 3:36:10 AM falls between 4/5/2022 1:54:35 PM and 4/14/2022 3:36:10 AM.
IsImprovementStdDev: Marked as improvement because 14.167087573509841 (T) = (0 -8.37125978466976) / Math.Sqrt((0.7642319967750785 / (299)) + (0.00012893871723342027 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.07895650541696003 = (9.088886500913253 - 8.37125978466976) / 9.088886500913253 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### StoreBlock.AnyLocation.InitBlockAllOnes128
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.793687011472721 < 8.578330688549483.
IsChangePoint: Marked as a change because one of 4/10/2022 4:58:35 AM, 4/14/2022 3:36:10 AM falls between 4/5/2022 1:54:35 PM and 4/14/2022 3:36:10 AM.
IsImprovementStdDev: Marked as improvement because 618.9381518022846 (T) = (0 -6.798299298100236) / Math.Sqrt((0.0038047218552246386 / (299)) + (4.5864361487459236E-06 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.24768990353188655 = (9.036565280748404 - 6.798299298100236) / 9.036565280748404 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### StoreBlock.AnyLocation.InitBlockAllZeros128
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.797049203990237 < 8.578679377119562.
IsChangePoint: Marked as a change because one of 4/10/2022 4:58:35 AM, 4/14/2022 3:36:10 AM falls between 4/5/2022 1:54:35 PM and 4/14/2022 3:36:10 AM.
IsImprovementStdDev: Marked as improvement because 502.3287154829973 (T) = (0 -6.793169498219718) / Math.Sqrt((0.0011288455034477304 / (299)) + (0.00020966795683831919 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.24806386209658648 = (9.034237291960428 - 6.793169498219718) / 9.034237291960428 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | 93c7c896c70737fb7b81480d11bba108fb0f7660 |
| Compare | 4e61fb11116393b9babdb029412eb37274cddf73 |
| Diff | Diff |
Improvements in System.Memory.Span<Byte>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| Fill - Duration of single invocation | 15.65 ns | 13.17 ns | 0.84 | 0.00 | True | |||||
| Clear - Duration of single invocation | 16.28 ns | 13.98 ns | 0.86 | 0.01 | True |
_1.png)
_2.png)
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Byte>*'Payloads
Histogram
System.Memory.Span<Byte>.Fill(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.172723978026482 < 14.669254621398144.
IsChangePoint: Marked as a change because one of 4/10/2022 4:58:35 AM, 4/14/2022 3:36:10 AM falls between 4/5/2022 1:54:35 PM and 4/14/2022 3:36:10 AM.
IsImprovementStdDev: Marked as improvement because 83.13661678831572 (T) = (0 -13.26133388428917) / Math.Sqrt((0.05440710912429472 / (299)) + (0.008965416648924094 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.15617723482580695 = (15.715781123245224 - 13.26133388428917) / 15.715781123245224 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Memory.Span<Byte>.Clear(Size: 512)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.979527241050063 < 15.53280670842487.
IsChangePoint: Marked as a change because one of 3/11/2022 5:51:22 PM, 4/10/2022 4:58:35 AM, 4/14/2022 3:36:10 AM falls between 4/5/2022 1:54:35 PM and 4/14/2022 3:36:10 AM.
IsImprovementStdDev: Marked as improvement because 52.2343186927163 (T) = (0 -13.849052834765859) / Math.Sqrt((0.08744660035173131 / (299)) + (0.032797832651702934 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.16675427771964696 = (16.620610780773045 - 13.849052834765859) / 16.620610780773045 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository