Devops Performance Metrics

This widget is to provide DevOps Perforamce metrics of a release definition based on DORA 2019 Report. Widget provides 3 of 4 metrics from the report:

• Change Failure Rate As ratio of sum of all not succeeded releases to production (failed, rejected, partially succeeded) to sum of all succeeded releases.
• Deployment Frequency As ratio of time differemce between the earliest and the newest releases to total number of all releases
• Lead time for changes As time difference between release creation time and time when deployment to prod is finished

Time to Restore Service Is skipped here, because this is product/application/implementation specific and cannot be covered but simple unified metric solution so far.

DORA Performance Metrics

Configuration

• Project The name of the project.
• Release Definition The name of the release.
• Release Environment The name of the environment of the release.
• Use Commit Date For LTC (GIT supported only). When selected, uses the date of the commit to calculate LTC. Otherwise takes the creation date of the release.
• Release Time Window (days) Duration of time in days between the first relase and the last one.
• Page Size Max. number of releases to get to calculate metrics. Default (when empty) is 50.

Important note

Selecting the "Use Commit Date For LTC" checkbox may cause performance issues due to N+1 query problem. To calculate the LTC, the widget must get the commit information for every release.

Sample report

Troubleshooting

In case of issues, first check the configuration and make sure that widget has a necessary permissions to read the API data for the Artifacts (vso.code) and the Releases (vso.release).