Versions Compared

Version Old Version 32 New Version 33
Changes made by

Anastasia Baranouskaya

Anastasia Baranouskaya

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel1
printablefalse

...

Excerpt

SCRUM

KANBAN / SUPPORT

FIXED SCOPE / PRICE

Ensure a predictability in a delivery of the most valuable scope incrementally/iteratively via sprint-by-sprint cadence, with the quality level allowing to ship to production every iteration



Monitor the input & output flows of your service as well as a drill down your pipeline retrospectively to ensure no bottlenecks, met SLAs and acceptable “first-time-right” quality


Keep a forecasted delivery date “On Track” to meet deadlines, with a strong change management to control the scope creep, and quality on a high level to ensure a safe rollout


QUALITY

ENGINEERING / TECHNOLOGY

DEVOPS INDUSTRY METRICS

View trends on defects to sign-offs releases with a greater confidence, analyze the overall testing efficiency, ensure a proper balance between manual vs automated testing


Make sure your dev teams are fast and reliable (volume & frequency of code commits), helping each other (peer reviews), and having quality gates over code and CI/CD pipelines in green


Boost the performance of your teams via faster lead time for changes to production, increased deployment frequency to production, faster time to restore service to production, and reduction in the change failure rate to production.




Metrics by Data Source Types

Release and task tracking

...

Summary

Purpose

Version Control Summary (roll up report over multiple code repositories)

Bird-eye view on key metrics from the source code repository on with ability to drill down.

Most Frequently Modified Files

Helps find out the most fragile points in the code base / architecture by showing a modification frequency for files in a project code base.

Biggest Commits

Shows the top of biggest commits in a project code base (last 7 / 30 / 90 days) to identify the biggest pain points for code review; the smaller the better.

Code base Change Trend

Shows an amount of code lines changed (added, modified, deleted) over last 6 months.

Commit Size per day (per-person view)

Shows a size of individual commits in a project code base per selected GIT repositories (branches) and selected team member(s) for the last 180 days

Commits Number per day (per-person view)

Shows a number of individual commits in a project code base per selected GIT repositories (branches) and selected team member(s) for the last 180 days.

Merge Request Average Lifetime

Shows the avg speed of new changes being incorporated to a master code due to delays on code reviews. The less the better - means less overhead for dev process/team to handle merges.


DevOps industry standard metrics

This is a set of measures and metrics described in the "Accelerate" book and summarized in this article. 

"Accelerate" DORA metric

Meaning

Relevant metrics in PERF

PERF data sources

Deployment frequency

By “deployment” we mean a software deployment to production or to an app store. The reason the frequency of production deployments matters is because it tells you how often you’re delivering something of value to end users and/or getting feedback from users.

Deployment Frequency 

Jenkins, GitLab CI

Deployment Frequency (Custom Metric v2)

JIRA, Rally

Releases by Month

JIRA, Rally





Lead Time for changes

The time it takes to go from code committed to code successfully running in production.

Average Pipeline Lead/Cycle Time

Jenkins, GitLab CI

Time between Done and Released (TBD)

JIRA, Rally

Lead Time for Changes (Custom Metrics v2)

JIRA, Rally

Resolution Time for Production Defects

JIRA, TFS, Rally

Lead and Cycle Time

JIRA, TFS, Rally

Scrum Cycle Time

JIRA, TFS, Rally





Time to restore service

The time to restore service or mean time to recover (MTTR) metric calculates the average time it takes to restore service

Pipeline Mean Time to Recovery


Jenkins, GitLab CI

Mean Time to Recovery (Custom Metric v2)

Jira, Rally





Change Failure Rate

A measure of how often deployment failures occur in production that require immediate remedy (particularity, rollbacks).

Red Pipeline Time

Jenkins, GitLab CI

Pipeline Success Rate

Jenkins, GitLab CI

Change Failure Rate (Custom Metrics v2)

JIRA, Rally

Production Defect Density per Release

JIRA, Rally


Per-person metrics

Warning

Disclaimer! Please always remember that

1) Metric is just an indicator. As a manager you always see a bigger context in which you should interpret numbers.

2) Metrics depend heavily on how well you have set up your data sources. Remember: if you set up the rules of interpretation that are right for your project, you will get the right metrics.

PERF is more focused on Team-level view. Although, there’re a few per-person metrics/widgets available: 

...