OBLYTECH Logo
OBLYTECH Logo
ServiceNow Agile Development KPIs and Metrics That Matter

ServiceNow Agile Development KPIs and Metrics That Matter

Velocity and Capacity Planning

Velocity measures how much work a team completes per sprint, expressed in story points. A typical team velocity might be 40 points per sprint. Stable velocity allows predictable planning: if team averages 40 points per sprint, a 200-point epic takes 5 sprints. This predictability supports roadmap commitments and dependency planning across teams.

Track velocity over time: is it increasing (team improving productivity and skill), stable (predictable and sustainable), or declining (problems emerging)? Fluctuation is normal: new team members or complex work may lower velocity temporarily. Flag significant declines for investigation.

Burndown and Sprint Health

Burndown charts show remaining work in a sprint, typically story points or task count plotted regularly. A healthy burndown slopes down consistently: work is completed at steady pace. Abnormal burndowns indicate problems: flat line (team not progressing, possible blockers), spike (new work added mid-sprint, scope creep), or late collapse (everything done last day, indicating understaffing or overcommitment).

Track burndown to spot issues early and intervene. A team that consistently finishes work on the last day of the sprint is unsustainably pushing. A team that finishes with days remaining may be under-committed and could take on more work.

Cycle Time and Lead Time

Cycle time (days from start to finish of a story within the sprint) and lead time (days from story creation to finish, including time waiting) measure responsiveness and flow. Lower is better; they indicate efficient delivery. Long cycle times (weeks per story) indicate bottlenecks: approval delays, technical debt slowing development, unclear requirements, or dependency waits. Address bottlenecks to improve flow and reduce time-to-market.

Compare cycle time and lead time. If they diverge greatly, time is spent waiting, not building. That waiting time is often non-engineering work: approval, testing, deployment, or staging. Reducing wait time often has more impact than reducing build time.

Defect Rates and Quality

Track defects found during development and after release, broken down by severity. Defect trends matter more than absolute counts: defect rate increasing indicates quality is declining. Root cause might be: rushing work, insufficient peer review, inadequate automated testing, or unaddressed technical debt accumulating.

High defect escape rate (defects found in production rather than development) indicates testing gaps. A team with low in-sprint defects but high post-release defects needs better test coverage or production monitoring.

Sprint Completion and Scope Commitment

Track the percentage of sprint-committed work that is actually completed (not just started). A team that completes only part of its committed points has a velocity below its commitment, and the gap shows up as variance. Consistently missing commitments suggests over-estimation or external interruptions derailing the team.

Also track scope changes mid-sprint: how many stories are added after sprint start? Frequent mid-sprint additions indicate either poor planning or reactive work (firefighting). Some reactive work is inevitable; high rates suggest a need for better prioritisation or more capacity reserved for unplanned work.

Team Health and Sustainability

Velocity can be artificially inflated by overworking teams unsustainably. Monitor leading indicators: overtime hours, team member turnover, escalating interpersonal conflicts, or burnout complaints. Survey team regularly: are they satisfied with work, do they feel valued, do they have resources they need, do they feel the pace is sustainable?

Unsustainable pace burns out teams. A team that delivers high velocity for a short burst and then collapses is worse than a team with consistent, sustainable velocity. Prioritise sustainability over short-term gains.

Customer Satisfaction and Value Delivery

Ultimately, agile development exists to deliver customer value. Track customer adoption of delivered features, satisfaction ratings, and whether the product is meeting customer needs. Velocity matters only if it is delivering valuable work. A team with perfect velocity delivering features nobody wants is not successful.

Measure value delivered: business outcomes achieved, customer problems solved, revenue impact. Tie agile metrics back to business results to demonstrate that the effort is worthwhile.

Retrospectives and Continuous Improvement

At the end of each sprint, hold retrospectives: what went well, what should improve, what will we change? Retrospectives are where metrics meet action. If burndown shows late-sprint rushes, the team should discuss and commit to starting work earlier. If defect rate is high, discuss testing improvements.

Track retrospective actions: did the team follow through on commitments? Monitor whether improvements from retrospectives are actually implemented and whether they have the desired effect on metrics.

Writing a definition for each metric before it is reported

Many disputes over agile measures often trace back to definitions nobody recorded. Two managers look at the same cycle time chart and read different numbers, because one counts from the moment a story is created and the other from the moment work starts. Before a metric appears on any dashboard, answer the four questions in the table for it. If the answers differ between teams, the metric can still be used, but only for comparisons within a team, and the dashboard should say so.

Metric Definition question to settle Common disagreement
Cycle time Which state marks the start, and does a story that moves back count from its first start? Whether time spent blocked is included
Velocity Are partially completed items counted, and are items moved in mid-sprint included? Whether carry-over is credited to the sprint it finished in
Defect escape rate Which environment marks escape, and which severities are counted? Whether a defect found in staging is an escape or a pre-release catch
Sprint completion What was committed, and at what point is the commitment fixed? Stories added after planning that are counted as committed by some teams

Metrics that should not be used to judge individuals

A metric that describes a team’s flow is a poor instrument for ranking the people inside it. Story counts reward the splitting of work into small items, cycle time rewards picking easy tickets, and defect counts reward whoever is assigned the least risky code. Once a metric is tied to a person’s evaluation, the people being measured will adjust their behavior to the measure, and the metric stops describing anything useful. Use team-level measures for planning and improvement, and keep individual performance conversations in a separate channel that does not depend on the platform’s numbers.

Reading a trend without reacting to a single point

A single sprint is a weak sample. A velocity drop in one cycle is more often explained by leave, an incident or a change in the work mix than by a change in ability. Before anyone acts on a metric, read it in a short sequence:

  1. Check the definition has not changed since the previous cycle, including any change in how the platform calculates the field.
  2. Look at the trend across at least the last several cycles, not just the latest figure.
  3. List what was different about the cycle: leave, incidents, new members, unusual work mix.
  4. Decide whether the change needs a response, a note in the record, or nothing at all.

Pairing measures so that one cannot be gamed alone

Every metric can be improved by making a choice that hurts something else. Pairing each measure with a counterweight makes the trade-off visible and makes gaming harder to hide.

Measure How it can be gamed Counterweight to read alongside
Throughput of completed items Splitting work into smaller, less valuable items Customer-facing outcomes delivered in the period
Cycle time Starting items late so the clock begins close to completion Share of work-in-progress that has been sitting unchanged
Defect count Closing defects as not reproducible or as duplicates Reopen rate and defects found after release
Velocity Inflating estimates so the same work scores higher Stability of estimates against a fixed set of reference items

Presenting metrics to a leadership audience

Leaders tend to want a single number, and the metrics they receive are often too detailed to act on. A better format is a short page with three elements: the measure with its definition in a footnote, the trend across recent periods, and the one or two decisions the measure is relevant to. If a measure does not inform a decision, it does not belong on that page. The governance model should name which measures go to which forum, so the same figure is not presented differently in two places.

Retiring a metric that no longer informs anything

Dashboards accumulate measures the way codebases accumulate functions, and many of them are never removed. At each review, ask of each measure which decision it changed in the last period. A measure that has changed no decision for a long stretch should be retired, and doing so is good hygiene rather than lost ground. Note the removal and its reason in the metric record so the debate does not restart next year.

When two measures disagree, the cause is often a definition or a data-entry habit rather than the work itself. The troubleshooting guide for Agile Development is the reference for symptoms like these.

Questions about agile measurement

Should velocity be compared across teams?

No. Each team estimates against its own history, so a higher number in one team does not mean more delivered work than a lower number in another. Comparing across teams invites inflation, and the comparison is not one the metric was built to support.

How do we measure work that is mostly unplanned?

Count completed items and measure cycle time from the moment work starts. Velocity against committed scope is less meaningful for that stream, and reporting it alongside a planned stream can make both look worse than they are.

What is a reasonable number of metrics for one dashboard?

Few enough that every figure on it has a named decision attached. If nobody can say what a number would change, it should move to a supporting view or be removed.

Do metrics replace the retrospective?

No. Metrics show where to look, and the retrospective is where the team explains what it saw. A metric that surprises the team is most useful when it becomes a question in the retrospective rather than a conclusion handed down from above.

Next step

Agree the definitions before the next leadership review so the dashboard starts from numbers everyone accepts.

Frequently asked questions

Should we compare velocity between teams?

No. Velocity is meaningful only for one team over time. Different teams estimate differently, work on different types of stories, have different experience. Compare a team to itself; do not compare across teams.

What if velocity is declining?

Investigate. Common causes: technical debt (fixing old problems takes time), team changes (new people slower), external interruptions, or process problems (too many unplanned work, unclear requirements). Address root cause in retrospectives.

How do we know if our metrics are healthy?

Healthy metrics show stable velocity, consistent sprint completion, low defect escape, reasonable cycle times, and team satisfaction. No single number is a target; focus on trends. Improving trends and a satisfied team indicate health.

Talk to Oblytech

Planning, running or fixing a ServiceNow programme? Tell us where you are and we will suggest a sensible next step.

Contact us