OBLYTECH Logo
OBLYTECH Logo
ServiceNow Security Operations KPIs and Metrics That Matter

ServiceNow Security Operations KPIs and Metrics That Matter

Security operations KPIs measure how quickly threats are detected and how well they are answered. This page covers detection and response times, alert quality, investigation metrics, threat hunting and the common ways metrics get misused, with a review cadence.

Detection and Response Metrics

Security operations exists to detect threats and respond effectively. The most important metrics measure detection speed and response speed. Mean Time to Detect (MTTD) measures how long threats remain undetected. Mean Time to Respond (MTTR) measures how long from detection to response action. Industry context matters; a one-minute detection for certain threat types is excellent, others require 15 seconds. Document what MTTD and MTTR you are targeting and what they mean for your environment.

Data source is ServiceNow incident records. Filter to security-related incidents, calculate the time from alert generation (detection) to incident creation (response begins). Track this monthly and review trends. If MTTD is increasing, alert systems may be degraded or tuned incorrectly. If MTTR is increasing, response team may be overloaded or lacking clear procedures.

Alert Quality Metrics

Security tools generate many alerts. The signal-to-noise ratio matters. Alert Volume measures how many alerts the team processes. False Positive Rate measures what percentage are not actual threats. True Positive Rate measures what percentage are actual threats that need response. An alert system that fires 10,000 alerts per day with 99 false positives is generating noise, not intelligence. Tune the system to reduce noise.

Data source is your SIEM or alert aggregation system. Calculate daily alert volume, percentage that are false positives (determined through investigation), percentage that are true positives requiring response. Alert volume varies widely by environment, so compare your figures with your own baseline over time. If your false positive rate is high against that baseline, alert tuning is needed.

Investigation Metrics

Investigation Completion Rate measures the percentage of security incidents that are fully investigated and closed. Mean Time to Investigation (MTTI) measures average time from incident creation to completion of investigation. Reinvestigation Rate measures incidents that are reopened because investigation was incomplete.

These metrics reveal whether investigation is thorough or rushed. A high completion rate with low reinvestigation rate indicates investigations are thorough. A low completion rate suggests the team is overwhelmed or lacking tools. High reinvestigation rate suggests investigations are being closed prematurely.

Data source is ServiceNow incident records. Tag security incidents, calculate completion rate and mean time from incident creation to closure. Include only incidents that reached investigation phase, not those that were determined to be false positives during triage.

Threat Hunting and Proactive Metrics

Not all security work is reactive response. Threat hunting is proactive searching for threats that detection tools may have missed. Measure Threat Hunt Coverage (what percentage of your systems and data are covered by proactive hunts) and Threats Found Through Hunting (how many actual threats were discovered through proactive work versus only through alerts). A healthy program finds some threats through proactive hunting, not only through reactive alerts.

This is harder to track systematically but worth measuring. If all threats are discovered through alerts, your hunting program may not be effective. If most threats are discovered through hunting, your alert system may not be tuned well.

Training and Capability Metrics

Security operations depends on skilled people. Track Certification Rate (what percentage of the team holds relevant security certifications). Track Training Completion Rate (what percentage complete required training annually). Track Staff Retention (how frequently analysts leave, indicating burnout or dissatisfaction). A team with high turnover cannot build institutional knowledge.

Data source is HR systems and training records. Measure this quarterly. If certification rate is declining or training completion is low, the organization is not investing in capability. If retention rate is declining noticeably year-over-year, the environment may not be sustainable.

Typical Misuse of Metrics

Do not use MTTR as the only measure of success. Responding quickly to a false alert is not success. A better metric is time to response on true threats combined with false positive rate. Do not measure alert volume without context; 10,000 alerts from a well-tuned system is different from 10,000 alerts from a poorly tuned system.

Do not hold analysts accountable for metrics they cannot control. If MTTD increases because threat detection tools are not updated, the analyst team is not responsible. If response time increases because of process bottlenecks in approvals, speed improvements require process change not performance pressure.

Review Cadence and Escalation

Review KPIs monthly. Calculate trends over 3-month and 12-month windows to distinguish short-term variance from meaningful changes. If a metric degrades significantly, escalate to security leadership with proposed fixes. A rising MTTR requires investigation: is the team overloaded, are procedures failing, are tools degraded?

Share KPIs with security leadership quarterly. Communicate progress on improvement initiatives. Show how investments (additional tools, training, staffing) are paying off through improved metrics. Celebrate improvements and be transparent about challenges.

KPI Summary Table

Metric Data Source Calculation Review Frequency
MTTD Alert system + SIEM Average time alert generated to incident created Monthly
MTTR Incident management Average time incident created to action taken Monthly
False Positive Rate SIEM + investigation Percentage of alerts determined not to be threats Monthly
Investigation Rate Incident management Percentage of incidents fully investigated Monthly
Staff Retention HR system Percentage of staff remaining year-over-year Quarterly

Writing a metric definition that two teams will calculate the same way

Many disagreements about security operations numbers are disagreements about definitions, not about performance. One team counts an alert as closed when the analyst clicks the button, another when the closure note is saved, and a third when the underlying source confirms the activity has stopped. Each count is defensible on its own, and together they produce a dashboard that nobody trusts. Writing each metric as a short, agreed definition before it is published is often a low-cost way to make the numbers usable.

This section is for the analyst who builds the reports and the manager who reads them. It covers how to write a definition that survives scrutiny, how to set a baseline, and how to check that the figures still mean what they meant when they were agreed.

The elements every definition card needs

Element What to write Common error
Population Which records are in scope, by type, source and severity Including test alerts or informational items in the same count as confirmed events
Start event The field or status change that starts the clock Starting from the time a record was created when the event occurred much earlier
End event The field or status change that stops the clock Stopping at a status that can be set without the action having happened
Exclusions Records removed from the count, and the rule for removing them Excluding inconvenient records without a written rule
Reopening Whether a reopened record is counted again, and from when Silently restarting the clock on reopened records
Owner and review date Who maintains the definition and when it is next checked No owner, so the definition drifts as fields are renamed

Setting a baseline before any target is discussed

A goal set before any reading exists can be guesswork presented as a plan. Calculate each metric over a period of normal operation using the agreed definition, and look at its spread rather than its single average. A measure that swings widely from week to week needs a longer window before any change can be read from it. Only once the spread is understood should the team discuss what movement would matter, and that discussion should name the cause it would look for if the measure moved.

  1. Write the definition card and have two people who did not write it calculate the metric from the same sample of records.
  2. Compare the two results. Any difference points to an ambiguity in the card, which should be fixed before going further.
  3. Run the calculation over a fixed historical period and record the spread of results.
  4. Agree which movements would prompt investigation, and name the first thing the team would check in each case.
  5. Publish the card alongside the figure, so every reader sees the definition next to the number.

Segmenting before concluding

A single headline figure can hide two opposite trends. An average response time may fall because simple alerts are closing faster while serious incidents take longer. Segment the same measure by alert source, severity and incident type before drawing a conclusion. Segmentation also reveals where the data is thin: a segment with very few records should be shown with that caveat, not averaged into the total as if it were stable.

Leading and lagging indicators

Many metrics describe what has already happened, which makes them lagging. A small number of leading indicators can warn earlier. Examples include the share of sources delivering events on schedule, the proportion of alerts with the fields needed for routing, and the age of the oldest open triage item. These are not outcome measures, but they show whether the conditions for good outcomes are in place, and they move before the headline figures do.

Data quality checks that belong beside the metric

Before a figure is published, check that the inputs are complete. Confirm that the timestamps used for the start and end events are populated for most records, that the closure reason is recorded, and that no source has silently stopped during the period. A figure computed from incomplete data should carry a note saying so. Presenting a clean number built on gaps can be one of the easiest ways to lose the trust of the people reading it.

Who signs off a changed definition?

The owner named on the card, after the change has been tested against the historical sample. Keep the superseded and current wording next to each other, so a restated trend can be explained.

Does an outside comparison mean anything?

Only when the definitions have been shown to match. Populations, severity scales and source coverage vary, so a comparison means little until those are aligned. Use outside benchmarks to prompt questions rather than to grade the team.

What do we do when a metric moves and nobody knows why?

Check the data quality items first, then the segments, then the definition. Many unexplained movements are explained by one of those three before any change in real activity is considered.

How many metrics should the team track?

Often fewer than teams first expect. Keep the handful the team will act on, and drop any figure that nobody has cited in a decision for a long stretch.

Linking measures to the rest of the program

Definitions work best once the workflows they measure are stable. The incident response metrics guide covers the response-side measures that often sit beside these.

Frequently asked questions

Should we set targets for MTTD and MTTR?

Yes. Research your threat landscape and set realistic targets. Set targets from your own measured performance. Document your targets and review them regularly as your threat environment changes.

How do we know if our false positive rate is acceptable?

Higher false positive rate is typical with more sensitive alert tuning (you catch more real threats but also more false alarms). Balance between missing threats and alert fatigue. Most well-tuned environments have a high false positive rate. Tune thresholds to reduce noise while catching real threats.

What metric is most important for security operations success?

True positive rate (actual threats detected and responded to) is most important. But you also need false positive rate context. High true positive rate combined with low false positive rate is ideal and rare.

Talk to Oblytech

Planning, running or fixing a ServiceNow programme? Tell us where you are and we will suggest a sensible next step.

Contact us