OBLYTECH Logo
OBLYTECH Logo
Common ServiceNow Operational Metrics Mistakes and How to Avoid Them
Home / Guides, Services and Solutions / IT Operations Management: Guides and Services / Operational Metrics: Guides and Services / Common ServiceNow Operational Metrics Mistakes and How to Avoid Them

Common ServiceNow Operational Metrics Mistakes and How to Avoid Them

Common operational metrics mistakes are the errors that let a dashboard look healthy while users complain. This page walks through seven of them, giving the symptom, root cause and fix for each, then a review sequence for errors that enter through the reporting pipeline.

Mistake 1: Measuring the Wrong Things

Symptom: your metrics dashboard shows everything is green, but customers are complaining about slow systems. The metrics do not reflect actual user experience.

Root cause: you are measuring infrastructure metrics (CPU, disk) but not application performance metrics (response time, throughput). Or you are measuring the wrong layer entirely.

Fix: start with user-facing metrics. What do customers care about? Response time, availability, error rate. Then work backwards: what infrastructure metrics explain those user metrics? CPU and disk explain availability; database query time explains response time.

Prevention: involve stakeholders in metric selection. Ask them: what would indicate the system is working well? Build metrics around their answers, not around what is easy to measure.

Mistake 2: Thresholds That Are Too Loose or Too Tight

Symptom: either alerts fire constantly for non-issues, or real problems are missed because thresholds are too high.

Root cause: thresholds were guessed or copied from another team. They were never tuned to your environment.

Fix: collect baseline data first. Run the system for one month with no alerting, just data collection. See what normal CPU usage looks like, what normal response times are, what normal error rates are. Then set thresholds based on that baseline. Example: if CPU is normally a substantial proportion, set alert threshold at the majority. If response time is normally 200ms, alert at 500ms.

Prevention: review thresholds quarterly. Are you getting the right alerts, or too many false positives? Adjust based on feedback. This is a continuous tuning cycle.

Mistake 3: Missing Context in Metrics Reports

Symptom: reports show numbers but no context. “Response time increased noticeably.” But was that expected (because of a load spike), or unexpected (a problem)?

Root cause: metrics are reported raw, without comparison to baselines or explanation of what is normal.

Fix: every metric report should include: the current value, the historical baseline, and the threshold. Example: “response time: 350ms (baseline: 200ms, alert threshold: 500ms).” This context helps readers understand if action is needed.

Prevention: include historical trends and context in every dashboard and report. Show data over time so patterns are visible. If there is a spike, can you explain why? If not, investigate.

Mistake 4: Not Distinguishing Availability From Performance

Symptom: your availability metric looks close to perfect, but users report that the system is slow, but users report that the system is slow. These are two different problems, and conflating them is confusing.

Root cause: mixing availability (is it up or down?) with performance (is it fast or slow?). A system can be up but slow, or down but briefly. These need separate metrics.

Fix: track both. Availability: what percentage of time is the system responding at all? Performance: when it responds, how fast is it? These tell different stories. Example: “availability is high, but a meaningful share of requests are slower than the SLA target.”

Prevention: define metrics separately for availability and performance. Do not fold them into a single metric where one hides the other.

Mistake 5: Ignoring Dependency Impact on Metrics

Symptom: your application metrics look good, but customers report issues. It turns out a downstream dependency (API, database, payment processor) is slow. Your metrics missed this.

Root cause: you measured your application in isolation, not including the impact of dependencies.

Fix: include end-to-end metrics. If your app calls an API and waits for the response, measure the total time including the API call. This shows customer impact, not just your component’s performance.

Prevention: map out dependencies. For each critical workflow, know what systems it touches. Measure end-to-end, not just each component.

Mistake 6: Setting Metrics Without Buy-In

Symptom: teams do not believe the metrics or do not use them. Dashboards are built but no one looks at them.

Root cause: metrics were defined by techies, not business stakeholders. They measure what is technical, not what business cares about.

Fix: involve business stakeholders in metric definition. What would “good performance” look like to them? What would “bad” look like? Build metrics around those definitions.

Prevention: metrics should be owned by operations and approved by stakeholders. Before a metric becomes official, get stakeholder buy-in.

Mistake 7: Confusing Correlation With Causation

Symptom: when CPU is high, you assume that is why response time is high. But sometimes response time is high even when CPU is low.

Root cause: high CPU correlates with slow response time but may not be the cause. The cause could be network latency, slow database, or a different problem altogether.

Fix: investigate correlations. When response time increases, check: CPU (maybe), database query time (maybe), API latency (maybe), or data size (maybe). Do not assume one metric causes another. Use comprehensive analysis.

Prevention: collect multiple metrics and look for patterns. Keep a playbook of “if response time is high, check these three things in order.” This reduces guessing.

Errors that live in the reporting pipeline rather than the measure

Many discussions of metric mistakes focus on choosing the wrong thing to measure. Those errors matter, but they are not the ones that quietly ruin a report. The damage often comes from the pipeline between the record and the dashboard: a timestamp read in the wrong time zone, a reopened record counted twice, a service-level calendar changed mid-period without a note, or a category renamed so that last quarter’s figure no longer matches this quarter’s filter. None of these looks like a mistake when you see the final chart. Each one shifts a number, and the shift often looks like a real improvement or a real decline.

The fix is to test the pipeline the same way you would test code. Pick a small set of records whose history you know, run them through the calculation, and check the output by hand. A discrepancy found this way costs an afternoon. The same discrepancy found by a director in a board pack costs a credibility that takes much longer to rebuild.

Failure modes, early signs and checks

The table lists failure modes that recur in reporting pipelines. Use it as a review checklist after any change to a source, a calculation or a filter.

Failure mode Early sign in the report Check to run
Timestamps mixed across time zones Daily counts peak at an odd hour or shift when the clock changes Compare one record’s start and end in the source with its value in the calculation
Reopened records counted twice Volume rises after a clean-up campaign with no matching rise in new work Count distinct record identifiers rather than rows for the period
Calendar changed mid-period A measure jumps on a date when the working calendar was edited Log calendar changes with their effective date and recalculate the affected period
Category renamed in the source A segment disappears from a chart or its total stops reconciling Reconcile the segment totals to the overall total each cycle
Empty fields treated as zero An average falls sharply after a form change Count missing values separately and exclude or flag them explicitly
Canceled work still counted Completion rate looks higher than the team’s own tally Filter on the final state the definition names, not on a state that merely looks final

A review sequence after any pipeline change

  1. Note the change, its date and the person who made it, in the metric’s change log.
  2. Choose five or six records with known histories that cover the edge cases in the table.
  3. Calculate the measure for those records by hand, using only the written definition.
  4. Compare the hand result with the report’s output for the same records and explain every difference.
  5. If the difference is real, fix the pipeline and repeat the test before the report is published.
  6. If the report already went out, issue a correction note to the same audience and name the figures that changed.

Why a correction note matters more than a silent fix

A silent correction tells readers that the earlier figure was never reliable. A short note that states the change, the affected period and the new figure keeps trust while protecting the record.

When a mistake should stop a report

Stop a report when a figure used in a decision is wrong and the decision has not yet been taken. Publishing a known error to meet a date is the most expensive shortcut in the whole process.

Who should run the hand check

Someone who did not build the calculation. The builder tends to check the output against their own assumptions, which means the same blind spot is repeated in the check.

How often the pipeline should be tested

After every change, and on a routine schedule even when nothing has changed, because sources change without notice. A source upgrade or a new integration can alter field formats silently.

Where these checks connect to the wider measure set

The checks above protect the figures; they do not decide which figures are worth reporting. The best practices for operational metrics describes how to keep definitions stable, and the note on building a service metric dictionary covers recording each definition precisely enough to test against. Where a measure depends on service levels, the service level and experience management work covers service level and experience management.

Bring the definition, one disputed record and the report output for that record.

Questions about metric errors

Is a small discrepancy worth investigating?

Yes, when it recurs or when it sits in a figure that feeds a decision. A small, consistent gap often points at a definition problem, and those are the hardest to fix later.

Can the errors be prevented entirely?

No, but many of them can be caught before publication if the hand check is part of the routine rather than a special exercise.

What if the definition itself is disputed?

Take the dispute to the governance forum, decide it there, and record the decision. Changing the calculation to match one side of the argument without a decision is the source of many later disagreements.

Frequently asked questions

How many metrics should we track?

Start with 5-10 critical metrics. Too many metrics is overwhelming; teams cannot act on all of them. Start with the most important, then add more as needed. Quality over quantity.

Should we track metrics for development and test environments?

Maybe. For production, definitely. For development and test, track whatever helps developers understand issues. But be cautious of alert fatigue: do not alert on test environment metrics.

How often should we calculate and report metrics?

Real-time or near-real-time for dashboards (5-minute updates). Daily or weekly for reports. Monthly for trend analysis. This three-level approach gives immediate visibility, weekly context, and monthly insights.

Talk to Oblytech

Planning, running or fixing a ServiceNow programme? Tell us where you are and we will suggest a sensible next step.

Contact us