OBLYTECH Logo
OBLYTECH Logo
ServiceNow Now Assist for ITSM KPIs and Metrics That Matter

ServiceNow Now Assist for ITSM KPIs and Metrics That Matter

Overview of Now Assist for ITSM Metrics

Now Assist for ITSM is an AI assistant within ServiceNow that helps IT support staff by suggesting actions, summarizing information and automating routine activities. Measuring its effectiveness requires metrics that capture adoption, quality of suggestions and business impact on incident and request handling.

Metrics fall into two categories: operational metrics that track how the tool is being used and business metrics that measure impact on support team efficiency and user satisfaction.

Operational Metrics

Assistant Activation Rate measures the proportion of incidents or requests where Now Assist was engaged. This is calculated as: active assisted tickets divided by total incident or request tickets in a time period. A low activation rate suggests adoption challenges or insufficient visibility to the feature.

Action Acceptance Rate tracks the proportion of suggestions that support staff act upon. It is calculated as: accepted actions divided by total suggestions presented. Higher acceptance indicates confidence in the AI recommendations.

Feature Utilization shows which AI capabilities are most used: summarization, next-step recommendations, knowledge article suggestions or automated categorization. This guides investment in improving the most valuable features.

Business Impact Metrics

Average Ticket Resolution Time measures the average time from ticket creation to closure, tracked separately for tickets assisted by Now Assist versus unassisted tickets. Improvement here indicates the AI accelerates work completion.

Support Staff Efficiency measures the time staff spend on non-value activities like manually summarizing notes or searching for relevant knowledge. As the AI automates these tasks, staff time should shift to problem-solving and communication.

Knowledge Article Effectiveness tracks how often suggested articles are useful to staff or customers. This is qualitative feedback captured through follow-up surveys or thumbs-up/down ratings on suggestions.

Common Metric Misuse

Treating activation rate as a success metric without checking acceptance rate can be misleading. High activation with low acceptance suggests the feature is visible but not trusted or valuable. Focus on acceptance and business outcomes rather than raw usage numbers.

Comparing resolution time before and after implementation without accounting for ticket complexity changes can overstate or understate impact. Control for ticket type and severity to isolate the AI’s contribution.

Assuming all suggested actions should be accepted is unrealistic. Suggestions may be contextually incorrect or trigger policies that require manual review. Track which types of recommendations are accepted versus rejected to understand where the AI model needs improvement.

Review Cadence and Action

Operational metrics should be reviewed monthly to track adoption trends and identify adoption barriers early. If activation is stalling, investigate barriers: feature visibility, training gaps or perceived quality issues.

Business impact metrics should be reviewed quarterly in the context of IT business reviews. Investigate unexpected trends, such as resolution time increases despite high AI activation, which may indicate other operational changes.

Quarterly reviews are also appropriate for analyzing which Now Assist features are valuable and which require improvement or removal. Adjust AI model tuning and training based on feedback and acceptance patterns.

Implementation of Now Assist for ITSM typically begins with a pilot group to validate the technology and gather initial feedback before full deployment. Pilot results should inform decisions about feature tuning, escalation thresholds and which incident types are best handled by the AI assistant.

Integration with Incident Management

Now Assist for ITSM should be integrated into incident workflows early, suggesting relevant knowledge articles or next steps as incidents are being investigated. This integration provides AI assistance in the context where support staff are already working, increasing adoption.

Feedback from support staff should be actively collected and used to improve Now Assist accuracy. If suggestions are consistently unhelpful for a particular incident type, adjust the AI model training or escalation thresholds for that type.

Comparing Now Assist data with IT Digest metrics from the module helps understand whether the AI is truly improving efficiency or just shifting work between support teams. Triangulating multiple data sources provides stronger evidence of impact.

Writing each measure as a specification before it is reported

Most measurement trouble with the assistant starts with a metric that sounds precise but has never been defined. “Time saved” can mean the agent’s self-estimate, the gap between record open and close, or the difference against a control queue, and each gives a different answer. Before any figure reaches a steering pack, write it as a short specification: the exact definition, the denominator, the data source, the owner and the paired guardrail that stops the measure being gamed. A metric without a guardrail tends to improve for the wrong reason, because the team optimizes whatever the number rewards.

Measure to define Denominator to fix in writing Guardrail to pair with it What it cannot show
Share of suggestions accepted without edit Suggestions shown to agents in the period, by use Reopen rate for records where a suggestion was accepted Whether the accepted text was correct
Time to first meaningful action on a record Records that reached an action in the queue, excluding automated updates Share of records returned to the queue after the first action Quality of the action itself
Summaries reviewed before saving Summaries generated, with the review step recorded Sampled comparison of summary against the work notes Whether reviewers read carefully
Routing accuracy for suggested destinations Suggested routings that a person then confirmed or changed Rework time after a changed routing Cases where the suggestion was never shown
Knowledge gaps surfaced by the assistant Requests where no article was suggested, by topic Share of those topics with an assigned knowledge owner Gaps the assistant never saw because the agent searched elsewhere

Setting up the measurement routine

A measurement routine is a sequence the team repeats, not a dashboard someone built once. The steps below keep the numbers defensible and the discussion focused on causes.

  1. Write the specification for each measure, including the denominator and the owner, and get the owner to sign it.
  2. Confirm the data source records the fields the denominator needs, and fix any gap before the baseline period starts.
  3. Capture a baseline from the queue before the assistant is switched on for it, and keep the baseline definition unchanged.
  4. Report each measure alongside its guardrail, so no figure appears on its own in a steering pack.
  5. Review any measure that moved sharply, and record whether the cause was the assistant, the content or the queue mix.

Blind spots that no metric will reveal

Some important changes are invisible to these measures. A rise in agents quietly rewriting outputs can look like good adoption when it is actually a sign of low trust. A drop in escalations can mean that agents have stopped escalating difficult cases because they expect the assistant to resolve them. Pair the numbers with a periodic read of real records and with a short conversation with agents at each review, since the qualitative account often explains a movement the numbers cannot.

Comparing against a control without overreaching

A control queue that does not use the assistant is a strong comparison, but only if the two queues carry similar work. Check the mix of categories and priorities before reading any difference as the assistant’s effect. Where the mix differs, report the difference with its caveat rather than adjusting it away with a formula nobody can explain.

How many measures should a steering pack include?

Keep it to a short list, with each measure held by someone able to explain it. A pack with many measures often has several that nobody checks, and those tend to be the ones that move for reasons nobody has examined.

Should we publish the measures to agents?

Publish the ones that help agents act, such as reopen causes or knowledge gaps in their own queue. Showing individual agents their acceptance rate invites gaming and tells you little about quality.

What if the baseline was poor?

Record that fact, and compare the assistant’s results with the baseline and with the control queue at the same time. A weak baseline makes improvement easier to show, so it should never be the only comparison in a report.

How often should the specifications be revisited?

Whenever a category scheme, a channel or a source feed changes, because a changed field can silently alter a denominator.

Do we need a data warehouse before measuring?

Not necessarily. Many teams start with the records and the feedback data already in the platform, and move to a broader model only when the questions outgrow what the platform can answer.

Next step

For now assist for itsm kpis and metrics that matter, the contact page is where specifics get raised. The note on monitoring dashboard decision design is the page to check for how to choose what a dashboard should show, and the guide to performance analytics for ITSM is where to look for the reporting layer the measures will sit in.

Frequently asked questions

What acceptance rate should I expect for Now Assist recommendations?

Acceptance rates vary significantly depending on the feature and AI confidence level. Lower rates may indicate suggestions are too generic or missing context. Investigate acceptance patterns by feature to identify which capabilities need refinement. Track acceptance separately for each type of recommendation to understand which AI features are trusted by staff.

How long should it take to see business impact from Now Assist?

Adoption takes time as staff familiarize themselves with the feature. Business impact metrics may lag adoption as staff shift behavior and processes adjust. Set realistic expectations with leadership.

Should resolution time decrease equally across all ticket types?

No. Complex tickets with high investigation requirements may see minimal time reduction. Simple, high-volume tickets like password resets see larger time savings. Report results by ticket type to show where Now Assist has the most impact.

Talk to Oblytech

Planning, running or fixing a ServiceNow programme? Tell us where you are and we will suggest a sensible next step.

Contact us