OBLYTECH Logo
OBLYTECH Logo
ServiceNow Major Incident Management Best Practices

ServiceNow Major Incident Management Best Practices

Establish Clear Severity and Escalation Criteria

Best practice 1: Define severity levels for incidents that trigger major incident response. Incidents with broad business impact such as those affecting production systems used by thousands of staff or preventing revenue-generating operations should escalate to major incident management. Incidents affecting only a small team or with workarounds may not meet major incident criteria. Clear definitions prevent confusion during crisis situations when speed matters.

The reason behind this practice is that major incident response requires different resources and processes than routine incident handling. Escalating every incident to major status wastes resources. Failing to escalate true major incidents delays appropriate response and damages business operations. Clear criteria help staff make rapid, consistent decisions about escalation.

Assemble and Structure Your Incident Response Team

Best practice 2: Define roles for major incident response including an incident commander, technical teams to investigate and fix the issue and communications teams to keep stakeholders informed. The incident commander coordinates the overall response, manages time and escalations and ensures people are working on the right priorities. Technical teams focus on understanding the problem and implementing fixes. Communications teams ensure all stakeholders understand status and impact.

The reason is that unstructured crisis response creates confusion and delays resolution. Multiple people attempting to manage the incident or working on conflicting priorities extends downtime. Clear roles and a single incident commander provide structure that improves response speed and coordination.

Implement Rapid War Room Setup

Best practice 3: Have procedures to assemble your incident response team quickly when a major incident is declared. This might include a conference bridge number that is always available, a chat channel that automatically invites key people and a shared workspace where teams can track investigation and resolution progress. Getting people coordinated within minutes of incident declaration dramatically improves response speed.

The reason is that the first minutes of a major incident are critical. If you spend thirty minutes assembling the team, you may already be into costly downtime. Pre-arranged communication channels and team lists allow rapid coordination without searching for contact information.

Establish Clear Communication Protocols

Best practice 4: Define what information must be communicated to whom during major incidents. Executives need status updates on business impact and estimated resolution time. Affected users need to know the incident is being handled and when service will be restored. Internal technical teams need detailed technical information about the investigation. Different audiences need different information.

The reason is that poor communication during crises damages trust and adds chaos. Stakeholders who do not receive timely updates assume the worst. Internal teams that do not understand what others are investigating may duplicate effort. Regular structured updates and clear audience-specific messaging improve coordination and reduce uncertainty.

Document the Post-Incident Review Process

Best practice 5: After each major incident, conduct a review to understand what happened, why it happened and what can be improved. Document findings and track whether lessons lead to real changes. Post-incident reviews build organizational learning and reduce recurrence of similar incidents.

The reason is that without formal post-incident review, organizations repeat the same mistakes. Review meetings are often rushed or skipped when operations are busy. Documenting the review process and making it mandatory ensures that major incidents drive improvements rather than just consuming time and resources during the crisis.

What Good Major Incident Response Looks Like

When major incident management is working well, declaration of a major incident triggers a coordinated response within minutes. Key people are automatically notified and begin coordinating. The incident commander takes control and prevents chaos. Technical teams focus on investigation while communications teams update stakeholders. Resolution progresses steadily rather than in random directions. Customers and internal staff receive timely updates and the incident is resolved or mitigated as quickly as possible.

What to Avoid in Major Incident Management

Avoid treating all incidents as major incidents; this dulls the urgency and consumes resources unnecessarily. Avoid ambiguous incident commander authority; unclear leadership extends resolution time. Avoid siloed technical investigation where different teams work on unrelated aspects without coordination. Avoid communicating only bad news to stakeholders; regular updates on investigation progress build confidence even if resolution is pending. Avoid skipping post-incident reviews; they are where true organizational learning occurs.

Deciding within the first ten minutes whether to declare

The hardest call in major incident work often arrives before anyone has a diagnosis. An on-call engineer sees errors climbing on a customer-facing service, does not yet know the cause, and has to choose between opening a major incident record and continuing as a standard incident. Waiting for certainty is often the wrong test, because by the time the cause is clear the response has already started late. A better test asks whether the impact is already known to be wide or business-critical, even while the cause is still unknown.

Write the test down before the night it is needed. A workable declaration test asks three questions. Is a service that customers or staff depend on unavailable or badly degraded? Is the impact spreading into other services? Does the person on call need more people than they can coordinate alone? If any answer is yes, declare and let the incident commander downgrade later. A declaration that turns out to be unnecessary costs a short bridge call. A declaration made too late costs the opening hour of coordination, which is the hour a team can least afford to lose. The triage habits in the first five minutes of incident triage feed directly into this decision, because the same facts are needed to judge severity.

Situation at first sight Declare now Work as a standard incident and reassess
Core service down with no workaround Yes No
Service degraded, workaround exists, scope still growing Yes No
Service degraded, workaround exists, scope stable and bounded Only if the workaround is failing Yes
One team’s internal tool slow, no customer or revenue effect No Yes
Vendor outage with no published end time, affecting daily operations Yes Only if the effect stays inside one team

A first-hour sequence for the person who declared

The person who makes the declaration is often not the person who should command the response. The sequence below keeps the declarer on the job that only they can do, which is describing what is broken, while the rest of the structure forms around them.

  1. Record the declaration reason in one sentence, naming the service affected and the time the impact was first seen.
  2. Name the incident commander in the record before anything else. If the declarer is the only technical person awake, they hand command over at once and return to diagnosis.
  3. Open the coordination channel and invite the owners of each affected service, not the whole department.
  4. Post a first status line that states what is known, what is not known and when the next update will arrive. The guidance on major incident communication covers what a status update should contain.
  5. Assign one person to keep the timeline current. Decisions, changes and hypotheses go in as they happen, each with a time, so the record does not depend on memory.
  6. Set the first review point for the declaration itself. The decision to keep or drop major status should be revisited on a schedule, not left running by default.

Where the practice breaks down in live incidents

  • The declarer stays on diagnosis and nobody commands. The first hour passes with several people changing the same system without knowing what the others have tried.
  • Status updates stop once the team gets busy, and executives learn about the outage from customers instead of from the response.
  • Owners are invited ad hoc. The database team joins an hour late, after the application team has ruled out the database on partial evidence.
  • The timeline is rebuilt from chat messages after closure, so the post-incident review starts with guesses about sequence.
  • The declaration is never revisited, and a contained problem keeps a large bridge running for the rest of the day.

Signs the practice is holding

You can read the record and reconstruct the response without asking anyone. Each handover of command has a time and a name attached. The first status update went out before the service desk began receiving calls about the outage. Downgrades happen on purpose, and someone can explain the reason for each one. When these things are true, the practice is working even if the incident itself was hard to fix. When the timeline has gaps that only the people involved can fill, the practice needs attention regardless of how quickly the service came back. The people behind those entries, and the authority they hold, are described in the governance model for major incidents, which is where to check first if the record is thin.

When not to declare a major incident

Not every bad hour is a major incident. A known fault with a tested workaround, affecting one team and no customer-facing service, is better handled in the normal queue with a named owner. Declaring it anyway teaches people to discount the declaration, and that cost lands on the next real event. Keep the standard path described in the incident management best practices for problems of this size, and reserve the major path for events where coordination, not just repair, is the constraint. Declarations that are rare enough to be taken seriously are themselves a control.

Follow-on questions about declaring in practice

Should a declaration be deleted if the outage ends within minutes?

Keep the record and close it with a short note explaining that the declaration was not needed in hindsight. Deleting it removes the evidence that the declaration test was applied at the time, and the next review of declarations needs that evidence to judge whether the test is too sensitive or too loose.

Does the incident commander need to be the most senior person on the call?

No. Seniority matters less than the ability to hold the timeline, decide on incomplete information and direct people to the right work. A senior leader who tries to command from a distance often slows the response, because the people doing the work wait for a decision that only someone on the bridge can make.

What should happen when nobody steps forward to command?

Write the default into the process. The person who declared holds command until they hand it over in the record. An unclaimed command is a process gap to fix in the next review, not a question to settle by asking for volunteers in the middle of an outage.

How often should status updates go out during a long incident?

Set the interval at the first review point and widen it once the service is stable. Choose the interval against the speed of change in the incident and the number of audiences waiting, not against a figure copied from elsewhere.

Frequently asked questions

How do you decide when to declare a major incident?

Major incidents typically involve production systems that are completely unavailable or severely degraded, affecting large numbers of users or business-critical operations. Organizations usually define specific criteria such as impact scope or outage duration. When doubt exists during a crisis, declare major incident status; you can always downgrade if the situation is less serious than initially thought.

Should the incident commander always be an executive or senior staff member?

The incident commander should be someone experienced in incident coordination and able to make decisions under pressure. This is often a senior technical staff member or operations manager rather than a business executive. Executives should be available for escalations but do not typically direct technical incident response.

How long should post-incident reviews take and when should they occur?

Post-incident reviews take longer for more complex incidents. Schedule them soon after the incident while details are fresh but after the team has time to recover. Delaying reviews too long often means people are too busy to participate fully.

Talk to Oblytech

Planning, running or fixing a ServiceNow programme? Tell us where you are and we will suggest a sensible next step.

Contact us