OBLYTECH Logo
OBLYTECH Logo
ServiceNow Data Migration and Import Sets Implementation Roadmap

ServiceNow Data Migration and Import Sets Implementation Roadmap

This roadmap sets out the phases of a ServiceNow data migration, from assessing source data and choosing a strategy to a dry run, production load and post-migration cleanup. Import sets are ServiceNow's native mechanism for loading data: records land in staging tables, transformation rules run, and then the data moves to production tables.

Foundation Phase: Data Assessment and Planning

Entry criteria: inventory of source data systems (what data exists, where, what format, how much), target scope (what data needs to migrate to ServiceNow), stakeholder alignment on migration strategy. Data migration is often the bottleneck in ServiceNow implementations. Assessment phase determines data quality in source systems, identifies data cleansing needed, estimates migration volume and complexity. Source systems often have data quality issues: duplicates, missing values, inconsistent formats, outdated records. Assessment surfaces these issues early, allowing time to decide: clean in source system before migration, clean during migration, or accept data quality issues and clean post-migration.

Migration strategy decisions determine approach: big bang migration (all data migrates at once), phased migration (data migrates in waves), or parallel run (old and new systems run together for a period). Each approach has trade-offs: big bang is fastest but riskiest; phased reduces risk but takes longer; parallel run provides safety but is expensive. Target architecture decisions (which data goes into ServiceNow, what stays in external systems, what’s archived) affect scope and effort. Deliverables include data inventory, migration strategy document, and effort/timeline estimates.

Design and Development Phase

Extract-Transform-Load (ETL) processes are designed to migrate data from source to target. Extraction retrieves data from source systems (database queries, file exports, API calls). Transformation converts source data to target format: source data might store dates as strings; ServiceNow expects date and time values in its own date-time format, so the transform has to convert the source value into it.. Transformation also performs data cleansing: trimming whitespace, removing duplicates, validating against business rules. Load inserts transformed data into ServiceNow. Import sets are ServiceNow’s native data import mechanism: data is loaded into staging tables, transformation rules applied, then data is moved to production tables.

Data mapping determines how source fields map to target fields: customer name in source system maps to company name in ServiceNow. Complex mappings (source has first/last name, target has full name; needs to be concatenated) require custom transformation logic. Lookups resolve references: a customer account number in the source needs to resolve to a company ID in ServiceNow. If the company doesn’t exist in ServiceNow, does it need to be created during migration, or should the record be skipped? These decisions are made during design phase.

Testing and Validation Phase

Migration testing ensures data arrives correctly and is usable. Test data migration into a fresh ServiceNow environment, then validate that data is correct: record counts match, sample data looks right, relationships are correct. Data quality validation checks that migrated data meets business rules: if an incident must have an assignment, are all migrated incidents assigned? If a customer must have contact information, do all customers have contact info? Validation failures trigger investigation: why is data missing? Can it be populated from other sources, or do records need to be excluded from migration?

User acceptance testing involves business users validating that migrated data is usable for their work. Incident managers review sample incidents to verify they’re correct. Managers review asset inventory to verify hardware is correctly represented. User feedback identifies issues: important data wasn’t migrated, relationships are wrong, or data is in unexpected format. Issues found during testing are addressed before production migration.

Dry Run and Production Migration

Dry run migration executes the full migration process in a controlled environment, identifying problems without affecting production. Dry run should include full rollback capability: if something goes wrong, revert to pre-migration state. Problems encountered in dry run are fixed before production migration. If dry run takes 8 hours to migrate 5 million records, production migration will take similar time; this informs maintenance window planning and communication.

Production migration executes the vetted process. Cutover procedures (detailed steps for migration, who does what, when, communication templates) are pre-planned and rehearsed. Parallel run verification (if old and new systems run in parallel) compares data between systems to ensure consistency. Rollback procedures are in place and ready to execute if problems occur. Post-migration verification ensures critical data is present and correct.

Post-Migration Cleanup and Optimization

After migration, data quality issues surface that weren’t caught in testing. Orphaned records (referenced data that doesn’t exist) are identified and cleaned. Duplicate records (same entity migrated twice) are merged or removed. Stale data (old records that should have been archived) is archived. These cleanup activities can take weeks or months depending on data volume. Continuous improvement: lessons from this migration inform next migrations.

Performance tuning optimizes ServiceNow after data arrival. Indices on frequently-queried fields speed up reports and searches. Database statistics are updated so the query optimizer works correctly. Queries and reports that worked fine with 10,000 records might be slow with 1 million records; performance tuning addresses this. User acceptance and training ensure users know how to find and work with migrated data.

Rollback Capability and Contingency

Despite thorough testing, production migration sometimes goes wrong. Database corruption, unexpected performance issues, or data that looks wrong post-migration might require rollback. Rollback procedures restore from pre-migration backups. Rollback decision criteria (what problems warrant rolling back) should be established before migration so decisions aren’t made in panic. Rollback is disruptive but sometimes necessary to prevent worse damage. Planning for rollback increases confidence in executing migrations.

Gates matter more than phase names

A roadmap for data migration often lists phases: assess, design, test, load, clean up. The phase names are accurate and tell a program lead almost nothing about when to move on. The useful part of a roadmap is the gate between phases, which states what must be true before the next phase is allowed to start. A team that moves through the phases on schedule but passes the gates on hope will discover the gaps during the cutover, when fixing them costs the most.

Describe each gate as a question the sponsor can answer with evidence. Avoid gates phrased as activities, such as “mapping complete”, because a mapping can be complete and wrong. Ask instead whether the mapping has been tested on a representative sample and whether the owners have signed the result.

Gate Question the gate answers Evidence required Who signs
Scope gate Do we know exactly which data is in and why? Dataset register with an owner for each entry Business sponsor
Design gate Can each target field be traced to a source field or an agreed default? Mapping document reviewed on a sample of real rows Platform owner and data architect
Rehearsal gate Does a full dry run produce the outcomes we expected? Row outcome comparison from the dry run Platform owner and data owner
Cutover gate Can we reverse the load if it goes wrong? Rollback rehearsal record and named operator Change approver
Acceptance gate Do the owners accept the data as the source of truth? Signed reconciliation and open exception list Business owners

Sequencing the work between gates

Between gates, the work can overlap, but only where the dependency is one-way. Dataset owners can review their mappings while the platform team builds transforms for another dataset. Reference loads must finish before dependent loads are rehearsed. The cutover window cannot be fixed until the rehearsal has shown how long the full load takes, which is why the rehearsal gate sits ahead of any commitment to a date.

  1. Agree the scope gate evidence first, because every later decision depends on which datasets exist.
  2. Run design work per dataset in parallel, with each mapping reviewed by its owner before it is rehearsed.
  3. Rehearse the full load in dependency order and record how long each stage took.
  4. Use the rehearsal timings to set the cutover window, then confirm the rollback rehearsal fits inside that window.
  5. Hold the acceptance gate open until the post-load reconciliation has been signed for each dataset.

Where roadmaps usually slip

Schedules often slip at the design gate, because the mapping questions look small until a real file is opened. A legacy field called status may hold fourteen values where the design assumed four. The second common slip is the rehearsal, which is shortened to save time and then run against a smaller volume than the live load. The third is acceptance, which is treated as a formality and then reopened after users find problems. Building an explicit allowance for each of these into the gate criteria is more honest than padding the overall plan.

Questions about the roadmap

Can we skip the rehearsal gate if we have migrated before?

Previous experience reduces the number of surprises but does not remove the need to measure this particular load. A rehearsal is the only point at which the real volume, the real extract and the real reference data meet the real map. Skipping it trades a known cost for an unknown one.

What happens if a gate fails late in the plan?

Return to the most recent gate whose evidence is no longer valid, and say so to the sponsor in those terms. A failed cutover gate often means the rehearsal evidence is stale, not that the design is wrong. Rerunning the rehearsal is faster than reopening the design, and it tells you whether the design needs to change.

Should the roadmap show dates?

It can show the order and the dependencies. Dates are better attached to the gates once the rehearsal has produced real timings, because dates set before that point are estimates that tend to be held as commitments. Mark them as estimates until the evidence is in.

Next step

A roadmap is only as good as the testing behind each gate. The post on validation and cutover describes the checks that gates rely on, and the data migration and integration service page covers how migration plans are scoped, cleaned and transformed.

What a ServiceNow data migration covers, and what to load first

“ServiceNow migration” is used for three different projects, and the right plan depends on which one you have. Moving record data from an older ITSM tool into ServiceNow is a data migration. Moving an existing ServiceNow instance to a new release or a new hosting arrangement is an upgrade or instance move, where the data stays put and the configuration carries the risk. Connecting ServiceNow to another system so that data keeps flowing is an integration, not a migration. This roadmap is about the first.

Decide what comes across before choosing how

Most teams bring reference data first, then live records, and leave long-closed history in an archive or a read-only extract. That decision shrinks the load and removes the oldest, least reliable records. Write down the cut-off date and who agreed it.

Load in dependency order

Records that point to other records can only load after their targets exist. A workable order in most implementations is:

Order Load Reason
1 Companies, locations and departments Other records reference them.
2 Users and groups Caller and assignment fields need them.
3 Configuration items and assets Tasks relate to them.
4 Open incidents, requests and changes These depend on everything above.
5 Closed tasks, attachments and comments Largest volume and lowest urgency.

Give every migrated record a stable key from the source system and use it as the coalesce field in the transform map, so that re-running a load updates records instead of duplicating them. Keep a mapping of old record numbers to new ones, because people will keep searching for the old number for months.

Once the order is agreed, the import sets guide covers staging tables and transform maps, the data migration and cutover page covers reconciliation evidence, and the migrating to ServiceNow section lists moves from specific tools. If you want a team to run the load, see ServiceNow migration services.

Frequently asked questions

How long should data migration take?

Depends on volume and complexity. Small migrations require less time than large migrations with millions of records. Speed depends on hardware, network, complexity of transformation. Test migrations on production-like hardware and network to estimate realistic timelines. Plan maintenance windows that are long enough for migration plus some buffer time. Better to finish early than rush and introduce errors.

What should we do with old data that isn't needed in ServiceNow?

Archive it: export to data warehouse, store in external archive, or keep in original source system. Don't just delete it—you may need it for regulatory compliance, audits, or historical analysis. Delete only when retention period expires (varies by data type; consult your retention policy for specific timelines). Document what was archived and where so it's findable if needed.

How do we handle data that doesn't fit ServiceNow's model?

Assess whether the data is needed in ServiceNow. If it's essential, extend ServiceNow's data model (add custom fields, custom tables) to accommodate it. If it's optional, leave it in the source system and integrate as needed. If it's rarely used, consider archiving instead of migrating. Not everything needs to migrate; some historical data is better left in archival systems.

Talk to Oblytech

Planning, running or fixing a ServiceNow programme? Tell us where you are and we will suggest a sensible next step.

Contact us