OBLYTECH Logo
OBLYTECH Logo
ServiceNow Integration Hub Optimisation
Home / Guides, Services and Solutions / Services / ServiceNow Integration Hub Optimisation

ServiceNow Integration Hub Optimisation

Existing Integration Hub flows that slow down as data grows, hammer external systems with retries or cost too much to run can usually be improved without changing what they deliver. This page explains how to find the cause, change one step at a time and hand the result over.

Optimising Integration Hub flows starts by separating a slow flow from a slow far system, then changing one thing at a time. This page covers the integration debt that accumulates in quickly built flows, performance profiling and the fixes that follow, architecture standardisation, error handling and retry design treated as a performance problem, monitoring, cost and resource efficiency, a tuning sequence, when tuning will not be enough, and what to hand over at the end.

Typical Starting Problems and Integration Debt

Many organisations build integrations quickly to solve immediate problems but do not revisit them for maintenance. Flows accumulate technical debt: inefficient queries that run slowly, retry logic that hammers external systems with failed calls, or hardcoded values that break when configuration changes. When new developers take over integrations, they find the code difficult to understand and maintain. Integration performance degrades as data volumes grow.

Another issue is scattered integrations. Each team builds integrations independently without sharing patterns or reusable components. This results in inconsistency: different authentication approaches, different error handling, different performance optimisations. When an external system changes, multiple integrations must be updated independently. Standardising integrations reduces maintenance burden and improves reliability.

Flow Performance Analysis and Optimization

We profile your integration flows to identify performance bottlenecks. Common issues include flows that make unnecessary API calls when data could be cached, database queries that are not optimised and retrieve more data than needed, and retry logic that hammers external systems. We recommend specific optimisations: batch multiple operations into a single API call, cache data that does not change frequently, add exponential backoff to retry logic so failing calls do not create excessive load.

We also analyse flow concurrency and resource usage. How many flows can run simultaneously without overwhelming the platform? Are there flows that should run serially because they conflict? Are resource allocations appropriate? Tuning resource allocation and concurrency can significantly improve performance under load.

Integration Architecture and Standardisation

We assess your integration architecture and identify opportunities to standardise. Flows that authenticate the same way should use common connection patterns. Flows that handle similar data should use common data transformation approaches. This standardisation reduces code duplication and makes maintenance easier. New developers can learn common patterns and apply them rather than figuring out each integration individually.

We also identify redundant integrations: multiple flows that accomplish similar goals independently. Consolidation improves performance and maintainability. A single flow that syncs data from an HR system to multiple downstream systems is better than separate flows for each destination. Consolidation might require refactoring but the long-term benefit justifies the investment.

Error Handling and Resilience

Well-designed integrations handle failures gracefully. We audit your error handling: when an external system is unavailable, does the flow retry appropriately or fail immediately? When data validation fails, does the flow quarantine the bad data for investigation or silently skip it? We recommend patterns: retry transient failures with exponential backoff, escalate persistent failures to humans for investigation, log all errors with context so you can troubleshoot issues.

We also assess resilience. If an external system goes down, can your flows continue operating with cached data? Can they queue requests and process them when the system comes back up? Can they failover to a backup system? These resilience measures reduce the impact of external system failures on your operations.

Monitoring and Observability

Integration monitoring should show both functional and performance metrics. Functional: are flows executing successfully or failing? Which flows fail most often? Performance: how long do flows take to complete, how many external API calls do they make, how much data is being processed. We recommend instrumenting flows with structured logging and metrics so these questions can be answered. Modern monitoring provides visibility into integration health and performance.

Alerting should be configured so integration failures are detected quickly. A flow that processes millions of records and is not monitored might fail silently, causing significant data inconsistencies before anyone notices. Alerting ensures failures are caught within minutes.

Cost Optimization and Resource Efficiency

Integrations consume platform resources and external API quota. Excessive API calls inflate costs and risk hitting rate limits. We identify opportunities to reduce consumption: batching operations, caching data, querying only needed fields rather than entire records. We also help optimise scheduled flows: if a flow runs hourly but data only changes daily, running it hourly wastes resources. Optimising frequency and scope can significantly reduce operational costs.

Separating a slow flow from a slow far system

This section is for the technical lead who has been told that an integration is slow and needs to find out where the time goes. A common first mistake on these jobs is to tune the platform side of a flow whose delay is spent waiting for the far system. Measure each step first, because the remedy for a slow external response differs from the remedy for a slow transform or a backed-up queue.

Symptom in run history Most likely cause First check
One outbound step takes most of the run time The far system is slow or the request is large Response time and payload size for that step only
Many short runs queued behind one another Synchronous design where asynchronous would fit Whether the caller waits for a result it does not use
Runs fail in bursts at the same time each day A scheduled load collides with another job or with a far-side batch window The schedule of every job touching the same far system
Steady slow growth in run time Record volume rising, with a lookup or transform scanning more each run Run time against record count across the test window
Retry volume climbing A permanent fault being retried as if it were temporary Error codes on the retried requests

A tuning sequence that avoids changing three things at once

  1. Choose one integration with a clear complaint and a recent history of runs, and record its current run time and error rate.
  2. Time each step separately using the run history, and identify the single step responsible for most of the delay.
  3. Change that one step only, such as switching to a bulk request, reducing the fields requested, or moving a lookup out of the loop.
  4. Run the integration on the same kind of data for the same period and compare the new figures with the baseline.
  5. Keep the change only if the record counts in both systems still match, since a faster flow that drops records is a regression.

Step five is where optimization work often goes wrong. A change that cuts run time while losing a small share of records will look successful in a dashboard and fail at the next reconciliation. Compare counts, not just durations.

Retry design as a performance problem

Retries are usually introduced to improve reliability, but badly chosen retries worsen both reliability and load. A retry that fires immediately after a timeout adds traffic to a system that is already struggling. Retries should back off, have a ceiling, and stop when the response is a client error that will not change on a second attempt. Back-off mechanics are covered on the retry policies page, and the far-side ceiling on the rate limits page.

When tuning will not be enough

Some integrations need redesign rather than tuning. Stop optimizing and plan a rebuild when the flow depends on a synchronous call that the business has outgrown, when the far system’s own limits make the required volume impossible, or when the transform logic has grown so large that no one can explain it. A tuning exercise that keeps finding small gains in a flow that should be replaced wastes the budget that the rebuild needs.

What to hand over at the end of an optimization

  • A before and after table of run time, error rate and record counts for each tuned integration.
  • A note of every setting changed, with the reason and the date it was changed.
  • A run-time threshold the owner sets from their own baseline, rather than a published figure, so that the next slowdown is noticed early.

The handover matters because the same slowdown often returns. A record of what was changed lets the next person decide whether to reverse a change or to extend it. For the monitoring side of that handover, see who should own integration monitoring.

Questions about optimizing Integration Hub flows

Is it better to speed up the flow or the far system?

Only the platform side can be changed by the platform team. If the far system is the slow step, the useful work is to agree a batch window, a bulk endpoint or a request limit with its owner. Tuning the flow around a slow external response rarely removes the delay.

Should a slow integration be moved to a scheduled job?

Sometimes. If the caller does not need the result immediately, moving the work to a scheduled or asynchronous pattern removes waiting from the user’s path. If the user is waiting for the result, a schedule only moves the wait to a later time.

How long should a tuned flow be watched?

Watch it across at least one full business cycle for the process it supports, so that month-end or end-of-day peaks are included. A flow that looks fast on a quiet day can still fail under the peak.

Frequently asked questions

How often should we rewrite old integrations vs. optimizing them?

If a flow is working and only needs performance tuning, optimization is faster than rewrite. If the flow is fundamentally broken or uses outdated patterns, rewrite might be justified. Consider: the cost of rewrite plus risk of breaking things during transition versus the benefit of modernisation. For critical flows, if rewrite risk is high, optimise the existing flow to extend its life, then plan a controlled rewrite later.

Should we implement middleware or use ServiceNow as the central integration hub?

ServiceNow is an excellent central hub for enterprise integrations. Middleware adds complexity and operational burden. Use ServiceNow Integration Hub unless you have specific needs middleware addresses: very high throughput requiring specialised architecture, need to integrate systems ServiceNow cannot reach, or compliance requirements isolating ServiceNow. For most organisations, keeping integrations in ServiceNow simplifies operations.

How do we handle API rate limits imposed by external systems?

Respect rate limits by design. Query external systems efficiently so you do not waste quota. Implement caching so you do not query the same data repeatedly. Implement backoff and retry logic so rate-limited requests are retried rather than failing immediately. Some external systems provide burst quotas; plan large bulk operations outside of peak hours to stay within burst limits. Monitor quota usage and alert if you are approaching limits so you can plan accordingly.

Talk to Oblytech

Planning, running or fixing a ServiceNow programme? Tell us where you are and we will suggest a sensible next step.

Contact us