Batch operations · Reconciliation

Find what drifted. Repair the batch deliberately.

Omni Loader reads sorted source and target snapshots, writes durable added, changed, and deleted difference artifacts, and can apply inserts, updates, and deletes as a controlled repair step.

The job to be done

Move the full dataset without turning failure into a restart.

A large migration is not finished when the first rows arrive. Omni Loader keeps parallel work productive, adapts the loading path to the target, and records enough progress to recover the part that failed.

Readers sort by the selected key, stream both sides, and classify rows as additions, changes, or deletions while writing reviewable difference files.

Why this path matters

Compare complete source and target views.

Readers sort by the selected key, stream both sides, and classify rows as additions, changes, or deletions while writing reviewable difference files.

What changes for you

Configure key selection and equality behavior for types where formatting, precision, or target representation require deliberate tolerance.

The outcome

Compare complete source and target views, review durable difference artifacts, and decide when repairs should be applied.

The payoff

See what the capability changes.

3 outcomes

Added · changed · deleted

Classify differences instead of reporting one opaque mismatch.

On disk

Durable diff artifacts

Review comparison output independently of the live readers.

Optional

Apply repairs

Choose whether detected differences should modify the target.

Where the work happens

The details that make the result usable.

Read each capability as part of the operating path. The important question is not whether a feature exists, but what work it removes and what evidence it leaves behind.

At a glance

A visual summary of the work.

Repair is a separate, operator-visible stage. This is recurring snapshot reconciliation, not transaction-log CDC or a zero-downtime change stream.

Illustration of changes spreading through a reconciliation process

Sorted snapshot comparison

Compare complete source and target views.

Readers sort by the selected key, stream both sides, and classify rows as additions, changes, or deletions while writing reviewable difference files.

Equality controls

Tune comparison for real data.

Configure key selection and equality behavior for types where formatting, precision, or target representation require deliberate tolerance.

Batch repair

Apply inserts, updates, and deletes from a completed comparison.

Repair is a separate, operator-visible stage. This is recurring snapshot reconciliation, not transaction-log CDC or a zero-downtime change stream.

The path to confidence

See the work. Make the call. Prove the result.

The page keeps the product detail close to the decision it supports. Your team can see what the software handles automatically, what it changes for the target, and what the result leaves ready to operate.

  1. Compare complete source and target views.

    Readers sort by the selected key, stream both sides, and classify rows as additions, changes, or deletions while writing reviewable difference files.

  2. Tune comparison for real data.

    Configure key selection and equality behavior for types where formatting, precision, or target representation require deliberate tolerance.

  3. Apply inserts, updates, and deletes from a completed comparison.

    Repair is a separate, operator-visible stage. This is recurring snapshot reconciliation, not transaction-log CDC or a zero-downtime change stream.

Keep the plan connected

Take the next useful step.

A capability becomes easier to operate when the next decision follows from the constraint you just uncovered. Explore the related work that completes this part of the path.

Your working set

What this page leaves you with

  • Added · changed · deleted
  • Durable diff artifacts
  • Compare complete source and target views.
  • Tune comparison for real data.
  • Reconcile snapshots with a controlled repair workflow.

Take the next step

Reconcile snapshots with a controlled repair workflow.

Compare complete source and target views, review durable difference artifacts, and decide when repairs should be applied.

Plan my migration