Monitoring

Schema events

Read the feed of source schema changes, see how SQL Flow handled each one, and find the tables that need your review.

The Schemas page lists the schema changes (DDL) that agents detected on the tables your pipelines capture, from every source, and what SQL Flow did with each one: apply it on the target, or hold the table for your review. For how schema changes reach each target, see Schema changes.

Open it from Schemas in the top navigation.

Summary tiles

Four tiles sit above the feed:

TileWhat it counts
AppliedEvents SQL Flow carried to the target, such as auto-propagated.
DetectedEvents SQL Flow noticed and didn't apply by itself, such as needs review.
BlockedEvents whose action starts with blocked. The figure turns red when it isn't zero.
Tracked tablesThe number of tables all your pipelines capture.

The first three count the events in the feed and follow the Filter by pipeline choice. They don't show whether a change is still waiting for you: use the pipeline's Schema review card for that.

Read the feed

Recent schema events has one row per event, newest first:

ColumnMeaning
WhenHow long ago the agent reported the event.
TableThe source table, with its schema.
ChangeA chip for the kind of change, followed by the statement.
ActionWhat SQL Flow did.

Select a row to open its pipeline.

Kinds of change

ChipMeaning
ADD COLUMNA column was added.
DROP COLUMNA column was dropped.
ALTER TYPEA column's type, nullability or position changed.
RENAME COLUMNA column was renamed.
INCOMPATIBLEThe capture no longer matches the source table, so it is blocked. The statement reads like Source schema changed for <table> (capture <instance>). The current capture no longer matches the source. Reload this table to resume.

When one statement changes several things, the chip shows the most significant one. DROP COLUMN and ALTER TYPE chips are amber, because they can discard data or change what the target holds.

Actions

ActionMeaning
auto-propagatedSQL Flow applied the change on the target, in order with the data. Nothing for you to do.
appliedSQL Flow confirmed that the change is on the target.
blocked · source schema changedThe capture can't follow the change. Reload the table, as the statement says.
needs reviewSQL Flow didn't apply this change automatically, for example a rename or a type change. If the target can't make the change exactly, SQL Flow holds that table at the change while every other table keeps streaming. Open the pipeline and look for a Schema review card. See Held schema changes.

A held table doesn't raise an alert. If a pipeline's source schema changes, check this page or the pipeline for a Schema review card.

Filter by pipeline

Choose a pipeline in Filter by pipeline to see its events only, or All pipelines to clear the filter. The filter is part of the page address, so you can share the filtered view. The same events are on the pipeline's Schema tab, under Schema changes.

How long events are kept

Schema events are deleted after 14 days.

See also

Previous
Alerts

If this was useful,
our newsletter will be too.

Get monthly insights on data engineering, AI, and building critical infrastructure - direct from the Spectral Core team and CEO Damir Bulic.