Skip to main content

Using the Pipeline Health Dashboard

See every import, metric refresh, and planning job for one day on a timeline, and set deadlines that tell you whether your data was ready on time.

Your Toolio data arrives through a chain of work: files land, metrics refresh against them, and planning jobs run on the refreshed numbers. The Pipeline Health dashboard puts one day of that work on a single timeline, so you can see what ran, when it finished, and what is still going.

You can also tell Toolio when your data is supposed to be ready. Set a readiness target — a daily deadline for the pipeline, a phase, or one operation — and the page reports whether each day met it.

Use Cases

  • Answer "is my data ready yet?" without checking the import history and the task drawer separately.

  • Find out why a morning report looked stale — a failed import, a refresh that ran long, or a job that never started.

  • Establish a daily deadline for data readiness and track how often you hit it.

  • Identify which operation consistently holds up the rest of the day.

Where to Find the Pipeline Health Dashboard

Open the profile menu in the top-right corner of Toolio and choose Pipeline Health. The page opens on today in your organization's time zone.

Every timestamp on the page — bars, tooltips, deadlines — is shown in that time zone, and the timeline states which one it is used above the chart.

[Screenshot: The profile menu with Pipeline Health highlighted]

Choosing a Day

Use the arrows on either side of the date button to step back and forward one day, or click the date itself to pick a day from the calendar. Today returns to the current day.

The calendar stops at today. The one exception is an overnight readiness target whose window is already open — when an evening window has opened for tomorrow's deadline, you can step forward one day to watch it.

Use the refresh button in the toolbar to pull in new runs. Deadlines and countdowns keep updating on their own, but the runs themselves are fetched when the page loads and when you refresh.

Reading the Timeline

The timeline is grouped into the three things the pipeline does, in the order they happen:

Group

What it contains

CSV imports

Files ingested into Toolio, the same runs the Data Imports page lists

Metric refresh

Data Refresh work that recalculates metrics against ingested data

Downstream planning

Planning jobs that run on refreshed metrics — Choice Plan, MFP, Allocation, and Settings work

Each group header shows how many runs it holds. Below it, one row per operation — the thing that ran, such as a specific importer or a specific refresh job.

[Screenshot: The timeline with the three phase groups expanded]

Bars and Hover Details

Each bar is one run, drawn from its start time to its finish. Where several runs overlap too closely to draw separately, they are folded into one bar — darker bars hold more runs, and a count appears beside them.

Hover a bar to see the run's status, start and finish times, duration, records processed, error count, who triggered it, and the filename or error reason where there is one. A run triggered by a person shows their email under Triggered by; a run started by the scheduler shows nothing there.

When you are viewing today, a vertical line marks the current time and everything to the right of it is shaded as future. An unfinished run's bar stops at that line rather than running to the edge of the chart.

Run Statuses

The five statuses in the legend and the status filter are:

Status

Meaning

Completed

Finished successfully

Completed with errors

Finished, but some records did not process — check the error count in the tooltip

Failed

Did not finish

Running

Still going

Pending

Queued, or in a state Toolio does not map to the four above

Click the status filter in the toolbar to show only the statuses you care about; each one carries its count for the day. The rows, bars, and counts always describe the same selection, so a filtered timeline is a complete picture of what you selected. Show all statuses clears it.

Breakdown Lanes

A refresh operation that covers more than one resource can be expanded — click the arrow beside the operation name to see one lane per resource, each with its own bars. Rows containing a failure or a warning expand on their own when a day first loads, so problems are visible without hunting for them.

Expand breakdowns and Collapse breakdowns in the timeline header open and close every row at once.

The Right-Hand Columns

Longest run reports the duration of the slowest run in the row, which is what tells you whether a row is slow or simply busy.

vs SLA appears once you have readiness targets configured. It shows how each row did against its deadline, and each group header shows how many of its operations were on time.

A row with runs that have no start time yet shows N awaiting start beside its name. Those runs cannot be plotted, so they are counted rather than drawn.

Setting Readiness Targets

Click Manage targets to open Data readiness targets. A target has three parts:

  • Scope — Whole pipeline, a phase, or a single operation. Search for a phase or operation by name.

  • Window opens — the time before which finishes do not count toward this day.

  • Ready by — the deadline for the day's data to be ready.

Two presets cover the common shapes: Overnight batch (20:00 → 07:00) and Morning refresh (01:00 → 09:00). A new target starts at 01:00 → 09:00. When Window opens is later on the clock than Ready by, the window starts the previous evening, which is what a nightly batch needs.

[Screenshot: The Data readiness targets dialog with a target being added]

💡 These times do not schedule anything. A readiness target describes when you expect data to be ready, and the dashboard measures your existing jobs against it — it does not move, start, or stop them.

Why the Window Matters

Without a window, yesterday's finished refresh would look like today's. Window opens draws the line: a run that finished at or before that time is excluded from the day's assessment, and a run that started earlier but finished inside the window still counts.

It also protects a good result from a later update. If your refresh was ready at 05:00 against a 09:00 deadline, an intraday top-up that starts at 13:00 does not undo that. A first delivery at 10:00, though, is late.

The question-mark icon in the dialog header opens How readiness targets work, which walks through eight worked examples on a shared 01:00 → 09:00 window.

More Specific Targets Win

Targets can overlap, and the most specific one applies. An operation target overrides a target on its phase, and a phase target overrides the pipeline-wide one. Each target card notes what it overrides, so you can see the hierarchy at a glance.

This means you can set one pipeline-wide deadline as your default and then carve out the operations that genuinely need a different one.

Use the edit and delete icons on each card to change or remove a target. Removing the pipeline-wide target leaves your phase and operation targets in place.

Reading the Data Readiness Band

Once you have at least one target, a Data readiness band appears above the timeline. Its headline counts the operations that were ready on time out of the operations a target measured.

Beside it, counters break down what is left. Missed shows on every day. On today you also get At risk (a deadline within the next 30 minutes and nothing ready yet), In progress, and Not due yet. Click a counter to dim every timeline row it does not describe; click it again to clear the highlight. Finish time unavailable appears only when a run finished without recording when — that one is a readout, not a filter.

When you are looking at today, a Next deadline tile names the next moment something is due and which target owns it.

[Screenshot: The Data readiness band showing counters and the next deadline]

Readiness Details

Readiness details opens a panel listing every target, worst result first. Each entry gives the verdict, the deadline, and — for a target covering several operations — how many were on time.

Where something went wrong, the entry names what to look at: Held up by the operation that bound the result, Waiting on one still running, or Slowest lane when a single operation's own lanes are the issue. Click an entry to jump to that row in the timeline.

Verdicts read as plain sentences, and the wording tells you which case you are in:

Verdict

What happened

Met · 4h early

Everything in the window finished ahead of the deadline

Missed · 1h late

The last finish landed after the deadline

In progress · due in 25m

Still running, deadline not reached

Still running · 15m past due

Started in the window, deadline has passed, not finished

Nothing ready · 30m past due

The deadline passed with no eligible delivery

Run failed

A run in the window failed and no successful retry replaced it

Finish time unavailable

The run finished but recorded no finish time

Targets With Nothing to Measure

At the bottom of the panel, Toolio names any target that governed nothing that day. This is not a miss. It happens for two reasons: the scope ran nothing, or a more specific target already judged all of its work.

A target measures whether the work that ran finished in time. It does not require work to run, so a weekly job is not marked late on the six days it was never going to run.

FAQs

Do I need a readiness target to use the page?

No. The timeline works on its own. Targets add the Data readiness band, the vs SLA column, and the deadline markers on the chart.

Will setting a target change when my jobs run?

No. Targets are measurement only. Job scheduling is configured elsewhere and is untouched by anything on this page.

Why is an operation missing from the scope list?

The scope list is built from recent run history plus your enabled refresh metric models. An operation that has not run recently enough to appear in that history cannot be offered a target yet.

Why does a target show "Nothing ready" instead of "Not due yet" on a past day?

Once a day is over, a deadline that passed with nothing eligible is a result rather than a countdown. On today the same target reads as not due yet until its deadline arrives.

A run failed, but the target still says it met. Why?

A failure is answered by a successful retry in the same lane. If the retry finished inside the window, that lane delivered and the target is met.

Why did my counts change without refreshing?

Deadlines and countdowns are recalculated against the live clock, so an in-progress result can become at risk or missed while the page is open. The runs themselves only change when you refresh.

Does this replace the import history or the task drawer?

No. Pipeline Health is a day-level view across all three phases at once. For a single run's full detail — row-level import errors, for example — the Data Imports page is still the place to go.

Did this answer your question?