Autonomous in the loop. Accountable at the gates. An agentic offering by Plainsight

The migration ends. The documentation doesn't.

Most migrations finish with a working platform and a documentation debt. This one finishes with both: the platform, and a living layer of documentation around it. Source-to-target lineage, a data dictionary, navigable transformations and data-quality tests, generated as the build happens and yours to keep.

What it is

The output side of the knowledge base.

The knowledge base documents your legacy estate: what your pipelines do today. This is the other end of the same story: your new platform, documented. As the builders generate the assets, the Cartographer stitches the lineage and the Chronicler writes the dictionary and runbooks, so the platform arrives explained, not just running.

  • Every table traced from the old estate to its new home
  • Generated from the build, not written up afterwards
  • Flavor-agnostic: the same lineage and docs in dbt or your own framework
  • Delivered into your repository and catalog: it's yours

Source-to-target lineage

sample · customer + orders
data lineage
SOURCE STAGING · SILVER MART · GOLD crm.customer source erp.address source erp.orders source stg_customer view stg_address view stg_orders view dim_customer snapshot · SCD2 fct_orders table

A sample: every model traced from source system to final mart, the whole estate as one graph.

More than the default

By default you get tables. You also keep the map.

A lift-and-shift, or the platform's own defaults, move the data and leave the understanding behind. The difference isn't the platform. It's what you can still explain a year later.

A lift-and-shift, or platform defaults

  • DocumentationWhatever survived in people's heads
  • LineageReconstructed by hand when something breaks
  • Data qualityDiscovered in production
  • OnboardingShadow a senior engineer for weeks

What the fleet leaves you Plainsight

  • DocumentationA data dictionary, generated and current
  • LineageNavigable, source to target, across the estate
  • Data qualityTests that ship with the build
  • OnboardingDocs a new hire can read on day one

You'd get the platform either way. The understanding of it is what you keep.

Who writes it

Written by the fleet, owned by you.

The Cartographer stitches the lineage; the Chronicler writes the data dictionary, runbooks and onboarding guides as the platform is built; the Test agents and the Reconciler generate the data-quality tests. Everything they produce lands in your repository and your platform's own catalog, never a portal you rent from us.

And because the tests run inside the build-test-run loop, the documentation keeps pace with the platform rather than lagging behind it. See how the loop works → · how the gates work →

A team reviewing the platform's generated documentation together
See it for real

Not slides. The actual generated artifacts.

Real output from a dbt build: the lineage graph, the searchable catalog and the documented BI consumers. Click any image to enlarge.

A dbt lineage graph: source models on the left flow through intermediate models into analytical marts on the right.
Source-to-target lineage. Every model traced from source to mart. Data lineage →
The dbt docs overview: a data platform catalog listing the bronze, silver and gold layers and their source systems.
A searchable catalog. Every layer, model and source, defined. Data dictionary →
A single model page in the dbt catalog with its description, typed columns, tests and a lineage graph.
One model, documented. Description, columns, tests and lineage in one place. Data dictionary →
A dbt exposure page for a Power BI dataset, showing its owner, description and the models it depends on.
Even your BI consumers. Power BI datasets documented as exposures. Living documentation →
Good questions

What you keep, answered.

Is the documentation ours?

Yes. It is generated into your repository and your platform’s own catalog, and delivered with the migration. Your code and data are analyzed for your migration only, never used to train models.

How is this different from the knowledge base?

The knowledge base documents your legacy estate: the input. This is your new platform documented: the output, with lineage, a data dictionary, tests and runbooks for what you actually run. The source-to-target lineage is the bridge between the two.

Does it stay current after go-live?

It is generated from the build, so it regenerates when the build changes, and the data-quality tests run on every pipeline run. The documentation and the guarantees move with your platform instead of rotting into a stale wiki.

Do we need dbt for this?

No. The dbt flavor ships dbt docs and dbt tests; in your own framework the Chronicler and the Cartographer generate the same lineage, dictionary and tests into your repo and catalog. Either way, you keep them. dbt or your own framework →

Where does it actually live?

In your Git repository and, where the platform supports it, its native catalog: Microsoft Purview and the OneLake catalog on Fabric, Unity Catalog on Databricks. Browsable by your team, diffable in version control.

Let's talk

Want to see what you'd keep?

The estate assessment documents a representative slice of your estate, so you can see the lineage, the dictionary and the tests you'd be left with before you commit.

Plan my migration

A short form, no spam. We usually reply within one business day.

Plan my migration