Your data warehouse schema isn’t static — tables get new columns, data changes, and structures evolve. ClarityQ runs daily discovery jobs to keep your Table Catalog in sync with your warehouse.Documentation Index
Fetch the complete documentation index at: https://docs.clarityq.ai/llms.txt
Use this file to discover all available pages before exploring further.
What the Jobs Discover
Each day, ClarityQ re-scans your cataloged tables and detects:| Change | What Happens |
|---|---|
| New columns | Added to the catalog in Pending status. An email notification is sent to relevant stakeholders. |
| Removed columns | Marked as Deleted in the catalog. |
| Updated column values | Sample values are refreshed for categorical columns (up to 50 distinct values per column). |
| Table metadata changes | Row counts, table size, and last modified timestamps are updated. |
| Schema changes | Data type modifications and structural changes are detected and reflected. |
How to Act on Findings
After a daily job runs, review the changes from the Table Catalog:New Columns
New columns appear with Pending status. For each one:- Review the column name, data type, and sampled values
- Accept or edit the AI-suggested description
- Approve the column to confirm it’s ready for use
- Hide it if it’s irrelevant or sensitive
Removed Columns
Columns that no longer exist in your warehouse are marked as Deleted. Review these to confirm they were intentionally removed from the source.Updated Values
Column value samples are refreshed automatically. If you see unexpected values, it may indicate a data quality issue upstream.Notifications
ClarityQ notifies you when discovery jobs find changes:- Email — Sent when new columns are detected on your tables
- Slack — Schema change notifications (if Slack is connected)
Manual Refresh
You can trigger a re-discovery at any time without waiting for the daily job:- Refresh a single table — From the table’s detail view, trigger a schema refresh
- Reset column values — Re-fetch all column values for a specific table
During discovery, the table’s state shows as In Progress. The catalog auto-refreshes every few seconds so you can track progress in real time.