> ## Documentation Index
> Fetch the complete documentation index at: https://docs.clarityq.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Daily Discovery Jobs

> How ClarityQ automatically detects schema changes and keeps your Table Catalog up to date.

Your data warehouse schema isn't static — tables get new columns, data changes, and structures evolve. ClarityQ runs daily discovery jobs to keep your Table Catalog in sync with your warehouse.

## What the Jobs Discover

Each day, ClarityQ re-scans your cataloged tables and detects:

| Change                     | What Happens                                                                                        |
| -------------------------- | --------------------------------------------------------------------------------------------------- |
| **New columns**            | Added to the catalog in **Pending** status. An email notification is sent to relevant stakeholders. |
| **Removed columns**        | Marked as **Deleted** in the catalog.                                                               |
| **Updated column values**  | Sample values are refreshed for categorical columns (up to 50 distinct values per column).          |
| **Table metadata changes** | Row counts, table size, and last modified timestamps are updated.                                   |
| **Schema changes**         | Data type modifications and structural changes are detected and reflected.                          |

## How to Act on Findings

After a daily job runs, review the changes from the Table Catalog:

### New Columns

New columns appear with **Pending** status. For each one:

* **Review** the column name, data type, and sampled values
* **Accept or edit** the AI-suggested description
* **Approve** the column to confirm it's ready for use
* **Hide** it if it's irrelevant or sensitive

### Removed Columns

Columns that no longer exist in your warehouse are marked as **Deleted**. Review these to confirm they were intentionally removed from the source.

### Updated Values

Column value samples are refreshed automatically. If you see unexpected values, it may indicate a data quality issue upstream.

## Notifications

ClarityQ notifies you when discovery jobs find changes:

* **Email** — Sent when new columns are detected on your tables
* **Slack** — Schema change notifications (if [Slack is connected](/integrations/slack/connecting-slack))

## Manual Refresh

You can trigger a re-discovery at any time without waiting for the daily job:

* **Refresh a single table** — From the table's detail view, trigger a schema refresh
* **Reset column values** — Re-fetch all column values for a specific table

<Note>
  During discovery, the table's state shows as **In Progress**. The catalog auto-refreshes every few seconds so you can track progress in real time.
</Note>