Metaplane supports adding monitors at both the database and table level. You can add monitors by clicking into your data warehouse from the left hand sidebar, and selecting the database(s) and/or table(s) you'd like to add monitors to. Locate the * Add Monitors button on the top right hand corner to get started.
- At the database and schema level, you'll see a full list of tables that you can add freshness, column count, row count, or custom SQL monitors to. You can select all tables with the checkbox next to the filter search to bulk add monitors.
- At the table level, you'll be able to apply any of the monitor types that Metaplane supports.
After creating a monitor, Metaplane will begin collecting the metadata and training our models immediately. The training period can be as little as 3 days.
Monitors are run each hour by default. By clicking into a monitor page, you can change the frequency through the dropdown on the top right corner:
We recommend starting with Freshness and Volume monitors, as stale data or a shift in the change in row count are common early indicators that there's a data quality issue present. If you navigate to the database object in the Metaplane UI, and then click on the "Monitors" tab, you'll be able to a curated recommendation list of where to automatically place monitors, based on usage.
We recommend placing these monitors, which efficiently use metadata, on your "landing zones" (i.e. tables that you load data into) and "curated tables" (i.e. tables that sit closest to your data product(s)). If you're looking for tactical advice, based on what other customers are doing, or just a sounding board, our team is always available to chat!
You'll be able to create multiple monitors in once either through the API or through the UI as shown below. Using the UI to bulk create monitors follows the same process as creating a single monitor.
Updated 3 months ago