| \n\nObject\n\n | \n\nInformation cataloged\n\n |
|---|---|
| \n\nColumns\n\n | \n\nName, Description, JDBC type, Column Type, Is Nullable, Default Value, Column size, Column index\n\n Extended metadata: Tags\n\n **Note:** Deprecated columns and any lineage related to these deprecated columns are not cataloged.\n\n |
| \n\nTable\n\n | \n\nName, Description, Schema, Primary key, Foreign key\n\n Extended metadata: Tags, Owner, Type, Creation date, Last Modified, Location, Provider, Version, Size, File Count, Partition Columns, Properties\n\n |
| \n\nModel\n\n | \n\nName, Owner, Description, Created By, Created At, Last Modified By, Last Modified At, Securable Kind, Securable Type\n\n |
| \n\nViews\n\n | \n\nName, Description, SQL definition, Tags\n\n |
| \n\nSchema\n\n | \n\nName\n\n Extended metadata: Tags\n\n |
| \n\nDatabase\n\n | \n\nType, Name, Server, Port, Environment, JDBC URL\n\n Extended metadata: Tags\n\n |
| \n\nNotebook\n\n | \n\nNotebook ID, Path, Language Type \\(SQL, Python, Scala, R\\)\n\n |
| \n\nFunction\n\n | \n\nName, Description, Function Type\n\n |
| \n\nJob\n\n | \n\nTitle, Description, Creator, Created At, Job run as, Format, Max Concurrent Runs, Notification On Start, Timeouts \\(sec\\), Notification On Success, Schedule, Git Source, Notification on Failure, Tags, List of tasks, List of clusters\n\n |
| \n\nCluster\n\n | \n\nName, Description, Node Type ID, Driver Node Type ID, Spark Version, Number of Workers, Autoscale Max Workers, Autoscale Min Workers, AWS Attributes, Tags\n\n |
| \n\nTask\n\n | \n\nTask Key, Type of Task \\(Notebook, dbt, Spark jar, Python script, Python wheel, Pipeline task, SQL\\), Task timeout, Retry interval, Cluster used by the task, Max retries, Depends on, Libraries, Notifications \\(On start, On success, On failure\\), Notebook File Path, Notebook Source, Notebook Parameters, Spark Jar Main Class Name, Spark Jar Parameters, Python Script File path, Python Script Parameters, Spark Submit Parameters, Pipeline ID, Pipeline Full Refresh, Python Wheel Package Name, Python Wheel Entry Point, Python Wheel Parameters, SQL Warehouse, SQL Query ID, SQL Dashboard ID, SQL Alert ID, Dbt Project Directory, Dbt Profiles Directory, Dbt warehouse, Dbt catalog, Dbt schema, Dbt commands\n\n |
| \n\nExternal Location\n\n | \n\nName, External URL, Description, Data Source Type, Created Date, Created By, Owner\n\n |
| \n\nStorage Credential\n\n | \n\nName, Description, Credential, Created Date, Created By, Owner\n\n |
| \n\nVolume\n\n | \n\nName, Description, Type, Owner, Created By, Created At, Last Modified By, Last Modified At, Metastore ID\n\n |
| \n\nMaterialized View\n\n | \n\nName, SQL Definition, Created, Last Modified\n\n |
| \n\nMetric View\n\n | \n\nName, Description, YAML Definition, Source Table, Source Table Type, Filter, Created, Last Modified\n\n |
| \n\nObject\n\n | \n\nInformation Cataloged\n\n |
|---|---|
| \n\nRow Filter Access Control\n\n | \n\nName\n\n |
| \n\nColumn Mask Access Control\n\n | \n\nName\n\n |
| \n\nAttribute Based Access Control\n\n | \n\nName, Description, Created by, Created at, Modified by, Modified at, On securable type, For securable type, To principals, Except principals\n\n |
| \n\nWorkspace bindings\n\n | \n\nWorkspace ID, Binding type\n\n |
| \n\nPrivileges\n\n | \n\nGranted to, Granted by, Privilege type, Granted on object, Inherited from\n\n |
| \n\nData asset page\n\n | \n\nRelationships\n\n |
|---|---|
| \n\nTable\n\n | \n\n- Columns contained in Table\n- Table Indexes\n- Has privileges\n\n Columns contained in Table\n\n |
| \n\nSchema\n\n | \n\n- Database that contains Schema\n- Table that is part of Schema\n- Has privileges\n\n |
| \n\nDatabase\n\n | \n\nSchema contained in Database\n\n |
| \n\nColumns\n\n | \n\n- Table Indexes\n- Table containing Column\n\n |
| \n\nTable Indexes\n\n | \n\nColumns\n\n |
| \n\nJob\n\n | \n\n- Clusters used by tasks in Job\n- Tasks contained within Job\n\n |
| \n\nCluster\n\n | \n\n- Cluster contained in job\n- Task using Cluster\n\n |
| \n\nTask\n\n | \n\n- Job containing Task\n- Cluster used by Task\n- Tasks depending on Task\n\n |
| \n\nNotebook\n\n | \n\n- Folder containing Notebook\n- Task sourcing data from Notebook\n\n |
| \n\nFolder\n\n | \n\n- Folders contained in Folder\n- Notebooks contained in Folder\n\n |
| \n\nExternal Location\n\n | \n\n- Uses storage credential\n- Connects to datasource \\(S3 bucket, S3 Object, Azure container or Azure blob\\)\n- Has workspace bindings\n\n |
| \n\nStorage Credential\n\n | \n\n- Has workspace bindings\n- Used by External Location\n\n |
| \n\nModel\n\n | \n\n- Registered in schema\n- Stored in data assets \\(S3 Bucket, S3 Object\\)\n\n |
| \n\nVolume\n\n | \n\n- Contained within schema\n- Stored in data assets \\(S3 Bucket, S3 Object\\)\n\n |
| \n\nMaterialized View\n\n | \n\n- Schema that contains Materialized Views\n- Columns that are part of Materialized Views\n\n |
| \n\nMetric View\n\n | \n\n- Schema that contains Metric Views\n- Columns that are part of Metric Views\n\n |
| \n\nPipeline\n\n | \n\n- Copies data to Databricks Table/Database Schema\n- Ingests data from Database Table/Database Schema\n\n |
| \n\nUnity Catalog Metastore\n\n | \n\nDatabases contained in metastore\n\n |
| \n\nRow Filter Access Control\n\n | \n\n- Applies to table\n- Uses function\n- Using column\n- Contained within schema\n\n |
| \n\nColumn Mask Access Control\n\n | \n\n- Applies to column\n- Uses function\n- Contained within schema\n\n |
| \n\nAttribute Based Access Control\n\n | \n\n- Applies to catalog, schema and table\n- Defined on catalog, schema and table\n- Uses function\n\n |
| \n\nCatalog\n\n | \n\n- Has workspace bindings\n- Has privileges\n\n |
| \n\nObject\n\n | \n\nLineage available\n\n |
|---|---|
| \n\nColumn in view\n\n | \n\nThe collector identifies the associated column in an upstream view or table for both Hive metastore and Unity Catalog: - Where the data is sourced from\n- That sort the rows via ORDER BY\n- That filter the rows via WHERE/HAVING\n- That aggregate the rows via GROUP BY\n\n **Note:** Deprecated columns and any lineage related to these deprecated columns are not cataloged.\n\n |
| \n\nNotebook\n\n | \n\nTasks that reference Notebook. \\(Only if Databricks Unity Catalog is enabled\\).\n\n |
| \n\nTable\n\n | \n\n- The collector identifies the upstream and downstream tables and their external locations \\(S3 and ADLS Gen2 data assets\\) along with the intermediate Job.\n- The collector harvests the Databricks table lineage to S3 object.\n\n |