Step 3: Configure a Silver Layer entity¶
The Silver Layer stores data in SCD Type 2 format, enabling historical tracking of changes.
To configure a Silver Layer entity, provide the following details:
Source configuration¶
- Pipeline: Obsolete, can be ignored.
- Schema: Automatically filled when creating a Bronze entity and cannot be altered in this stage.
- Name: Automatically filled when creating a Bronze entity and cannot be altered in this stage.
- Entity value: Use Entity value to add key-value pairs for extraction. These are often optional, but required for certain scenarios. To see the complete list of entity values applicable for the Silver entities click here.
Target configuration¶
- Lakehouse: Select the lakehouse where your data will be stored.
- Schema: Name of the schema where the Silver table will be stored in the lakehouse.
- Name: Name of the table where the data will be stored.
- Columns to exclude: Exclude specific columns from being loaded from Bronze to Silver.
- Columns to exclude from history: Exclude columns from historical tracking (for example, frequently changing comments or system-generated timestamps).