Incremental loading

Incremental loading extracts only new or updated records since the last pipeline run, improving efficiency. When incremental loading is enabled, specify: - Incremental column: The column used to filter and extract only new or updated records since the last extraction. If no previous extraction exists, a full load is performed. - Incremental partition: Optionally, specify a partition column to improve extraction performance.

Incremental loading requirements

To be able to use incremental loading, the following requirements must be met: - An incremental column (for example, DateModified) must be available in your source. - The incremental column must be of type date or datetime.

Deletions

Deletions are not detected with incremental loads. To capture deletions, schedule periodic full loads.
For more information, see Loadgroups.