Skip to content

Organize Data Loads with Load Planner Groups in NCC Portal

A Loadgroup in NCC Portal is a collection of entities, such as Landing Zone or Gold, that share a unified load schedule. Loadgroups enable efficient management and organization of data loading processes.

Default Loadgroup

By default, all entities are assigned to the Default loadgroup. This configuration ensures that all entities are loaded through the Landing Zone, Bronze, Silver, and Gold layers.

Advantages of Additional Loadgroups

Adding extra loadgroups allows you to:

  • Schedule more frequent loads for specific entities (for example, daily, weekly, or custom intervals).
  • Align data loading with maintenance windows for database servers.
  • Isolate unreliable APIs, enabling targeted retries for affected entities.
  • Reload only Gold Layer entities after updating business logic in your Semantic Model or Warehouse.

Add Entities to a Loadgroup

You can add entities to a loadgroup in two ways: via the Landing Zone entity or Gold entity screens, or through the Load Planner Groups page.

NOTE
You can remove entities from Load Planner Groups using the same two methods as adding them. Instead of adding the entity to a new Load Planner Group, select the bin symbol next to the Load Planner Group you want to remove the entity from.

IMPORTANT
When you add a Landing Zone entity to a Load Planner Group that is linked to multiple Bronze entities, all Bronze entities and their linked Silver entities will be loaded when the Load Planner Group is triggered.

Add via the Entity Page

To add a Landing Zone or Gold entity to a Load Planner Group:

  1. Navigate to the entity page.
  2. Click the Load Planner symbol:
    Selecting the Load Planner Group symbol
  3. In the dialog that appears, select the Load Planner Group to add the entity to.
    Adding the entity into the Load Planner Group

IMPORTANT
Adding an entity that is already promoted to Production to a Load Planner Group in Development will only add the entity to the Development Load Planner Group. You must promote the entity to Production to include it in the Production Load Planner Group.

Add via the Load Planner Groups Page

To add entities using the Load Planner Groups page:

  1. Select the Load Planner Group you want to use and click the pencil symbol to edit or create a Load Planner Group.
    Selecting the Load Planner Group
  2. Select the entity you want to add.
    Adding Entities to the Load Planner Group
  3. Save the updated Load Planner Group.

Configure a Loadgroup Schedule

To configure a schedule for a loadgroup:

  1. Create a pipeline.
  2. Add an Invoke Pipeline activity.
  3. Set the LoadGroups parameter to a comma-separated list of loadgroup names (no spaces).
  4. In the ribbon, select Schedule and configure the desired schedule.

WARNING
Ensure the pipeline schedule does not overlap with the load duration. For example, if loading a group takes 9 minutes, schedule intervals greater than 9 minutes to avoid concurrent runs.

Loadgroup schedule example

TIP
Use the Capacity Metrics App to verify that your schedule fits within available capacity.