Configure End-to-End Orchestration and Monitoring

Note: This article is intended for database administrators. Ensure the following tasks are completed by someone with the appropriate database administration privileges.

Generating end-to-end tasks

See Generate End-To-End Tasks and Execution Packages for full instructions. The high-level steps are as follows:

1. Open the desired Deliver instance and create an execution package. Ensure the Semantic Model within the Deliver instance is added to Include Steps.
2. Right-click on the execution package and select Generate End-To-End Tasks and Packages.
   Note:

   If any changes are made to the semantic model, update the auto-generated objects by repeating this step.

3. This automatically generates a perspective, an execution package in the relevant Prepare instances, and transfer tasks in the relevant Ingest instances and data sources.

Configuring on-demand ingestion (optional)

On-demand ingestion is a quick way to ensure data is always refreshed from the source when Prepare instances are executed. See On-Demand Ingestion for more information.

1. Identify the data sources used to populate the model. You can do this by:
   • Examining the data lineage of the desired semantic model, or
   • Checking which data sources have an auto-generated task.
2. Right-click on the data source and select Edit Data Source.
3. Click Advanced Settings and check the Enable data on demand box. This allows the data source to transfer data into Ingest instance storage before the Prepare instance ingests it.

Configure Jet Analytics Orchestration

See Getting Started with Orchestration and Scheduling Data Integration Execution Packages in Jet Analytics Orchestration for full instructions. The high-level steps are as follows.

Add the data provider

1. Generate an API key in Security and Permissions within the Jet Analytics Portal.
2. In the Jet Analytics Orchestration Desktop, add a new Data Provider with your system and Jet Analytics SaaS as the data source type.
3. Paste the API key generated in the previous step and test the connection.

Create a package

1. Add your Jet Analytics Data Integration execution packages in Jet Analytics Orchestration by right-clicking Packages > New > Jet Analytics Prepare.
2. Select the execution package.
3. Repeat for all execution packages you want to orchestrate.

Add multiple packages to a process

1. Right-click Processes > New > Process.
2. Click Add Steps.
3. Drag and drop packages from the right-side pane.
4. Save the process.

Create a process map

1. Right-click Process Map > New > Process Map.
2. In the right-side pane, find the Process property and link the process map to the process you created.
3. Click Background to design the process map.
4. Click Items and drag and drop your packages from the right-side pane onto the map.

Add a schedule

1. Select a predefined schedule group or create a new one.
2. Drag and drop your desired process.
3. Configure the schedule.
4. Save and deploy your changes.