Add Prepare Instances
Note: Relates to Jet Analytics Data Integration 6024.1 and later versions.
The Prepare instance is the area in Jet Analytics Data Integration where you map data from your Ingest instance, then cleanse, transform, and consolidate it into a reliable, consistent data warehouse. Jet Analytics Data Integration supports several storage types depending on your use case.
Add a Prepare instance
Navigate to Data Estate > Instances, click Add Instance >Add prepare instance.
General
- In the Instance name box, enter a name to identify the instance in the Portal and in Jet Analytics Data Integration.
- (Optional) In the Instance description box, enter additional context — for example, the intended storage type and environment name.
- In the Log Retention Days box, adjust the number of days execution logs should be retained. The default is 90 days.
- Enable Team Development to allow multiple developers to access the instance simultaneously.
- Select the Server storage type you want to use.
Note: All connection credentials are protected with 256-bit AES encryption.
SQL Server storage
- In the Server name box, enter the name of the server where the database will be stored. For named instances, use the format ServerName\InstanceName.
- In the Database box, enter the name for the database to create. Jet Analytics Data Integration creates this database when you click Create Storage… in the Edit Instance dialog — see Create Prepare storage below.
- In the Authentication list, select the authentication mode:
- Windows Authentication: Uses the logged-in Windows user's credentials.
- SQL Server Authentication: Uses a SQL Server login. Enter the username and password in the corresponding fields.
- Azure AD Password Authentication: Uses Azure AD credentials from a domain that is not federated with Azure AD. Enter the username and password.
- Azure AD Integrated Authentication: Uses the logged-in Windows user's credentials, provided the user is signed in with Azure AD credentials from a domain federated with Azure AD.
- (Optional) In the Connection timeout box, enter the number of seconds to wait before terminating a connection attempt. Set to 0 to wait indefinitely.
- (Optional) In the Command timeout box, enter the number of seconds to wait before terminating a command. Set to 0 to wait indefinitely.
- In the Batch size box, enter the number of rows to copy when using ADO.NET transfer. Set to 0 for unlimited.
- (Optional) In the Encrypt connection list, configure connection encryption:
- No: Communication is not encrypted (default).
- Yes: Communication is encrypted and the server certificate is verified by a certificate authority.
- Yes, trust server certificate: Communication is encrypted but the server certificate is not verified. Not recommended for public networks.
- (Optional) In the Additional connection properties box, enter any connection string properties not available in the UI. These override values in the other fields.
Dedicated SQL Pool storage
See Use Azure Synapse Dedicated SQL Pool for Prepare Instance Storage for configuration instructions.
Snowflake storage
See Use Snowflake for Prepare Instance Storage for configuration instructions.
Transfer from Ingest
This section controls how data is transferred from Ingest storage to the Prepare storage.
In the Technology list, select the transfer method:
- ADO.NET (default): Uses the ADO.NET framework on the Ingest server to transfer data.
-
A significant volume of data is transferred from Ingest to Prepare frequently, or
The Ingest server becomes overloaded during transfer.
Azure Data Factory: Automatically generates an ADF pipeline to transfer data from the Ingest server to the Prepare storage. Recommended when: If selected, connection information for your Azure Data Factory resource is required. See Use Azure Data Factory for Data Movement for details.
Note: Azure Data Factory transfer is not supported when using Snowflake storage.
Click Save to create the Prepare instance.
Jet Analytics Data Integration must be refreshed to display newly created Prepare instances.
Edit a Prepare instance
Navigate to Data Estate > Instances.
- Click the instance to open the instance details page.
- Click Edit, make the desired changes, and click Save.
Jet Analytics Data Integration must be refreshed to display newly created Prepare instances.
Delete a Prepare instance
Navigate to Data Estate > Instances.
- Click Delete next to the instance. The Delete confirmation dialog appears.
- Enter the instance name to confirm, add a comment (reason for deletion), and click Delete.
Create Prepare storage
Before deploying and executing tables in a Prepare instance data area, the data storage must be created.
- In Jet Analytics Data Integration, right-click the instance and select Edit Instance.
- Click Create Storage…Jet Analytics Data Integration runs the necessary scripts to create the database.