Skip to main content

Add Ingest Instances

Ingest instances are added in the Jet Analytics Portal. Unlike Prepare and Deliver instances, a few additional steps are required before an Ingest instance can be used in Jet Analytics Data Integration — specifically, the Jet Analytics Ingest Service must be installed on a server and configured to run the Ingest instance.

When creating an Ingest instance in the Jet Analytics Portal, specify the hostname and port of the machine where the Ingest Service is or will be installed. The hostname is the IP address or DNS name of that machine. The port is the port number the Ingest Service listens on — ensure that this port is open on the host machine using an inbound firewall rule to allow connections from Jet Analytics Data Integration.

Note: All connection credentials are protected with 256-bit AES encryption.

Add an Ingest instance

In the Jet Analytics Portal, navigate to Data Estate > Instances, click Add new instance, and then click Add Ingest instance. The form is divided into three sections.

The Jet Analytics portal is managed by the insightsoftware Support team. For assistance or additional information, reach out to Product Support .

General

  1. In the Name box, enter the name for the Ingest instance.
  2. In the Description box, enter a description. The description is displayed on the instance details page in Jet Analytics Data Integration.
  3. (Optional) In the Log Retention Days box, adjust the number of days logs should be kept. The default is 90 days.
  4. In the Storage type list, select the type of storage:

Note: SQL Server Authentication is required for Azure SQL Database, Azure SQL Managed Instance, and SQL Database storage types.

Storage

For SQL Server storage, complete the following fields:

  1. In the Server name box, enter the name of the SQL Server. For named instances, use the format ServerName\InstanceName.
  2. From the Server type list, select the SQL server type. This only needs to be changed if using an Azure Dedicated SQL Pool (formerly Azure SQL Data Warehouse).
  3. In the Database box, enter the name for the Ingest instance database. This database is created during initialisation in Jet Analytics Data Integration.
  4. In the Username box, enter the SQL authentication username. Windows Authentication is not supported.
  5. In the Password box, enter the password for the SQL authentication account.
  6. (Optional) In the Connection timeout box, enter the number of seconds to wait before terminating a connection attempt. Set to 0 to wait indefinitely.
  7. (Optional) In the Command timeout box, enter the number of seconds to wait before terminating a command. Set to 0 to wait indefinitely.
  8. In the Batch size box, enter the number of rows to copy when using ADO.NET transfer. Set to 0 for unlimited.
  9. (Optional) In the Encrypt connection list, select the encryption option:
    • No: Communication is not encrypted (default).
    • Yes: Communication is encrypted and the server certificate is verified by a certificate authority.
    • Yes, trust server certificate: Communication is encrypted but the server certificate is not verified. Not recommended for public networks.
  10. (Optional) In the Additional connection properties box, enter any connection string properties not available in the UI. These override values in other fields.
  11. Click Save.

Note: Jet Analytics Data Integration must be refreshed to display newly created Ingest instances.

Ingest Server Connection Information

This section provides the connection information that Jet Analytics Data Integration uses to connect to the Ingest Service. The Ingest Service does not need to be installed before completing this section — these settings can be updated later if needed.

Note:

One Ingest Service can only host one Ingest instance. Each Ingest instance must have unique connection settings in this section.

  1. In the IP or hostname box, enter the IP address or hostname of the machine where the Ingest Service is or will be installed. In Azure, use the public IP address or DNS name of the VM. This address must be reachable from machines running Jet Analytics Data Integration and the Jet Analytics Execution Service. If all services are running on the same machine (such as in a sandbox environment), enter localhost.
  2. In the Port box, enter the port number. The default is 20000. Ensure this port is open on the host machine's firewall and any network firewalls between the Ingest Service and client machines.

Firewall Rules

If the Ingest Service is running on a VM in Azure, create an inbound security rule in the VM's networking settings for the port defined in the Ingest Server Connection Information section above.

Note:

The inbound rule on port 20000 (or the port you configured) must be set on the VM where the Ingest Service is running, allowing inbound TCP connections from machines running Jet Analytics Data Integration and the Jet Analytics Execution Service. If using DNS names rather than IP addresses for the hostname, configuration is more resilient to IP address changes.

Edit an Ingest instance

In the Jet Analytics Portal, navigate to Data Estate > Instances.

The Jet Analytics portal is managed by the insightsoftware Support team. For assistance or additional information, reach out to Product Support .

  1. Click on the instance to open the instance details page.
  2. Click Edit, make the desired changes, and click Save.

Note: Jet Analytics Data Integration must be refreshed to retrieve the latest changes for an Ingest instance.

Delete an Ingest instance

In the Jet Analytics Portal, navigate to Data Estate > Instances.

The Jet Analytics portal is managed by the insightsoftware Support team. For assistance or additional information, reach out to Product Support .

  1. Click Delete next to the instance. The Delete confirmation dialog appears.
  2. Enter the instance name to confirm, add a comment (reason for deletion), and click Delete.

Initialise the Ingest instance in Jet Analytics Data Integration

Create Ingest storage

Before executing transfer tasks in an Ingest instance, the data storage must be created.

  1. In Jet Analytics Data Integration, open the Ingest instance.
  2. Right-click the instance and select Edit Instance.
  3. Click Create Storage… to create the storage for the Ingest instance.

Test the storage connection

After creating the storage, click Test Storage Connection to confirm it is available and ready for use.

Troubleshooting

Create Storage error

Error:Service request failed: Response status code does not indicate success: 403 (This request is not authorized to perform this operation using this permission)

Cause: A storage container was manually created outside Jet Analytics Data Integration — for example, in the Azure portal under the storage account resource.

Resolution: Either delete the manually created container in the Azure portal, or change the storage container name in the Jet Analytics Portal. Then right-click the instance in Jet Analytics Data Integration, select Edit Instance, and click Create Storage… again.

Was this article helpful?

We're sorry to hear that.