Skip to main content

Jet Analytics Data Integration Upgrade

Released October 2022. Jet Analytics Data Integration is the cloud-enabled successor to Jet Analytics20.10, introducing a new architecture based on Ingest, Prepare, and Deliver instances managed through the Jet Analytics Portal.

Instances are self-contained objects that can be connected together to define the flow of data. They replace local repositories and projects, and are managed entirely by Jet Analytics to provide a simpler, more reliable experience.

New

  • Cloud-powered instances as building blocks of the Data Estate: Ingest, Prepare, and Deliver instances are created and managed by company admins and are available to developers in Jet Analytics Data Integration after signing in.

    The Jet Analytics portal is managed by the insightsoftware Support team. For assistance or additional information, reach out to Product Support.

    Instances are the basis for the usage-based pricing model.

  • Manage data sources in the Portal: Admins can set up data source connections in the Portal. Credentials remain confidential while still allowing users to access the data source.
  • User management and access control in the Portal: Users and their instance access are managed centrally in the Portal.
  • Sign-in replaces licence keys and client secrets: Sign-in is now required to use Jet Analytics Data Integration. Licence keys and client secrets are no longer needed, including for Ingest Service setup.
  • Full documentation including Ingest instances: Documentation can now be created for Ingest instances, extending the existing documentation capabilities from Prepare instances.
  • Context-sensitive help: Click ? in the title bar or press F1 in any window to open a relevant article on the support site.
  • Ingest: Oracle data source provider:Jet Analytics-enhanced data source with date and numeric range conversion and exclusion of system schemas.
  • Ingest: Dynamics 365 Business Central data sources: The Jet Analytics-enhanced data source for Dynamics 365 Business Central supports account selection and includes a data source for Business Central option values.
  • Ingest: Roll up data files in Azure Data Lake: Storage management tasks can roll up (merge) incremental load files in Azure Data Lake to improve performance when loading from the Ingest instance. The rollup uses Azure Data Factory.
  • Ingest: Sync data sources through Azure Data Factory: Data sources transferred via Azure Data Factory can now also be synchronised through ADF, without requiring direct access from the Ingest instance to the source.
  • Ingest: "Subtraction from value" option for incremental load: A value or amount of time can be subtracted from the incremental selection rule during incremental load, to ensure all changes are captured from the source.
  • Prepare: Data profiling: A standard analysis can be run on a table to get an overview of the data profile, supplementing the existing table preview feature.
  • Prepare: Execute PowerShell scripts as an external step: PowerShell scripts can be executed as an external step in an execution package, enabling interaction with external components.
  • Prepare: Lookup transformation: A new transformation type enables small or trivial lookups to be managed more efficiently than with conditional lookup fields.
  • Prepare: Multiple Ingest table mappings based on filters (Mapping Sets): Multiple tables can be mapped into a single Prepare table from the Ingest instance using filters.
  • Prepare: Multiple Ingest instances as sources for one Prepare instance: A single Prepare instance can now draw data from multiple Ingest instances.
  • Deliver: Power BI Premium XMLA endpoint: A new endpoint type supporting the Power BI Premium XMLA Read/Write Endpoint.
  • Deliver: CSV endpoint: A new endpoint enabling export to CSV files, replacing the Data Export functionality previously available in Deliver instances.

Changed

  • Improved synchronisation from Prepare to Deliver and Ingest to Prepare: Synchronisation now provides a better overview of changes, with options to accept or reject changes and remap fields in bulk.
  • Ingest: Table selection from a list: Tables can be selected for copying to the Ingest instance from a list in addition to using rule-based selection.
  • Ingest: Improved ADF pipelines for Data Lake to Prepare transfers: The logic for transferring data from Azure Data Lake Ingest storage to a Prepare instance via Azure Data Factory has been updated to use fewer pipelines, improving performance and reducing cost.
  • Business Units removed: Business Units have been replaced by Prepare instance data areas.
  • Prepare: SSIS removed as a transfer option.
  • Deliver: SSAS Multidimensional (OLAP) Cubes, the Qlik modeller, and Data Export removed.
  • All previously deprecated features removed, including: Azure Data Lake Storage Gen1 as Ingest storage, regular expressions in Ingest, data aggregations on Prepare tables, Enable BK hash key and Use left outer join options, Force sub select and Use temporary table options on conditional lookup fields, SQL mode Partition By option on lookup fields, Split and Concatenate options on field-to-field data movement, and Time tables in Prepare instances.

Planned features (at time of release)

  • Improved multiple environments: Planned extensive support for multiple environments in the Portal, including automatic connection updates to reduce manual work.
  • End-to-end scheduling.
  • Automated migration: A migration tool to move projects from Jet Analytics 20.10 into the new instance-based structure. See Migration Tool — Upgrade from Jet Analytics 20.10 to Jet Analytics Data Integration.
  • Custom data source providers (Open Interface Data Source).

Documentation for this release

Getting started — setup

Getting started — configure Azure services

Ingest

Portal

Executions

Prepare

Deliver

Was this article helpful?

We're sorry to hear that.