Jet Analytics Data Integration 6814.1
Released November 13, 2024. Desktop version 6814.1.
New
- Redesigned metadata synchronisation and table selection: The metadata management and table selection workflow in the Ingest layer has been completely reimagined. Synchronise Tasks are now called Metadata Import Tasks and import metadata from the data source into Ingest storage rather than performing a full synchronisation. The Data Source Explorer has become the Metadata Manager — the central place for synchronising data sources, selecting tables, and mapping them to Ingest storage, all based on the metadata imported by Metadata Import Tasks.
-
Easier orchestration with synchronisation from Data Integration: Transfer tasks and execution packages in Jet Analytics Data Integration can now be synchronised with Jet Analytics Orchestration for richer scheduling and orchestration than is available with Jobs. To get started, generate an API key and use it to create a new Jet Analytics Data Integration data provider in Jet Analytics Orchestration.
The Jet Analytics portal is managed by the insightsoftware Support team. For assistance or additional information, reach out to Product Support .
Jobs have been deprecated. Schedule Jet Analytics Data Integration execution packages via Jet Analytics Orchestration rather than using Jobs.
- Redesigned Instances page: The Instances page has been updated with a new list view to complement the card-based view, collapsible cards to help focus on specific environments, and a consolidated toolbar with a search box and buttons for adding instances and managing environments.
- Prepare instance on Microsoft Fabric Lakehouse: Fabric Lakehouse can now be used as Prepare instance storage. In this first version, functionality is limited to what is possible with Simple Mode enabled.
-
New data source providers: Three new Jet Analytics-branded data source providers are available:
- Parquet — similar to the existing CSV and Excel providers.
- OData — similar to the existing REST provider.
- Finance & Operations OneLake — supports transferring data to Ingest instances using Azure Data Lake Gen2 or Fabric storage. When both the Ingest and Prepare instances use Fabric storage, data bypasses Ingest storage and is transferred directly to Prepare storage for better performance and reduced storage consumption.
- Restore deleted instances: A soft delete feature has been implemented for instances. Deleted instances can be restored for up to 30 days after deletion.
Improved
- The Migrate Instance dialog has been restructured into steps, includes a review section, and now allows the source instance and environment to be selected within the dialog itself.
- A nine-dot navigation menu in the top-right corner of the Jet Analytics Portal now provides quick access to Jet Analytics MDM, Jet Analytics DQ, and Jet Analytics Orchestration.
- A banner on the Portal Home page now provides advance notice of upcoming system maintenance.
- The Upgrade data source page has been updated to match the new Portal design.
- On CSV data sources, custom null values such as "N/A" and "-" can now be defined in the Null Values field.
- On SAP Table data sources, a new Table name filter enables irrelevant tables to be filtered out before they appear in Jet Analytics Data Integration. This speeds up metadata import from SAP and makes the large number of SAP tables easier to manage.
- Password protection has been applied to additional relevant fields in Jet Analytics-branded data source providers to prevent accidental credential exposure.
- Azure Blob Storage and Azure Data Lake Storage can now be connected using principal user credentials. This applies to the Jet Analytics-branded CSV, Excel, and Parquet data sources.
- Ingest authentication refresh logic has been made more robust to prevent potential connectivity issues.
- SQL queries now include a 30-second command timeout, preventing client lockups during cloud database issues. Logging in Jet Analytics Data Integration has also been improved for clearer task tracking.
- When upgrading Jet Analytics Data Integration, more information is now shown about what is being imported from the previous version on first run.
Fixed
Portal
- On the Migrations page, cards now accommodate longer instance names.
- On the Instances page, non-data-estate admin users would sometimes receive "User not authorised" or "Missing data estate permission" errors.
- Test Connection was returning a successful result for non-existent paths in cloud storage locations (AWS, Azure, GCS).
Jet Analytics Data Integration
- Invalid data sources under Ingest instances are now displayed with "(invalid)" postfixed to the name in red, making them easier to identify.
- Fixed a "Task was canceled" error when opening Jet Analytics Data Integration with over 250 instances. HTTP timeout settings have also been adjusted to improve loading.
- Using the Integrate existing objects feature would sometimes cause a "duplicate key" error. Duplicate keys are now handled correctly.
- Fixed a radio button issue that prevented switching between the Valid and Raw tables when creating indexes.
- In the Filter Rows window, the Preview button was available even when the data source did not support preview.
- Fixed an issue where changes made in Edit SQL Snippet Transformation were not being saved.
- Improved the error message displayed on Reports > Errors.
- Tables with selection rules would fail when dragged from one data area to another in a Prepare instance using Snowflake storage.
- In version 6766.1, SAP data sources experienced degraded performance due to the accidental release of a 32-bit version of the TXIntegrationServices component. This has been corrected.
- Updated the stored procedures for executing Prepare instances to sort data by DW_ODXBatchNumber during a full load insert into the valid table. If DW_ODXBatchNumber is not available, the sort defaults to DW_Id ascending.
- Fixed intermittent "terminated unexpectedly" errors during execution package runs. Access token refresh logic is now more robust: it permits refreshes up to 4 hours before expiration, retries failed attempts, and automatically refreshes when the Execution Service restarts.
- The Execution Service was ignoring proxy settings during package execution, resulting in misleading error descriptions.
- The Jet Analytics REST data source provider now correctly handles empty property names, property names starting or ending with a colon, and property names containing more than one colon.