Table and Column Selection in an Ingest Instance

Note: Relates to Jet Analytics Data Integration 6024.1 and later versions.

Tables and columns for an Ingest instance data source are selected in two places: at the data source level using the Metadata Manager, and at the transfer task level using the Table Selection dialog. Selection at the data source level determines what is available; transfer task selection further limits what is transferred in a given task.

Select tables and columns at the data source level

Right-click the data source and select Metadata Manager. Any transfer tasks for the data source will be limited to the tables and columns selected here.

1. Enter a search phrase in the Tables field and click Search to locate a specific table. Select the Included checkbox next to a table to include it and make it available for transfer to Ingest storage.
2. When a table is selected on the left, the available fields for that table appear on the right. All fields are included automatically when the table is marked as included. Uncheck the Included checkbox for any fields to exclude. Use the Fields search field on the right to locate specific fields.
3. Click OK.
4. Review the pending changes and click Commit.
5. Click Yes to confirm.

Note: In addition to the fields from the data source, an auto-generated field dw_timestamp is available for selection. It contains a timestamp for when each row was copied from the source system.

Select tables at the transfer task level

Tables can also be selected at the transfer task level to limit what a specific task transfers. A table must first be selected at the data source level in the Metadata Manager before it can be added to a transfer task. Column selection is only available at the data source level — not at the transfer task level.

When adding a new transfer task

Right-click the data source and select Add Transfer Task…

Select Add all tables to include all data source tables, or select Let me select the tables to open the Table Selection dialog.

When editing an existing transfer task

Right-click the existing transfer task and select Select Tables to open the Table Selection dialog.

Simple selection

In the Table Selection dialog, filter by schema or table name to narrow the list. Select tables and click Add, or click Add All to add all listed tables. Click Finish when done.

Advanced (rule-based) selection

Click Switch to Advanced Selection to apply rule-based selection using schema and/or table name criteria. If tables were already selected using simple selection, rules are automatically created for those tables.

To create a rule — for example, to include all tables whose names contain "salesorder" — select Contains (ignore case) from the Table dropdown, enter the search phrase, and click Include matches. Click Finish when done.

After selecting tables, execute the transfer task to load data from the source to Ingest instance storage.