(ETL) Standardized Data Transformation

<< Click to Display Table of Contents >>

RayVentory Catalog > 12.6 > User Guide > Workflows > Working with Data Hub > Running Dependent Tasks 

(ETL) Standardized Data Transformation

To import the required tasks it is necessary to import the reports from the template on the Task tab of RayVentory Data Hub. 

Data transformation > Data transformation 

 

Imported tasks:

 

ETLTask

 

Connector parameters:

 

Configuration tab

oTransformations: This parameter can contain a JSON (.json file) that defines the transformation steps. In the Standardized Data Transformation task the JSON is already set.

oVerbosity: This parameter determines whether the output will be trimmed or not. The user has to options to choose from:
STANDARD: In the standard mode, the output is trimmed to contain relevant data. Hidden and private tables will not be written. This mode is recommended for production.
VERBOSE: In the verbose mode, hidden/private tables will be written. This is useful for troubleshooting or diagnostics.
By default, the standard mode is set.

Connection tab

oResult database connection string: This parameter contains the connection string to the result database to get raw data. It is set by default as an auto variable which is always available, even if not defined directly in the Edit task dialog: ###RESULT_DATABASE_CONNECTION_STRING###. This is already configured.

 

Once all mandatory parameters have been specified, the task can be triggered.

1.Select the Standardized Data Transformation available in the 2.1 Data transformation folder in the Tasks tab.

2.Click on the Run button located at the top of the page.

 

The Standardized Data Transformation task should now be completed successfully.

 

ETLTaskSuccessful

 

The following tables will be created in the database for the Standardized Data Transformation task:

 

dbo.DataTransformationresult-result_accounts

dbo.DataTransformationresult-result_device_relations

dbo.DataTransformationresult-result_devices

dbo.DataTransformationresult-result_inv_raw_arp

dbo.DataTransformationresult-result_inv_raw_file

dbo.DataTransformationresult-result_inv_raw_generic

dbo.DataTransformationresult-result_inv_raw_msi

dbo.DataTransformationresult-result_inv_raw_tag

dbo_DataTransformationresult-result_software

dbo.DataTransformationresult-result_software_summary

dbo.DataTransformationresult-users