<< Click to Display Table of Contents >> Raynet One Data Hub > 2026.2 > Administration and User Guide  Device Deduplication

The Device Deduplication feature provides a new processing pipeline that consolidates records from multiple data sources into a single, authoritative dataset. It replaces the classic Standardized Data Transformation pipeline for environments where cross-source deduplication is required.

 

The deduplication pipeline consists of two stages:

 

1.Layer 1 (L1) Transformation Tasks — Source-specific tasks that normalize raw collected data into a common unified schema. These tasks are organized under the 1.1 Transform Data Collection to Unified Schema task group.

2.Deduplicator Connector Tasks — Connector tasks that read the normalized L1 data and produce deduplicated output tables for devices, software, and users.

 

The deduplication pipeline is available as an alternative to the classic Standardized Data Transformation. Both pipelines can coexist in the same installation. When importing a template bundle that includes both pipelines, the import wizard presents a Strategy selection step to choose which pipeline feeds downstream reports and dashboards.

 

When the Device Deduplication strategy is selected, full backwards compatibility is maintained. Existing reports and tasks based on the Standardized Data Transformation do not require modification.