Data-Quality

Introduction

The Data Quality module allows configuring and applying data quality rules to different types of assets. The rules are executed sequentially, from the first to the last, and the most recent rules overwrite the previous ones in case of conflict.

Accessing the Module

To access the Data Quality module, follow these steps:

1. Log into the platform.

2. Go to the menu where the Data Quality option is located.

3. A list of configured rules will be displayed.

Creating a New Rule

1. Click the "New rule" button at the top.

2. A screen will open with two steps for rule creation.

Step 1: Name and Assets

1. Assign a name to the rule in the "Rule name" field.

2. Select the type of asset to which the rule will apply in the "Asset Type" field.

3. Filter assets by name in the "Filter by asset name" field (regular expressions such as .* can be used to select all assets).

4. Click "Find" to list the assets that meet the selected criteria.

5. Select the desired assets from the resulting list.

6. Click "Next" to continue with the configuration.

Step 2: Properties and Values

1. Configure the values and properties that will define the rule.

2. Adjust the parameters according to data validation requirements.

3. Confirm the configuration and save the rule.

Editing and Deleting Rules

• To edit a rule, select the three-dot menu at the far right of the rule and choose the edit option.

• To delete a rule, select the checkbox of the desired rule and choose the delete option.

Publishing Rules

The "Update" button in the top right corner does not update the interface but instead publishes the rules so they take effect in the system.

Procedure to publish:

1. Make the desired changes to the rules.

2. Click the "Update" button.

3. Confirm the publication if prompted.

4. The rules will be applied to the assets according to the established configuration.

Asset Status and Data Quality Events

In the asset status tree, blue tooltips indicate that there is an event related to Data Quality. This means there are active rules that have triggered an alert or impacted the data quality of the asset.

To review these events:

1. Locate the asset in the status tree.

2. Go to the Events module to view detailed information.

Reviewing Data Quality Events

To review Data Quality events, follow these steps:

1. Go to the Events module in the side menu.

2. At the top, select the Data Quality tab.

3. You will see a list of events related to data quality.

4. Each event includes details such as:

   • Affected asset

   • Impacted property

   • Period when the event occurred

   • Event status (Active/Inactive)

5. Within the event details, you can view:

   • Asset property

   • Event type

   • Current condition

   • Last recorded value before the alert

6. If necessary, adjust the rules in the Data Quality module to resolve issues.