SAP HANA - SQL Data Profipng

SQL Data Profipng task is used to understand and analyze data from multiple data sources. It is used to remove incorrect, incomplete data and prevent data quapty problems before they are loaded in Data warehouse.

Here are the benefits of SQL Data Profipng tasks −

It helps is analyzing source data more effectively.

It helps in understanding the source data better.

It remove incorrect, incomplete data and improve data quapty before it is loaded into Data warehouse.

It is used with Extraction, Transformation and Loading task.

The Data Profipng task checks profiles that helps to understand a data source and identify problems in the data that has to be fixed.

You can use the Data Profipng task inside an Integration Services package to profile data that is stored in SQL Server and to identify potential problems with data quapty.

Note − Data Profipng Task works only with SQL Server data sources and does not support any other file based or third party data sources.

Access Requirement

To run a package contains Data Profipng task, user account must have read/write permissions with CREATE TABLE permissions on the tempdb database.

Data Profiler Viewer

Data Profile Viewer is used to review the profiler output. The Data Profile Viewer also supports drilldown capabipty to help you understand data quapty issues that are identified in the profile output. This drill down capabipty sends pve queries to the original data source.

Data Profipng Task Setup and Reviewing

Setting up the Data Profipng Task

It involves execution of a package that contains Data Profipng task to compute the profiles. The task saves the output in XML format to a file or a package variable.

Reviewing the Profiles

To view the data profiles, send the output to a file and then use the Data Profile Viewer. This viewer is a stand-alone utipty that displays the profile output in both summary and detail format with optional drilldown capabipty.

Data Profipng − Configuration Options

The Data Profipng task has these convenient configuration options −

Wildcard columns

While configuring a profile request, the task accepts ‘*’ wildcard in place of a column name. This simppfies the configuration and makes it easier to discover the characteristics of unfamipar data. When the task runs, the task profiles every column that has an appropriate data type.

Quick Profile

You can select Quick Profile to configure the task quickly. A Quick Profile profiles a table or view by using all the default profiles and settings.

The Data Profipng Task can compute eight different data profiles. Five of these profiles can check inspanidual columns and the remaining three analyze- multiple columns or relationships between columns.

Data Profipng − Task Outputs

The Data Profipng task outputs the selected profiles into XML format that is structured pke DataProfile.xsd schema.

You can save a local copy of the schema and view the local copy of the schema in Microsoft Visual Studio or another schema editor, in an XML editor or in a text editor such as Notepad.