What is Etl – Troubleinthepeace

ETL . Overview

The ETL process is also known as the Data Acquisition and Integration (Data Acquisition and Integration) process.

You are viewing: What is Etl

Extract (Data Acquisition): access the source system to extract the data. The data generated from this process is called source data.Transform (Data Integration): check, clean, adjust to DW requirements. The data generated by this process is called Load Data.Load (Data Integration): update the DW with the data provided from Load Data.


Data Mapping

Data Mapping helps identify source data (location locationstatus statetime timing,…) meets the data requirements of a DW. The device transformations to create the data elements in the DW are also shown in this data map. Data Mapping can be presented in the form of spreadsheets, charts or text.


Simple Data Mapping


Business Rule

Business rules are used to create data quality validations of the data and its flows in the DW (ETL stream, Aggregation stream). Therefore, any data elements in the DW must maintain consistent behavior; and if it can affect the perceived quality of the DW, it must be included in the Business Rules list.

See also: What is Landscape – Definition, Example, Explanation

For example:


ETL . Architecture



In an ETL application, data is obtained from the Operational System. Extracted data Extracted Data captured on the platform controlled by the ETL application. The process of capturing data on this platform is called Staging. This platform is called Staging Platform or Staging Environment. At this time, Staged Data in raw form raw, like its mode and state in the active application. Before the Transform process, Staged Data was called Source Data.

The Transform application implements the necessary data transformation slabs on Source Data to conform it to the rules, layout, and formatting in the DW. Transformed Data is still captured in the Staging Platform. However, after Transform, Staged Data called Load Data.

Load application is a bridge between the distance ETL/Staging Platform and DW Platform. Load application reads Load Data and executes INSERT, UPDATE, DELETE steps on DW. When the application Load is successful, the ETL completes.



The difference between ETL and ELT applications is the platform on which the application executes its functionality.

See also: What is Level

The ELT application uses the ELT platform as a temporary platform to connect to the DW RDBMS platform. ELT platform extracts operational data, loads it directly into Staging Table on the DW RDBMS platform. All Transform functionality is done on this platform. Finally, the DW is loaded from within the DW RDBMS platform.

ETL . Design Principles

Process principles:

One Thing at a TimeKnow when to BeginKnow when to EndLarge to Medium to SmallStage Data IntegrityKnow what you have

Stage principles:


About Troubleinthepeace

Troubleinthepeace specializing in synthesizing information about daily life activities

View all posts by Troubleinthepeace →

Trả lời

Email của bạn sẽ không được hiển thị công khai.