Jump to: navigation, search

Extract, Transform, And Load

Also known as ETL. The ETL processes extract data from various data sources; transform the data into a format and structure that is suitable for subsequent business purposes; and load the data into a target data store (other database, data mart, or data warehouse).



Glossary

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Job History and Status

You can view information about job history and status using either of the following methods:

  • Voice of Process—This page describes how you can use Voice of Process to find information about the status and processing history of Genesys Info Mart jobs.
  • Genesys Info Mart Manager—For information about viewing the status and history of jobs using Genesys Info Mart Manager, see Using Genesys Info Mart Manager.

About Voice of Process

Use Voice of Process functionality to access information related to the processing history of Genesys Info Mart jobs, including to:

  • Quickly check the state of Genesys Info Mart jobs.
  • Track the data extraction progress of each extraction job cycle.
  • Track the data transformation progress of each transformation cycle.
  • Identify the job that inserted a particular row of data or made the most recent update to it.

The Genesys Info Mart database provides several service control tables, which in addition to existing administrative views, store the ETL processing history details.

Checking the state of ETL processing

The ADMIN_ETL_JOB_HISTORY administrative view is updated each time a job is executed. By monitoring this view, administrators can quickly assess the current state of all jobs.

[+] Expand: Checking the State of ETL processing

Tracking the progress of data extraction

A row is added to the ADMIN_EXTRACT_HISTORY administrative view when Job_ExtractICON successfully completes extracting a source data table. Administrators can closely track the progress of the data extract cycle by monitoring this view.

[+] Expand: Tracking the progress of data extraction

Tracking the progress of data transformation

Administrators can closely track the progress of the data transform cycle by viewing the contents of the CTL_TRANSFORM_HISTORY table.

[+] Expand: Tracking the progress of data transformation

Identifying the job that inserted or updated data

In Info Mart’s dimensional model, every table that receives inserts has a CREATE_AUDIT_KEY service field. Every table that can also receive updates has an additional UPDATE_AUDIT_KEY service field. Both these fields contain a reference to a row in the CTL_AUDIT_LOG table.

[+] Expand: Identifying the job that inserted or updated data

Feedback

Comment on this article:

blog comments powered by Disqus
This page was last modified on 17 December 2015, at 15:28.