IBM DataStage Online Training Modules Overview

Information Server

Introduction to the IBM Information Server Architecture, the Server Suite components, the various tiers in the Information Server

InfoSphere DataStage

Understanding the IBM InfoSphere DataStage, the Job life cycle to develop, test, deploy and run data jobs, high performance parallel framework, real-time data integration.

DataStage Features

Introduction to the design elements, various DataStage jobs, creating massively parallel framework, scalable ETL features, working with DataStage jobs

DataStage Job

Understanding the DataStage Job, creating a Job that can effectively extract, transform and load data, cleansing and formatting data to improve its quality

Parallelism, Partitioning and Collecting

Learning about data parallelism – pipeline parallelism and partitioning parallelism, the two types of data partitioning – Key-based partitioning and Keyless partitioning, detailed understanding of partitioning techniques like round robin, entire, hash key, range, DB2 partitioning, data collecting techniques and types like round robin, order, sorted merge and same collecting methods.

Job Stages of InfoSphere DataStage

Understanding the various job stages – data source, transformer, final database, the various parallel stages – general objects, debug and development stages, processing stage, file stage types, database stage, real time stage, restructure stage, data quality and sequence stages of InfoSphere DataStage.

Stage Editor

Understanding the parallel job stage editors, the important types of stage editors in DataStage

Sequential File

Working with the Sequential file stages, understanding runtime column propagation, working with RCP in sequential file stages, using the sequential file stage as a source stage and target stage.

Dataset and Fileset

Understanding the difference between dataset and fileset and how DataStage works in each scenario.

Sample Job Creation

Creating of a sample DataStage job using the dataset and fileset types of data

Properties of Sequential File stage and Data Set Stage

Learning about the various properties of Sequential File Stage and Dataset stage

Lookup File Set Stage

Creating a lookup file set, working in parallel or sequential stage, learning about single input and output link.

Transformer Stage

Studying the Transformer Stage in DataStage, the basic working of this stage, characteristics -single input, any number of outputs and reject link, how it differs from other processing stages, the significance of Transformer Editor, and evaluation sequence in this stage.

Transformer Stage Functions & Features

Deep dive into Transformer functions – String, type conversion, null handling, mathematical, utility functions, understanding the various features like constraint, system variables, conditional job aborting, Operators and Trigger Tab.

Looping Functionality

Understanding the looping functionality in Transformer Stage, output with multiple rows for single input row, the procedure for looping, loop variable properties.

Teradata Enterprise Stage

Connecting to the Teradata Enterprise Stage, properties of connection

Single partition and parallel execution

Generating data using Row Generator sequentially in a single partition, configuring to run in parallel

Aggregator Stage

Understanding the Aggregator Stage in DataStage, the two types of aggregation – hash mode and sort mode.

Different Stages Of Processing

Deep learning of the various stages in DataStage, the importance of Copy, Filter and Modify stages to reduce number of Transformer Stages

Parameters and Value File

Understanding Parameter Set, storing DataStage and Quality Stage job parameters and default values in files, the procedure to deploy Parameter Sets function and its advantages.

DataStage Projects

Project 1 :  Making sense of financial data

Industry :  Financial Services

Problem Statement : Extract value from multiple sources & varieties of data in the financial domain

Description : In this project you will learn how to work with disparate data in the financial services domain and come up with valuable business insights. You will deploy IBM InfoSphere DataStage for the entire Extract, Transform, Load process to leverage it for a parallel framework either on-premise or on the cloud for high performance results. You will work on big data at rest and big data in motion as well.

Highlights :

• Creating DataStage jobs for ETL process
• Deploying DataStage Parallel Stage Editor
• Data Partitioning for getting consistent results

Project 2 : Enterprise IT data management

Industry :  Information Technology

Problem Statement :  Software enterprises have a lot of data and this needs to made sense of in order to derive valuable insights from it

Description : This project involves working with the data warehouse existing in a company deploying the IBM DataStage onto it for the various processes of extract, transform, and load. You will learn how DataStage manages high performance parallel computing. You will learn how it implements extended metadata management and enterprise connectivity. This also includes combining heterogeneous data.

Highlights :

• Enforce workload & business rules
• DataStage deployed on heterogeneous data
• Integrating real-time data at scale.

Project 3 : Medical drug discovery and development

Industry :  Pharmaceutical

Problem Statement :  A pharmaceutical company wants to speed the process of drug discovery and development through using ETL solutions.

Description :  This project deals with the domain of drug molecule discovery and development. You will learn how DataStage helps to make sense of the huge data warehouse that resides within the pharmaceutical domain which includes data about patient history, existing molecules, and the effect of the existing drugs and so on. The ETL tool DataStage will help to make the process of drug discovery that much easier.

Highlights :

• Combining various types of data with ETL process
• Converting the data and transferring it for analysis
• Making the data ready for visualization & insights.

Project 4 :  Finding the oil reserves in ocean

Industry :  Oil and Gas

Problem Statement :  Finding new oil reserves is a very herculean task. There are huge amounts of data that need to be parsed in order to find where oil exists in the ocean. This is where there is a need for an ETL tool like DataStage.

Description :  This project deals with the process of deploying ETL tool like Datastage to parse petabytes of data for discovering new oil. This data could be in the form of geological data, sensor data, streaming data and so. You will learn how DataStage can make sense of all this data.

Highlights :

• Working with cloud or on-premise data
• Deploying DataStage for static or streaming data
• Converting data into the right format for analysis

DATASTAGE Administration Training

Course Curriculum

DataStage Admin Online Training Modules

• DataStage Admin Content
• Data Warehouse
• DataStage and Its Deployment
• Types of DataStage (Server/Parallel)
• Partitioning and Pipelining
• Different Stages in DataStage
• Find option in DataStage
• Sequencer Jobs

IBM InfoSphere Information Server Administration

• Technical Overview
• Overview of Clients used for Administration
• Authentication and Suite Security
• Stopping and Starting Information Server
• Session Management
• Engine Tier Architecture
• Engine Tier Configuration
• Engine Tier Connectivity
• Engine Tier Monitoring
• Metadata Asset Management
• Information Services Console Configuration
• Installation, Deployment, and Recovery
• Serviceability
• DataStage Administrator project

Job Opportunities in IBM DataStage

Right now the global industry is facing shortage of skilled experts IBM DataStage With millions of vacancies around the world across different sectors, a career in this domain is being termed as the hottest job of the decade. The effective demand for experts having the right talent & skills to handle all the real-world challenges in this platform will continue to increase for a long period of time as per the experts view. So hurry up & work towards building the best career knowledge in this platform by availing SacrosTek Systems IBM DataStage Online Training.

SacrosTek Systems offer certification programs for IBM DataStage. Certificates are issues on successful completion of the course and the assessment examination. Students are requested to participate in the real-time project program to get first-hand experience on the usage and application of the IBM DataStage. The real-time projects are designed by our team of industry experts to help students get best possible exposure to the IBM DataStage and its applications.