From 0 to 1: ETL Testing

1

Welcome! Thank you for learning the ETL Testing Course !
2

Introduction
3

The Basics - Data warehouse Concepts course This section talks about the Data Warehouse concepts course which covers other in-depth topics
4

Data Mart : In this section we talk about all the aspects of Data Mart and its characteristics along with the differences to DWH.
5

Data Warehouse Architectures : This section has the details of all the baseline architectures possible for setting up an Enterprise Data warehouse.
6

Dimensional ModelingData : Modeling is the formalization and documentation of existing processes and events that occur during application software design and development.
7

How to build a Dimensional Model? - This section has the details of how to build a Dimensional Model
8

Various Objects in a Dimensional Model : This section has the details the different objects which will be built in a Dimensional Model
9

Data Integration and ETL : Data Integration - Critical For Businesses. In this section we will understand what is Data Integration and ETL.
10

ETL Vs ELT : This section explains the ETL and ELT processes and their differences along with the advantages and disadvantages.
11

Typical Roles In DWH Project : Different kinds of roles which are typically found in a DWH project are discussed in this section.
12

DW/BI/ETL Implementation ApproachThis section describes the overall implementation approach for any DW/BI/ETL projects.
13

DW/BI/ETL Test Stratergy and Data Centric Approach : In this we talk about the different phases of Data Centric Test Strategy
14

Different Categories Of Projects where DW/BI/ETL Testing is required : This section outlines the different categories of DWH projects in which there is a need for DW/BI/ETL testing to be done.
15

Roles and Responsibilities of an ETL Testing Professional : ETL testing role is one of the critical roles in a Data warehouse project. This section outlines the different roles and responsibilities of an ETL testing professional.
16

Database Testing : In this section we talk about the different types of Database Testing and how to opt for those based on the project.
17

Basics of ETL Testing
18

Database Testing Vs ETL Testing : In this section we talk about the differences between Database Testing and ETL Testing. Also, we talk about the best options to use based on the project situation.
19

Defect Management : This section outlines the different aspects of the Bug Report
20

Possible Reasons for Defects & Bugs : This section outlines different reasons and situations which cause the defects to arise and how to over come them
21

Issues/Defect Management Process : The following Defect Management process should be followed in order to reduce issue turn around time.
22

Issue Severity Table : The following section outlines the criteria for determining the severity of a given issue.
23

Quality Center Defect Category Descriptions : This section provides descriptions of the defect status category labels that can be assigned to issues in QC.
24

Categories of ETL Testing : In this section we talk about the most common most common types of tests that need to be done for ETL Testing.
25

Different Tools/Technologies used in DWH/BI/ETL Testing : In this section we talk about the different Tools/Technologies used in DWH/BI/ETL Testing.
26

Informatica Power Center (ETL Tool) Types of Databases used in ETL Testing
27

Installation and Configuration of Informatica Power Center : In this section we will talk about different steps to download the software and install it.
28

Informatica - Pre-Requisites to start the Hands on : In this section we will start with setting up all the basic stuff for you to get started with the hands on exercises.
29

Client Tools and Sample WorkFlow Creation : Types of Databases used in ETL Testing
30

Introduction to Transformations : In this section, we talk about the different transformations available in Informatica
31

Transformation's functions in brief : In this section, we talk about the available transformations in brief.
32

Data Types in Informatica : Conversion of the native datatypes to the compatible transformation datatypes
33

Different Types of Ports in Informatica : In this section, we talk about the different types of ports in Informatica
34

Functions in Informatica : In this section we talk about different commonly used functions
35

Workflow Manager : In this section, we learn the sub tools available in Workflow Manger and the importance of them.
36

Informatica PowerCenter MonitorInformatica Power Center Monitor
37

Other important objects and activities in Informatica : In this lecture, we talk about the other important objects and the activities in Informatica
38

Practical Scenario : Flat File Source to Flat File and Relational Targets : In this section we see the mapping creation and workflow execution of the Flat File Source to Flat File and Relational Targets

01 Welcome! Thank you for learning the ETL Testing Course with me
02 What is Data ETL Testing and the Challenges in ETL testing 03 What will be the future of ETL tools testing as big data is getting popular
04 Master Data Warehouse Concepts Step by Step from Scratch 05 Is Data Warehouse still relevant in the age of Big Data 06 What is Data 07 Why Data Warehouse is implemented 08 What is a Data Warehouse
009 What is a Data Mart 0010 Fundamental difference between Data Warehouse and Data Mart 011 Mistakes and Misconceptions of a Data Mart
0012 Revised Enterprise Architecture or Centralized Architecture 0013 Revised Federated Data Warehouse Architecture 0014 Multi Tired Architecture 0015 Components of a Data Warehouse Architecture 0016 Purpose of a Staging Area in Data Warehouse Architecture - Part 1 0017 Purpose of a Staging Area in Data Warehouse Architecture - Part 2
0018 What is Data Modeling 0019 Why should a Tester know Data Modeling 0020 Data Modeling Techniques 0021 ER Data Model 0022 Dimensional Model 0023 Differences between ER Model and Dimensional Model 0024 Different phases required to build a Dimensional Data Model 0025 Business Requirements
0026 CDM - Conceptual Data Model 0027 LDM - Logical Data Model 0028 Physical Data Model 0029 Database
0030 What is a Dimension Table 0031 What is a Fact Table 0032 Additive Facts 0033 Semi Additive Facts 0034 Non-Additive Facts 0035 Fact less Facts 0036 What is a Star Schema 0037 What is a Snow Flake Schema 0038 Galaxy Schema or Fact Constellation Schema 0039 Snow Flake Vs Star Schema 0040 Conformed Dimensions 0041 Junk Dimensions 0042 Degenerate Dimensions 0043 Role Playing Dimensions 0044 SCD Intro and Example Preparation 0045 SCD Type 1 2 3 0046 SCD Summary
0047 Data Integration and ETL 0048 What is ETL 0049 Data Acquisition 0050 Data Transformation 0051 Common Questions on DI and ETL
0052 ETL Explained-1 0053 ELT Explained-2 0054 ETL Vs ELT Differences
0055 Project Sponsor 0056 Project Manager 0057 Functional Analyst or Business Analyst 0058 SME - Subject Matter Expert 0059 DW BI Architect and Data Modeler 0060 DWH Tech Admin 0061 ETL Developers 0062 BI OLAP Developers 0063 ETL Testers QA Group 0064 DB UNIX Network Admins 0065 Data Architect_ Data Warehouse Architect_ BI Architect and Solution Architect 0066 Final Note about the Roles
0067 Different phases in DW-BI-ETL Implementation Approach 0068 Knowledge Capture Sessions 0069 Requirements 0070 Architecture Phase 0071 Data Model - Database 0072 ETL Phase 0073 Data Access Phase 0074 Data Access Types - Selection 0075 Data Access Types - Drilling Down 0076 Data Access Types - Exception Reporting 0077 Data Access Types - Calculations 0078 Data Access Types - Graphics and Visualization 0079 Data Access Types -Data Entry Options 0080 Data Access Types - Customization 0081 Data Access Types - WebBased Reporting 0082 Data Access Types - BroadCasting 0083 Deploy 0084 Iterative Approach
0085 Introduction and Knowledge Capture Sessions 0086 Test Strategy and Plan 0087 Define Test Framework 0088 Assess Source and Target Components 0089 Test ETL - The Data Centric Method 0090 System and Integration Testing 0091 Regression Testing 0092 Performance Testing 0093 Acceptance Test
0094 Different Categories Of DWH Projects 0095 New DataWarehouse SetUp 0096 Migration Testing - Includes Data Migration 0097 Change Requests - For Existing Projects 0098 OLAP Dashboard Report Testing
0099 Knowledge of the project or the application 00100 Analysis of the specifications provided by the clients 00101 Approve requirements and design specifications 00102 Create and Maintain the test strategy document 00103 Design the Test Cases as per the Test plan 00104 Estimate the efforts required to design the test cases and execute the project 00105 Tracability of requirements to test cases 00106 Define Exit and Entrance criteria 00107 Creating Test Plan Test Scenario Test Cases and Test Scripts to validate source 00108 Test data creation 00109 Creating and Maintaining Reusable Scripts and Execute Test Scripts 00110 Execute backend data-driven test cases 00111 Client Co-ordination and Incorporate UAT Test cases and Identify Bugs 00112 Other Roles and Responsibilites
00114 Database Testing Vs GUI Testing 00115 Structural Database Testing 00116 Functional Database Testing 00117 Functional Database Testing - Part 2 00118 Non Functional Database Testing 00119 Summary of Database Testing
00120 What is Data Testing ETL Testing and the Challenges in ETL testing 00121 What will be the future of ETL tools testing as big data is getting popular
00122 Database Testing and ETL Testing 00123 Differences between Database Testing and ETL Testing 00124 Database testing during ETL Testing - Explained with a project setup
00125 Bug Reports 00126 After Finding the Defect 00127 Writing the Bug Summary 00128 Using Appropriate Language - Phrases 00129 Steps to Reproduce the Defect 00130 Including Test Data 00131 Including Screen Shots 00132 Severity - Priority 00133 Logs 00134 Other Information
00135 Introduction to the common causes for defects 00136 Insufficient-Incorrect Requirements 00137 Assumptions - Mis-Understanding 00138 Wrong Decision During The Design 00139 Good Programmers With Wrong Goals 00140 Complexity 00141 Time Constriants 00142 Frequently Changing Business Requirements
00143 Reporting the discrepancy 00144 Communicating the discrepancy 00145 Escalating the discrepancy 00146 Generating Metrics
00147 Critical Issue Severity 00148 High Severity Issues 00149 Medium Severity Issues 00150 Low Severity Issues
00151 Defect Status Category Labels
00152 Metadata Testing 00153 Data Completeness Testing 00154 Data Quality Testing - Data Duplicates 00155 Data Quality Testing - Business Validation and Rules 00156 Data Transformation - White Box Testing 00158 ETL Regression Testing 00159 Reference Data Testing 00160 Incremental ETL Testing 00161 ETL Integration Testing 00162 ETL Performance Testing
00163 Different Types of Enterprise Databases 00164 Different ETL tools available in the Market 00165 Which ETL tool should you learn if you are starting with ETL testing now
00166 Informatica Power Center Architecture
00167 Pre Installation Steps and System Pre-Requisites 00168 Quick Tip- Product Availability Matrix - PAM 00169 Download Software 00170 Power Center Server Installation 00171 Power Center Client Installation 00172 Administration Console Introduction 00173 List of Services Available 00174 Repository Service Creation 00175 Setting up Integration Service
00176 Repository Configuration and Folder Creation 00177 Basic File directory structures
00178 Client Tools and Components 00179 Setting up the Database Connection at Mapping Designer and Workflow Manager 00180 Let_s start with the Mapping Designer 00181 Mapping Designer - Finding Object Dependencies 00182 The Complete Cycle - Lets build the first Mapping Session and the Workflow
00183 Transformations Overview 00184 Different Categories of Transformations 00185 Active Transformations 00186 Passive Transformations 00187 Connected Transformations and Unconnected Transformations 00188 Multi Group Transformations 00189 Restricted Process Transformations 00190 Data Flow Rules
00191 Brief introduction to Transformations and it_s functions 00192 Aggregator Trasformation 00193 Expression Transformation 00194 Filter Transformation 00195 Joiner Transformation 00196 Lookup Transformation 00197 Normalizer Transformation 00198 Rank Transformation 00199 Router Transformation 00200 Sequence Generator Transformation 00201 Stored Procedure Transformation 00202 Sorter Transformation 00203 Source Qualifier Transformation 00204 Update Strategy Transformation 00205 XML Source Qualifier Transformation 00206 XML Parser Transformation 00207 XML Generator Transformation 00208 Union Transformation 00209 HTTP Transformation 00210 Transaction Control Transformation 00211 Identity Resolution Transformation 00212 Custom Transformation 00213 Data Masking Transformation 00214 Additional Information about Informatica Power Center Transformations
00215 Power Center_s Native Data Types and Data Type Conversion
00216 Ports in Informatica
00217 Different Types of Functions 00218 Best ways to get around functions
00219 Components of Workflow Manager
00220 Workflow Monitor 00221 Monitor Tool_s functionality and Available Options 00222 Session Log
00223 Repository Manager Activities 00224 Mapplet 00225 Usage of Debugger
00226 Requirements for Flat File Source to Flat File and Relational Target 00227 Required Target Attributes based on the requirement 00228 Target Table creation based on the requirement 00229 Source Flat File Creation with the test data 00230 Source File directory for the source to be placed 00231 Let_s create the mapping with the requirements at hand 00232 Workflow Creation for the mapping created with the requirements 00233 Different aspects-areas which needs to be verified during a workflow run 00234 What is S2T document and what should this document contain 00235 Source to Target Mapping - Sample 1 00236 Source to Target Mapping - Sample 2 00237 Source to Target Mapping - For the requirements we are using 00238 Technical Test Cases 00239 Verifying the workflow run and the source to target records 00240 Test Cases for Business and Data Validations 00241 Bug fixes for the issues identified 00242 Restarting the Workflow for further testing 00243 Duplicate Records Check and Record Count Verification 00244Data Validation Checks - Using SQL queries Create - Delete- Drop- Select- Minus 00245 Test Case for verifying the Unique Sequence numbers 00246 Fix and Retest of the Active Flag scenario