This document describes how to use ETL Validator to check field formats through the creation of test cases and SQL queries. It provides step-by-step instructions to create a test plan, select tables and fields, add SQL queries to find records that violate field format rules, run the test, and view results. The key benefits of ETL Validator are listed as 100% test coverage, repeatability, cost reduction, faster time to market, and end to end testing.

1. ETL Validator Usecases:
Field Format Check
www.datagaps.com

2. ETL Validator
Comprehensive Testing
Automation
Extract. Load. Validate (Patented)

3. 100% Test
Coverage
Repeatability Cost Reduction Faster Time to
Market
End to End Testing
ETL Validator
Key Benefits

4. Usecase :
Field Format Check
Create a test case:
Identify records from
Countries table where
• ‘Country ISO Code’ is
numeric
‘Country ISO Code’ is a text
data field
Start with creating a
new Data Rules Test
Plan

5. Usecase:
Name your test plan.
Select the Database
Connection.
Navigate to the next
screen.
Field Format Check

6. Usecase:
Expand the schema; in
this example, ‘public’.
Select and expand the
table ‘Countries’.
Select the field
‘country_iso_code’.
Click on ‘Add SQL Query
Rule’.
Field Format Check

7. Usecase:
Type in the SQL query:
select * from countries WHERE
country_iso_code ~ '^[0-9]{2}’
This query finds records with
numeric characters. [Note that sql
syntax varies as per your tool. Here it is
PostgreSQL.]
‘Run Query’ to see the results.
Name the query.
Save the query.
Field Format Check

8. Usecase:
‘Datatype Check’ rule
has been added.
For second usecase, we
will find invalid dates.
Select and expand the
table ‘Promotions’.
Select the field
‘promo_begin_date’.
Click on ‘Add SQL Query
Rule’.
Field Format Check

9. Usecase:
Type in the SQL query:
select * from promotions where
to_char(promo_begin_date,
'YYYY') > to_char
(current_timestamp, 'YYYY’)
This query finds records with
promotion date in future.
[Note that sql syntax varies as per your
tool. Here it is PostgreSQL.]
‘Run Query’ to see the
results.
Name the query.
Save the query.
Field Format Check

10. Usecase:
Navigate to Next screen.
In order to run test cases
of only the ‘Countries’&
‘Promotions’ table –
• Click on settings icon
• Unselect other tables.
Save the settings.
Field Format Check

11. Usecase:
Click on ‘Run’.
‘FAILED’ indicates that
there are records that
didn’t satisfy the rule.
The grid shows results
from first test case in the
list above.
Click on subsequent rows
to see those results.
Click on ‘View Report in
Browser’ to see same
results in web layout.
Field Format Check

12. Usecase:
Same info is displayed
in web layout.
The link can be shared
with others.
Click on the upward
arrow to see the
records
Field Format Check

13. More with ETL Validator….
• Data counts validation with allowed variance
• Check Data Quality using Data Rules Test Plan
• Advanced ETL Testing using a Component Test Case
• Avoiding inline views on your queries in ETL Validator
• Checking for Mandatory Fields
www.datagaps.com