1.
Validation Engine :
Intelligent Data
Extraction
SUJAN SIVAJI

2.
Validation Engine
1. Validation engine acts central in the process of extracting entities from documents to the output
being displayed. Its an intermediary layer between Extractor and Output Dashboard.
2. We can merge Regex and ML approach together for extraction process using Validation Engine.
3. Independent extraction using any technique wont affect the defined output by having
intermediary layer – Validation Engine.
4. An overall consistent, error –free and Dynamic system will be deployed with this intermediary
layer.

3.
Role of Validation engine:
1. Redundancy check.
2. Intelligent Character Recognition.
3. Compliance check (with respect to agreed output with client)
4. Doing Arithmetic operations.
5. Derived entities.

4.
1. Redundancy check:
Validation engine would check for the same entity extracted multiple times and will output only once.
The output from validation engine will look as below:

5.
2. Intelligent Character
Recognition
1. To recognize handwritten information from documents , we require ICR to encode corresponding
characters and numbers. Its part of OCR functionality.
2. Spell check is performed.

6.
3. Compliance Check:
1. To check the right data – i.e. Key and Value pair is matched with respect to client agreed
extraction rules. The incorrect and mismatch data is examined with respect to data type and
start, end of characters in keys.
2. Logic pertaining to defined goals is checked to make our system consistent and error free using
Validation engine.

7.
4. Arithmetic operations
“ The term ends in 04 years from start date.”
In a document if an above line is parsed then we need a system to calculate start date + 04 years and
output it as Term.

8.
5.Derived entities:
Create new entities using existing data extracted , adds an extra layer of intelligence.
Example Derived entities: (only for illustration)
1. Distance between supplier and client.
2. Number of days of contract (In years /months).
3. Certain compliance pertaining to different contract docs based on business knowledge.