1. BITS Pilani
Pilani|Dubai|Goa|Hyderabad
Data Health Monitoring
By: Neelesh Palod, Shivalik Sen, Praveen Sharma, Pearly Khare
PS2: Ramco Systems Ltd.
By: Pearly Khare, Abhinav Jain, Neelesh Palod, Shivalik Sen, Praveen Sharma
PS II- Ramco Systems
2. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Data Health Monitoring Tool
• This tool will be used to execute consistency queries, transaction statistics, month end
reconciliations and generate reports. Phase 1 – Consistency Queries
• The consistency report is used as a measure of Data Health. It checks for inconsistent
data in the database.
• It uses the set of consistency queries that compare the master table with other tables
to find discrepancy in data.
• It is important to keep data discrepancy and inconsistencies at a minimum to reduce
query times, errors, faulty outputs,
• Transaction statistics is used to know about the frequency of the component of the
aviation product, used by the costumer, user load, etc.
3. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Sign In
4. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Dashboard
5. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Consistency Report
6. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Consistency Report
7. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Consistency Report Results
8. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Transaction Statistics
9. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Transaction Statistics Results
11. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Admin Site
12. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Admin Dashboard
13. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Authentication- User
14. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Add User
15. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Master- Business Component
16. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Add Customer
17. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Add Modules
18. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Sign Out
19. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Design
20. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Design
21. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Design
22. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Design
23. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
• Django is a free and open source web application framework, written in Python,
which follows the model view–controller (MVC) architectural pattern.
• A web application framework (WAF) is a software framework that is designed to
support the development of dynamic websites, web applications, web services and
web resources.
• Model–view–controller (MVC) is a software architectural pattern for implementing
user interfaces.
• Django’s primary goal is to ease the creation of complex, database-driven websites.
• Python is used throughout, even for settings, files, and data models.
Coding
24. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
• Model layer: Django provides an abstraction layer (the “models”) for structuring and
manipulating the data of your Web application.
• View layer: Django has the concept of “views” to encapsulate the logic responsible for
processing a user’s request and for returning the response.
• Template layer: The template layer provides a designer-friendly syntax for rendering
the information to be presented to the user .
• Server arrangements: Django officially supports four database backends: PostgreSQL,
MySQL, SQLite, and Oracle. Microsoft SQL Server can be used with django-mssql but
only in Microsoft operating systems.
Django Key Features
25. BITS Pilani, Deemed to be University under Section 3 of UGC Act, 1956
Data Analysis
• Phase two program
• Data analysis on a big data scale might be needed here. If in house servers not able
to handle – we will look at Hadoop/Hive options.
• Data mining needed to spot trends in Data Health – redundancies, inconsistencies,
etc
• Trends predictable or not – spikes can be predicted based on event sequence
algorithms
• In first phase – plan to introduce an intermediate level time domain analysis for
inconsistencies, redundancies – spot trends, spikes, etc