SlideShare une entreprise Scribd logo
1  sur  8
Télécharger pour lire hors ligne
The Four Primary Approaches to Data Quality Management




         The Four Primary Approaches to Data Quality Management
SUMMARY
Data Quality Management is a complex and varied set of approaches and tools. The large number
of these approaches and tools can be confusing for both Data Management professionals and
business people alike, and for all who attempt to maintain or improve the quality of data used by
their organisations. This paper helps you find your way through this complex landscape by:

   Providing a simple explanation of the main approaches
   Highlighting the main features of each approach
   Outlining the main strengths and shortcomings of each approach


AUTHORS
This paper is the first output of the DAMA UK Working Group on “Approaches to Data Quality
Management”.

Chris Maynard – Transforming Information
Zoey Husband – Ford Credit UK
Nigel Turner – Trillium Software
Neil Harvey – Diversey, part of Sealed Air

INTRODUCTION
While researching for this paper we have investigated approaches to maintaining and improving
the quality of information derived from the electronic data in an enterprise. We have chosen to
call these approaches, “Data Quality Management” (DQM). In our thinking, Data Quality
Management is a subset of Data Management.

Distilling the published methodologies for Data Quality Management reveals four recurring
themes. We call these the Primary Approaches to DQM. (It is possible that they apply to other
areas of Data Management, such as Data Security, but we have not yet investigated them.) Most
methodologies emphasise ONE of these primary approaches, some combine two, and a few
recognise all four.

Each approach has its merits. Each has its shortcomings. We will now consider each in turn.



                         This work is licensed under the Creative Commons Attribution-ShareAlike 3.0
                              Unported License. http://creativecommons.org/licenses/by-sa/3.0/
                                           Attribute to “DAMA UK” www.damauk.org


21st January 2012 v1.2                                                                          Page 1
The Four Primary Approaches to Data Quality Management

PEOPLE-BASED APPROACHES
Changing people’s attitudes and actions towards Data Quality Management through training,
education and community building

A people-based approach assumes that the main cause of poor Information Quality in
organisations is people. People can and often do create, amend and delete information and data
wrongly. Often people do not understand the value of the data assets they work with and so fail
to preserve, enhance or use those assets. So we focus on the people within the organisation,
improving their awareness and skills in Data Quality Management. This will in turn address the
basic shortcoming of Data Management, that of human ownership. Data and information are not
there to generate work for computers. They are there to help people make decisions.

People-based approaches encourage people to communicate and work together to solve their
information problems. They tend to regard Data Quality Management as a cultural and business
change challenge - business transformation is the key driver. IT systems and process are just
enablers. Outcomes of this approach include some interesting “stewardship”, “community of
practice” and “bodies of knowledge” (BOK) methodologies which, unlike the other approaches,
provide a clear role for a Human Resource function in Data Quality Management.

Typical Environments
This sort of approach is often used in Research and Development departments of large
organisations, particularly if they are geographically dispersed. These approaches often work well
in groups of professionals working with a high degree of autonomy such as medics and lawyers. In
contrast it is also effective in very small organisations, where just getting people to do things
consistently can make the biggest difference.

Strengths
People-centric approaches result in strong and sustainable Stewardship and Governance models.
IT Tools come and go, processes can be re-written. These approaches appreciate that people’s
behaviour, skills and attitudes are important in managing data and information. They recognise
the importance of human error as a cause of poor data quality. They can be very cost effective
and very motivating.

A key strength of a people-centric approach is it can produce results very quickly in areas where
data quality is down to human error or lack of understanding. In communities of practice it may
require little more than an evangelical figure and a few willing disciples as a driver.

Shortcomings
Frequent shortcomings are sustainability and penetration. There is only so much you can do in
changing behaviour; it requires willingness on behalf of both the “educator” and the “trainee”.

While quick fixes are possible, complete success requires building a true culture change. This
usually takes a long time. It requires long-term engagement from people and is therefore easily
hampered by political issues or poor relationships.



21st January 2012 v1.2                                                                       Page 2
The Four Primary Approaches to Data Quality Management


PROCESS-BASED APPROACHES
Delivering improved information by improving business processes

Process-driven approaches see DQM as first and foremost a business issue and not an IT problem.

Failures in data quality are seen primarily as the result of business process failures. Poor data
quality management and data quality are symptoms of poor process design and execution.
Improving processes can therefore enhance data and its management. In addition these
approaches often lay emphasis on getting to the root cause of the particular information quality
problem and then in designing, developing and deploying processes that remove or mitigate the
cause.

Typical Environments
These approaches are used in enterprises which rely on process discipline rather than individual
skill. They work well in process-driven enterprises such as manufacturing, call-centres, large retail
operations, and in organisations with a high staff turn-over.

Strengths
Process-based approaches are particularly attractive to business people as they tend to intuitively
understand the value of process so they are often the easiest “sell”.

They are a very good way of involving operational people in Data Quality Management and of
engaging business managers. The methodologies used encourage getting to the root cause of
each problem, as they drive data correction at source, removing or reducing the need to use costly
IT methods to transform the data.

If the correct Business Process Management tools are chosen to match specific situations and
business environments, these approaches can be very effective. They can be quick to deploy and
provide clearly defined statistics to demonstrate any improvements.

If the processes are developed with controls that enable to them to identify errors early, they can
ensure consistency.

Shortcomings
Not all Data Quality Management issues come from process failings. If this is not used in
conjunction with technology approaches the control can be manually intensive and resource-
hungry to implement, especially in larger organisations.

In large organisations process change can be expensive and resource-heavy and once set up, it
tends to require ongoing control and assurance.

Process approaches tend to encounter difficulties in high-skill enterprises or when there is no
repeated process, or no culture of process thinking.




21st January 2012 v1.2                                                                         Page 3
The Four Primary Approaches to Data Quality Management

INFORMATION-BASED APPROACHES
Improving the nature of the information itself, usually by focusing on structure and meaning

Information and data need good design and wide standardisation. The focus is on designing data
well so that a) it meets the enterprise’s requirements, b) it can be easily re-processed by different
systems and c) the information it represents can be productively shared between many people.

A failure to understand the significance of the information approach to Data Quality Management
can lead to a range of baffling problems in spite of our best intentions with people, process and
technology. High among these are problems of meaning such as the proverbial attempt to
“compare apples with oranges”. Incompatible data meaning can make automated interchange
between systems effectively impossible. Even a well-implemented, single shared system can be
quickly undermined by inconsistent reference data.

Terminology and practice among information-based approaches are diverse, but there is usually
an emphasis on structure, meaning and standardisation. Attention to Structure (e.g. Entity-
Relationship Modelling, Data Modelling, Normal Form, Business Rules) builds a foundation for data
that is compatible, complete, stable, flexible, concise and fit for purpose. Attention to Meaning
(e.g. Semantics, Taxonomy, Classification, Ontology, Meta-Data, Business Definitions) helps ensure
that data is comparable, consistent and intuitive. Standardisation (of Codes, Names, Definitions
and Structures) helps ensure that data is comparable, compatible and consistent across the
enterprise.

Typical Environments
These approaches are characteristic of many Data Management specialists. They thrive in large
organisations – large enough that standardisation cannot be achieved informally. They are useful
to those which need a high degree of control or precision in their information – government
departments, financial institutions, military and pharmaceuticals.

Strengths
At best these approaches help to bridge the divide between IT and non-IT functions. They provide
a language and tools to lead both sides to a deep understanding of their enterprise. They help
non-IT people to be precise about the information they need, making it easier for IT to meet those
needs. Once well embedded they allow new functionality to be built-on quickly. They provide an
excellent foundation for widespread data and information sharing.

Shortcomings
However, they require special skills. Getting good design used as standard across the enterprise
can require a high level of discipline. They can become an “ivory tower” exercise with no practical
relevance to the enterprise at large, especially if attempted with no regard to the other three
primary approaches. In that case the improved data structures can be almost impossible to
implement in practice. Some of these Information approaches are difficult to apply when most
applications are bought rather than built in house.




21st January 2012 v1.2                                                                         Page 4
The Four Primary Approaches to Data Quality Management

TECHNOLOGY-BASED APPROACHES
Bringing the power of technology to bear explicitly on information quality

Technology-based approaches recognise that the data explosion experienced globally over the last
ten years or so has been generated by advances in technology. These include the rise of the
internet, mobile access to data, digital storage and social networking. The volume of electronic
data now held by both organisations and individuals worldwide is such that it cannot be managed
without the use of specialist data quality technologies.

There is no doubt that technology has a critical role to play in Data Quality Management. In
response to this a plethora of established and emerging technologies have emerged to help
organisations store, manage, exploit and access electronic data. Some key technology areas
include databases and data warehouses, business intelligence applications, master data
management (MDM) tools, data quality improvement software, data mining and analytic
applications, metadata repositories, extract, transform and load (ETL) toolsets and data profiling
tools.

Typical Environments
Examples of technology-based approaches can be found in IT consultancies, financial departments
of large organisations and government departments.

Strengths
These approaches recognise that IT has a significant role to play in Data Quality Management and
its improvement. They appreciate that specialist Data Quality Management tools can make a
significant impact, especially in larger enterprises where the sheer quantity of electronic data
demands automated Data Quality Management

Shortcomings
The implication of this approach in many organisations is that Data Quality Management is
primarily the responsibility of the IT department. Improving Data Quality Management and its
exploitation is seen as a key function of IT – delivering the right information at the right time to
the right place at the right price.

However, Data Quality Management is more than a technology issue. Many studies have shown
that an organisation’s ability to capture, store and exploit data for commercial advantage is
heavily dependent on its business processes and the way its people create and change data. Many
data quality improvement initiatives fail to meet their stated objectives because they start with
the misperception that technology alone will deliver the required benefits. Buyers often fall for
the hype of technology vendors. These projects often turn into costly failures, because applying
new technology to problems can be an expensive investment. Sometimes focusing on people,
process or information can deliver a better return on investment. In summary, improving
technology can be a necessary part of improvement, but in itself is unlikely to give the enterprise
the data quality it needs.




21st January 2012 v1.2                                                                           Page 5
The Four Primary Approaches to Data Quality Management

COMBINED APPROACHES
Delivering superior information quality by combining more than one primary approach

The four Primary Approaches are People, Process, Information and
Technology. Given that two pairs (Information and Process,
People and Technology) – are often seen as opposites, we can
map the four approaches like this. Two pairs that are often
combined are linked by the dotted arrows.

If the four primary approaches have their strengths
and shortcomings then it comes as no surprise to find
that some methodologies are combinations of more
than one primary approach. We found some that combine
People and Process, some combine Information and
Technology, and a few combine all four in what we might call
Combined Approaches.

The existence of these approaches suggests that the Data Quality Management challenge is a
holistic one, necessarily encompassing all four primary approaches. Only this can bring about
enduring and comprehensive improvement.

Overemphasising one perspective can often negatively impact others. For instance introducing a
new Customer Relationship Management system without changing business processes or
retraining people can make the problem worse and not better. Trying to optimise one approach
without properly assessing its wider ramifications can have the effect of sub-optimising the whole.

Typical environments
The more complex the environment the more likely it is that you will see such a model. Examples
might be a global organisation with different divisions or regions in different states of maturity, a
telecommunications company, a global bank or a large retailer.

Strengths
Data Quality Management is a complex challenge. Tackling that challenge with a combination of
people, process, information and technology increases the chance of success. Progress in one
dimension supports or stimulates progress in another, improving the chance of making and
sustaining overall improvements in quality. The combined approach recognises this, approaches
the problem accordingly, and so is more likely to find fundamental solutions to the root causes. It
also forces business and IT to work together to address the problems.

Shortcomings
In practice a combined approach means that although individuals or groups can be given primary
responsibility for leading the Data Quality Management change, they need to involve all affected
stakeholders. Data Quality Managers are thus faced with an organisational transformation
challenge, which is typically beyond their authority and ability. Combined approaches are rarely
quick fixes. These approaches can be complex and time consuming and many people feel
uncomfortable dealing with the required level of complexity.

21st January 2012 v1.2                                                                         Page 6
The Four Primary Approaches to Data Quality Management

SO WHAT DO I AIM FOR?
Use whichever primary approach suits your organisation and your skills, but take time to learn
about the others and always bear in mind that if you have problems getting one approach to be
effective, there may be an answer waiting in another.
If you are a beginner in Data Quality Management, don’t be afraid to get stuck in to just one of the
primary approaches. Your route in can start with any of them. But if you want to develop a career
in this area, then, over time, you should work to get experience of each of the others. This will
maximise your value to your enterprise.

ACKNOWLEDGEMENTS
Throughout this paper we have avoided making reference to specific authors. All methodologies
have their merits and shortcomings.

However, we found in our research two authors who have come independently to somewhat
similar conclusions as ourselves. It is therefore right to acknowledge them here. John McKean in
his book “Information Masters: Secrets of the Customer Race” writes of “a balanced investment
across the seven information competency determinants of people skills, processes, organization
structure, culture, leadership, technology and information itself.” If, as we believe, his “people
skills, organization structure, culture and leadership” map into our primary approach of “people”
then we recognise the same four categories.

Dan Power in an article called “A 4-D Approach to Data Governance” writes that “working across
the four dimensions of people, process, technology and information is critical to your data
governance success.” (Information Management Magazine, May/June 2011.)

AND FINALLY
The path to good Data Quality Management and Data Quality Management can be a long and
lonely one. So keep in touch with other professionals. Remember it is a marathon and not a
sprint. High quality and sustainable solutions take time to build.

Keep up to date with new ideas. This is a growing area of interest but as yet there is no Utopian
solution. There is and will be a lot of good advice out there.


                                               -o0o-



Chris Maynard
Nigel Turner
Zoey Husband
Neil Harvey




21st January 2012 v1.2                                                                       Page 7
The Four Primary Approaches to Data Quality Management

STRENGTHS AND SHORTCOMINGS OF THE FOUR PRIMARY DATA QUALITY MANAGEMENT APPROACHES
 Approach                             Strengths                                                   Shortcomings                                               When to consider?
               Appreciates that people’s behaviour, skills and attitudes
                                                                                                                                              When people’s behaviour and motivation is a key
                are important in managing data and information               Culture change usually takes a long time so not good for
                                                                                                                                               issue
               Recognises the importance of human error as a cause of        problems that require more urgent solutions
                                                                                                                                              When enterprise is loosely controlled with high
PEOPLE          poor data quality                                            Absolutely requires engagement from people
                                                                                                                                               personal autonomy
               Improving Data Quality Management can ultimately only        Easily hampered by political issues or poor relationships
                                                                                                                                              High-skill enterprises
                happen if people recognise its importance
                                                                                                                                              Small rather than large enterprises
               Can be very cost effective and very motivating
               Recognises that good processes create good data, bad
                processes create bad data, so the process must be fixed
                                                                             Tends to be heavily manually intensive, so resource hungry      High staff turnover or process-driven enterprises
                to improve the data
                                                                              to implement, especially in larger organisations                When driving Data Quality Management from outside
               Encourages getting to the root causes of quality
                                                                             Once set up, this tends to require ongoing control               IT or when the IT department cannot be involved
PROCESS         problems
                                                                             In large organisations, processes are difficult to change       Can be an “easier sell” to the enterprise
               Business people tend to understand processes intuitively
                                                                             May encounter difficulties in high-skill enterprises or when    Aligns well with process-driven enterprises e.g.
                so encourages leadership and involvement,
                                                                              there is no repeated process                                     manufacturing, call-centres, retail
               A good way of engaging business managers and
                operational people in Data Quality Management
               Focuses on the data itself which is, after all, our goal
               Starting with the information can bring insights of value    Requires special skills
                                                                                                                                              Soon
                to the business                                              Getting good design used as standard across the enterprise
                                                                                                                                              “Greenfield” situation
               An important contributor to understanding the problem         can require a high level of discipline
                                                                                                                                              Mergers and acquisitions
                – even when the solution is to be found with another         They can become an “ivory tower” exercise with no
                                                                                                                                              Major integration exercises (of systems of
                approach                                                      practical relevance to the enterprise at large. Then
INFORMATION                                                                                                                                    organisations)
               Recognises that business and IT need to work in               improved data structures can be almost impossible to
                                                                                                                                              Where you don’t know about the company or the
                partnership to resolve problems                               implement in practice
                                                                                                                                               information space
               Data has more permanence than process and the high           Some of these Information approaches are difficult to apply
                                                                                                                                              Very useful in integrating systems or enterprises
                level decision-makers in the enterprise often recognise       when most applications are bought rather than built in
                the value                                                     house.
               Encourages and supports “fact-based” decision making
                                                                             Tends to reinforce the view that Data Quality Management        When you have a clear set of requirements matched
               Recognises that IT has a significant role to play in Data
                                                                              is an IT and not a enterprise challenge                          to a clear technology solution
                Quality Management and its improvement
                                                                             May be used to “hide” data problems and increase the            When IT is driving Data Quality Management with
               Specialist Data Quality Management tools can make a
TECHNOLOGY                                                                    problems longer term                                             little support from the rest of the enterprise
                significant impact, especially in larger enterprises
                                                                             Can be a significant expense with uncertainty of return on      When large volumes of data are involved
               The exponential growth of electronic data demands new
                                                                              investment                                                      In highly automated enterprises
                tools to help automate Data Quality Management
                                                                             New technology can be very disruptive to an enterprise          When improvements need no human intervention




21st January 2012 v1.2                                                                                                                                                                         Page 8

Contenu connexe

Dernier

BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,noida100girls
 
Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Seta Wicaksana
 
Youth Involvement in an Innovative Coconut Value Chain by Mwalimu Menza
Youth Involvement in an Innovative Coconut Value Chain by Mwalimu MenzaYouth Involvement in an Innovative Coconut Value Chain by Mwalimu Menza
Youth Involvement in an Innovative Coconut Value Chain by Mwalimu Menzaictsugar
 
Future Of Sample Report 2024 | Redacted Version
Future Of Sample Report 2024 | Redacted VersionFuture Of Sample Report 2024 | Redacted Version
Future Of Sample Report 2024 | Redacted VersionMintel Group
 
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...lizamodels9
 
Buy gmail accounts.pdf Buy Old Gmail Accounts
Buy gmail accounts.pdf Buy Old Gmail AccountsBuy gmail accounts.pdf Buy Old Gmail Accounts
Buy gmail accounts.pdf Buy Old Gmail AccountsBuy Verified Accounts
 
Independent Call Girls Andheri Nightlaila 9967584737
Independent Call Girls Andheri Nightlaila 9967584737Independent Call Girls Andheri Nightlaila 9967584737
Independent Call Girls Andheri Nightlaila 9967584737Riya Pathan
 
8447779800, Low rate Call girls in Tughlakabad Delhi NCR
8447779800, Low rate Call girls in Tughlakabad Delhi NCR8447779800, Low rate Call girls in Tughlakabad Delhi NCR
8447779800, Low rate Call girls in Tughlakabad Delhi NCRashishs7044
 
Call Girls In Connaught Place Delhi ❤️88604**77959_Russian 100% Genuine Escor...
Call Girls In Connaught Place Delhi ❤️88604**77959_Russian 100% Genuine Escor...Call Girls In Connaught Place Delhi ❤️88604**77959_Russian 100% Genuine Escor...
Call Girls In Connaught Place Delhi ❤️88604**77959_Russian 100% Genuine Escor...lizamodels9
 
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort ServiceCall US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Servicecallgirls2057
 
Investment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy CheruiyotInvestment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy Cheruiyotictsugar
 
The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024christinemoorman
 
Innovation Conference 5th March 2024.pdf
Innovation Conference 5th March 2024.pdfInnovation Conference 5th March 2024.pdf
Innovation Conference 5th March 2024.pdfrichard876048
 
Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Kirill Klimov
 
NewBase 19 April 2024 Energy News issue - 1717 by Khaled Al Awadi.pdf
NewBase  19 April  2024  Energy News issue - 1717 by Khaled Al Awadi.pdfNewBase  19 April  2024  Energy News issue - 1717 by Khaled Al Awadi.pdf
NewBase 19 April 2024 Energy News issue - 1717 by Khaled Al Awadi.pdfKhaled Al Awadi
 
Organizational Structure Running A Successful Business
Organizational Structure Running A Successful BusinessOrganizational Structure Running A Successful Business
Organizational Structure Running A Successful BusinessSeta Wicaksana
 
Digital Transformation in the PLM domain - distrib.pdf
Digital Transformation in the PLM domain - distrib.pdfDigital Transformation in the PLM domain - distrib.pdf
Digital Transformation in the PLM domain - distrib.pdfJos Voskuil
 
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCRashishs7044
 
Islamabad Escorts | Call 03070433345 | Escort Service in Islamabad
Islamabad Escorts | Call 03070433345 | Escort Service in IslamabadIslamabad Escorts | Call 03070433345 | Escort Service in Islamabad
Islamabad Escorts | Call 03070433345 | Escort Service in IslamabadAyesha Khan
 

Dernier (20)

BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
 
Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...
 
Youth Involvement in an Innovative Coconut Value Chain by Mwalimu Menza
Youth Involvement in an Innovative Coconut Value Chain by Mwalimu MenzaYouth Involvement in an Innovative Coconut Value Chain by Mwalimu Menza
Youth Involvement in an Innovative Coconut Value Chain by Mwalimu Menza
 
Future Of Sample Report 2024 | Redacted Version
Future Of Sample Report 2024 | Redacted VersionFuture Of Sample Report 2024 | Redacted Version
Future Of Sample Report 2024 | Redacted Version
 
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
 
Buy gmail accounts.pdf Buy Old Gmail Accounts
Buy gmail accounts.pdf Buy Old Gmail AccountsBuy gmail accounts.pdf Buy Old Gmail Accounts
Buy gmail accounts.pdf Buy Old Gmail Accounts
 
Japan IT Week 2024 Brochure by 47Billion (English)
Japan IT Week 2024 Brochure by 47Billion (English)Japan IT Week 2024 Brochure by 47Billion (English)
Japan IT Week 2024 Brochure by 47Billion (English)
 
Independent Call Girls Andheri Nightlaila 9967584737
Independent Call Girls Andheri Nightlaila 9967584737Independent Call Girls Andheri Nightlaila 9967584737
Independent Call Girls Andheri Nightlaila 9967584737
 
8447779800, Low rate Call girls in Tughlakabad Delhi NCR
8447779800, Low rate Call girls in Tughlakabad Delhi NCR8447779800, Low rate Call girls in Tughlakabad Delhi NCR
8447779800, Low rate Call girls in Tughlakabad Delhi NCR
 
Call Girls In Connaught Place Delhi ❤️88604**77959_Russian 100% Genuine Escor...
Call Girls In Connaught Place Delhi ❤️88604**77959_Russian 100% Genuine Escor...Call Girls In Connaught Place Delhi ❤️88604**77959_Russian 100% Genuine Escor...
Call Girls In Connaught Place Delhi ❤️88604**77959_Russian 100% Genuine Escor...
 
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort ServiceCall US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
 
Investment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy CheruiyotInvestment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy Cheruiyot
 
The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024
 
Innovation Conference 5th March 2024.pdf
Innovation Conference 5th March 2024.pdfInnovation Conference 5th March 2024.pdf
Innovation Conference 5th March 2024.pdf
 
Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024
 
NewBase 19 April 2024 Energy News issue - 1717 by Khaled Al Awadi.pdf
NewBase  19 April  2024  Energy News issue - 1717 by Khaled Al Awadi.pdfNewBase  19 April  2024  Energy News issue - 1717 by Khaled Al Awadi.pdf
NewBase 19 April 2024 Energy News issue - 1717 by Khaled Al Awadi.pdf
 
Organizational Structure Running A Successful Business
Organizational Structure Running A Successful BusinessOrganizational Structure Running A Successful Business
Organizational Structure Running A Successful Business
 
Digital Transformation in the PLM domain - distrib.pdf
Digital Transformation in the PLM domain - distrib.pdfDigital Transformation in the PLM domain - distrib.pdf
Digital Transformation in the PLM domain - distrib.pdf
 
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
 
Islamabad Escorts | Call 03070433345 | Escort Service in Islamabad
Islamabad Escorts | Call 03070433345 | Escort Service in IslamabadIslamabad Escorts | Call 03070433345 | Escort Service in Islamabad
Islamabad Escorts | Call 03070433345 | Escort Service in Islamabad
 

En vedette

PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 

En vedette (20)

PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 

DAMA UK Approaches to Data Quality Management

  • 1. The Four Primary Approaches to Data Quality Management The Four Primary Approaches to Data Quality Management SUMMARY Data Quality Management is a complex and varied set of approaches and tools. The large number of these approaches and tools can be confusing for both Data Management professionals and business people alike, and for all who attempt to maintain or improve the quality of data used by their organisations. This paper helps you find your way through this complex landscape by:  Providing a simple explanation of the main approaches  Highlighting the main features of each approach  Outlining the main strengths and shortcomings of each approach AUTHORS This paper is the first output of the DAMA UK Working Group on “Approaches to Data Quality Management”. Chris Maynard – Transforming Information Zoey Husband – Ford Credit UK Nigel Turner – Trillium Software Neil Harvey – Diversey, part of Sealed Air INTRODUCTION While researching for this paper we have investigated approaches to maintaining and improving the quality of information derived from the electronic data in an enterprise. We have chosen to call these approaches, “Data Quality Management” (DQM). In our thinking, Data Quality Management is a subset of Data Management. Distilling the published methodologies for Data Quality Management reveals four recurring themes. We call these the Primary Approaches to DQM. (It is possible that they apply to other areas of Data Management, such as Data Security, but we have not yet investigated them.) Most methodologies emphasise ONE of these primary approaches, some combine two, and a few recognise all four. Each approach has its merits. Each has its shortcomings. We will now consider each in turn. This work is licensed under the Creative Commons Attribution-ShareAlike 3.0 Unported License. http://creativecommons.org/licenses/by-sa/3.0/ Attribute to “DAMA UK” www.damauk.org 21st January 2012 v1.2 Page 1
  • 2. The Four Primary Approaches to Data Quality Management PEOPLE-BASED APPROACHES Changing people’s attitudes and actions towards Data Quality Management through training, education and community building A people-based approach assumes that the main cause of poor Information Quality in organisations is people. People can and often do create, amend and delete information and data wrongly. Often people do not understand the value of the data assets they work with and so fail to preserve, enhance or use those assets. So we focus on the people within the organisation, improving their awareness and skills in Data Quality Management. This will in turn address the basic shortcoming of Data Management, that of human ownership. Data and information are not there to generate work for computers. They are there to help people make decisions. People-based approaches encourage people to communicate and work together to solve their information problems. They tend to regard Data Quality Management as a cultural and business change challenge - business transformation is the key driver. IT systems and process are just enablers. Outcomes of this approach include some interesting “stewardship”, “community of practice” and “bodies of knowledge” (BOK) methodologies which, unlike the other approaches, provide a clear role for a Human Resource function in Data Quality Management. Typical Environments This sort of approach is often used in Research and Development departments of large organisations, particularly if they are geographically dispersed. These approaches often work well in groups of professionals working with a high degree of autonomy such as medics and lawyers. In contrast it is also effective in very small organisations, where just getting people to do things consistently can make the biggest difference. Strengths People-centric approaches result in strong and sustainable Stewardship and Governance models. IT Tools come and go, processes can be re-written. These approaches appreciate that people’s behaviour, skills and attitudes are important in managing data and information. They recognise the importance of human error as a cause of poor data quality. They can be very cost effective and very motivating. A key strength of a people-centric approach is it can produce results very quickly in areas where data quality is down to human error or lack of understanding. In communities of practice it may require little more than an evangelical figure and a few willing disciples as a driver. Shortcomings Frequent shortcomings are sustainability and penetration. There is only so much you can do in changing behaviour; it requires willingness on behalf of both the “educator” and the “trainee”. While quick fixes are possible, complete success requires building a true culture change. This usually takes a long time. It requires long-term engagement from people and is therefore easily hampered by political issues or poor relationships. 21st January 2012 v1.2 Page 2
  • 3. The Four Primary Approaches to Data Quality Management PROCESS-BASED APPROACHES Delivering improved information by improving business processes Process-driven approaches see DQM as first and foremost a business issue and not an IT problem. Failures in data quality are seen primarily as the result of business process failures. Poor data quality management and data quality are symptoms of poor process design and execution. Improving processes can therefore enhance data and its management. In addition these approaches often lay emphasis on getting to the root cause of the particular information quality problem and then in designing, developing and deploying processes that remove or mitigate the cause. Typical Environments These approaches are used in enterprises which rely on process discipline rather than individual skill. They work well in process-driven enterprises such as manufacturing, call-centres, large retail operations, and in organisations with a high staff turn-over. Strengths Process-based approaches are particularly attractive to business people as they tend to intuitively understand the value of process so they are often the easiest “sell”. They are a very good way of involving operational people in Data Quality Management and of engaging business managers. The methodologies used encourage getting to the root cause of each problem, as they drive data correction at source, removing or reducing the need to use costly IT methods to transform the data. If the correct Business Process Management tools are chosen to match specific situations and business environments, these approaches can be very effective. They can be quick to deploy and provide clearly defined statistics to demonstrate any improvements. If the processes are developed with controls that enable to them to identify errors early, they can ensure consistency. Shortcomings Not all Data Quality Management issues come from process failings. If this is not used in conjunction with technology approaches the control can be manually intensive and resource- hungry to implement, especially in larger organisations. In large organisations process change can be expensive and resource-heavy and once set up, it tends to require ongoing control and assurance. Process approaches tend to encounter difficulties in high-skill enterprises or when there is no repeated process, or no culture of process thinking. 21st January 2012 v1.2 Page 3
  • 4. The Four Primary Approaches to Data Quality Management INFORMATION-BASED APPROACHES Improving the nature of the information itself, usually by focusing on structure and meaning Information and data need good design and wide standardisation. The focus is on designing data well so that a) it meets the enterprise’s requirements, b) it can be easily re-processed by different systems and c) the information it represents can be productively shared between many people. A failure to understand the significance of the information approach to Data Quality Management can lead to a range of baffling problems in spite of our best intentions with people, process and technology. High among these are problems of meaning such as the proverbial attempt to “compare apples with oranges”. Incompatible data meaning can make automated interchange between systems effectively impossible. Even a well-implemented, single shared system can be quickly undermined by inconsistent reference data. Terminology and practice among information-based approaches are diverse, but there is usually an emphasis on structure, meaning and standardisation. Attention to Structure (e.g. Entity- Relationship Modelling, Data Modelling, Normal Form, Business Rules) builds a foundation for data that is compatible, complete, stable, flexible, concise and fit for purpose. Attention to Meaning (e.g. Semantics, Taxonomy, Classification, Ontology, Meta-Data, Business Definitions) helps ensure that data is comparable, consistent and intuitive. Standardisation (of Codes, Names, Definitions and Structures) helps ensure that data is comparable, compatible and consistent across the enterprise. Typical Environments These approaches are characteristic of many Data Management specialists. They thrive in large organisations – large enough that standardisation cannot be achieved informally. They are useful to those which need a high degree of control or precision in their information – government departments, financial institutions, military and pharmaceuticals. Strengths At best these approaches help to bridge the divide between IT and non-IT functions. They provide a language and tools to lead both sides to a deep understanding of their enterprise. They help non-IT people to be precise about the information they need, making it easier for IT to meet those needs. Once well embedded they allow new functionality to be built-on quickly. They provide an excellent foundation for widespread data and information sharing. Shortcomings However, they require special skills. Getting good design used as standard across the enterprise can require a high level of discipline. They can become an “ivory tower” exercise with no practical relevance to the enterprise at large, especially if attempted with no regard to the other three primary approaches. In that case the improved data structures can be almost impossible to implement in practice. Some of these Information approaches are difficult to apply when most applications are bought rather than built in house. 21st January 2012 v1.2 Page 4
  • 5. The Four Primary Approaches to Data Quality Management TECHNOLOGY-BASED APPROACHES Bringing the power of technology to bear explicitly on information quality Technology-based approaches recognise that the data explosion experienced globally over the last ten years or so has been generated by advances in technology. These include the rise of the internet, mobile access to data, digital storage and social networking. The volume of electronic data now held by both organisations and individuals worldwide is such that it cannot be managed without the use of specialist data quality technologies. There is no doubt that technology has a critical role to play in Data Quality Management. In response to this a plethora of established and emerging technologies have emerged to help organisations store, manage, exploit and access electronic data. Some key technology areas include databases and data warehouses, business intelligence applications, master data management (MDM) tools, data quality improvement software, data mining and analytic applications, metadata repositories, extract, transform and load (ETL) toolsets and data profiling tools. Typical Environments Examples of technology-based approaches can be found in IT consultancies, financial departments of large organisations and government departments. Strengths These approaches recognise that IT has a significant role to play in Data Quality Management and its improvement. They appreciate that specialist Data Quality Management tools can make a significant impact, especially in larger enterprises where the sheer quantity of electronic data demands automated Data Quality Management Shortcomings The implication of this approach in many organisations is that Data Quality Management is primarily the responsibility of the IT department. Improving Data Quality Management and its exploitation is seen as a key function of IT – delivering the right information at the right time to the right place at the right price. However, Data Quality Management is more than a technology issue. Many studies have shown that an organisation’s ability to capture, store and exploit data for commercial advantage is heavily dependent on its business processes and the way its people create and change data. Many data quality improvement initiatives fail to meet their stated objectives because they start with the misperception that technology alone will deliver the required benefits. Buyers often fall for the hype of technology vendors. These projects often turn into costly failures, because applying new technology to problems can be an expensive investment. Sometimes focusing on people, process or information can deliver a better return on investment. In summary, improving technology can be a necessary part of improvement, but in itself is unlikely to give the enterprise the data quality it needs. 21st January 2012 v1.2 Page 5
  • 6. The Four Primary Approaches to Data Quality Management COMBINED APPROACHES Delivering superior information quality by combining more than one primary approach The four Primary Approaches are People, Process, Information and Technology. Given that two pairs (Information and Process, People and Technology) – are often seen as opposites, we can map the four approaches like this. Two pairs that are often combined are linked by the dotted arrows. If the four primary approaches have their strengths and shortcomings then it comes as no surprise to find that some methodologies are combinations of more than one primary approach. We found some that combine People and Process, some combine Information and Technology, and a few combine all four in what we might call Combined Approaches. The existence of these approaches suggests that the Data Quality Management challenge is a holistic one, necessarily encompassing all four primary approaches. Only this can bring about enduring and comprehensive improvement. Overemphasising one perspective can often negatively impact others. For instance introducing a new Customer Relationship Management system without changing business processes or retraining people can make the problem worse and not better. Trying to optimise one approach without properly assessing its wider ramifications can have the effect of sub-optimising the whole. Typical environments The more complex the environment the more likely it is that you will see such a model. Examples might be a global organisation with different divisions or regions in different states of maturity, a telecommunications company, a global bank or a large retailer. Strengths Data Quality Management is a complex challenge. Tackling that challenge with a combination of people, process, information and technology increases the chance of success. Progress in one dimension supports or stimulates progress in another, improving the chance of making and sustaining overall improvements in quality. The combined approach recognises this, approaches the problem accordingly, and so is more likely to find fundamental solutions to the root causes. It also forces business and IT to work together to address the problems. Shortcomings In practice a combined approach means that although individuals or groups can be given primary responsibility for leading the Data Quality Management change, they need to involve all affected stakeholders. Data Quality Managers are thus faced with an organisational transformation challenge, which is typically beyond their authority and ability. Combined approaches are rarely quick fixes. These approaches can be complex and time consuming and many people feel uncomfortable dealing with the required level of complexity. 21st January 2012 v1.2 Page 6
  • 7. The Four Primary Approaches to Data Quality Management SO WHAT DO I AIM FOR? Use whichever primary approach suits your organisation and your skills, but take time to learn about the others and always bear in mind that if you have problems getting one approach to be effective, there may be an answer waiting in another. If you are a beginner in Data Quality Management, don’t be afraid to get stuck in to just one of the primary approaches. Your route in can start with any of them. But if you want to develop a career in this area, then, over time, you should work to get experience of each of the others. This will maximise your value to your enterprise. ACKNOWLEDGEMENTS Throughout this paper we have avoided making reference to specific authors. All methodologies have their merits and shortcomings. However, we found in our research two authors who have come independently to somewhat similar conclusions as ourselves. It is therefore right to acknowledge them here. John McKean in his book “Information Masters: Secrets of the Customer Race” writes of “a balanced investment across the seven information competency determinants of people skills, processes, organization structure, culture, leadership, technology and information itself.” If, as we believe, his “people skills, organization structure, culture and leadership” map into our primary approach of “people” then we recognise the same four categories. Dan Power in an article called “A 4-D Approach to Data Governance” writes that “working across the four dimensions of people, process, technology and information is critical to your data governance success.” (Information Management Magazine, May/June 2011.) AND FINALLY The path to good Data Quality Management and Data Quality Management can be a long and lonely one. So keep in touch with other professionals. Remember it is a marathon and not a sprint. High quality and sustainable solutions take time to build. Keep up to date with new ideas. This is a growing area of interest but as yet there is no Utopian solution. There is and will be a lot of good advice out there. -o0o- Chris Maynard Nigel Turner Zoey Husband Neil Harvey 21st January 2012 v1.2 Page 7
  • 8. The Four Primary Approaches to Data Quality Management STRENGTHS AND SHORTCOMINGS OF THE FOUR PRIMARY DATA QUALITY MANAGEMENT APPROACHES Approach Strengths Shortcomings When to consider?  Appreciates that people’s behaviour, skills and attitudes  When people’s behaviour and motivation is a key are important in managing data and information  Culture change usually takes a long time so not good for issue  Recognises the importance of human error as a cause of problems that require more urgent solutions  When enterprise is loosely controlled with high PEOPLE poor data quality  Absolutely requires engagement from people personal autonomy  Improving Data Quality Management can ultimately only  Easily hampered by political issues or poor relationships  High-skill enterprises happen if people recognise its importance  Small rather than large enterprises  Can be very cost effective and very motivating  Recognises that good processes create good data, bad processes create bad data, so the process must be fixed  Tends to be heavily manually intensive, so resource hungry  High staff turnover or process-driven enterprises to improve the data to implement, especially in larger organisations  When driving Data Quality Management from outside  Encourages getting to the root causes of quality  Once set up, this tends to require ongoing control IT or when the IT department cannot be involved PROCESS problems  In large organisations, processes are difficult to change  Can be an “easier sell” to the enterprise  Business people tend to understand processes intuitively  May encounter difficulties in high-skill enterprises or when  Aligns well with process-driven enterprises e.g. so encourages leadership and involvement, there is no repeated process manufacturing, call-centres, retail  A good way of engaging business managers and operational people in Data Quality Management  Focuses on the data itself which is, after all, our goal  Starting with the information can bring insights of value  Requires special skills  Soon to the business  Getting good design used as standard across the enterprise  “Greenfield” situation  An important contributor to understanding the problem can require a high level of discipline  Mergers and acquisitions – even when the solution is to be found with another  They can become an “ivory tower” exercise with no  Major integration exercises (of systems of approach practical relevance to the enterprise at large. Then INFORMATION organisations)  Recognises that business and IT need to work in improved data structures can be almost impossible to  Where you don’t know about the company or the partnership to resolve problems implement in practice information space  Data has more permanence than process and the high  Some of these Information approaches are difficult to apply  Very useful in integrating systems or enterprises level decision-makers in the enterprise often recognise when most applications are bought rather than built in the value house.  Encourages and supports “fact-based” decision making  Tends to reinforce the view that Data Quality Management  When you have a clear set of requirements matched  Recognises that IT has a significant role to play in Data is an IT and not a enterprise challenge to a clear technology solution Quality Management and its improvement  May be used to “hide” data problems and increase the  When IT is driving Data Quality Management with  Specialist Data Quality Management tools can make a TECHNOLOGY problems longer term little support from the rest of the enterprise significant impact, especially in larger enterprises  Can be a significant expense with uncertainty of return on  When large volumes of data are involved  The exponential growth of electronic data demands new investment  In highly automated enterprises tools to help automate Data Quality Management  New technology can be very disruptive to an enterprise  When improvements need no human intervention 21st January 2012 v1.2 Page 8