Your Analytics does not have to be dramatic to be useful

Andrew Patricio
Andrew PatricioFounder at dataeffectiveness.com à Data Effectiveness
Analytics doesn’t have to be
dramatic to be useful
11 September 2023
Background
People
Structure
Data “Science” to Data Science
Background
Intro
Andrew Patricio
Principal, Digital Services UnidosUS
Previous
• DC Govt
• Management Consulting
UnidosUS
UnidosUS, previously known as NCLR (National
Council of La Raza) is the nation’s largest
Hispanic civil rights and advocacy organization.
• Policy & Advocacy
• Programs
• Partner with affiliated local organizations that
work directly with community
• Affiliate Network – 280+ affiliates across the US
• Principal, Digital Services
• New role, started spring 2021
• Chief digital/data officer function
UnidosUS acts as Platform
We enable the
work of and act as
a convenor for
nonprofits working
with US Hispanic
community
TA + $
TA
+
$
Ecosystem of subgrants
and technical assistance
(TA) to affiliates and
other partners
Data is an overhead cost
DATA
DATA
Data is fragmented
and is a cost not an
asset.
Data approach is
tactical and
transactional.
Doesn’t support
ecosystem
Solution: UnidosUS JUNTOS PLATFORM
JUNTOS
PLATFORM
Affiliates /
Partners
Community
Government
“Virtual”
Affilliate
Affilliate 1
Affilliate 2
Affilliate 3
Funders
Data becomes an
organizational and
community
resource
Academia
Staff
DATA
DATA
JUNTOS
PLATFORM
DATA
DATA
UnidosUS “platform” supported by Juntos Platform
Ecosystem of
subgrants and
technical assistance
supported by data
as an asset
TA + $
TA
+
$
High level data platform architecture
Data catalog
Data
Model
processing
Data Lake
(File level tagging)
monday
.com
Raisers
Edge
Other data
files: excel, csv,
etc
Concur
Read only
one way
exports
Intake
Processing
Data
Model
interface
JUNTOS
PLATFORM
Data Analyst Low
level queries using R,
SQL, Python, etc
Program Staff dashboards
WFD
Edu
Health
Finance
P&A
Housing
Data Warehouse
structured
“enterprise data model”
WFD
Edu
Housing
Finance
P&A
Health
MetaData
(Affiliate, Location, etc)
Analytics Data
Products
Adhoc &
scheduled
Queries
External Data
(Census, BLS, CDC, etc)
Reality
Alchemer
Quickbase
Great
plains
Housing
Health
Edu
WFD
Fiannce
P&A
People
Data people more important than data system
Right data person/Wrong system
Inefficient but effective
Wrong data person/Right system
Efficiently ineffective
Start with program person with “data mentality” who can be trained on data
tools/techniques rather than data person that needs to learn program.
Analytics does not replace Intuition
We hope to see something different from
a new data tool/approach because we
think the purpose of analytics is to replace
“subjective” human judgement
Purpose of analytics is to support human
work
• Data supporting communication
• Data supporting understanding
Intuition
Data
Analytics
Analytics Data
Intuition and data are part of a cycle, not two
different paths
Judgement
Judgement
Judgement
Intuition
Data Sophistication Journey
Stage Focus Question Tools Relevant and Easily Available
Immediate Fulfill
requests
Where is the data? understand the need to do more with data
but not exactly what that means
Email, phone Data doesn’t exist until we ask for it
Present Data
capture
What is the data? staff are able to ask simple questions about
the data because its easier to get to
Individual
databases
Data exists but not easily accessible
Past Reporting What is the data telling us about what is going on now?
standard metrics/business rules/reports are precalculated so
staff can spend time on more value adding data work
Data lake,
Data marts
Data exists and is easily accessible via
dashboards and other data tools
Future Analytics What is the data telling us about what we should do?
Data is a core part of how we plan out our work because it is
very easy to get to. Our educated guesses are now more data
supported, our gut feelings easily can be validated and fleshed
out with data analytics
Data
Warehouse,
Data Science
New data from analytics products is
easily created and easily accessible
Current
focus
An organization’s approach to data evolves over time
Digestibility – Meet your users where they are
Create appropriate level of data system for your data sophistication
Analytics cannot far outstrip your user’s ability to use it
Set expectations to right level – what is possible based on data quality etc
Don’t build a
Ferrari to go
through a field
“Data Entry Team” not “Users”
End users are fundamental to success but “Analytics" can be intimidating
Start your users slow
and work your way up
You
are
here
Start with the familiar
Recognizing
themselves in the
data increases
emotional buy-in
(eg GIS - first thing
people do a try and
find thier house)
Reduce Cognitive workload
Systems provide structure and orientation
• Logical flow (step 1, step 2, etc)
• Forest instead of trees (data points in
context)
Common language for communication
Goal is to have accurate metrics aligned with business goal
1. Cannot talk about accuracy if there isn’t agreement on the value being reported
2. Once the value is consistent, you can talk about if it’s accurate
3. Once it’s accurate you can talk about whether it’s relevant to business goal
Metric A
Report 1: 90
Report 2: 81
Report 3: 87
Metric A
Report 1: 87
Report 2: 87
Report 3: 87
Consistent
Metric A
Report 1: 85
Report 2: 85
Report 3: 85
Metric
aligned with
goal
Not
Relevant
Determine proposed change
and go through cycle again
Accurate Relevant
DATA KNOWLEDGE INFORMATION
Accuracy
Relevancy
Consistency
0
1
2
3
4
5
6
Immediate Present Past Future
Data Confidence – Evolves over time
Confidence
starts off
unknown
Confidence drops but
uncertainty narrows as you
pull data into a reporting
system and you see your
actual data quality is poor
As data is actually
captured, our confidence
increases but is still
somewhat uncertain
Your understanding of
your data increases,
quality goes up, and
confidence rebounds
Set expectations when putting new system in place.
“Garbage in is Garbage out” – realization usually starts with seeing “Garbage out”
Structure
Not all interesting questions are relevant
Resources should be focused
on data that ultimately solves
the main problem of achieving
organizational goals
Prioritization
• Desired organizational success prioritize which outcomes business should focus on
• Desired business outcomes prioritize which decisions analytics should focus on
• Desired analytics decisions prioritizes which data reporting should focus on
Prioritize
Outcomes
Prioritize
Analytics
Prioritize
Data
Traceability
Traceability tells you what is impacted
by upstream mistakes or change in
business rules
System helps tie outputs back to
inputs
Data “Science” to Data Science
Data Science - Iteration
Science is usually
about incrementalism
not revolution
Maxwell Lorentz Michaelson, Morley
Poincaré
“Standing on the shoulders of giants”
Data Science - Experimentation
Independent Variables - controllable
Independent Variables - environmental Systems /
Processes
System helps to focus
on what should be
controlled and what of
that can actually be
controlled
Data Science - Statistics
Data as common language for
communication
• Stats vs individual anecdotes
• Shared institutional knowledge
Andrew Patricio
apatricio@unidosus.org
https://www.linkedin.com/in/andrewpatricio1/
1 sur 28

Recommandé

DC Salesforce1 Tour Data Governance Lunch Best Practices deck par
DC Salesforce1 Tour Data Governance Lunch Best Practices deckDC Salesforce1 Tour Data Governance Lunch Best Practices deck
DC Salesforce1 Tour Data Governance Lunch Best Practices deckBeth Fitzpatrick
3.5K vues43 diapositives
Cff data governance best practices par
Cff data governance best practicesCff data governance best practices
Cff data governance best practicesBeth Fitzpatrick
2.6K vues43 diapositives
How to unlock new data-driven potential for your organization par
How to unlock new data-driven potential for your organizationHow to unlock new data-driven potential for your organization
How to unlock new data-driven potential for your organizationMichal Hodinka
381 vues58 diapositives
Data Cleaning par
Data CleaningData Cleaning
Data CleaningBecky Nahas
454 vues24 diapositives
Next generation analytics par
Next generation analyticsNext generation analytics
Next generation analyticsEddie Carter
85 vues2 diapositives
How to Scale your Analytics in a Maturing Organization par
How to Scale your Analytics in a Maturing OrganizationHow to Scale your Analytics in a Maturing Organization
How to Scale your Analytics in a Maturing OrganizationKissmetrics on SlideShare
2.5K vues61 diapositives

Contenu connexe

Similaire à Your Analytics does not have to be dramatic to be useful

Building a Data Quality Program from Scratch par
Building a Data Quality Program from ScratchBuilding a Data Quality Program from Scratch
Building a Data Quality Program from Scratchdmurph4
7.4K vues25 diapositives
Data fluency par
Data fluencyData fluency
Data fluencyMartha Horler
643 vues18 diapositives
Accelerate Data Discovery par
Accelerate Data Discovery   Accelerate Data Discovery
Accelerate Data Discovery Attivio
487 vues17 diapositives
DataWeek: Oh no, I'm running a data-driven cult! par
DataWeek: Oh no, I'm running a data-driven cult!DataWeek: Oh no, I'm running a data-driven cult!
DataWeek: Oh no, I'm running a data-driven cult!Huge
7.5K vues14 diapositives
What is Data Observability.pdf par
What is Data Observability.pdfWhat is Data Observability.pdf
What is Data Observability.pdf4dalert
26 vues15 diapositives
Data_Harmonization_ClearStory par
Data_Harmonization_ClearStoryData_Harmonization_ClearStory
Data_Harmonization_ClearStoryWilliam Davis
250 vues9 diapositives

Similaire à Your Analytics does not have to be dramatic to be useful(20)

Building a Data Quality Program from Scratch par dmurph4
Building a Data Quality Program from ScratchBuilding a Data Quality Program from Scratch
Building a Data Quality Program from Scratch
dmurph47.4K vues
Accelerate Data Discovery par Attivio
Accelerate Data Discovery   Accelerate Data Discovery
Accelerate Data Discovery
Attivio487 vues
DataWeek: Oh no, I'm running a data-driven cult! par Huge
DataWeek: Oh no, I'm running a data-driven cult!DataWeek: Oh no, I'm running a data-driven cult!
DataWeek: Oh no, I'm running a data-driven cult!
Huge7.5K vues
What is Data Observability.pdf par 4dalert
What is Data Observability.pdfWhat is Data Observability.pdf
What is Data Observability.pdf
4dalert26 vues
Data_Harmonization_ClearStory par William Davis
Data_Harmonization_ClearStoryData_Harmonization_ClearStory
Data_Harmonization_ClearStory
William Davis250 vues
Getting Ahead Of The Game: Proactive Data Governance par Harley Capewell
Getting Ahead Of The Game: Proactive Data GovernanceGetting Ahead Of The Game: Proactive Data Governance
Getting Ahead Of The Game: Proactive Data Governance
Harley Capewell754 vues
Foundation of information system par RajThakuri
Foundation of information systemFoundation of information system
Foundation of information system
RajThakuri117 vues
Data Quality_ the holy grail for a Data Fluent Organization.pptx par Balvinder Hira
Data Quality_ the holy grail for a Data Fluent Organization.pptxData Quality_ the holy grail for a Data Fluent Organization.pptx
Data Quality_ the holy grail for a Data Fluent Organization.pptx
Balvinder Hira233 vues
Self-service analytics risk_September_2016 par Leigh Ulpen
Self-service analytics risk_September_2016Self-service analytics risk_September_2016
Self-service analytics risk_September_2016
Leigh Ulpen87 vues
The Data Lake - Balancing Data Governance and Innovation par Caserta
The Data Lake - Balancing Data Governance and Innovation The Data Lake - Balancing Data Governance and Innovation
The Data Lake - Balancing Data Governance and Innovation
Caserta 2.4K vues
Data-Ed: Trends in Data Modeling par Data Blueprint
Data-Ed: Trends in Data ModelingData-Ed: Trends in Data Modeling
Data-Ed: Trends in Data Modeling
Data Blueprint1.7K vues
Data-Ed Online: Trends in Data Modeling par DATAVERSITY
Data-Ed Online: Trends in Data ModelingData-Ed Online: Trends in Data Modeling
Data-Ed Online: Trends in Data Modeling
DATAVERSITY2.6K vues
Moving Data Science from an Event to A Program: Considerations in Creating Su... par Domino Data Lab
Moving Data Science from an Event to A Program: Considerations in Creating Su...Moving Data Science from an Event to A Program: Considerations in Creating Su...
Moving Data Science from an Event to A Program: Considerations in Creating Su...
Domino Data Lab 293 vues
Data Quality Tools In Data Migrations par Steve Tuck
Data Quality Tools In Data MigrationsData Quality Tools In Data Migrations
Data Quality Tools In Data Migrations
Steve Tuck1.1K vues

Dernier

Data structure and algorithm. par
Data structure and algorithm. Data structure and algorithm.
Data structure and algorithm. Abdul salam
19 vues24 diapositives
RuleBookForTheFairDataEconomy.pptx par
RuleBookForTheFairDataEconomy.pptxRuleBookForTheFairDataEconomy.pptx
RuleBookForTheFairDataEconomy.pptxnoraelstela1
67 vues16 diapositives
Organic Shopping in Google Analytics 4.pdf par
Organic Shopping in Google Analytics 4.pdfOrganic Shopping in Google Analytics 4.pdf
Organic Shopping in Google Analytics 4.pdfGA4 Tutorials
11 vues13 diapositives
Chapter 3b- Process Communication (1) (1)(1) (1).pptx par
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptxayeshabaig2004
5 vues30 diapositives
Building Real-Time Travel Alerts par
Building Real-Time Travel AlertsBuilding Real-Time Travel Alerts
Building Real-Time Travel AlertsTimothy Spann
111 vues48 diapositives
3196 The Case of The East River par
3196 The Case of The East River3196 The Case of The East River
3196 The Case of The East RiverErickANDRADE90
11 vues4 diapositives

Dernier(20)

Data structure and algorithm. par Abdul salam
Data structure and algorithm. Data structure and algorithm.
Data structure and algorithm.
Abdul salam 19 vues
RuleBookForTheFairDataEconomy.pptx par noraelstela1
RuleBookForTheFairDataEconomy.pptxRuleBookForTheFairDataEconomy.pptx
RuleBookForTheFairDataEconomy.pptx
noraelstela167 vues
Organic Shopping in Google Analytics 4.pdf par GA4 Tutorials
Organic Shopping in Google Analytics 4.pdfOrganic Shopping in Google Analytics 4.pdf
Organic Shopping in Google Analytics 4.pdf
GA4 Tutorials11 vues
Chapter 3b- Process Communication (1) (1)(1) (1).pptx par ayeshabaig2004
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptx
Building Real-Time Travel Alerts par Timothy Spann
Building Real-Time Travel AlertsBuilding Real-Time Travel Alerts
Building Real-Time Travel Alerts
Timothy Spann111 vues
Vikas 500 BIG DATA TECHNOLOGIES LAB.pdf par vikas12611618
Vikas 500 BIG DATA TECHNOLOGIES LAB.pdfVikas 500 BIG DATA TECHNOLOGIES LAB.pdf
Vikas 500 BIG DATA TECHNOLOGIES LAB.pdf
vikas126116188 vues
Understanding Hallucinations in LLMs - 2023 09 29.pptx par Greg Makowski
Understanding Hallucinations in LLMs - 2023 09 29.pptxUnderstanding Hallucinations in LLMs - 2023 09 29.pptx
Understanding Hallucinations in LLMs - 2023 09 29.pptx
Greg Makowski17 vues
CRIJ4385_Death Penalty_F23.pptx par yvettemm100
CRIJ4385_Death Penalty_F23.pptxCRIJ4385_Death Penalty_F23.pptx
CRIJ4385_Death Penalty_F23.pptx
yvettemm1006 vues
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx par DataScienceConferenc1
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
Short Story Assignment by Kelly Nguyen par kellynguyen01
Short Story Assignment by Kelly NguyenShort Story Assignment by Kelly Nguyen
Short Story Assignment by Kelly Nguyen
kellynguyen0119 vues
Supercharging your Data with Azure AI Search and Azure OpenAI par Peter Gallagher
Supercharging your Data with Azure AI Search and Azure OpenAISupercharging your Data with Azure AI Search and Azure OpenAI
Supercharging your Data with Azure AI Search and Azure OpenAI
Peter Gallagher37 vues
Cross-network in Google Analytics 4.pdf par GA4 Tutorials
Cross-network in Google Analytics 4.pdfCross-network in Google Analytics 4.pdf
Cross-network in Google Analytics 4.pdf
GA4 Tutorials6 vues
Advanced_Recommendation_Systems_Presentation.pptx par neeharikasingh29
Advanced_Recommendation_Systems_Presentation.pptxAdvanced_Recommendation_Systems_Presentation.pptx
Advanced_Recommendation_Systems_Presentation.pptx
UNEP FI CRS Climate Risk Results.pptx par pekka28
UNEP FI CRS Climate Risk Results.pptxUNEP FI CRS Climate Risk Results.pptx
UNEP FI CRS Climate Risk Results.pptx
pekka2811 vues

Your Analytics does not have to be dramatic to be useful

  • 1. Analytics doesn’t have to be dramatic to be useful 11 September 2023
  • 4. Intro Andrew Patricio Principal, Digital Services UnidosUS Previous • DC Govt • Management Consulting
  • 5. UnidosUS UnidosUS, previously known as NCLR (National Council of La Raza) is the nation’s largest Hispanic civil rights and advocacy organization. • Policy & Advocacy • Programs • Partner with affiliated local organizations that work directly with community • Affiliate Network – 280+ affiliates across the US • Principal, Digital Services • New role, started spring 2021 • Chief digital/data officer function
  • 6. UnidosUS acts as Platform We enable the work of and act as a convenor for nonprofits working with US Hispanic community TA + $ TA + $ Ecosystem of subgrants and technical assistance (TA) to affiliates and other partners
  • 7. Data is an overhead cost DATA DATA Data is fragmented and is a cost not an asset. Data approach is tactical and transactional. Doesn’t support ecosystem
  • 8. Solution: UnidosUS JUNTOS PLATFORM JUNTOS PLATFORM Affiliates / Partners Community Government “Virtual” Affilliate Affilliate 1 Affilliate 2 Affilliate 3 Funders Data becomes an organizational and community resource Academia Staff DATA DATA
  • 9. JUNTOS PLATFORM DATA DATA UnidosUS “platform” supported by Juntos Platform Ecosystem of subgrants and technical assistance supported by data as an asset TA + $ TA + $
  • 10. High level data platform architecture Data catalog Data Model processing Data Lake (File level tagging) monday .com Raisers Edge Other data files: excel, csv, etc Concur Read only one way exports Intake Processing Data Model interface JUNTOS PLATFORM Data Analyst Low level queries using R, SQL, Python, etc Program Staff dashboards WFD Edu Health Finance P&A Housing Data Warehouse structured “enterprise data model” WFD Edu Housing Finance P&A Health MetaData (Affiliate, Location, etc) Analytics Data Products Adhoc & scheduled Queries External Data (Census, BLS, CDC, etc) Reality Alchemer Quickbase Great plains Housing Health Edu WFD Fiannce P&A
  • 12. Data people more important than data system Right data person/Wrong system Inefficient but effective Wrong data person/Right system Efficiently ineffective Start with program person with “data mentality” who can be trained on data tools/techniques rather than data person that needs to learn program.
  • 13. Analytics does not replace Intuition We hope to see something different from a new data tool/approach because we think the purpose of analytics is to replace “subjective” human judgement Purpose of analytics is to support human work • Data supporting communication • Data supporting understanding Intuition Data Analytics Analytics Data Intuition and data are part of a cycle, not two different paths Judgement Judgement Judgement Intuition
  • 14. Data Sophistication Journey Stage Focus Question Tools Relevant and Easily Available Immediate Fulfill requests Where is the data? understand the need to do more with data but not exactly what that means Email, phone Data doesn’t exist until we ask for it Present Data capture What is the data? staff are able to ask simple questions about the data because its easier to get to Individual databases Data exists but not easily accessible Past Reporting What is the data telling us about what is going on now? standard metrics/business rules/reports are precalculated so staff can spend time on more value adding data work Data lake, Data marts Data exists and is easily accessible via dashboards and other data tools Future Analytics What is the data telling us about what we should do? Data is a core part of how we plan out our work because it is very easy to get to. Our educated guesses are now more data supported, our gut feelings easily can be validated and fleshed out with data analytics Data Warehouse, Data Science New data from analytics products is easily created and easily accessible Current focus An organization’s approach to data evolves over time
  • 15. Digestibility – Meet your users where they are Create appropriate level of data system for your data sophistication Analytics cannot far outstrip your user’s ability to use it Set expectations to right level – what is possible based on data quality etc Don’t build a Ferrari to go through a field
  • 16. “Data Entry Team” not “Users” End users are fundamental to success but “Analytics" can be intimidating Start your users slow and work your way up You are here Start with the familiar Recognizing themselves in the data increases emotional buy-in (eg GIS - first thing people do a try and find thier house)
  • 17. Reduce Cognitive workload Systems provide structure and orientation • Logical flow (step 1, step 2, etc) • Forest instead of trees (data points in context)
  • 18. Common language for communication Goal is to have accurate metrics aligned with business goal 1. Cannot talk about accuracy if there isn’t agreement on the value being reported 2. Once the value is consistent, you can talk about if it’s accurate 3. Once it’s accurate you can talk about whether it’s relevant to business goal Metric A Report 1: 90 Report 2: 81 Report 3: 87 Metric A Report 1: 87 Report 2: 87 Report 3: 87 Consistent Metric A Report 1: 85 Report 2: 85 Report 3: 85 Metric aligned with goal Not Relevant Determine proposed change and go through cycle again Accurate Relevant DATA KNOWLEDGE INFORMATION Accuracy Relevancy Consistency
  • 19. 0 1 2 3 4 5 6 Immediate Present Past Future Data Confidence – Evolves over time Confidence starts off unknown Confidence drops but uncertainty narrows as you pull data into a reporting system and you see your actual data quality is poor As data is actually captured, our confidence increases but is still somewhat uncertain Your understanding of your data increases, quality goes up, and confidence rebounds Set expectations when putting new system in place. “Garbage in is Garbage out” – realization usually starts with seeing “Garbage out”
  • 21. Not all interesting questions are relevant Resources should be focused on data that ultimately solves the main problem of achieving organizational goals
  • 22. Prioritization • Desired organizational success prioritize which outcomes business should focus on • Desired business outcomes prioritize which decisions analytics should focus on • Desired analytics decisions prioritizes which data reporting should focus on Prioritize Outcomes Prioritize Analytics Prioritize Data
  • 23. Traceability Traceability tells you what is impacted by upstream mistakes or change in business rules System helps tie outputs back to inputs
  • 24. Data “Science” to Data Science
  • 25. Data Science - Iteration Science is usually about incrementalism not revolution Maxwell Lorentz Michaelson, Morley Poincaré “Standing on the shoulders of giants”
  • 26. Data Science - Experimentation Independent Variables - controllable Independent Variables - environmental Systems / Processes System helps to focus on what should be controlled and what of that can actually be controlled
  • 27. Data Science - Statistics Data as common language for communication • Stats vs individual anecdotes • Shared institutional knowledge