Contenu connexe Similaire à How to use Latent Semantic Analysis to Glean Real Insight - Franco Amalfi (20) Plus de Social Media Camp (20) How to use Latent Semantic Analysis to Glean Real Insight - Franco Amalfi2. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
How to use Latent Semantic
Analysis to Glean Real Insight
Better insights, Better content, Better engagement
Franco Amalfi
Director, Digital Engagement Strategy Program
Oracle Public Sector North America
23 May 2015
3. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.
3Oracle Confidential
4. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Delivering Service to Citizens is Changing
Oracle Confidential
1980s 1990s 2000s 2010s
Empowered
Employees
Digital is
Humanized
Knowledge
Everywhere
Internet of
Things
Mobile as
Primary Channel
Cross-Channel
Service
WHAT’S NEXT
what’s
CHANGED
4
5. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Empowered Citizens
5
Always Connected, Always Sharing, Always Aware
COMMUNICATION HAS CHANGED
Oracle Confidential
6. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Social is a Key Component of a Citizen Engagement Strategy
Public Opinion
Understand sentiment on key issues
on an ongoing basis
Citizen Engagement
Interact with constituents on social
networks to reach them rapidly and
at a lower cost
Transparency & Collaboration
Connect with constituents on key
issues to better gauge needs and
align strategy
Oracle Confidential 6
7. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Average Time Spent
on Social Media:
2.1 Hours
7Oracle Confidential
8. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Challenges in the Modern Social Environment
Finding right communication channels 4
Citizens in multiple channels 2
Citizens posting problems publicly 3
Too much noise in social media 1
8Oracle Confidential
9. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Oracle Social Relationship Management
Internal Social
Collaboration
Social Engagement
and Listening
Social
Data
Social Publishing
Better Insights, Better Content, Faster Service
Leverage Oracle Social to empower
your agency, enhance your CX
capabilities and grow your business.
A unified social solution providing best-
in-class networking, listening,
engagement and publishing that can
socially enable the enterprise.
Set of prebuilt integrations for social
listening and engagement, social
marketing, social commerce, social selling
and social customer service.
Oracle Confidential 9
10. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Typical Social Listening Challenges
Spam and duplicate posts1
Large conversation volumes3
Search term ambiguity2
Finding value in posts4
1010Oracle Confidential
11. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Oracle Uses a Blended Technology Approach for Listening
Unstructured Text Processing
Oracle Confidential 11
Latent
Semantic
Analysis
Natural
Language
Processing
Keyword
Boolean
Terms plus Match Any,
Match All, Match None
conditions
Parsing unstructured text to
diagram speech
Used in setting up Topics through
Themes, and in categorization to:
Topics & Indicators
12. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Blended Listening Technology Approach
Comparison
Oracle Confidential 12
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
10000
Keyword Only Keyword Boolean KB & Semantic
Context
Noise
Missed Valid
Valid
• Keyword Only
overstates by 800%
• Keyword Boolean
misses 40%
• Semantic Search –
achieves most valid
content
13. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
What I want to get posts about What I will get posts about in a keyword
solution
13
Example: Search Social Media for ‘Jaguar’
Oracle Confidential
14. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 14
Keyword Solutions Use Boolean Logic to Try to Find
Relevant Posts
AND
(car OR drive OR driving OR automobile OR buy OR
buying OR bought OR purchase OR purchasing OR
purchased OR dealer OR dealership OR cars OR want
OR …)
NOT
(football OR jacksonville OR stadium OR team OR
animal OR jungle OR zoo OR lions OR tigers OR bears
OR dating OR coach OR player OR players OR …)
JAGUAR
Oracle Confidential
15. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
PROS CONS
15
Keyword Solution Using Boolean Search Pros & Cons
+ Tends to return results quickly
+ Quick on-boarding process
- Topics time consuming to build
- Must read results to find irrelevant posts
- No advanced analytics unless outsourced to 3rd
party
- Time consuming & no consistency
Oracle Confidential
16. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
A data dictionary is built to increase
accuracy
Common Advanced Analytics – Term
Clouds
16
How Natural Language Processing is Better than Keyword
Oracle Confidential
17. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
When all these things… … Mean this:
17
What Natural Language Processing Has Difficulty
Determining
Oracle Confidential
Doctor
Physician Pediatrician
Surgeon
General
Practitioner
18. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
PROS CONS
18
Natural Language Processing Pros & Cons
+ More relevant results
+ Advanced analytics via term clouds
+ More accurate sentiment
- Slow processing speeds
- Lengthy on-boarding time (months vs. days)
- Doesn’t automatically know when multiple words
have same meaning
- Time consuming & expensive
Oracle Confidential
19. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
How Does Latent
Semantic Analysis
Work?
Uses a statistically based algorithm that
automatically groups conversations
together that look alike.
Or more simply put…
Oracle Confidential 19
20. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Occurrence
Matrix
Oracle Confidential 20
21. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Processed Jaguar
Conversations
Jaguar
post
Jaguar
post
Jaguar
post
Jaguar
post
Jaguar
post
Jaguar
post
Jaguar
Cars
Drive
Buy /
loan
Jungle
Animals
Hunt
Football
Soccer
Game
Jaguar
Cars
Drive
Buy /
loan
Jungle
Animals
Hunt
Football
Soccer
Game
Jaguar
Cars
Drive
Buy /
loan
Jungle
Animals
Hunt
Football
Soccer
Game
Jaguar
Sedan
Buick
Mustang
VehicleCoup
Wheel
Jaguar
Cars
22. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
LSA Technology
Finding & Targeting
the right
conversations in all
the noise
92% Accurate
Categorization
23. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
LSA Snippets only show relevant
text around target word
Advantage =
1. More accurate sentiment
2. Thematic analysis
3. Indicators
4. Categorization
24. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
PROS CONS
24
Latent Semantic Analysis Pros & Cons
+ Automatic categorization
+ 92% accurate categorization
+ Advanced analytics via themes & term clouds
+ White space analysis
+ Indicators for insight discovery
+ More accurate sentiment
+ Fast processing speeds
+ Easy on-boarding process
- None
Oracle Confidential
25. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Summary Snapshot Comparison
Capability Keyword / Boolean Natural Language Processing Latent Semantic Analysis
Rapid set-up of listening topics 4 2 4
Listening accuracy; ease of
removing irrelevant results
1 3 4
Sentiment analysis without manual
effort
0 1 3
Indicators 0 0 4
Advanced analytics 0 4 4
Speed of run-time execution 4 2 4
25Oracle Confidential
26. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Best Results Are Achieved When You Use All Three
Oracle SRM Does
26Oracle Confidential
27. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Blended Technology Approach
High categorization
accuracy92% Reduced cost
1 Set up a topic with a single
keyword
Faster time to insight
27Oracle Confidential
Better Results and Ease of Use
28. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 28
DEMO
Latent Semantic Analysis in Action
Oracle Confidential
29. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Contact Us
Franco Amalfi
Email: franco.amalfi@oracle.com
@amalfifranco
29Oracle Confidential
https://www.linkedin.com/in/francoamalfi