Submit Search
Upload
Perfect Text Analytics Provides Fast, Useable, Consistent and Inclusive Insights
•
Download as PPTX, PDF
•
3 likes
•
7,250 views
AI-enhanced title
Lexalytics
Follow
Presentation by Seth Redmore, VP Product Management at the Text Analytics Summit 2010
Read less
Read more
Technology
Education
Report
Share
Report
Share
1 of 28
Download now
Recommended
Text Analytics for Dummies 2010
Text Analytics for Dummies 2010
Seth Grimes
Predictive Text Analytics
Predictive Text Analytics
Seth Grimes
Text Mining and Visualization
Text Mining and Visualization
Seth Grimes
Text Analytics Presentation
Text Analytics Presentation
Skylar Ritchie
An Introduction to Text Analytics: 2013 Workshop presentation
An Introduction to Text Analytics: 2013 Workshop presentation
Seth Grimes
Data Science - Part XI - Text Analytics
Data Science - Part XI - Text Analytics
Derek Kane
Popular Text Analytics Algorithms
Popular Text Analytics Algorithms
PromptCloud
Text Analytics Overview, 2011
Text Analytics Overview, 2011
Seth Grimes
Recommended
Text Analytics for Dummies 2010
Text Analytics for Dummies 2010
Seth Grimes
Predictive Text Analytics
Predictive Text Analytics
Seth Grimes
Text Mining and Visualization
Text Mining and Visualization
Seth Grimes
Text Analytics Presentation
Text Analytics Presentation
Skylar Ritchie
An Introduction to Text Analytics: 2013 Workshop presentation
An Introduction to Text Analytics: 2013 Workshop presentation
Seth Grimes
Data Science - Part XI - Text Analytics
Data Science - Part XI - Text Analytics
Derek Kane
Popular Text Analytics Algorithms
Popular Text Analytics Algorithms
PromptCloud
Text Analytics Overview, 2011
Text Analytics Overview, 2011
Seth Grimes
Text Analytics Market Insights: What's Working and What's Next
Text Analytics Market Insights: What's Working and What's Next
Seth Grimes
Data Science - Part I - Sustaining Predictive Analytics Capabilities
Data Science - Part I - Sustaining Predictive Analytics Capabilities
Derek Kane
Analysis of ‘Unstructured’ Data
Analysis of ‘Unstructured’ Data
Seth Grimes
Unstructured data processing webinar 06272016
Unstructured data processing webinar 06272016
George Roth
Getting Started with Unstructured Data
Getting Started with Unstructured Data
Christine Connors
Complaint Analysis in Indonesian Language Using WPKE and RAKE Algorithm
Complaint Analysis in Indonesian Language Using WPKE and RAKE Algorithm
IJECEIAES
Nuts and bolts
Nuts and bolts
NBER
Mind the Semantic Gap
Mind the Semantic Gap
Panos Alexopoulos
How many truths can you handle?
How many truths can you handle?
Panos Alexopoulos
Conceptual foundations of text mining and preprocessing steps nfaoui el_habib
Conceptual foundations of text mining and preprocessing steps nfaoui el_habib
El Habib NFAOUI
Textmining Introduction
Textmining Introduction
guest0edcaf
Zomato eda report
Zomato eda report
vidit jain
Text analytics
Text analytics
Utkarsh Sharma
Module 9: Natural Language Processing Part 2
Module 9: Natural Language Processing Part 2
Sara Hooker
Applications: Prediction
Applications: Prediction
NBER
Text Analytics Applied (LIDER roadmapping presentation)
Text Analytics Applied (LIDER roadmapping presentation)
Seth Grimes
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Jay R Modi
Detailed Investigation of Text Classification and Clustering of Twitter Data ...
Detailed Investigation of Text Classification and Clustering of Twitter Data ...
ijtsrd
Troubleshooting and Optimizing Named Entity Resolution Systems in the Industry
Troubleshooting and Optimizing Named Entity Resolution Systems in the Industry
Panos Alexopoulos
Evaluation Mechanism for Similarity-Based Ranked Search Over Scientific Data
Evaluation Mechanism for Similarity-Based Ranked Search Over Scientific Data
AM Publications
Ibm watson boston meetup may 27 2015
Ibm watson boston meetup may 27 2015
IBM
Findability Day 2016 - Augmented intelligence
Findability Day 2016 - Augmented intelligence
Findwise
More Related Content
What's hot
Text Analytics Market Insights: What's Working and What's Next
Text Analytics Market Insights: What's Working and What's Next
Seth Grimes
Data Science - Part I - Sustaining Predictive Analytics Capabilities
Data Science - Part I - Sustaining Predictive Analytics Capabilities
Derek Kane
Analysis of ‘Unstructured’ Data
Analysis of ‘Unstructured’ Data
Seth Grimes
Unstructured data processing webinar 06272016
Unstructured data processing webinar 06272016
George Roth
Getting Started with Unstructured Data
Getting Started with Unstructured Data
Christine Connors
Complaint Analysis in Indonesian Language Using WPKE and RAKE Algorithm
Complaint Analysis in Indonesian Language Using WPKE and RAKE Algorithm
IJECEIAES
Nuts and bolts
Nuts and bolts
NBER
Mind the Semantic Gap
Mind the Semantic Gap
Panos Alexopoulos
How many truths can you handle?
How many truths can you handle?
Panos Alexopoulos
Conceptual foundations of text mining and preprocessing steps nfaoui el_habib
Conceptual foundations of text mining and preprocessing steps nfaoui el_habib
El Habib NFAOUI
Textmining Introduction
Textmining Introduction
guest0edcaf
Zomato eda report
Zomato eda report
vidit jain
Text analytics
Text analytics
Utkarsh Sharma
Module 9: Natural Language Processing Part 2
Module 9: Natural Language Processing Part 2
Sara Hooker
Applications: Prediction
Applications: Prediction
NBER
Text Analytics Applied (LIDER roadmapping presentation)
Text Analytics Applied (LIDER roadmapping presentation)
Seth Grimes
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Jay R Modi
Detailed Investigation of Text Classification and Clustering of Twitter Data ...
Detailed Investigation of Text Classification and Clustering of Twitter Data ...
ijtsrd
Troubleshooting and Optimizing Named Entity Resolution Systems in the Industry
Troubleshooting and Optimizing Named Entity Resolution Systems in the Industry
Panos Alexopoulos
Evaluation Mechanism for Similarity-Based Ranked Search Over Scientific Data
Evaluation Mechanism for Similarity-Based Ranked Search Over Scientific Data
AM Publications
What's hot
(20)
Text Analytics Market Insights: What's Working and What's Next
Text Analytics Market Insights: What's Working and What's Next
Data Science - Part I - Sustaining Predictive Analytics Capabilities
Data Science - Part I - Sustaining Predictive Analytics Capabilities
Analysis of ‘Unstructured’ Data
Analysis of ‘Unstructured’ Data
Unstructured data processing webinar 06272016
Unstructured data processing webinar 06272016
Getting Started with Unstructured Data
Getting Started with Unstructured Data
Complaint Analysis in Indonesian Language Using WPKE and RAKE Algorithm
Complaint Analysis in Indonesian Language Using WPKE and RAKE Algorithm
Nuts and bolts
Nuts and bolts
Mind the Semantic Gap
Mind the Semantic Gap
How many truths can you handle?
How many truths can you handle?
Conceptual foundations of text mining and preprocessing steps nfaoui el_habib
Conceptual foundations of text mining and preprocessing steps nfaoui el_habib
Textmining Introduction
Textmining Introduction
Zomato eda report
Zomato eda report
Text analytics
Text analytics
Module 9: Natural Language Processing Part 2
Module 9: Natural Language Processing Part 2
Applications: Prediction
Applications: Prediction
Text Analytics Applied (LIDER roadmapping presentation)
Text Analytics Applied (LIDER roadmapping presentation)
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Detailed Investigation of Text Classification and Clustering of Twitter Data ...
Detailed Investigation of Text Classification and Clustering of Twitter Data ...
Troubleshooting and Optimizing Named Entity Resolution Systems in the Industry
Troubleshooting and Optimizing Named Entity Resolution Systems in the Industry
Evaluation Mechanism for Similarity-Based Ranked Search Over Scientific Data
Evaluation Mechanism for Similarity-Based Ranked Search Over Scientific Data
Similar to Perfect Text Analytics Provides Fast, Useable, Consistent and Inclusive Insights
Ibm watson boston meetup may 27 2015
Ibm watson boston meetup may 27 2015
IBM
Findability Day 2016 - Augmented intelligence
Findability Day 2016 - Augmented intelligence
Findwise
INTELLLEX tech team hiring
INTELLLEX tech team hiring
Ellery Sutanto
Wdc tech talk cooper hackathon 2015
Wdc tech talk cooper hackathon 2015
IBM
IBM Cognitive platform: IBM Watson
IBM Cognitive platform: IBM Watson
Daniela Zuppini
Get Started With Python Language.pdf
Get Started With Python Language.pdf
Cerebrum Infotech
Intro to watson bluemix services
Intro to watson bluemix services
Vikas Manoria
Natural language processing
Natural language processing
Janu Jahnavi
Taking A Look At Web Services
Taking A Look At Web Services
Stacey Cruz
Steve Mills - Your Cognitive Future
Steve Mills - Your Cognitive Future
SogetiLabs
ChatGPT Deck.pptx
ChatGPT Deck.pptx
omornahid1
IBM cognitive service introduction
IBM cognitive service introduction
Hui Wen Han
iadaatpa gala boston
iadaatpa gala boston
Manuel Herranz
Cognitive Computing
Cognitive Computing
Pietro Leo
ICIC 2013 New Product Introductions CEPT
ICIC 2013 New Product Introductions CEPT
Dr. Haxel Consult
Symfony2
Symfony2
Nursultan Turdaliev
Internet vs intranet vs extranet
Internet vs intranet vs extranet
Tej Kiran
Content Analytics for Better Search
Content Analytics for Better Search
Seth Grimes
Mamba Media - Decoding Digital Language
Mamba Media - Decoding Digital Language
Mamba Media
MambaMedia-decoding-digital
MambaMedia-decoding-digital
Robin Cormack
Similar to Perfect Text Analytics Provides Fast, Useable, Consistent and Inclusive Insights
(20)
Ibm watson boston meetup may 27 2015
Ibm watson boston meetup may 27 2015
Findability Day 2016 - Augmented intelligence
Findability Day 2016 - Augmented intelligence
INTELLLEX tech team hiring
INTELLLEX tech team hiring
Wdc tech talk cooper hackathon 2015
Wdc tech talk cooper hackathon 2015
IBM Cognitive platform: IBM Watson
IBM Cognitive platform: IBM Watson
Get Started With Python Language.pdf
Get Started With Python Language.pdf
Intro to watson bluemix services
Intro to watson bluemix services
Natural language processing
Natural language processing
Taking A Look At Web Services
Taking A Look At Web Services
Steve Mills - Your Cognitive Future
Steve Mills - Your Cognitive Future
ChatGPT Deck.pptx
ChatGPT Deck.pptx
IBM cognitive service introduction
IBM cognitive service introduction
iadaatpa gala boston
iadaatpa gala boston
Cognitive Computing
Cognitive Computing
ICIC 2013 New Product Introductions CEPT
ICIC 2013 New Product Introductions CEPT
Symfony2
Symfony2
Internet vs intranet vs extranet
Internet vs intranet vs extranet
Content Analytics for Better Search
Content Analytics for Better Search
Mamba Media - Decoding Digital Language
Mamba Media - Decoding Digital Language
MambaMedia-decoding-digital
MambaMedia-decoding-digital
Recently uploaded
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
Malak Abu Hammad
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
ThousandEyes
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
Pixlogix Infotech
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Martijn de Jong
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
HampshireHUG
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
Results
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Miguel Araújo
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
UK Journal
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
The Digital Insurer
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Drew Madelung
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
Delhi Call girls
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
Gabriella Davis
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
Radu Cotescu
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Igalia
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
wesley chun
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
Anna Loughnan Colquhoun
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
Igalia
Recently uploaded
(20)
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
Perfect Text Analytics Provides Fast, Useable, Consistent and Inclusive Insights
1.
Perfect Text Analytics
Seth Redmore VP, Product Management
2.
Perfect per·fect
[adj., n. pur-fikt; v. per-fekt] 1. conforming absolutely to the description or definition of an ideal type: a perfect sphere; a perfect gentleman. 2. excellent or complete beyond practical or theoretical improvement: There is no perfect legal code. The proportions of this temple are almost perfect. 2 All right reserved © 2010 Lexalytics Inc.
3.
Text Analytics The
term text analytics describes a set of linguistic statistical, and machine learning techniques that model and structure the information content of textual sources. (Wikipedia) In other words, enhancing the value of text content by extracting entities, features, context, relationships and emotion. 3 All right reserved © 2010 Lexalytics Inc.
4.
Perfect is Fast
Average Human Reading Speed: 250wpm Conservative computer reading speed: 6000 wpm/core (our speed on a moderate single core) Each core is equivalent to the reading bandwidth of 12 people. Modern machines have 8 cores. That’s just about 100 people in a box. Nice. 4 All right reserved © 2010 Lexalytics Inc.
5.
Perfect is Useable
“I don’t like the results” is not the same as “the results are incorrect” Understanding the behavior key to usefulness Can you make better decisions? Can you make more money or save money? What is the most controversial area of text analytics? Thompson Reuters trading w/Sentiment Analysis increased Alpha (profit over market) by 80 basis points 5 All right reserved © 2010 Lexalytics Inc.
6.
Useable: How much
can you differ? “In my shop, that up until now has relied exclusively on human coding, we consider anything below 90% to be unacceptably inaccurate…. There is no doubt that automated sentiment is getting much much better, but to suggest that people should be okay with 20% of their data being wrong is just absurd.” Katie Delahaye Payne Why is 10% “wrong” so much less absurd than 20% “wrong”? 20% Error 10% Error 6 All right reserved © 2010 Lexalytics Inc.
7.
Perfect is Consistent
Same results for same content, every time University of Pittsburgh “Multi-Perspective Question Answering” Corpus: 535 documents, 11k+ sentences. 40 hours of training for each rater ~80% inter-rater agreement 7 All right reserved © 2010 Lexalytics Inc.
8.
Perfect is (new)
Knowledge Discover the stuff you don’t know Text Analytics is really, really great at telling you the who, the what, and the where. Sometimes the “how” You have to supply the “why” – but that question is way easier to answer when you know the other “w’s and the h” 8 All right reserved © 2010 Lexalytics Inc.
9.
Perfect Includes Everything
Running our top of the line software flat out across one year will cost you about $.002/document analyzed (news article sized content) (assuming 3 docs/core-second, 8 core machine) The more data the better and the greater worth your ta has 9 All right reserved © 2010 Lexalytics Inc.
10.
Perfect is Trainable
Can you solve YOUR business problem with it? Can you optimize to suit different kinds of content and roll those results up into a single reporting system? 10 All right reserved © 2010 Lexalytics Inc.
11.
Perfect Text Analytics
11 All right reserved © 2010 Lexalytics Inc. Fast Useable Consistent Knowledge (that is) Inclusive Trainable
12.
Customer Snapshots (or,
“rubber, meet road”)
13.
Reputation Management 13
All right reserved © 2010 Lexalytics Inc.
14.
Politics 14 All
right reserved © 2010 Lexalytics Inc.
15.
Market Intelligence Client
Employee User Authentication Single Sign-on External Content Providers SinglePoint Client Company User Authentication Web 2.0 Collaboration Search Results Secondary Research Suppliers User Authentication MI Analyst Text Analytics Integrated Index News & Journals NL Search Engine FIREWALL Internal Document Repository Optional Document Repository Financial analyst reports Internal research Content Processing Custom Web Crawls & Gov. Databases Trash can crawl, FTP or CD 15 All right reserved © 2010 Lexalytics Inc.
16.
Hospitality 16 All
right reserved © 2010 Lexalytics Inc.
17.
18.
19.
QED (Quantitative and
Event-Driven Trading) Banks, hedge funds.
20.
21.
Pharma 19 All
right reserved © 2010 Lexalytics Inc.
22.
The Next Year…
23.
Opinion Mining Who
said what about whom? All right reserved © 2010 Lexalytics Inc. 21
24.
Sarcasm, Twitter Model
trained to detect sarcasm Once detected, you can decide what to do with it – because actually determining the sentiment is going to be unreliable New model trained on Twitter content Moving towards a concept of text analytics driven by business logic All right reserved © 2010 Lexalytics Inc. 22
25.
Thesaurus-based Theme Rollup
Machine generated conceptual taxonomy Gas/Electric Hybrid and EV might roll up to EV Fewer themes, but very useful to detect patterns across content All right reserved © 2010 Lexalytics Inc. 23
26.
Foreign Language Support
French is first, followed by other Romance languages New stemmer New summarization algorithm New part-of-speech tagger Automatic language detection New sentiment/entity extraction algorithms Also applicable to vertical specific content Confidence scoring by algorithm Use business logic to meld the results All right reserved © 2010 Lexalytics Inc. 24
27.
Trainable Entity Sentiment
New technique for entity sentiment Initial results from testing in English extremely promising Average human scoring overlap of >> 90% for scored sentences Initially used only for French 25 All right reserved © 2010 Lexalytics Inc.
28.
Tool Enhancements Eventually
use on English content: Twitter Customer Satisfaction Others… Entity Management Toolkit Part of Speech Tagset training Using to train Salience on French Sentiment Toolkit Build your own entity sentiment models: French (first) New Sentiment Toolkit + Maximum Entropy model builder allows new Entity and Sentiment modules New EMT helps us build a new French PoS tagger Entity Extraction & Sentiment Models Fully Tagged Document Doc POS Tagger 26 All right reserved © 2010 Lexalytics Inc. Themes & Summaries
29.
Business Logic +
TA Algorithms Content Source Search Business Logic Other TA System Sarcasm Route On Sports Finance Unknown $ ? A B C D Entity: Cisco 27 All right reserved © 2010 Lexalytics Inc. ProbabilityScores Cisco : Positive
30.
Summary Lots of
people making money with text analytics In lots of different verticals Next 12 months brings online a whole host of features to make our software even more flexible Check out tas.lexalytics.com Check out www.lexalytics.com/lexascope All right reserved © 2010 Lexalytics Inc. 28
Download now