SlideShare une entreprise Scribd logo
1  sur  40
John Liu PhD, CFA
Behavioral Analytics for
Financial Intelligence
2
Machine Learning
platform that
understands
human
communication
Nashville
Washington
New York
London
Goldman Sachs
Credit Suisse
In-Q-Tel
Silver Lake
National Security
Financial Services
Healthcare
Data Science
CONFIDENTIAL 2
DIGITAL REASONING |
CONFIDENTIAL
Prepared Exclusively for
Intel Capital
Digital Reasoning
Trusted Cognitive Computing For A Better World
Financial Services
FX Rate
Manipulation
• Collusion and
manipulation
• "Quid-pro-
quo”
• Clustered Bid/
Ask quotes
• Order
execution
around the
benchmark
• Trading abuse
• Deal related
language
• Abusive/dirty
references
• Improper
placement and
execution
Wall Cross
Violations
• Insider trading
• M&A leakage
• Personal trade
execution
• Companies on
Restricted list
•  Email from/to
sensitive
countries
•  Bribery & gift
language
• Presence of
attachments
• Deal related
language &
order execution
• Public info to
enhance KYC
profiles
• Email to/from
economically
sanctioned
countries
Conduct Risk
Anti-Bribery
Anti-Money
Laundering
Unauthorized
Trading
3
Electronic Communications Surveillance
• Counter-terrorism &
proliferation
• Human geography,
pattern of life
• Suspicious Activity
Reporting (SAR)
• Criminal investigations
• Regulatory oversight
• Disaster response
Public Sector
4
DoD & IC Law Enforcement Civilian
•  Abundance of data available that captures
human behavior
•  Understanding human behavior makes for
better decision making
•  Behavioral analytics transforming financial
industry
5
3 Big Ideas
BIG data: recording the annals of human behavior
(YouTube collects 500TB/day, mostly about cats)
Data, Data, Data
6
Types of Data
Structured Data = Any data that can be stored in a table
Unstructured Data = Everything else!
Categories of Unstructured Data:
•  Text (emails, im chats, tweets, legal docs, etc…)
•  Image (Facebook, Instagram, webpages)
•  Video (Youtube, security cameras, drones)
•  Audio (phone calls, voicemail, open mic)
•  GPS/IoT streams
•  Romance novels
7
What is Behavioral Analytics?
8
We are creatures
of habit.
Definition: Behavioral analytics quantify the effects of
psychological, social, cognitive, and emotional factors
on human decision-making
Behavioral Analytics Purpose
9
Events, Relationships and Anomalies
(Friends, Supply Chain, Cyber)
Eat	
  
Burp	
  
Sleep	
  
Process Mining: Habits and Behavior
(Shopping Habits, Buying Cycle)
Preferences: Likes and Dislikes
(Advertising, Regulatory Reporting)
Behavioral Analytics
10
Descriptive
Did
Identify & Track
Behavior
Anomaly
Detection
Fraud, Cyber,
Insider
Predictive
Will Do
Credit Scoring
Risk
Management
CRM & Cross-
Selling
Diapers & Beer
Prescriptive
Want To Do
Behavior
Modification
Gamification
Fixing Cognitive
Heuristics/Biases
Behavioral Analytics Aspects
11
Group/Entity
•  Baseline assessment
•  Cohort analysis
Individuals
•  Personal habits
•  Cognitive heuristics & biases
Process
Discovery
Event/
Funnel
Analysis
Path
Analysis
Cohort
Analysis
12
Behavioral
Analytics for
Financial
Intelligence
Investments and
Finance
Psychology
Computer
Science
Algorithmic
Trading
Behavioral
Finance
Behavioral
Analytics
Sweet
Spot
Application to Financial Intelligence
13
Customer
Insight
Human
Resources
Risk &
Compliance
Market
Intelligence
CRM Knowledge
Extraction, Servicing
& Cross-Sell
Fraud/Misconduct
Detection, Credit
Scoring, Wall-Cross
Recruiting/Retention,
Talent Analytics,
Automated
Management
Behavioral Investing,
Alpha Generation,
Liars Poker
Customer Insight
•  Goal: leverage customer interactions to predict client
preferences and behavior
•  CRM, emails, documents, phone logs, chat, …
14
CRM
Emails
Voice
Chat
Knowledge/
Relationship
Extraction
Association
Rule
Learning
Natural Language Processing (NLP)
15
Intent	
  
Sentiment
Knowledge Graph
Fact/Relation Extraction
Named-Entity Recognition
Syntactic Parsing
Shallow Parsing
POS/EOS
Tokenization
What’s	
  For	
  
Dinner?	
  
Customer Insight Example
•  Extracting Knowledge Base SVO triples from customer
chat
16
*	
  
*	
  
Bid/Offer
*	
   *	
  
Financial Product Financial Product
*	
  
Bid/Offer
*	
  
*	
  
*	
  
Financial Entity
Financial Benchmark
Financial Benchmark
Financial Benchmark Financial Model Financial Benchmark Bid/Offer
*	
  
Financial Level
Financial Benchmark
*	
  *	
   *	
  
*	
  
Subject Verb ObjectModifier
Client buys 50M GM bonds
17
Why	
  do	
  we	
  call	
  it	
  a	
  “Knowledge	
  Graph”?	
  
	
  
Paul	
  	
  
Tudor	
  Jones	
  
Michael	
  	
  
Cardillo	
  
Galleon	
  	
  
Tech	
  	
  
Fund	
  
Kris	
  	
  
Chellam	
  
Krish	
  	
  
Panu	
  
Ian	
  	
  
Horowitz	
  
Stan	
  	
  
Druckenmiller	
  
Leon	
  	
  
Shaulov	
  
P&G	
  	
  
TransacHons	
  
GS	
  
TransacHons	
  
Rajat	
  Gupta	
   Richard	
  
SchuKe	
  
Fantasy	
  Football	
  	
  
League	
  
Wharton	
  	
  
School	
  
Proctor	
  &	
  	
  
Gamble	
  
Goldman	
  	
  
Sachs	
  
SpotTail	
  	
  
Capital	
  Advisors	
  
McKinsey	
  	
  
&	
  Co.	
  
Intel	
  Corp.	
  
Anil	
  Kumar	
  
Gary	
  	
  
Cohn	
  
David	
  	
  
Loeb	
  
Lunch	
  
Fund	
  
Galleon	
  
Group	
  LLC	
  
Rajiv	
  Goel	
  
P	
  &	
  G	
  Board	
  
PorQolio	
  
Manager	
  
Raj	
  Rajaratnam	
  
Voyager	
  Capital	
  
Partners	
  
Customer Intelligence Graph
•  Customer Touch Points
•  Competitive Targeting
•  Cross-Sell
•  Up-Sell
•  Orphans
18
Orphaned Customer
19
Help!!
Human Resources
•  Goal: Talent recruitment, retention, placement,
performance evaluation, promotion, compensation,
workforce planning
•  Focus: identifying qualities of high performers, changing
outcomes (promote the best, encourage the rest)
20
Talent Analytics Example
21
•  Employee Retention: Real cost of losing a high-skill
employee can often be > 1.5-2.0x annual salary
Source: Dave Weisbeck
Risk & Compliance
•  Goal: Financial, Legal, and Regulatory risk measurement
and management
•  Data Sources: internal communications (text, voice),
client interactions, social media, HR, CRM, expenses, etc
•  Event and Behavioral Anomaly Detection
•  AML
•  SAR
•  Unauthorized Trading
•  Manipulation
•  Misconduct
22
Time Series Outlier Detection
Box-Jenkins (ARIMA – autocorrelation)
•  Pros: seasonality, stationarity detection
•  Cons: subjectivity in parameter initialization
Holt-Winters (Exponential Smoothing)
•  Pros: seasonality (single), computation
•  Cons: subjectivity in parameter initialization
Seasonal Hybrid (Generalized) ESD
•  Pros: seasonality (LOESS), local & global anomalies
•  Cons: low recall
23
Example: Seasonal Hybrid ESD
24
Source:	
  anomaly.io	
  
Relationship Graph
25
Market Intelligence
•  Goal: Identifying and modifying individual and collective
investor behavior for individual or collective gain
•  Data Sources: news, SEC filings, corporate releases,
public and private databases, electronic and written
communications, audio/video, social media, Bud Fox
11/6/15 26
GekkoisticAltruistic
Behavior Modification
•  After watching which movie would investors express
greater risk tolerance in portfolio activities?
11/6/15 27
Fischer et.al., Risk Analysis, Vol. 31, No. 5, 2011
Investor Paradox
A fair coin is flipped:
•  If heads, your net worth increases 40%
•  If tails, your net worth decreases by 30%
Would you play this game?
How many times would you play?
11/6/15 28
Cognitive Error
•  Game has positive expectation over short-term, but
negative expectation over the long run
11/6/15 29
0
0.5
1
1.5
2
2.5
1 11 21 31 41
NetWorth
Games Played
Answer: Play Just Once
Which Would You Prefer?
A.  $1 today?
B.  $1.05 a month from now?
What if the choices were:
A.  $1 in 24 months from now?
B.  $1.05 in 25 months from now?
Most people prefer A in the first instance, B in second.
Example of “hyperbolic discounting”
30
Cognitive Heuristics and Biases
11/6/15 31
Definition: a systematic pattern of deviation from
norm or rationality in judgment, a mental shortcut
where inferences are drawn in illogical fashion.
Example: Alpha Generation
•  Goal: identify persistent sources of alpha
•  Key is “persistent” as most signals (e.g. sentiment) are
viewed as transitory and unstable over long-term
•  Current approaches incorporate emotional, affect
psychology and intent models that aggregate individual
sentiment to identify short-term group trends
•  Incorporate models of investor behavior?
32
Alpha: the active return above a benchmark
representing investment skill
Sentiment Analysis
“The outlook reflects our expectations that Apple will
continue to maintain and defend its strong market position
in mobile devices and tablets despite seeing an decline in
its addressable market.”
33
Source: Yahoo
Behavioral Economics
Traditional
•  Perfect rationality
•  Expected utility theory
•  Risk aversion
•  Efficient market
hypothesis
•  CAPM and APT
Behavioral
•  Bounded rationality
•  Prospect theory
•  Loss aversion
•  Adaptive market
hypothesis
•  Behavioral Asset Pricing
•  Market anomalies
34
Empirical evidence diverges greatly from classic theory
Why do market anomalies exist?
Identified Market Anomalies
35
Year Authors Anomaly
1968 Ball & Brown Earnings announcement effect
1975 Haugen & Heins Low volatility effect
1976 Rozeff & Kinney January effect
1977 Basu Low P/E effect
1981 Gibbons & Hess Monday effect
1981 Shiller Excess volatility effect
1981 Banz Size effect
1985 Rosenberg, Reid, Lanstein Value effect
1987 DeBondt & Thaler Over-reaction to bad news
1993 Jegadeesh & Titman Momentum investing
Drivers of Anomalies
Cognitive Errors
•  Conservatism
•  Overweight Bayesian priors
•  Confirmation
•  Selection bias
•  Gambler’s Fallacy
•  Mean reversion
•  Representativeness
•  Overweight recent evidence
•  Availability
•  Familiarity premium
Emotional Biases
•  Loss aversion
•  Pain > Gain
•  Overconfidence
•  Underestimate risk
•  Endowment
•  Sentimental value premium
•  Status-Quo
•  Regret-aversion
•  Herd behavior
36
Anomalies are drivers of excess return (alpha)
Quantitative Behavioral Finance
•  Behavioral asset pricing model:
•  This is a linear factor model that includes behavioral
bias sentiment factors
•  Exposure to behavioral biases given by weights γi
37
E r[ ]= rf + βj
j=1
k
∑ (rj −rf )+ γi
i=1
m
∑ bi
Expected
Return
Risk-free
Rate
Factor
Beta
Bias
Sentiment
Premium
Risk
Factor
Premium
In Search of Alpha
38
1.  Context-based analysis to extract features of behavioral
biases observed in investors
2.  Combine these features with structured data to
formulate behavioral bias factors
3.  Use the factors to fit regression models for asset returns
4.  Construct factor portfolios to monetize market
anomalies by overweight/underweight exposure to
specific behavioral biases
Alpha
Factor
Portfolios
Behavioral
Analytics
Data
Key Takeaways
•  We have too much data, not enough actionable insights
•  Humans are prone to cognitive “mistakes” (some more
than others)
•  Behavioral analytics can identify and quantify individual
and group cognitive behavior
•  The financial industry can benefit from much of the
behavioral analytics insights developed in other
industries
•  There is a lot more to do!
39
Final Words
•  We at Digital Reasoning are actively exploring neural
embedding and deep learning methods to enhance
feature extraction and prediction of behavioral biases
•  Synthesys Studio: http://beta.digitalreasoning.com
•  Book (Q2 2016): Python Machine Learning by Example
40

Contenu connexe

Tendances

Credit card fraud detection
Credit card fraud detectionCredit card fraud detection
Credit card fraud detection
kalpesh1908
 

Tendances (20)

Data Science: Applying Random Forest
Data Science: Applying Random ForestData Science: Applying Random Forest
Data Science: Applying Random Forest
 
Fraud detection ML
Fraud detection MLFraud detection ML
Fraud detection ML
 
Understanding blockchain
Understanding blockchainUnderstanding blockchain
Understanding blockchain
 
Supervised learning
Supervised learningSupervised learning
Supervised learning
 
Fraud detection
Fraud detectionFraud detection
Fraud detection
 
Detecting fraud with Python and machine learning
Detecting fraud with Python and machine learningDetecting fraud with Python and machine learning
Detecting fraud with Python and machine learning
 
CREDIT CARD FRAUD DETECTION
CREDIT CARD FRAUD DETECTION CREDIT CARD FRAUD DETECTION
CREDIT CARD FRAUD DETECTION
 
Predicting Bank Customer Churn Using Classification
Predicting Bank Customer Churn Using ClassificationPredicting Bank Customer Churn Using Classification
Predicting Bank Customer Churn Using Classification
 
Predictive analytics in health insurance
Predictive analytics in health insurancePredictive analytics in health insurance
Predictive analytics in health insurance
 
Bitcoin and the future of cryptocurrency
Bitcoin and the future of cryptocurrencyBitcoin and the future of cryptocurrency
Bitcoin and the future of cryptocurrency
 
Machine Learning for Sales & Marketing
Machine Learning for Sales & MarketingMachine Learning for Sales & Marketing
Machine Learning for Sales & Marketing
 
Future of AI Smart Networks
Future of AI Smart NetworksFuture of AI Smart Networks
Future of AI Smart Networks
 
Redefining intelligence: Exploring the latest advances in next-generation AI ...
Redefining intelligence: Exploring the latest advances in next-generation AI ...Redefining intelligence: Exploring the latest advances in next-generation AI ...
Redefining intelligence: Exploring the latest advances in next-generation AI ...
 
Thesis presentation ist
Thesis presentation istThesis presentation ist
Thesis presentation ist
 
Credit card fraud detection
Credit card fraud detectionCredit card fraud detection
Credit card fraud detection
 
Navigating uncertainty: The art and science of learning and doing 10x in a te...
Navigating uncertainty: The art and science of learning and doing 10x in a te...Navigating uncertainty: The art and science of learning and doing 10x in a te...
Navigating uncertainty: The art and science of learning and doing 10x in a te...
 
Blockchain use cases
Blockchain use casesBlockchain use cases
Blockchain use cases
 
IRJET- Credit Card Fraud Detection using Random Forest
IRJET-  	  Credit Card Fraud Detection using Random ForestIRJET-  	  Credit Card Fraud Detection using Random Forest
IRJET- Credit Card Fraud Detection using Random Forest
 
Blockchain-enabled supply chain management
Blockchain-enabled supply chain managementBlockchain-enabled supply chain management
Blockchain-enabled supply chain management
 
A Study on Credit Card Fraud Detection using Machine Learning
A Study on Credit Card Fraud Detection using Machine LearningA Study on Credit Card Fraud Detection using Machine Learning
A Study on Credit Card Fraud Detection using Machine Learning
 

En vedette

Transforming Finance With Analytics
Transforming Finance With AnalyticsTransforming Finance With Analytics
Transforming Finance With Analytics
Kathleen Brunner
 

En vedette (8)

Advancing internal audit analytics
Advancing internal audit analytics Advancing internal audit analytics
Advancing internal audit analytics
 
The Future of Internal Audit through data analytics
The Future of Internal Audit through data analyticsThe Future of Internal Audit through data analytics
The Future of Internal Audit through data analytics
 
Finance Analytics
Finance AnalyticsFinance Analytics
Finance Analytics
 
Finance and Audit Predictive Analytics
Finance and Audit Predictive AnalyticsFinance and Audit Predictive Analytics
Finance and Audit Predictive Analytics
 
Finance Analytics
Finance AnalyticsFinance Analytics
Finance Analytics
 
Transforming Finance With Analytics
Transforming Finance With AnalyticsTransforming Finance With Analytics
Transforming Finance With Analytics
 
Modernizing the Finance Function with Qlik
Modernizing the Finance Function with QlikModernizing the Finance Function with Qlik
Modernizing the Finance Function with Qlik
 
Machine Learning in Customer Analytics
Machine Learning in Customer AnalyticsMachine Learning in Customer Analytics
Machine Learning in Customer Analytics
 

Similaire à Behavioral Analytics for Financial Intelligence

Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Vivastream
 
Workshop E: Fighting Fraud and Cyber Crime: WTF…"Where's the Fraud"
Workshop E: Fighting Fraud and Cyber Crime: WTF…"Where's the Fraud"Workshop E: Fighting Fraud and Cyber Crime: WTF…"Where's the Fraud"
Workshop E: Fighting Fraud and Cyber Crime: WTF…"Where's the Fraud"
Vivastream
 
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Vivastream
 
Core Elements of Retail LP Shortened version 15MB
Core Elements of Retail LP Shortened version 15MBCore Elements of Retail LP Shortened version 15MB
Core Elements of Retail LP Shortened version 15MB
Alan Greggo
 
Moving to the Cloud: A Security and Hosting Introduction
Moving to the Cloud: A Security and Hosting IntroductionMoving to the Cloud: A Security and Hosting Introduction
Moving to the Cloud: A Security and Hosting Introduction
Blackbaud
 

Similaire à Behavioral Analytics for Financial Intelligence (20)

Sentiment-Driven Financial Intelligence
Sentiment-Driven Financial IntelligenceSentiment-Driven Financial Intelligence
Sentiment-Driven Financial Intelligence
 
Deconstructing Data Breach Cost
Deconstructing Data Breach CostDeconstructing Data Breach Cost
Deconstructing Data Breach Cost
 
Co3 rsc r5
Co3 rsc r5Co3 rsc r5
Co3 rsc r5
 
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
 
Workshop E: Fighting Fraud and Cyber Crime: WTF…"Where's the Fraud"
Workshop E: Fighting Fraud and Cyber Crime: WTF…"Where's the Fraud"Workshop E: Fighting Fraud and Cyber Crime: WTF…"Where's the Fraud"
Workshop E: Fighting Fraud and Cyber Crime: WTF…"Where's the Fraud"
 
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
Fighting Fraud and Cyber Crime: WTF ... "Where's the Fraud"
 
Big Data Analytics Summit - April, 2014
Big Data Analytics Summit - April, 2014Big Data Analytics Summit - April, 2014
Big Data Analytics Summit - April, 2014
 
Data and ethics Training
Data and ethics TrainingData and ethics Training
Data and ethics Training
 
Rethinking The Conventions Of Market Research_Orc Consumer Deck presented to ...
Rethinking The Conventions Of Market Research_Orc Consumer Deck presented to ...Rethinking The Conventions Of Market Research_Orc Consumer Deck presented to ...
Rethinking The Conventions Of Market Research_Orc Consumer Deck presented to ...
 
Artificial Intelligence – Time Bomb or The Promised Land?
Artificial Intelligence – Time Bomb or The Promised Land?Artificial Intelligence – Time Bomb or The Promised Land?
Artificial Intelligence – Time Bomb or The Promised Land?
 
Callcredit's Fraud Summit 2016 - Plenary session
Callcredit's Fraud Summit 2016 - Plenary sessionCallcredit's Fraud Summit 2016 - Plenary session
Callcredit's Fraud Summit 2016 - Plenary session
 
Know Your Adversary: Analyzing the Human Element in Evolving Cyber Threats
Know Your Adversary: Analyzing the Human Element in Evolving Cyber ThreatsKnow Your Adversary: Analyzing the Human Element in Evolving Cyber Threats
Know Your Adversary: Analyzing the Human Element in Evolving Cyber Threats
 
Connections Drive Digital Transformation
Connections Drive Digital TransformationConnections Drive Digital Transformation
Connections Drive Digital Transformation
 
Digital Transformation and the Journey to a Highly Connected Enterprise
Digital Transformation and the Journey to a Highly Connected EnterpriseDigital Transformation and the Journey to a Highly Connected Enterprise
Digital Transformation and the Journey to a Highly Connected Enterprise
 
Fortify Your Enterprise with IBM Smarter Counter-Fraud Solutions
Fortify Your Enterprise with IBM Smarter Counter-Fraud SolutionsFortify Your Enterprise with IBM Smarter Counter-Fraud Solutions
Fortify Your Enterprise with IBM Smarter Counter-Fraud Solutions
 
Strategic Frameworks & Tools
Strategic Frameworks & ToolsStrategic Frameworks & Tools
Strategic Frameworks & Tools
 
Core Elements of Retail LP Shortened version 15MB
Core Elements of Retail LP Shortened version 15MBCore Elements of Retail LP Shortened version 15MB
Core Elements of Retail LP Shortened version 15MB
 
Human Capital Risk — Identifying Talent Beta for Mergers and Acquisitions and...
Human Capital Risk — Identifying Talent Beta for Mergers and Acquisitions and...Human Capital Risk — Identifying Talent Beta for Mergers and Acquisitions and...
Human Capital Risk — Identifying Talent Beta for Mergers and Acquisitions and...
 
Moving to the Cloud: A Security and Hosting Introduction
Moving to the Cloud: A Security and Hosting IntroductionMoving to the Cloud: A Security and Hosting Introduction
Moving to the Cloud: A Security and Hosting Introduction
 
Principles of Marketing Course - Session 2
Principles of Marketing Course - Session 2Principles of Marketing Course - Session 2
Principles of Marketing Course - Session 2
 

Plus de John Liu

Plus de John Liu (14)

Kubeflow and Data Science in Kubernetes
Kubeflow and Data Science in KubernetesKubeflow and Data Science in Kubernetes
Kubeflow and Data Science in Kubernetes
 
Artificial Intelligence As a Service
Artificial Intelligence As a ServiceArtificial Intelligence As a Service
Artificial Intelligence As a Service
 
Machine Learning with Small Data
Machine Learning with Small DataMachine Learning with Small Data
Machine Learning with Small Data
 
Data Analytics in Computational Law
Data Analytics in Computational LawData Analytics in Computational Law
Data Analytics in Computational Law
 
AI & Machine Learning: Business Transformation
AI & Machine Learning: Business TransformationAI & Machine Learning: Business Transformation
AI & Machine Learning: Business Transformation
 
DeepREM
DeepREMDeepREM
DeepREM
 
Social Network Analysis for Healthcare
Social Network Analysis for HealthcareSocial Network Analysis for Healthcare
Social Network Analysis for Healthcare
 
Healthy Competition: How Adversarial Reasoning is Leading the Next Wave of In...
Healthy Competition: How Adversarial Reasoning is Leading the Next Wave of In...Healthy Competition: How Adversarial Reasoning is Leading the Next Wave of In...
Healthy Competition: How Adversarial Reasoning is Leading the Next Wave of In...
 
A Way Forward
A Way ForwardA Way Forward
A Way Forward
 
I2P and the Dark Web
I2P and the Dark WebI2P and the Dark Web
I2P and the Dark Web
 
Beyond Machine Learning: The New Generation of Learning Algorithms Coming to ...
Beyond Machine Learning: The New Generation of Learning Algorithms Coming to ...Beyond Machine Learning: The New Generation of Learning Algorithms Coming to ...
Beyond Machine Learning: The New Generation of Learning Algorithms Coming to ...
 
Naive Bayes for the Superbowl
Naive Bayes for the SuperbowlNaive Bayes for the Superbowl
Naive Bayes for the Superbowl
 
Neural Networks in the Wild: Handwriting Recognition
Neural Networks in the Wild: Handwriting RecognitionNeural Networks in the Wild: Handwriting Recognition
Neural Networks in the Wild: Handwriting Recognition
 
Role of Data Science in ERM @ Nashville Analytics Summit Sep 2014
Role of Data Science in ERM @ Nashville Analytics Summit Sep 2014Role of Data Science in ERM @ Nashville Analytics Summit Sep 2014
Role of Data Science in ERM @ Nashville Analytics Summit Sep 2014
 

Dernier

+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
Health
 
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
nirzagarg
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
gajnagarg
 
Computer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdfComputer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdf
SayantanBiswas37
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
gajnagarg
 
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
gajnagarg
 
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
gajnagarg
 

Dernier (20)

+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
 
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt
 
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
 
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
 
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowVadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
 
Computer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdfComputer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdf
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
 
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24  Building Real-Time Pipelines With FLaNKDATA SUMMIT 24  Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
 
Digital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham WareDigital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham Ware
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
 
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
 
Fun all Day Call Girls in Jaipur 9332606886 High Profile Call Girls You Ca...
Fun all Day Call Girls in Jaipur   9332606886  High Profile Call Girls You Ca...Fun all Day Call Girls in Jaipur   9332606886  High Profile Call Girls You Ca...
Fun all Day Call Girls in Jaipur 9332606886 High Profile Call Girls You Ca...
 
Dubai Call Girls Peeing O525547819 Call Girls Dubai
Dubai Call Girls Peeing O525547819 Call Girls DubaiDubai Call Girls Peeing O525547819 Call Girls Dubai
Dubai Call Girls Peeing O525547819 Call Girls Dubai
 
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
 

Behavioral Analytics for Financial Intelligence

  • 1. John Liu PhD, CFA Behavioral Analytics for Financial Intelligence
  • 2. 2 Machine Learning platform that understands human communication Nashville Washington New York London Goldman Sachs Credit Suisse In-Q-Tel Silver Lake National Security Financial Services Healthcare Data Science CONFIDENTIAL 2 DIGITAL REASONING | CONFIDENTIAL Prepared Exclusively for Intel Capital Digital Reasoning Trusted Cognitive Computing For A Better World
  • 3. Financial Services FX Rate Manipulation • Collusion and manipulation • "Quid-pro- quo” • Clustered Bid/ Ask quotes • Order execution around the benchmark • Trading abuse • Deal related language • Abusive/dirty references • Improper placement and execution Wall Cross Violations • Insider trading • M&A leakage • Personal trade execution • Companies on Restricted list •  Email from/to sensitive countries •  Bribery & gift language • Presence of attachments • Deal related language & order execution • Public info to enhance KYC profiles • Email to/from economically sanctioned countries Conduct Risk Anti-Bribery Anti-Money Laundering Unauthorized Trading 3 Electronic Communications Surveillance
  • 4. • Counter-terrorism & proliferation • Human geography, pattern of life • Suspicious Activity Reporting (SAR) • Criminal investigations • Regulatory oversight • Disaster response Public Sector 4 DoD & IC Law Enforcement Civilian
  • 5. •  Abundance of data available that captures human behavior •  Understanding human behavior makes for better decision making •  Behavioral analytics transforming financial industry 5 3 Big Ideas
  • 6. BIG data: recording the annals of human behavior (YouTube collects 500TB/day, mostly about cats) Data, Data, Data 6
  • 7. Types of Data Structured Data = Any data that can be stored in a table Unstructured Data = Everything else! Categories of Unstructured Data: •  Text (emails, im chats, tweets, legal docs, etc…) •  Image (Facebook, Instagram, webpages) •  Video (Youtube, security cameras, drones) •  Audio (phone calls, voicemail, open mic) •  GPS/IoT streams •  Romance novels 7
  • 8. What is Behavioral Analytics? 8 We are creatures of habit. Definition: Behavioral analytics quantify the effects of psychological, social, cognitive, and emotional factors on human decision-making
  • 9. Behavioral Analytics Purpose 9 Events, Relationships and Anomalies (Friends, Supply Chain, Cyber) Eat   Burp   Sleep   Process Mining: Habits and Behavior (Shopping Habits, Buying Cycle) Preferences: Likes and Dislikes (Advertising, Regulatory Reporting)
  • 10. Behavioral Analytics 10 Descriptive Did Identify & Track Behavior Anomaly Detection Fraud, Cyber, Insider Predictive Will Do Credit Scoring Risk Management CRM & Cross- Selling Diapers & Beer Prescriptive Want To Do Behavior Modification Gamification Fixing Cognitive Heuristics/Biases
  • 11. Behavioral Analytics Aspects 11 Group/Entity •  Baseline assessment •  Cohort analysis Individuals •  Personal habits •  Cognitive heuristics & biases Process Discovery Event/ Funnel Analysis Path Analysis Cohort Analysis
  • 13. Application to Financial Intelligence 13 Customer Insight Human Resources Risk & Compliance Market Intelligence CRM Knowledge Extraction, Servicing & Cross-Sell Fraud/Misconduct Detection, Credit Scoring, Wall-Cross Recruiting/Retention, Talent Analytics, Automated Management Behavioral Investing, Alpha Generation, Liars Poker
  • 14. Customer Insight •  Goal: leverage customer interactions to predict client preferences and behavior •  CRM, emails, documents, phone logs, chat, … 14 CRM Emails Voice Chat Knowledge/ Relationship Extraction Association Rule Learning
  • 15. Natural Language Processing (NLP) 15 Intent   Sentiment Knowledge Graph Fact/Relation Extraction Named-Entity Recognition Syntactic Parsing Shallow Parsing POS/EOS Tokenization What’s  For   Dinner?  
  • 16. Customer Insight Example •  Extracting Knowledge Base SVO triples from customer chat 16 *   *   Bid/Offer *   *   Financial Product Financial Product *   Bid/Offer *   *   *   Financial Entity Financial Benchmark Financial Benchmark Financial Benchmark Financial Model Financial Benchmark Bid/Offer *   Financial Level Financial Benchmark *  *   *   *   Subject Verb ObjectModifier Client buys 50M GM bonds
  • 17. 17 Why  do  we  call  it  a  “Knowledge  Graph”?     Paul     Tudor  Jones   Michael     Cardillo   Galleon     Tech     Fund   Kris     Chellam   Krish     Panu   Ian     Horowitz   Stan     Druckenmiller   Leon     Shaulov   P&G     TransacHons   GS   TransacHons   Rajat  Gupta   Richard   SchuKe   Fantasy  Football     League   Wharton     School   Proctor  &     Gamble   Goldman     Sachs   SpotTail     Capital  Advisors   McKinsey     &  Co.   Intel  Corp.   Anil  Kumar   Gary     Cohn   David     Loeb   Lunch   Fund   Galleon   Group  LLC   Rajiv  Goel   P  &  G  Board   PorQolio   Manager   Raj  Rajaratnam   Voyager  Capital   Partners  
  • 18. Customer Intelligence Graph •  Customer Touch Points •  Competitive Targeting •  Cross-Sell •  Up-Sell •  Orphans 18
  • 20. Human Resources •  Goal: Talent recruitment, retention, placement, performance evaluation, promotion, compensation, workforce planning •  Focus: identifying qualities of high performers, changing outcomes (promote the best, encourage the rest) 20
  • 21. Talent Analytics Example 21 •  Employee Retention: Real cost of losing a high-skill employee can often be > 1.5-2.0x annual salary Source: Dave Weisbeck
  • 22. Risk & Compliance •  Goal: Financial, Legal, and Regulatory risk measurement and management •  Data Sources: internal communications (text, voice), client interactions, social media, HR, CRM, expenses, etc •  Event and Behavioral Anomaly Detection •  AML •  SAR •  Unauthorized Trading •  Manipulation •  Misconduct 22
  • 23. Time Series Outlier Detection Box-Jenkins (ARIMA – autocorrelation) •  Pros: seasonality, stationarity detection •  Cons: subjectivity in parameter initialization Holt-Winters (Exponential Smoothing) •  Pros: seasonality (single), computation •  Cons: subjectivity in parameter initialization Seasonal Hybrid (Generalized) ESD •  Pros: seasonality (LOESS), local & global anomalies •  Cons: low recall 23
  • 24. Example: Seasonal Hybrid ESD 24 Source:  anomaly.io  
  • 26. Market Intelligence •  Goal: Identifying and modifying individual and collective investor behavior for individual or collective gain •  Data Sources: news, SEC filings, corporate releases, public and private databases, electronic and written communications, audio/video, social media, Bud Fox 11/6/15 26 GekkoisticAltruistic
  • 27. Behavior Modification •  After watching which movie would investors express greater risk tolerance in portfolio activities? 11/6/15 27 Fischer et.al., Risk Analysis, Vol. 31, No. 5, 2011
  • 28. Investor Paradox A fair coin is flipped: •  If heads, your net worth increases 40% •  If tails, your net worth decreases by 30% Would you play this game? How many times would you play? 11/6/15 28
  • 29. Cognitive Error •  Game has positive expectation over short-term, but negative expectation over the long run 11/6/15 29 0 0.5 1 1.5 2 2.5 1 11 21 31 41 NetWorth Games Played Answer: Play Just Once
  • 30. Which Would You Prefer? A.  $1 today? B.  $1.05 a month from now? What if the choices were: A.  $1 in 24 months from now? B.  $1.05 in 25 months from now? Most people prefer A in the first instance, B in second. Example of “hyperbolic discounting” 30
  • 31. Cognitive Heuristics and Biases 11/6/15 31 Definition: a systematic pattern of deviation from norm or rationality in judgment, a mental shortcut where inferences are drawn in illogical fashion.
  • 32. Example: Alpha Generation •  Goal: identify persistent sources of alpha •  Key is “persistent” as most signals (e.g. sentiment) are viewed as transitory and unstable over long-term •  Current approaches incorporate emotional, affect psychology and intent models that aggregate individual sentiment to identify short-term group trends •  Incorporate models of investor behavior? 32 Alpha: the active return above a benchmark representing investment skill
  • 33. Sentiment Analysis “The outlook reflects our expectations that Apple will continue to maintain and defend its strong market position in mobile devices and tablets despite seeing an decline in its addressable market.” 33 Source: Yahoo
  • 34. Behavioral Economics Traditional •  Perfect rationality •  Expected utility theory •  Risk aversion •  Efficient market hypothesis •  CAPM and APT Behavioral •  Bounded rationality •  Prospect theory •  Loss aversion •  Adaptive market hypothesis •  Behavioral Asset Pricing •  Market anomalies 34 Empirical evidence diverges greatly from classic theory Why do market anomalies exist?
  • 35. Identified Market Anomalies 35 Year Authors Anomaly 1968 Ball & Brown Earnings announcement effect 1975 Haugen & Heins Low volatility effect 1976 Rozeff & Kinney January effect 1977 Basu Low P/E effect 1981 Gibbons & Hess Monday effect 1981 Shiller Excess volatility effect 1981 Banz Size effect 1985 Rosenberg, Reid, Lanstein Value effect 1987 DeBondt & Thaler Over-reaction to bad news 1993 Jegadeesh & Titman Momentum investing
  • 36. Drivers of Anomalies Cognitive Errors •  Conservatism •  Overweight Bayesian priors •  Confirmation •  Selection bias •  Gambler’s Fallacy •  Mean reversion •  Representativeness •  Overweight recent evidence •  Availability •  Familiarity premium Emotional Biases •  Loss aversion •  Pain > Gain •  Overconfidence •  Underestimate risk •  Endowment •  Sentimental value premium •  Status-Quo •  Regret-aversion •  Herd behavior 36 Anomalies are drivers of excess return (alpha)
  • 37. Quantitative Behavioral Finance •  Behavioral asset pricing model: •  This is a linear factor model that includes behavioral bias sentiment factors •  Exposure to behavioral biases given by weights γi 37 E r[ ]= rf + βj j=1 k ∑ (rj −rf )+ γi i=1 m ∑ bi Expected Return Risk-free Rate Factor Beta Bias Sentiment Premium Risk Factor Premium
  • 38. In Search of Alpha 38 1.  Context-based analysis to extract features of behavioral biases observed in investors 2.  Combine these features with structured data to formulate behavioral bias factors 3.  Use the factors to fit regression models for asset returns 4.  Construct factor portfolios to monetize market anomalies by overweight/underweight exposure to specific behavioral biases Alpha Factor Portfolios Behavioral Analytics Data
  • 39. Key Takeaways •  We have too much data, not enough actionable insights •  Humans are prone to cognitive “mistakes” (some more than others) •  Behavioral analytics can identify and quantify individual and group cognitive behavior •  The financial industry can benefit from much of the behavioral analytics insights developed in other industries •  There is a lot more to do! 39
  • 40. Final Words •  We at Digital Reasoning are actively exploring neural embedding and deep learning methods to enhance feature extraction and prediction of behavioral biases •  Synthesys Studio: http://beta.digitalreasoning.com •  Book (Q2 2016): Python Machine Learning by Example 40