SlideShare une entreprise Scribd logo
1  sur  15
BigData in Banking
Challenges and Solutions
Arshavsky Andzhey
Director, Big Data dept., SberBank
Avarshavsky.sbt@sberbank.ru
andzhey@mac.com
2015
3
Innovations like killers –
destruction stages of standard banking system
① Internet & social networks
Control and choice
② Screens and Smartphones
Anyplace any time
③ Mobile wallet
Out of cash and plastic cards
④ Accounts without Banks
No bank accounts
⑤ BigData
Cros-system personalization and
targeting
*Бретт Кинг, Банк 3.0
4
BIGDATA as the development of approaches to the use of data
Information like
competition
differentiator
Information like
innovation
enablement
Information as
strategic asset
Information for
business analysys
Data for business
“Day by day
operations”
“Datawarehousing”
Thevalueofinformationforbusiness
“Information in business context”
“Business innovations
based on information”
“Adaptive business strategy”
Information usage methods maturity
+ INTERNET AND OPEN DATA
BIGDATA in Banking
5
BIGDATA In Banking
Information challenges in large Banks (XL)
Data is the most valuable asset in all XL banks
A few know how to apply data for solving even this day
challenges
A few know how to leverage internet, external or open data
sources to understand clients better and attract new
customers
6
The Key challenge with data analysis
Through the development of the Big Data Infrastructure which solves
the challenges with data pre-processing and attribution thru building
intelligent data processing Framework, the company will be able to
optimize labor costs by reducing works on data preparation of data
for the development of business applications up to 70%!
BIGDATA in Banking
It is estimated (by Gartner), 70% of the time spent on analytical projects are
dedicated to bringing, cleaning and data integration, mainly due to the following
problems:
The difficulty of locating data due to the carelessness among disparate business
applications and business systems
To be more than appropriate for analysis, data require reengineering and
reformatting
􏰀The acquisition of data for analysis in a specified format creates a huge burden
on the teams that own the systems data source . Often the same data is
requested or purchase by a variety of departments and business units, which
creates additional work and chaos
The need for process setup regular data exchange
7
Data and Analytics tools as shared resource
Client
Product
Transactions
Location
….
Instruments
RISKS Dept.
RETAIL Dept.
OPERATIONS Dept.
SEQURITY Dept.
CORPORATE
CLIENTS Dept.
HR
BIGDATA in Banking
BIGDATA to a lesser extent, about the data size and is
more about the opportunity to work with many
different data types, formats and applications with
powerful analytic capabilities.
8
Sources of business growth and execution excelence
BIGDATA in Banking
Client
ПРИВЛЕЧЕНИЕ
УДЕРЖАНИЕ
ПРОДАЖИ
ПЕРВИЧНЫЕ
ВТОРИЧНЫЕ
КРЕДИТЫ
РИСКИ
ЗАДОЛЖЕННОСТИ
АНТИФРОД
ВНУТРЕННИЙ
ВНЕШНИЙ
HR
ОПТИМИЗАЦИЯ
ПРОЦЕССОВ
①
②
③ ④
9
Data Factory conception
Big Data Factory should enable data processing in a uniform manner for
all platforms, functions and customers. To build easily changeable and
easy to use data processing operating model with the required level of
trust for both traditional and not so traditional data sources
Tasks: Information trust
Traditional and not so traditional
data sources
BIGDATA in Banking
• Delivery information
• Information integration
(Cleaning, Transformation,
Mapping, Improvement)
• Information search
• Access to information
• Study hypotheses
• Learning models and
information analysis
• Backup/ Cleanup/ Restore
• Administration
• Lifecycle management
• Data quality
• Reference data
• Record linkage and the resolution of
contradictions
• Classification
• Reporting
• Internet data
• Data virtualization
10
ЦК Супермассивов данныхBIGDATA PLATFORM HIGH-LEVEL CONCEPTION
11
BIGDATA in Banking
Data Factory Scenarious
The experts of the subject areas of the Bank's business need to access the
organization's data for research, sampling, annotation and modelling
Data Scientists works on new
models
Marketing is looking for data for the
new compains
Security services looking for data
for drill a suspicious transaction
Retail unit wants to make the
best proposal to the client
……..
Daily activity
The need for ad hoc access to
diverse data
Support analysis and decision
making
To use the terminology subject
matter experts when accessing
data
Providing the same easy access to data in spreadsheets, with the ability to scale to huge
volumes and distribution on a huge variety of types of information while protecting sensitive
information and optimizing it storage systems.
BIGDATA in Banking
Data 2 profit process
Task formalization
DATA
PREPARATION
DATA
EXPLORATION
ADDITIONAL
INDICATORS
ALATITICS &
MODELING
MODEL VALIDATION
MODEL
PRODUCTIZATION
EFFECIENCY
MONITORING
12
①
13
HDFS, row data
Data
exchange
Data preparation, processing and
analytical layer
Analytical Views
Ad-hoc analytics Development factory
Streaming
Big Data applications. Integration.
marts API
BIGDATA in Banking
Possible architecture
14
BI & BIGDATA
Traditional BI Big Data
Based on DWH
Precession is crucial
Flat data scheme
Long time 2 market
hi-end hardware
Based on Hadoop and Spark
Any precesion
Complex and variable data schemes
Ad-hoc analytics
Short time 2 market
New data sources
Low cost
Both approaches are valid
BIGDATA in Banking
15
BIGDATA in Banking
Is not expensive - OPEN SOURCE does work
Low cost
No vendor lock
Community support
APPLICATION LAYER
Spark
Hadoop
SQL
NoSQLDB
16
BIGDATA in Banking
Thanks and good luck!

Contenu connexe

Tendances

Big data & analytics for banking new york lars hamberg
Big data & analytics for banking new york   lars hambergBig data & analytics for banking new york   lars hamberg
Big data & analytics for banking new york lars hambergLars Hamberg
 
TechConnex Big Data Series - Big Data in Banking
TechConnex Big Data Series - Big Data in BankingTechConnex Big Data Series - Big Data in Banking
TechConnex Big Data Series - Big Data in BankingAndre Langevin
 
Business case for Big Data Analytics
Business case for Big Data AnalyticsBusiness case for Big Data Analytics
Business case for Big Data AnalyticsVijay Rao
 
Big data it’s impact on the finance function
Big data it’s impact on the finance functionBig data it’s impact on the finance function
Big data it’s impact on the finance functionMike Davis
 
Digital Transformation: How to Build an Analytics-Driven Culture
Digital Transformation: How to Build an Analytics-Driven CultureDigital Transformation: How to Build an Analytics-Driven Culture
Digital Transformation: How to Build an Analytics-Driven CultureAlexander Loth
 
BIG Data & Hadoop Applications in Finance
BIG Data & Hadoop Applications in FinanceBIG Data & Hadoop Applications in Finance
BIG Data & Hadoop Applications in FinanceSkillspeed
 
How advanced analytics is impacting the banking sector
How advanced analytics is impacting the banking sectorHow advanced analytics is impacting the banking sector
How advanced analytics is impacting the banking sectorMichael Haddad
 
How Eastern Bank Uses Big Data to Better Serve and Protect its Customers
How Eastern Bank Uses Big Data to Better Serve and Protect its CustomersHow Eastern Bank Uses Big Data to Better Serve and Protect its Customers
How Eastern Bank Uses Big Data to Better Serve and Protect its CustomersBrian Griffith
 
Big Data Analytics in light of Financial Industry
Big Data Analytics in light of Financial Industry Big Data Analytics in light of Financial Industry
Big Data Analytics in light of Financial Industry Capgemini
 
Importance of Big data for your Business
Importance of Big data for your BusinessImportance of Big data for your Business
Importance of Big data for your Businessazuyo.com
 
Big Data Analytics for Banking, a Point of View
Big Data Analytics for Banking, a Point of ViewBig Data Analytics for Banking, a Point of View
Big Data Analytics for Banking, a Point of ViewPietro Leo
 
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATIONBig Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATIONMatt Stubbs
 
Big Data & Business Analytics: Understanding the Marketspace
Big Data & Business Analytics: Understanding the MarketspaceBig Data & Business Analytics: Understanding the Marketspace
Big Data & Business Analytics: Understanding the MarketspaceBala Iyer
 
Big data analytic market opportunity
Big data analytic market opportunityBig data analytic market opportunity
Big data analytic market opportunityStanley Wang
 

Tendances (20)

Big data & analytics for banking new york lars hamberg
Big data & analytics for banking new york   lars hambergBig data & analytics for banking new york   lars hamberg
Big data & analytics for banking new york lars hamberg
 
TechConnex Big Data Series - Big Data in Banking
TechConnex Big Data Series - Big Data in BankingTechConnex Big Data Series - Big Data in Banking
TechConnex Big Data Series - Big Data in Banking
 
Banking Big Data Analytics
Banking Big Data AnalyticsBanking Big Data Analytics
Banking Big Data Analytics
 
5 Big Data Use Cases for 2013
5 Big Data Use Cases for 20135 Big Data Use Cases for 2013
5 Big Data Use Cases for 2013
 
Big Data Analytics
Big Data AnalyticsBig Data Analytics
Big Data Analytics
 
Business case for Big Data Analytics
Business case for Big Data AnalyticsBusiness case for Big Data Analytics
Business case for Big Data Analytics
 
Advanced Analytics in Banking, CITI
Advanced Analytics in Banking, CITIAdvanced Analytics in Banking, CITI
Advanced Analytics in Banking, CITI
 
Big data it’s impact on the finance function
Big data it’s impact on the finance functionBig data it’s impact on the finance function
Big data it’s impact on the finance function
 
Digital Transformation: How to Build an Analytics-Driven Culture
Digital Transformation: How to Build an Analytics-Driven CultureDigital Transformation: How to Build an Analytics-Driven Culture
Digital Transformation: How to Build an Analytics-Driven Culture
 
BIG Data & Hadoop Applications in Finance
BIG Data & Hadoop Applications in FinanceBIG Data & Hadoop Applications in Finance
BIG Data & Hadoop Applications in Finance
 
How advanced analytics is impacting the banking sector
How advanced analytics is impacting the banking sectorHow advanced analytics is impacting the banking sector
How advanced analytics is impacting the banking sector
 
How Eastern Bank Uses Big Data to Better Serve and Protect its Customers
How Eastern Bank Uses Big Data to Better Serve and Protect its CustomersHow Eastern Bank Uses Big Data to Better Serve and Protect its Customers
How Eastern Bank Uses Big Data to Better Serve and Protect its Customers
 
Big Data Analytics in light of Financial Industry
Big Data Analytics in light of Financial Industry Big Data Analytics in light of Financial Industry
Big Data Analytics in light of Financial Industry
 
Importance of Big data for your Business
Importance of Big data for your BusinessImportance of Big data for your Business
Importance of Big data for your Business
 
Big Data Analytics for Banking, a Point of View
Big Data Analytics for Banking, a Point of ViewBig Data Analytics for Banking, a Point of View
Big Data Analytics for Banking, a Point of View
 
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATIONBig Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
 
Graph Database
Graph Database  Graph Database
Graph Database
 
Big Data & Business Analytics: Understanding the Marketspace
Big Data & Business Analytics: Understanding the MarketspaceBig Data & Business Analytics: Understanding the Marketspace
Big Data & Business Analytics: Understanding the Marketspace
 
Big data analytic market opportunity
Big data analytic market opportunityBig data analytic market opportunity
Big data analytic market opportunity
 
Big data
Big dataBig data
Big data
 

En vedette

Code Camp Auckland 2015 - DEV1 Microsoft API Approaches 101
Code Camp Auckland 2015 - DEV1 Microsoft API Approaches 101Code Camp Auckland 2015 - DEV1 Microsoft API Approaches 101
Code Camp Auckland 2015 - DEV1 Microsoft API Approaches 101Nikolai Blackie
 
Custom Image Classifier with Visual Recognition: Building with Watson
Custom Image Classifier with Visual Recognition: Building with Watson Custom Image Classifier with Visual Recognition: Building with Watson
Custom Image Classifier with Visual Recognition: Building with Watson IBM Watson
 
INFOGRAPHIC: Big Data Alchemy
INFOGRAPHIC: Big Data AlchemyINFOGRAPHIC: Big Data Alchemy
INFOGRAPHIC: Big Data AlchemyCapgemini
 
Building an Image Recognition Service - How to leverage IBM Watson for visual...
Building an Image Recognition Service - How to leverage IBM Watson for visual...Building an Image Recognition Service - How to leverage IBM Watson for visual...
Building an Image Recognition Service - How to leverage IBM Watson for visual...10x Nation
 
Microsoft vision & strategy keynote for partners
Microsoft vision & strategy keynote for partnersMicrosoft vision & strategy keynote for partners
Microsoft vision & strategy keynote for partners- Michiel van Vliet -
 
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...Trivadis
 
Introduction and Overview of BigData, Hadoop, Distributed Computing - BigData...
Introduction and Overview of BigData, Hadoop, Distributed Computing - BigData...Introduction and Overview of BigData, Hadoop, Distributed Computing - BigData...
Introduction and Overview of BigData, Hadoop, Distributed Computing - BigData...Mahantesh Angadi
 
Apache hadoop bigdata-in-banking
Apache hadoop bigdata-in-bankingApache hadoop bigdata-in-banking
Apache hadoop bigdata-in-bankingm_hepburn
 
Big Data Alchemy: How can Banks Maximize the Value of their Customer Data?
Big Data Alchemy: How can Banks Maximize the Value of their Customer Data?Big Data Alchemy: How can Banks Maximize the Value of their Customer Data?
Big Data Alchemy: How can Banks Maximize the Value of their Customer Data?Capgemini
 
Provide place information based on image matching
Provide place information based on image matchingProvide place information based on image matching
Provide place information based on image matchingSeong-Ho Hong
 
Information house
Information houseInformation house
Information houseNick_K
 
[DDBJing29]DDBJ Nucleotide Sequence Submission System の紹介(第29回 DDBJing 講習会 in...
[DDBJing29]DDBJ Nucleotide Sequence Submission System の紹介(第29回 DDBJing 講習会 in...[DDBJing29]DDBJ Nucleotide Sequence Submission System の紹介(第29回 DDBJing 講習会 in...
[DDBJing29]DDBJ Nucleotide Sequence Submission System の紹介(第29回 DDBJing 講習会 in...DNA Data Bank of Japan center
 
Could Martial Arts Improve Your Life
Could Martial Arts Improve Your LifeCould Martial Arts Improve Your Life
Could Martial Arts Improve Your Lifekaratedojo2
 

En vedette (20)

Code Camp Auckland 2015 - DEV1 Microsoft API Approaches 101
Code Camp Auckland 2015 - DEV1 Microsoft API Approaches 101Code Camp Auckland 2015 - DEV1 Microsoft API Approaches 101
Code Camp Auckland 2015 - DEV1 Microsoft API Approaches 101
 
Custom Image Classifier with Visual Recognition: Building with Watson
Custom Image Classifier with Visual Recognition: Building with Watson Custom Image Classifier with Visual Recognition: Building with Watson
Custom Image Classifier with Visual Recognition: Building with Watson
 
Xamarin microsoft graph
Xamarin microsoft graphXamarin microsoft graph
Xamarin microsoft graph
 
Machine Learning for Images
Machine Learning for ImagesMachine Learning for Images
Machine Learning for Images
 
INFOGRAPHIC: Big Data Alchemy
INFOGRAPHIC: Big Data AlchemyINFOGRAPHIC: Big Data Alchemy
INFOGRAPHIC: Big Data Alchemy
 
Building an Image Recognition Service - How to leverage IBM Watson for visual...
Building an Image Recognition Service - How to leverage IBM Watson for visual...Building an Image Recognition Service - How to leverage IBM Watson for visual...
Building an Image Recognition Service - How to leverage IBM Watson for visual...
 
Microsoft vision & strategy keynote for partners
Microsoft vision & strategy keynote for partnersMicrosoft vision & strategy keynote for partners
Microsoft vision & strategy keynote for partners
 
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...
 
Space Waste Management
Space Waste ManagementSpace Waste Management
Space Waste Management
 
Introduction and Overview of BigData, Hadoop, Distributed Computing - BigData...
Introduction and Overview of BigData, Hadoop, Distributed Computing - BigData...Introduction and Overview of BigData, Hadoop, Distributed Computing - BigData...
Introduction and Overview of BigData, Hadoop, Distributed Computing - BigData...
 
Retail Rebooted (August 2013)
Retail Rebooted (August 2013)Retail Rebooted (August 2013)
Retail Rebooted (August 2013)
 
Apache hadoop bigdata-in-banking
Apache hadoop bigdata-in-bankingApache hadoop bigdata-in-banking
Apache hadoop bigdata-in-banking
 
Big data security
Big data securityBig data security
Big data security
 
A data analyst view of Bigdata
A data analyst view of Bigdata A data analyst view of Bigdata
A data analyst view of Bigdata
 
Big Data Alchemy: How can Banks Maximize the Value of their Customer Data?
Big Data Alchemy: How can Banks Maximize the Value of their Customer Data?Big Data Alchemy: How can Banks Maximize the Value of their Customer Data?
Big Data Alchemy: How can Banks Maximize the Value of their Customer Data?
 
Provide place information based on image matching
Provide place information based on image matchingProvide place information based on image matching
Provide place information based on image matching
 
Jose maría
Jose maríaJose maría
Jose maría
 
Information house
Information houseInformation house
Information house
 
[DDBJing29]DDBJ Nucleotide Sequence Submission System の紹介(第29回 DDBJing 講習会 in...
[DDBJing29]DDBJ Nucleotide Sequence Submission System の紹介(第29回 DDBJing 講習会 in...[DDBJing29]DDBJ Nucleotide Sequence Submission System の紹介(第29回 DDBJing 講習会 in...
[DDBJing29]DDBJ Nucleotide Sequence Submission System の紹介(第29回 DDBJing 講習会 in...
 
Could Martial Arts Improve Your Life
Could Martial Arts Improve Your LifeCould Martial Arts Improve Your Life
Could Martial Arts Improve Your Life
 

Similaire à BigData in Banking

Choosing the Right Big Data Architecture for your Business
Choosing the Right Big Data Architecture for your BusinessChoosing the Right Big Data Architecture for your Business
Choosing the Right Big Data Architecture for your BusinessChicago Hadoop Users Group
 
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data VirtualizationKASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data VirtualizationDenodo
 
Building the Artificially Intelligent Enterprise
Building the Artificially Intelligent EnterpriseBuilding the Artificially Intelligent Enterprise
Building the Artificially Intelligent EnterpriseDatabricks
 
Big Data is Here for Financial Services White Paper
Big Data is Here for Financial Services White PaperBig Data is Here for Financial Services White Paper
Big Data is Here for Financial Services White PaperExperian
 
Three Dimensions of Data as a Service
Three Dimensions of Data as a ServiceThree Dimensions of Data as a Service
Three Dimensions of Data as a ServiceDenodo
 
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...Denodo
 
Four Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics StrategyFour Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics StrategyArcadia Data
 
Big agendas for big data analytics projects
Big agendas for big data analytics projectsBig agendas for big data analytics projects
Big agendas for big data analytics projectsThe Marketing Distillery
 
Die Big Data Fabric als Enabler für Machine Learning & AI
Die Big Data Fabric als Enabler für Machine Learning & AIDie Big Data Fabric als Enabler für Machine Learning & AI
Die Big Data Fabric als Enabler für Machine Learning & AIDenodo
 
DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalDataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalHarvinder Atwal
 
Modern Data Challenges require Modern Graph Technology
Modern Data Challenges require Modern Graph TechnologyModern Data Challenges require Modern Graph Technology
Modern Data Challenges require Modern Graph TechnologyNeo4j
 
DAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
DAMA Webinar: Turn Grand Designs into a Reality with Data VirtualizationDAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
DAMA Webinar: Turn Grand Designs into a Reality with Data VirtualizationDenodo
 
Data Virtualization. An Introduction (ASEAN)
Data Virtualization. An Introduction (ASEAN)Data Virtualization. An Introduction (ASEAN)
Data Virtualization. An Introduction (ASEAN)Denodo
 
Empowering your Enterprise with a Self-Service Data Marketplace (EMEA)
Empowering your Enterprise with a Self-Service Data Marketplace (EMEA)Empowering your Enterprise with a Self-Service Data Marketplace (EMEA)
Empowering your Enterprise with a Self-Service Data Marketplace (EMEA)Denodo
 
Big Data LDN 2018: DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAI...
Big Data LDN 2018: DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAI...Big Data LDN 2018: DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAI...
Big Data LDN 2018: DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAI...Matt Stubbs
 
Future of Power: Big Data - Søren Ravn
Future of Power: Big Data - Søren RavnFuture of Power: Big Data - Søren Ravn
Future of Power: Big Data - Søren RavnIBM Danmark
 

Similaire à BigData in Banking (20)

Pres_Big Data for Finance_vsaini
Pres_Big Data for Finance_vsainiPres_Big Data for Finance_vsaini
Pres_Big Data for Finance_vsaini
 
Bi orientations
Bi orientationsBi orientations
Bi orientations
 
Choosing the Right Big Data Architecture for your Business
Choosing the Right Big Data Architecture for your BusinessChoosing the Right Big Data Architecture for your Business
Choosing the Right Big Data Architecture for your Business
 
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data VirtualizationKASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
 
Building the Artificially Intelligent Enterprise
Building the Artificially Intelligent EnterpriseBuilding the Artificially Intelligent Enterprise
Building the Artificially Intelligent Enterprise
 
Big Data is Here for Financial Services White Paper
Big Data is Here for Financial Services White PaperBig Data is Here for Financial Services White Paper
Big Data is Here for Financial Services White Paper
 
Three Dimensions of Data as a Service
Three Dimensions of Data as a ServiceThree Dimensions of Data as a Service
Three Dimensions of Data as a Service
 
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
 
Four Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics StrategyFour Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics Strategy
 
Big agendas for big data analytics projects
Big agendas for big data analytics projectsBig agendas for big data analytics projects
Big agendas for big data analytics projects
 
Die Big Data Fabric als Enabler für Machine Learning & AI
Die Big Data Fabric als Enabler für Machine Learning & AIDie Big Data Fabric als Enabler für Machine Learning & AI
Die Big Data Fabric als Enabler für Machine Learning & AI
 
DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalDataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
 
Modern Data Challenges require Modern Graph Technology
Modern Data Challenges require Modern Graph TechnologyModern Data Challenges require Modern Graph Technology
Modern Data Challenges require Modern Graph Technology
 
6 Reasons to Use Data Analytics
6 Reasons to Use Data Analytics6 Reasons to Use Data Analytics
6 Reasons to Use Data Analytics
 
Big Data analytics best practices
Big Data analytics best practicesBig Data analytics best practices
Big Data analytics best practices
 
DAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
DAMA Webinar: Turn Grand Designs into a Reality with Data VirtualizationDAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
DAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
 
Data Virtualization. An Introduction (ASEAN)
Data Virtualization. An Introduction (ASEAN)Data Virtualization. An Introduction (ASEAN)
Data Virtualization. An Introduction (ASEAN)
 
Empowering your Enterprise with a Self-Service Data Marketplace (EMEA)
Empowering your Enterprise with a Self-Service Data Marketplace (EMEA)Empowering your Enterprise with a Self-Service Data Marketplace (EMEA)
Empowering your Enterprise with a Self-Service Data Marketplace (EMEA)
 
Big Data LDN 2018: DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAI...
Big Data LDN 2018: DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAI...Big Data LDN 2018: DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAI...
Big Data LDN 2018: DATA MANAGEMENT AUTOMATION AND THE INFORMATION SUPPLY CHAI...
 
Future of Power: Big Data - Søren Ravn
Future of Power: Big Data - Søren RavnFuture of Power: Big Data - Søren Ravn
Future of Power: Big Data - Søren Ravn
 

Plus de Andzhey Arshavskiy

Digital Society Laboratory (DSL)
Digital Society Laboratory (DSL)Digital Society Laboratory (DSL)
Digital Society Laboratory (DSL)Andzhey Arshavskiy
 
WHAT IS BIG DATA? AND HOW IT APPLIED IN MODERN MARKETING
WHAT IS BIG DATA? AND HOW IT APPLIED IN MODERN MARKETINGWHAT IS BIG DATA? AND HOW IT APPLIED IN MODERN MARKETING
WHAT IS BIG DATA? AND HOW IT APPLIED IN MODERN MARKETINGAndzhey Arshavskiy
 
Ispras (трудаков, коршунов)
Ispras (трудаков, коршунов)Ispras (трудаков, коршунов)
Ispras (трудаков, коршунов)Andzhey Arshavskiy
 
Dmitry Gubanov presentation for ФИSNA
Dmitry Gubanov presentation for ФИSNADmitry Gubanov presentation for ФИSNA
Dmitry Gubanov presentation for ФИSNAAndzhey Arshavskiy
 
Дмитрий Игнатов для ФИSNA
Дмитрий Игнатов для ФИSNAДмитрий Игнатов для ФИSNA
Дмитрий Игнатов для ФИSNAAndzhey Arshavskiy
 
Digital Society Laboratory (Аршавский)
Digital Society Laboratory (Аршавский)Digital Society Laboratory (Аршавский)
Digital Society Laboratory (Аршавский)Andzhey Arshavskiy
 

Plus de Andzhey Arshavskiy (12)

dsl & bigdata
dsl & bigdatadsl & bigdata
dsl & bigdata
 
Dsl public
Dsl publicDsl public
Dsl public
 
Digital Society Lab (about)
Digital Society Lab (about)Digital Society Lab (about)
Digital Society Lab (about)
 
Digital Society Laboratory (DSL)
Digital Society Laboratory (DSL)Digital Society Laboratory (DSL)
Digital Society Laboratory (DSL)
 
WHAT IS BIG DATA? AND HOW IT APPLIED IN MODERN MARKETING
WHAT IS BIG DATA? AND HOW IT APPLIED IN MODERN MARKETINGWHAT IS BIG DATA? AND HOW IT APPLIED IN MODERN MARKETING
WHAT IS BIG DATA? AND HOW IT APPLIED IN MODERN MARKETING
 
Ispras (трудаков, коршунов)
Ispras (трудаков, коршунов)Ispras (трудаков, коршунов)
Ispras (трудаков, коршунов)
 
Dmitry Gubanov presentation for ФИSNA
Dmitry Gubanov presentation for ФИSNADmitry Gubanov presentation for ФИSNA
Dmitry Gubanov presentation for ФИSNA
 
Дмитрий Игнатов для ФИSNA
Дмитрий Игнатов для ФИSNAДмитрий Игнатов для ФИSNA
Дмитрий Игнатов для ФИSNA
 
Digital Society Laboratory (Аршавский)
Digital Society Laboratory (Аршавский)Digital Society Laboratory (Аршавский)
Digital Society Laboratory (Аршавский)
 
мосты
мостымосты
мосты
 
Japan creativity.pps
Japan creativity.ppsJapan creativity.pps
Japan creativity.pps
 
Big data, Clouds & HPC
Big data, Clouds & HPCBig data, Clouds & HPC
Big data, Clouds & HPC
 

BigData in Banking

  • 1. BigData in Banking Challenges and Solutions Arshavsky Andzhey Director, Big Data dept., SberBank Avarshavsky.sbt@sberbank.ru andzhey@mac.com 2015
  • 2. 3 Innovations like killers – destruction stages of standard banking system ① Internet & social networks Control and choice ② Screens and Smartphones Anyplace any time ③ Mobile wallet Out of cash and plastic cards ④ Accounts without Banks No bank accounts ⑤ BigData Cros-system personalization and targeting *Бретт Кинг, Банк 3.0
  • 3. 4 BIGDATA as the development of approaches to the use of data Information like competition differentiator Information like innovation enablement Information as strategic asset Information for business analysys Data for business “Day by day operations” “Datawarehousing” Thevalueofinformationforbusiness “Information in business context” “Business innovations based on information” “Adaptive business strategy” Information usage methods maturity + INTERNET AND OPEN DATA BIGDATA in Banking
  • 4. 5 BIGDATA In Banking Information challenges in large Banks (XL) Data is the most valuable asset in all XL banks A few know how to apply data for solving even this day challenges A few know how to leverage internet, external or open data sources to understand clients better and attract new customers
  • 5. 6 The Key challenge with data analysis Through the development of the Big Data Infrastructure which solves the challenges with data pre-processing and attribution thru building intelligent data processing Framework, the company will be able to optimize labor costs by reducing works on data preparation of data for the development of business applications up to 70%! BIGDATA in Banking It is estimated (by Gartner), 70% of the time spent on analytical projects are dedicated to bringing, cleaning and data integration, mainly due to the following problems: The difficulty of locating data due to the carelessness among disparate business applications and business systems To be more than appropriate for analysis, data require reengineering and reformatting 􏰀The acquisition of data for analysis in a specified format creates a huge burden on the teams that own the systems data source . Often the same data is requested or purchase by a variety of departments and business units, which creates additional work and chaos The need for process setup regular data exchange
  • 6. 7 Data and Analytics tools as shared resource Client Product Transactions Location …. Instruments RISKS Dept. RETAIL Dept. OPERATIONS Dept. SEQURITY Dept. CORPORATE CLIENTS Dept. HR BIGDATA in Banking BIGDATA to a lesser extent, about the data size and is more about the opportunity to work with many different data types, formats and applications with powerful analytic capabilities.
  • 7. 8 Sources of business growth and execution excelence BIGDATA in Banking Client ПРИВЛЕЧЕНИЕ УДЕРЖАНИЕ ПРОДАЖИ ПЕРВИЧНЫЕ ВТОРИЧНЫЕ КРЕДИТЫ РИСКИ ЗАДОЛЖЕННОСТИ АНТИФРОД ВНУТРЕННИЙ ВНЕШНИЙ HR ОПТИМИЗАЦИЯ ПРОЦЕССОВ ① ② ③ ④
  • 8. 9 Data Factory conception Big Data Factory should enable data processing in a uniform manner for all platforms, functions and customers. To build easily changeable and easy to use data processing operating model with the required level of trust for both traditional and not so traditional data sources Tasks: Information trust Traditional and not so traditional data sources BIGDATA in Banking • Delivery information • Information integration (Cleaning, Transformation, Mapping, Improvement) • Information search • Access to information • Study hypotheses • Learning models and information analysis • Backup/ Cleanup/ Restore • Administration • Lifecycle management • Data quality • Reference data • Record linkage and the resolution of contradictions • Classification • Reporting • Internet data • Data virtualization
  • 10. 11 BIGDATA in Banking Data Factory Scenarious The experts of the subject areas of the Bank's business need to access the organization's data for research, sampling, annotation and modelling Data Scientists works on new models Marketing is looking for data for the new compains Security services looking for data for drill a suspicious transaction Retail unit wants to make the best proposal to the client …….. Daily activity The need for ad hoc access to diverse data Support analysis and decision making To use the terminology subject matter experts when accessing data Providing the same easy access to data in spreadsheets, with the ability to scale to huge volumes and distribution on a huge variety of types of information while protecting sensitive information and optimizing it storage systems.
  • 11. BIGDATA in Banking Data 2 profit process Task formalization DATA PREPARATION DATA EXPLORATION ADDITIONAL INDICATORS ALATITICS & MODELING MODEL VALIDATION MODEL PRODUCTIZATION EFFECIENCY MONITORING 12 ①
  • 12. 13 HDFS, row data Data exchange Data preparation, processing and analytical layer Analytical Views Ad-hoc analytics Development factory Streaming Big Data applications. Integration. marts API BIGDATA in Banking Possible architecture
  • 13. 14 BI & BIGDATA Traditional BI Big Data Based on DWH Precession is crucial Flat data scheme Long time 2 market hi-end hardware Based on Hadoop and Spark Any precesion Complex and variable data schemes Ad-hoc analytics Short time 2 market New data sources Low cost Both approaches are valid BIGDATA in Banking
  • 14. 15 BIGDATA in Banking Is not expensive - OPEN SOURCE does work Low cost No vendor lock Community support APPLICATION LAYER Spark Hadoop SQL NoSQLDB