SlideShare une entreprise Scribd logo
1  sur  24
PROFESSIONAL PORTFOLIO
Monica Opris
SQL & BI Developer
OVERVIEW
 1. My specialties
 2. BI Projects involved in
 3. Continuous improvement
 4. Recommended books
 5. About me
SPECIALTIES
 Databases: Microsoft SQL Server, MySQL and
Oracle Tools/Products
 Microsoft: SSMS, SSIS, SSAS, SSRS, Sharepoint,
 Oracle: PL/SQL Developer and
 Open Source: Jasper Reports.
 Database design and programming
 Data modeling
 Business Intelligence
- Data Warehouse (Dan Linstedt's Data Vault Model
and Methodology, Bill Inmon's DW )
- Data Mart (Ralph Kimball Model and
Methodology)
BUSINESS INTELLIGENCE DEVELOPER
 SQL Server and SQL programming language, BI
concepts and architecture (Data warehouse, Data
Mart, Data Vault, MDX), SSIS, SSAS, SSRS. BI
Test cases Validation, Error Handling in SSIS,
Builing, Deploying, Managing, Securing Reports
using SSRS and Report Buider.
MICROSOFT BI STACK
BI PROJECTS
 Banking
 Company management
 Assurance
BANKING PROJECT FLOW
 Microsoft SQL Server 2008 R2 ,SSIS and C#
 received in an input folder a set of files
(transactions between accounts and customers)
 whenever a file arrives it is extracted, transformed
and loaded in databases.
 the output files are generated when all expected
files arrives.
 ETL process generates messages which are stored
into a log table.
LAYERED VIEW IMPLEMENTATION
DATABASES
 three databases for main data storage
 Staging: here the data suffer basic validations and
transformations
 Core: the central repository of the data (like a
datawarehouse)
 Output: here the data in stored in the format expected to
be in the output files
 two auxiliary databases:
 Configuration: store all parameters and other
configuration data on which the system is based.
 AuditAndLog: store all information regarding auditing
and also all the messages which the processes
generate.
PROCESSES
- six interdependent processes:
 F2S: File to staging: Loads the data from the input files
to the Staging DB
 S2C: Staging to Core: Loads the data from the Staging
DB to the Core DB
 C2O: Core to Output: Loads the data from the Core DB
to the Output DB and latter to the output files.
 LOG: Log messages to external files in a format
required by the consumer systems of those file.
 CFA: Check File Arrival: Is checking if the expected files
arrived or not, and notify if a file is not arrived in the
specified time-window.
 PURGE: It purges old data from databases.
COMPANY MANAGEMENT PROJECT FLOW
 SQL Server 2012, PowerPivot 2010
 develop and monitoring the structure of the
company using source data collected from
Operational Systems (iTimeTrack, CRM,
SmartOffice,Costs, Budgets).
IMPLEMENTATION OVERVIEW
THE MAIN TASKS:
 create Audit database structure (contains tables that are logging all the events
occurring in the system),
 staging area database structure (SQL dynamic scripts to generate tables,
primary keys, indexes and views to concatenate the table columns),
 Data Vault database structure (SQL scripts used to generate Hubs, Satellites and
Links) and
 Data Mart database structure (SQL scripts to generate dimensions and facts tables),
 create PITs and bridge tables to improve performance of the queries,
 analyze the full and delta load for each table,
 ETL Integration: stored procedures to import the data from source to staging area,
from staging area to Data Vault and from Data Vault to Data Mart,
 create linked servers,
 create SSIS packages used to import the CSV source files,
 package configuration and deploy,
 use PowerView from SharePoint to create reports.
BI SEMANTIC MODEL
MULTIDIMENSIONAL MODEL VS
TABULAR MODEL
 Multidimensional
 - complex calculations and scoping
 - Many-to-Many relationships
 - complex modeling solution
 - access to many different external data sources
 Tabular
 - consistently fast query time
 - planning on using Power View (an interactive data
exploration, visualization, and presentation
experience browser-based Silverlight application
launched from SharePoint Server 2010)
INSURANCE PROJECT
 involved in a maintenance BI project of a mix of
applications and technologies that are used to
gather, provide access to and analyze data and
information about company operations.
 The main tasks I had provide me with the ability to
resolve database administration issues:
MAIN TASKS
 cube deployment errors,
 wrong mapping of columns in cube,
 update links with the right values,
 set the protection level in order to get package access,
 implement business logic - create a job running if another one
is correctly processed, run the job if more than 1 business day
is past- add rights to users,
 move the project on TFS,
 upgrade the BI solution in order to bring performance,
robustness and a better platform to improve the solution,
 implement a purge process to adjust the space allocation for
files
 code review and research in reducing SQL Server deadlocks,
 implement Backup and Recovery planning.
SSRS REPORT
RESEARCH MOVING TO SQL SERVER 2012
 SQL Server engine-
 ColumnStore index - combined with enhanced query
processing features, improves data warehouse query
performance by hundreds to thousands of times in
some cases;
 Database engine is more powerful.
 Analysis Services-
 New tabular model which allows analysis using
PowerPivot for Excel 2012 gives powerful tools for
analyze very quickly large amounts of data
 Improving integration of PowerPivot to SharePoint
portal (if the user choose to deploy a SharePoint portal)
RESEARCH MOVING TO SQL SERVER 2012
 Reporting Services-
 PowerView: an interactive data exploration,
visualization, and presentation experience. It provides
drag-and-drop ad hoc reporting for business users such
as data analysts, business decision makers, and
information workers.
 Integration Services-
 The processing engine is better
 Deployment and administration of packages greatly
enhanced
 Reduced memory usage
 The upgrade process will bring performance,
robustness and, in the future, a better platform to
improve the current BI solution.
CONTINUOUS IMPROVEMENT
Create database objects, Work with data, Modify data and Optimize
queries
RECOMMENDED BOOKS
Best Practices for Business Intelligence
PRESENTATIONS, BEST PRACTICES, TASKS
DESCRIPTION, RECOMMENDED BOOKS
ro.linkedin.com/pub/monica-opris/38/659/407
http://businessintelligencedev.blogspot.ro/

Contenu connexe

Tendances

New features of sql server 2016 bi features
New features of sql server 2016 bi featuresNew features of sql server 2016 bi features
New features of sql server 2016 bi featuresChris Testa-O'Neill
 
SQL Server Reporting Services (SSRS) 101
 SQL Server Reporting Services (SSRS) 101 SQL Server Reporting Services (SSRS) 101
SQL Server Reporting Services (SSRS) 101Sparkhound Inc.
 
GCharles_Resume_Summer_2016_SS_Short
GCharles_Resume_Summer_2016_SS_ShortGCharles_Resume_Summer_2016_SS_Short
GCharles_Resume_Summer_2016_SS_Shortsshgc
 
jerry_wen_resume
jerry_wen_resumejerry_wen_resume
jerry_wen_resumejerry wen
 
Sql server reporting services
Sql server reporting servicesSql server reporting services
Sql server reporting servicesssuser1eca7d
 
SQL Reporting Services
SQL Reporting ServicesSQL Reporting Services
SQL Reporting Servicesneha mittal
 
simha msbi resume
simha msbi resumesimha msbi resume
simha msbi resumeT.N simha
 
Ssrs introduction session 1
Ssrs introduction session 1Ssrs introduction session 1
Ssrs introduction session 1Muthuvel P
 
Maharshi_Amin_416
Maharshi_Amin_416Maharshi_Amin_416
Maharshi_Amin_416mamin1411
 
What is Business Objects
What is Business Objects What is Business Objects
What is Business Objects BigClasses.com
 
Mohamed sakr Senior ETL Developer
Mohamed sakr   Senior ETL Developer Mohamed sakr   Senior ETL Developer
Mohamed sakr Senior ETL Developer Mohamed Sakr
 
Presentation 1 - SSRS (1)
Presentation 1 - SSRS (1)Presentation 1 - SSRS (1)
Presentation 1 - SSRS (1)Anurag Rana
 
shun(Michael)_Liang_Resume_2-1-2017
shun(Michael)_Liang_Resume_2-1-2017shun(Michael)_Liang_Resume_2-1-2017
shun(Michael)_Liang_Resume_2-1-2017MICHAEL LIANG
 
Introduction to Microsoft SQL Server 2008 R2 Integration Services
Introduction to Microsoft SQL Server 2008 R2 Integration ServicesIntroduction to Microsoft SQL Server 2008 R2 Integration Services
Introduction to Microsoft SQL Server 2008 R2 Integration ServicesQuang Nguyễn Bá
 
Nicholas Dragon Sql Server Developer
Nicholas Dragon Sql Server DeveloperNicholas Dragon Sql Server Developer
Nicholas Dragon Sql Server DeveloperNicholas Dragon
 

Tendances (20)

New features of sql server 2016 bi features
New features of sql server 2016 bi featuresNew features of sql server 2016 bi features
New features of sql server 2016 bi features
 
William Lu
William LuWilliam Lu
William Lu
 
SQL Server Reporting Services (SSRS) 101
 SQL Server Reporting Services (SSRS) 101 SQL Server Reporting Services (SSRS) 101
SQL Server Reporting Services (SSRS) 101
 
GCharles_Resume_Summer_2016_SS_Short
GCharles_Resume_Summer_2016_SS_ShortGCharles_Resume_Summer_2016_SS_Short
GCharles_Resume_Summer_2016_SS_Short
 
SSRS for DBA's
SSRS for DBA'sSSRS for DBA's
SSRS for DBA's
 
jerry_wen_resume
jerry_wen_resumejerry_wen_resume
jerry_wen_resume
 
MSBI-SSRS PPT
MSBI-SSRS PPTMSBI-SSRS PPT
MSBI-SSRS PPT
 
Sql server reporting services
Sql server reporting servicesSql server reporting services
Sql server reporting services
 
SQL Reporting Services
SQL Reporting ServicesSQL Reporting Services
SQL Reporting Services
 
simha msbi resume
simha msbi resumesimha msbi resume
simha msbi resume
 
Ssrs introduction session 1
Ssrs introduction session 1Ssrs introduction session 1
Ssrs introduction session 1
 
Maharshi_Amin_416
Maharshi_Amin_416Maharshi_Amin_416
Maharshi_Amin_416
 
What is Business Objects
What is Business Objects What is Business Objects
What is Business Objects
 
Ssrs 2008 R2 webinar
Ssrs 2008 R2   webinarSsrs 2008 R2   webinar
Ssrs 2008 R2 webinar
 
Ssis 2008
Ssis 2008Ssis 2008
Ssis 2008
 
Mohamed sakr Senior ETL Developer
Mohamed sakr   Senior ETL Developer Mohamed sakr   Senior ETL Developer
Mohamed sakr Senior ETL Developer
 
Presentation 1 - SSRS (1)
Presentation 1 - SSRS (1)Presentation 1 - SSRS (1)
Presentation 1 - SSRS (1)
 
shun(Michael)_Liang_Resume_2-1-2017
shun(Michael)_Liang_Resume_2-1-2017shun(Michael)_Liang_Resume_2-1-2017
shun(Michael)_Liang_Resume_2-1-2017
 
Introduction to Microsoft SQL Server 2008 R2 Integration Services
Introduction to Microsoft SQL Server 2008 R2 Integration ServicesIntroduction to Microsoft SQL Server 2008 R2 Integration Services
Introduction to Microsoft SQL Server 2008 R2 Integration Services
 
Nicholas Dragon Sql Server Developer
Nicholas Dragon Sql Server DeveloperNicholas Dragon Sql Server Developer
Nicholas Dragon Sql Server Developer
 

Similaire à Professional Portfolio

Similaire à Professional Portfolio (20)

Ganesh CV
Ganesh CVGanesh CV
Ganesh CV
 
It ready dw_day3_rev00
It ready dw_day3_rev00It ready dw_day3_rev00
It ready dw_day3_rev00
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2
 
Whats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 CwWhats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 Cw
 
James Henry Robinson
James Henry RobinsonJames Henry Robinson
James Henry Robinson
 
Patel v res_(1)
Patel v res_(1)Patel v res_(1)
Patel v res_(1)
 
Ramesh BODS_IS
Ramesh BODS_ISRamesh BODS_IS
Ramesh BODS_IS
 
Msbi power bi_ lead
Msbi power bi_ leadMsbi power bi_ lead
Msbi power bi_ lead
 
Ramesh BODS_IS
Ramesh BODS_ISRamesh BODS_IS
Ramesh BODS_IS
 
Bw_Hana
Bw_HanaBw_Hana
Bw_Hana
 
SAP BI/DW Training with BO Integration
SAP BI/DW Training with BO IntegrationSAP BI/DW Training with BO Integration
SAP BI/DW Training with BO Integration
 
Dale Brooks Resume D
Dale Brooks Resume DDale Brooks Resume D
Dale Brooks Resume D
 
KarenResumeDBA
KarenResumeDBAKarenResumeDBA
KarenResumeDBA
 
KarenResumeDBA
KarenResumeDBAKarenResumeDBA
KarenResumeDBA
 
Balamurugan msbi cv
Balamurugan msbi cvBalamurugan msbi cv
Balamurugan msbi cv
 
Sql business intelligence
Sql business intelligenceSql business intelligence
Sql business intelligence
 
Resume Vikram_S
Resume Vikram_SResume Vikram_S
Resume Vikram_S
 
Introduction to microsoft sql server 2008 r2
Introduction to microsoft sql server 2008 r2Introduction to microsoft sql server 2008 r2
Introduction to microsoft sql server 2008 r2
 
Resume_Navneet_Formatted
Resume_Navneet_FormattedResume_Navneet_Formatted
Resume_Navneet_Formatted
 
BI SQL Server2008R2 Portfolio
BI SQL Server2008R2 PortfolioBI SQL Server2008R2 Portfolio
BI SQL Server2008R2 Portfolio
 

Plus de MoniqueO Opris

Master Data Management
Master Data ManagementMaster Data Management
Master Data ManagementMoniqueO Opris
 
Backup And Recovery Planning
Backup And Recovery PlanningBackup And Recovery Planning
Backup And Recovery PlanningMoniqueO Opris
 
Object modeling in robotic perception
Object modeling in robotic perceptionObject modeling in robotic perception
Object modeling in robotic perceptionMoniqueO Opris
 

Plus de MoniqueO Opris (6)

Master Data Management
Master Data ManagementMaster Data Management
Master Data Management
 
SQL debugging
SQL debuggingSQL debugging
SQL debugging
 
Database migration
Database migrationDatabase migration
Database migration
 
An Introduction To BI
An Introduction To BIAn Introduction To BI
An Introduction To BI
 
Backup And Recovery Planning
Backup And Recovery PlanningBackup And Recovery Planning
Backup And Recovery Planning
 
Object modeling in robotic perception
Object modeling in robotic perceptionObject modeling in robotic perception
Object modeling in robotic perception
 

Professional Portfolio

  • 2. OVERVIEW  1. My specialties  2. BI Projects involved in  3. Continuous improvement  4. Recommended books  5. About me
  • 3. SPECIALTIES  Databases: Microsoft SQL Server, MySQL and Oracle Tools/Products  Microsoft: SSMS, SSIS, SSAS, SSRS, Sharepoint,  Oracle: PL/SQL Developer and  Open Source: Jasper Reports.  Database design and programming  Data modeling  Business Intelligence - Data Warehouse (Dan Linstedt's Data Vault Model and Methodology, Bill Inmon's DW ) - Data Mart (Ralph Kimball Model and Methodology)
  • 4. BUSINESS INTELLIGENCE DEVELOPER  SQL Server and SQL programming language, BI concepts and architecture (Data warehouse, Data Mart, Data Vault, MDX), SSIS, SSAS, SSRS. BI Test cases Validation, Error Handling in SSIS, Builing, Deploying, Managing, Securing Reports using SSRS and Report Buider.
  • 6. BI PROJECTS  Banking  Company management  Assurance
  • 7. BANKING PROJECT FLOW  Microsoft SQL Server 2008 R2 ,SSIS and C#  received in an input folder a set of files (transactions between accounts and customers)  whenever a file arrives it is extracted, transformed and loaded in databases.  the output files are generated when all expected files arrives.  ETL process generates messages which are stored into a log table.
  • 9. DATABASES  three databases for main data storage  Staging: here the data suffer basic validations and transformations  Core: the central repository of the data (like a datawarehouse)  Output: here the data in stored in the format expected to be in the output files  two auxiliary databases:  Configuration: store all parameters and other configuration data on which the system is based.  AuditAndLog: store all information regarding auditing and also all the messages which the processes generate.
  • 10. PROCESSES - six interdependent processes:  F2S: File to staging: Loads the data from the input files to the Staging DB  S2C: Staging to Core: Loads the data from the Staging DB to the Core DB  C2O: Core to Output: Loads the data from the Core DB to the Output DB and latter to the output files.  LOG: Log messages to external files in a format required by the consumer systems of those file.  CFA: Check File Arrival: Is checking if the expected files arrived or not, and notify if a file is not arrived in the specified time-window.  PURGE: It purges old data from databases.
  • 11. COMPANY MANAGEMENT PROJECT FLOW  SQL Server 2012, PowerPivot 2010  develop and monitoring the structure of the company using source data collected from Operational Systems (iTimeTrack, CRM, SmartOffice,Costs, Budgets).
  • 13. THE MAIN TASKS:  create Audit database structure (contains tables that are logging all the events occurring in the system),  staging area database structure (SQL dynamic scripts to generate tables, primary keys, indexes and views to concatenate the table columns),  Data Vault database structure (SQL scripts used to generate Hubs, Satellites and Links) and  Data Mart database structure (SQL scripts to generate dimensions and facts tables),  create PITs and bridge tables to improve performance of the queries,  analyze the full and delta load for each table,  ETL Integration: stored procedures to import the data from source to staging area, from staging area to Data Vault and from Data Vault to Data Mart,  create linked servers,  create SSIS packages used to import the CSV source files,  package configuration and deploy,  use PowerView from SharePoint to create reports.
  • 15. MULTIDIMENSIONAL MODEL VS TABULAR MODEL  Multidimensional  - complex calculations and scoping  - Many-to-Many relationships  - complex modeling solution  - access to many different external data sources  Tabular  - consistently fast query time  - planning on using Power View (an interactive data exploration, visualization, and presentation experience browser-based Silverlight application launched from SharePoint Server 2010)
  • 16.
  • 17. INSURANCE PROJECT  involved in a maintenance BI project of a mix of applications and technologies that are used to gather, provide access to and analyze data and information about company operations.  The main tasks I had provide me with the ability to resolve database administration issues:
  • 18. MAIN TASKS  cube deployment errors,  wrong mapping of columns in cube,  update links with the right values,  set the protection level in order to get package access,  implement business logic - create a job running if another one is correctly processed, run the job if more than 1 business day is past- add rights to users,  move the project on TFS,  upgrade the BI solution in order to bring performance, robustness and a better platform to improve the solution,  implement a purge process to adjust the space allocation for files  code review and research in reducing SQL Server deadlocks,  implement Backup and Recovery planning.
  • 20. RESEARCH MOVING TO SQL SERVER 2012  SQL Server engine-  ColumnStore index - combined with enhanced query processing features, improves data warehouse query performance by hundreds to thousands of times in some cases;  Database engine is more powerful.  Analysis Services-  New tabular model which allows analysis using PowerPivot for Excel 2012 gives powerful tools for analyze very quickly large amounts of data  Improving integration of PowerPivot to SharePoint portal (if the user choose to deploy a SharePoint portal)
  • 21. RESEARCH MOVING TO SQL SERVER 2012  Reporting Services-  PowerView: an interactive data exploration, visualization, and presentation experience. It provides drag-and-drop ad hoc reporting for business users such as data analysts, business decision makers, and information workers.  Integration Services-  The processing engine is better  Deployment and administration of packages greatly enhanced  Reduced memory usage  The upgrade process will bring performance, robustness and, in the future, a better platform to improve the current BI solution.
  • 22. CONTINUOUS IMPROVEMENT Create database objects, Work with data, Modify data and Optimize queries
  • 23. RECOMMENDED BOOKS Best Practices for Business Intelligence
  • 24. PRESENTATIONS, BEST PRACTICES, TASKS DESCRIPTION, RECOMMENDED BOOKS ro.linkedin.com/pub/monica-opris/38/659/407 http://businessintelligencedev.blogspot.ro/

Notes de l'éditeur

  1. SSIS’ core purpose is to move data and do something with it. This is probably my favorite tool in the SQL Server BI Stack because it is very visual and you can see where your data is going. Once the ETL is developed, you can also schedule it to run as often as you need updated information. It has many other uses, such as import/export to Excel, emailing attachments, looping through files, performing maintenance on the server.
  2. SQL Server Analysis Services (SSAS) to create OLAP databases, also known as Cubes. These OLAP databases are high performance database structures that aggregate, slice-and-dice and organize your dimensions with hierarchies, allowing you to drill down until you get to the data you want. On top of all of that, it is really fast.