SlideShare une entreprise Scribd logo
1  sur  38
Télécharger pour lire hors ligne
1
Welcome to ServerlessToronto.org
2
Introduce Yourself:
- Where from? Why are you here?
- Looking for, or Offering work?
Fill the survey to win prises!
May 10, 2021: “Running (Business
Analytics for) a Serverless Insurance
Company” starts at 18:10pm…
Serverless Evolution (since FaaS started)
3
Serverless is New Agile & Mindset
#1 We started as Back-
end FaaS (Serverless)
Developers who enjoyed
“gluing” other people’s
APIs and Managed
Services)
#3 We're obsessed by
creating business value
(meaningful MVPs,
Products), focusing on
Outcomes – NOT
Outputs, and we mesh
well with Product
Managers
#2 We build bridges
between Serverless
Community (“Dev leg”),
and Front-end, Voice-First
& UX folks (“UX leg”)
#4 Achieve agility NOT
by “sprinting” faster
(like in Scrum), but
working smarter (by
using bigger building
blocks and less Ops)
Disconnect between IT & Business needs
4
How to help companies accelerate?
Technology is not the point => We are here to create Value
Adopting Serverless Mindset allowed us to shift the focus from “pimping
up our cars” (infrastructure/code), towards “driving” (the business) forward.
≠
Let’s bridge the Businesses & IT Gap by:
5
1. bringing more Business-focused
topics (like one today) to educate,
2. offering free Second Opinions on
Application/Data Architecture
modernization (to Businesses),
3. offering for-fee Consulting service
(regardless of how short they are),
4. start offering “matchmaking”
services… to connect Cloud experts
in the Community with Employers.
Fill the Survey to indicate your
needs / interests, and
to win Manning raffle today:
https://forms.gle/97fXbFxxtPzp4jsh8
Knowledge Sponsor
(on our path to enlightenment :)
1. Go to www.manning.com
2. Select *any* e-Book, Video course, or liveProject you want!
3. Add it to your shopping cart (no more than 1 item in the cart)
4. Raffle winners will send me the emails (used in Manning portal),
5. So the publisher can move it to your Dashboard – as if purchased.
Fill the survey to win!
Upcoming ServerlessToronto.org Meetups
7
1) Azure for Bioinformatics: Data
Lake Architecture for genomic-
scale data analysis – Lynn Langit
2) Smart Cities in Italy put Silicon
Valley to shame with innovative
IoT solutions – Antonio Puliafito
3) Building a Data Cloud to enable
Analytics and AI-Driven
Innovation – Lak Lakshmanan,
Head Data Analytics & AI @ GCP
4) Snowflake talk… and YOUR
“This is my Architecture” style
presentations are welcome!
Please rate us on Meetup &
Tell your peers we’re here to
Help YOU help others
8
Just an example how Joe influenced us
9
Presentation + Demo
Running Business Analytics for a
Serverless Insurance Company
@joeemison
I Have Made Mistakes: 22 years, 6 startups
Organizations Die on Common, Predictable, Unnecessary Hills
Undifferentiated Heavy Lifting Tech Blocks Everything
The Best Organizations Focus and Empower Leaders
Focus on the differentiated:
● Faster
● Cheaper
● Better
● Develop Internal Staff
Get out of the way:
● Leaders can execute in parallel
● Everyone is in technology
● No one can hide
Examples within Branch: Serverless Architecture
Examples within Branch: Software-as-a-Service
All about ETLs and Data Warehouses
Talend
Alteryx
y42
There’s Another Way: EL … T and Data Lakes
Fivetran at Branch
BigQuery at Branch
Looker at Branch
Enabling Every Decision
to be Data-Driven
Automated data integration that adapts to change for reliable data access.
Agenda
1. How Analytics Is
Changing
2. The Impact of
Automation
3. What is Fivetran?
4. UI Demo
High Rate of Resource Waste on Pipelines
The analytics landscape has shifted
● Constraining compute
(On-premises)
● Perpetual licensing
● ETL outside the database
● Separation of storage +
compute (on-premise)
● Subscription licensing
● Complex pipelines required
for large datasets
Single Node Databases Scalable Databases
● Auto scale cloud DBMS
● Usage based licensing
● Separation of storage and
compute allows for agile
data pipelines
Modern Cloud Databases
Pipeline architecture is being built on old assumptions
Business
Outcomes
Data-driven decisions at scale
require automation so you can...
Save Resources
Deliver insights more reliably with
less resources
Discover More Insights
Centralize more data to discover
hidden insights to optimize all
areas of your business
Free up Time
Without maintaining data
pipelines, use this time to _____
Data Reliability Fully Managed
Centralized Data
Pipeline can restart from a
point of failure, with minimal
costs, so that data integrity is
preserved in case of source
outage
Infrastructure is cloud-hosted
and fully managed to reduce
resource management for
servers and development
Raw source data should be
brought to a centralized
destination and delivered in a
schema that is optimized for
analytic workloads
The pipeline requirements...
A Powerful
Core Platform
Automated
Fivetran creates and maintains a perfect replica
of your data, with minimal user intervention
across 150+ connectors
Resilient
The core architecture of Fivetran enables
recovery from any point of failure with no user
intervention required
Cloud Native
Our engineers monitor and update our code as
the sources change
➔ Automatic Data
Updates (DML)
➔ Automatic Schema
Migrations (DDL)
➔ Automated Recovery
from Failure
(Idempotent)
➔ Micro-batched
architecture
➔ Extensible Cloud
Functions
What makes it different?
Serious about security
SOC 2 TYPE 2 certified,
GDPR compliant,
HIPAA BAA
Regularly audited
and certified for data
industry best practices.
End-to-end Encryption
Data is encrypted
end-to-end in transit
and at rest using
encrypted user keys.
No Data Retention
Data is deleted after
no more than 24 hours
from our system.
Fivetran Managed Workflow
1 2 3 4 5 6
Authenticate into
sources
Fivetran handles
scheduling and
batching queries
and API calls
Source sends
data to Fivetran
in form of JSON
or Queried Data
Automatic
Normalization of
Data
Fivetran creates
the appropriate
schemas and
tables in the
destination
Destination
Fivetran General Architecture
Automatic
Data Updates
Insert
Update
Delete
Source Destination
Automatic
Schema
Drift Handling
Add Column
Remove Column
Change Type
Source Destination
Add Object
Remove Object
We continually add new connectors!
Visit our directory page for an up to date list!
Sales Databases
Events
Files Functions
● Microsoft Dynamics 365
● Salesforce
● Shopify
● PrestaShop
● Pipedrive
● Spree Commerce
● OsCommerce
● PrestaShop
● Microsoft Dynamics NAV
● Oracle EBS
● WooCommerce
● Loaded Commerce
● DynamoDB
● MariaDB
● MongoDB
● MySQL
● Oracle
● PostgreSQL
● SQL Server
● Segment
● Snowplow
● Webhooks
● Airtable
● Amazon Cloudfront
● Amazon Kinesis
● Amazon S3
● Azure Blob Storage
● Box
● Browser Upload
● Dropbox
● Email
● FTP
● FTPS
● Google Cloud Storage
● Google Drive
● Google Sheets
● SFTP
● AWS Lambda
● Azure Functions
● Google Cloud Functions
Warehouses
● Azure Data Explorer
● Azure SQL
● BigQuery
● MySQL
● Panoly
● Periscope
● PostgreSQL
● Redshift
● Snowflake
→ fivetran.com/directory
Prebuilt connectors
Support
● Comm100
● Freshdesk
● Front
● Help Scout
● Intercom
● Kustomer
● UserVoice
● Zendesk
● Zendesk Chat
Marketing
● Adobe Analytics
● AdRoll
● Apple Search Ads
● Appsflyer
Finance
● Anaplan
● Braintree
● Coupa
● Lightspeed
● NetSuite SuiteAnalytics
● QuickBooks Online
● Recharge
● Recurly
● SAP ERP
● Square
● Stripe
● Xero
● Zuora
● Microsoft Dynamics Suite
● Sage Intacct
● SAP Concur
Human Resources
● Greenhouse
● Lever
● Workday
Productivity
● Asana
● Mavenlink
● ServiceNow
● Height
● CSV Uploader
● Airtable
● Bing Ads
● Braze
● Campaign Manager
● Criteo
● Facebook
● Google Ads
● Google Analytics
● Google Play
● Google Search Console
● HubSpot
● Iterable
● Itunes Connect
● Klaviyo
● LinkedIn Ads
● MailChimp
● Mandrill
● Marin Software
● Marketo
● Oracle Eloqua
● Outbrain
● Pardot
● Pinterest Ads
● Sailthru
● Salesforce Marketing Cloud
● SendGrid
● Snapchat Ads
● Taboola
● Twitter Ads
● Yahoo Gemini
● YouTube
Customers
Investors
Highlights
● 2,500+ customers
● 2.5 Trillion Rows Synced/Month
● 2019 Deloitte Fast 500 Award
Winner
● 2019 Y Combinator Top
Companies List
→ https://www.seagate.com/files/www-content/our-story/trends/files/idc-seagate-dataage-whitepaper.pdf
Top Rated
4.5 Rating
Denver, CO Munich, DE
Oakland, CA Bangalore, IN
Dublin, IR
Sydney, AU
Fivetran UI
Branch Case Study
(Fivetran, AWS)
Join www.ServerlessToronto.org
Home of “Less IT Mess”

Contenu connexe

Tendances

Tendances (20)

Microsoft power platform
Microsoft power platformMicrosoft power platform
Microsoft power platform
 
From Business Hindsight to Foresight with Azure Synapse Analytics
From Business Hindsight to Foresight with Azure Synapse AnalyticsFrom Business Hindsight to Foresight with Azure Synapse Analytics
From Business Hindsight to Foresight with Azure Synapse Analytics
 
20220205 Getting started with power bi
20220205 Getting started with power bi20220205 Getting started with power bi
20220205 Getting started with power bi
 
Implementing ChatOps using Microsoft Power Platform
Implementing ChatOps using Microsoft Power PlatformImplementing ChatOps using Microsoft Power Platform
Implementing ChatOps using Microsoft Power Platform
 
Unleash office 365 with the power of cognitive services and microsoft graph api
Unleash office 365 with the power of cognitive services and microsoft graph apiUnleash office 365 with the power of cognitive services and microsoft graph api
Unleash office 365 with the power of cognitive services and microsoft graph api
 
Surfacing SPFx Solutions in SharePoint, MS Teams, and Outlook Add-in
Surfacing SPFx Solutions in SharePoint, MS Teams, and Outlook Add-inSurfacing SPFx Solutions in SharePoint, MS Teams, and Outlook Add-in
Surfacing SPFx Solutions in SharePoint, MS Teams, and Outlook Add-in
 
Informatica Cloud for Oracle
Informatica Cloud for OracleInformatica Cloud for Oracle
Informatica Cloud for Oracle
 
"Build AI Compliant Whatsapp-like Chat App Using Qiscus SDK" by Evan Purnama ...
"Build AI Compliant Whatsapp-like Chat App Using Qiscus SDK" by Evan Purnama ..."Build AI Compliant Whatsapp-like Chat App Using Qiscus SDK" by Evan Purnama ...
"Build AI Compliant Whatsapp-like Chat App Using Qiscus SDK" by Evan Purnama ...
 
SharePoint Inspired 'Get more from your data with Office 365'
SharePoint Inspired 'Get more from your data with Office 365'SharePoint Inspired 'Get more from your data with Office 365'
SharePoint Inspired 'Get more from your data with Office 365'
 
Informatica cloud Powercenter designer
Informatica cloud Powercenter designerInformatica cloud Powercenter designer
Informatica cloud Powercenter designer
 
Google Cloud Machine Learning
 Google Cloud Machine Learning  Google Cloud Machine Learning
Google Cloud Machine Learning
 
20181212 AWS NL - Informatica Cloud Overview
20181212 AWS NL - Informatica Cloud Overview20181212 AWS NL - Informatica Cloud Overview
20181212 AWS NL - Informatica Cloud Overview
 
The business today - PowerApps, Power BI y Microsoft Flow
The business today - PowerApps, Power BI y Microsoft FlowThe business today - PowerApps, Power BI y Microsoft Flow
The business today - PowerApps, Power BI y Microsoft Flow
 
Build your Own Business Application Using Microsoft Power Apps
Build your Own Business Application Using Microsoft Power AppsBuild your Own Business Application Using Microsoft Power Apps
Build your Own Business Application Using Microsoft Power Apps
 
LotusLive Overvew
LotusLive OvervewLotusLive Overvew
LotusLive Overvew
 
The People's Innovation Platform - Microsoft Power Platform
    The People's Innovation Platform - Microsoft Power Platform    The People's Innovation Platform - Microsoft Power Platform
The People's Innovation Platform - Microsoft Power Platform
 
Informatica Cloud Overview
Informatica Cloud OverviewInformatica Cloud Overview
Informatica Cloud Overview
 
2018 10-17 J1 1B - How to plan your modern workplace project - Ammar Hasayen
2018 10-17 J1 1B - How to plan your modern workplace project - Ammar Hasayen 2018 10-17 J1 1B - How to plan your modern workplace project - Ammar Hasayen
2018 10-17 J1 1B - How to plan your modern workplace project - Ammar Hasayen
 
2018 10-17 J1 3C - Hybrid architectures with Amazon Web Services, Office 365 ...
2018 10-17 J1 3C - Hybrid architectures with Amazon Web Services, Office 365 ...2018 10-17 J1 3C - Hybrid architectures with Amazon Web Services, Office 365 ...
2018 10-17 J1 3C - Hybrid architectures with Amazon Web Services, Office 365 ...
 
Identifying Users Across Platforms with a Universal ID Webinar Slides
Identifying Users Across Platforms with a Universal ID Webinar SlidesIdentifying Users Across Platforms with a Universal ID Webinar Slides
Identifying Users Across Platforms with a Universal ID Webinar Slides
 

Similaire à Running Business Analytics for a Serverless Insurance Company - Joe Emison & Fivetran

Azure for AWS & GCP Pros: Which Azure services to use?
Azure for AWS & GCP Pros: Which Azure services to use?Azure for AWS & GCP Pros: Which Azure services to use?
Azure for AWS & GCP Pros: Which Azure services to use?
Daniel Zivkovic
 
Running Data Platforms Like Products
Running Data Platforms Like ProductsRunning Data Platforms Like Products
Running Data Platforms Like Products
VMware Tanzu
 
Cortana analytics ou comment office 365 peut rendre vos données plus intellig...
Cortana analytics ou comment office 365 peut rendre vos données plus intellig...Cortana analytics ou comment office 365 peut rendre vos données plus intellig...
Cortana analytics ou comment office 365 peut rendre vos données plus intellig...
Nicolas Georgeault
 
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Denodo
 
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Lviv Startup Club
 

Similaire à Running Business Analytics for a Serverless Insurance Company - Joe Emison & Fivetran (20)

Azure for AWS & GCP Pros: Which Azure services to use?
Azure for AWS & GCP Pros: Which Azure services to use?Azure for AWS & GCP Pros: Which Azure services to use?
Azure for AWS & GCP Pros: Which Azure services to use?
 
SPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDSSPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDS
 
Meetup Toulouse Microsoft Azure : Bâtir une solution IoT
Meetup Toulouse Microsoft Azure : Bâtir une solution IoTMeetup Toulouse Microsoft Azure : Bâtir une solution IoT
Meetup Toulouse Microsoft Azure : Bâtir une solution IoT
 
Running Data Platforms Like Products
Running Data Platforms Like ProductsRunning Data Platforms Like Products
Running Data Platforms Like Products
 
Cortana analytics ou comment office 365 peut rendre vos données plus intellig...
Cortana analytics ou comment office 365 peut rendre vos données plus intellig...Cortana analytics ou comment office 365 peut rendre vos données plus intellig...
Cortana analytics ou comment office 365 peut rendre vos données plus intellig...
 
How to grow to a modern workplace in 16 steps with microsoft 365
How to grow to a modern workplace in 16 steps with microsoft 365How to grow to a modern workplace in 16 steps with microsoft 365
How to grow to a modern workplace in 16 steps with microsoft 365
 
Unlocking the Value of Your Data Lake
Unlocking the Value of Your Data LakeUnlocking the Value of Your Data Lake
Unlocking the Value of Your Data Lake
 
Power to the People: A Stack to Empower Every User to Make Data-Driven Decisions
Power to the People: A Stack to Empower Every User to Make Data-Driven DecisionsPower to the People: A Stack to Empower Every User to Make Data-Driven Decisions
Power to the People: A Stack to Empower Every User to Make Data-Driven Decisions
 
SPSNYC2019 - What is Common Data Model and how to use it?
SPSNYC2019 - What is Common Data Model and how to use it?SPSNYC2019 - What is Common Data Model and how to use it?
SPSNYC2019 - What is Common Data Model and how to use it?
 
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
 
IBM Cloud pak for data brochure
IBM Cloud pak for data   brochureIBM Cloud pak for data   brochure
IBM Cloud pak for data brochure
 
Microsoft cloud big data strategy
Microsoft cloud big data strategyMicrosoft cloud big data strategy
Microsoft cloud big data strategy
 
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
 
Oracle OpenWorld 2017 Review (31st October 2017 - 250 slides)
Oracle OpenWorld 2017 Review (31st October 2017 - 250 slides)Oracle OpenWorld 2017 Review (31st October 2017 - 250 slides)
Oracle OpenWorld 2017 Review (31st October 2017 - 250 slides)
 
RightScale Roadtrip Boston: Accelerate to Cloud
RightScale Roadtrip Boston: Accelerate to CloudRightScale Roadtrip Boston: Accelerate to Cloud
RightScale Roadtrip Boston: Accelerate to Cloud
 
AWS vs Azure vs Google (GCP) - Slides
AWS vs Azure vs Google (GCP) - SlidesAWS vs Azure vs Google (GCP) - Slides
AWS vs Azure vs Google (GCP) - Slides
 
2014.10.22 Building Azure Solutions with Office 365
2014.10.22 Building Azure Solutions with Office 3652014.10.22 Building Azure Solutions with Office 365
2014.10.22 Building Azure Solutions with Office 365
 
Simply Business' Data Platform
Simply Business' Data PlatformSimply Business' Data Platform
Simply Business' Data Platform
 
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
 
Accelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationAccelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and Visualization
 

Plus de Daniel Zivkovic

Opinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & BuildersOpinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & Builders
Daniel Zivkovic
 
Intro to Vertex AI, unified MLOps platform for Data Scientists & ML Engineers
Intro to Vertex AI, unified MLOps platform for Data Scientists & ML EngineersIntro to Vertex AI, unified MLOps platform for Data Scientists & ML Engineers
Intro to Vertex AI, unified MLOps platform for Data Scientists & ML Engineers
Daniel Zivkovic
 
Serverless Evolution during 3 years of Serverless Toronto
Serverless Evolution during 3 years of Serverless TorontoServerless Evolution during 3 years of Serverless Toronto
Serverless Evolution during 3 years of Serverless Toronto
Daniel Zivkovic
 
AWS re:Invent 2020 Serverless Recap
AWS re:Invent 2020 Serverless RecapAWS re:Invent 2020 Serverless Recap
AWS re:Invent 2020 Serverless Recap
Daniel Zivkovic
 

Plus de Daniel Zivkovic (20)

All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
 
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
 
Opinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & BuildersOpinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & Builders
 
Google Cloud Next '22 Recap: Serverless & Data edition
Google Cloud Next '22 Recap: Serverless & Data editionGoogle Cloud Next '22 Recap: Serverless & Data edition
Google Cloud Next '22 Recap: Serverless & Data edition
 
Conversational Document Processing AI with Rui Costa
Conversational Document Processing AI with Rui CostaConversational Document Processing AI with Rui Costa
Conversational Document Processing AI with Rui Costa
 
How to build unified Batch & Streaming Pipelines with Apache Beam and Dataflow
How to build unified Batch & Streaming Pipelines with Apache Beam and DataflowHow to build unified Batch & Streaming Pipelines with Apache Beam and Dataflow
How to build unified Batch & Streaming Pipelines with Apache Beam and Dataflow
 
Gojko's 5 rules for super responsive Serverless applications
Gojko's 5 rules for super responsive Serverless applicationsGojko's 5 rules for super responsive Serverless applications
Gojko's 5 rules for super responsive Serverless applications
 
Retail Analytics and BI with Looker, BigQuery, GCP & Leigha Jarett
Retail Analytics and BI with Looker, BigQuery, GCP & Leigha JarettRetail Analytics and BI with Looker, BigQuery, GCP & Leigha Jarett
Retail Analytics and BI with Looker, BigQuery, GCP & Leigha Jarett
 
What's new in Serverless at AWS?
What's new in Serverless at AWS?What's new in Serverless at AWS?
What's new in Serverless at AWS?
 
Intro to Vertex AI, unified MLOps platform for Data Scientists & ML Engineers
Intro to Vertex AI, unified MLOps platform for Data Scientists & ML EngineersIntro to Vertex AI, unified MLOps platform for Data Scientists & ML Engineers
Intro to Vertex AI, unified MLOps platform for Data Scientists & ML Engineers
 
Empowering Developers to be Healthcare Heroes
Empowering Developers to be Healthcare HeroesEmpowering Developers to be Healthcare Heroes
Empowering Developers to be Healthcare Heroes
 
Smart Cities of Italy: Integrating the Cyber World with the IoT
Smart Cities of Italy: Integrating the Cyber World with the IoTSmart Cities of Italy: Integrating the Cyber World with the IoT
Smart Cities of Italy: Integrating the Cyber World with the IoT
 
Lunch & Learn BigQuery & Firebase from other Google Cloud customers
Lunch & Learn BigQuery & Firebase from other Google Cloud customersLunch & Learn BigQuery & Firebase from other Google Cloud customers
Lunch & Learn BigQuery & Firebase from other Google Cloud customers
 
Serverless Evolution during 3 years of Serverless Toronto
Serverless Evolution during 3 years of Serverless TorontoServerless Evolution during 3 years of Serverless Toronto
Serverless Evolution during 3 years of Serverless Toronto
 
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCPSimpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
 
AWS re:Invent 2020 Serverless Recap
AWS re:Invent 2020 Serverless RecapAWS re:Invent 2020 Serverless Recap
AWS re:Invent 2020 Serverless Recap
 
SRE Topics with Charity Majors and Liz Fong-Jones of Honeycomb
SRE Topics with Charity Majors and Liz Fong-Jones of HoneycombSRE Topics with Charity Majors and Liz Fong-Jones of Honeycomb
SRE Topics with Charity Majors and Liz Fong-Jones of Honeycomb
 
Deliver Business Value Faster with AWS Step Functions
Deliver Business Value Faster with AWS Step FunctionsDeliver Business Value Faster with AWS Step Functions
Deliver Business Value Faster with AWS Step Functions
 
What’s the big deal with Graph Databases?
What’s the big deal with Graph Databases?What’s the big deal with Graph Databases?
What’s the big deal with Graph Databases?
 
How to augment On-premise Call Centers to Scale-out to the Cloud
How to augment On-premise Call Centers to Scale-out to the CloudHow to augment On-premise Call Centers to Scale-out to the Cloud
How to augment On-premise Call Centers to Scale-out to the Cloud
 

Dernier

Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
chiefasafspells
 
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
masabamasaba
 
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
masabamasaba
 
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg
 
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
masabamasaba
 

Dernier (20)

Architecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the pastArchitecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the past
 
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
tonesoftg
tonesoftgtonesoftg
tonesoftg
 
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
 
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
 
Artyushina_Guest lecture_YorkU CS May 2024.pptx
Artyushina_Guest lecture_YorkU CS May 2024.pptxArtyushina_Guest lecture_YorkU CS May 2024.pptx
Artyushina_Guest lecture_YorkU CS May 2024.pptx
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK Software
 
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
 
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
 
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
 
WSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - KeynoteWSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - Keynote
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
 
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
 
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park %in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
 
WSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaSWSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaS
 
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
 

Running Business Analytics for a Serverless Insurance Company - Joe Emison & Fivetran

  • 1. 1
  • 2. Welcome to ServerlessToronto.org 2 Introduce Yourself: - Where from? Why are you here? - Looking for, or Offering work? Fill the survey to win prises! May 10, 2021: “Running (Business Analytics for) a Serverless Insurance Company” starts at 18:10pm…
  • 3. Serverless Evolution (since FaaS started) 3 Serverless is New Agile & Mindset #1 We started as Back- end FaaS (Serverless) Developers who enjoyed “gluing” other people’s APIs and Managed Services) #3 We're obsessed by creating business value (meaningful MVPs, Products), focusing on Outcomes – NOT Outputs, and we mesh well with Product Managers #2 We build bridges between Serverless Community (“Dev leg”), and Front-end, Voice-First & UX folks (“UX leg”) #4 Achieve agility NOT by “sprinting” faster (like in Scrum), but working smarter (by using bigger building blocks and less Ops)
  • 4. Disconnect between IT & Business needs 4 How to help companies accelerate? Technology is not the point => We are here to create Value Adopting Serverless Mindset allowed us to shift the focus from “pimping up our cars” (infrastructure/code), towards “driving” (the business) forward. ≠
  • 5. Let’s bridge the Businesses & IT Gap by: 5 1. bringing more Business-focused topics (like one today) to educate, 2. offering free Second Opinions on Application/Data Architecture modernization (to Businesses), 3. offering for-fee Consulting service (regardless of how short they are), 4. start offering “matchmaking” services… to connect Cloud experts in the Community with Employers. Fill the Survey to indicate your needs / interests, and to win Manning raffle today: https://forms.gle/97fXbFxxtPzp4jsh8
  • 6. Knowledge Sponsor (on our path to enlightenment :) 1. Go to www.manning.com 2. Select *any* e-Book, Video course, or liveProject you want! 3. Add it to your shopping cart (no more than 1 item in the cart) 4. Raffle winners will send me the emails (used in Manning portal), 5. So the publisher can move it to your Dashboard – as if purchased. Fill the survey to win!
  • 7. Upcoming ServerlessToronto.org Meetups 7 1) Azure for Bioinformatics: Data Lake Architecture for genomic- scale data analysis – Lynn Langit 2) Smart Cities in Italy put Silicon Valley to shame with innovative IoT solutions – Antonio Puliafito 3) Building a Data Cloud to enable Analytics and AI-Driven Innovation – Lak Lakshmanan, Head Data Analytics & AI @ GCP 4) Snowflake talk… and YOUR “This is my Architecture” style presentations are welcome! Please rate us on Meetup & Tell your peers we’re here to Help YOU help others
  • 8. 8 Just an example how Joe influenced us
  • 10. Running Business Analytics for a Serverless Insurance Company @joeemison
  • 11. I Have Made Mistakes: 22 years, 6 startups
  • 12. Organizations Die on Common, Predictable, Unnecessary Hills Undifferentiated Heavy Lifting Tech Blocks Everything
  • 13. The Best Organizations Focus and Empower Leaders Focus on the differentiated: ● Faster ● Cheaper ● Better ● Develop Internal Staff Get out of the way: ● Leaders can execute in parallel ● Everyone is in technology ● No one can hide
  • 14. Examples within Branch: Serverless Architecture
  • 15. Examples within Branch: Software-as-a-Service
  • 16. All about ETLs and Data Warehouses Talend Alteryx y42
  • 17. There’s Another Way: EL … T and Data Lakes
  • 21. Enabling Every Decision to be Data-Driven Automated data integration that adapts to change for reliable data access.
  • 22. Agenda 1. How Analytics Is Changing 2. The Impact of Automation 3. What is Fivetran? 4. UI Demo
  • 23. High Rate of Resource Waste on Pipelines
  • 24. The analytics landscape has shifted ● Constraining compute (On-premises) ● Perpetual licensing ● ETL outside the database ● Separation of storage + compute (on-premise) ● Subscription licensing ● Complex pipelines required for large datasets Single Node Databases Scalable Databases ● Auto scale cloud DBMS ● Usage based licensing ● Separation of storage and compute allows for agile data pipelines Modern Cloud Databases Pipeline architecture is being built on old assumptions
  • 25. Business Outcomes Data-driven decisions at scale require automation so you can... Save Resources Deliver insights more reliably with less resources Discover More Insights Centralize more data to discover hidden insights to optimize all areas of your business Free up Time Without maintaining data pipelines, use this time to _____
  • 26. Data Reliability Fully Managed Centralized Data Pipeline can restart from a point of failure, with minimal costs, so that data integrity is preserved in case of source outage Infrastructure is cloud-hosted and fully managed to reduce resource management for servers and development Raw source data should be brought to a centralized destination and delivered in a schema that is optimized for analytic workloads The pipeline requirements...
  • 27. A Powerful Core Platform Automated Fivetran creates and maintains a perfect replica of your data, with minimal user intervention across 150+ connectors Resilient The core architecture of Fivetran enables recovery from any point of failure with no user intervention required Cloud Native Our engineers monitor and update our code as the sources change
  • 28. ➔ Automatic Data Updates (DML) ➔ Automatic Schema Migrations (DDL) ➔ Automated Recovery from Failure (Idempotent) ➔ Micro-batched architecture ➔ Extensible Cloud Functions What makes it different?
  • 29. Serious about security SOC 2 TYPE 2 certified, GDPR compliant, HIPAA BAA Regularly audited and certified for data industry best practices. End-to-end Encryption Data is encrypted end-to-end in transit and at rest using encrypted user keys. No Data Retention Data is deleted after no more than 24 hours from our system.
  • 30. Fivetran Managed Workflow 1 2 3 4 5 6 Authenticate into sources Fivetran handles scheduling and batching queries and API calls Source sends data to Fivetran in form of JSON or Queried Data Automatic Normalization of Data Fivetran creates the appropriate schemas and tables in the destination Destination
  • 33. Automatic Schema Drift Handling Add Column Remove Column Change Type Source Destination Add Object Remove Object
  • 34. We continually add new connectors! Visit our directory page for an up to date list! Sales Databases Events Files Functions ● Microsoft Dynamics 365 ● Salesforce ● Shopify ● PrestaShop ● Pipedrive ● Spree Commerce ● OsCommerce ● PrestaShop ● Microsoft Dynamics NAV ● Oracle EBS ● WooCommerce ● Loaded Commerce ● DynamoDB ● MariaDB ● MongoDB ● MySQL ● Oracle ● PostgreSQL ● SQL Server ● Segment ● Snowplow ● Webhooks ● Airtable ● Amazon Cloudfront ● Amazon Kinesis ● Amazon S3 ● Azure Blob Storage ● Box ● Browser Upload ● Dropbox ● Email ● FTP ● FTPS ● Google Cloud Storage ● Google Drive ● Google Sheets ● SFTP ● AWS Lambda ● Azure Functions ● Google Cloud Functions Warehouses ● Azure Data Explorer ● Azure SQL ● BigQuery ● MySQL ● Panoly ● Periscope ● PostgreSQL ● Redshift ● Snowflake → fivetran.com/directory Prebuilt connectors Support ● Comm100 ● Freshdesk ● Front ● Help Scout ● Intercom ● Kustomer ● UserVoice ● Zendesk ● Zendesk Chat Marketing ● Adobe Analytics ● AdRoll ● Apple Search Ads ● Appsflyer Finance ● Anaplan ● Braintree ● Coupa ● Lightspeed ● NetSuite SuiteAnalytics ● QuickBooks Online ● Recharge ● Recurly ● SAP ERP ● Square ● Stripe ● Xero ● Zuora ● Microsoft Dynamics Suite ● Sage Intacct ● SAP Concur Human Resources ● Greenhouse ● Lever ● Workday Productivity ● Asana ● Mavenlink ● ServiceNow ● Height ● CSV Uploader ● Airtable ● Bing Ads ● Braze ● Campaign Manager ● Criteo ● Facebook ● Google Ads ● Google Analytics ● Google Play ● Google Search Console ● HubSpot ● Iterable ● Itunes Connect ● Klaviyo ● LinkedIn Ads ● MailChimp ● Mandrill ● Marin Software ● Marketo ● Oracle Eloqua ● Outbrain ● Pardot ● Pinterest Ads ● Sailthru ● Salesforce Marketing Cloud ● SendGrid ● Snapchat Ads ● Taboola ● Twitter Ads ● Yahoo Gemini ● YouTube
  • 35. Customers Investors Highlights ● 2,500+ customers ● 2.5 Trillion Rows Synced/Month ● 2019 Deloitte Fast 500 Award Winner ● 2019 Y Combinator Top Companies List → https://www.seagate.com/files/www-content/our-story/trends/files/idc-seagate-dataage-whitepaper.pdf Top Rated 4.5 Rating Denver, CO Munich, DE Oakland, CA Bangalore, IN Dublin, IR Sydney, AU