Steve Rimar, CEO & Founder of Analytica Consulting, presents: Big Data Analytics with Qlik & Splunk

1. Big Data Analytics with Qlik & Splunk
Steve Rimar
CEO & Founder
Analytica Consulting
San Diego, CA

2. Agenda
• About Me
• What is Splunk
• Why Qlik + Splunk?
• Integration Methods
• Summary

3. About Steve Rimar – CEO & Founder
• Former Director of Analytics at Qualcomm (2006 – 2014)
• Managed one of the largest Qlik deployments: 10k users, 3k apps, 500
developers
• 15 Years of Analytics & BI Experience
• CEO & Founder of Analytica Consulting
• Qlik Luminary 2016 - Present
• Multiple Publications within InformationWeek, CNN, Investors
Business Daily, etc.

4. About Analytica Consulting
• Experts in data visualization, analytics, and data mining
• Based in California
• Over 10 years of expertise in many technology platforms
• Partner of Qlik, Tableau and Splunk
• Clients include UCSD Health System, California Department of Public
Health, Pacific Life, Sony, Hologic, illumina, DJO Global, Edwards
Lifesciences, etc.

5. What is Big Data?
Big Data Small Data

6. What is Splunk
• Indexes and makes data searchable
• Data must have a time stamp (i.e. event)
• Provides visibility, reporting and analytics
• Doesn’t lock you into a fixed schema
• Not a competitor to Qlik

7. Real Splunk Use-Case
• Semiconductor Engineering
– Electronic Design Automation (EDA) tool
usage
– 100’s of tools, 1000’s of engineers = A LOT
OF usage
– Captured usage every 5 minutes
– 50 billion+ records
• Insights:
– EDA License Utilization = BIG $$$ saving by
providing better license allocation
– Real-time view into who is working on what
= Better project management and resource
allocation

8. Splunk Strengths & Weaknesses
• Strengths:
– Large scale data index
– Very strong search interface
– Good basic visualization capabilities
• Weaknesses:
– Interactive visualization
• Requires advanced XML and coding
– Real-time slicing and dicing
• Every new “slice” = a new search
• Or build interactive dashboard using
their advanced XML = coding
– Specialized visualizations
• Requires use of other viz packages and
a lot of coding

9. So let’s put Qlik on top of it!

10. Qlik + Splunk Integration
• Method 1:
– Splunk ODBC connector
– Designed for Tableau + Excel only (Boo!!!)
– Works with Qlik with some hacking
– Supports only saved searches
– Performance is terrible
– Limited to non-clustered architecture

11. Qlik + Splunk Integration
• Method 2:
– Qlik web service connector
– Great for generic web services
– But not easy to use
– Doesn’t work well with direct data discovery
– Performance is ok, but not acceptable
– Security is tricky

12. Qlik + Splunk Integration
• Method 3 - Let’s Build a Connector!
– Natively connect to both platforms using their
APIs
– Stream data directly from Splunk into Qlik’s in-
memory model
– Saved searches & live searches
– Enterprise security
– Direct data discovery to allow Splunk to do heavy
lifting
– Supports clustered environment
– Partial reloads

13. Splunk + QlikView Connector

14. Splunk + QlikView Connector
Splunk search
string saved
directly in script
editor

15. Splunk + QlikSense Connector

16. Splunk + QlikSense Connector

17. Splunk + QlikSense Connector

18. Try it out!

19. More Questions?
• steverimar@analyticaconsulting.com
• http://www.analyticaconsulting.com