July NY Enterprise Technology Meetup http://www.meetup.com/ny-enterprise-tech/events/69794792/

1. Real-Time Big Data Analytics
Shay Hassidim, Deputy CTO
Shay@gigaspaces.com

2. ABOUT MYSELF – SHAY HASSIDIM
 GigaSpaces US CTO
 More than 20 years of SW development
 Java , .Net , C++ , you name it…
 Almost 10 years with GigaSpaces
 From the time we have been startup at the garage…
 Oversight the entire technical operations within the Americas
 Located in GigaSpaces NY HQ
2

3. GIGASPACES BUSINESS CARD
Healthcare
300+ Direct Customers 75+ Cloud Customers
40+ Fortune 500 + Organization 25+ ISVs
Founded 2000
3

4. CUSTOMERS SAMPLES
• Credit risk / pricing systems
• Credit card services
• Trading (equities / energy / fixed income / forex/high
frequency) systems
• Cloud/Virtualization Platforms
• User web portal systems
• Market Data systems
• Reconciliation systems
4

5. GIGASPACES PRODUCT EVOLUTION
FROM DATA, TO APPLICATION, TO VIRTUAL DATA CENTER
PaaS
Enablement:
Application • Run & manage
Cloud multiple apps, of
End to End Enablement: any kind, on
Application • Run your XAP
private & public
Data Scaling Scaling clouds
app on private &
• Scale your • Scale your entire public clouds
application’s application:
data tier web, BL, data, m
essaging
5

6. WHAT ARE OUR CHALLENGES?
Real-Time Big Data Analytics
6

7. SPEED
7

8. SCALABILITY
8

9. SIMPLE
9

10. THE DEMO
What are the most popular
words on Twitter ?
10

11. WHAT ARE THE MOST 3 POPULAR WORDS ON TWITTER ?
Just
Found
Love
11

12. TWITTER REAL-TIME ANALYTICS ENGINE
 300 million tweets/day
 On avg - 8,000 tweets/sec
 On peak - 25,000 tweets/sec
 Scale linearly
 Elastic
 Facebook gets 100 billion hits per
day
12

13. ARCHITECTURE HOT SPOTS
CPU bottleneck
Network bottleneck
Counters contention
Database bottleneck
13

14. REAL-TIME FLOW
14

15. NO HOT SPOTS….
No CPU bottleneck
No Network bottleneck
No Counters contention
No Database bottleneck
15

16. SOLUTION FEATURES
• Light Event Processing
• Map-reduce
• Event-driven
• Execute code with data
• Transactional
• Schema-less
• Secured
• Elastic
• Asynchronous persistence to big data store
16

17. Shay Hassidim – CTO, USA Norm Leitman – Sales Engineer
shay@gigaspaces.com nleitman@gigaspaces.com
17
917-723-1415 732-672-2707