The document discusses Hazelcast architecture and configuration options. It provides an overview of Hazelcast data structures like maps, queues, locks and topics. It then details different serialization options in Hazelcast like Serializable, DataSerializable, Portable and pluggable serialization. It benchmarks the different serialization approaches by serializing a shopping cart object and finds that pluggable serialization using Kryo provides the best performance with read throughput of 60 ops/ms and size of 210 bytes. The presentation concludes with a Q&A session.

1. 1
Hazelcast Deep Dive

2. 2
Emrah Kocaman
Software Engineer @ Hazelcast
emrahkocaman
emrah@hazelcast.com

3. Hazelcast Architecture
Hazelcast Configuration Options
Hazelcast IMap Configuration Details
Hazelcast Clients
Hazelcast Serialization
Q/A Session
3
Agenda

4. Hazelcast Architecture
4
Map Set Queue
Lock/
Sem.
Atomics Topic User DefinedMultiMap
Ring
Buffer
Web Sessions
Java
C++ .NET
Portable Serialization /
Pluggable Serialization
Memcached REST
Internal Client
Network Protocol
java.util.concurrent.*javax.cache.*Hibernate 2nd Level Cache
Executor ServiceSQL Query Map / Reduce Aggregation
Low-level Services API
Node Engine
(Threads, Instances, Eventing, Wait/Notify, Invocation)
Partition Management
(Master Partition, Data Affinity, Replicas, Migrations, Partition Groups)
Cluster Management
(Multicast, IP List, AWS/OpenStack)
Networking
(IPv4, IPv6)
On-heap Storage
ManagementCenter
(API,JMX)
Security
(Connection,Encryption,Authentication,Authorization)
WAN
(TopologyAwarePartitionManagement,WANReplication)
Hazelcast Open Source Hazelcast Enterprise
Predicate Entry Processor
High-Density (HD) Memory Store
Continuous Query
HD Near Cache
Open Client
Network Protocol
Hot Restart Store*
* Coming in 3.6

5. Hazelcast Configuration
Options
5
XML Configuration
Programmatic configuration
Spring Configuration

6. XML Configuration
6

7. XML Configuration
7

8. XML Configuration
8

9. XML Configuration
9
`hazelcast.config` system property
Working directory
Classpath
Default from Hazelcast.jar

10. XML Configuration
10
ClasspathXmlConfig
FileSystemXmlConfig
InMemoryXmlConfig
UrlXmlConfig

11. Programmatic Configuration
11

12. Distributed Map
Configuration
12

13. Distributed Map
Configuration
13

14. 14
IT’S DEMO TIME

15. Hazelcast Clients
15
Same intuitive API
Similar configuration approach
SSL Support
Hazelcast Client Protocol
Java, C/C++, .NET, REST,
memcache

16. 16
IT’S DEMO TIME

17. Hazelcast Serialization
17
Map, Cache, Queue, Set, List
Executor Service
Entry Processors
Lock
Topic

18. Where it is used?
18
serialization + deserialization
serialization
serialization
serialization
serialization
deserialization

19. Optimised Types
19
Byte
Boolean
Character
Short
Integer
Long
Float
Double
byte[]
char[]
short[]
int[]
long[]
float[]
double[]
String
Date
BigInteger
BigDecimal
Class
Enum

20. Hazelcast Serialization
20
Serializable
DataSerializable
IdentifiedDataSerializable
Portable
Pluggable

21. Shopping Cart Item
21

22. Shopping Cart
22

23. Benchmark – 100,000 times
23
maxOrders = 100 * 1000
maxCartItem= 5

24. java.io.Serializable
24
Pros
Standard
Doesn’t require any implementation
Cons
Takes more time and cpu
Occupies more space

25. java.io.Serializable - Results
25
Read Performance
31 ops in ms
Write Performance
46 ops in ms
Binary object size
525 bytes

26. java.io.Externalizable
26
Pros
Standard
Efficient than Serializable in terms of CPU and Memory
Cons
Requires to implement the actual serialization

27. ShoppingCartItem -
implementation
27

28. ShoppingCart-
implementation
28

29. java.io.Externalizable -
Results
29
Read Performance
61 ops in ms
Write Performance
60 ops in ms
Binary object size
235 bytes

30. DataSerializable
30
Pros
Efficient than Serializable in terms of CPU and Memory
Cons
Hazelcast specific
Requires to implement the actual serialization
Uses Reflection while de-serializing

31. ShoppingCartItem -
implementation
31

32. ShoppingCart-
implementation
32

33. DataSerializable- Results
33
Read Performance
64 ops in ms
Write Performance
59 ops in ms
Binary object size
231 bytes

34. IdentifiedDataSerializable
34
Pros
Efficient than Serializable in terms of CPU and Memory
Doesn’t use Reflection while de-serializing
Cons
Hazelcast specific
Requires to implement the actual serialization
Requires to implement a Factory and configuration

35. ShoppingCartItem -
implementation
35

36. ShoppingCart-
implementation
36

37. IdentifiedDataSerializable – Factory Implementation
37

38. IdentifiedDataSerializable-
Results
38
Read Performance
68 ops in ms
Write Performance
60 ops in ms
Binary object size
186 bytes

39. Portable
39
Pros
Efficient than Serializable in terms of CPU and Memory
Doesn’t use Reflection while de-serializing
Supports versioning
Supports partial de-serialization during Queries
Cons
Hazelcast specific
Requires to implement the actual serialization
Requires to implement a Factory and Class Definition
Class definition is also sent together with Data but stored only
once per class

40. ShoppingCartItem -
implementation
40

41. ShoppingCart-
implementation
41

42. Portable – Factory
Implementation
42

43. Portable- Results
43
Read Performance
65 ops in ms
Write Performance
54 ops in ms
Binary object size
386 bytes

44. Pluggable – (ex: Kryo)
44
Pros
Doesn’t require class to implement an interface
Very convenient and flexible
Can be stream based or byte array based
Cons
Requires to implement the actual serialization
Requires to plug and configure

45. Stream and ByteArray
Serializers
45

46. ShoppingCartItem -
implementation
46

47. ShoppingCart-
implementation
47

48. ShoppingCart Kryo
StreamSerializer
48

49. Pluggable Serialization
Configuration
49

50. Kryo- Results
50
Read Performance
60 ops in ms
Write Performance
51 ops in ms
Binary object size
210 bytes

51. Compression
51
Compresses the data.
Can be applied to Serializable and Externalizable
only.
Very slow (~1000 times) and CPU consuming.
Can reduce 525 bytes to 26 bytes.

52. Summary
52
Serializable
R:31 ops/ms, W: 46 ops/ms, Size: 525 bytes
Externalizable
R:61 ops/ms, W: 60 ops/ms, Size: 235 bytes
DataSerializable
R:64 ops/ms, W: 59 ops/ms, Size: 231 bytes
IdentifiedDataSerializable
R:68 ops/ms, W: 60 ops/ms, Size: 186 bytes
Portable
R:65 ops/ms, W: 54 ops/ms, Size: 386 bytes
Kryo
R:60 ops/ms, W: 51 ops/ms, Size: 210 bytes

53. Thank you ! :)
emrah@hazelcast.com
53
any questions ?

54. 54
http://www.zenika.com/formation-hazelcast-essentials.html
30Th November - Free Training