In this 'In the brain' session speaker Daniel Sikar talks on the topic titled 'Running Coherence Clustered Cache on Amazon EC2'

1. Running Coherence Clustered Cache
on Amazon EC2
In The Brain of Daniel Sikar
Skills Matter, London, UK
09.11.2010

2. Skills Matter supports the Agile and Open Source
developer community, by organising free events,
training courses, conferences and by publishing
thousands of podcasts on ideas and technologies
that drive innovation.
116-120 Goswell Road, London, EC1V 7DP
Tel: +44 (0)207 183 9040
info@skillsmatter.com
Welcome to Skills Matter

3. Daniel Sikar
Consultant
Developer
Trainer
Internet & scientific data acquisition applications
Delivers AWS, Oracle Coherence
and Hadoop courses
at Skills Matter
dsikar@gmail.com

4. Running Coherence Clustered Cache
on Amazon EC2

6. Why use AWS?
Other PAAS infrastructures:
● GoGrid
● Rackspace Cloud
● Eucalyptus
● PlanetLab
● OpenCirrus
● SARA

7. EC2 Environment - abridged
Regions
Instances
AMIs
Security Groups

8. Regions
AP-SOUTHEAST-1
Availability zones: ap-southeast-{1a, 1b}
EU-WEST-1
Availability zones: eu-west-{1a, 1b}
US-EAST-1
Availability zones: us-east-{1a, 1b, 1c, 1d}
US-WEST-1
Availability zones: us-west-{1a, 1b}

9. EC2 Environment - abridged
INSTANCES = Running virtual machines
AMIs = Virtual machine images
SECURITY GROUPS = Firewall configurations

10. Amazon Machine Image (AMI)

11. $ ec2-run-instances (...)
ec2-api-tools

14. $ env
$ cd bin
$ ls
$ ec2-describe-instances
$ ec2-describe-images
ec2-api-tools

15. AWS Public Images - 31.01.2010
REGIONS
● EU-West 1207
● US-East 4521
● US-West 343
Public AMIs
0
500
1000
1500
2000
2500
3000
3500
4000
4500
5000
eu-w est
us-east
us-w est

16. AWS Public Images - 31.01.2010
Operating Systems
● Flavours of Unix 5707
● Windows 364
Public AMIs
0
1000
2000
3000
4000
5000
6000
*nix
Window s

17. AWS Public Images - 31.01.2010
Architecture
● i386 4560
● x86_64 1511
Public AMIs
0
500
1000
1500
2000
2500
3000
3500
4000
4500
5000
i386
x86_64

18. Public AMIs Region/OS/Architecture
eu-w est us-east us-w est
0
500
1000
1500
2000
2500
3000
3500
4000
L32
L64
W32
W64

19. EU-WEST Top 5 Public AMI Owners
● JumpBox 204
● Alestic 198
● Canonical 177
● Amazon 161
● BitNami 60
Public AMI Ow ners
0
50
100
150
200
250
JumpBox
Alestic
Canonical
Amazon
BitNami

20. US-EAST Top 5 Public AMI Owners
● rPath 776
● JumpBox 588
● Alestic 363
● Canonical 319
● Amazon 169
Public AMI Ow ners
0
100
200
300
400
500
600
700
800
900
rPath
JumpBox
Alestic
Canonical
Amazon

21. US-WEST Top 5 Public AMI Owners
● Canonical 100
● Amazon 79
● Alestic 53
● Right Scale 14
● Debian Zone 13
Public AMI Ow ners
0
20
40
60
80
100
120
Canonical
Amazon
Alestic
Right Scale
Debian Zone

22. Public AMIs
$ ec2dim -a > amis.txt
$ cat amis.txt | grep moodle
$ ping <public dns>
$ c:<...>putty.exe

23. Public AMIs
TURNKEY SOLUTIONS

25. Why use caching?
Share objects across servers
Lower response time
Increase throughput
Increase availability
Distributed/parallel processing
Failover

26. Design Patterns

27. ● JSR-107 JCACHE – Java Temporary Caching
API (2001)
● Tangosol (2000 - 2007)
● Oracle Coherence (2007 - 2010)
Coherence timeline

28. Coherence Key Concepts
● Clustering
● Availability
● Reliability
● Scalability

29. Coherence Key Concepts
● Partitioning
● Replication
● Near Caching

30. Coherence Key Concepts
● CacheStore
● Write-Behind
● Refresh-Ahead
● Write-Through
● Read-Through

31. Coherence Networking Protocols
Coherence uses TCMP, a combination of:
● Multicast
● Unicast
● TCP

32. WKA
Well-Known-Addresses
Used in environments where multicast is not
allowed or not suitable.

33. WKA Configuration
Command line:
-Dtangosol.coherence.wka=<ip address>
-Dtangosol.coherence.wka.port=<port number>

34. WKA Configuration
Configuration file:
<?xml version='1.0'?>
<!DOCTYPE coherence SYSTEM "coherence.dtd">
<coherence xml-override="/tangosol-coherence-override.xml">
<well-known-addresses>
<socket-address id="1">
<address>10.228.22.128</address>
<port>8088</port>
</socket-address>
<socket-address id="2">
<address>10.228.79.164</address>
<port>8088</port>
</socket-address>
</well-known-addresses>
</coherence>

35. EC2AddressProvider
Looks for instances with assigned Elastic IP

36. EC2AddressProvider
Method Summary
accept()
determineCredentials()
generateWKAList(...)
getNextAddress
reject(Throwable exception)

37. EC2AddressProvider
Authentication of EC2 calls:
Java system properties:
● tangosol.coherence.ec2addressprovider.accesskey=<access key>
● tangosol.coherence.ec2addressprovider.secretkey=<secret key>
Embedded properties file:
● accessKey=<access key>
● secretKey=<secret key>

38. EC2AddressProvider
Libraries:
● AWS SDK for Java
● Coherence
● Coherence Common (Incubator) – class
com.oracle.coherence.cloud.amazon.EC2AddressProvider

39. Coherence Clustered Cache
+
EC2
=
Running Coherence on virtual machines

40. Windows EC2 Instance
Configuration
$ ec2auth default -P icmp -t -1:-1
+ Firewall (switch off instance firewall)

41. Accessing a Windows EC2 Instance running
Coherence Clustered Caching
Access

42. $ ec2-describe-addresses
$ mstsc
Access

43. # start cache server
$ cache-server.cmd
# start clients
$ coherence.cmd
# run
# help, cache, put, assert
# maps, list, lock, unlock, delete
Basic Cache Operations

44. Conclusion
Setting up and running
Coherence Clustered Cache is simple on
PAAS environments
such as Amazon EC2

45. Questions?

46. Coming up next Nov-Dec 2010:
AWS EC2 S3 Workshop - 1 day
15.11.2010
Coherence Clustered Caching - 2 days
16.12.2010
Coherence Clustered Caching - 2 days
13.12.2010
Introduction to Hadoop - 2 days
20.12.2010
Skills Matter – London, UK

47. Thank you for attending!
Running Coherence Clustered Cache
on Amazon EC2
In The Brain of Daniel Sikar
Skills Matter, London, UK
09.11.2010