Liferay 6.1 and solr 4 in cluster

1. Installing Liferay 6.1 and SOLR 4 in cluster
Israel Olalla
@iolalla

2. Looking for inspiration
“Only a life lived for others is a life worthwhile.”
Albert Einstein
2

3. What we want to get?
•Index and search all the content from Liferay
•No single point of failure
•Simple to manage: simple to add new machines, stop one and add
one to the cluster
•As cheap as possible: No Expensive HW or software to control the
cluster.
•Manage index and configuration with the same system
3

4. OLD Liferay Reference Architecture
4

5. New Liferay Reference Architecture
5

6. Configuring Zookeeper and SOLR
1. Configure the zookeeper cluster: http://zookeeper.apache.org/
6

7. Configuring Zookeeper and SOLR
1. Configure the zookeeper cluster: http://zookeeper.apache.org/
2. Adapt solrconfig.xml to the new replication scenario
7

8. Configuring Zookeeper and SOLR
1. Configure the zookeeper cluster: http://zookeeper.apache.org/
2. Adapt solrconfig.xml to the new replication scenario
3. Adapt schema.xml to support Liferay
8

9. Configuring Zookeeper and SOLR
1. Configure the zookeeper cluster: http://zookeeper.apache.org/
2. Adapt solrconfig.xml to the new replication scenario
3. Adapt schema.xml to support Liferay
4. Configure Tomcat to connect to the zookeeper cluster
5. Start the zookeeper cluster
9

10. Configuring Zookeeper and SOLR
1. Configure the zookeeper cluster: http://zookeeper.apache.org/
2. Adapt solrconfig.xml to the new replication scenario
3. Adapt schema.xml to support Liferay
4. Configure Tomcat to connect to the zookeeper cluster
10

11. Configuring Zookeeper and SOLR
1. Configure the zookeeper cluster: http://zookeeper.apache.org/
2. Adapt solrconfig.xml to the new replication scenario
3. Adapt schema.xml to support Liferay
4. Configure Tomcat to connect to the zookeeper cluster
5. Start the zookeeper cluster
11

12. Configuring Zookeeper and SOLR
1. Configure the zookeeper cluster: http://zookeeper.apache.org/
2. Adapt solrconfig.xml to the new replication scenario
3. Adapt schema.xml to support Liferay
4. Configure Tomcat to connect to the zookeeper cluster
5. Start the zookeeper cluster
6. Start the SOLR Cluster
12

13. Configuring Zookeeper and SOLR
13

14. Configuring Liferay
1. Choose the right solr-web plugin, yes the one that supports zookeeper
14

15. Configuring Liferay
1. Choose the right solr-web plugin, yes the one that supports zookeeper
2. Configure the solr-spring.xml to point to the zookeeper cluster
15

16. Configuring Liferay
1. Choose the right solr-web plugin, yes the one that supports zookeeper
2. Configure the solr-spring.xml to point to the zookeeper cluster
3. Start the liferay cluster.
16

17. Where we can get it?
•At the writing of this presentation, the plugin to
work with zookeeper is not integrated yet with the
liferay plugins head maybe in the future will end
there but know you have to use this fork:
https://github.com/iolalla/liferay-
plugins/tree/master/webs/solr-web
•If you want to find more instructions to
compile/modify the code or just the final
war, please read this post:
http://israelolalla.blogspot.com.es/2012/11/liferay-
61-solr-4-zookeeper-massive.html
17

18. Summary
Pros:
•Architecture is 100% active, all machines are candidates
for Master, in the index or search process.
•100% shared nothing architecture, no need for network
shares, NFS, etc..
•We can manage the configuration files centrally.
•Architecture that is self Multi Master, ie if the Master
fall, cluster itself choose the new Master.
•Very efficient replication copies files and indices.
Cons:
•There is a bit more RAM and CPU consumption by the
new process.
18

19. Where we are?
Contact with iSOCO
Want to innovate?
Barcelona Madrid Pamplona Valencia
Tel +34 935 677 200 Tel +34 913 349 797 Tel +34 948 102 408 Tel +34 963 467 143
Av. Torre Blanca, 57 Av. del Partenón, 16-18, 1º7ª Parque Tomás Oficina 107
Edificio ESADE CREAPOLIS Campo de las Naciones Caballero, 2, 6º4ª C/ Prof. Beltrán Báguena, 4
Oficina 3C 15 28042 Madrid 31006 Pamplona 46009 Valencia
08172 Sant Cugat del Vallès
Barcelona
19