An Easy way to build a server cluster without top of rack switches (MEMO)
12-Feb-2015
SAKURA Internet Research Center.
Senior Researcher / Naoto MATSUMOTO
2. Proof of Concept
Reduce top of rack switches costs
10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server
Top of Rack SW
Aggregation SW
Paper: How to build and manage a large scale switchless server clustering, Naoto MATSUMOTO,IOT28, 2015 /
The Special Interest Group on Internet and Operation Technology (SIG-IOT) / Information Processing Society of Japan.
3. How does it works
Using OSPFv3 Link-state advertisement for server clustering
Quagga or
another routing
daemons
4. How to build it (CentOS7)
# yum install -y quagga iptables-services
# nmcli con mod eth0 connection.autoconnect yes
# nmcli con mod eth1 connection.autoconnect yes
# nmcli con mod eth2 connection.autoconnect yes
# nmcli con mod eth3 connection.autoconnect yes
# echo "net.ipv6.conf.all.forwarding = 1" >> /etc/sysctl.conf
# cp -p /etc/quagga/zebra.conf /etc/quagga/ospf6d.conf
# setsebool -P zebra_write_config 1
# systemctl mask firewalld
# systemctl disable ip6tables
# systemctl enable ospf6d
# systemctl start ospf6d
# vtysh
# configure terminal
# router ospf6
# router-id 10.0.0.16
# redistribute connected
# area 0.0.0.0 range fd50:d026:7eee::/48
# interface eth0 area 0.0.0.0
# interface eth1 area 0.0.0.0
# interface eth2 area 0.0.0.0
# interface eth3 area 0.0.0.0
# interface lo
# ipv6 address fd50:d026:7eee:16::16/64
# end
# write
# quit
# reboot
Routing daemon setup
OSPFv3 configuration
10. Conclusion
"An Easy way to build a server cluster
without top of rack Switches" is ...
- Reduce top of rack switches & cables costs.
- Lightweight and simple configuration.
- High network durability.
- Good IPv4/IPv6 backward compatibility.