discussion on shared storage for the rest of us

1. shared storage for the rest of us
scott boss
Southeast Linuxfest 2010
june 11-13, 2010
Wednesday, January 2, 13 1

2. identity theft information
scott boss
email: scott@sboss.net
twitter: the_sboss
Wednesday, January 2, 13 2

3. SURPRISE!
A raffle for gifts from O’Reilly
Publishing will be at the end
of the presentation.
Wednesday, January 2, 13 3

4. target audience
small to medium sized businesses
families / homes
workgroups
geeks*
Wednesday, January 2, 13 4

5. why do we want shared storage?
to share files between computers / people
shared storage for clustered servers
it’s cool
why not?
to make our customers happy.
Wednesday, January 2, 13 5

6. options
local storage
SAN
NAS
cloud storage
Wednesday, January 2, 13 6

7. local disks
internal disks (IDE/
SATA)
~$50-$150 each
limited number on a
host.
Wednesday, January 2, 13 7

8. external drives
usb* (external) disks
~$90-$250 each
limited number on a
host.
Wednesday, January 2, 13 8

9. “thumb” drives
very portable
small amounts of
storage
easy to move files
around
not shared storage
Wednesday, January 2, 13 9

10. local storage summary
PROs CONs
low costs can’t share the disks
between the hosts*
limited number of internal
disks.
usb can be slow if you
have lots of usb devices.
limited protection.
Wednesday, January 2, 13 10

11. options
local storage
SAN
NAS
cloud storage
Wednesday, January 2, 13 11

12. HBAs
HBA (host bus adapter)
$900-$1500 each
HBA is a specialized
SCSI controller
Wednesday, January 2, 13 12

13. san switches & cabling
san fibre switches
$10k-$250k each
fibre fiber cables
$90-$200 each
Wednesday, January 2, 13 13

14. san storage array
high speed
highly redundant
expensive per GB of
storage
$40k-$millions
Wednesday, January 2, 13 14

15. san summary
PROs CONs
high speed large costs / GB
highly redundant additional dedicated
multiple hosts can share hardware is required to
the same disks. use it.
Wednesday, January 2, 13 15

16. options
local storage
SAN
NAS
cloud storage
Wednesday, January 2, 13 16

17. NAS protocols
NFS
CIFS
AFP (AFPoverTCP)
iSCSI
AoE
Wednesday, January 2, 13 17

18. NFS
native with all UN*Xes, Linux and MacOSX
Windows can do it with UNIX Services for NT package.
second best performance of the bunch.
Wednesday, January 2, 13 18

19. CIFS
native with all Windows and MacOSX
UN*X, Linux can do it with Samba package.
worst performance of the bunch.
Wednesday, January 2, 13 19

20. AFP (AFPoverTCP)
native with MacOSX
linux can do it with Netatalk package.
best performance of the bunch.
Wednesday, January 2, 13 20

21. iSCSI
block storage (like internal/SAN storage)
can have any filesystem.
needs an iSCSI initiator.
slower speeds that local storage.
Wednesday, January 2, 13 21

22. AoE
block storage (like internal/SAN storage)
can have any filesystem.
although over the network, does not use TCP/IP.
can not be routed.
least amount of support of the NAS protocols.
Wednesday, January 2, 13 22

23. FCoE
block storage (like internal/SAN storage)
can have any filesystem.
works with Lossless Ethernet.
must be used with a CNA.
not finalized standard yet.
Wednesday, January 2, 13 23

24. hardware/software options
Wednesday, January 2, 13 24

25. NAS appliance (low end)
many low end players
$350+
basic NAS features
web admin interface
Wednesday, January 2, 13 25

26. NAS appliance (high end)
EMC and NetApp are
the big players
$100k-$500k
many advanced
features
replication
dedup
backup connections
Wednesday, January 2, 13 26

27. homemade NAS server
most configurable
any O/S can be used
within reason.
can be a virtual
machine
can use an existing
host.
Wednesday, January 2, 13 27

28. homemade NAS appliance
preconfigured O/S
already tweaked to be
a NAS appliance
can be a virtual
machine
can use an existing
hardware.
Wednesday, January 2, 13 28

29. time to install FreeNAS
Wednesday, January 2, 13 29

30. Wednesday, January 2, 13 30

31. basic configurations
hostname
disk management
network
services
Wednesday, January 2, 13 31

32. Wednesday, January 2, 13 32

33. make a share
create a mountpoint
CIFS share
NFS share
AFP share
Wednesday, January 2, 13 33

34. Wednesday, January 2, 13 34

35. using the share
Windows via CIFS
Linux vis NFS
MacOSX via AFP
Wednesday, January 2, 13 35

36. Wednesday, January 2, 13 36

37. using the share
Windows via CIFS
Linux vis NFS
MacOSX via AFP
Wednesday, January 2, 13 37

38. Wednesday, January 2, 13 38

39. using the share
Windows via CIFS
Linux vis NFS
MacOSX via AFP
Wednesday, January 2, 13 39

40. Wednesday, January 2, 13 40

41. NAS summary
PROs CONs
low cost speed
no special hardware/ not a block device (NFS,
software on clients CIFS, AFP)
Wednesday, January 2, 13 41

42. options
local storage
SAN
NAS
cloud storage
Wednesday, January 2, 13 42

43. cloud storage
network based
low cost
accessible via standard
protocols like HTTP,
FTP, NFS & REST APIs.
good for backups
Wednesday, January 2, 13 43

44. cloud storage (public)
Amazon S3
Rackspace Cloud
Space
Mozy (EMC)*
Wednesday, January 2, 13 44

45. cloud storage (public II)
Jungle Disk
Carbonite
ElephantDrive
Wednesday, January 2, 13 45

46. cloud storage (private)
ParaScale
Mezeo
Atmos (EMC)
Wednesday, January 2, 13 46

47. cloud storage summary
PROs CONs
low cost speed
no special hardware/ not a block device
software on clients limited use cases.
locally and maybe
geographically
redundant.
Wednesday, January 2, 13 47

48. what is the best storage
solution for you?
it will all depend...
Wednesday, January 2, 13 48

49. </presentation>
Wednesday, January 2, 13 49

50. Time for the Raffle
have three (3) “ebooks” to give away from
O’Reilly Publishing.
Wednesday, January 2, 13 50

51. questions?
Wednesday, January 2, 13 51