Slide deck of talk by @abperiasamy @fosdem2016

1. Userspace Linux I/O
towards Petascale Storage
Anand Babu (AB) Periasamy
@abperiasamy

2. What is this talk not
about?

3. Userspace is not SLOW!
❏GlusterFS demonstrates 2 GB/s per node
❏DPDK shows 35.2 Mpps on Xeon E5465
❏Linux Kernel at 12.2 Mpps on Xeon E5465
❏DPDK at 80 Mpps on Xeon E2600

4. User Space Storage Systems
❏Filesystems
❏GlusterFS, Hadoop HDFS, NFS-Ganesha, uNFS
❏ Block Storage
❏ NBD, LIO/TCM, scst, tgt, DRBD
❏Object Storage

5. Languages
❏C - GlusterFS
❏Python - OpenStack Swift
❏Java - Hadoop HDFS
❏Golang - Minio

6. Interface to Kernel
❏FUSE, CUSE, UIO, libusb
❏Intel DPDK / SPDK
❏Mellanox libvma
❏Standard libc (POSIX)

8. Common Pitfalls
❏Grand Unified System
❏Massively Scalable
❏Performance focussed
❏Complex Algorithms
❏Intelligent Self-managing

9. Filesystem
❏NFS-Ganesha vs Custom RPC
❏kernel NFS Client, libnfs, FUSE, LD_PRELOAD
NFS
Passive
NFS
Active
NFS
Passive
Eventually
Consistent
Eventually
Consistent
Active I/O

10. Block Storage
❏NBD vs tgt
❏Log-structured
D D D D
P P P P
Intel ISA-L Erasure Code
DPDK + NBD | tgt

11. Object Storage
❏No more POSIX. Kernel free!
❏Certificate based trust (Let’s Encrypt)
❏Free to choose any language
❏Stick to Amazon S3 APIs
❏HTTP is the new TCP/IP

12. Cache
❏Tachyon Project
❏Memcached
❏Varnish, Squid
❏Redis
❏Opportunity for a new project:

13. Questions..
@abperiasamy