A presentation on NFS and some of the important patches for PNFS

1. Red Hat Enterprise Linux / NFS
Syed M Shaaf Klaus Oxdal
Solution Architect Partner and Alliances, Nordics
Red Hat Red Hat
1 Red Hat Enterprise Linux and NFS | Syed M Shaaf

2. WHAT WE DO
We offer a range of mission-critical software and services covering:
IaaS/PaaS MIDDLEWARE OPERATING SYSTEM
VIRTUALIZATION STORAGE
HOW WE DO IT.
We develop everything using
THE BENEFITS.
an OPEN SOURCE model.
Flexibility
Shared development reduces Faster technology innovation
costs & accelerates innovation.
Better quality
Open collaboration offers
products that genuinely meet Better price & performance
customers' requirements.
Alignment to your needs
2 Red Hat Enterprise Linux and NFS | Syed M Shaaf

3. PRODUCT PROCESS
PARTICIPATE 100,000+
PROJECTS We participate in & create upstream
projects.
We build & support open communities
around integrated projects.
INTEGRATE
We enable software & hardware
partners to participate at every stage
of development.
STABILIZE We commercialize these
innovations together with a rich
ecosystem of services & certifications.
3 Red Hat Enterprise Linux and NFS | Syed M Shaaf

4. OUR CUSTOMERS
The largest global exchange
on the planet. The largest global distribution
system in the world.
We are pleased to offer supported enterprise-class Red Hat
Enterprise Linux on demand for our customers. A leading enterprise cloud
computing vendor.
Wherever you live, it is likely that several letters that you Red Hat has impressed us with its
have received have been read, coded, and processed for outstanding engineering capabilities
delivery by one of our systems using JBoss Enterprise and commitment to our strategic
Application Platform as the middleware foundation. alliance.
4 Red Hat Enterprise Linux and NFS | Syed M Shaaf

5. Red Hat Enterprise Linux
5 Red Hat Enterprise Linux and NFS | Syed M Shaaf

6. RED HAT ENTERPRISE LINUX 6
SCALABILITY
6 Red Hat Enterprise Linux and NFS | Syed M Shaaf

7. RED HAT ENTERPRISE LINUX 6
SCALABILITY
7 Red Hat Enterprise Linux and NFS | Syed M Shaaf

8. RED HAT ENTERPRISE LINUX 6
SCALABILITY
8 Red Hat Enterprise Linux and NFS | Syed M Shaaf

9. RED HAT ENTERPRISE LINUX 6
COMMUNITY LEADERSHIP
9 Red Hat Enterprise Linux and NFS | Syed M Shaaf

10. NFS
10 Red Hat Enterprise Linux and NFS | Syed M Shaaf

11. NFS V4
● NFS version 3 most used! Why Change it??
Performance!
● Version 4 is now the default protocol version for
RHEL6
● IETF: RFC3530: http://tools.ietf.org/html/rfc3530
11 Red Hat Enterprise Linux and NFS | Syed M Shaaf

12. NFS Version 4.0 – Noteworthy features
● Version 4 is a Stateful Protocol.
● Delegations
● Mandated Security
● Referrals
● Firewall Friendly (kinda!)
12 Red Hat Enterprise Linux and NFS | Syed M Shaaf

13. NFS version 4 – Gotchas!
● “All My files are owned by NOBODY!!!”
● Idmapping: steved@redhat.com ==> 3606
● DNS problem 90% of the time
● 'Domain=' in /etc/idmapd.conf
● Mounting Legacy servers.
● Mount negotiation start at v4
● For Legacy server use /etc/nfsmount.conf mount
negotiation
13 Red Hat Enterprise Linux and NFS | Syed M Shaaf

14. NFS version 4.1
● Sessions
● Session IDs
● Parallel NFS (pNFS)
● File Layout (NAS environment) - Netapp
● Block Layout
● Object Layout
● IETF: RFC5661
● http://tools.ietf.org/html/rfc5661
14 Red Hat Enterprise Linux and NFS | Syed M Shaaf

15. NFS version 4.1 in RHEL
● RHEL6 Client
● Tech Preview in 6.2
● pNFS: File layouts only
● RHEL7 Client
● All layouts supported.
15 Red Hat Enterprise Linux and NFS | Syed M Shaaf

16. NFS version 4.1 – Make it work!
● Enabling 4.1/pNFS on the client
● mount -o minorversion=1
● Does the server support pNFS
● nfs4filelayout_init: NFSv4 File Layout Driver
Registering..
● “pnfs=<layout>” in /proc/self/mountstats
16 Red Hat Enterprise Linux and NFS | Syed M Shaaf

17. NFS version 4.2
● Labeled NFS
● Security contexts
● Server to Server Copy
● offload to server copy operation
● Sparse Files
● IETF: Internet-Draft
● http://tools.ietf.org/html/draft-ietf-nfsv4-minorversion2-11
17 Red Hat Enterprise Linux and NFS | Syed M Shaaf

18. 6.4 and some important
changes
18 Red Hat Enterprise Linux and NFS | Syed M Shaaf

19. Operating system - IO
Operating System ( Kernel )
2:
1:
Buffers and Cache
Storage
Data
3:
Application
Data
Application
Cache/Buffer Pool
Data
19 Red Hat Enterprise Linux and NFS | Syed M Shaaf

20. Operating system – Direct IO
Operating System ( Kernel )
2:
1:
Buffers and Cache
Storage
Data
Application
Data
Application
Cache/Buffer Pool
Data
20 Red Hat Enterprise Linux and NFS | Syed M Shaaf

21. Direct IO with PNFS, is it useful?
● O_DIRECT patches into pnfs
● Access the storage directly. Why?
● Databases are a good candidate, when?
● All operations are done in block size multiples
21 Red Hat Enterprise Linux and NFS | Syed M Shaaf

22. RED HAT ENTERPRISE LINUX 6
Slots and TCP window size
● Allow the number of available slots to grow with the
TCP window size.
● RHEL 6.3 dynamically allocates RPC slots up to the
sunrpc.tcp_max_slot_table_entries ( 65536)
● Previously the number of in-flight RPC requests was
limited to 128 (default 16). This affected the
performance of OLTP workloads when using the kernel
based NFS client.
● NFS 4.1 max session slots is set with the boot
parameter:
nfs.max_session_slots (do not set higher than above)
22 Red Hat Enterprise Linux and NFS | Syed M Shaaf

23. References
● Steve Dickson
● http://people.redhat.com/steved/Summits/
● NFSv4.1 new features: Sessions, Parallel NFS (pNFS)
● http://www.iaps.com/nfsv4.1-new-features.html
● Parallel NFS (pNFS)
● http://www.pnfs.com/
23 Red Hat Enterprise Linux and NFS | Syed M Shaaf

24. Thank you!
Syed M Shaaf Klaus Oxdal
Solution Architect Partner and Alliances, Nordics
Red Hat Red Hat
24 Red Hat Enterprise Linux and NFS | Syed M Shaaf