Webcast Presentation - ClearCase Deployments: New upgrading flexibility to ClearCase v8.x makes life easier and other strategies

Join the Community
www.rational-ug.org
Tweet with Us @RationalUC #rationaluc
www.twitter.com/rationaluc
Join Our Group on LinkedIn: Global Rational User Community
https://www.linkedin.com/groups/Global-Rational-User-Community-GRUC-120486/about
Connect with Us on Google+
https://plus.google.com/+RationalugOrgGlobal/posts

© 2013 IBM Corporation
ClearCase Deployments: New upgrading
flexibility to ClearCase v8.x makes life
easier and other strategies
Mike Donati, Performance Engineer
IBM Software, Rational
17 April 2014

Accelerating Product and Service Innovation | Rational
22
Please note the following
IBM’s statements regarding its plans, directions, and intent are subject to change or
withdrawal without notice at IBM’s sole discretion.
Information regarding potential future products is intended to outline our general product
direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment,
promise, or legal obligation to deliver any material, code or functionality. Information
about potential future products may not be incorporated into any contract. The
development, release, and timing of any future features or functionality described for our
products remains at our sole discretion.
Performance is based on measurements and projections using standard IBM
benchmarks in a controlled environment. The actual throughput or performance that any
user will experience will vary depending upon many factors, including considerations
such as the amount of multiprogramming in the user’s job stream, the I/O configuration,
the storage configuration, and the workload processed. Therefore, no assurance can be
given that an individual user will achieve results similar to those stated here.

33
Agenda
 Current releases – 7.1.x, 8.0, 8.0.1
– 7.1.x End of Support
– 8.0 Performance Enhancements
– 8.0 Schema Upgrade
– 8.0 CTE
– 8.0.1 - ClearCase Security: Role-based Granular Access Control Lists
– Fixpacks
 Upgrading ClearCase systems
– Client
– CCRC server
– VOB server
 How to prepare for ClearCase Deployment changes

4
7.1 – End of Support
 Reaching the end of the normal 5 year support lifecycle
 Announced in April that End Of Support is September 30, 2014
 3 year extension available for additional cost
 Intend to release last fixpack for 7.1.2 in Q1 2014
 Reserve the option to address high-priority APARs as necessary in testfixes
 Please plan your upgrade
4

5
Overview of IBM Rational ClearCase and ClearQuest
Upgrade Assistance Program
Objective: Proactive Support engagement to assist our ClearCase and ClearQuest
clients with upgrade planning and technical assistance during their upgrade
 Identify/contact clients who are in the process of planning a ClearCase and/or
ClearQuest upgrade in 2014
 Dedicate a Support resource to be available to assist with any issues that arise
during the upgrade
 Leading up to scheduled upgrade, hold periodic meetings with client and
Support resource to:
– Understand/document upgrade plans/challenges/environment
– Provide relevant content to assist with upgrade preparation
– Identify key contacts who will be performing the upgrade
 This program is available at no additional cost
 Please contact Leigh Haith (lhaith@us.ibm.com) or Barbara Smith
(barbs @us.ibm.com) if interested in participating in this program
5

6
8.0 – ClearCase Performance
 CCRC Web load performance improved as much as 40% with multi-threading
 Base ClearCase performance improved as much as 20%
 UCM performance improved as much as 30%, much greater for certain operations
 ClearCase evil-twin protection is built-in, 10 – 100x improvement over triggers
6
201320122011 2013 Q1 Future

7
8.0 – ClearCase Schema Upgrade (optional)
 Minimum for 8.0: Schema 54, Feature Level 3
 New Schema 80
 New Feature Level 7, turns on…
– UCM performance enhancements
– Built-in evil twin detection and prevention
– Bi-directional Rational Team Concert integration links
– Predefined element types
 Easier to upgrade
– One VOB at a time
– Schema upgrade is time consuming, Feature Level 7 upgrade is fast.
– VOB family feature level upgrade must be done simultaneously across sites
 Ready for new functionality in 8.0.1
 http://www-01.ibm.com/support/docview.wss?uid=swg27023578&aid=1
7
201320122011 2013 Q1 Future

8
8.0 – ClearTeam Explorer
 A Unified ClearCase Client
• Rich User Interface
• Supports multiple platforms
• Supports LAN and WAN view types
• Dynamic & Web Views
 Provides First Class Integrations
• Inbuilt ClearQuest Integration
• Inbuilt Jazz Platform Integration
 Easily Consumable
• Less than 100MB extension install
•Web View Cmd Line
• rcleartool
8
Easy to install. Easy to use. Highly Productive
“It’s a developer’s delight…”
201320122011 2013 Q1 Future

9

10

11
ClearCase CCRC 7.1.2.3 vs 8.0.0.2 with WAS 8

12
WAN Simulation Tests (1)
WAN
500 – 750 Miles, Boston to Raleigh: 30ms latency, 100Mbps bandwidth
1500 – 1750 Miles, Boston to Dallas: 60ms, 10Mbps
3000 – 3500 Miles, Boston to Los Angeles or to London, UK: 100ms, 10Mbps
LAN
<1 Mile, Local campus: 0.5ms, 100Mbps
Boston
Raleigh
DallasLos Angeles
Web View Load 435MB on Windows
7.1.2.3 vs. 8.0.0.0 Simulating different WANs
0
2
4
6
8
10
12
14
16
18
20
0.5ms 100Mbps 30ms 100Mbps 60ms 10Mbps 100ms 10Mbps
Latency / Bandwidth
Responsetime(minutes)
7.1.2.3
8.0.0.0

13
WAN Simulation Tests (2)
Web View Load 435MB, 8.0.0.0
(simulated LAN: 0.5ms 100Mbps)
0 1 2 3 4 5 6
windows
linux
sparc
platform
Response time (minutes)
7.1.2.3
8.0.0.0
(simulated WAN: 100ms, 10Mbps)
0 2 4 6 8 10 12 14 16 18 20
windows
linux
sparc
platform
7.1.2.3
8.0.0.0
0 2 4 6 8 10 12 14
windows
linux
sparc
platform
7.1.2.3
8.0.0.0
0 2 4 6 8 10
windows
linux
sparc
platform
7.1.2.3
8.0.0.0

14
Evil twin prevention performance gains
 Test case 1: directory (db) with 505 versions
– Evil twin trigger 1: 3.2 minutes, Evil twin trigger 2: 10 seconds, Built in detection: 1.3 seconds
 Test case 2: directory (vob) with 1069 versions
– Evil twin trigger 1: 6 minutes, Evil twin trigger 2: 16 seconds, Build in detection: 1.5 seconds
ClearCase Evil Twin Trigger vs Builtin Schema 80
1 10 100 1000
505
1069
Directoryversions
Time in seconds (logarithmic)
Schema 80 (builtin)
Trigger 2
Trigger 1

1515
ReformatVOB time estimates
 Linux Server - xSeries 3650, RHEL 5.8, 2 x Intel Xeon 5160 @ 3.00GHz (dual core), 16GB
 Linux Client - xSeries 345, RHEL 5.3, Intel Xeon @ 2.66GHz (dual core), 4GB
 Windows Server - xSeries 366, Windows 2008R2, 4 x Intel Xenon @ 3.67Ghz(dual core), 8GB
 Storage – Same for all configurations - NetApp 3170 with 15K SAS drives
 Conclusion – each site should run tests to find approximate timings for their configuration
– UCM project VOBs are slower, VOBs with large DO pools run a bit faster
reformatvob timings
0
50
100
150
200
250
300
linux server 1Gb linux server
iSCSI
linux client
100Mb
linux client 1Gb Windows server
1Gb
MBperminute
Fastest
Average
Slowest

16
8.0.1 – ClearTeam Explorer Enhancements
 Version Tree enhancements
– Support multiple instances of the Version Tree view
– Copy/Send to version retains the original element name
– Copy version extended pathname
– Show whole label type
– Sort labels by apply time
– Copy labels
 Logical Model support
– Preference to disable for checkin and undo checkout
– Display Logical Model element name in dialogs
– Annotation to reflect partial selection of model elements
– Performance improvements for large models
– Better action enablement for models with mixed state
– Preferences to customize ClearCase operations on models
 Headless build and project set import support
16
201320122011 2013 Q1 Future
 Usability
– Address Bar support for activity selector to find change set
– Create View/Join Project default to drive letter: {none}
– ClearCase Checkouts view (with Logical Model support)
– Join Project Wizard to load project components only
– Merge Search from a view
– Make Baseline from a list of activities
– Attribute Handling
– Non-modal Edit View Configuration dialog
– Automatic merge support on Checkin non-latest
– Compare/Vtree/History from Checkin/Undo Checkout
– General performance improvements
 Eclipse 3.8, Eclipse 4.2.2, Macintosh OS 10.7
 VS.net Integration uses CTE for dynamic views
 Site-wide enforceable RTC integration

17
 Security enhancements
• SSL Support, Proxy Authentication, Groups, Login
 Usability improvements
• Session Management / Caching, Customizable Runtime
Environment, Improved Scripting Support
 Enhancements to commands/options
• Significantly expanded Options, New Commands
 Server-side trigger support
• Just like CCRC, with clearprompt support
 Ongoing enhancements planned for future releases
CCRC CLI rcleartool enhancements

18
8.0.1 - Platforms
• ClearCase
– SLES on x86, PPC, Linux 390
11 SP2
– Oracle Solaris on x86, SPARC
11, 11.1
– AIX 6.1 TL7, 6.1 TL8
AIX 7.1 TL1, 7.1 TL2
Power 7+
– Ubuntu 12.04
– Mac OS X 10.7 (CCRC only)
– VMware ESXi V5.0
– 64-bit Microsoft Windows Explorer
– Samba 3.5.11, 3.5.14, 3.5.16
– Open SSL
– Visual Studio 2012
– Eclipse 3.7, 3.8, 4.2.1, 4.2.2
– Sybase PowerBuilder 12.5
• ClearQuest
– Oracle Solaris 11.1 on SPARC only
– Internet Explorer 10
– Firefox ESR17, ESR17.0.2
– Firefox 21
– Eclipse 4.2.2
– OSLC 2.0 Consumer Support
– Apache Solr 3.6.1
– SQL Server 2012 SP1
– DB2 10.1
• Common
– RHEL on x86, PPC, Linux 390
5.8, 5.9, 6.2, 6.3
– Windows 8
– Windows 2012 Server
– WAS/IHS 7.0.0.27, 8.0.0.4, 8.0.0.5,
8.5
– JRE updates: Java 5 SR15, Java 6
SR12
– JREs have been upgraded to
address security vulnerabilities
– IM 1.6.2 , IM 1.6.2_64, IM 1.6.3
– IBM Installation Manager console
support
– RCL 8.1.2.1, 8.1.3
– GSKit update
– USGCB for Windows 7
18
201320122011 2013 Q1 Future

19
8.0.1 – RHEL and NAS
 History
– Mixed performance results for various RHEL 5.x kernels involving NAS/NFS storage
– Testing RHEL 6.x versions
– Significant performance issue discovered in RHEL 6.x and SLES 11.x testing
 Recent Issue
– Linux kernel changed NFS client that caused performance issue when the almd file is accessed over NFS.
All 2.6.27 and higher kernels are believe to be affected.
– Workaround in Q2 release
– Working with Red Hat and Novell to identify and resolve
– Technote will be updated
 Bugzilla defect filed against RHEL 6.x
– https://bugzilla.linux.ibm.com/show_bug.cgi?id=87502
 Bugzilla defect filed against SLES 11
– https://bugzilla.linux.ibm.com/show_bug.cgi?id=91976
19
201320122011 2013 Q1 Future

20
8.0.1 - Performance
 mklabel
– 10-20% improvement
– Introduced slight delay into certain operations
– http://www-01.ibm.com/support/docview.wss?uid=swg21574484
 iSCSI
– Interesting and positive results comparing iSCSI to NAS under load
 Multi-processor scaling
– Improved parallel audited build performance (MVFS MP Scaling).
– A parallel audited -J 16 build of ClearCase source on a Linux 32-CPU machine improved by 43%
20
201320122011 2013 Q1 Future

21
8.0.1 – ClearCase Role-based Granular Access Control Lists
21
201320122011 2013 Q1 Future
 Out of the box Solution to:
– Provide granular Access Control of files and folders
stored in ClearCase Repositories
– Out of the box Role based Security to associate roles
with user accounts and/or groups
 This Solution provides the mechanism to:
– Effectively control access to sensitive IP assets stored in ClearCase and shared among distributed
development teams
– Overcome Operating System group limitations to implement strong IP security solution.
maximum groups on UNIX and Linux for use with ClearCase:
http://www-01.ibm.com/support/docview.wss?rs=984&uid=swg21207807
MVFS limitations on the number of ClearCase groups a user may belong:
http://www-01.ibm.com/support/docview.wss?rs=0&uid=swg21131881

22
8.0.1 – Rational Team Concert Integration
 Specify RTC work items during ClearCase operations
– Check In, Checkout, Add to Source Control, Move, Rename, Remove, Merge
 Create new RTC work items
 Allows 1:N, N:1, or N:N associations between versions/activities and work items.
 Enable integration locally, or enforce integration from VOB server
 Full support for CLM server rename
– http://pic.dhe.ibm.com/infocenter/clmhelp/v4r0m1/topic/com.ibm.team.connector.scm.cc.doc/topics/c_cc_b
ridge_server_rename.html
22
201320122011 2013 Q1 Future

23
7.1.2.12, 8.0.0.8, 8.0.1.1
 ClearCase
– CMI Enhancements – Support throughout the CC stack
– ClearTeam Explorer
• preview only option for update can be set as the default
• vtree annotates with RESERVED/UNRESERVED for checked out version
• Upgrade unlabeled baseline
– rcleartool find –print, merge, deliver, rebase
– Several enhancements to the ClearCase Cadence integration
23
201320122011 2013 Q1 Future

24
8.0.0.9, 8.0.1.2
 ClearCase
– Platforms: Z/OS 2.1 added
– Linux VOB mount limit increased from 1K to 4K
– Change Management Integration supports ClearQuest state transitions
– ClearTeam Explorer adds Create Project support
– rcleartool make baseline (mkbl) enhancements to create component baselines
– cleartool mkelem enhancement to reset original name of a .mkelem file
– Cleartool chproj to automatically select the project based on the –cview argument
– Several enhancements to the ClearCase Cadence Integration
24
201320122011 2013 Q1 Future

25
Formula to approximate enable_acls runtime
 The final step to enable ACLs once the VOBs are at feature level 8
– cleartool protectvob –enable_acls $vob_path
 The runtime depends on a number of factors
– VOB server performance
– Container access speed (local disk vs SAN vs NAS)
– Number of elements, versions and cleartext containers
 Enable_acls performed on a small VOB can provide runtime estimate of a large VOB
– Use countdb to find # of ELEMENT and VERSION in each VOB
•ELEMENT : 62283
•VERSION : 149800
•Total # = ELEMENT + VERSION + CLTXT containers for each VOB
•Time per 100K = (Total # / runtime (minutes)) * 100,000
ELEMENT VERSION CLTXT Total Runtime per 100K
/vobs/java 62283 149800 0 212,083 4.1 1.93
/vobs/atria 11814 583178 0 594,992 11.63 1.95
/vobs/3rdparty 116996 774122 0 891,118 16.27 1.83
/vobs/sys 642309 1319551 0 1,961,860 36.77 1.87
/vobs/java 62283 149800 49000 261,083 5.35 2.05
/vobs/atria 11814 583178 18000 612,992 13.2 2.15
/vobs/3rdparty 116996 774122 66000 957,118 19.1 2.00
/vobs/sys 642309 1319551 222000 2,183,860 45.98 2.11

26
NFSv4 Configuration with NAS
 Note: When using NFSv4 filer storage for a VOB, ClearCase may encounter slow performance for
checkout, checkin, clearfsimport, and related operations that create new containers in VOB storage
directories. If you disable write delegations in the filer configuration, you may see performance
improvements for these operations.
 These are some of our observations using a NetApp 3170 OnTap 8.1.1 7-Mode:
– http://media.netapp.com/documents/tr-3580.pdf
 The following table shows how different platforms perform with NFSv4 enabled, with write delegation
on and off.
– NOTE: Negative numbers mean that NFSv4 is faster than NFSv3 in our tests.
– These results are only valid in the Rational ClearCase performance environment
NFSv4 NFSv4
NFSv4 w/write
delegation off
NFSv4 w/write
delegation off
clearfsimport mklabel clearfsimport mklabel
RHEL 5.6 -5% -7% 24% 2%
RHEL 6.2 1% 21% 0% 4%
SUSE 11.2 -14% -6% 4% 1%
Solaris SPARC 10 651% 13% 12% 18%
Solaris SPARC 11 220% 4% 1% 3%
Solaris x86 11 1% 1% 3% 1%
Aix 7.1 10% 57% 9% 11%

2727
Base ClearCase 8.0.1.0 vs 8.0.0.x – RHEL 5.5

2828
ClearCase UCM 8.0.1.0 vs 8.0.0.x – RHEL 5.5

2929
CCRC Server 8.0.1.0 vs 8.0.0.1

3030
CCRC Server 8.0.1.x Scalability – up to 400 Users!!

3131
Results for MultiProcessor MVFS Improvements
Full Build RHEL 5.6 X86 32-CPU
0
5
10
15
20
25
30
35
J4 J8 J16 J32
Concurrency
BuildTime(min)
8.0.0.4 8.0.0.6 8.0.0.6 Run 2 Q2 2013

32
ClearCase Deployment – Mix of Versions
VOB Server A – 8.0
VOB Server B – 7.1.2
VOB Server C – 8.0
NAS
View Server ZClient 1 – 7.1.2
Client 2 – 8.0
Client 3 – 8.0.1
Client n
LAN
CM Server 7.1.2
CCRC Server 8.0.1
MultiSite MultiSite – 8.0

33
Differences with ClearCase install for 7.1.x vs 8.0.x
 ClearCase deployment version sync
– 8.0.x servers and clients can be mixed in the same deployment
 Introduction of Installation Manager
– 7.1.x was the first ClearCase install to use Installation Manager
– Installation Manager has been used for many releases and benefits from many fixes
 ClearCase VOB server schema
– 7.1.x VOB servers had to reformat all VOBs at once to the new schema
– 8.0.x VOB servers can host schema 54 and 80 at the same time
 CCRC Server usage of WebSphere
– 7.1.x had WAS bundled with ClearCase which limited upgrade options
– 8.0.x uses separate install of WAS to allow WAS to be upgraded when needed
 Integrations with other Rational Products
– These still have requirements on compatible versions

34
Why upgrade my VOB server to 8.0.x?
 Performance improvements discussed previously
– New schema 80 for better UCM performance
– New feature levels for new capabilities
 Evil twin detection
 Ability to host old and new VOB schemas
– Can now upgrade VOBs one at a time
 Complete compatibility with 7.1.x servers
 MultiSite compatibility with 7.1.x replicas
 Support new OS versions
 http://www-01.ibm.com/support/docview.wss?uid=swg21597061

35
Why upgrade my CCRC server to 8.0.x?
– Multithreaded view load/update
– 64 bit WAS 8.x – up to 400 users!!
 Ability to install and upgrade WAS independently
– Can use WAS 8.0 64 bit for better scalability ( CC 8.0.0.1 or later )
– Installation Manager for easier install vs multistep install for WAS 7.x via Install Shield
• http://pic.dhe.ibm.com/infocenter/cchelp/v8r0m0/index.jsp?topic=%2Fcom.ibm.rational.clearcase.cc_m
s_install.doc%2Ftopics%2Fc_install_overview.htm
 Better client support
– New CTE has smaller footprint and more capabilities
– Command line usage with CCRC CLI - rcleartool
 Complete compatibility with 7.1.x servers

36
Why upgrade my ClearCase client to 8.0.x?
– MultiProcessor improvements for builds
– Base ClearCase and UCM performance
 Complete compatibility with 7.1.x VOB servers
 Use new ClearTeam Explorer for dynamic views
 Be prepared for site wide ClearCase upgrades
 http://www-01.ibm.com/support/docview.wss?uid=swg21597061
 NOTE: Plan carefully to make sure compatibility is maintained with other IBM Rational products

Upgrade strategies
 Limit the amount of change
– ClearCase Version
– Operating System
– Server Hardware
– Storage Hardware
– Lab and Networking
 Validate backup/restore processes
 Document and save any custom settings
– If an upgrade install fails, you may have to uninstall
 Use cleartool hostinfo to probe ClearCase versions used in the region
– Lets you know which client versions are being used
 Test each step of the way

3838
How to prepare for ClearCase Deployment changes
Hardware
 # of systems and OS’s
 # of processors and kind
(cores/threads/GHz)
 Amount of RAM
 Storage connection type
(NFS/FC/iSCSI)
 Network connections (#
and type)
 Current server
virtualization in use, if any
Usage
 ClearCase version
 VOB server
 View server
 Build server
 CC Remote Client
 License/registry
 Multi-site
 Integrations (ClearQuest,
Rational Team Concert,
others)
Volume
 # of users on average
 # builds per day
 Average build run time
 Total VOB size
 Total database size
 Discover and Document current Deployment

3939
Run baseline tests
Establish performance baseline for current environment
Identify a repeatable test or set of tests
– clearsfsimport
– mklabel
– build
– rcleartool for changes to CCRC Server
Consider both single-user and load testing
Strongly recommended to start with repeatable scripts
Increase consistency of tests and therefore confidence in results
These same tests will be re-run on new test environment
Will be able to compare current and new environments and verify performance
improvements
Document environment changes and performance after each change

40
© Copyright IBM Corporation 2013. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind,
express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have
the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM
software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities
referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature
availability in any way. IBM, the IBM logo, Rational, the Rational logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States,
other countries or both. Other company, product, or service names may be trademarks or service marks of others.
www.ibm.com/software/rational

41
www.ibm.com/software/rational

Webcast Presentation - ClearCase Deployments: New upgrading flexibility to ClearCase v8.x makes life easier and other strategies

Recommended

Recommended

More Related Content

Recently uploaded

Recently uploaded (20)

Featured

Featured (20)

Webcast Presentation - ClearCase Deployments: New upgrading flexibility to ClearCase v8.x makes life easier and other strategies