My presentation from COLLABORATE 16 conference

1. Session ID:
Prepared by:
Oracle E-Business Suite
R12.2.5 on Database 12c:
Install, Patch and Administer
10288
@ AndrejsKarpovs
Andrejs Karpovs
Lead Oracle Applications DBA
Tieto

2. About me
• Lead Oracle Apps DBA / Technical infrastructure
architect at Tieto [Latvia]
• Oracle Certified Master
• Oracle ACE
• Masters Degree in Computer Science
• Speaker: Collaborate, UKOUG, OUGH, Oracle
• RAC Attack Ninja
• Blog: adbaday.wordpress.com
2

3. Coming from Latvia
3

4. Tieto
• Tieto is the largest Nordic IT services company
4

5. Overview (I)
5

6. Overview (II)
6

7. Installation
• Useful 12.2 Documents (Doc ID 1585889.1)
• Oracle E-Business Suite Release 12.2
Technology Stack Documentation Roadmap
(Doc ID 1934915.1)
• R12.2.0 -> R12.2.5
7

8. 1585889.1

9. 1934915.1
9

10. OS preparation
• yum install oracle-ebs-server-R12-preinstall
– addons must be enabled
– /etc/yum.repos.d/public-yum-ol6.repo
• yum install oracle-rdbms-server-12cR1-preinstall
• For the rest
– Oracle E-Business Suite Installation and Upgrade
Notes Release 12 (12.2) for Linux x86-64 (Doc ID
1330701.1)
10

11. Staging area (I)
• Download media from e-delivery
• Download startCD 12.2.0.51, patch 22066363
always check for a latest startCD before performing
a new install
• Unzip only startCD, use ./buildStage.sh
– Create staging area
– Copy patches to staging area
• Make sure all media files are present
– VISION
– PROD

12. Staging area (II)
• R12.2: How To Create the Stage In Preparation For
Installation Note 1596433.1
• Do I Need A New Stage Area For startCD
12.2.0.51?
– https://blogs.oracle.com/stevenChan/entry/rapid_insta
ll_startcd_51
– Yes, you must create a new stage area to use startCD
12.2.0.51. A stage area created with an earlier
startCD will not work. This is because (as noted
above) startCD 12.2.0.51 uses Oracle Database
12cR1 (12.1.0.2), while earlier startCDs used 11gR1
(11.2.0.3). In addition, startCD 12.2.0.51 uses a later
patch set (11.1.1.9.0) of Oracle Fusion Middleware
Web Tier Utilities than the 11.1.1.7.0 patch set used
by earlier startCDs.
12

13. Staging area (III)
• How Can I Obtain Oracle Database 12.1.0.2 and
Oracle Web Tier Utilities 11.1.1.9.0?
13

14. 14

15. 15

16. 16

17. Installation (I)
17

18. Installation (II)
18

19. Installation (III)
19

20. Installation (IV)
20

21. Installation (V)
21

22. Installation (VI)
22

23. Installation (VII)
23

24. Installation (VIII)
24

25. Installation (IX)
25

26. Installation (X)
26

27. Installation (Summary)
• Shipped with RMAN backup instead of zipped datafiles
• Can be installed directly to RAC /w ASM
– make sure clusterware is healthy and properly
configured
– additional workarounds might be needed
– Checks and Potential Issues Installing EBS R12.2 on
RAC Cluster using Rapid Install (Doc ID 1595139.1)
• Latest startCD comes with JDK/JRE 7
• Decreased build up time
• Do not add secondary application tier node during
installation
– implement shared appl_top once R12.2.5 upgrade is
completed and all required post steps are done
• OVM templates do exist for R12.2.5
27

28. Installation using OVM
• Engineered Systems
– templates
• OVM Farm
– Virtual appliances
• Oracle VM Virtual Appliances for Oracle E-
Business Suite Deployment Guide, Release 12.2.4
(Doc ID 1928303.1)
– Haven’t found a note for 12.2.5
28

29. Post Install, Next
Steps
• Oracle E-Business Suite Release 12.2.5 Readme
(Doc ID 1983050.1)
• Oracle E-Business Suite Release Notes, Release
12.2 (Doc ID 1320300.1)
• Applying the Latest AD and TXK Release Update
Packs to Oracle E-Business Suite Release 12.2
(Doc ID 1617461.1) 29

30. Steps
• Latest rapidWiz comes with 12c database (12.1.0.2)
– singletenant(multi-tenant not supported)
• FMW 11.1.1.9.0
• RapidWiz delivered EBS 12.2.0
– Latest available is 12.2.5
• 12.2.0 can be directly upgraded to 12.2.5
– not an online patch
• In case of RAC installation, additional post steps are
needed for configuration tuning
– srvctl setenv ...
– sqlnet.ora
• !!! Do not only rely on your own documentation !!!
– check MoS notes with each and every new installation

31. Beware (I)
• $TNS_ADMIN/sqlnet.ora
• lsnrctl reload $ORACLE_SID
31

32. Beware (II)
• SQLNET.EXPIRE_TIME=1
32

33. High Level Plan (I)
• Fix Timestamp Mismatch Issues for Synonym,View,
Package and Package Body,Patch 17268684
• Apply Consolidated Seed Table Upgrade, Patch
17204589:12.2.0
– Update current view snapshotbefore patch
• Run ETCC - EBS TechnologyCodelevelCheckeragainst
RDBMS home and Apps tier
– Patch 17537119 - always check for latest version before
running to be updated on the bugs list
– Oracle E-Business Suite Release 12.2: Consolidated
List of Patches and Technology Bug Fixes(Doc ID
1594274.1)- contains required patches
• Apply mandatory db and apps patches,run ETCC again
– ETCC will store data in DB, therefore mandatory for
further steps
• For Engineered Systems
– Database Patches Required by Oracle E-Business Suite
on Oracle Engineered Systems:Exadata Database
Machines and SuperClusters (Doc ID 1392527.1)
33

34. 34

35. 35

36. High Level Plan (II)
• Apply Patches: DB, WLS, FMW
• Apply AD and TXK updates
– Always check for latest available AD and TXK
updates
• Upgrade to R12.2.5
• Apply additional critical patches (if any)
• Perform cutover, fs_clone
• Backup
36

37. Patching process (I)
• Database and Fusion Middleware patches
– latest version of opatch
– opatch apply
– check README for any post steps
• Weblogic
– take latest available PSU (10.3.6.0.x)
– Master Note on WebLogic Server Patch Set Updates
(PSUs) (Doc ID 1470197.1)
• Application Patches
– adop
– hotpatch where instructed so
37

38. Patching Process (II)
38

39. R12.2.5 Upgrade
• adop phase=apply apply_mode=downtime
patches=19676458
• adop phase=cleanup
• adop phase=fs_clone
39

40. R12.2.5 Post-Upgrade
• adop phase=prepare, apply, finalize, cutover, cleanup
• Go through full online patching cycle and fs switching
to confirm everything is working as expected
40

41. Administration
41

42. Administration (I)
• Try to avoid it until R12.2.5 is applied :)
• Begin with . EBSapps.env run/patch
• Note the filesystem you are in
• Note the changes in directory structure

43. R12.1 vs R12.2 (I)
43

44. R12.1 vs R12.2 (II)
44

45. Administration (II)
• Weblogic console
• Fusion Middleware Control
• AFPASSWD
• $ADMIN_SCRIPTS_HOME
– adstrtal.sh
– adstpall.sh
– adadminsrvctl.sh start forcepatchfs
– adnodemgrctl.sh
45

46. Administration (III): autoconfig
• Not all the files and configurations are under autoconfig
control anymore. WLS managed configuration files
include:
– httpd.conf
– admin.conf
– ssl.conf
– JVM arguments
– CLASSPATH
– ...
• Change the value in WLS -> run adSyncContext.pl. ->
run autoconfig
• adProvisionEBS.pl -> provision EBS settings to WLS
– JVM, add managed servers, remove second appl tier
node, etc.
• adRegisterWLSListeners.pl run in background and syncs
values between WLS and CONTEXT_FILE, but not all
46

47. Administration (IV)
• APPS password change - should be updated also in
WLS datasource
– Shut down the application tier services
– Change the APPLSYS password
– Start AdminServer using the adadminsrvctl.sh script
from your RUN filesystem
– Do not start any other application tier services.
– Update the “apps” password in WLS Datasource as
follows
47

48. Administration (V)
• Simplified Look & Feel
• Better integration with OAM and OID
• Build-in OHS and WLS
– No need to install additional components
– Add Webgate on top of R12.2 OHS
– Add AccessGate wls managed server into
EBS_Domain
• Less complexity
48

49. Administration (VI): Cloning
49

50. Administration (VII): Cloning
• Not much difference from R12.1
• FMW_Home handled by WLS utilities
• adpreclone.pl creates a clone stage of FMW_Home
• adcfgclone builds new FMW_Home on target via
WLS utilities
50

51. Custom application
• Creating a Custom Application in Oracle E-Business
Suite Release 12.2 (Doc ID 1577707.1)
• download IZU patch (3636980)
– fill in the template files
• use adsplice
51

52. Custom development
• Developing and Deploying Customizations in Oracle
E-Business Suite Release 12.2 (Doc ID 1577661.1)
• run edition
– application development
• patch edition
– patch development
• editionable objects
– upgrade objects for Online Patching
52

53. Integrations
• Webgate installation
– txkrun.pl -script=SetOAMReg -installWebgate=yes -
webgatestagedir=/u01/install/wg
• Deploy AccessGate
• Register with OAM
– txkrun.pl -script=SetOAMReg -registeroam=yes -
ldapProvider=OUD -oidUserName="cn=directory
manager"
53

54. Patching
54

55. Patching (I)
• ADOP Initially introduced as revolutionary breakthrough
in patching mechanisms with zero downtime required for
patching
• It appears that downtime is still needed (10-20 minutes
depending on environment size, hardware resources,
etc.)
• downtime mode introduced in latest AD/TXK
• hotpatch still exists
– official statement is that every R12.2 patch is online
patch
– exceptions
• R12.2.5 release update (+downtime)
• NLS patches
• if Oracle states so
• built in merge option
• all patches have to be placed under $PATCH_TOP
(fs_ne)

56. Patching (II)
56

57. Patching (III)
• Download patch to $NE_BASE/EBSapps/patch directory
– $PATCH_TOP
• Prepare the system for patching:
– $ source <EBS_ROOT>/EBSapps.env
– $ adop phase=prepare
• Apply a patch
– $ adop phase=apply patches=<patch_list> merge=yes
• After all patches have been successfully applied,complete
the patching cycle:
– $ adop phase=finalize
– $ adop phase=cutover
– $ source <EBS_ROOT>EBSapps.env run
– $ adop phase=cleanup
• Synchronize the technology level between patch and run file
systems:
– $ adop phase=fs_clone
57

58. Patching (IV)
58

59. Patching (V)
• Using the Online Patching Readiness Report in
Oracle E-Business Suite Release 12.2 (Doc ID
1531121.1)
• Found in MoS that some limitations do exist:
59

60. Patching (VI): Experiences
• Overall patching time increased
• Problems with Applications multi-node environments
– Do not enable multi-node during installation
• Not possible to instantly allow patch to finish even if
some object, form or report failed
– flags=autoskip
• abandon=yes restart=no -> restart from beginning
• abandon=no restart=yes -> continue from failed
point
– check adctrl before
• should use skipsyncerror=yes beforehand
60

61. New features in R12.2.5 (I)
61

62. New features in R12.2.5 (II)
• dualfs option
– perl adcfgclone.pl appsTier dualfs
– clone the Run and Patch file systems in a single
operation
• New EBS installation central inventory
• Weblogic server performance enchancements
• Script to change Weblogic password
– $FND_TOP/patch/115/bin/txkUpdateEBSDomain.pl -
action=updateAdminPassword
• adopmon
62

63. Thank you and
questions
Session evaluation