Slides from OakTable world

1. @connor_mc_d
Connor McDonald
OracleDBA
co.uk
connormcdonald.wordpress.com

4. bio slide

5. a funny story
5

6. 6

7. 7

8. gratuitous book plug
8

10. why
10

11. everyone wants
11
goodata

12. 12
SQL> select * from CUSTOMERS;
CID FORENAME SURNAME DOB
-------- --------------- ----------------- ---------
101230 Sarah Johnson 01-JUN-75
101233 Michael Smith 13-FEB-69
101237 Peter Brown 24-OCT-82
SQL> select * from CUSTOMERS;
CID FORENAME SURNAME DOB
-------- --------------- ----------------- ---------
101230 Sarah Johnson 01-JUN-75
101252 MyTestGuy DoesümlautWork 01-JAN-01
101268 Spaces 01-JAN-01
prod
dev

13. easy to do
13

14. 14
RMAN> DUPLICATE DATABASE TO myclone
2 FROM ACTIVE DATABASE;
prod

15. one small problem
15

16. 16

17. storage administrator
17

18. 18
CEO

19. clone your database ....
19
once

20. everyone wants
20
currednatta

21. 21
prod
dev
nightly
prod
dev
weekly
prod
dev
annually

22. 22

23. everyone wants
23
full sdiazetda

24. 24
prod
dev
annually

25. 25
prod
dev

26. You are here
Hard
Place
26

27. 27
prod
dev

28. risk
28

29. 29
procedure MY_LATEST_PROC is
begin
for i in (
select *
from EVERY_PIECE_OF_DATA_WE_HAVE
where UNINDEXED_COLUMN = 10
)
loop
...
end;
SQL> exec MY_LATEST_PROC
PL/SQL Procedure completed successfully.
Elapsed: 00:00:00.03

30. 30

31. everyone wants
31
their doawtna

32. 32

33. 33
prod
Mike Sue Tom Michelle

34. what typically happens ...
34

35. 35
Mike Sue Tom Michelle
dev

36. From: Mike
To : EVERYBODY !!
Which *@&@# changed my code
and broke the build ?!?!?
36

37. "Database environments are constantly
getting bigger and bigger, and they are
increasingly the bottleneck"
-Tim Campos,
Facebook CIO
37

38. a solution is at hand
38

39. clone db
39

40. free !
40

41. let
41
me
repeat

42. oracle feature that is free !
42

43. single prerequisite
43

44. direct NFS (11.2)
44

45. 45

46. lets talk about NFS ...
46

47. 47

48. a little back story...
48

49. 90's
49

50. 50

51. 51

52. 52

53. 53

54. something terrible happened...
54

55. 55

56. local disk causes ...
56

57. "problems"
57

58. 58

59. "hard to manage"
59

60. "inefficent"
60

61. (some) truth
61

62. 62

63. "10 SCSI disks please"
63

64. "sorry"
64

65. fast SCSI
65

66. fast wide SCSI
66

67. ultra SCSI
67

68. ultra wide SCSI
68

69. ultra 2 SCSI
69

70. ultra 2 wide SCSI
70

71. ultra wide uber mega super duper SCSI
71

72. the (claimed) solution
72

73. 73

74. consolidation
74

75. performance
75

76. ease of management
76

77. 77

78. SAN
78

79. 79

80. fine in the 90s...
80

81. 81
FC 1Gb/sec
Ethernet 10Mb/sec

82. "disks are slow ...
82

83. ... and fibre is ...
83

84. 84

85. 85

86. modern disk drive
86

87. 150MB per second
87

88. 88
2Gb/sec

89. 2Gb / sec = 256MB / sec
89

90. 2 disks !
90

91. the other problem
91

92. provide that data
92

93. Like I always say,
"Everything is a CPU problem."
- Kevin Closson
93

94. 94

95. "the SAN can't be slow"
95

96. 96

97. advances
97

98. 98
12486GGbb//sseecc

99. we need GB per second
99

100. for disks !
100

101. flash etc even "worse"
101

102. separating server from disk
102

103. ... can be an expensive mistake
103

104. 104
CEO

105. irony
105

106. 106

107. Exadata "magic"
107

108. big data "revolution"
108

109. 109

110. 110

111. "move to code near to the data"
111

112. 112

113. consolidation makes sense if ...
113

114. ... storage tier offers something
114

115. business continuance volume
WAFL clustering
115
snapshots
iSCSI site mirroring

116. successful vendors did this
116

117. 117

118. back to NFS
118

119. does it "give me something" ?
119

120. yes
120

121. 1) shared file system
121

122. RAC / TTS / parallelism
122

123. 2) ethernet
123

124. 124

125. FC HBA
FC switch
125

126. so why isn't everyone using it ?
126

127. "ethernet is slow"
127

128. 128
1 Gb 4 Gb

129. bonding
129

130. 130
124 Gb

131. technology advances
131

132. 132
1410 GGbb

133. 133

134. 134

135. 135
60Gb

136. why direct NFS ?
136

137. "NFS is slow"
137

138. (partially) true
138

139. 139
oracle
OS
NFS client cache

140. solution
140

141. direct NFS
141

142. 142
oracle
NFS
OS
NFS client cache

143. direct NFS rocks !
143

144. 144
Source:
Red Hat Enterprise Linux Protocol Performance
Comparison with Oracle Database 11g Release 2
NetApp, TR-3932, June 2011

145. even if no interest in cloning...
145

146. ... think about direct NFS
146

147. 147

148. back to clone db
148

149. direct NFS means ...
149

150. Oracle controls the I/O
150

151. controls where writes go
151

152. and voila ! clone db
152

153. RMAN imagecopy clone via direct NFS
153
prod

154. "um ..... and ?"
154

155. 155
RMAN imagecopy
clone database
prod
dNFS
COW

156. COW = copy on write
156

157. clone is the imagecopy
157

158. ... but is read write !
158

159. deltas written as COW
159

160. 160
SQL> connect /@myclone
Connected.
SQL> update EMP
2 set ENAME = 'JOE'
3 where ENAME = 'SUE';

161. 161
READ ONLY
Ename: SUE
JOE
clone db

162. clone initial size =
162

163. ZERO
163

164. 164
SQL> select * from EMP;

165. 165
block1 block2 block3 block4 block5
block1 block3 block5
read only
clone

166. clone 5
166
clone 2
clone 1
clone 3
clone 4

167. how to do it ?
167

168. "under the covers" worry
168

169. Doc ID 1210656.1
169
perl clonedb.pl

170. its not !
170

171. time for a demo
171

172. 172

173. DEMO
173
demo1

174. so what does "clonedb.pl" do ?
174

175. generates SQL ... (poorly)
175

176. flexible point in time
176
demo2

177. and its fast
demo3 / demo4
177

178. this poor laptop...
178

179. 5 x ~20GB databases
179
(plus 12c + VM)

180. 180

181. still can clone !
181

182. just COW data on dNFS
182

183. 183
copy
clone
prod
SAN SAN
redo
SAN
COW

184. "but we're on windows"
184

185. still can clone !
185

186. direct NFS works on windows
186
as you've just seen

187. real customer
187

188. 188

189. dev cdev
nightly
AIX / RAM
189

190. virtually no limitations
190

191. available RAM
191

192. available disk
192
( small )

193. available licenses
193
( additional servers )

194. x86 the real winner
194

195. every developer ... own database
195
VM on developer PC

196. discussion point
196

197. 197
LICENSE RIGHTS
We grant you a nonexclusive, nontransferable limited license to
use the programs only for the purpose of developing, testing,
prototyping and demonstrating your application, and not for any
other purpose.
If you use the application you develop under this license for any
internal data processing or for any commercial or production
purposes, or you want to use the programs for any purpose
other than as permitted under this agreement, you must obtain
a production release version of the program by contacting us or
an Oracle reseller to obtain the appropriate license.

198. seems to be ok
198

199. cloning ... in 12c
199

200. trivial ...
200

201. ... but potentially space hungry
201

202. 1) trivial
202

203. 203

204. SQL> create pluggable database MY_CLONE_PDB
204
2 from MY_SOURCE_PDB;
Pluggable database created.

205. you're done !
205

206. > 1 pluggable database
206

207. 207

208. DEMO
208
demo1.sh

209. avoiding space consumption
209

210. "snapshot" copy
210

211. DEMO
211
demo2.sh

212. :-(
212

213. ZFS appliance
NetApp appliance
ACFS
213

214. 12.1.0.2
214

215. 215
With the initialization parameter CLONEDB set
to true, snapshot clones of a pluggable
database are supported on any ... file systems
with Oracle Direct NFS (dNFS) enabled
(yet to verify)

216. "2 minute clone....
... 10 hour imagecopy"
216

217. two technologies
217

218. 1 ) block change tracking
218

219. full backup = slow
219

220. incremental backup ...
220

221. 221

222. read every file ... every block
222

223. "has SCN advanced ?"
223
write to backup

224. easy solution
224

225. 225
SQL> alter database enable block change tracking
2 using file 'c:oracledb112bct.dat' reuse;
Database altered.

226. very low risk
226

227. CTWR process
227

228. cost = zero
228

229. cost = "zero"
229

230. reason 1
230

231. lots of block changes ...
231

232. .. lots of redo
232

233. redo is complicated
233

234. load CTWR versus LGWR
234

235. reason 2
235

236. asynchronous from user
236

237. CTWR and CKPT
237

238. 238
you
buffer cache
ckpt
ctwr
bct.dat
dbwr

239. reason 3
239

240. 240
SQL> select * from v$sgastat
2 where name like '%change%';
POOL NAME BYTES
------------ -------------------------- ----------
shared pool change notification obj m 16416
shared pool change tracking state cha 2584
shared pool change notification regis 16416
shared pool change tracking recovery 262144

241. x$krc...
241
X$KRCFH
X$KRCEXT
X$KRCCDE
X$KRCCDS
X$KRCCDR
X$KRCGFE
X$KRCFDE
X$KRCFBH
X$KRCBIT
X$KRCSTAT

242. space efficient
242

243. 243
datafile 1
datafile 2
datafile 3
BCT 32k 32k 32k

244. chunks
244

245. 245
SQL> SELECT (count(distinct b.fno||' '||bno) * 32)/1024 MB
2 FROM x$krcbit b,
3 (SELECT MIN(ver) min_ver, fno
4 FROM
5 (SELECT curr_vercnt ver,curr_highscn high,
6 curr_lowscn low,fno
7 FROM x$krcfde
8 UNION ALL
9 SELECT vercnt ver, high,
10 low, fno
11 FROM x$krcfbh
12 )
13 WHERE
14 (SELECT MAX(bd.checkpoint_change#)
15 FROM v$backup_datafile bd
16 WHERE bd.incremental_level <= 1) between low and high
17 GROUP BY fno ) sub
18 WHERE b.fno = sub.fno
19 AND b.vercnt >= sub.min_ver;
MB
----------
46.34375

246. detailed info...
246
http://www.pythian.com/documents/Pythian-oracle-block-change.pdf

247. DEMO*
247

248. 248
C:oracle11.2.0.3BIN>rman target /
Recovery Manager: Release 11.2.0.3.0 - Production on ...
Copyright (c) 1982, 2011, Oracle and/or its affiliates..
connected to target database: DB112 (DBID=730732064)
RMAN> RUN {
2> allocate channel c1 type disk format 'c:oraclebkp%N.lev0';
3>
4> BACKUP INCREMENTAL LEVEL 0 DATABASE;
5>
6> }
using target database control file instead of recovery catalog
allocated channel: c1
channel c1: SID=190 device type=DISK

249. 249
Starting backup at 09/11/2014 13:58:15
channel c1: starting datafile copy
input datafile file number=00005
name=C:ORACLEORADATADB112DATAFILEO1_MF_DEMO_95F7ZWNP_.DBF
output file name=C:ORACLEBKPDEMO.LEV0 ...
channel c1: datafile copy complete, elapsed time: 00:03:15
...
Finished backup at 09/11/2014 14:02:41
released channel: c1
RMAN>

250. 4 minutes 36 seconds
250
20GB

251. DEMO
251
demo5

252. 2 ) rolling recovery
252

253. superfast incrementals
253

254. ... but what about recovery
254

255. 255
20GB
Mon Tue Wed Thu Fri

256. slow
256

257. but ....
257

258. recover from a backup
258
10g+

259. 259
RMAN> RECOVER COPY OF DATABASE
WITH TAG 'rolling';

260. 260
20GB
Mon Tue Wed Thu Fri

261. DEMO
261
demo7

262. 262
RMAN> RECOVER COPY OF DATABASE
WITH TAG 'rolling'
UNTIL TIME 'sysdate-3';

263. 263
RMAN> RUN {
RECOVER COPY OF DATABASE
WITH TAG 'rolling';
RECOVER COPY OF DATABASE
WITH TAG 'day3'
UNTIL TIME 'sysdate-3';
RECOVER COPY OF DATABASE
WITH TAG 'day7'
UNTIL TIME 'sysdate-7';
}

264. bringing it all together
264

265. prod
only once !
bkp 3day 7day
incrementals
265

266. 266
prod
bkp 3day 7day

267. easy point in time copies
267
fast backup
unlimited clones

268. free !
268

269. let
269
me
repeat

270. oracle feature that is free !
270

271. once you see the benefits
271

272. consider more rigour
272

273. 273

274. 274

275. Connor McDonald
OracleDBA
co.uk
275

276. 276
@connor_mc_d
ORA-03113
connormcdonald.wordpress.com