Google App Engine 3 hour workshop for Java developers presented at GIDS 2010 in Bangalore, India

1. Google App Engine
a JVM cloud computing workshop
by Matthew McCullough, Ambient Ideas, LLC

2. Matthew McCullough
★ Open Source Architect
Ambient Ideas, LLC
★ Twitter
@matthewmccull
★ Email
matthewm@ambientideas.com
★ Web
ambientideas.com/blog

3. 90 min 90 min

4. on ?
Le ss
sto ry
H i

5. v elo pe rs!
We ’re De

6. Let’s build an app!

7. Google App Engine SDK

10. Google Web Toolkit SDK

13. Google Eclipse Plugin

16. Let’s code!

18. deploy to
local development server

20. debugging defaults

22. Success!

23. Why the cloud?

24. I have an idea for an app!

26. scrounge up money

27. LD
SO

28. going great, then...

30. Spiked Traffic

32. D LD
LO
S OS

33. Whew! We survived!

35. Not again!

36. D LD LD
LO O
S OS S

38. can’t afford to keep doing this!

39. success = crowds

40. crowds can be good

41. crowds can be bad

42. crowds are sudden

43. crowds are transient

45. fu nds!
No Re

46. pay-per-use!

47. brilliant!

48. GAE Account

49. before a real deployment

50. sign up for GAE

51. http://appengine.google.com

52. Google account

53. SMS-delivered code

55. demo of signup

56. Production Deployment

57. reserve App ID

58. http://appengine.google.com
Control Panel

59. demo reserving App ID

60. set App ID & Version

61. demo setting App ID

62. deploy...

63. demo deploying to
production GAE from
eclipse

64. <appid>.appspot.com

65. Pay-as-you-go?

67. who thought of this?

68. Joh
nM
cCa
r thy

69. 1960

70. 1960

71. 1960

72. “com putation may someday
d as a publ ic utility”
be organize
-John McCarthy

74. with the premise that the data services and
“It starts
be on servers. We c all it cloud computing
architecture should
be in a cloud somewhere.”
– they should
-Eric Schmidt, 8/9/2006

75. what does this solve?

76. New Signups Active Users
Users
Jan Feb Mar Apr May Jun Jul Aug Sep

77. minimal cost for
short-lived peaks

78. Command Line (SDK)

79. appcfg.sh
appcfg.cmd

80. production maintenance

81. > appcfg.sh help
Action must be one of:
help: Print help for a specific action.
request_logs: Write request logs in Apache common log format.
rollback: Rollback an in-progress update.
update: Create or update an app version.
update_indexes: Update application indexes.
update_cron: Update application cron jobs.
update_queues: Update application task queue definitions.
update_dos: Update application DoS protection configuration.
version: Prints version information.
cron_info: Displays times for the next several runs of each
cron job.
Use 'help <action>' for a detailed description.

82. demo appcfg help

83. push to production

84. appcfg.sh update war

85. fetch logs

86. appcfg.sh request_logs war mylogs.log

87. demo appcfg fetch logs

88. dev_appserver.sh
dev_appserver.cmd

89. Jetty Servlet Container

90. demo dev_appserver

91. The WAR

92. WAR folder format

93. no actual WAR

94. optimized to upload delta

95. Logging

96. log4j

97. java.util.logging

98. System.out == info
System.err == warning

100. The Datastore

101. A place to store data

102. Filesystem

103. Relational database

104. column-oriented

105. List ( Maps ( Maps ) )

106. schema-less

108. Persisting Easily
★ Low Level Datastore API
★ com.google.appengine.api.datastore

110. low level API

111. full control
but...
vendor lock in

112. DataNucleus

113. Who?

114. DataNucleus

116. JDO

117. JPA

118. demo JDO persistence

119. demo two rows with
columns differing

120. Why Google’s cloud?

121. free to start

122. generous free quotas

123. no hardware to own

124. no OS to patch

125. no network to secure

126. SaaS
PaaS
IaaS

127. Python
+
JVM languages

128. Java Runtime 1.6

129. Jetty servlet container

130. Google uptime

131. Google scaling brilliance

132. freedom through constraints

133. freedom through constra
ints

134. The Whitelist

135. the allowed classes

136. Banned
⅘
Java

137. The JRE Class White List
A Java App Engine application's access to the classes in the Java standard library (the Java Runtime Environment, or JRE)
is limited to the following classes:
java.awt.datatransfer.DataFlavor
java.awt.datatransfer.MimeType
java.awt.datatransfer.Transferable
java.beans.AppletInitializer
java.beans.BeanDescriptor
java.beans.BeanInfo
java.beans.Beans
java.beans.ConstructorProperties
java.beans.Customizer
java.beans.DefaultPersistenceDelegate
java.beans.DesignMode
java.beans.Encoder
java.beans.EnumPersistenceDelegate
java.beans.EventHandler
java.beans.EventSetDescriptor
java.beans.ExceptionListener
java.beans.FeatureDescriptor
java.beans.IndexedPropertyChangeEvent
java.beans.IndexedPropertyDescriptor
java.beans.IntrospectionException
java.beans.Introspector
java.beans.MethodDescriptor
java.beans.ParameterDescriptor
java.beans.PersistenceDelegate
java.beans.PropertyChangeEvent
java.beans.PropertyChangeListener

138. org.xml.sax.DocumentHandler
org.xml.sax.EntityResolver
org.xml.sax.ErrorHandler
org.xml.sax.HandlerBase
org.xml.sax.InputSource
org.xml.sax.Locator
org.xml.sax.Parser
org.xml.sax.SAXException
org.xml.sax.SAXNotRecognizedException
org.xml.sax.SAXNotSupportedException
org.xml.sax.SAXParseException
org.xml.sax.XMLFilter
org.xml.sax.XMLReader
org.xml.sax.ext.Attributes2
org.xml.sax.ext.Attributes2Impl
org.xml.sax.ext.DeclHandler
org.xml.sax.ext.DefaultHandler2
org.xml.sax.ext.EntityResolver2
org.xml.sax.ext.LexicalHandler
org.xml.sax.ext.Locator2
org.xml.sax.ext.Locator2Impl
org.xml.sax.helpers.AttributeListImpl
org.xml.sax.helpers.AttributesImpl
org.xml.sax.helpers.DefaultHandler
org.xml.sax.helpers.LocatorImpl
org.xml.sax.helpers.NamespaceSupport
org.xml.sax.helpers.ParserAdapter
org.xml.sax.helpers.ParserFactory
org.xml.sax.helpers.XMLFilterImpl
org.xml.sax.helpers.XMLReaderAdapter
org.xml.sax.helpers.XMLReaderFactory

139. controversial

141. you agree with Sun policing it or not,
“Whether all very well for
Java compatib ility has served us
over a decade.
es being sure as a d eveloper that all
That includ ll platforms.
core classes a re present on a
-sets of the cor e classes in the
Creating sub
tform was forb idden for a really
Java pla nd irresponsible to
good reaso n, and it's wanton a
casually flaunt the rules.”
s
-Simon Phipps, OSS Manager, Sun Microsystem

142. what about
J2ME?

143. No threads

144. No File I/O

145. No Sockets

146. No JNI

147. demo violating the
whitelist locally

148. demo violating the
whitelist remotely

149. Why another vendor’s cloud?

150. better response times

151. 3000
‘hello world’
2250 GAE response times
in milliseconds
1500
750

152. OS neutrality

153. choice of programming language

154. avoiding G
AE
platform l
ock-in

156. EC2

157. SimpleDB

158. S3 Storage

160. CloudServers

161. Windows OS

162. Linux OS

163. CDN

164. open networking

165. root access

166. 1.5 cents/hour

167. 0.66 rupees/hour

168. Dashboard

169. web console

170. logging

171. datastore inspector

172. usage graphs

174. Memcache

175. retrieve,
but don’t calculate

176. why the 2nd data source?

177. tested, measured, proven

178. JSR-107 / JCache

180. demo memcache

181. Mail

182. email services

183. common for web apps

184. realiable delivery

185. URL Fetch

186. only means of port
connectivity

187. 10 second limit

188. 10 MB request limit

189. demo URLFetch

190. demo fail on 10MB get

191. Task Queue

192. webhook pattern

193. outbound = API

194. inbound = HTTP POST

195. scheduled

196. queues

197. worker, processing

198. but still limited to
30 seconds

199. Quotas

200. why?

201. multi-tenancy

202. cumulative

203. per day

204. per minute

205. 30 seconds max
per request

209. demo quota limit grid

210. profiling usage

211. demo quota code

212. demo app stats

213. Costs

214. very affordable

215. great for startups

216. great for
weekend experiments

217. demo cost grid

218. Security

219. helped by constraints

220. built-in authentication

222. developer roles

223. web.xml

224. demo security config

225. spring security
(formerly acegi)

226. Co-Developers

227. dev invite process

228. https://
only for appspot domains

229. Domain Names

230. CNAME entries

231. Real World
Comparisons

232. Limits too tight?

233. Blobs > 50MB?

234. Throughput > 72GB / day?

235. Throughput > 1TB / day?

236. Transactions > 43,000,000 / day?

237. Blob Store

238. images, zips, audio

239. Datastore, 1 MB limit

240. 50MB max

241. XMPP

242. Jabber, Google Talk, Google Wave

243. instant message service

244. why in a GAE app?

245. webhook pattern

246. demo XMPP console,
API

247. Image Manipulation

248. convenience functions

249. AWT on blacklist

251. Secure Data Connector

252. Enterprise

254. Concerns

255. p s
ck u
ba

256. no binary solution

257. csv export

258. Resources

259. Official Blog

260. App Gallery

261. http://vancouver2010.crosspollinate.org/search

262. Issue Tracker

263. Datastore Archive Feature Request

264. Maven Support Feature Request

266. The takeaways

267. What is the single
biggest benefit of GAE?
Scalability

268. What type of business
best fits GAE?
Startups

269. What types of apps
best fit GAE?
Web Mashups

270. What is the hardest
limit of GAE to work
around?
30 sec. processing

271. Google App Engine
a JVM cloud computing workshop
att end ing!
you for
Th ank
by Matthew McCullough, Ambient Ideas, LLC

272. Resources
SDK Downloads: http://code.google.com/appengine/downloads.html
App Gallery: http://appgallery.appspot.com/
Issue Tracker: http://code.google.com/p/googleappengine/issues/list
Secure Data Connector Install: http://code.google.com/securedataconnector/docs/1.0/installing.html

273. Photo Credits
Various Clouds: http://www.ambientideasphotography.com
Newspaper: http://www.flickr.com/photos/12836528@N00/1202823367
Flickr Chart: http://www.flickr.com/photos/85494010@N00/84912961
No Refunds: http://www.flickr.com/photos/8804814@N08/2591957763
Cell Phone Number Pad: http://www.flickr.com/photos/88543347@N00/2243527026
Men Conversation: http://www.flickr.com/photos/99037763@N00/2314463032
Backup Tape: http://www.flickr.com/photos/48615294@N00/75622824

274. Photo Credits
Clouds: http://www.flickr.com/photos/cindy47452/1624383308/
Big Chair: http://www.flickr.com/photos/annapickard/20988642/sizes/o/
Yellow Crowd: http://www.flickr.com/photos/twose/887903401/sizes/l/
Multicolor Crowd: http://www.flickr.com/photos/akc77/3370167184/sizes/l/
Jet Truck: http://www.flickr.com/photos/85819182@N00/301495633
Puzzled Power Plug: http://www.flickr.com/photos/95492938@N00/3203311346
Power Towers: http://www.flickr.com/photos/97544179@N00/3317530283
Reporter: http://www.flickr.com/photos/19953384@N00/4101633839
Idea Lightbulb Head: http://www.flickr.com/photos/17731548@N00/981372736