See the recording at http://looker.com/learn#ufh-i-225858450-driving-data-democracy-hadoop-amazon-redshift The Hadoop ecosystem has improved markedly over the past few years. Moreover, MPP databases seem to slot in nicely as complementary tools to map-reduce batch jobs, in that they allow analytics teams to easily query massive structured data sets. Rex Gibson, Manager of Data Engineering at Knewton and Scott Hoover, Data Scientist at Looker walk through how these pipelines work. They discuss: - their technology and data stacks - possible drawbacks to Hadoop + Redshift - the merits and drawbacks associated with making data processing and querying more “democratic.”

1. 1
Driving Data Democracy:
Hadoop & Amazon
Redshift

2. Housekeeping
• We will do Q&A at the end.
• You should see a box on the right
side of your screen.
• There is a button marked “Q&A”
on the bottom menu.
• We will be recording this
• We will send you the recording
tomorrow.
• We will also send you the slides
tomorrow.
RecordingQ&A

3. Rex Gibson
Manager of Data Engineering
Knewton
Rich Taylor
Platform Marketing
Looker
Scott Hoover
Data Scientist
Looker
Meet the Speakers

4. 4
TransitionCan you introduce yourself and your company?

5. 5
TransitionWhat is your data infrastructure?

6. APIs
App Usage Data
Looker Data Infrastructure

7. Let’s talk data sources and challenges

8. 8
TransitionHow can data engineering be more accessible?

9. 9
TransitionWho consumes data and how?

10. 10
TransitionHow to handle users of different skill level?

11. 11
TransitionHadoop or MPP or both?

12. Q&A

13. THANK YOU!