Big query the first step - (MOSG)
•
0 j'aime•424 vues
BigQuery =The First Step= Mulodo Open Study Group (MOSG) @Ho chi minh, Vietnam http://www.meetup.com/Open-Study-Group-Saigon/events/231233151/
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à Big query the first step - (MOSG)
Similaire à Big query the first step - (MOSG) (20)
Plus de Soshi Nemoto
Plus de Soshi Nemoto (11)
Dernier
Dernier (20)
Big query the first step - (MOSG)
- 1. Google BigQuery - The first step - 2016/05/28 Mulodo Vietnam Co., Ltd.
- 2. What’s BigQuery Official site : https://cloud.google.com/bigquery/docs/ BigQuery is Google's fully managed, petabyte scale, low cost analytics data warehouse. BigQuery is NoOps—there is no infrastructure to manage and you don't need a database administrator—so you can focus on analyzing data to find meaningful insights, use familiar SQL, and take advantage of our pay-as-you-go model. → WDH: SQL like (easy to use), Petabyte scale(for Huge data)
- 3. Features of BigQuery Column oriented Database Full Scan instead of using Index Charge for scanned data size http://static.googleusercontent.com/media/research.google.com/ja//pubs/archive/36632.pdf https://www.flickr.com/photos/mairin/galleries/72157624181197793/ https://cloud.google.com/blog/big-data/2016/03/google-bigquery-cuts-historical-data-storage-cost-in-half-and-accelerates-many-queries-by-10x
- 4. The first step - overview - 1. Preparation (create account) 2. Try BigQuery with prepared data 3. Upload your data to your BigQuery storage and try it.
- 5. Preparation steps 1. Preparation (create account) 1. Create your Google account 2. Move to Google Cloud platform (has no account) 3. “Try IT Free” 4. “Sign up for free trial” 5. Account registration 6. Move to Google Cloud Platform (login) 7. Select ‘BigQuery’ from left menu (top-left icon)
- 6. Create your google account 1. Preparation (create account) 1. Create your Google account https://accounts.google.com/signUp
- 7. Move to Google Cloud Platform 1. Preparation (create account) 2. Go to Google Cloud platform (has no account) 3. “Try IT Free” https://cloud.google.com
- 8. Move to Google Cloud Platform 1. Preparation (create account) 2. Go to Google Cloud platform (has no account) 3. “Try IT Free” https://cloud.google.com
- 9. Move to Google Cloud Platform 1. Preparation (create account) 2. Go to Google Cloud platform (has no account) 3. “Try IT Free” https://cloud.google.com
- 10. Account registration 1. Preparation (create account) 4. “Sign up for free trial” 5. Account registration
- 11. Account registration 1. Preparation (create account) 4. “Sign up for free trial” 5. Account registration <- Credit Card required
- 12. Move to Google Cloud Platform 1. Preparation (create account) 6. Move to Google Cloud Platform (login) 7. Select ‘BigQuery’ from left menu (top-left icon) https://cloud.google.com
- 13. Move to Google Cloud Platform 1. Preparation (create account) 6. Move to Google Cloud Platform (login) 7. Select ‘BigQuery’ from left menu (top-left icon) https://cloud.google.com
- 14. Move to Google Cloud Platform 1. Preparation (create account) 6. Move to Google Cloud Platform (login) 7. Select ‘BigQuery’ from left menu (top-left icon) https://cloud.google.com
- 15. Now you are ready to use BigQuery
- 16. Credit card .... I can hardly check how much I have as free credit.
- 17. Credit card .... I can hardly check how much I have as free credit. Okay. Anytime you can check your free creit and trial days easily.
- 18. ... I wanna try BigQuery
- 19. Try BigQuery with public data
- 20. Try BigQuery with public data
- 21. Query
- 22. Query SELECT repository_name FROM [bigquery-public- data:samples.github_timeline] LIMIT 1000
- 23. Query SELECT repository_name FROM [bigquery-public- data:samples.github_timeline] LIMIT 1000
- 24. Query SELECT repository_name FROM [bigquery-public- data:samples.github_timeline] LIMIT 1000
- 25. Query SELECT repository_name FROM [bigquery-public- data:samples.github_timeline] LIMIT 1000
- 26. Query SELECT repository_name FROM [bigquery-public- data:samples.github_timeline] LIMIT 1000 EX) Query complete (2.1s elapsed, cached) Query complete (3.8s elapsed, 61.4 MB processed)
- 27. More query SELECT actor, actor_attributes_name , count( actor_attributes_name ) as amount FROM [bigquery-public-data:samples.github_timeline] group by actor, actor_attributes_name order by amount desc LIMIT 1000
- 28. Much more query You can check query syntax by yourself. https://cloud.google.com/ bigquery/query-reference
- 29. Upload your data 1. Create database 2. Create Table (with CSV) 3. check “Table ID” 4. QUERY!
- 34. Create newTable (with CSV file)
- 35. Create newTable (with CSV file)
- 36. Create newTable (with CSV file)
- 37. Create newTable (with CSV file) nemo,47,nemo@mulodo.com foo,30,foo@example.com bar,25,bar@example.com sample.csv
- 38. Create newTable (with CSV file) nemo,47,nemo@mulodo.com foo,30,foo@example.com bar,25,bar@example.com sample.csv
- 39. Check “Table ID”
- 40. Check “Table ID”
- 41. Check “Table ID”
- 42. QUERY for your own table!!
- 43. Now you are ready to use BigQuery.
- 44. Next Install GCP SDK Use command line tools Characteristic of Google BigQuery. Especially, Tips for business use. Thank you!