Sky Yin

6 Abonné

Data paranoid, failed entrepreneur, ex stock trader, father, Canadian in US, Shanghainese. Programming since 13 (QBasic in DOS on a 386 PC with a 5' floppy disk). Once studied Physics then went to Canada to learn more on business. Built a company then got hit by financial crisis. Got married and moved to US. Moved to Silicon Valley with wife as she got a job there. Love freedom and enjoy all the randomness in life. Highest Kaggle rank: 1076th / 300k https://www.kaggle.com/piggybox http://stackoverflow.com/users/2102764/piggybox https://github.com/piggybox

database time-series functional programming inventory spark redshift data-engineering spark-summit spark redshift data quality data cleansing machine learning etl data munging data wrangling

Tout plus

Activité
À propos

Tout plus

Sky Yin

Présentations

Data cleansing

Open Air 2016 Mini Talk

Migration from Redshift to Spark

Inventory as Pure Functions

J’aime

Kubernetes on AWS at Zalando: Failures & Learnings - DevOps NRW

Top 5 Mistakes to Avoid When Writing Apache Spark Applications

(BDT303) Running Spark and Presto on the Netflix Big Data Platform

Spark shuffle introduction

Streaming SQL

Choosing an HDFS data storage format- Avro vs. Parquet and more - StampedeCon 2015

Effective testing for spark programs Strata NY 2015