SlideShare une entreprise Scribd logo
1  sur  30
Télécharger pour lire hors ligne
非常人走非常路
參與ASF打世界杯比賽
葉祐欣
Apr. 2021 @ NTUEE
Who is This Guy
- ASF member
- Apache Bigtop / Ignite / DataSketches PMC member
- Contribute to ASF since 2014
Agenda
- 參與ASF,我所看見的不同風景
- 台海兩岸工作經驗談
- 台灣軟體產業升級之路
What is the ASF?
Hierarchy of an Apache Project
Hierarchy of the ASF (Apache Software Foundation)
Foo Bar Company
正職 + 參與ASF
= 2X 工作經驗
參與ASF
我所看見的不同風景
Back in 2012,大家都有一座心目中的Hadoop
- TMH (Trend Micro Hadoop)
- Infra團隊負責Hadoop ecosystem相關production issues與tool開發
- 崇尚Apache Projects,工程師以貢獻patch能被merge為榮!
- 開設Hadoop團隊技術blogpost
- 鼓勵團隊投稿國際conference,增加技術影響力
工作經歷
- Hadoop DevOps
- 開發Hadoop deployment tool,管理100+ servers
- TMH leverages Apache Bigtop
- 輸掉 ETU Hadoop Competition 2014 (slide),工作上也不順利
- 轉換方想,找個新目標,開始嘗試貢獻Apache Bigtop
社群經歷
- 認識熱心的社群mentor Jay Vyas(RedHat)
- 在JIRA comment建議解法/步驟
- Concall討論問題
- 互相Review PR,教學相長
- 融入社群,取得大家的認可
- 2014年聖誕節,受邀成為Apache Bigtop committer
正向循環
- 成為committer,開始在conference給talks
- 在國際conference上學習新知,並帶回公司做sharing
- 公司主管給予更多機會,參與新專案打造solutions
- 專案經驗到國際conference上分享
- Promote to PMC...
環境 X 運氣 X 努力
環境形塑你的價值觀,價值觀影響你的決策
成為Apache committer有價值嗎?
下班時間刷副本還是刷ASF比較有價值?
從 Committer -> PMC -> Chair 的變化
- 開發轉管理
- 激勵contributor,鼓勵他們更多的參與貢獻
- 與其他專案的談合作,做PR/marketing promote專案
- Mentoring new contributor,成長為committer / PMC
- 監督運作,發現不符合Apache Way的操作,要適時給予意見
- 制定project走向,例如增加整合的專案數量(廣),或是專精把熱門專案的整合做
更精緻(深)
Bigtop 的案例
- Cloudera棄養 -> RedHat / AWS / IBM / SK Teelcom / Arm / NTT Data
- user -> contributor -> committer -> PMC -> PMC chair
- Jun He, Arm (2020 ex-chair)
- Kengo Seki, NTT Data (2021 chair)
- 讓contributor相信,升遷的管道是通暢的
- 適時promote new committer / PMC,任人唯賢
- 只要能某種程度掌握專案(votes、話語權),公司採用開源專案的Risk也會降低,
一起合作貢獻開源就是Z>B
ASF Member
- Legal, culture, anything that makes ASF better
- Incubator,孵化新的Apache top-level project
- 著重建立一個健康的Apache community,不是著重code maturity
- Can vote new ASF members
- Can run ASF board of directors
- Paid?
公司不賺錢是不道德的
個人不賺錢也是不道德的
油水1: 可以換成錢的隱性收入
- 學習成長:tech、non-tech(英文、溝通效率、說服力、領導力、解決意見衝突)
- 名聲/權威:談薪水/職級時的加分項
- 面試機會:Google / Facebook / Microsoft / Amazon AWS / Databricks
- International Conference Talks: travel & party for free~
- ODPi to sponsor Apache Bigtop
development: $50000 USD
- 我夢到的:?
油水2: 直接換成錢
談錢俗氣
追求卓越,成功伴隨而來
台海兩岸工作經驗談
輸出倒逼輸入,很功利,也很有效
- 期末考範圍才念,沒考的不念
- 帶著production issue看Apache專案code
- 讀書會,要報的那一章念最熟,其他章都沒看
- 寫Document / Blog,教別人,給talk/sharing/demo,準備時學習速率最高
- 施比受更有福
- 投履歷無聲卡,再寄信問一次
- Contest / Program 投投投
- Conference CFP,先上再說(waitlist / 取消),尋求贊助
- 團隊不熟Bigtop,自己先研究
- 團隊不熟Docker,自己先研究
- 團隊沒有distributed ML solution,自己先研究
- 不要等,你就是沒有人
積極主動,創造機會,創造選項
- 台灣工程師薪水 V.S. 矽谷薪水
- 很少有 Principal / Distinguished Engineer
- To B company難做,quality不用這麼高
- Scale: 效能優化2%,省下幾億 V.S. 做一個專案省6萬,不如少hire一個人
- 亂世造英雄
- 提昇思考的維度,看穿現實背後的真相,才能真正解決問題
凡是現實的都是合理的
台灣軟體產業升級之路
- 跨國公司中國branch不斷培養人才
- 國內有舞台(市場),great wall阻擋外面產品賣不進去
- 國內有舞台(市場),輸出到逼輸入,自產自研
- 國內有舞台(市場),大量海龜看到國內機會,回國報效國家,產業進一步升級
偷看隔壁考卷,中國軟體為什麼能起來?
30年衣錦還鄉計畫 — 給下一代光明的未來
- 參與ASF打世界杯,到國外唸書就業,學習最新技術,賺一包錢,回國創業
- 海龜有國際視野,打亞洲/世界杯市場
- 量變引起質變,產業需求放量,帶動供給 (國外輸入、大學培養)
- 產業升級,軟體工程水準↗,企業賺錢↗,薪水↗
有選擇才是真自由

Contenu connexe

Plus de Evans Ye

TensorFlow on Spark: A Deep Dive into Distributed Deep Learning
TensorFlow on Spark: A Deep Dive into Distributed Deep LearningTensorFlow on Spark: A Deep Dive into Distributed Deep Learning
TensorFlow on Spark: A Deep Dive into Distributed Deep LearningEvans Ye
 
2017 big data landscape and cutting edge innovations public
2017 big data landscape and cutting edge innovations public2017 big data landscape and cutting edge innovations public
2017 big data landscape and cutting edge innovations publicEvans Ye
 
ONE FOR ALL! Using Apache Calcite to make SQL smart
ONE FOR ALL! Using Apache Calcite to make SQL smartONE FOR ALL! Using Apache Calcite to make SQL smart
ONE FOR ALL! Using Apache Calcite to make SQL smartEvans Ye
 
The Apache Way: A Proven Way Toward Success
The Apache Way: A Proven Way Toward SuccessThe Apache Way: A Proven Way Toward Success
The Apache Way: A Proven Way Toward SuccessEvans Ye
 
The Apache Way
The Apache WayThe Apache Way
The Apache WayEvans Ye
 
Leveraging docker for hadoop build automation and big data stack provisioning
Leveraging docker for hadoop build automation and big data stack provisioningLeveraging docker for hadoop build automation and big data stack provisioning
Leveraging docker for hadoop build automation and big data stack provisioningEvans Ye
 
Using the SDACK Architecture to Build a Big Data Product
Using the SDACK Architecture to Build a Big Data ProductUsing the SDACK Architecture to Build a Big Data Product
Using the SDACK Architecture to Build a Big Data ProductEvans Ye
 
Trend Micro Big Data Platform and Apache Bigtop
Trend Micro Big Data Platform and Apache BigtopTrend Micro Big Data Platform and Apache Bigtop
Trend Micro Big Data Platform and Apache BigtopEvans Ye
 
How bigtop leveraged docker for build automation and one click hadoop provis...
How bigtop leveraged docker for build automation and  one click hadoop provis...How bigtop leveraged docker for build automation and  one click hadoop provis...
How bigtop leveraged docker for build automation and one click hadoop provis...Evans Ye
 
How bigtop leveraged docker for build automation and one click hadoop provis...
How bigtop leveraged docker for build automation and  one click hadoop provis...How bigtop leveraged docker for build automation and  one click hadoop provis...
How bigtop leveraged docker for build automation and one click hadoop provis...Evans Ye
 
BigTop vm and docker provisioner
BigTop vm and docker provisionerBigTop vm and docker provisioner
BigTop vm and docker provisionerEvans Ye
 
Docker workshop
Docker workshopDocker workshop
Docker workshopEvans Ye
 
Fits docker into devops
Fits docker into devopsFits docker into devops
Fits docker into devopsEvans Ye
 
Getting involved in world class software engineering tips and tricks to join ...
Getting involved in world class software engineering tips and tricks to join ...Getting involved in world class software engineering tips and tricks to join ...
Getting involved in world class software engineering tips and tricks to join ...Evans Ye
 
Deep dive into enterprise data lake through Impala
Deep dive into enterprise data lake through ImpalaDeep dive into enterprise data lake through Impala
Deep dive into enterprise data lake through ImpalaEvans Ye
 
How we lose etu hadoop competition
How we lose etu hadoop competitionHow we lose etu hadoop competition
How we lose etu hadoop competitionEvans Ye
 
Network Traffic Search using Apache HBase
Network Traffic Search using Apache HBaseNetwork Traffic Search using Apache HBase
Network Traffic Search using Apache HBaseEvans Ye
 
Building hadoop based big data environment
Building hadoop based big data environmentBuilding hadoop based big data environment
Building hadoop based big data environmentEvans Ye
 
Hdfs ha using journal nodes
Hdfs ha using journal nodesHdfs ha using journal nodes
Hdfs ha using journal nodesEvans Ye
 

Plus de Evans Ye (20)

TensorFlow on Spark: A Deep Dive into Distributed Deep Learning
TensorFlow on Spark: A Deep Dive into Distributed Deep LearningTensorFlow on Spark: A Deep Dive into Distributed Deep Learning
TensorFlow on Spark: A Deep Dive into Distributed Deep Learning
 
2017 big data landscape and cutting edge innovations public
2017 big data landscape and cutting edge innovations public2017 big data landscape and cutting edge innovations public
2017 big data landscape and cutting edge innovations public
 
ONE FOR ALL! Using Apache Calcite to make SQL smart
ONE FOR ALL! Using Apache Calcite to make SQL smartONE FOR ALL! Using Apache Calcite to make SQL smart
ONE FOR ALL! Using Apache Calcite to make SQL smart
 
The Apache Way: A Proven Way Toward Success
The Apache Way: A Proven Way Toward SuccessThe Apache Way: A Proven Way Toward Success
The Apache Way: A Proven Way Toward Success
 
The Apache Way
The Apache WayThe Apache Way
The Apache Way
 
Leveraging docker for hadoop build automation and big data stack provisioning
Leveraging docker for hadoop build automation and big data stack provisioningLeveraging docker for hadoop build automation and big data stack provisioning
Leveraging docker for hadoop build automation and big data stack provisioning
 
Using the SDACK Architecture to Build a Big Data Product
Using the SDACK Architecture to Build a Big Data ProductUsing the SDACK Architecture to Build a Big Data Product
Using the SDACK Architecture to Build a Big Data Product
 
Trend Micro Big Data Platform and Apache Bigtop
Trend Micro Big Data Platform and Apache BigtopTrend Micro Big Data Platform and Apache Bigtop
Trend Micro Big Data Platform and Apache Bigtop
 
How bigtop leveraged docker for build automation and one click hadoop provis...
How bigtop leveraged docker for build automation and  one click hadoop provis...How bigtop leveraged docker for build automation and  one click hadoop provis...
How bigtop leveraged docker for build automation and one click hadoop provis...
 
How bigtop leveraged docker for build automation and one click hadoop provis...
How bigtop leveraged docker for build automation and  one click hadoop provis...How bigtop leveraged docker for build automation and  one click hadoop provis...
How bigtop leveraged docker for build automation and one click hadoop provis...
 
BigTop vm and docker provisioner
BigTop vm and docker provisionerBigTop vm and docker provisioner
BigTop vm and docker provisioner
 
Docker workshop
Docker workshopDocker workshop
Docker workshop
 
Fits docker into devops
Fits docker into devopsFits docker into devops
Fits docker into devops
 
Getting involved in world class software engineering tips and tricks to join ...
Getting involved in world class software engineering tips and tricks to join ...Getting involved in world class software engineering tips and tricks to join ...
Getting involved in world class software engineering tips and tricks to join ...
 
Deep dive into enterprise data lake through Impala
Deep dive into enterprise data lake through ImpalaDeep dive into enterprise data lake through Impala
Deep dive into enterprise data lake through Impala
 
How we lose etu hadoop competition
How we lose etu hadoop competitionHow we lose etu hadoop competition
How we lose etu hadoop competition
 
Network Traffic Search using Apache HBase
Network Traffic Search using Apache HBaseNetwork Traffic Search using Apache HBase
Network Traffic Search using Apache HBase
 
Vagrant
VagrantVagrant
Vagrant
 
Building hadoop based big data environment
Building hadoop based big data environmentBuilding hadoop based big data environment
Building hadoop based big data environment
 
Hdfs ha using journal nodes
Hdfs ha using journal nodesHdfs ha using journal nodes
Hdfs ha using journal nodes
 

非常人走非常路:參與ASF打世界杯比賽