apache open source (bay area k group)
TRANSCRIPT
OSS developer == hacker ?
Who I am● 1999 (18 yr): SNU political science major● 2006 (25 yr): UWaterloo with no prior programming
experience● 2012 (31 yr): Cloudera with no prior OSS experience● 2012 (31 yr): Apache Pig and Sqoop committer● 2013 (32 yr): Apache Pig PMC member
Anyone can become an OSS developer!
Apache Software Foundation
Koreans in the ASF
● Apache Hama: 윤진석● Apache Hive: 류승우● Apache Pig: 박철수● Apache Tajo: 최현식
How the ASF worksASFBoard of Directors
ProjectManagementCommittee
PodlingProjectManagementCommittee
Top-level Projects Incubator Projects
Roles
User
Contributor
Committer
PMC member
PMC chair
Apache Pig
Apache Pig
1st gen high-level language on Hadoop● Apache Hive (SQL)● Apache Pig (Pig Latin)
2nd gen high-level language on Hadoop● Scalding (Scalar)● Cascalog (Clojure)
Contribution
● Help others on user mailing list○ [email protected]
● Discuss issues on dev mailing list○ [email protected]
● Contribute and review patches● Give a tech talk on the project● Write a book about the project
Votes
Timeline
2012/05: First patch committed2012/11: Committer (35+ patches)2013/11: PMC member (100+ patches)
Milestone
Pig on Tez (PIG-3446)● Apache Tez is new data processing framework on
Hadoop 2.0 (YARN).● Apache Hive and Pig are replacing MR backend with
Tez backend.● Collaboration of 5 engineers from Hortonworks,
LinkedIn, Netflix, and Yahoo.
OSS developer == poor ?
OSS at Netflix
● Netflix OSS○ http://netflix.github.io/#repo
● Apache OSS○ Curator (ZooKeeper library)○ Hadoop○ Hive○ Pig
Sell OSS at work
● Sell an idea inside company○ “I will make ETL process 2x faster in 1 year.”
● Sell an idea inside community○ “I will implement Pig on Tez. Interested?”
● Fight back skepticism and doubts○ “Is it a good idea to rely on OSS community?”○ “Is Cheolsoo really doing any work?”
Be strategic
● Grow out of your employer○ How?
■ Build reputation in community■ Give talks at conferences
○ Why?■ Enhance negotiating power ■ Stay independent from manager
Be passionate
Believe in the Apache way
Question?