SlideShare une entreprise Scribd logo
1  sur  20
TopCoder
Developing software through crowdsourcing
How TopCoder came
about?Jack Hughes
Tallan Inc. (Business
Data Services)
Sold for $920M
Lessons learnt from
Tallan?
Not happy with the operations of Tallan
Expensive and time consuming recruitment
process
Evolving technologies results in high employee
turnover rate
More can be done to save clients time and money
Crowdsourcing was the solution!
TopCoder v1.0
Consulting Business Model
Host competitions with monetary rewards from
sponsors
Build community strength
Gain popularity
Winner gets a job with the sponsor
HR firm
• Looking to
hire
Client
• Held
Competitions
TopCoder • Winner got
hired
Crowd
TopCoder v2.0
Competition Based Model
Crowd sourcing Software Development
Tasks of Software Development Process
Task
Conceptual
ization
Specificatio
n
Architec
ture
Component
Production
Application
Assembly
Certific
ation
Deploy
ment
v.2.0 PM PM PM COM PM PM PM
• Looking for
software
application
Client
• Held
Competitions
TopCoder • Winner got
rewarded
Crowd
TopCoder v2.1
Competition Based Model
Dissatisfied with $20 mln in revenue
Platform Managers costs too high
Tasks of Software Development Process
• Looking for
software
application
Client
• Held
Competitions
TopCoder • Winner got
rewarded
Crowd
Task
Conceptual
ization
Specificatio
n
Architec
ture
Component
Production
Application
Assembly
Certific
ation
Deploy
ment
v.2.0 PM PM PM COM PM PM PM
v2.1 PM & COM PM & COM COM COM COM PM
PM &
COM
Did it work?
2007 2008 2009
Total Revenue
(million)
$18.31 $18.75 $8.44
Cost of Platform
Managers
(million)
$4.89 $4.59 $1.88
Cost of PM vs
TR (%)
26.7% 24.5% 22.3%
Decrease in contest from 2008 to 2009
Switched from hourly based consultation to monthly
fee
Types of Competition
Algorithm Competition
Attract new members
Retain existing members
Software Development Competition
Provide clients with specific solutions
Expand TopCoder’s catalog
Algorithm Competitions
Timed competitions
Available in Java, C#, C++ & VB.Net
Single Round Match consists:
Coding Phase
Challenging Phase
System Testing Phase
Algorithm Competitions
Coding Phase
Lasts 75 mins
Contestants presented with the same 3 questions
Points awarded for successfully compiled solutions
Total time elapsed
Challenging Phase
Lasts 15 mins
Challenge the functionality of other competitors’ code
Successful challenge:
Defendant – loss of original submission points
Challenger – 50 point reward
Unsuccessful challenge:
Challenger – reduction of 25 points
Algorithm Competitions
System Testing Phase
Applied to all submitted code (not successfully
challenged)
Flawed code submission will lose all points
Automated tester applies a set of inputs
if submission’s output does not match expected
output, submission is considered flawed
All successful challenges will be added to the set of
inputs for the System Testing Phase
Example of an Algorithm
Competition
Example of Algorithm
Competition
011100011
Encrypt by adding to each digit to the sum of the
adjacent digits
[0+1], [0+1+1], [1+1+1] etc.
123210122
How does it attract & retain the
TopCoder Community
Think about your lab practices/tests
Challenging
Prove your worth
Self improvement
Community
TopCoder Community Activeness & Earning
Distribution
Latent
Pool
Normal
Active
Pool
82.5% 17.5% 95%
5%
Motivating the Community
Money is the most attractive thing
TopCoder ratings
How to motivate the latent
pool?
Monetary Award
$50 for successful compilation of code by latent
pool (for 5 rounds)
1.5 times prize money if they are the winner
Prospective Jobs

Contenu connexe

Similaire à Top coder

3.10.22 Philly Basis Presentation.pptx
3.10.22 Philly Basis Presentation.pptx3.10.22 Philly Basis Presentation.pptx
3.10.22 Philly Basis Presentation.pptxsaikrishnap14
 
Top Coder Platform Overview 92209
Top Coder Platform Overview 92209Top Coder Platform Overview 92209
Top Coder Platform Overview 92209Brian
 
Making the Move to Behavior Driven Development
Making the Move to Behavior Driven DevelopmentMaking the Move to Behavior Driven Development
Making the Move to Behavior Driven DevelopmentQASymphony
 
[Sample Question] Salesforce Certified Integration Architect Exam
[Sample Question] Salesforce Certified Integration Architect Exam[Sample Question] Salesforce Certified Integration Architect Exam
[Sample Question] Salesforce Certified Integration Architect ExamAdinaCoyle
 
Acceptance Test Driven Development at StarWest 2014
Acceptance Test Driven Development at StarWest 2014Acceptance Test Driven Development at StarWest 2014
Acceptance Test Driven Development at StarWest 2014jaredrrichardson
 
Quality Jam: BDD, TDD and ATDD for the Enterprise
Quality Jam: BDD, TDD and ATDD for the EnterpriseQuality Jam: BDD, TDD and ATDD for the Enterprise
Quality Jam: BDD, TDD and ATDD for the EnterpriseQASymphony
 
QSDA2022: Qlik Sense Data Architect | Q & A
QSDA2022: Qlik Sense Data Architect | Q & AQSDA2022: Qlik Sense Data Architect | Q & A
QSDA2022: Qlik Sense Data Architect | Q & APalakMazumdar1
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity Software Ireland
 
Coghead Overview 21 Aug08
Coghead Overview 21 Aug08Coghead Overview 21 Aug08
Coghead Overview 21 Aug08Tomoaki Sawada
 
Test & Dynamics CRM - extremeCRM Berlin 2012
Test & Dynamics CRM - extremeCRM Berlin 2012Test & Dynamics CRM - extremeCRM Berlin 2012
Test & Dynamics CRM - extremeCRM Berlin 2012Wael Hamze
 
Quantifying DevOps Adoption Empirically for Demonstrable ROI
Quantifying DevOps Adoption Empirically for Demonstrable ROIQuantifying DevOps Adoption Empirically for Demonstrable ROI
Quantifying DevOps Adoption Empirically for Demonstrable ROIDevOps for Enterprise Systems
 
How to Prepare for Product Based Companies?
How to Prepare for Product Based Companies?How to Prepare for Product Based Companies?
How to Prepare for Product Based Companies?Joel Kingsley
 
Develop a Defect Prevention Strategy—or Else!
Develop a Defect Prevention Strategy—or Else!Develop a Defect Prevention Strategy—or Else!
Develop a Defect Prevention Strategy—or Else!TechWell
 
Quality and Cost Management: Methods and Results
Quality and Cost Management: Methods and ResultsQuality and Cost Management: Methods and Results
Quality and Cost Management: Methods and Resultstimwrodgers
 
Lessons learned from measuring software development processes
Lessons learned from measuring software development processesLessons learned from measuring software development processes
Lessons learned from measuring software development processesMarkus Unterauer
 

Similaire à Top coder (20)

Top coder
Top coderTop coder
Top coder
 
3.10.22 Philly Basis Presentation.pptx
3.10.22 Philly Basis Presentation.pptx3.10.22 Philly Basis Presentation.pptx
3.10.22 Philly Basis Presentation.pptx
 
Top Coder Platform Overview 92209
Top Coder Platform Overview 92209Top Coder Platform Overview 92209
Top Coder Platform Overview 92209
 
Making the Move to Behavior Driven Development
Making the Move to Behavior Driven DevelopmentMaking the Move to Behavior Driven Development
Making the Move to Behavior Driven Development
 
[Sample Question] Salesforce Certified Integration Architect Exam
[Sample Question] Salesforce Certified Integration Architect Exam[Sample Question] Salesforce Certified Integration Architect Exam
[Sample Question] Salesforce Certified Integration Architect Exam
 
Acceptance Test Driven Development at StarWest 2014
Acceptance Test Driven Development at StarWest 2014Acceptance Test Driven Development at StarWest 2014
Acceptance Test Driven Development at StarWest 2014
 
Atdd half day_new_1_up
Atdd half day_new_1_upAtdd half day_new_1_up
Atdd half day_new_1_up
 
Quality Jam: BDD, TDD and ATDD for the Enterprise
Quality Jam: BDD, TDD and ATDD for the EnterpriseQuality Jam: BDD, TDD and ATDD for the Enterprise
Quality Jam: BDD, TDD and ATDD for the Enterprise
 
QSDA2022: Qlik Sense Data Architect | Q & A
QSDA2022: Qlik Sense Data Architect | Q & AQSDA2022: Qlik Sense Data Architect | Q & A
QSDA2022: Qlik Sense Data Architect | Q & A
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
 
Spi Cost Roi
Spi Cost RoiSpi Cost Roi
Spi Cost Roi
 
Coghead Overview 21 Aug08
Coghead Overview 21 Aug08Coghead Overview 21 Aug08
Coghead Overview 21 Aug08
 
Test & Dynamics CRM - extremeCRM Berlin 2012
Test & Dynamics CRM - extremeCRM Berlin 2012Test & Dynamics CRM - extremeCRM Berlin 2012
Test & Dynamics CRM - extremeCRM Berlin 2012
 
Quantifying DevOps Adoption Empirically for Demonstrable ROI
Quantifying DevOps Adoption Empirically for Demonstrable ROIQuantifying DevOps Adoption Empirically for Demonstrable ROI
Quantifying DevOps Adoption Empirically for Demonstrable ROI
 
How to Prepare for Product Based Companies?
How to Prepare for Product Based Companies?How to Prepare for Product Based Companies?
How to Prepare for Product Based Companies?
 
Develop a Defect Prevention Strategy—or Else!
Develop a Defect Prevention Strategy—or Else!Develop a Defect Prevention Strategy—or Else!
Develop a Defect Prevention Strategy—or Else!
 
Quality and Cost Management: Methods and Results
Quality and Cost Management: Methods and ResultsQuality and Cost Management: Methods and Results
Quality and Cost Management: Methods and Results
 
presentation
presentationpresentation
presentation
 
Lessons learned from measuring software development processes
Lessons learned from measuring software development processesLessons learned from measuring software development processes
Lessons learned from measuring software development processes
 
Automatied Testing QA
Automatied Testing QAAutomatied Testing QA
Automatied Testing QA
 

Top coder

  • 2. How TopCoder came about?Jack Hughes Tallan Inc. (Business Data Services) Sold for $920M
  • 3. Lessons learnt from Tallan? Not happy with the operations of Tallan Expensive and time consuming recruitment process Evolving technologies results in high employee turnover rate More can be done to save clients time and money Crowdsourcing was the solution!
  • 4. TopCoder v1.0 Consulting Business Model Host competitions with monetary rewards from sponsors Build community strength Gain popularity Winner gets a job with the sponsor HR firm • Looking to hire Client • Held Competitions TopCoder • Winner got hired Crowd
  • 5. TopCoder v2.0 Competition Based Model Crowd sourcing Software Development Tasks of Software Development Process Task Conceptual ization Specificatio n Architec ture Component Production Application Assembly Certific ation Deploy ment v.2.0 PM PM PM COM PM PM PM • Looking for software application Client • Held Competitions TopCoder • Winner got rewarded Crowd
  • 6. TopCoder v2.1 Competition Based Model Dissatisfied with $20 mln in revenue Platform Managers costs too high Tasks of Software Development Process • Looking for software application Client • Held Competitions TopCoder • Winner got rewarded Crowd Task Conceptual ization Specificatio n Architec ture Component Production Application Assembly Certific ation Deploy ment v.2.0 PM PM PM COM PM PM PM v2.1 PM & COM PM & COM COM COM COM PM PM & COM
  • 7. Did it work? 2007 2008 2009 Total Revenue (million) $18.31 $18.75 $8.44 Cost of Platform Managers (million) $4.89 $4.59 $1.88 Cost of PM vs TR (%) 26.7% 24.5% 22.3% Decrease in contest from 2008 to 2009 Switched from hourly based consultation to monthly fee
  • 8. Types of Competition Algorithm Competition Attract new members Retain existing members Software Development Competition Provide clients with specific solutions Expand TopCoder’s catalog
  • 9.
  • 10. Algorithm Competitions Timed competitions Available in Java, C#, C++ & VB.Net Single Round Match consists: Coding Phase Challenging Phase System Testing Phase
  • 11. Algorithm Competitions Coding Phase Lasts 75 mins Contestants presented with the same 3 questions Points awarded for successfully compiled solutions Total time elapsed Challenging Phase Lasts 15 mins Challenge the functionality of other competitors’ code Successful challenge: Defendant – loss of original submission points Challenger – 50 point reward Unsuccessful challenge: Challenger – reduction of 25 points
  • 12. Algorithm Competitions System Testing Phase Applied to all submitted code (not successfully challenged) Flawed code submission will lose all points Automated tester applies a set of inputs if submission’s output does not match expected output, submission is considered flawed All successful challenges will be added to the set of inputs for the System Testing Phase
  • 13.
  • 14. Example of an Algorithm Competition
  • 15. Example of Algorithm Competition 011100011 Encrypt by adding to each digit to the sum of the adjacent digits [0+1], [0+1+1], [1+1+1] etc. 123210122
  • 16. How does it attract & retain the TopCoder Community Think about your lab practices/tests Challenging Prove your worth Self improvement
  • 17. Community TopCoder Community Activeness & Earning Distribution Latent Pool Normal Active Pool 82.5% 17.5% 95% 5%
  • 18. Motivating the Community Money is the most attractive thing TopCoder ratings
  • 19.
  • 20. How to motivate the latent pool? Monetary Award $50 for successful compilation of code by latent pool (for 5 rounds) 1.5 times prize money if they are the winner Prospective Jobs

Notes de l'éditeur

  1. http://news.cnet.com/CMGI-to-buy-Tallan-for-920-million/2100-12_3-264732.html