SlideShare une entreprise Scribd logo
1  sur  26
Télécharger pour lire hors ligne
CMMI® for
SCAMPISM Cl
          Class A A
                  Appraisal R
                       i l Results
                               lt
2011 Mid-Year Update



Software Engineering Institute
Carnegie Mellon University
Pittsburgh, PA 15213


September 2011




                      CMMI-SCAMPI v1.2/v1.3 Class A
                      Appraisal Results © 2011 Carnegie Mellon University
                                                                        1
                      September 2011
                      © 2011 Carnegie Mellon University
Outline

Introduction
Current Status
Community Trends
Organizational Trends
Summary and Terms Used in this Briefing




This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all
organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification
purposes.
The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead
appraisers, team leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization
is a “certifying authority” of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be
used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported
results of the use of CMMI products and services only.



                                                                                             CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                             Appraisal Results
                                                                                                                                   2
                                                                                             September 2011
                                                                                             © 2011 Carnegie Mellon University
Introduction - Purpose

Characterize the adoption of CMMI

Describe results from Standard CMMI Appraisal Method for Process
Improvement (SCAMPISM) v1.2/v1.3 Class A appraisals using Capability
Maturity Model® Integration (CMMI v1.2/ v1.3)*




* Organizations previously appraised against CMMI v1.0 /v1.1 and which have not reappraised against v1.2 or v1.3
  are not included in this report.


* SVC,ACQ appraisals are included in this report, P-CMM appraisals are not included in this report,




                                                                                  CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                  Appraisal Results
                                                                                                                      3
                                                                                  September 2011
                                                                                  © 2011 Carnegie Mellon University
Introduction - Briefing Contents

This briefing includes three primary sections:

1.
1 Current Status
 • Snapshot of the development community based on the most recent
   appraisals, since SCAMPI V 1.2 release, of reporting organizations

2. Community Trends
 • Global distribution of appraisals
 •G
  Growth in th number of appraisals performed
      th i the    b    f      i l      f    d
 • Shifts in the maturity profile over time

3.
3 Organizational Trends
 • Time to move up in maturity based on change in maturity level and time
   between appraisals

                                                       CMMI-SCAMPI v1.2/v1.3 Class A
                                                       Appraisal Results
                                                                                           4
                                                       September 2011
                                                       © 2011 Carnegie Mellon University
Process Maturity Profile
                          by All Reporting Organizations
                           3600
                           3400
                           3200
                           3000
                           2800
                                                                                  65.4%
                 ations




                           2600
                           2400
Number of Organiza




                           2200
                           2000
                           1800
                           1600
                           1400
     r




                           1200
                                                                          23.4%
                           1000
                            800
                            600
                            400
                                        4.0%                                                                                 5.1%
                            200                           0.5%                                   1.6%
                              0
                                     Not Given          Initial         Managed   Defined   Quantitatively               Optimizing
                                                                                             Managed

                          Based on most recent appraisal of 4220 organizations
                                                                                             CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                             Appraisal Results
                                                                                                                                      5
                                                                                             September 2011
                                                                                             © 2011 Carnegie Mellon University
Process Maturity Profile (SVC Only)
                        by All Reporting Organizations
                         50




                         40
            nizations
Numb of Organ




                         30

                                                                                                        51.0%
   ber




                                                                              42.9%
                         20




                         10


                                            6.1%


                           0
                                          Not Given                          Managed                   Defined

                        Based on most recent appraisal of 49 organizations
                                                                                       CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                       Appraisal Results
                                                                                                                           6
                                                                                       September 2011
                                                                                       © 2011 Carnegie Mellon University
Reporting Organization Categories


      Commercial/In-house                                                               80.5%




           Contractor for
       Military/Government
                                         15.8%




Military/Government Agency        3.7%




                             0             1000            2000            3000                   4000            5000

                                                          Number of Organizations
                                                                      g
Based on 4220 organizations reporting an organization category
                                                                              CMMI-SCAMPI v1.2/v1.3 Class A
                                                                              Appraisal Results
                                                                                                                         7
                                                                              September 2011
                                                                              © 2011 Carnegie Mellon University
Process Maturity Profile
                                     by Reporting Organization Categories
                                      100%


                                       90%                                                                                           Commercial/In-house = 3356
                                                                                                                                     C      i l/I h
            ations Within Category




                                                                                                                                     Contractor for Military/Government = 659
                                       80%
                                                                                                                                     Military/Government Agency = 153

                                       70%
                                                                                                             61.7%
                                       60%                                                                           58.3%



                                       50%
                                                                                                     43.1%
                                                                                                                             39.9%
% of Organiza




                                       40%


                                       30%                                                   27.6%


                                                                                     20.4%
                                       20%
                                                            15.7%


                                       10%
                                                                                                                                                                             5.8%
                                                3.5% 2.9%                                                                                                            4.6%
                                                                                                                                          1.9%                                      2.6%
                                                                    0.4% 0.2% 0.7%                                                               0.3% 1.3%
                                         0%
                                                 Not Given              Initial        Managed                  Defined                  Quantitatively               Optimizing
                                                                                                                                          Managed

                                     Based on most recent appraisal of 4168 organizations reporting an organization category
                                                                                                                                         CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                                                                         Appraisal Results
                                                                                                                                                                                           8
                                                                                                                                         September 2011
                                                                                                                                         © 2011 Carnegie Mellon University
Organization Size
Based on the total number of employees within the area of the organization that was appraised


                                                   1001 to 2000
                           501 to 1000                1.9%
                                                                                   2000+
                              4.0%
                              4 0%                                                  1.6%
                                                                                    1 6%



              301 to 500
                5.4%                                                                                        25 or fewer
                                                                                                               20.3%


              201 to 300                         201 to 2000+
                5.8%
                                                    18.6%



                                           101 to 200                        1 to 100
                                             15.1%
                                             15 1%                            66.3%
                                                                              66 3%




                                                                                                         26 to 50
                                                                                                                0
                                                                                                          25.9%
                               76 to 100
                                 7.6%



                                                                  51 to 75
                                                                   12.6%
                                                                   12 6%
Based on   4197 organizations reporting size data
                                                                                           CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                           Appraisal Results
                                                                                                                               9
                                                                                           September 2011
                                                                                           © 2011 Carnegie Mellon University
Organization Size (SVC Only)
Based on the total number of employees within the area of the organization that was appraised

                                       1001 to 2000          2000+
                                          2.0%               4.1%

             501 to 1000
               12.2%
               12 2%




                                              201 to 2000+
                                                 32.7%                                          25 or f
                                                                                                      fewer
301 to 500                                                                                         49.0%
  6.1%




     201 to 300                                        1 to 100
       8.2%                                             65.3%

             101 to 200
               2.0%

                           76 to 100
                             2.0%
                                            51 to 75
                                             4.1%
                                                              26 to 50
                                                               10.2%



Based on 49 organizations reporting size data
                                                                         CMMI-SCAMPI v1.2/v1.3 Class A
                                                                         Appraisal Results
                                                                                                              10
                                                                         September 2011
                                                                         © 2011 Carnegie Mellon University
Maturity Profile by Organization Size
                             Based on the total number of employees within the area of the organization that was appraised

                               100%


                                90%
% of Organizations by Size




                                80%
                                                                                   72.4%




                                                                                                             69.8%




                                                                                                                                     68.5%




                                                                                                                                                                 68.3%




                                                                                                                                                                                                                               68.1%
                                70%




                                                                                                                                                                                                                                                                                                           61.5%
                                                                                                                                                                                                0.2%
                 s




                                                                                                                                                                                                                                                                     57.2%
                                                                                                                                                                                               60




                                                                                                                                                                                                                                                                                                           6




                                                                                                                                                                                                                                                                                                                                         54.5%
                                                          53.8%




                                60%


                                50%
                                                  40.7%




                                                                                                                                                                                                                                                                                                                                                   39.4%
                                40%
                                  %
     O




                                30%
                                                                                                     23.1%




                                                                                                                                                                                                                                                                                                                   23.1%
                                                                           22.5%




                                                                                                                                                                                                                                                                                    22.3%
                                                                                                                             20.2%




                                                                                                                                                                                       18.0%
                                                                                                                                                         17.2%




                                                                                                                                                                                                                                                             13.9%
                                20%




                                                                                                                                                                                                                                              12.8%
                                                                                                                                                                                                                       11.1%




                                                                                                                                                                                                                                                                                            10.3%
                                                                                                                                                                                                                         %
                                                                                                                                                                                                                      9.8%




                                                                                                                                                                                                                                              1
                                                                                                                                                                                7.4%




                                                                                                                                                                                                                                                      6.0%
                                                                                                                                                                               5.8%
                                                                                                                                                  5.4%




                                                                                                                                                                                                                  5.3%




                                                                                                                                                                                                                                                                                                    5.1%
                                                                                                                                                 4.7%




                                10%
                                                                                                                                                                                                       4.1%
                                           4.0%




                                                                                                                                                3.5%
                                                                                              3.2%




                                                                                                                                                                                                                                                                                                                           3.0%
                                                                                                                                                                            3.0%
                                                                    2.6%




                                                                                                                      2.5%




                                                                                                                                                                                                                                       2.2%
                                                                                                                     2.1%
                                                                                                                     1.5%




                                                                                                                                                                                                                                                                                                                                  1.5%
                                                                                            1.1%
                                                                                           1.0%




                                                                                                                                             0.9%




                                                                                                                                                                                                                                                                             0.6%
                                        0.6%



                                                                  0.6%

                                                                  0.5%




                                                                                                                                                                                                              0.4%
                                                                                                                                                                         0.4%
                                                                                           0.4%
                                                                  0.4%




                                                                                                                                                                                                                                                                                                                                            1.5%
                                 0%
                                         25 or fewer                  26 to 50                  51 to 75                 76 to 100                 101 to 200                   201 to 300                          301 to 500                         501 to 1000 1001 to 2000                                                   2000+
                                                                     Not Given                   Initial                 Managed                    Defined                       Quantitatively Managed                                                              Optimizing

                             Based on    4197 organizations reporting size data
                                                                                                                                                                                                                                                        CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                                                                                                                                                                                        Appraisal Results
                                                                                                                                                                                                                                                                                                                                                           11
                                                                                                                                                                                                                                                        September 2011
                                                                                                                                                                                                                                                        © 2011 Carnegie Mellon University
USA and Non-USA
Reporting Organization Categories

                                                        316
     Commercial/In
     Commercial/In-
        house                                                                                                    3040




    Contractor for                                                    468
 Military/Government
                                 191




                                                                            USA: 100% = 864

                                                                            Non-USA: 100% = 3304
                                       80
 Military/Government
        Agency              73




                       0%        10%        20%   30%   40%    50%      60%       70%        80%          90%           100%

                                                         % of Organizations



                                                                                    CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                    Appraisal Results
                                                                                                                               12
                                                                                    September 2011
                                                                                    © 2011 Carnegie Mellon University
Maturity Profile by All Reporting
             Organizations in the USA
                      100%


                       90%


                       80%
% of Organizations




                       70%


                       60%
                                                                        453
                       50%


                       40%                                    317

                       30%


                       20%


                       10%         56
                                                                                                                 41
                                                      1
                                                                                        2
                        0%
                                Not Given          Initial   Managed   Defined   Quantitatively              Optimizing
                                                                                        g
                                                                                  Managed

                     Based on 870 organizations in the USA
                                                                                 CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                 Appraisal Results
                                                                                                                          13
                                                                                 September 2011
                                                                                 © 2011 Carnegie Mellon University
Maturity Profile by All Reporting
                     Organizations based outside the USA
                     100%


                      90%


                      80%
            ations




                                                                              2305
                      70%
% of Organiza




                      60%


                      50%


                      40%


                      30%

                                                                    672
                      20%


                      10%                                                                                                  176
                                   111
                                                                                             67
                                                    19
                       0%
                                Not Given         Initial          Managed   Defined   Quantitatively              Optimizing
                                                                                         Managed
                     Based on 3350 organizations outside the USA

                                                                                       CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                       Appraisal Results
                                                                                                                                 14
                                                                                       September 2011
                                                                                       © 2011 Carnegie Mellon University
Section 2—Community Trends

Appraisals are conducted through June 2011 and reported to the SEI by
July 2011

• 73 countries reporting appraisals
  – Most of the appraisals are from Asia and North America.

• 4612 Appraisals posted on PARS
  – Expired appraisals are removed from PARS and replaced with the newest
    reappraisal result.




                                                     CMMI-SCAMPI v1.2/v1.3 Class A
                                                     Appraisal Results
                                                                                         15
                                                     September 2011
                                                     © 2011 Carnegie Mellon University
Countries Where Appraisals Have Been
 Performed and Reported to the SEI




Argentina   Australia     Austria     Bahrain       Bangladesh Belgium                   Brazil                Brunei Darussalam
Bulgaria    Canada        Chile       China         Colombia      Costa Rica             Czech Republic        Denmark
Egypt       Finland       France      Germany       Greece        Guatemala              Hong Kong             Hungary
India       Indonesia     Ireland     Israel        Italy         Japan                  Jordan                Korea,
                                                                                                               Korea Republic Of
Latvia      Lebanon       Lithuania Luxembourg      Macedonia     Malaysia               Mauritius             Mexico
Morocco     Nepal         Netherlands New Zealand   Norway        Pakistan               Panama                Paraguay
Peru        Philippines   Poland      Portugal      Qatar         Romania                Russia                Saudi Arabia
Singapore   Slovakia      South AfricaSpain         Sri Lanka     Sweden                 Switzerland           Taiwan
Thailand    Tunisia       Turkey      Ukraine       United Arab E United Kingdom         United States         Uruguay
Viet Nam
                               Red country name: New additions with this reporting since March 2011
                                                                                   CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                   Appraisal Results
                                                                                                                               16
                                                                                   September 2011
                                                                                   © 2011 Carnegie Mellon University
Number of Appraisals Reported to the SEI
              by Continent
                         4000



                         3500
           ppraisals




                         3000
                                                   2660

                         2500
                          500
 umber of Ap




                         2000



                         1500
Nu




                                                                                                1244


                         1000

                                                                                 580
                          500
                                                                                                                           295

                                     54                            13
                            0
                                   Africa          Asia         Australia       Europe      North America          South America

                       Based on 4846 appraisals
                       North America includes Canada the USA and Mexico; South America includes Central America and the
                                               Canada,    USA,
                       Caribbean ; Australia includes New Zealand
                                                                                                       CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                                       Appraisal Results
                                                                                                                                           17
                                                                                                       September 2011
                                                                                                       © 2011 Carnegie Mellon University
Number of Appraisals and Maturity Levels
Reported to the SEI by Country
                                   Maturity   Maturity   Maturity   Maturity Maturity                                      Maturity    Maturity   Maturity   Maturity   Maturity
                     Number of      Level 1    Level 2    Level 3    Level 4  Level 5                        Number of      Level 1     Level 2    Level 3    Level 4    Level 5
Country              Appraisals    Reported   Reported   Reported   Reported Reported Country                Appraisals    Reported    Reported   Reported   Reported   Reported
Argentina            66                       37         23                  2        Malaysia               45                       8           35                    2
Australia            11                       3          3                            Mauritius              10 or fewer
Austria              10 or fewer                                                      Mexico                 95                       43          45         1          5
Bahrain              10 or fewer                                                      Morocco                10 or fewer
Bangladesh           10 or fewer                                                      Nepal                  10 or fewer
Belgium              10 or fewer                                                      Netherlands            11            1          3           6
Brazil               125           1          67         48                  7        New Zealand            10 or fewer
Brunei Darussalam    10 or fewer                                                      Norway                 10 or fewer
Bulgaria             10 or fewer                                                      Pakistan               24            1          21          1                     1
Canada               30            1          9          12                  3        Panama                 10 or fewer
Chile                33            1          21         10                  1             g y
                                                                                      Paraguay               10 or fewer
China                1557                     63         1409       43       35       Peru                   18                       10          7
Colombia             40            1          15         8          3        5        Philippines            11                       1           4          1          4
Costa Rica           10 or fewer                                                      Poland                 10 or fewer
Czech Republic       10 or fewer                                                      Portugal               16                       6           9                     1
Denmark              10 or fewer                                                      Qatar                  10 or fewer
Egypt                40            1          24         11                  1        Romania                10 or fewer
Finland              10 or fewer                                                      Russia                 10 or fewer
France               111                      66         34                  1        Saudi Arabia           11                       2           6          1          1
Germany              55            6          19         16                           Singapore              14                       4           8          1
Greece               10 or fewer                                                      Slovakia               10 or fewer
Guatemala            10 or fewer                                                      South Africa           10 or fewer
Hong Kong            10 or fewer                                                      Spain                  186           1          106         62         2          4
Hungary              10 or fewer                                                      Sri Lanka              15                       2           13
India                462                      12         330        3        108      Sweden                 10 or fewer
Indonesia            10 or fewer                                                      Switzerland            10 or fewer
Ireland              10 or fewer                                                      Taiwan                 98            1          42          50         4
Israel               13                                  7                   4        Thailand               38                       12          25                    1
Italy                45                       18         23                           Tunisia                10 or fewer
Japan                165           7          39         85         6        7        Turkey                 22                                   19                    3
Jordan               10 or fewer                                                      Ukraine                10 or fewer
Korea, Republic Of   128                      49         59         10       4        United Arab Emirates   10 or fewer
Latvia               10 or fewer                                                      United Kingdom         74            1          21          26                    5
Lebanon              10 or fewer                                                      United States          1119          5          417         550        3          60
Lithuania            10 or fewer                                                      Uruguay
                                                                                         g y                 10 or fewer
Luxembourg           10 or fewer                                                      Viet Nam               17                                   14         1          2
Macedonia            10 or fewer

                                                                                                                               CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                                                               Appraisal Results
                                                                                                                                                                                   18
                                                                                                                               September 2011
                                                                                                                               © 2011 Carnegie Mellon University
Number of SCAMPI A Appraisals Reported to
              SEI by Year
                         1600

                                            TOTAL
                                                                    1375
                         1400                                                1349
                                            POSTED ON PARs
                                                                     1310    1299
             raisals




                         1200

                                                             1004
  mber of Appr




                         1000

                                                             941

                          800
Num




                          600                         556                                              551

                                                                                                        542
                                                       509
                          400



                          200

                                     11
                            0
                                     2006             2007   2008   2009    2010                       2011

                       Based on 4846 appraisals
                                                                            CMMI-SCAMPI v1.2/v1.3 Class A
                                                                            Appraisal Results
                                                                                                                19
                                                                            September 2011
                                                                            © 2011 Carnegie Mellon University
Trends in the Community Maturity Profile
                     100%


                       90%

                                                                                                                                                      2006                        11
                       80%
                                                                                                                                                      2007                      564
                                                                                                                                                      2008
           zations




                                                                                                                                                                               1516




                                                                                                                                  65.4%
                                                                                                                          64.6%
                       70%




                                                                                                    63.6%


                                                                                                                        62.9%
                                                                                                                                                      2009                     2770




                                                                                                                     8.2%
                                                                                                                                                      2010                    3,846
% of Organiz




                                                                                                                    58
                       60%
                                                                                                                                                      2011                    4,220




                                                                                                            47.9%
                       50%


                       40%
                                                                                    31.4%
                                                                                 28.2%




                                                                                                                                                                      27.3%
                                                                              25.1%

                                                                                            23.4%
                       30%
                                                                             23.8%


                       20%




                                                                                                                                                                                   9.4%
                                                                      9.1%
                                       9.0%
                                    6.1%




                                                                                                                                                                                          5.1%
                                                                                                                                                                               5.7%
                       10%




                                                                                                                                                                              5.2%
                                                                                                                                                                              5.1%
                                  4.9%

                                              4.0%
                                  4.4%




                                                                                                                                                         1.6%
                                                                                                                                               1.6%
                                                               0.5%




                                                                                                                                              1.3%
                                                      1.2%




                                                                                                                                              1.1%
                                                                                                                                              1.0%
                                                     0.8%
                                                     0.5%
                                                     0.4%




                        0%
                                 Not Given           Initial           Managed                          Defined Quantitatively ManagedOptimizing

                     Based on a cumulative view of the most recent appraisals of organizations up through the year indicated
                                                                                                                                          CMMI-SCAMPI v1.2/v1.3 Class A
                                                                                                                                          Appraisal Results
                                                                                                                                                                                                 20
                                                                                                                                          September 2011
                                                                                                                                          © 2011 Carnegie Mellon University
Time to Move Up


                        40


Number of months
to move to                                                                                            75th Percentile
next maturity           30
level                                                                     25.5
                                                                                                      Median

                                                                  21
                                              19
                        20
                                                                                                      25th Percentile



                        10
                                       5



           Time Period of Initial
                     Appraisal                        2006 to Present

                           Level    1 to 2   2 to 3              3 to 4    3 to 5

                             Orgs     7       146                 31        40



                                                                           CMMI-SCAMPI v1.2/v1.3 Class A
                                                                           Appraisal Results
                                                                                                                        21
                                                                           September 2011
                                                                           © 2011 Carnegie Mellon University
Summary -1

Since 2006, 4846 SCAMPI v1.2/1.3 appraisals have been reported to
the SEI.
Appraisals report from China, Spain, Brazil, Argentina, and India are
increasing at a rapid rate.

More than 66% of appraised organizational units have 100 or fewer
employees. The percentage is increasing steadily.

The majority of reported appraisals are maturity level 2 and 3
organizations.
The number of appraisals in the USA and China represent more than
55% of th t t l number of appraisals.
     f the total   b    f       i l
China is now reporting more appraisals than USA


                                                   CMMI-SCAMPI v1.2/v1.3 Class A
                                                   Appraisal Results
                                                                                       22
                                                   September 2011
                                                   © 2011 Carnegie Mellon University
Summary -2

For organizations that began their CMMI-based SCAMPI effort with V1.2
or later, the median time to move from
• maturity level 2 to 3 is 19 months

• maturity level 3 to 4 is 21 months

• maturity level 3 to 5 is 25.5 months




                                                CMMI-SCAMPI v1.2/v1.3 Class A
                                                Appraisal Results
                                                                                    23
                                                September 2011
                                                © 2011 Carnegie Mellon University
Terms Used in this Report

Company      - Parent of the appraised entity
               A company can be a commercial or non-commercial firm, for-profit or not
               for-profit business a research and development unit a higher education
                          business,                              unit,
               unit, a government agency, or branch of service, etc.

Organization - a.k.a. Appraised entity
              The organization unit to which the appraisal results apply. An appraised
              entity can be the entire company, a selected business unit, units
              supporting a particular product line or service, etc.

Non-USA      - Appraised entity whose geographic location is not within the United States.
               The parent of the appraised entity may or may not be based within the
               United States.

PARS         - Published Appraisal Results webpage contains CMMI® appraisals
               published at the request of the appraisal sponsor.
               The link is: http://sas.sei.cmu.edu/pars/

                                                              CMMI-SCAMPI v1.2/v1.3 Class A
                                                              Appraisal Results
                                                                                                  24
                                                              September 2011
                                                              © 2011 Carnegie Mellon University
Contact Information


SEI Customer Relations   (412) 268-5800
                               268 5800
SEI FAX number           (412) 268-5758

Internet Address         customer-relations@sei.cmu.edu
                                           @

Mailing Address          Customer Relations
                         Software Engineering Institute
                         Carnegie Mellon University
                         Pittsburgh, PA 15213-3890




                                            CMMI-SCAMPI v1.2/v1.3 Class A
                                            Appraisal Results
                                                                                25
                                            September 2011
                                            © 2011 Carnegie Mellon University
NO WARRANTY
THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE
MATERIAL IS FURNISHED ON AN “AS-IS" BASIS CARNEGIE MELLON UNIVERSITY
                             AS IS BASIS.
MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO
ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR
PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM
USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY
WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT,
TRADEMARK, OR COPYRIGHT INFRINGEMENT.
Use of any trademarks in this presentation is not intended in any way to infringe on the
rights of the trademark holder
                        holder.
This Presentation may be reproduced in its entirety, without modification, and freely
distributed in written or electronic form without requesting formal permission. Permission
is required for any other use. Requests for permission should be directed to the Software
Engineering Institute at permission@sei.cmu.edu.
This work was created in the performance of Federal Government Contract Number
FA8721-05-C-0003 with Carnegie Mellon University for the operation of the Software
Engineering Institute, a federally funded research and development center. The
Government of the United States has a royalty-free government-purpose license to use,
duplicate, or disclose the work, in whole or in part and in any manner, and to have or
permit others to do so, for government purposes pursuant to the copyright license under
the clause at 252.227-7013.

                                                                CMMI-SCAMPI v1.2/v1.3 Class A
                                                                Appraisal Results
                                                                                                    26
                                                                September 2011
                                                                © 2011 Carnegie Mellon University

Contenu connexe

En vedette

CMMI - High Maturity Misconceptions and Pitfalls
CMMI - High Maturity Misconceptions and PitfallsCMMI - High Maturity Misconceptions and Pitfalls
CMMI - High Maturity Misconceptions and Pitfalls
Rajesh Naik
 
Change Management Practices (Primavera BSS)plementing CMMI - Henrique Narciso
Change Management Practices (Primavera BSS)plementing CMMI - Henrique NarcisoChange Management Practices (Primavera BSS)plementing CMMI - Henrique Narciso
Change Management Practices (Primavera BSS)plementing CMMI - Henrique Narciso
Paula Gomes
 
Overview of cmmi v1.3
Overview of cmmi v1.3Overview of cmmi v1.3
Overview of cmmi v1.3
dp4824
 
Ch 7 integrating quality activities in the projectlife cycle
Ch 7 integrating quality activities in the projectlife cycleCh 7 integrating quality activities in the projectlife cycle
Ch 7 integrating quality activities in the projectlife cycle
Kittitouch Suteeca
 

En vedette (18)

it4116_04_scampi
it4116_04_scampiit4116_04_scampi
it4116_04_scampi
 
CMMI - High Maturity Misconceptions and Pitfalls
CMMI - High Maturity Misconceptions and PitfallsCMMI - High Maturity Misconceptions and Pitfalls
CMMI - High Maturity Misconceptions and Pitfalls
 
Change Management Practices (Primavera BSS)plementing CMMI - Henrique Narciso
Change Management Practices (Primavera BSS)plementing CMMI - Henrique NarcisoChange Management Practices (Primavera BSS)plementing CMMI - Henrique Narciso
Change Management Practices (Primavera BSS)plementing CMMI - Henrique Narciso
 
Ch 12(spi)cm mi scampi
Ch 12(spi)cm mi scampiCh 12(spi)cm mi scampi
Ch 12(spi)cm mi scampi
 
CMMI Project Planning Presentation
CMMI Project Planning PresentationCMMI Project Planning Presentation
CMMI Project Planning Presentation
 
Cmmi
CmmiCmmi
Cmmi
 
Overview of cmmi v1.3
Overview of cmmi v1.3Overview of cmmi v1.3
Overview of cmmi v1.3
 
5012621 cmmi
5012621 cmmi5012621 cmmi
5012621 cmmi
 
CMMI Explored - Concept of Maturity
 CMMI Explored - Concept of Maturity CMMI Explored - Concept of Maturity
CMMI Explored - Concept of Maturity
 
Applying Capability Maturity Model Integration (CMMI) for Your Company Proces...
Applying Capability Maturity Model Integration (CMMI) for Your Company Proces...Applying Capability Maturity Model Integration (CMMI) for Your Company Proces...
Applying Capability Maturity Model Integration (CMMI) for Your Company Proces...
 
CMMi = Scrum, Keynote, Recife May 08
CMMi = Scrum, Keynote, Recife May 08CMMi = Scrum, Keynote, Recife May 08
CMMi = Scrum, Keynote, Recife May 08
 
Capability Maturity Model Integrity (CMMI)
Capability Maturity Model Integrity (CMMI)Capability Maturity Model Integrity (CMMI)
Capability Maturity Model Integrity (CMMI)
 
Introduction to CMMI-DEV v1.3 - Day 1
Introduction to CMMI-DEV v1.3  - Day 1Introduction to CMMI-DEV v1.3  - Day 1
Introduction to CMMI-DEV v1.3 - Day 1
 
CMMI-DEV 1.3 Tool (checklist)
CMMI-DEV 1.3 Tool (checklist)CMMI-DEV 1.3 Tool (checklist)
CMMI-DEV 1.3 Tool (checklist)
 
Ch 7 integrating quality activities in the projectlife cycle
Ch 7 integrating quality activities in the projectlife cycleCh 7 integrating quality activities in the projectlife cycle
Ch 7 integrating quality activities in the projectlife cycle
 
Data-Ed Online: Data Management Maturity Model
Data-Ed Online: Data Management Maturity ModelData-Ed Online: Data Management Maturity Model
Data-Ed Online: Data Management Maturity Model
 
Capability maturity model
Capability maturity modelCapability maturity model
Capability maturity model
 
CMMI Capability Maturity Model Integration
CMMI   Capability Maturity Model Integration CMMI   Capability Maturity Model Integration
CMMI Capability Maturity Model Integration
 

2011 Sep CMMI Process Maturity Report

  • 1. CMMI® for SCAMPISM Cl Class A A Appraisal R i l Results lt 2011 Mid-Year Update Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213 September 2011 CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results © 2011 Carnegie Mellon University 1 September 2011 © 2011 Carnegie Mellon University
  • 2. Outline Introduction Current Status Community Trends Organizational Trends Summary and Terms Used in this Briefing This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes. The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead appraisers, team leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a “certifying authority” of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only. CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 2 September 2011 © 2011 Carnegie Mellon University
  • 3. Introduction - Purpose Characterize the adoption of CMMI Describe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPISM) v1.2/v1.3 Class A appraisals using Capability Maturity Model® Integration (CMMI v1.2/ v1.3)* * Organizations previously appraised against CMMI v1.0 /v1.1 and which have not reappraised against v1.2 or v1.3 are not included in this report. * SVC,ACQ appraisals are included in this report, P-CMM appraisals are not included in this report, CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 3 September 2011 © 2011 Carnegie Mellon University
  • 4. Introduction - Briefing Contents This briefing includes three primary sections: 1. 1 Current Status • Snapshot of the development community based on the most recent appraisals, since SCAMPI V 1.2 release, of reporting organizations 2. Community Trends • Global distribution of appraisals •G Growth in th number of appraisals performed th i the b f i l f d • Shifts in the maturity profile over time 3. 3 Organizational Trends • Time to move up in maturity based on change in maturity level and time between appraisals CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 4 September 2011 © 2011 Carnegie Mellon University
  • 5. Process Maturity Profile by All Reporting Organizations 3600 3400 3200 3000 2800 65.4% ations 2600 2400 Number of Organiza 2200 2000 1800 1600 1400 r 1200 23.4% 1000 800 600 400 4.0% 5.1% 200 0.5% 1.6% 0 Not Given Initial Managed Defined Quantitatively Optimizing Managed Based on most recent appraisal of 4220 organizations CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 5 September 2011 © 2011 Carnegie Mellon University
  • 6. Process Maturity Profile (SVC Only) by All Reporting Organizations 50 40 nizations Numb of Organ 30 51.0% ber 42.9% 20 10 6.1% 0 Not Given Managed Defined Based on most recent appraisal of 49 organizations CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 6 September 2011 © 2011 Carnegie Mellon University
  • 7. Reporting Organization Categories Commercial/In-house 80.5% Contractor for Military/Government 15.8% Military/Government Agency 3.7% 0 1000 2000 3000 4000 5000 Number of Organizations g Based on 4220 organizations reporting an organization category CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 7 September 2011 © 2011 Carnegie Mellon University
  • 8. Process Maturity Profile by Reporting Organization Categories 100% 90% Commercial/In-house = 3356 C i l/I h ations Within Category Contractor for Military/Government = 659 80% Military/Government Agency = 153 70% 61.7% 60% 58.3% 50% 43.1% 39.9% % of Organiza 40% 30% 27.6% 20.4% 20% 15.7% 10% 5.8% 3.5% 2.9% 4.6% 1.9% 2.6% 0.4% 0.2% 0.7% 0.3% 1.3% 0% Not Given Initial Managed Defined Quantitatively Optimizing Managed Based on most recent appraisal of 4168 organizations reporting an organization category CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 8 September 2011 © 2011 Carnegie Mellon University
  • 9. Organization Size Based on the total number of employees within the area of the organization that was appraised 1001 to 2000 501 to 1000 1.9% 2000+ 4.0% 4 0% 1.6% 1 6% 301 to 500 5.4% 25 or fewer 20.3% 201 to 300 201 to 2000+ 5.8% 18.6% 101 to 200 1 to 100 15.1% 15 1% 66.3% 66 3% 26 to 50 0 25.9% 76 to 100 7.6% 51 to 75 12.6% 12 6% Based on 4197 organizations reporting size data CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 9 September 2011 © 2011 Carnegie Mellon University
  • 10. Organization Size (SVC Only) Based on the total number of employees within the area of the organization that was appraised 1001 to 2000 2000+ 2.0% 4.1% 501 to 1000 12.2% 12 2% 201 to 2000+ 32.7% 25 or f fewer 301 to 500 49.0% 6.1% 201 to 300 1 to 100 8.2% 65.3% 101 to 200 2.0% 76 to 100 2.0% 51 to 75 4.1% 26 to 50 10.2% Based on 49 organizations reporting size data CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 10 September 2011 © 2011 Carnegie Mellon University
  • 11. Maturity Profile by Organization Size Based on the total number of employees within the area of the organization that was appraised 100% 90% % of Organizations by Size 80% 72.4% 69.8% 68.5% 68.3% 68.1% 70% 61.5% 0.2% s 57.2% 60 6 54.5% 53.8% 60% 50% 40.7% 39.4% 40% % O 30% 23.1% 23.1% 22.5% 22.3% 20.2% 18.0% 17.2% 13.9% 20% 12.8% 11.1% 10.3% % 9.8% 1 7.4% 6.0% 5.8% 5.4% 5.3% 5.1% 4.7% 10% 4.1% 4.0% 3.5% 3.2% 3.0% 3.0% 2.6% 2.5% 2.2% 2.1% 1.5% 1.5% 1.1% 1.0% 0.9% 0.6% 0.6% 0.6% 0.5% 0.4% 0.4% 0.4% 0.4% 1.5% 0% 25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+ Not Given Initial Managed Defined Quantitatively Managed Optimizing Based on 4197 organizations reporting size data CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 11 September 2011 © 2011 Carnegie Mellon University
  • 12. USA and Non-USA Reporting Organization Categories 316 Commercial/In Commercial/In- house 3040 Contractor for 468 Military/Government 191 USA: 100% = 864 Non-USA: 100% = 3304 80 Military/Government Agency 73 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% % of Organizations CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 12 September 2011 © 2011 Carnegie Mellon University
  • 13. Maturity Profile by All Reporting Organizations in the USA 100% 90% 80% % of Organizations 70% 60% 453 50% 40% 317 30% 20% 10% 56 41 1 2 0% Not Given Initial Managed Defined Quantitatively Optimizing g Managed Based on 870 organizations in the USA CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 13 September 2011 © 2011 Carnegie Mellon University
  • 14. Maturity Profile by All Reporting Organizations based outside the USA 100% 90% 80% ations 2305 70% % of Organiza 60% 50% 40% 30% 672 20% 10% 176 111 67 19 0% Not Given Initial Managed Defined Quantitatively Optimizing Managed Based on 3350 organizations outside the USA CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 14 September 2011 © 2011 Carnegie Mellon University
  • 15. Section 2—Community Trends Appraisals are conducted through June 2011 and reported to the SEI by July 2011 • 73 countries reporting appraisals – Most of the appraisals are from Asia and North America. • 4612 Appraisals posted on PARS – Expired appraisals are removed from PARS and replaced with the newest reappraisal result. CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 15 September 2011 © 2011 Carnegie Mellon University
  • 16. Countries Where Appraisals Have Been Performed and Reported to the SEI Argentina Australia Austria Bahrain Bangladesh Belgium Brazil Brunei Darussalam Bulgaria Canada Chile China Colombia Costa Rica Czech Republic Denmark Egypt Finland France Germany Greece Guatemala Hong Kong Hungary India Indonesia Ireland Israel Italy Japan Jordan Korea, Korea Republic Of Latvia Lebanon Lithuania Luxembourg Macedonia Malaysia Mauritius Mexico Morocco Nepal Netherlands New Zealand Norway Pakistan Panama Paraguay Peru Philippines Poland Portugal Qatar Romania Russia Saudi Arabia Singapore Slovakia South AfricaSpain Sri Lanka Sweden Switzerland Taiwan Thailand Tunisia Turkey Ukraine United Arab E United Kingdom United States Uruguay Viet Nam Red country name: New additions with this reporting since March 2011 CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 16 September 2011 © 2011 Carnegie Mellon University
  • 17. Number of Appraisals Reported to the SEI by Continent 4000 3500 ppraisals 3000 2660 2500 500 umber of Ap 2000 1500 Nu 1244 1000 580 500 295 54 13 0 Africa Asia Australia Europe North America South America Based on 4846 appraisals North America includes Canada the USA and Mexico; South America includes Central America and the Canada, USA, Caribbean ; Australia includes New Zealand CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 17 September 2011 © 2011 Carnegie Mellon University
  • 18. Number of Appraisals and Maturity Levels Reported to the SEI by Country Maturity Maturity Maturity Maturity Maturity Maturity Maturity Maturity Maturity Maturity Number of Level 1 Level 2 Level 3 Level 4 Level 5 Number of Level 1 Level 2 Level 3 Level 4 Level 5 Country Appraisals Reported Reported Reported Reported Reported Country Appraisals Reported Reported Reported Reported Reported Argentina 66 37 23 2 Malaysia 45 8 35 2 Australia 11 3 3 Mauritius 10 or fewer Austria 10 or fewer Mexico 95 43 45 1 5 Bahrain 10 or fewer Morocco 10 or fewer Bangladesh 10 or fewer Nepal 10 or fewer Belgium 10 or fewer Netherlands 11 1 3 6 Brazil 125 1 67 48 7 New Zealand 10 or fewer Brunei Darussalam 10 or fewer Norway 10 or fewer Bulgaria 10 or fewer Pakistan 24 1 21 1 1 Canada 30 1 9 12 3 Panama 10 or fewer Chile 33 1 21 10 1 g y Paraguay 10 or fewer China 1557 63 1409 43 35 Peru 18 10 7 Colombia 40 1 15 8 3 5 Philippines 11 1 4 1 4 Costa Rica 10 or fewer Poland 10 or fewer Czech Republic 10 or fewer Portugal 16 6 9 1 Denmark 10 or fewer Qatar 10 or fewer Egypt 40 1 24 11 1 Romania 10 or fewer Finland 10 or fewer Russia 10 or fewer France 111 66 34 1 Saudi Arabia 11 2 6 1 1 Germany 55 6 19 16 Singapore 14 4 8 1 Greece 10 or fewer Slovakia 10 or fewer Guatemala 10 or fewer South Africa 10 or fewer Hong Kong 10 or fewer Spain 186 1 106 62 2 4 Hungary 10 or fewer Sri Lanka 15 2 13 India 462 12 330 3 108 Sweden 10 or fewer Indonesia 10 or fewer Switzerland 10 or fewer Ireland 10 or fewer Taiwan 98 1 42 50 4 Israel 13 7 4 Thailand 38 12 25 1 Italy 45 18 23 Tunisia 10 or fewer Japan 165 7 39 85 6 7 Turkey 22 19 3 Jordan 10 or fewer Ukraine 10 or fewer Korea, Republic Of 128 49 59 10 4 United Arab Emirates 10 or fewer Latvia 10 or fewer United Kingdom 74 1 21 26 5 Lebanon 10 or fewer United States 1119 5 417 550 3 60 Lithuania 10 or fewer Uruguay g y 10 or fewer Luxembourg 10 or fewer Viet Nam 17 14 1 2 Macedonia 10 or fewer CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 18 September 2011 © 2011 Carnegie Mellon University
  • 19. Number of SCAMPI A Appraisals Reported to SEI by Year 1600 TOTAL 1375 1400 1349 POSTED ON PARs 1310 1299 raisals 1200 1004 mber of Appr 1000 941 800 Num 600 556 551 542 509 400 200 11 0 2006 2007 2008 2009 2010 2011 Based on 4846 appraisals CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 19 September 2011 © 2011 Carnegie Mellon University
  • 20. Trends in the Community Maturity Profile 100% 90% 2006 11 80% 2007 564 2008 zations 1516 65.4% 64.6% 70% 63.6% 62.9% 2009 2770 8.2% 2010 3,846 % of Organiz 58 60% 2011 4,220 47.9% 50% 40% 31.4% 28.2% 27.3% 25.1% 23.4% 30% 23.8% 20% 9.4% 9.1% 9.0% 6.1% 5.1% 5.7% 10% 5.2% 5.1% 4.9% 4.0% 4.4% 1.6% 1.6% 0.5% 1.3% 1.2% 1.1% 1.0% 0.8% 0.5% 0.4% 0% Not Given Initial Managed Defined Quantitatively ManagedOptimizing Based on a cumulative view of the most recent appraisals of organizations up through the year indicated CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 20 September 2011 © 2011 Carnegie Mellon University
  • 21. Time to Move Up 40 Number of months to move to 75th Percentile next maturity 30 level 25.5 Median 21 19 20 25th Percentile 10 5 Time Period of Initial Appraisal 2006 to Present Level 1 to 2 2 to 3 3 to 4 3 to 5 Orgs 7 146 31 40 CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 21 September 2011 © 2011 Carnegie Mellon University
  • 22. Summary -1 Since 2006, 4846 SCAMPI v1.2/1.3 appraisals have been reported to the SEI. Appraisals report from China, Spain, Brazil, Argentina, and India are increasing at a rapid rate. More than 66% of appraised organizational units have 100 or fewer employees. The percentage is increasing steadily. The majority of reported appraisals are maturity level 2 and 3 organizations. The number of appraisals in the USA and China represent more than 55% of th t t l number of appraisals. f the total b f i l China is now reporting more appraisals than USA CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 22 September 2011 © 2011 Carnegie Mellon University
  • 23. Summary -2 For organizations that began their CMMI-based SCAMPI effort with V1.2 or later, the median time to move from • maturity level 2 to 3 is 19 months • maturity level 3 to 4 is 21 months • maturity level 3 to 5 is 25.5 months CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 23 September 2011 © 2011 Carnegie Mellon University
  • 24. Terms Used in this Report Company - Parent of the appraised entity A company can be a commercial or non-commercial firm, for-profit or not for-profit business a research and development unit a higher education business, unit, unit, a government agency, or branch of service, etc. Organization - a.k.a. Appraised entity The organization unit to which the appraisal results apply. An appraised entity can be the entire company, a selected business unit, units supporting a particular product line or service, etc. Non-USA - Appraised entity whose geographic location is not within the United States. The parent of the appraised entity may or may not be based within the United States. PARS - Published Appraisal Results webpage contains CMMI® appraisals published at the request of the appraisal sponsor. The link is: http://sas.sei.cmu.edu/pars/ CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 24 September 2011 © 2011 Carnegie Mellon University
  • 25. Contact Information SEI Customer Relations (412) 268-5800 268 5800 SEI FAX number (412) 268-5758 Internet Address customer-relations@sei.cmu.edu @ Mailing Address Customer Relations Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213-3890 CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 25 September 2011 © 2011 Carnegie Mellon University
  • 26. NO WARRANTY THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE MATERIAL IS FURNISHED ON AN “AS-IS" BASIS CARNEGIE MELLON UNIVERSITY AS IS BASIS. MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT, TRADEMARK, OR COPYRIGHT INFRINGEMENT. Use of any trademarks in this presentation is not intended in any way to infringe on the rights of the trademark holder holder. This Presentation may be reproduced in its entirety, without modification, and freely distributed in written or electronic form without requesting formal permission. Permission is required for any other use. Requests for permission should be directed to the Software Engineering Institute at permission@sei.cmu.edu. This work was created in the performance of Federal Government Contract Number FA8721-05-C-0003 with Carnegie Mellon University for the operation of the Software Engineering Institute, a federally funded research and development center. The Government of the United States has a royalty-free government-purpose license to use, duplicate, or disclose the work, in whole or in part and in any manner, and to have or permit others to do so, for government purposes pursuant to the copyright license under the clause at 252.227-7013. CMMI-SCAMPI v1.2/v1.3 Class A Appraisal Results 26 September 2011 © 2011 Carnegie Mellon University