1. Peer To Patent
Pilot 2 Results

2. What began with a
Modest Proposal
Beth Noveck
Former Deputy Chief Technology
Officer for Open Government
Professor

3. With the help from our sponsors
Pilot 1 Sponsors Pilot 2 Sponsors

4. Launched a way for the public to collaborate and
communicate with the USPTO

5. Peer To Patent Process Map

6. Peer To Patent Reviewing Process

15. Initial hypotheses were
supported by the Pilot 1 results
(June 15, 2007- June 15, 2009)
•Public participation improves the patent examination
process.
•Citizen experts will participate and produce relevant
information.
•Public participation improves patent quality.

16. Based on this success, the USPTO elected to conduct a
second Peer To Patent pilot and prove that
an open network will autonomously expand.

17. Pilot 2 launched Oct. 1, 2010 ending Sept. 30, 2011
The last of the applications finished review Dec. 31, 2011

18. The USPTO added new challenges to
Pilot 2 to test the program’s scope.

19. New Pilot. New Challenges.
• Increase in the number of
applications allowed by USPTO
• Pilot 1: Max 400
• Pilot 2: Max 1000

20. New Pilot. New Challenges.
New technology classifications became eligible
for participation:
• Pilot One June 2007- April 2008:
Computer Architecture, Software and
Information Security
• Pilot One July 2008- July 2009: Business
Methods and E-Commerce
• Pilot Two: Biotechnology,
Biopharmaceuticals, Telecommunications,
Speech Recognition

21. New Pilot. New Challenges.
Increase student involvement
•USPTO challenged Peer To
Patent to involve students
from around the country

22. New Pilot. New Challenges.
New Constraints:
• Decreased review time
from 4 months to 3
months
• Reduced number of
reviewer submissions
from 10 to 6.

23. New Pilot. New Challenges
• New Website design to
allow for smoother
integration for
international projects.

24. Amount of Participating applications
Pilot 1 226
Pilot 2 308

25. Technology Classifications
June 2007- July 2008- Sept 2010-
April 2008 July 2009 Oct 2011
Computer Business Methods Biotechnology,
Architecture, and E-Commerce Biopharmaceuticals,
Software and Telecommunication,
Information Security Speech Recognition
Applications from 29
Applications from 19 different classes different classes

26. Technology Classifications of
Participating Applications

27. Pilot 2 Participating Applicants
Unique Applicants- 156
Top Participating Applicants

28. Pilot 1 Participating Applicants Comparison
Unique Applicants- 100
Top Applicants

29. Citizen Experts
Pilot 2 Reviewing Community
•Total Registered Reviewers- 1509
•Total Active Reviewers- 603
•Total Continuing Reviewers- 211
•Total Student Reviewers- 142
•Active
Reviewers designated by actual participation on
www.peertopatent.org
•Continuing reviewers participated in both Pilot 1 and Pilot 2

30. Citizen-Experts Pilot 1 Comparison

31. Pilot 2 Traffic
Unique Visitors 29,393
Total Visits 47,763
Page Views 217,402
Pages/Visit 4.55
Avg. Visit Duration 4:28

32. Pilot 2 Top Visiting Countries
US 30462
UK 3066
India 1778
Canada 1314
Germany 1038

33. Pilot 2 Visitor Traffic

34. Pilot 2 Traffic Sources
Top Search Traffic Sources

35. Pilot 2 Referral Traffic
Peak denotes traffic from
reddit.com post Nov 9, 2010
Top Referral Sources
reddit.com 3880 peertopatent.org 513
patentlyo.com 1112 USPTO 365
en.wikipedia.org 11008 ipo.gov.uk 353
P2P tumblr 850 Article One Partners 275
facebook 530

36. Reviewer Activity
Pilot 2 2010- Pilot 1 2007-
2011 2009

37. Student Reviewers
Over 40 universities represented

38. Reviewer Activity
2010-2011 2007-2009
Registered
1509 2800
Reviewers
Discussion
616 747
Comments
Annotations 179 107
Research 252 68

39. Student Reviewer Activity

40. Pilot 2 Reviewer Activity

41. Pilot 1 Reviewer Activity Comparison

42. Examiner Office Actions

43. Peer To Patent Prior Art used in an Office Action

44. Rejection Basis
*Examiner Comment- used to establish “person having skill
in the art” but not as a 103 basis

45. Pilot 2 Prior Artist Awards
Awarded to reviewers whose prior art
was used in an examiner office action

46. Pilot 1 Prior Artists Comparison

47. We thank you for your participation!