Supporting Software Developers with a Holistic Recommender System @ ICSE 2017, Buenos Aires, Argentina

1. SUPPORTING SOFTWARE DEVELOPERS
WITH A HOLISTIC RECOMMENDER SYSTEM
R AE E LV
Luca Ponzanelli
Michele Lanza
Gabriele Bavota
Andrea Mocci
Università della Svizzera italiana
Rocco Oliveto
Simone Scalabrino
University of Molise
Massimiliano Di Penta University of Sannio

3. Stack
Overflow
Video
Tutorials
API
Documentation
Bug
Reports
Development
Emails
Code
Samples

4. Stack
Overflow
Video
Tutorials
API
Documentation
Bug
Reports
Development
Emails
Code
Samples

5. Stack
Overflow
Video
Tutorials
API
Documentation
Bug
Reports
Development
Emails
Code
Samples

16. Developer’s knowledge context
is not considered

17. IDE

18. Web Browser IDE

19. LIBRAhttp://libra.inf.usi.ch

22. Web
Browser
IDE

23. IDE
Web
Browser

24. IDE

25. {…}
{…}
{…}

26. Context Graph
{…}
{…}
{…}
{…}

27. Artifact Similarity
{…}
~

28. Holistic
Similarity
{…}

29. {…}
{…}
{…}
Island Parser
StORMeD
http://stormed.inf.usi.ch

30. {…}
{…}
{…}
Heterogeneous
Abstract Syntax Tree

31. Heterogeneous
Abstract Syntax Tree
</> {;}
JSON Text StackTraceJavaXML

32. Heterogeneous
Abstract Syntax Tree
</> {;}

33. Meta-Information
Model
{…}
Term
Frequencies
Method
Declarations
Types
XML
Elements
Identifiers
Variables
Declarations
JSON
Members
Method
Invocations

34. Types
Term
Frequencies
Term
Frequencies
Method
Declarations
Types{…}
Variable
Declarations
Meta-Information
Model

35. Meta-Information
Model
Types
Term
Frequencies
Term
Frequencies
Method
Declarations
Types{…}
Variable
Declarations

36. Holistic
Similarity
Vx,y =⟨NL Similarity, Type Similarity⟩
fsim(Rx, Ry) = Vx,y

37. Holistic
Context Graph
{…}
{…}
{…}
{…}

38. {…}
{…}
{…}
HoliRank
Holistic PageRank
{…}

39. {…}
{…}
{…}
HoliRank
Artifact Centrality
{…}

40. ContextComplementarity
Result Prominence
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.0
Search
Results

41. {…}
{…}
{…}
{…}
Context
Complementarity

42. {…}
{…}
{…}
{…}
Context
Complementarity

43. {…}
{…}
{…}
{…}
1.0
0.6
0.6 0.3
0.2
0.2
0.1
0.2
0.4
HoliRank(Result)
Context
Complementarity

44. {…}
{…}
{…}
{…}
0.0
0.4
0.4 0.7
0.8
0.8
0.9
0.8
0.6
1 - HoliRank(Result)
Context
Complementarity

45. Search
Results
ContextComplementarity
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.0
Result Prominence

46. Result
Prominence

47. Result
Prominence
1.0
0.6
0.10.4
0.3
0.5
HoliRank(Result)

48. Search
Results
ContextComplementarity
Result Prominence
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.0

49. Term
Frequencies
Method
Declarations
Types
XML
Elements
Identifiers
Variables
Declarations
JSON
Members
Method
Invocations

50. Term
Frequencies
Method
Declarations
Types
XML
Elements
Identifiers
Variables
Declarations
JSON
Members
Method
Invocations
Σ

51. Search
Results
ContextComplementarity
Result Prominence
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.0

52. Search
Results
ContextComplementarity
Result Prominence
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.0

53. Search
Results
ContextComplementarity
Result Prominence
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.0
domain1.com
domain2.com
domain3.com

54. Does Libra help developers?

55. Controlled
Experiment
Industrial
Applicability
Study I Study II

56. Enhancement Tasks
Bug Fixing Tasks
16 Developers
Study I
Setup

57. Enhancement
Task
Bug Fixing
Task
75’
Study I
Setup

58. Enhancement
Task
Bug Fixing
Task
75’
Study I
Setup

59. Task
Completion
Study I
Setup
Developers’
Agreement

60. Study I
Agreement
ContextComplementarity Result Prominence
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.0
Developers’
Agreement

61. Study I
Agreement
0%
12.5%
25%
37.5%
50%
Abs. No No Maybe Yes Abs. Yes
Do you agree with
Prominence?
73% agreement

62. Study I
Agreement
0%
12.5%
25%
37.5%
50%
Abs. No No Maybe Yes Abs. Yes
Do you agree with
Complementarity?
83% agreement

63. Study I
Completion
Task
Completion
90%
75%
25%
50%

64. +25% completeness
Treatment
Completenessofthetasks
100
Without
Libra
80
60
40
0
With
Libra
20
Study I
Completion
Bug Fixing

65. 100
Without
Libra
Treatment
80
60
40
0
With
Libra
Completenessofthetasks
+37% completeness
20
Study I
Completion
Enhancement

66. 100
Without
Libra
Treatment
80
60
40
0
With
Libra
Completenessofthetasks
+52% completeness
20
Study I
Completion
Overall

67. Controlled
Experiment
Industrial
Applicability
Study I Study II

68. Study II
Setup
…
5 Developers
Semi-Structured
Interviews

69. Study II
Results
Is Libra useful?

70. Study II
Results
0%
15%
30%
45%
60%
Abs. No No Maybe Yes Abs. Yes
Is Libra useful?
60% found Libra useful

71. Study II
Results
Would you use Libra?

72. Study II
Results
0%
15%
30%
45%
60%
Abs. No No Maybe Yes Abs. Yes
Would you use Libra?
100% would use Libra

73. Study II
Results
“I noticed that Libra allowed me to find
the most appropriate web page quicker.”

74. Study II
Results
“Libra flowlessly integrates into the
classical developer's workflow, without
adding complexity.”
“I noticed that Libra allowed me to find
the most appropriate web page quicker.”

75. Study II
Results
“Libra flowlessly integrates into the
classical developer's workflow, without
adding complexity.”
“I noticed that Libra allowed me to find
the most appropriate web page quicker.”
“I particularly like the idea of adding
information to the Google ranking.”

76. Study II
Results
“The graph-based interface provides
too many details.”

77. Study II
Results
“You could think of a single metric that
provides an indication of both
complementarity and prominence.”
“The graph-based interface provides
too many details.”

78. Controlled
Experiment
Industrial
Applicability
Study I Study II

79. A holistic analysis of the information context
can offer better support to information
navigation and retrieval

80. SUPPORTING SOFTWARE DEVELOPERS
WITH A HOLISTIC RECOMMENDER SYSTEM
R AE E LV
Luca Ponzanelli
Michele Lanza
Gabriele Bavota
Andrea Mocci
Università della Svizzera italiana
Rocco Oliveto
Simone Scalabrino
University of Molise
Massimiliano Di Penta University of Sannio
http://libra.inf.usi.ch