When it started in 2007, EMFCompare 1.x was designed to compare models that could fit entirely in memory. Since then, EMF has been used to design bigger and bigger models, to the point that they can sometimes barely fit entirely in a laptop's memory. EMFCompare 1.x is irrelevant to compare such big models because its comparison engine needs to handle 2 or 3 versions (three-way diff) of the models under comparison. To be able to work with such large models, models are often split in multiple resources to form a set of strongly connected components in a way that a single component can fit entirely in memory. Yet EMFCompare 1.x cannot handle strategies adapted to these models such as not loading the entire model in memory or loading it piece after piece. EMFCompare 2 is a rewrite from scratch with scalability in minds. It now has a smart scope feature to leverage the above strategies. It only loads the fragments susceptible to have changed and then compares only these parts. This way, EMFCompare 2 is able to compare models with millions of elements in a number of steps proportional to the number of differences. During this talk, we will introduce you to the new framework and how we now are able to scale to millions. This will be shown with a lot of demo in support. We will also show you the brand new user interface that has been revamped to scale along with the new engine.

1. EMF Compare 2
Scaling to Millions
Mikaël Barbero 24 October 2012

2. http://idealistpropaganda.blogspot.fr/2010/04/imaginary-foundations-make-difference.html
EMF Compare 2.0
• Released mid-september 2012
• Sponsored by Ericsson under Polarsys and
Modeling Platform Working Group (MPWG)
• Goal: performance should relate to number
of differences, not to the size of the model
• But also simpler API, better
understanding of differences for end-
users...

3. Brand New UI Better integration with Team/Compare

4. http://www.flickr.com/photos/viggum/2417430161/
Demo
Because it worths a thousand words

5. How does it works? in a Nutshell

6. Match

7. http://www.flickr.com/photos/brianjmatis/3209203494/
Differencing

8. Dependencies
http://www.flickr.com/photos/qilin/2262821682/

9. Equivalences
http://www.bavarianfootballworks.com/2012/9/24/3384502/preview-fc-bayern-vs-vfl-wolfsburg

10. http://www.theology21.com/2010/07/27/are-you-talking-to-me-the-art-of-misunderstanding-and-theological-double-talk/
Conflicts

11. Merge
http://www.flickr.com/photos/brendanlynch/5013468408/

12. Match
Difference
Summary
Requirement
Equivalence
Conflict

13. How to scale to Millions?
http://www.flickr.com/photos/somemixedstuff/2403249501/

14. A graph of EObjects
A «logical» EMF model

15. A
C
D
A graph of EObjects B
G
In Resources
E
F

16. A
C
D
A graph of EObjects B
G
Cross-resources links
E
F

17. A B C
A graph of Resources D
E
G
F

18. A B C
Ancestor
D
E
G
A B C
Left (local) F
D
E
G A B C
F
D
E
G
F
Right (remote)

19. A B C
Ancestor
D
E
G
A B C
Left (local) F
D
E
G A B C
F
D
E
G
F
Right (remote)

20. A B C
Ancestor
D
E
G
A B C
Left (local) F
D
E
G A B C
F
D
E
G
F
Right (remote)

21. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

22. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

23. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

24. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

25. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

26. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

27. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

28. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

29. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

30. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Smart Resolve All Multi-Threaded

31. A B C
Ancestor
D
E
G
A B C
Left (local) F
D
E
G A B C
F
D
E
G
F
Right (remote)

32. A B C
Ancestor
D
E
G
A B C
Left (local) F
D
E
G A B C
F
D
E
G
F
Right (remote)

33. A B C
Ancestor
D
E
G
A B C
Left (local) F
D
E
G A B C
F
D
E
G
F
Right (remote)

34. Summary

35. Summary
Build the graph of
resources

36. Summary
Build the graph of
resources
Smart resolve all

37. Summary
Find which
Build the graph of
resources has
resources
changed
Smart resolve all

38. Summary
Find which
Build the graph of
resources has
resources
changed
Binary comparison
Smart resolve all
of resources

39. Summary
Find which
Build the graph of Compare resource
resources has
resources with differences
changed
Binary comparison
Smart resolve all
of resources

40. Summary
Find which
Build the graph of Compare resource
resources has
resources with differences
changed
Match, Diff, etc.
Binary comparison
Smart resolve all without resolving
of resources
proxies

41. Kill two pigs with one (angry) bird
http://extremehdwallpapers.com/wp-content/uploads/2012/08/angry-birds-wallpaper-hd-.jpg

42. http://www.flickr.com/photos/roberts87/2646193801/
Lightweight How light?

43. http://www.flickr.com/photos/themonnie/2495892146/
Fast How fast?

44. Number of fragments (resources) Number of EObjects Disk Usage (XMI files size)
10000 10000K 1000M
1000 1000K
100M
100 100K
10M
10 10K
Small Medium Large Small Medium Large Small Medium Large
Sample Models The numbers (x2 in 2-ways, x3 in 3-ways)

45. The
promised millions
Number of fragments (resources) Number of EObjects Disk Usage (XMI files size)
10000 10000K 1000M
1000 1000K
100M
100 100K
10M
10 10K
Small Medium Large Small Medium Large Small Medium Large
Sample Models The numbers (x2 in 2-ways, x3 in 3-ways)

46. Small Medium Large
120
90
CPU Usage
Time (sec)
60
Some changes in 1 resource
30
1 10 100
number of changes

47. Small Medium Large
120
90
CPU Usage
Time (sec)
60
1 change in some fragments
30
1 5 10 20
number of changed fragments

48. 600
450
Max Heap (MiB)
Memory Usage
300
Max Heap (-Xmx512m)
150
0
Small Medium Large

49. http://www.flickr.com/photos/exploratorium/4689347618/in/set-72157624060408411 http://www.flickr.com/photos/exploratorium/4680503314/in/set-72157624060408411 http://www.flickr.com/photos/exploratorium/4689346802/in/set-72157624060408411
What’s Next?

50. Model Resolving Scope Narrowing Matching
Differencing Post-Process
100 %
75 %
Time distribution
50 %
25 %
Small 0 %
Nominal
Large

51. Index Cross-Resources Links
http://www.flickr.com/photos/manchesterlibrary/5425247171/

52. Porting Eclipse Papyrus support
http://www.flickr.com/photos/manchesterlibrary/5425247171/

53. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Protect the Integrity of the Model When committing, updating...

54. A
G B
C
D
To be loaded
F
Loaded
E Unloaded
Protect the Integrity of the Model When committing, updating...

55. http://nn.wikipedia.org/wiki/Fil:Postcards_and_magnifying_glass.jpg
Generic Content Based Match Engine Decently Fast

56. http://cdn.memegenerator.net/instances/400x/20451927.jpg
Merge Wizard Help to Resolve Conflict

57. http://www.space.com/17376-sharing-the-light-of-two-suns.html
EMF Compare 2.1 With Kepler (Eclipse 4.3), June 2013

58. What you should remember
New UI
Blazing Fast and
Lightweight
More to come ;)

59. http://www.eclipse.org/emf/compare/
http://www.slideshare.net/mikaelbarbero/