A Multivocal Literature Review on the use of DevOps for e-learning systems
•Télécharger en tant que PPTX, PDF•
1 j'aime•173 vues
Track 14. 9th International Workshop on Software Engineering for E-learning (ISELEAR’18) Authors: Mary Sánchez-Gordón and Ricardo Colomo-Palacios https://youtu.be/W6oAObExar8
Recommandé
Recommandé
Contenu connexe
Similaire à A Multivocal Literature Review on the use of DevOps for e-learning systems
Similaire à A Multivocal Literature Review on the use of DevOps for e-learning systems (20)
Plus de Technological Ecosystems for Enhancing Multiculturality
Plus de Technological Ecosystems for Enhancing Multiculturality (20)
Dernier
Dernier (20)
A Multivocal Literature Review on the use of DevOps for e-learning systems
- 1. A Multivocal Literature Review on the use of DevOps for e-learning systems Ricardo Colomo-Palacios Mary Sánchez-Gordón
- 2. Why study the use of DevOps for e-learning systems?
- 4. E-Learning Systems Learning Management Systems (LMS) become very popular among universities. Adoption is not limited to learning institutions. E-learning tools are evolving towards the cloud
- 5. E-Learning Systems Learning Management Systems (LMS) become very popular among universities. Adoption is not limited to learning institutions. E-learning tools are evolving towards the cloud
- 6. E-Learning Systems Learning Management Systems (LMS) become very popular among universities. Adoption is not limited to learning institutions. E-learning tools are evolving towards the cloud
- 7. Cloud computing computation storage communication Use of resources flexibility and mobility INFRASTRUCTURE
- 8. Devops An approach to reduce software development times by integrating a set of tools in order to get a better and automated transition towards production.
- 9. DevOps The integration between software development and its operational deployment needs to be a continuous one
- 10. DevOps
- 11. Devops DevOps is highly connected to tools and to Cloud Computing.
- 12. A Multivocal Literature Review on the use of DevOps for e-learning systems
- 15. Research approach: MLR Planning • Research background, • Research questions, • Search strategy, • Study selection criteria and procedures, • Data extraction, and • Data synthesis strategies Protocol
- 16. Research approach: MLR Planning Protocol Research Questions
- 17. Research approach: MLR Planning RQ1: How has DevOps evolved in the e- learning systems area? RQ2: What is the use of DevOps for e- learning systems? Protocol Research Questions
- 18. Research approach: MLR Planning Protocol Research Questions Search String
- 19. Research approach: MLR Planning Protocol Research Questions Search String I. Scoping: “DevOps” II. Intervention: (“e-learning system” AND “learning management system”) (“DevOps” AND “e-learning system” ) (“DevOps” AND “learning management system”)
- 20. Research approach: MLR Search strategy Planning Protocol Research Questions Search String (“DevOps” AND “e-learning system” ) (“DevOps” AND “learning management system”)
- 21. Research approach: MLR Search strategy Search resources Search process Planning Protocol Research Questions Search String (“DevOps” AND “e-learning system” ) (“DevOps” AND “learning management system”)
- 22. Research approach: MLR Search strategy Search resources Planning Protocol Research Questions Search String 1. Google Scholar Academic Literature 2. Google Grey literature Search process (“DevOps” AND “e-learning system” ) (“DevOps” AND “learning management system”)
- 23. Research approach: MLR Search strategy Search resources Planning Protocol Research Questions Search String Search process (“DevOps” AND “e-learning system” ) (“DevOps” AND “learning management system”) Academic Professional 1. Google Scholar Academic Literature 2. Google Grey literature
- 24. Research approach: MLR Search strategy Search resources Search process Planning Protocol Research Questions Search String Inclusion: • Studies present the use of DevOps in e- learning systems or LMS. • Studies are explicity related to SE. • 2014 to 2018 (May). Excluded: • Studies not presented in English. • Studies not accessible in full-text. • Studies that are duplicates of other studies. Inclusion / Exclusion Criteria (“DevOps” AND “e-learning system” ) (“DevOps” AND “learning management system”)
- 25. Research approach: MLR Search strategy Search resources Search process Planning Protocol Research Questions Search String Inclusion / Exclusion Criteria (“DevOps” AND “e-learning system” ) (“DevOps” AND “learning management system”) Inclusion: • Studies present the use of DevOps in e- learning systems or LMS. • Studies are explicity related to SE. • 2014 to 2018 (May). Excluded: • Studies not presented in English. • Studies not accessible in full-text. • Studies that are duplicates of other studies.
- 26. Research approach: MLR Seach Google (200) Google Scholar (32) (i) "DevOps" AND "e-learning systems" (ii) "DevOps" AND "Learning Management System“ 1 Relevance ranking approach (Google's PageRank algorithm)
- 27. Research approach: MLR Seach Google (200) Google Scholar (32) Studies after inclusion/exclusion (i) "DevOps" AND "e-learning systems" (ii) "DevOps" AND "Learning Management System“ 1 2 Read title and meta-text provided by Google Search. *Forward literature relevant to RQs (33) * Read title, abstract and keywords. • Forward literature relevant to RQs (14)
- 28. Research approach: MLR Seach (22) * Read full text. * Forward literature relevant to RQs (3) Google (200) Google Scholar (32) Studies after inclusion/exclusion Studies after full text reading (i) "DevOps" AND "e-learning systems" (ii) "DevOps" AND "Learning Management System“ 31 2 Read title and meta-text provided by Google Search. *Forward literature relevant to RQs (33) * Read title, abstract and keywords. • Forward literature relevant to RQs (14)
- 29. Research approach: MLR Seach Read title and meta-text provided by Google Search. *Forward literature relevant to RQs (33) (22) * Read full text. * Forward literature relevant to RQs (3) Google (200) Google Scholar (32) * Read title, abstract and keywords. • Forward literature relevant to RQs (14) Perform Primary Studies (25) Studies after inclusion/exclusion Studies after full text reading Data extraction (i) "DevOps" AND "e-learning systems" (ii) "DevOps" AND "Learning Management System“ 31 2 4
- 30. Results
- 31. How has DevOps evolved in the e- learning systems area?
- 32. Evolution of DevOps in this area
- 33. Evolution of DevOps in this area 22 3
- 34. Evolution of DevOps in this area
- 35. Evolution of DevOps in this area 7
- 36. What is the use of DevOps for e- learning systems?
- 37. DevOps for E-learning Systems
- 38. DevOps for E-learning Systems
- 39. DevOps for E-learning Systems A.1 EU Project [S01] Klamma, R., Koren, I., Nicolaescu, P., Renzel, D., Kravcik, M., Shahriari, M., Derntl, M., Peffer, G. and Elferink, R. 2015. DevOpsUse – Scaling Continuous Innovation. Technical Report #Report 4 (D6.3). It developed technologies that support informal learning in the workplace for Small and Medium sized Enterprises (SMEs).
- 40. DevOps for E-learning Systems
- 41. DevOps for E-learning Systems A.2 Conference [S02] Perez-Soler, S. and Guerra, E. 2017. Assisted modelling over social networks with SOCIO. MODELS (Satellite Events). (2017), 1–5. [S03] Weerasiri, D. and Benatallah, B. 2015. Unified Representation and Reuse of Federated Cloud Resources Configuration Knowledge. 2015 IEEE 19th International Enterprise Distributed Object Computing Conference (Sep. 2015), 142–150. [S04] Nenkov, N., Dimitrov, G., Dyachenko, Y. and Koeva, K. 2016. Artificial intelligence technologies for personnel learning management systems. 2016 IEEE 8th International Conference on Intelligent Systems (IS) (Sep. 2016), 189–195. [S05] Burgos, D. and Corbí, A. 2017. STEAM Subjects Enhanced through Virtual Containers for OER. (Dubai, 2017), 2–12. [S06] Bruneliere, H., Al-Shara, Z., Alvares, F., Lejeune, J. and Ledoux, T. 2018. A Model- based Architecture for Autonomic and Heterogeneous Cloud Systems. (Funchal, Portugal, 2018), 201/212. [S07] Moltó, G. and Caballer, M. 2014. On using the cloud to support online courses. 2014 IEEE Frontiers in Education Conference (FIE) Proceedings (Oct. 2014), 1–9.
- 42. DevOps for E-learning Systems
- 43. DevOps for E-learning Systems A.3 Web – job ads [S08] Hiring for DevOps Consultant(Contract to hire) in Noida, for Exp. [S09] Job opening: DevOps Engineer at Epignosis [S10] Expertus - DevOps Engineer (5-10 yrs), Chennai, DevOps,AWS,Cloud,Ruby on Rails, Tech IT Jobs - hirist.com [S11] (4) Senior DevOps Engineer - AWS, Docker, Jenkins | Technology Navigators, Inc. | LinkedIn [S12] Remote Verso is Hiring at Verso Learning [S13] Linux Systems Administrator, Brighton [S14] Mid-level Linux Systems Administrator Job in Sussex, ENG at Stratospherec [S15] Junior Linux Systems Administrator Job in Sussex, ENG at Stratospherec
- 44. DevOps for E-learning Systems
- 45. DevOps for E-learning Systems A.3 Web – service/product [S16] Talking about DevOps at Joomla Day UK 2017 - SSOFB [S17] DEVOPS. Case study Macmillan. [S18] How Much Does It Cost To Build A WordPress LMS? 2018. [S19] 42 Lines - Custom Learning Software [S20] Software Development | Euvic Group [S21] Media. ValueLabs. [S22] Verso - Home. DevOps [S23] KnightWorks Consulting, Inc. [S24] Microsoft Cloud Profitability Scenarios. [S25] Services | CTEC. CI LMS
- 47. Results reveal a nascent but still modest interest in DevOps in e-learning solutions. Academic Professional 25
- 48. Results reveal a nascent but still modest interest in DevOps in e-learning solutions. Academic Professional The increasing adoption of cloud e- learning solutions and the increasing pressure to deploy new versions of software with boost the interest in this research area. 25
- 49. Results reveal a nascent but still modest interest in DevOps in e-learning solutions. Academic Professional The use of DevOps should be investigated in detail due to its potential impact on the e-learning industry. 25 The increasing adoption of cloud e- learning solutions and the increasing pressure to deploy new versions of software with boost the interest in this research area.
- 50. Results reveal a nascent but still modest interest in DevOps in e-learning solutions. Academic Professional It would be interesting to conduct research not only in DevOps tools but also in other aspects such as cultural, methods and practices- 25 The use of DevOps should be investigated in detail due to its potential impact on the e-learning industry. The increasing adoption of cloud e- learning solutions and the increasing pressure to deploy new versions of software with boost the interest in this research area.
- 51. Results reveal a nascent but still modest interest in DevOps in e-learning solutions. Academic Professional It would be interesting to conduct research not only in DevOps tools but also in other aspects such as cultural, methods and practices- 25 The use of DevOps should be investigated in detail due to its potential impact on the e-learning industry. The increasing adoption of cloud e- learning solutions and the increasing pressure to deploy new versions of software with boost the interest in this research area. Thank you!
Notes de l'éditeur
- Besides, Cloud computing provides dynamically scalable infrastructure supplying computation, storage and communication capabilities as services. Allowing flexibility and mobility in the use of resources for teaching purposes.
- Devops also recognizes that
- Also there is a growing interest in DevOps from practitioners and researchers
- And DevOps is highly connected to tools and to Cloud Computing.
- In this scenario, the connection of these two research fields seems to be promising. However, the interaction of both has not been studied in deep. To bridge this gap, in this paper, a multivocal literature review over a systematic literature review was chOsen. By doing this, we analyze scientific and professional literature on the topic.
- You‘ll find more details in the paper about how_we_approach_ Now, I am going to briefly descri(a)ibe this approach.
- Planning is the first stage …
- to define the plan for the review, a protocol was adapted from Kitchemham guidelines
- To get an explicit view of the state of the art,
- two research questions were formulated:
- And The keyw(ue)ords used to find an answer to the research questions were three:
- scoping “DevOps” and intervention: “e-learning system” AND “learning management system”.
- The search strategy includes
- search resources and search process.
- The first one includes: two databases search engines, Google Scholar and Google.
- And grey literature includes but is not limited to: blogs, post, white papers and articles
- The second one includes the inclusion and exclusion cri(a)teria.
- After that, we conducted the data extraction, and data synthesis.
- The next figure shows the overall search process. The search string was appl(a)ied in May 2018, re(i)turning 232 papers in total. To limit the results in google, we applied a relevance ranking approach That means by simple observations, relevant results usually only appear in the first few pages so that only the first several pages were checked (at least 10) and only continued further if needed
- After that, By manual inspection of abstract and the keywords in text context, the irrelevant studies were remo(u)ved and a set of 33 and 14 papers remained.
- In the third step, those papers were re(i)view(u)ed based on full text,
- Finally, to check the consistency of the inclusion/exclusion decisions, a test-retest approach and re-evalua(ei)t(s)ion of a random sample of the primary studies was made.
- The resu(o)lts in detail can be find in the paper.
- This Figure shows that Only 12% of the primary studies (3) come from the scientific literature, while 88% of the primary studies (22) come from the grey literature.
- Despite the small number of publications available in the literature, it is expected that the results give us a global view at the topic.
- Also, This Figure shows the number of primary studies identified regarding their year of publication. As one can see, a high number of publications (14 out of 25) were published since 2017.
- However, there are a group of publications (7 out of 25) in which the year of publication is not available (N/A).
- Looking at the specific publication type,
- it was clear that the EU Project was the most significant research effort to use DevOps.
- It developed technologies that support informal learning in the workplace, in particular Small and Medium sized Enterprises (SMEs).
- Despite the fact that 6 papers were presented in Conferences.
- Only Half of them were found in Google Scholar. Also 2 of them claim that they use DevOps tools, while the other four papers suggest the use of DevOps but it is not clear if they are using DevOps.
- On the other hand, the job ads give us a good idea about the real demands of DevOps role in the e-learning industry.
- In general, it indicates that there are services and products related to e-learning systems that use DevOps.
- Finally, there is a group of service and products
- Here we can find 3 blog 3 companies’ websites that are mentioning DevOps but they don’t specify how they are using it 4 companies that claim to be using a DevOps approach offers custom development for LMS integration and customization DevOps as continuous integration DevOps as software delivery approach Microsoft Azure in Education
- In conclusion, Despite the fact that there is an incre(i)asingly interest on DevOps and e-learning systems, there are only 25 primary studies related to the use of devops for e-learning systems
- We believe that
- Therefore,
- In this sense,
- In this sense,