This document presents the results of a systematic literature review on architectural approaches for implementing clinical decision support systems in the cloud. The review identified 12 primary studies and analyzed them based on their proposed architectural approach, contributions of cloud computing, challenges, application area, type of clinical decision support, quality attributes, and data sources. Common findings included the use of three main components - a knowledge database, inference engine, and interface server. Key challenges were performance, compatibility and reliability, while security and privacy were main concerns. There was also a lack of formalism in software engineering practices and rigor in defining cloud-based approaches.

1. Architectural approaches for implementing
Clinical Decision Support Systems in Cloud: A
Systematic Review
Luis Tabares, Jhonatan Hernandez and Ivan Cabezas
imcabezas@usbcali.edu.co
June 27, 2016
International Workshop on Cloud Connected Health, CCH 2016, Washington D.C .
1

2. 2
Ivan
Luis
LIDIS Jhonatan

3. Content
Clinical Decision Support Systems
Cloud Computing
Systematic Review Protocol
Systematic Review Results
Final Remarks
3

4. Clinical Decision Support Systems
CDSS:
Systems providing clinicians, staff and
patients with intelligently filtered knowledge
and person-specific information, presented at
appropiate time, to enhance health and
health care outcomes
Types:
• Alerts and Reminders
• Knowledge service
• Diagnostic, treatment and prescription
support
• Information Recovery
• Image recognition and interpretation
4
Administrative
Managing clinical complexity
Cost control
Decision support
(Wyatt & Spiegelhalter, 1991; Berner,
2009; Goertzel, 1969; Coiera, 2005)
Knowledge
based
Non-
knowledge
based

5. Cloud Computing
5
Model for enabling ubiquitous, convenient, on-demand network
access to a shared pool of configurable computing resources.
On-demand self-service
Broad network access
Resource pooling
Rapid elasticity
Measured service
(Mell & Grance, 2009)

6. Systematic Literature Review
6
A systematic literature review (SLR) is a
means of identifying, evaluating and
interpreting all available research relevant
to a particular research question, or topic
area, or phenomenon of interest
(Kitchenham, 2004; “Exploring Systematic
Reviews,” n.d.)

7. SLR Protocol
7
(Kitchenham, 2004)

8. SLR Planning
8
Identified need:
Determine and discuss key issues and approaches involving
architectural designs in implementing a CDSS using Cloud
Computing.
CDSS
Cloud
Computing
Intervention of Cloud
Computing in CDSS
implementations
Identification
of the need
for a review

9. SLR Planning (ii)
9
Research Questions:
ID Research Question (RQ)
RQ1 What evidence is there about implementing CDSS in the cloud since 2010?
What are the major architectural approaches, contributions, limitations and
concerns about implementing Cloud CDSS?
RQ2 Among health areas, which have more CDSS implementations?
RQ3 What types of CDSS are being built?
RQ4 What are the quality attributes that are typically driven in CDSS
architectural designs?
RQ5 What are the main data sources used in cloud-based CDSS?
RQ6 What evidence is there that cloud computing is an adequate approach for
implementing CDSS?
Specifying
the research
question(s)

10. SLR Conducting
10
Search Process
Identification
of research

11. SLR Conducting (ii)
11
Selection of Primary Studies
Inclusion Criteria (IC)
ID Criteria
IC1 Primary studies published between 2010 and 2016
IC2 Journals and conference proceedings
IC3 Articles describing the use or intervention of cloud
computing on CDSS
Exclusion Criteria (EC)
ID Criteria
EC1 Articles not showing the intervention of cloud computing
on CDSS
EC2 Duplicated reports of the same study
Selection of
primary
studies

12. SLR Conducting (iii)
12
Study Quality Assessment
ID Assessment Question (AQ) Score
AQ1 Was the method process properly
described?
12,5%
AQ2 Were the results clearly described? 12,5%
AQ3 Was the architectural approach
described?
25%
AQ4 It is possible to identify key quality
attributes or driving design scenarios?
25%
AQ5 The article guides a future architectural
design to conduct a CDSS
implementation?
25%
Study
quality
assessment

13. SLR Conducting (iv)
13
Data Extraction & Monitoring
Data extraction
and monitoring

14. SLR Conducting (v)
14
Data Extraction Template
Extracted Data
General Data: data extractor, extraction date, data checker, checking date, study identifier,
title, authors, year of publication, full reference, name of database, type of source, name of
source and quality assessment score
Summary of the proposed architectural approach
Contributions of cloud computing on CDSS
Gaps on intervention of cloud computing on CDSS
Challenges of computing on CDSS
Application area within the domain of health
Types of proposed clinical decision support systems
List of quality attributes addressed
Data sources proposed for the implementation of the CDSS
Data extraction
and monitoring

15. SLR Conducting (vi)
15
Data Analysis
ID Synthesis or Tabulations (T) RQ
T1 For each study, the proposed architectural approach, its main
contributions, gaps and challenges
RQ1
T2 Number of studies per outcome about intervention of cloud
computing on CDSS
RQ6
T3 Number of studies per application area RQ2
T4 Number of studies per type of CDSS RQ3
T5 Number of studies per quality attributes RQ4
T6 Number of studies per data source RQ5
T7 Discussion about intervention of cloud computing on CDSS
implementations in terms of main outcomes detected in the
literature
RQ6
Data
synthesis

16. SLR Results
16
12
8
4 4 4
1 1 1

17. SLR Results (ii)
17

18. SLR Results (iii)
18

19. SLR Results (iv)
19

20. SLR Results (v)
20
Cloud-based CDSS Architectural Drivers
Security
Compatibility
Performance

21. SLR Results (vi)
21

22. SLR Results (vii)
22

23. SLR Results (viii)
23

24. SLR Results (ix)
24
Intervention of Cloud Computing on CDSS
Cost-efficiency
Better patient outcomes
“Unlimited resources”
Clinical data quality
Researching knowledge

25. Final Remarks
• Healthcare organizations are adopting cloud-based CDSS
to provide enhanced patient care comes.
• On-premise environments could allow similar advantages
but the effort to achieve that in these environments is
larger.
• Main challenges in cloud-based CDSS: Performance,
Compatibility and Reliability.
• Main concerns in cloud-based CDSS: Security and
Privacy. These concerns may not be being well validated
in practice.
• May be a lack of formalism regarding to software
engineering practice.
25

26. Final Remarks (ii)
• There is a lack of rigor using the term “Cloud”
26
On-demand self-service
Broad network access
Resource pooling
Rapid elasticity
Measured service
• It was discussed a web-based,
SOA-based or ROA-based
proposals without use the term
“cloud computing” rigorously.
• Not all primary characteristics
of Cloud Computing are being
strictly implemented in their
proposals.

27. Final Remarks (iii)
27
Common Cloud-based CDSS Architectural Approach
(Oh et al., 2015)
3 Common
Components:
• Knowledge database
• Inference Engine
• Interface Server

28. Future Work
CDSS Triage as a Service
28
Common CDSS
Components

29. References
AbuKhousa, E., Mohamed, N., & Al-Jaroodi, J. (2012). e-Health Cloud: Opportunities and Challenges.
Future Internet, 4(4), 621–645. http://doi.org/10.3390/fi4030621
ACM Digital Library. (n.d.). Retrieved May 13, 2016, from http://dl.acm.org/
Afwani, R., & Supangkat, S. H. (2012). Mobile cloud design of reminder system for Tuberculosis treatment
in Indonesia. In 2012 International Conference on Cloud Computing and Social Networking (ICCCSN)
(pp. 1–4). IEEE. http://doi.org/10.1109/ICCCSN.2012.6215737
Ahmed, S. (2015). Knowledge based systems for ubiquitous e-healthcare. 2014 International Conference
on Web and Open Access to Learning, ICWOAL 2014. http://doi.org/10.1109/ICWOAL.2014.7009205
Ahmed, S., & Abdullah, A. (2011). E-healthcare and data management services in a cloud. In 8th
International Conference on High-capacity Optical Networks and Emerging Technologies (pp. 248–
252). IEEE. http://doi.org/10.1109/HONET.2011.6149827
Ahuja, S. P., Mani, S., & Zambrano, J. (2012). A Survey of the State of Cloud Computing in Healthcare.
Network and Communication Technologies, 1(2), p66. http://doi.org/10.5539/nct.v1n2p66
ANDERSON, J. A., & WILLSON, P. (2008). Clinical Decision Support Systems in Nursing. CIN: Computers,
Informatics, Nursing, 26(3), 151–158. http://doi.org/10.1097/01.NCN.0000304783.72811.8e
Bakker, A., & Pluyter-Wenting, E. (2002). Hospital information systems. Studies in Health Technology and
Informatics, 65, 208–230.
Bass, L., Clements, P., & Kazman, R. (2012). Software Architecture in Practice Third Edition.
29

30. References (ii)
Berner, E. (2009). Clinical decision support systems: state of the art. AHRQ Publication, (09). Retrieved
from
http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:Clinical+Decision+Support+System
s+:+State+of+the+Art#0
Black, A. S., & Sahama, T. (2015). eHealth-as-a-service (eHaaS): The industrialisation of health informatics,
a practical approach. 2014 IEEE 16th International Conference on E-Health Networking, Applications
and Services, Healthcom 2014, 555–559. http://doi.org/10.1109/HealthCom.2014.7001902
Callegari, D., Conte, E., Ferreto, T., Fernandes, D., Moraes, F., Burmeister, F., & Severino, R. (2015). EpiCare
- A home care platform based on mobile cloud computing to assist epilepsy diagnosis. In Proceedings
of the 2014 4th International Conference on Wireless Mobile Communication and Healthcare -
“Transforming Healthcare Through Innovations in Mobile and Wireless Technologies”, MOBIHEALTH
2014 (pp. 148–151). Institute of Electrical and Electronics Engineers Inc.
http://doi.org/10.1109/MOBIHEALTH.2014.7015931
Chen, Y. Y., Goh, K. N., & Chong, K. (2013). Rule Based Clinical Decision Support System for Hematological
Disorder, 43–48.
Chouvarda, I., Philip, N. Y., Natsiavas, P., Kilintzis, V., Sobnath, D., Kayyali, R., … Maglaveras, N. (2014).
WELCOME – innovative integrated care platform using wearable sensing and smart cloud computing
for COPD patients with comorbidities. Conference Proceedings : ... Annual International Conference
of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology
Society. Annual Conference, 2014, 3180–3. http://doi.org/10.1109/EMBC.2014.6944298
30

31. References (iii)
Ciprés, A. P., Fardoun, H. M., Alghazzawi, D. M., & Oadah, M. (2012). KAU e-Health Mobile System.
Dixon, B. E., Simonaitis, L., Goldberg, H. S., Paterno, M. D., Schaeffer, M., Hongsermeier, T., … Middleton,
B. (2013). A pilot study of distributed knowledge management and clinical decision support in the
cloud. Artificial Intelligence in Medicine, 59(1), 45–53. http://doi.org/10.1016/j.artmed.2013.03.004
EMR vs EHR vs PHR | ed-informatics.org. (n.d.). Retrieved March 6, 2016, from http://ed-
informatics.org/healthcare-it-in-a-nutshell-2/emr-vs-ehr-vs-phr/
Engineering Village - First choice for serious engineering research. (n.d.). Retrieved May 13, 2016, from
https://www.engineeringvillage.com/
Frize, M., Bariciak, E., Dunn, S., Weyand, S., Gilchrist, J., & Tozer, S. (2011). Combined Physician-Parent
Decision Support tool for the neonatal intensive care unit. 2011 IEEE International Symposium on
Medical Measurements and Applications, 59–64. http://doi.org/10.1109/MeMeA.2011.5966652
Gawanmeh, A., Al-hamadi, H., Al-qutayri, M., Chin, S., & Saleem, K. (2016). Reliability Analysis of
Healthcare Information Systems : State of the Art and Future Directions Reliability Analysis of
Healthcare Information Systems : State of the Art and Future Directions, (October 2015), 56–63.
Gorton, I. (2006). Essential software architecture. (Springer, Ed.)Essential Software Architecture. Berlin,
Germany: Springer Berlin Heidelberg. http://doi.org/10.1007/3-540-28714-0
Home - PubMed - NCBI. (n.d.). Retrieved May 13, 2016, from http://www.ncbi.nlm.nih.gov/pubmed
Hsieh, J., & Hsu, M.-W. (2012). A cloud computing based 12-lead ECG telemedicine service. BMC Medical
Informatics and Decision Making, 12(1), 77. http://doi.org/10.1186/1472-6947-12-77
31

32. References (iv)
Hussain, M., Khattak, A. M., Khan, W. A., Fatima, I., Amin, M. B., Pervez, Z., … Latif, K. (2013). Cloud-based
Smart CDSS for chronic diseases. Health and Technology, 3(2), 153–175.
http://doi.org/10.1007/s12553-013-0051-x
IEEE Xplore Digital Library. (n.d.). Retrieved May 13, 2016, from
http://ieeexplore.ieee.org/Xplore/home.jsp
Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele, UK, Keele University,
33(TR/SE-0401), 28. http://doi.org/10.1.1.122.3308
Kitchenham, B., & Charters, S. (2007). Guidelines for performing Systematic Literature Reviews in Software
Engineering. Engineering, 2, 1051. http://doi.org/10.1145/1134285.1134500
Koufi, V., Malamateniou, F., Vassilacopoulos, G., & Prentza, A. (2012). An Android-Enabled Mobile
Framework for Ubiquitous Access to Cloud Emergency Medical Services. In 2012 Second Symposium
on Network Cloud Computing and Applications (pp. 95–101). IEEE.
http://doi.org/10.1109/NCCA.2012.30
Lomotey, R. K., & Deters, R. (2014). Mobile-Based Medical Data Accessibility in mHealth. In 2014 2nd IEEE
International Conference on Mobile Cloud Computing, Services, and Engineering (pp. 91–100). IEEE.
http://doi.org/10.1109/MobileCloud.2014.24
Mell, P., & Grance, T. (2009). Draft NIST Working Definition of Cloud Computing. National Institute of
Standards and Technology, 53, 50. http://doi.org/10.1136/emj.2010.096966
32

33. References (v)
Nimbalkar, R. A., & Fadnavis, R. A. (2014). Domain specific search of nearest hospital and Healthcare
Management System. In 2014 Recent Advances in Engineering and Computational Sciences (RAECS)
(pp. 1–5). IEEE. http://doi.org/10.1109/RAECS.2014.6799536
Oh, S., Cha, J., Ji, M., Kang, H., Kim, S., Heo, E., … Yoo, S. (2015). Architecture Design of Healthcare
Software-as-a-Service Platform for Cloud-Based Clinical Decision Support Service. Healthcare
Informatics Research, 21(2), 102–10. http://doi.org/10.4258/hir.2015.21.2.102
Sahama, T., Simpson, L., & Lane, B. (2013). Security and Privacy in eHealth: Is it possible? 2013 IEEE 15th
International Conference on E-Health Networking, Applications and Services, Healthcom 2013,
(Healthcom), 249–253. http://doi.org/10.1109/HealthCom.2013.6720676
Scopus - Welcome to Scopus. (n.d.). Retrieved May 13, 2016, from https://www.scopus.com/
Wallace, B. C., Dahabreh, I. J., Schmid, C. H., Lau, J., & Trikalinos, T. A. (2014). Clinical Decision Support.
Clinical Decision Support: The Road to Broad Adoption: Second Edition. Elsevier.
http://doi.org/10.1016/B978-0-12-398476-0.00012-9
Wang, J., Abid, H., Lee, S., Shu, L., & Xia, F. (2011). A secured health care application architecture for
cyber-physical systems. Control Engineering and Applied Informatics, 13(3), 101–108. Retrieved from
http://www.scopus.com/inward/record.url?eid=2-s2.0-84855303509&partnerID=tZOtx3y1
33

34. 34

35. 35

36. Architectural approaches for implementing
Clinical Decision Support Systems in Cloud: A
Systematic Review
Iván Cabezas, Luis Tabares and Jhonatan Hernández
imcabezas@usbcali.edu.co
June 27, 2016
International Workshop on Cloud Connected Health, CCH 2016, Washington D.C .
36