SlideShare a Scribd company logo
1 of 32
Download to read offline
IEC 62304: SDLC Conformance and Management
Rita King
CEO & Senior Consultant
(919) 313-3961
ritaking@methodsense.com
AboutMethodSense
Our Agenda
• Introductions
• IEC 62304 Historical Backdrop
• IEC 62304 Overview
• IEC 62304 Implementation
• Some Things to Watch Out For
© 2015 MethodSense, Inc. 2
AboutMethodSense
Introducing Your Presenter
Rita King - CEO & Senior Consultant
More than 25 years of experience as a regulator, technologist and
professional auditor with international reputation as a regulatory
expert. Rita is a founding member of the Underwriters Laboratories
team that defined, launched, and managed the operations of the first
US program to evaluate safety critical software used in commercial and
medical devices and developed the ANSI approved Standard for Safety
Critical Software, UL 1998.
Rita developed and commercialized InfoStrength Smart Enterprise
Suite, a 21 CFR Part 11 Software as a Service content management
solution specifically designed for the life science industry and founded
her company in 2000.
© 2015 MethodSense, Inc. 3
AboutMethodSense
MethodSense Experience
MethodSense is a Life Science service company
adding strategic value with integrated expertise:
• InfoStrength Software Solutions
• Regulatory Affairs
• Quality Assurance
• Technology Management
• Business Operations
© 2015 MethodSense, Inc. 4
HistoricalBackdrop
Software, Medical Devices and Managing Risk
• In the mid 1990’s the FDA and Underwriters
Laboratories (UL) observed a problem:
• High percentage of reported incidents of adverse events for medical
device software attributed to “user error” by Medical Device
Companies
• Research showed that a significant number of these incidents had
their root cause in the quality or unintended performance of the
software itself, not “user error”
• UL response to this problem – UL 1998:
• UL developed and published the standard UL 1998 for Safety Critical
Software
• UL 1998 applies to non-networked embedded microprocessor
software and addresses the risks unique to product hardware
controlled by software in programmable components
© 2015 MethodSense, Inc. 5
HistoricalBackdrop
Software, Medical Devices and Managing Risk
• FDA response to this problem: 21 CFR Part 11
• Part 11 requires FDA-regulated industries to implement controls,
including audits, system validations, audit trails, electronic
signatures, and documentation for software and systems involved in
processing electronic data that are:
• Required to be maintained by the FDA predicate rules or
• Used to demonstrate compliance to a predicate rule.
• Applies to software applications that support Medical Device
Businesses, Medical Device Products and software applications that
qualify as a Medical Device
•Part 11 Intent: Establish Safety and Efficacy by Validating or
Delivering Evidentiary Demonstration that Software Applications
Perform as the User Intends
© 2015 MethodSense, Inc. 6
HistoricalBackdrop
Software, Medical Devices and Managing Risk
• Classic Validation Representation
• Improved Product Quality
© 2015 MethodSense, Inc. 7
HistoricalBackdrop
Software, Medical Devices and Managing Risk
• Additional quality regulations designed to reduce
risk and enhance safety
• FDA’s 21 CFR Part 820 (GMPs)
• ISO 13485
• Does the following equation eliminate
unacceptable software risk?
GMPs / 13485 + Software Validation = Safe Medical Device
Software
© 2015 MethodSense, Inc. 8
HistoricalBackdrop
Software, Medical Devices and Managing Risk
• Assessing the equation: GMPs / 13485 + Software
Validation = Safe Medical Device Software
• GMPs & 13485 are vague when it comes to
software QA
• Validation insufficiently addresses software risk
• FDA Medical Recall Report: FY2003 to FY2012
“Evaluating the Most Common Cause of Recall – Software
Design Failures … Failure to implement software design
controls, and where appropriate, testing procedures, as well
as increasing complexity of the medical device use
environment (with increased connectivity and
interoperability) can lead to software anomalies often
requiring a correction or removal.”
© 2015 MethodSense, Inc. 9
HistoricalBackdrop
Software, Medical Devices and Managing Risk
• GMPs / 13485 and Software Validation do not
sufficiently eliminate unacceptable risk in medical
devices that are or incorporate software
• Enter IEC 62304
• Used by EU since 2008
• Incorporated into IEC 60601-1 3rd Edition
Amendment 1 (2014) & required by Clause 14
Clause 14 requires manufacturers to comply with IEC 62304 unless the device’s
software has no role in providing basic safety or essential performance or risk
analysis demonstrates that a failure of any Programmable Electronic Safety
System (PESS) does not lead to an unacceptable risk.
• Incorporated into IEC 61010 3rd Edition
© 2015 MethodSense, Inc. 10
HistoricalBackdrop
Software, Medical Devices and Managing Risk
• IEC 62304 enhances medical device safety by tying
the Software Development Life Cycle directly into
• ISO 14971 and Risk Management
• Compliant Quality Management System (e.g. ISO
13485)
• IEC 62304 addresses the risk gap by
• Creating specificity for software management where
GMPs or ISO 13485 are vague
• Incorporating ISO 14971 risk management where
Part 11 or Validation does not
• And requiring detail or rigor in software Design,
Testing, and Verification
© 2015 MethodSense, Inc. 11
IEC62304Overview
What is IEC 62304?
• IEC 62304 is the international standard that:
• Defines software development lifecycle requirements for
medical device software
• Requires all aspects of the software development life
cycle to be scrutinized, including:
• Development
• Risk management
• Configuration
• Problem resolution
• Maintenance
• Provides a common framework for medical device
manufacturers to develop software
© 2015 MethodSense, Inc. 12
IEC62304Overview
What Does Conformance with IEC 62304 Accomplish?
• Conformance with IEC 62304:
• Fulfills the requirements of the EU Medical Device
Directive
• Serves as a benchmark for compliance with regulatory
requirements in US because it is recognized by the FDA
as a consensus standard
• Recognized in most countries that use compliance
standards to fulfill regulatory requirements
• Conformance with IEC 62304 has become a part of
medical device commercialization roadmap
© 2015 MethodSense, Inc. 13
IEC62304Overview
Is Conformance with IEC 62304 Required?
• Is IEC 62304 Required in the US Market?
• Technically, “NO” because it is voluntary
• For all practical purposes, “YES” if you fall into one
of these categories
• IEC 60601-1 3rd Edition Amendment 1 is required
• The device relies upon software to perform Basic Safety
functions
• The device relies upon software for Essential Performance
• If you do not conform with IEC 62304 and also fall
into one of these categories then you must
demonstrate the software development process
used is as good as, or better than, the process
presented in IEC 62304, a form of de facto
compliance
© 2015 MethodSense, Inc. 14
IEC62304Overview
Is Conformance with IEC 62304 Required?
• How do I know if IEC 60601-1 3rd Edition
Amendment 1 Applies to My Device?
• If IEC 60601-1 3rd Edition Amendment 1 Clause
14 applies to the medical device, then
• Clause 14 requires manufacturers to comply
with IEC 62304
• Unless the device’s software has no role in
providing basic safety or
• Essential Performance or risk analysis
demonstrates that a failure of any Programmable
Electronic Safety System (PESS) does not lead to an
unacceptable risk.
© 2015 MethodSense, Inc. 15
IEC62304Overview
Is Conformance with IEC 62304 Required?
• How do I know if the device relies on software for
basic safety?
• If the role of the software includes risk mitigation
then the software has a role in providing basic
safety
• Examples:
• A primary function of the device is controlled by
software.
• Software mitigates a risk if hardware fails
• A risk analysis will identify your device’s level of
unacceptable risk and determine the role of
software in risk mitigation
© 2015 MethodSense, Inc. 16
IEC62304Overview
Is Conformance with IEC 62304 Required?
• How do I know if the device relies on software for
Essential Performance?
• Follow a process of elimination:
• List all functional aspects of your device, including accuracy,
measurements and its capabilities
• Determine whether any of these are already covered by the Basic
Safety requirements of IEC 60601-1 or whether any item is not part
of the device’s intended use
• For every item remaining that is controlled by software, pose the
question: “If this item degrades, will it create a risk for the patient?”
• If “YES” for any item, you must identify how product’s functionality
must be maintained so the risk is still acceptable (i.e. utilize
hardware controls as a back up mechanisms to a potential software
failure, include separate software controls, software validation, etc.)
• This is the device’s Essential Performance
© 2015 MethodSense, Inc. 17
IEC62304Overview
Is Conformance with IEC 62304 Required?
• Example of software as Essential Performance?
• Consider a device that claims its Essential Performance is
accurate within 5%.
• If the device is relying on software to maintain that
accuracy or provide an alert when outside of 5%, and
that software fails, then the manufacturer will be unable
to detect if the device’s Essential Performance is being
met.
• This means the software is providing Essential
Performance.
• Once you know your device software is responsible for
Essential Performance, you must comply with IEC 62304 to
ensure there is no unacceptable risk to a patient
© 2015 MethodSense, Inc. 18
IEC62304Implementation
How do You Conform with IEC 62304?
• IEC 62304 Challenge
• The Devil is in the Details……..
• There are A Lot of Details
• There are ways to practically tackle this challenge
to accommodate your company’s needs and
satisfy the requirements of the standard for a
medical device
© 2015 MethodSense, Inc. 19
IEC62304Implementation
How do You Conform with IEC 62304?
• Conforming with IEC 62304 requires 2 parts
• Processes – Policies & Procedures for your Software
Development Life Cycle
• Evidence that those processes are applied to the
medical device software
• The processes developed and applied to your
medical device software depends on its Software
Safety Classification
• Our Next Steps:
• Review Software Safety Classifications
• High Level Review and Practical Application of Processes
• Tying Processes to SDLC Evidence for the Test Laboratory
© 2015 MethodSense, Inc. 20
IEC62304Implementation
IEC 62304 Software Safety Classifications
Safety Classifications: IEC 62304 v. FDA Software
Level of Concern
• Safety Classifications Considerations
• The riskier the software, the more rigorous the controls
• Important Tip: Clear segmentation of software can
allow for discreetly classifying parts of the software
which may make the documentation and testing easier
IEC 62304 Software Safety Classification FDA Pre-Market Submission Software
Levels of Concern
Class A: No Injury or Damage to Health is
Possible
Minor: Failures or latent design flaws are
unlikely to cause any injury
Class B: Non-serious Injury is Possible Moderate: Failure or latent possible
design flaw could directly or indirectly
result in minor injury
Class C: Death or Serious Injury is Possible Major: Failure or flaw could directly or
indirectly result in death or serious injury
© 2015 MethodSense, Inc. 21
IEC62304Implementation
Software Development Life Cycle Process
•IEC 62304 Processes, Tasks and
Deliverables must be implemented
•Requires a Quality Management System
and Risk Management Process compliant
with ISO 14971
•However, IEC 62304 does not prescribe:
•An organizational structure
•A particular methodology
•A particular document format
© 2015 MethodSense, Inc. 22
IEC62304Implementation
IEC 62304 SDLC Deliverables
•Challenge: This has the look and feel of
an SDLC known as the Waterfall Model.
Is that so?
•NO. What this represents is a set of
deliverables for a Test Laboratory or a
Regulatory Authority (e.g. the FDA)
•Important: Think in terms of
incorporating into your SDLC
methodology the creation of these
deliverables
© 2015 MethodSense, Inc. 23
IEC62304Implementation
IEC 62304 SDLC Deliverables
•IEC 62304 is pretty clear about what
deliverables are required
•Test Laboratories have their own
check lists you can use as guidance to
demonstrate your IEC 62304
compliance
•MethodSense has created an IEC
62304 Action List that identifies the
required deliverables and we can
share this with you
•Therefore, the IEC 62304 deliverables
are well understood and we can focus
on practical considerations for
implementation
© 2015 MethodSense, Inc. 24
IEC62304Implementation
IEC 62304 Implementation for Alternative SDLC Methodologies
• Waterfall Model:
• Generally recognized as impractical and rarely used SDLC model
• Fails to account for the iterative nature of Software Development
• As a model accommodates the creation of deliverables (e.g.
documents) because it allows minimal change along the way
• Agile Model:
• Generally recognized as a very practical SDLC model
• Accounts for the iterative nature of software development
• As a model and depending on its implementation makes it difficult
to efficiently create the expected 62304 deliverables (e.g.
documents) since requirements may be changing during software
development
• How can you generate IEC 62304 deliverables in an
Agile environment?
© 2015 MethodSense, Inc. 25
IEC62304Implementation
IEC 62304 and Agile Development Methodologies
• IEC 62304 Conformance Tips in an Agile
Environment
• Map onto your Agile SDLC IEC 62304 deliverables
• Think about segmenting your software to allow the
Safety Classifications to apply differently to the
different software segments
• Ensure your automated tools will deliver documents
that meet expectations and conformance needs
• If your deliverables cannot keep up with your
method, think about scaling back iterative change in
a hybrid approach
© 2015 MethodSense, Inc. 26
IEC62304Implementation
IEC 62304 Tips
• Common software functionality manufacturers fail
to recognize as IEC 62304 compliance issues:
• Alarms and Alerts - often an Essential Performance
requirement because they are intended to detect
abnormalities
• Speed & Position Sensors - use software to limit range of
motion, speed and force which are Basic Safety concerns
• Algorithms - remove the software and the device is no
longer able to operate as intended, resulting in the
algorithms being part of Essential Performance
© 2015 MethodSense, Inc. 27
IEC62304Implementation
IEC 62304 Tips
• Pitfalls to Avoid
• Document Your Process Well – document
management is essential for meeting compliance
goals
• Software of Unknown Pedigree (SOUP) – manage
your SOUP appropriately
• Document Development – make certain you are
sufficiently resourced to support document
development needs
• Version Control & Updates – clearly define what is a
software update and further how the software will be
maintained in a validated state
© 2015 MethodSense, Inc. 28
IEC62304Implementation
IEC 62304 Tips
• What if Your Device Software is Developed by a
Third Party?
• Supplier Management Process – confirm that
software vendor complies with IEC 62304 and
processes are reviewed during vendor audit
• Quality Agreement – confirm that:
• It defines vendor responsibilities and 62304
Deliverables
• Vendors procedures used for software development
will be provided to you and the test lab for review
• Establish your SDLC – at minimum, your process
will define acceptance criteria (i.e. IEC 62304
compliance and deliverables) from your vendor
© 2015 MethodSense, Inc. 29
IEC62304Implementation
IEC 62304 Success
• IEC 62304 File will be reviewed to ensure:
• It contains all required documentation including a
risk management file
• Procedures meet the requirements of the standard
• Each check list item is satisfied
• A product review is conducted and further a review
of the relevant software segments if it has been
decided that the software performs Basic Safety or
Essential Performance for your device
•After the review, a Pass or Fail Report is
delivered
Move Commercialization Forward!
© 2015 MethodSense, Inc. 30
Confidential
MethodSense Thanks You!!!
Discussion / Q&A
© 2015 MethodSense, Inc. 31
Thank you.
Rita King
CEO & Senior Consultant
(919) 313-3961
ritaking@methodsense.com
© 2015 MethodSense, Inc.

More Related Content

What's hot

Medical Device Regulatory Approval
Medical Device Regulatory ApprovalMedical Device Regulatory Approval
Medical Device Regulatory Approval
ruyang89
 
Design and development of medical device
Design and development of medical deviceDesign and development of medical device
Design and development of medical device
Malesh M
 
Medical devices CHINA
Medical devices CHINA Medical devices CHINA
Medical devices CHINA
Parul Institute of Pharmacy
 

What's hot (20)

An Overview for Software as a Medical Device (SaMD)
An Overview for Software as a Medical Device (SaMD)An Overview for Software as a Medical Device (SaMD)
An Overview for Software as a Medical Device (SaMD)
 
Medical Device Regulatory Approval
Medical Device Regulatory ApprovalMedical Device Regulatory Approval
Medical Device Regulatory Approval
 
Design and development of medical device
Design and development of medical deviceDesign and development of medical device
Design and development of medical device
 
validation and verification of medical device.pptx
validation and verification of medical device.pptxvalidation and verification of medical device.pptx
validation and verification of medical device.pptx
 
Medical Device Regulations - 510(k) Process
Medical Device Regulations - 510(k) ProcessMedical Device Regulations - 510(k) Process
Medical Device Regulations - 510(k) Process
 
Medical devices CHINA
Medical devices CHINA Medical devices CHINA
Medical devices CHINA
 
ISO 13485.pptx
ISO 13485.pptxISO 13485.pptx
ISO 13485.pptx
 
ISO-13485-2016.pptx
ISO-13485-2016.pptxISO-13485-2016.pptx
ISO-13485-2016.pptx
 
Difference between fda 21 cfr part 820 and ISO 13485
Difference between fda 21 cfr part 820 and ISO 13485Difference between fda 21 cfr part 820 and ISO 13485
Difference between fda 21 cfr part 820 and ISO 13485
 
Cybersecurity and Software Updates in Medical Devices.pdf
Cybersecurity and Software Updates in Medical Devices.pdfCybersecurity and Software Updates in Medical Devices.pdf
Cybersecurity and Software Updates in Medical Devices.pdf
 
Classification of In Vitro Diagnostic Devices per FDA and IVDR Rules
Classification of In Vitro Diagnostic Devices per FDA and IVDR RulesClassification of In Vitro Diagnostic Devices per FDA and IVDR Rules
Classification of In Vitro Diagnostic Devices per FDA and IVDR Rules
 
ISO Standard 13485
ISO Standard 13485ISO Standard 13485
ISO Standard 13485
 
Good design practice for medical devices
Good design practice for medical devicesGood design practice for medical devices
Good design practice for medical devices
 
EU Medical Device Regulatory Framework_Dec, 2022
EU Medical Device Regulatory Framework_Dec, 2022EU Medical Device Regulatory Framework_Dec, 2022
EU Medical Device Regulatory Framework_Dec, 2022
 
Medical device design and development | Combination Product
Medical device design and development | Combination ProductMedical device design and development | Combination Product
Medical device design and development | Combination Product
 
7 Steps - How to Get a CE Marking Certification for Medical Devices?
7 Steps - How to Get a CE Marking Certification for Medical Devices?7 Steps - How to Get a CE Marking Certification for Medical Devices?
7 Steps - How to Get a CE Marking Certification for Medical Devices?
 
The European Medical Device Regulations - analysis of the final text
The European Medical Device Regulations - analysis of the final textThe European Medical Device Regulations - analysis of the final text
The European Medical Device Regulations - analysis of the final text
 
Software as a Medical Device (SaMD) - IMDRF Definition and Categorisation
Software as a Medical Device (SaMD) - IMDRF Definition and CategorisationSoftware as a Medical Device (SaMD) - IMDRF Definition and Categorisation
Software as a Medical Device (SaMD) - IMDRF Definition and Categorisation
 
What is Medical Devices Testing
What is Medical Devices TestingWhat is Medical Devices Testing
What is Medical Devices Testing
 
FDA Regulations and Medical Device Pathways to Market | Kevin Daly | Lunch & ...
FDA Regulations and Medical Device Pathways to Market | Kevin Daly | Lunch & ...FDA Regulations and Medical Device Pathways to Market | Kevin Daly | Lunch & ...
FDA Regulations and Medical Device Pathways to Market | Kevin Daly | Lunch & ...
 

Similar to IEC 62304: SDLC Conformance and Management

Similar to IEC 62304: SDLC Conformance and Management (20)

Building a QMS for Your SaMD
Building a QMS for Your SaMDBuilding a QMS for Your SaMD
Building a QMS for Your SaMD
 
Building a QMS for Your SaMD Part II
Building a QMS for Your SaMD Part IIBuilding a QMS for Your SaMD Part II
Building a QMS for Your SaMD Part II
 
Quality Control for Medical Device Software - It Arena Lviv Presentation
Quality Control for Medical Device Software - It Arena Lviv PresentationQuality Control for Medical Device Software - It Arena Lviv Presentation
Quality Control for Medical Device Software - It Arena Lviv Presentation
 
Critical Steps in Software Development: Enhance Your Chances for a Successful...
Critical Steps in Software Development: Enhance Your Chances for a Successful...Critical Steps in Software Development: Enhance Your Chances for a Successful...
Critical Steps in Software Development: Enhance Your Chances for a Successful...
 
Health apps regulation and quality control case studies and session 2 present...
Health apps regulation and quality control case studies and session 2 present...Health apps regulation and quality control case studies and session 2 present...
Health apps regulation and quality control case studies and session 2 present...
 
Health apps regulation and quality control case studies and session 2 present...
Health apps regulation and quality control case studies and session 2 present...Health apps regulation and quality control case studies and session 2 present...
Health apps regulation and quality control case studies and session 2 present...
 
Software controlled electron mechanical systems reliability
Software controlled electron mechanical systems reliabilitySoftware controlled electron mechanical systems reliability
Software controlled electron mechanical systems reliability
 
Software Testing - Software Quality (Part 2)
Software Testing - Software Quality (Part 2)Software Testing - Software Quality (Part 2)
Software Testing - Software Quality (Part 2)
 
Overview of Software QA and What is Software Quality
Overview of Software QA and What is Software QualityOverview of Software QA and What is Software Quality
Overview of Software QA and What is Software Quality
 
Perforce user webinar fractyl dhb jb_dhb_adr edits
Perforce user webinar fractyl dhb jb_dhb_adr editsPerforce user webinar fractyl dhb jb_dhb_adr edits
Perforce user webinar fractyl dhb jb_dhb_adr edits
 
When Medical Device Software Fails Due to Improper Verification & Validation ...
When Medical Device Software Fails Due to Improper Verification & Validation ...When Medical Device Software Fails Due to Improper Verification & Validation ...
When Medical Device Software Fails Due to Improper Verification & Validation ...
 
Computer Software Assurance (CSA): Understanding the FDA’s New Draft Guidance
Computer Software Assurance (CSA): Understanding the FDA’s New Draft GuidanceComputer Software Assurance (CSA): Understanding the FDA’s New Draft Guidance
Computer Software Assurance (CSA): Understanding the FDA’s New Draft Guidance
 
Software validation do's and dont's may 2013
Software validation do's and dont's may 2013Software validation do's and dont's may 2013
Software validation do's and dont's may 2013
 
The critical role of QA in Medical Device Testing.pdf
The critical role of QA in Medical Device Testing.pdfThe critical role of QA in Medical Device Testing.pdf
The critical role of QA in Medical Device Testing.pdf
 
ISO 13485: What's Next?
ISO 13485: What's Next?ISO 13485: What's Next?
ISO 13485: What's Next?
 
Practical Advice for FDA’s 510(k) Requirements.pdf
Practical Advice for FDA’s 510(k) Requirements.pdfPractical Advice for FDA’s 510(k) Requirements.pdf
Practical Advice for FDA’s 510(k) Requirements.pdf
 
Usability Validation Testing of Medical Devices and Software
Usability Validation Testing of Medical Devices and SoftwareUsability Validation Testing of Medical Devices and Software
Usability Validation Testing of Medical Devices and Software
 
The Future of Quality and Regulatory for SaMD
The Future of Quality and Regulatory for SaMDThe Future of Quality and Regulatory for SaMD
The Future of Quality and Regulatory for SaMD
 
Software as a Medical Device (SaMD) Challenges and Opportunities for 2021 and...
Software as a Medical Device (SaMD) Challenges and Opportunities for 2021 and...Software as a Medical Device (SaMD) Challenges and Opportunities for 2021 and...
Software as a Medical Device (SaMD) Challenges and Opportunities for 2021 and...
 
5 Key Considerations at the Start of SaMD Development
5 Key Considerations at the Start of SaMD Development5 Key Considerations at the Start of SaMD Development
5 Key Considerations at the Start of SaMD Development
 

Recently uploaded

Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai KuwaitThe Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
daisycvs
 
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Anamikakaur10
 
Call Girls In Nangloi Rly Metro ꧂…….95996 … 13876 Enjoy ꧂Escort
Call Girls In Nangloi Rly Metro ꧂…….95996 … 13876 Enjoy ꧂EscortCall Girls In Nangloi Rly Metro ꧂…….95996 … 13876 Enjoy ꧂Escort
Call Girls In Nangloi Rly Metro ꧂…….95996 … 13876 Enjoy ꧂Escort
dlhescort
 
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabiunwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
Abortion pills in Kuwait Cytotec pills in Kuwait
 
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
amitlee9823
 
Chandigarh Escorts Service 📞8868886958📞 Just📲 Call Nihal Chandigarh Call Girl...
Chandigarh Escorts Service 📞8868886958📞 Just📲 Call Nihal Chandigarh Call Girl...Chandigarh Escorts Service 📞8868886958📞 Just📲 Call Nihal Chandigarh Call Girl...
Chandigarh Escorts Service 📞8868886958📞 Just📲 Call Nihal Chandigarh Call Girl...
Sheetaleventcompany
 
Call Girls From Raj Nagar Extension Ghaziabad❤️8448577510 ⊹Best Escorts Servi...
Call Girls From Raj Nagar Extension Ghaziabad❤️8448577510 ⊹Best Escorts Servi...Call Girls From Raj Nagar Extension Ghaziabad❤️8448577510 ⊹Best Escorts Servi...
Call Girls From Raj Nagar Extension Ghaziabad❤️8448577510 ⊹Best Escorts Servi...
lizamodels9
 
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
lizamodels9
 
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
daisycvs
 

Recently uploaded (20)

Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai KuwaitThe Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
 
Cracking the Cultural Competence Code.pptx
Cracking the Cultural Competence Code.pptxCracking the Cultural Competence Code.pptx
Cracking the Cultural Competence Code.pptx
 
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
 
Call Girls In Nangloi Rly Metro ꧂…….95996 … 13876 Enjoy ꧂Escort
Call Girls In Nangloi Rly Metro ꧂…….95996 … 13876 Enjoy ꧂EscortCall Girls In Nangloi Rly Metro ꧂…….95996 … 13876 Enjoy ꧂Escort
Call Girls In Nangloi Rly Metro ꧂…….95996 … 13876 Enjoy ꧂Escort
 
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabiunwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
 
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
 
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
 
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort ServiceEluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
 
Chandigarh Escorts Service 📞8868886958📞 Just📲 Call Nihal Chandigarh Call Girl...
Chandigarh Escorts Service 📞8868886958📞 Just📲 Call Nihal Chandigarh Call Girl...Chandigarh Escorts Service 📞8868886958📞 Just📲 Call Nihal Chandigarh Call Girl...
Chandigarh Escorts Service 📞8868886958📞 Just📲 Call Nihal Chandigarh Call Girl...
 
Call Girls From Raj Nagar Extension Ghaziabad❤️8448577510 ⊹Best Escorts Servi...
Call Girls From Raj Nagar Extension Ghaziabad❤️8448577510 ⊹Best Escorts Servi...Call Girls From Raj Nagar Extension Ghaziabad❤️8448577510 ⊹Best Escorts Servi...
Call Girls From Raj Nagar Extension Ghaziabad❤️8448577510 ⊹Best Escorts Servi...
 
Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024
 
Famous Olympic Siblings from the 21st Century
Famous Olympic Siblings from the 21st CenturyFamous Olympic Siblings from the 21st Century
Famous Olympic Siblings from the 21st Century
 
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
 
Call Girls Zirakpur👧 Book Now📱7837612180 📞👉Call Girl Service In Zirakpur No A...
Call Girls Zirakpur👧 Book Now📱7837612180 📞👉Call Girl Service In Zirakpur No A...Call Girls Zirakpur👧 Book Now📱7837612180 📞👉Call Girl Service In Zirakpur No A...
Call Girls Zirakpur👧 Book Now📱7837612180 📞👉Call Girl Service In Zirakpur No A...
 
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
 
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsValue Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
 
Call Girls Ludhiana Just Call 98765-12871 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 98765-12871 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 98765-12871 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 98765-12871 Top Class Call Girl Service Available
 
Phases of Negotiation .pptx
 Phases of Negotiation .pptx Phases of Negotiation .pptx
Phases of Negotiation .pptx
 
Falcon Invoice Discounting: Empowering Your Business Growth
Falcon Invoice Discounting: Empowering Your Business GrowthFalcon Invoice Discounting: Empowering Your Business Growth
Falcon Invoice Discounting: Empowering Your Business Growth
 

IEC 62304: SDLC Conformance and Management

  • 1. IEC 62304: SDLC Conformance and Management Rita King CEO & Senior Consultant (919) 313-3961 ritaking@methodsense.com
  • 2. AboutMethodSense Our Agenda • Introductions • IEC 62304 Historical Backdrop • IEC 62304 Overview • IEC 62304 Implementation • Some Things to Watch Out For © 2015 MethodSense, Inc. 2
  • 3. AboutMethodSense Introducing Your Presenter Rita King - CEO & Senior Consultant More than 25 years of experience as a regulator, technologist and professional auditor with international reputation as a regulatory expert. Rita is a founding member of the Underwriters Laboratories team that defined, launched, and managed the operations of the first US program to evaluate safety critical software used in commercial and medical devices and developed the ANSI approved Standard for Safety Critical Software, UL 1998. Rita developed and commercialized InfoStrength Smart Enterprise Suite, a 21 CFR Part 11 Software as a Service content management solution specifically designed for the life science industry and founded her company in 2000. © 2015 MethodSense, Inc. 3
  • 4. AboutMethodSense MethodSense Experience MethodSense is a Life Science service company adding strategic value with integrated expertise: • InfoStrength Software Solutions • Regulatory Affairs • Quality Assurance • Technology Management • Business Operations © 2015 MethodSense, Inc. 4
  • 5. HistoricalBackdrop Software, Medical Devices and Managing Risk • In the mid 1990’s the FDA and Underwriters Laboratories (UL) observed a problem: • High percentage of reported incidents of adverse events for medical device software attributed to “user error” by Medical Device Companies • Research showed that a significant number of these incidents had their root cause in the quality or unintended performance of the software itself, not “user error” • UL response to this problem – UL 1998: • UL developed and published the standard UL 1998 for Safety Critical Software • UL 1998 applies to non-networked embedded microprocessor software and addresses the risks unique to product hardware controlled by software in programmable components © 2015 MethodSense, Inc. 5
  • 6. HistoricalBackdrop Software, Medical Devices and Managing Risk • FDA response to this problem: 21 CFR Part 11 • Part 11 requires FDA-regulated industries to implement controls, including audits, system validations, audit trails, electronic signatures, and documentation for software and systems involved in processing electronic data that are: • Required to be maintained by the FDA predicate rules or • Used to demonstrate compliance to a predicate rule. • Applies to software applications that support Medical Device Businesses, Medical Device Products and software applications that qualify as a Medical Device •Part 11 Intent: Establish Safety and Efficacy by Validating or Delivering Evidentiary Demonstration that Software Applications Perform as the User Intends © 2015 MethodSense, Inc. 6
  • 7. HistoricalBackdrop Software, Medical Devices and Managing Risk • Classic Validation Representation • Improved Product Quality © 2015 MethodSense, Inc. 7
  • 8. HistoricalBackdrop Software, Medical Devices and Managing Risk • Additional quality regulations designed to reduce risk and enhance safety • FDA’s 21 CFR Part 820 (GMPs) • ISO 13485 • Does the following equation eliminate unacceptable software risk? GMPs / 13485 + Software Validation = Safe Medical Device Software © 2015 MethodSense, Inc. 8
  • 9. HistoricalBackdrop Software, Medical Devices and Managing Risk • Assessing the equation: GMPs / 13485 + Software Validation = Safe Medical Device Software • GMPs & 13485 are vague when it comes to software QA • Validation insufficiently addresses software risk • FDA Medical Recall Report: FY2003 to FY2012 “Evaluating the Most Common Cause of Recall – Software Design Failures … Failure to implement software design controls, and where appropriate, testing procedures, as well as increasing complexity of the medical device use environment (with increased connectivity and interoperability) can lead to software anomalies often requiring a correction or removal.” © 2015 MethodSense, Inc. 9
  • 10. HistoricalBackdrop Software, Medical Devices and Managing Risk • GMPs / 13485 and Software Validation do not sufficiently eliminate unacceptable risk in medical devices that are or incorporate software • Enter IEC 62304 • Used by EU since 2008 • Incorporated into IEC 60601-1 3rd Edition Amendment 1 (2014) & required by Clause 14 Clause 14 requires manufacturers to comply with IEC 62304 unless the device’s software has no role in providing basic safety or essential performance or risk analysis demonstrates that a failure of any Programmable Electronic Safety System (PESS) does not lead to an unacceptable risk. • Incorporated into IEC 61010 3rd Edition © 2015 MethodSense, Inc. 10
  • 11. HistoricalBackdrop Software, Medical Devices and Managing Risk • IEC 62304 enhances medical device safety by tying the Software Development Life Cycle directly into • ISO 14971 and Risk Management • Compliant Quality Management System (e.g. ISO 13485) • IEC 62304 addresses the risk gap by • Creating specificity for software management where GMPs or ISO 13485 are vague • Incorporating ISO 14971 risk management where Part 11 or Validation does not • And requiring detail or rigor in software Design, Testing, and Verification © 2015 MethodSense, Inc. 11
  • 12. IEC62304Overview What is IEC 62304? • IEC 62304 is the international standard that: • Defines software development lifecycle requirements for medical device software • Requires all aspects of the software development life cycle to be scrutinized, including: • Development • Risk management • Configuration • Problem resolution • Maintenance • Provides a common framework for medical device manufacturers to develop software © 2015 MethodSense, Inc. 12
  • 13. IEC62304Overview What Does Conformance with IEC 62304 Accomplish? • Conformance with IEC 62304: • Fulfills the requirements of the EU Medical Device Directive • Serves as a benchmark for compliance with regulatory requirements in US because it is recognized by the FDA as a consensus standard • Recognized in most countries that use compliance standards to fulfill regulatory requirements • Conformance with IEC 62304 has become a part of medical device commercialization roadmap © 2015 MethodSense, Inc. 13
  • 14. IEC62304Overview Is Conformance with IEC 62304 Required? • Is IEC 62304 Required in the US Market? • Technically, “NO” because it is voluntary • For all practical purposes, “YES” if you fall into one of these categories • IEC 60601-1 3rd Edition Amendment 1 is required • The device relies upon software to perform Basic Safety functions • The device relies upon software for Essential Performance • If you do not conform with IEC 62304 and also fall into one of these categories then you must demonstrate the software development process used is as good as, or better than, the process presented in IEC 62304, a form of de facto compliance © 2015 MethodSense, Inc. 14
  • 15. IEC62304Overview Is Conformance with IEC 62304 Required? • How do I know if IEC 60601-1 3rd Edition Amendment 1 Applies to My Device? • If IEC 60601-1 3rd Edition Amendment 1 Clause 14 applies to the medical device, then • Clause 14 requires manufacturers to comply with IEC 62304 • Unless the device’s software has no role in providing basic safety or • Essential Performance or risk analysis demonstrates that a failure of any Programmable Electronic Safety System (PESS) does not lead to an unacceptable risk. © 2015 MethodSense, Inc. 15
  • 16. IEC62304Overview Is Conformance with IEC 62304 Required? • How do I know if the device relies on software for basic safety? • If the role of the software includes risk mitigation then the software has a role in providing basic safety • Examples: • A primary function of the device is controlled by software. • Software mitigates a risk if hardware fails • A risk analysis will identify your device’s level of unacceptable risk and determine the role of software in risk mitigation © 2015 MethodSense, Inc. 16
  • 17. IEC62304Overview Is Conformance with IEC 62304 Required? • How do I know if the device relies on software for Essential Performance? • Follow a process of elimination: • List all functional aspects of your device, including accuracy, measurements and its capabilities • Determine whether any of these are already covered by the Basic Safety requirements of IEC 60601-1 or whether any item is not part of the device’s intended use • For every item remaining that is controlled by software, pose the question: “If this item degrades, will it create a risk for the patient?” • If “YES” for any item, you must identify how product’s functionality must be maintained so the risk is still acceptable (i.e. utilize hardware controls as a back up mechanisms to a potential software failure, include separate software controls, software validation, etc.) • This is the device’s Essential Performance © 2015 MethodSense, Inc. 17
  • 18. IEC62304Overview Is Conformance with IEC 62304 Required? • Example of software as Essential Performance? • Consider a device that claims its Essential Performance is accurate within 5%. • If the device is relying on software to maintain that accuracy or provide an alert when outside of 5%, and that software fails, then the manufacturer will be unable to detect if the device’s Essential Performance is being met. • This means the software is providing Essential Performance. • Once you know your device software is responsible for Essential Performance, you must comply with IEC 62304 to ensure there is no unacceptable risk to a patient © 2015 MethodSense, Inc. 18
  • 19. IEC62304Implementation How do You Conform with IEC 62304? • IEC 62304 Challenge • The Devil is in the Details…….. • There are A Lot of Details • There are ways to practically tackle this challenge to accommodate your company’s needs and satisfy the requirements of the standard for a medical device © 2015 MethodSense, Inc. 19
  • 20. IEC62304Implementation How do You Conform with IEC 62304? • Conforming with IEC 62304 requires 2 parts • Processes – Policies & Procedures for your Software Development Life Cycle • Evidence that those processes are applied to the medical device software • The processes developed and applied to your medical device software depends on its Software Safety Classification • Our Next Steps: • Review Software Safety Classifications • High Level Review and Practical Application of Processes • Tying Processes to SDLC Evidence for the Test Laboratory © 2015 MethodSense, Inc. 20
  • 21. IEC62304Implementation IEC 62304 Software Safety Classifications Safety Classifications: IEC 62304 v. FDA Software Level of Concern • Safety Classifications Considerations • The riskier the software, the more rigorous the controls • Important Tip: Clear segmentation of software can allow for discreetly classifying parts of the software which may make the documentation and testing easier IEC 62304 Software Safety Classification FDA Pre-Market Submission Software Levels of Concern Class A: No Injury or Damage to Health is Possible Minor: Failures or latent design flaws are unlikely to cause any injury Class B: Non-serious Injury is Possible Moderate: Failure or latent possible design flaw could directly or indirectly result in minor injury Class C: Death or Serious Injury is Possible Major: Failure or flaw could directly or indirectly result in death or serious injury © 2015 MethodSense, Inc. 21
  • 22. IEC62304Implementation Software Development Life Cycle Process •IEC 62304 Processes, Tasks and Deliverables must be implemented •Requires a Quality Management System and Risk Management Process compliant with ISO 14971 •However, IEC 62304 does not prescribe: •An organizational structure •A particular methodology •A particular document format © 2015 MethodSense, Inc. 22
  • 23. IEC62304Implementation IEC 62304 SDLC Deliverables •Challenge: This has the look and feel of an SDLC known as the Waterfall Model. Is that so? •NO. What this represents is a set of deliverables for a Test Laboratory or a Regulatory Authority (e.g. the FDA) •Important: Think in terms of incorporating into your SDLC methodology the creation of these deliverables © 2015 MethodSense, Inc. 23
  • 24. IEC62304Implementation IEC 62304 SDLC Deliverables •IEC 62304 is pretty clear about what deliverables are required •Test Laboratories have their own check lists you can use as guidance to demonstrate your IEC 62304 compliance •MethodSense has created an IEC 62304 Action List that identifies the required deliverables and we can share this with you •Therefore, the IEC 62304 deliverables are well understood and we can focus on practical considerations for implementation © 2015 MethodSense, Inc. 24
  • 25. IEC62304Implementation IEC 62304 Implementation for Alternative SDLC Methodologies • Waterfall Model: • Generally recognized as impractical and rarely used SDLC model • Fails to account for the iterative nature of Software Development • As a model accommodates the creation of deliverables (e.g. documents) because it allows minimal change along the way • Agile Model: • Generally recognized as a very practical SDLC model • Accounts for the iterative nature of software development • As a model and depending on its implementation makes it difficult to efficiently create the expected 62304 deliverables (e.g. documents) since requirements may be changing during software development • How can you generate IEC 62304 deliverables in an Agile environment? © 2015 MethodSense, Inc. 25
  • 26. IEC62304Implementation IEC 62304 and Agile Development Methodologies • IEC 62304 Conformance Tips in an Agile Environment • Map onto your Agile SDLC IEC 62304 deliverables • Think about segmenting your software to allow the Safety Classifications to apply differently to the different software segments • Ensure your automated tools will deliver documents that meet expectations and conformance needs • If your deliverables cannot keep up with your method, think about scaling back iterative change in a hybrid approach © 2015 MethodSense, Inc. 26
  • 27. IEC62304Implementation IEC 62304 Tips • Common software functionality manufacturers fail to recognize as IEC 62304 compliance issues: • Alarms and Alerts - often an Essential Performance requirement because they are intended to detect abnormalities • Speed & Position Sensors - use software to limit range of motion, speed and force which are Basic Safety concerns • Algorithms - remove the software and the device is no longer able to operate as intended, resulting in the algorithms being part of Essential Performance © 2015 MethodSense, Inc. 27
  • 28. IEC62304Implementation IEC 62304 Tips • Pitfalls to Avoid • Document Your Process Well – document management is essential for meeting compliance goals • Software of Unknown Pedigree (SOUP) – manage your SOUP appropriately • Document Development – make certain you are sufficiently resourced to support document development needs • Version Control & Updates – clearly define what is a software update and further how the software will be maintained in a validated state © 2015 MethodSense, Inc. 28
  • 29. IEC62304Implementation IEC 62304 Tips • What if Your Device Software is Developed by a Third Party? • Supplier Management Process – confirm that software vendor complies with IEC 62304 and processes are reviewed during vendor audit • Quality Agreement – confirm that: • It defines vendor responsibilities and 62304 Deliverables • Vendors procedures used for software development will be provided to you and the test lab for review • Establish your SDLC – at minimum, your process will define acceptance criteria (i.e. IEC 62304 compliance and deliverables) from your vendor © 2015 MethodSense, Inc. 29
  • 30. IEC62304Implementation IEC 62304 Success • IEC 62304 File will be reviewed to ensure: • It contains all required documentation including a risk management file • Procedures meet the requirements of the standard • Each check list item is satisfied • A product review is conducted and further a review of the relevant software segments if it has been decided that the software performs Basic Safety or Essential Performance for your device •After the review, a Pass or Fail Report is delivered Move Commercialization Forward! © 2015 MethodSense, Inc. 30
  • 31. Confidential MethodSense Thanks You!!! Discussion / Q&A © 2015 MethodSense, Inc. 31
  • 32. Thank you. Rita King CEO & Senior Consultant (919) 313-3961 ritaking@methodsense.com © 2015 MethodSense, Inc.