SlideShare une entreprise Scribd logo
1  sur  72
Medical Literature: Reading, Interpreting, and Writing Muhammad Mamdani, PharmD, MA, MPH Director, Applied Health Research Centre LKSKI of St. Michael’s Hospital Associate Professor – University of Toronto Adjunct Faculty – King Saud University February 2010
Objectives ,[object Object],[object Object],[object Object],[object Object]
Clinical Research: Basic Purpose and Context
The Common Goal of Research ,[object Object],[object Object],TRUTH Study 3 Study 1 Study 2
Perception: Reality vs Belief
Variability in Perceptions
The Trouble with Research Example: H. pylori eradication and non-ulcer dyspepsia ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Evolving Nature of Research
The Evolving Nature of Research ,[object Object],[object Object],[object Object],[object Object]
But How Do I Know About the Quality and Validity of the Study?
Understanding Clinical Research:  What do I Need to Fully Interpret a Clinical Study? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Medical Research Spectrum (Sung, JAMA, 2003)
The Medical Research Spectrum (Sung, JAMA, 2003)
Basic Clinical Research Methodology
Comparative Clinical Research:  A Simplistic Overview (Melot, CCM, 2009)
Approaches to Clinical Research ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Randomized Clinical Trial: Design (Melot, CCM, 2009)
Validity and Biases in Clinical Trials (Melot, CCM, 2009)
Major Observational Study Types ,[object Object],[object Object],[object Object],[object Object]
TIME Basic Schematic for Cross-Sectional Study Data for analysis ,[object Object],[object Object],[object Object],[object Object]
TIME Look-back Window Index Entry Date for Exposure End of Follow-up Date Observation Window Basic Schematic for Cohort Study ,[object Object],[object Object],[object Object]
Basic Schematic for Case-Control Study Time Period Event No Event Cases Controls Time Period ,[object Object],[object Object],[object Object],[object Object]
Basic Schematic for Case-Crossover Study Time Period A Time Period B Event Compare exposure in Time Period A vs. Time Period B only among patients with an event and exposure in either period ,[object Object],[object Object],[object Object],[object Object]
How Do I Know Which Study Design is Best? Oxford Centre for Evidence-Based Medicine, 2002 Level of Evidence Study Type Level 1 RCTs Level 2 Cohort Studies Level 3 Case-Control Studies Level 4 Case Series Level 5 Expert Opinion
Analytical Aspects
Numeric Literacy (Horton and Switzer, NEJM, 2005) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Numerical Methods ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Measures of Association:  An Example Total n = 40,000 N per study group = 20,000 Absolute Risks AR (Placebo) = 0.5% AR (Treatment) = 0.15% ARR = 0. 5% - 0.15% =  0.35% NNT = 1/0.35% = 296 Relative Risks   RR = 0.15% / 0.5% =  0.30 RRR = 1/RR = 70% OR (CC: Logistic Regression) HR (Cohort: Cox PH Models) Placebo Treatment MI 100 30 No MI 19900 19970
Issues with Numerical Approaches ,[object Object],[object Object]
Literature Evaluation Tools
Standards for Assessing Quality of Research ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Consort Statement
STROBE
Group Activity: Pitt et al
Group Exercise ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Pitt et al: Study Overview
RALES:  Randomized ALdactonE Study Pitt et al, N Engl J Med, 1999 ,[object Object],[object Object],Screened  (n=?) Randomize Spironolactone (n=822) 25 mg po qd - Increase to 50 mg po qd where tolerated Placebo (n=841) Inclusion Exclusion
RALES Criteria ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
RALES - Results Outcome Absolute Risk Relative Risk Death Pl=46%  Spir=35% p<0.001 0.70  (0.60-0.82) Readmission for HF Pl=36%  Spir=26% p<0.001 0.65 (0.54-0.77) Serious Hyperkalemia Pl=1.2%  Spir=1.7% p=0.42 NS
What Happened in Actual Practice? Juurlink et al, NEJM, 2004
Spironolactone Prescription Uptake 1994-2001 RALES
Hospital Admission Associated with   K + RALES
Admission Associated with   K +  Ending in Death RALES
What about the expected benefits?
Readmission for Heart Failure RALES
All-Cause Mortality RALES
What Happened???
In the ‘Real World’…. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
What’s the Problem?
Anton et al J Clin Pharm Ther 2003; 28: 285-7 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Findings ,[object Object],[object Object],J Clin Pharm Ther 2003;28:285-7
Bozkurt et al J Am Coll Cardiol 2003;41:211-4 Criteria Bozkurt et al (n=104) RALES (n=822) NHYA (% patients) I II III IV Undocumented 4.5% 4.5% 15.3% 10.3% 65.4% 0% 0.5% 72% 27% 0% % Patients with LVEF < 35% 54.8% 100% % Patients with renal insufficiency at baseline 30.7% Excluded Use of beta-blockers 34.6% 11%
[object Object],What RALES said… What we heard… ,[object Object]
Interpreting Evidence:  Key Points ,[object Object],[object Object],[object Object]
Putting It All Together ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Where Does Evidence Fit Into the Decision-Making Process? BELIEFS BEHAVIOUR Evidence Personal Values / Experience Societal Values ‘ Other’ Factors
Clinical Research: Writing a Scientific Manuscript
What Do Journal Editors Look For? What will maximize the journal’s IMPACT FACTOR? Characteristic Implications Clinical Relevance Research question should be relevant: Ask other clinicians about question’s clinical importance Originality Research question should ideally be unique: Perform a PubMed search Clarity Research question should be simple Study design should be well explained with ONE primary endpoint Before beginning study – know which 4 or 5 figures and/or tables will be produced; make mock figures/tables Know your audience: simple language Good Science Assemble a team: study  lead, methodologist, statistician, clinician, at least one senior researcher Must have good design, sufficient sample size, and analysis plan Brevity Keep the manuscript short: 2,000 – 3,000 words Consider different formats: brief reports, research letters
Fogg, BJ, et al, What makes Websites Credible? Stanford Persuasive Technology Lab
Author Photo Results believable trustworthy competent credible unbiased expert COMPOSITE casual   photo no photo formal photo Fogg, BJ, et al, What makes Websites Credible? Stanford Persuasive Technology Lab
The Anatomy of a Clinical Research Question ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Anatomy of a Clinical Research Question ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Research Impact ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Other Considerations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Research and Communications:  An Example
Background ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
So We Conducted a Study   (Park-Wyllie et al, NEJM, 2006) ,[object Object],[object Object],[object Object],[object Object],[object Object]
What Were the Results? ,[object Object],[object Object],[object Object],[object Object]
The Basic Communications Plan ,[object Object],[object Object],[object Object],[object Object]
Making the Numbers Tangible ,[object Object],[object Object],[object Object],[object Object]
Impact ,[object Object],[object Object],[object Object],[object Object],[object Object]
 

Contenu connexe

Tendances

Nakasongola Community Diagnosis Report
Nakasongola Community Diagnosis ReportNakasongola Community Diagnosis Report
Nakasongola Community Diagnosis Report
Oriba Dan Langoya
 

Tendances (20)

Outpatient Department (OPD)
Outpatient Department (OPD)Outpatient Department (OPD)
Outpatient Department (OPD)
 
6. Randomised controlled trial
6. Randomised controlled trial6. Randomised controlled trial
6. Randomised controlled trial
 
Dietary services_ Madhu & Kritika (1).pptx
Dietary services_ Madhu & Kritika (1).pptxDietary services_ Madhu & Kritika (1).pptx
Dietary services_ Madhu & Kritika (1).pptx
 
PMH
PMHPMH
PMH
 
Licenses and standardization of hospitals
Licenses and standardization of hospitalsLicenses and standardization of hospitals
Licenses and standardization of hospitals
 
Hospital report
Hospital report Hospital report
Hospital report
 
Nakasongola Community Diagnosis Report
Nakasongola Community Diagnosis ReportNakasongola Community Diagnosis Report
Nakasongola Community Diagnosis Report
 
Medical Ethics
Medical EthicsMedical Ethics
Medical Ethics
 
Hospital management17
Hospital management17Hospital management17
Hospital management17
 
Bioethics
BioethicsBioethics
Bioethics
 
GUIDELINES ON CONDUCTING CLINICAL RESEARCH IN HOSPITAL KUALA LUMPUR
GUIDELINES ON CONDUCTING CLINICAL RESEARCH IN HOSPITAL KUALA LUMPURGUIDELINES ON CONDUCTING CLINICAL RESEARCH IN HOSPITAL KUALA LUMPUR
GUIDELINES ON CONDUCTING CLINICAL RESEARCH IN HOSPITAL KUALA LUMPUR
 
Hospital design
Hospital designHospital design
Hospital design
 
Healthcare Ethics
Healthcare Ethics Healthcare Ethics
Healthcare Ethics
 
Team based collaborative care
Team based collaborative careTeam based collaborative care
Team based collaborative care
 
The Medical Home Model: Patient Centered Care
The Medical Home Model: Patient Centered CareThe Medical Home Model: Patient Centered Care
The Medical Home Model: Patient Centered Care
 
Doctors order sheet
Doctors order sheetDoctors order sheet
Doctors order sheet
 
Evidence based medicine
Evidence based medicineEvidence based medicine
Evidence based medicine
 
Importance of opd
Importance of opdImportance of opd
Importance of opd
 
1 public health ethics
1 public health ethics1 public health ethics
1 public health ethics
 
Risk of bias in systematic review
Risk of bias in systematic reviewRisk of bias in systematic review
Risk of bias in systematic review
 

En vedette

Patient Monitoring
Patient Monitoring	Patient Monitoring
Patient Monitoring
Khalid
 
Airway Evaluation and Management
Airway Evaluation and Management	Airway Evaluation and Management
Airway Evaluation and Management
Khalid
 
Fluids
Fluids		Fluids
Fluids
Khalid
 
Role of anesthesiologist in pre-opertive period
Role of anesthesiologist in pre-opertive period	Role of anesthesiologist in pre-opertive period
Role of anesthesiologist in pre-opertive period
Khalid
 
Introduction to Regional
Introduction to Regional	Introduction to Regional
Introduction to Regional
Khalid
 
Interpretation OF PFT
Interpretation OF PFT		Interpretation OF PFT
Interpretation OF PFT
Khalid
 
Electrical Safety, Humidity And Scavenging
Electrical Safety, Humidity And ScavengingElectrical Safety, Humidity And Scavenging
Electrical Safety, Humidity And Scavenging
Khalid
 
Airway Evaluation and Management
Airway Evaluation and Management		Airway Evaluation and Management
Airway Evaluation and Management
Khalid
 

En vedette (20)

8-Clinical Trial Studies
8-Clinical Trial Studies8-Clinical Trial Studies
8-Clinical Trial Studies
 
CVS PSL and Monitoring
CVS PSL and Monitoring	CVS PSL and Monitoring
CVS PSL and Monitoring
 
Presentation on co drug strategy for treating hypertension in type ii
Presentation on co drug strategy for treating hypertension in type iiPresentation on co drug strategy for treating hypertension in type ii
Presentation on co drug strategy for treating hypertension in type ii
 
VIVEKANAND JAIN : My journey to ifla wlic seminars
VIVEKANAND JAIN : My journey to ifla wlic seminarsVIVEKANAND JAIN : My journey to ifla wlic seminars
VIVEKANAND JAIN : My journey to ifla wlic seminars
 
Patient Monitoring
Patient Monitoring	Patient Monitoring
Patient Monitoring
 
Airway Evaluation and Management
Airway Evaluation and Management	Airway Evaluation and Management
Airway Evaluation and Management
 
Jain monk yogindra sagar ji maharaj
Jain monk yogindra sagar ji maharajJain monk yogindra sagar ji maharaj
Jain monk yogindra sagar ji maharaj
 
Antihypertensive lecture
Antihypertensive lecture Antihypertensive lecture
Antihypertensive lecture
 
Online resources user training programme
Online resources user training programmeOnline resources user training programme
Online resources user training programme
 
Fluids
Fluids		Fluids
Fluids
 
Role of anesthesiologist in pre-opertive period
Role of anesthesiologist in pre-opertive period	Role of anesthesiologist in pre-opertive period
Role of anesthesiologist in pre-opertive period
 
Opioids
Opioids		Opioids
Opioids
 
9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic Review9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic Review
 
Introduction to Regional
Introduction to Regional	Introduction to Regional
Introduction to Regional
 
Interpretation OF PFT
Interpretation OF PFT		Interpretation OF PFT
Interpretation OF PFT
 
Electrical Safety, Humidity And Scavenging
Electrical Safety, Humidity And ScavengingElectrical Safety, Humidity And Scavenging
Electrical Safety, Humidity And Scavenging
 
Airway Evaluation and Management
Airway Evaluation and Management		Airway Evaluation and Management
Airway Evaluation and Management
 
Pulmonary Imaging
Pulmonary ImagingPulmonary Imaging
Pulmonary Imaging
 
Bhu alumni 2015
Bhu alumni 2015Bhu alumni 2015
Bhu alumni 2015
 
Banaras hindu university 2
Banaras hindu university 2Banaras hindu university 2
Banaras hindu university 2
 

Similaire à Medical Literature

Eblm pres final
Eblm pres finalEblm pres final
Eblm pres final
prasath172
 
Critical appraisal of meta-analysis
Critical appraisal of meta-analysisCritical appraisal of meta-analysis
Critical appraisal of meta-analysis
Samir Haffar
 
Module 4 Submodule 4. 2 Final June 2007
Module 4 Submodule 4. 2 Final June 2007Module 4 Submodule 4. 2 Final June 2007
Module 4 Submodule 4. 2 Final June 2007
Flavio Guzmán
 
Drug risk assessment 23 4-2010
Drug risk assessment 23 4-2010Drug risk assessment 23 4-2010
Drug risk assessment 23 4-2010
RobHeerdink
 
Clinicaltrial 300807
Clinicaltrial 300807Clinicaltrial 300807
Clinicaltrial 300807
amitgajjar85
 

Similaire à Medical Literature (20)

Ebm Nahid Sherbini
Ebm Nahid SherbiniEbm Nahid Sherbini
Ebm Nahid Sherbini
 
Eblm pres final
Eblm pres finalEblm pres final
Eblm pres final
 
Doug Altman 15 Jan09 V4
Doug Altman 15 Jan09 V4Doug Altman 15 Jan09 V4
Doug Altman 15 Jan09 V4
 
Critical appraisal of meta-analysis
Critical appraisal of meta-analysisCritical appraisal of meta-analysis
Critical appraisal of meta-analysis
 
Research methodology
Research methodologyResearch methodology
Research methodology
 
Research methodology
Research methodologyResearch methodology
Research methodology
 
LOE and SOR criteria
LOE and SOR criteriaLOE and SOR criteria
LOE and SOR criteria
 
Intent-to-Treat (ITT) Analysis in Randomized Clinical Trials
Intent-to-Treat (ITT) Analysis in Randomized Clinical TrialsIntent-to-Treat (ITT) Analysis in Randomized Clinical Trials
Intent-to-Treat (ITT) Analysis in Randomized Clinical Trials
 
Module 4 Submodule 4. 2 Final June 2007
Module 4 Submodule 4. 2 Final June 2007Module 4 Submodule 4. 2 Final June 2007
Module 4 Submodule 4. 2 Final June 2007
 
Why bother with evidence-based practice?
Why bother with evidence-based practice?Why bother with evidence-based practice?
Why bother with evidence-based practice?
 
Evidence based Practice in Emergency Medicine
Evidence based Practice in Emergency Medicine Evidence based Practice in Emergency Medicine
Evidence based Practice in Emergency Medicine
 
Ebm
EbmEbm
Ebm
 
Case Report Writing
Case Report WritingCase Report Writing
Case Report Writing
 
Research methodology
Research methodologyResearch methodology
Research methodology
 
systematic review and metaanalysis
systematic review and metaanalysis systematic review and metaanalysis
systematic review and metaanalysis
 
Strategies For Answering Clinical Queries
Strategies For Answering Clinical QueriesStrategies For Answering Clinical Queries
Strategies For Answering Clinical Queries
 
Drug risk assessment 23 4-2010
Drug risk assessment 23 4-2010Drug risk assessment 23 4-2010
Drug risk assessment 23 4-2010
 
Evidence Based Practice and Finding the Information You Need
Evidence Based Practice and Finding the Information You NeedEvidence Based Practice and Finding the Information You Need
Evidence Based Practice and Finding the Information You Need
 
Published Research, Flawed, Misleading, Nefarious - Use of Reporting Guidelin...
Published Research, Flawed, Misleading, Nefarious - Use of Reporting Guidelin...Published Research, Flawed, Misleading, Nefarious - Use of Reporting Guidelin...
Published Research, Flawed, Misleading, Nefarious - Use of Reporting Guidelin...
 
Clinicaltrial 300807
Clinicaltrial 300807Clinicaltrial 300807
Clinicaltrial 300807
 

Plus de Khalid

Plus de Khalid (19)

Introduction to medical ethics
Introduction to medical ethics	Introduction to medical ethics
Introduction to medical ethics
 
Physiological Changes In Pregnancy
Physiological Changes In Pregnancy	Physiological Changes In Pregnancy
Physiological Changes In Pregnancy
 
Diabetes Mellitus
Diabetes MellitusDiabetes Mellitus
Diabetes Mellitus
 
Pulmonary Embolism
Pulmonary Embolism	Pulmonary Embolism
Pulmonary Embolism
 
Shock
Shock	Shock
Shock
 
General Anesthesia
General AnesthesiaGeneral Anesthesia
General Anesthesia
 
Emergency Medicine
Emergency Medicine		Emergency Medicine
Emergency Medicine
 
Diagnosis and Management of Shock
Diagnosis and Management of Shock		Diagnosis and Management of Shock
Diagnosis and Management of Shock
 
Patient Monitoring
Patient Monitoring	Patient Monitoring
Patient Monitoring
 
Blood Transfusion
Blood Transfusion	Blood Transfusion
Blood Transfusion
 
Opioids Drugs
Opioids DrugsOpioids Drugs
Opioids Drugs
 
IV anesthetic
IV anesthetic		IV anesthetic
IV anesthetic
 
Muscle Relaxants
Muscle RelaxantsMuscle Relaxants
Muscle Relaxants
 
Pharmacodynamics
PharmacodynamicsPharmacodynamics
Pharmacodynamics
 
Pharmacokinetics
PharmacokineticsPharmacokinetics
Pharmacokinetics
 
Physics And Clinical Measurements
Physics And Clinical MeasurementsPhysics And Clinical Measurements
Physics And Clinical Measurements
 
Hemodynamic Pressure Monitoring
Hemodynamic Pressure MonitoringHemodynamic Pressure Monitoring
Hemodynamic Pressure Monitoring
 
Preoperative Evaluation
Preoperative EvaluationPreoperative Evaluation
Preoperative Evaluation
 
Anesthesia Machine
Anesthesia MachineAnesthesia Machine
Anesthesia Machine
 

Medical Literature

  • 1. Medical Literature: Reading, Interpreting, and Writing Muhammad Mamdani, PharmD, MA, MPH Director, Applied Health Research Centre LKSKI of St. Michael’s Hospital Associate Professor – University of Toronto Adjunct Faculty – King Saud University February 2010
  • 2.
  • 3. Clinical Research: Basic Purpose and Context
  • 4.
  • 7.
  • 8. The Evolving Nature of Research
  • 9.
  • 10. But How Do I Know About the Quality and Validity of the Study?
  • 11.
  • 12. The Medical Research Spectrum (Sung, JAMA, 2003)
  • 13. The Medical Research Spectrum (Sung, JAMA, 2003)
  • 14. Basic Clinical Research Methodology
  • 15. Comparative Clinical Research: A Simplistic Overview (Melot, CCM, 2009)
  • 16.
  • 17. Randomized Clinical Trial: Design (Melot, CCM, 2009)
  • 18. Validity and Biases in Clinical Trials (Melot, CCM, 2009)
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24. How Do I Know Which Study Design is Best? Oxford Centre for Evidence-Based Medicine, 2002 Level of Evidence Study Type Level 1 RCTs Level 2 Cohort Studies Level 3 Case-Control Studies Level 4 Case Series Level 5 Expert Opinion
  • 26.
  • 27.
  • 28. Measures of Association: An Example Total n = 40,000 N per study group = 20,000 Absolute Risks AR (Placebo) = 0.5% AR (Treatment) = 0.15% ARR = 0. 5% - 0.15% = 0.35% NNT = 1/0.35% = 296 Relative Risks RR = 0.15% / 0.5% = 0.30 RRR = 1/RR = 70% OR (CC: Logistic Regression) HR (Cohort: Cox PH Models) Placebo Treatment MI 100 30 No MI 19900 19970
  • 29.
  • 31.
  • 35.
  • 36. Pitt et al: Study Overview
  • 37.
  • 38.
  • 39. RALES - Results Outcome Absolute Risk Relative Risk Death Pl=46% Spir=35% p<0.001 0.70 (0.60-0.82) Readmission for HF Pl=36% Spir=26% p<0.001 0.65 (0.54-0.77) Serious Hyperkalemia Pl=1.2% Spir=1.7% p=0.42 NS
  • 40. What Happened in Actual Practice? Juurlink et al, NEJM, 2004
  • 42. Hospital Admission Associated with  K + RALES
  • 43. Admission Associated with  K + Ending in Death RALES
  • 44. What about the expected benefits?
  • 45. Readmission for Heart Failure RALES
  • 48.
  • 50.
  • 51.
  • 52. Bozkurt et al J Am Coll Cardiol 2003;41:211-4 Criteria Bozkurt et al (n=104) RALES (n=822) NHYA (% patients) I II III IV Undocumented 4.5% 4.5% 15.3% 10.3% 65.4% 0% 0.5% 72% 27% 0% % Patients with LVEF < 35% 54.8% 100% % Patients with renal insufficiency at baseline 30.7% Excluded Use of beta-blockers 34.6% 11%
  • 53.
  • 54.
  • 55.
  • 56. Where Does Evidence Fit Into the Decision-Making Process? BELIEFS BEHAVIOUR Evidence Personal Values / Experience Societal Values ‘ Other’ Factors
  • 57. Clinical Research: Writing a Scientific Manuscript
  • 58. What Do Journal Editors Look For? What will maximize the journal’s IMPACT FACTOR? Characteristic Implications Clinical Relevance Research question should be relevant: Ask other clinicians about question’s clinical importance Originality Research question should ideally be unique: Perform a PubMed search Clarity Research question should be simple Study design should be well explained with ONE primary endpoint Before beginning study – know which 4 or 5 figures and/or tables will be produced; make mock figures/tables Know your audience: simple language Good Science Assemble a team: study lead, methodologist, statistician, clinician, at least one senior researcher Must have good design, sufficient sample size, and analysis plan Brevity Keep the manuscript short: 2,000 – 3,000 words Consider different formats: brief reports, research letters
  • 59. Fogg, BJ, et al, What makes Websites Credible? Stanford Persuasive Technology Lab
  • 60. Author Photo Results believable trustworthy competent credible unbiased expert COMPOSITE casual photo no photo formal photo Fogg, BJ, et al, What makes Websites Credible? Stanford Persuasive Technology Lab
  • 61.
  • 62.
  • 63.
  • 64.
  • 66.
  • 67.
  • 68.
  • 69.
  • 70.
  • 71.
  • 72.