SlideShare une entreprise Scribd logo
1  sur  34
Télécharger pour lire hors ligne
Strategic Gen AI (ChatGPT)
Integration at Enterprise-level
Kevin Lee
Disclaimer
The views and opinions presented here represent those of
the speaker and should not be considered to represent
any companies or organizations.
Agenda
➢ Gen AI (ChatGPT) Implementation
Roadmap for the whole organization
➢ Gen AI & ChatGPT Introduction
➢ Risks and Concerns
➢ Benefits and Use Cases
➢ Cross Functional Team
➢ Policy and Guidelines
➢ Training and Education
➢ PoC
➢ Evaluation
➢ Discussion
3
Does your company allow ChatGPT
at Work?
4
5
A fear of
missing out
A fear of
messing up
Gen AI (Generative AI)
- Introduction
- Gen AI Market Trend
What is Gen AI?
Gen AI – a trained Machine Learning
model that generate new contents
with a simple prompt.
• Text (e.g., Large Language Models) :
Content Writing, Chatbots, Assistants,
Search
• Code : Code Generation, Data Set
Generation
• Image : Image Generation, Image Edit
• Audio : Voice Generation/Edit, Sound
creation, Audio Translation
• Video : Video Creation/Edit, Voice
Translation, Deepfake
7
Gen AI in AI Landscape
8
AI
ML
DL
Gen AI
How Gen AI ( LLM) Works
• So, when ‘input texts’
are prompted into LLM,
LLM provide ‘response’,
which show a highest
probability.
9
10
Bloomberg Gen AI
Market Prediction
ChatGPT
- Introduction
- Development
- Plan
- Popularity
- Why Should I use it & Why not
What is ChatGPT?
• ChatGPT is an advanced LLM developed by
OpenAI.
• ChatGPT is trained on large corpus of text (~300B
tokens).
• Its main strength
• the ability to generate human-like responses in
various contexts.
• The ability to understand and generate text in a
wide range of domains.
• Its application
• Inquiry/prompt ( rather than search )
• Content Generation
• Customer support
• Interactive Storytelling
• Coding
• Image Analysis
• Art Development 12
ChatGPT Development
13
ChatGPT4
• March’2023
• 8K tokens
• 32k tokens (ChatGPT4-
32k)
• ~1,760B parameters
ChatGPT3.5
• April’2023
• 4K tokens (3,072 words)
• 16K tokens
(ChatGPT3.5-turbo-16k)
• 175B parameters
ChatGPT3
• June’2020
• 1,536 words
• 175B parameters
ChatGPT2
• Feb’2019
• 768 word
• 1.5B parameters
Reference Points
• Tweet : 55 words
• NY Times Article : 622 words
• Standard Novel : 90K words
• Kings James Bible : 783,137 words
Each prompt include the current tokens and previous tokens.
ChatGPT Popularity
ChatGPT gained 100M users within 2 months since its release. 14
Reasons that ChatGPT is not being used
• A lack of understanding of
ChatGPT Use Cases / Benefits
• A lack of ChatGPT Usages(
Prompt Engineering)
• Concerns/Risks using ChatGPT
15
Gen AI (ChatGPT)
Implementation
Roadmap
17
Gen AI (ChatGPT) Implementation Roadmap
Risk and
Concerns
Benefits and
Use Cases
Cross
Functional
Team
Policy and
Guideline
Training /
Education
PoC
ROI
Concerns using AI (ChatGPT)
- Data Privacy & Security
- Bias
- Regulatory Compliance
- Ethical Consideration
- Black Box Feature
- Resource Requirements
- Lack of Expertise
- Cost & ROI
19
Data Privacy
• Data Privacy – the right of a
person to have control over
how their personal
information is collected and
used. (e.g., clinical trial data)
• Since ML is built using data,
ML algorithms can contain
sensitive information even
though it is one of a Big Data.
• The growth of ML has
increased the possibility of
using sensitive data in ways
that may violate data
privacy. (e.g., ChatGPT)
20
Bias of Machine Learning
• Phenomenon that occurs
when ML algorithms
produces results that are
prejudiced due to wrong
assumptions
• Examples :
• Amazon ML recruiting
engine show a bias on
women.
• ML was trained to
vet applicants using
10 years of resume
• Most came from
men, a reflection of
male dominance
across tech industry.
21
Regulatory Compliance
• Regulatory Compliance – the
process of adhering to laws,
regulations, standards, and other
rules set by governments and
other regulatory bodies.
• For pre-market approval, AI-
based software needs to follow
regulatory guidelines (e.g., Good
Machine Learning for Medical
Device Development Guiding
Principles)
22
Ethical Consideration
• Who will make decision? AI or
human?
• Can AI be responsible for their
decision?
• Is AI transparent?
Potential Benefits using
ChatGPT
- Higher Productivity / Efficiency
- Better Patient Engagement
- Patient’s Recruitment
- Enhancement in Image
- Market Research & Insights
ChatGPT Users vs Non-users
• Results of consultants
using ChatGPT
• finished 12.2% more
tasks on average
• completed tasks
25.1% more quickly
• produced 40%
higher quality results
24
Bar Exam Score Performance :
ChatGPT3.5 vs ChatGPT4
25
10% vs 90%
CPA Exam Performance:
ChatGPT3.5 vs ChatGPT4
26
35.1% vs 85.1%
ChatGPT
Implementation and
Management
Cross-Functional Team
28
Cross-Functional
AI Team
Biometrics
IT
QA
Data
Privacy
Legal
Regulatory
Leadership
AI Implementation
through Enterprise Policy
and Guidelines
- Data Privacy
- Regulatory Compliance
- Secure Data Storage
- Secure Access in Gen AI
30
Risks
Enterprise-wide Policies &
Guidelines
Compliant AI
Implementation
Risk mitigation through Policies and Guidelines
31
Employee
Training
• Employees who will
be using and
managing
ChatGPT
• Security best
practices
• Data Privacy
• Data Handling
Procedures with
ChatGPT
• Ethics and
Compliance
32
Evaluation
Security and
Compliance
ROI
User
Experience
Training and
Support
Ethical
Considerations
33
So, should we
use Gen AI
such as
ChatGPT at
work?
Discussion : Q & A

Contenu connexe

Similaire à A fear of missing out and a fear of messing up : A Strategic Roadmap for ChatGPT Integration at Work

Similaire à A fear of missing out and a fear of messing up : A Strategic Roadmap for ChatGPT Integration at Work (20)

Why many data science projects fail
Why many data science projects fail Why many data science projects fail
Why many data science projects fail
 
The UAE AI Strategy: Building Intelligent Enterprises
The UAE AI Strategy: Building Intelligent EnterprisesThe UAE AI Strategy: Building Intelligent Enterprises
The UAE AI Strategy: Building Intelligent Enterprises
 
CHAT-GPT Prompts for Grant Writing, Fundraising, and Marketing.pdf
CHAT-GPT Prompts for Grant Writing, Fundraising, and Marketing.pdfCHAT-GPT Prompts for Grant Writing, Fundraising, and Marketing.pdf
CHAT-GPT Prompts for Grant Writing, Fundraising, and Marketing.pdf
 
Whats Next for Machine Learning
Whats Next for Machine LearningWhats Next for Machine Learning
Whats Next for Machine Learning
 
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit ShahANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
 
3 Business Problems Chatbots Solve Best
3 Business Problems Chatbots Solve Best3 Business Problems Chatbots Solve Best
3 Business Problems Chatbots Solve Best
 
Dr Christoph Nieuwoudt- AI in Financial Services
Dr Christoph Nieuwoudt- AI in Financial ServicesDr Christoph Nieuwoudt- AI in Financial Services
Dr Christoph Nieuwoudt- AI in Financial Services
 
ANIn Hyderabad Nov2023|Generative AI for software engineering - Lakshman Peet...
ANIn Hyderabad Nov2023|Generative AI for software engineering - Lakshman Peet...ANIn Hyderabad Nov2023|Generative AI for software engineering - Lakshman Peet...
ANIn Hyderabad Nov2023|Generative AI for software engineering - Lakshman Peet...
 
An Introduction To Using ChatGPT For Business
An Introduction To Using ChatGPT For BusinessAn Introduction To Using ChatGPT For Business
An Introduction To Using ChatGPT For Business
 
Algorithm Marketplace and the new "Algorithm Economy"
Algorithm Marketplace and the new "Algorithm Economy"Algorithm Marketplace and the new "Algorithm Economy"
Algorithm Marketplace and the new "Algorithm Economy"
 
Intro to Artificial Intelligence w/ Target's Director of PM
 Intro to Artificial Intelligence w/ Target's Director of PM Intro to Artificial Intelligence w/ Target's Director of PM
Intro to Artificial Intelligence w/ Target's Director of PM
 
What is Chatgpt Complete Guide
What is Chatgpt Complete GuideWhat is Chatgpt Complete Guide
What is Chatgpt Complete Guide
 
Minne analytics presentation 2018 12 03 final compressed
Minne analytics presentation 2018 12 03 final   compressedMinne analytics presentation 2018 12 03 final   compressed
Minne analytics presentation 2018 12 03 final compressed
 
Partnering with the big boys
Partnering with the big boysPartnering with the big boys
Partnering with the big boys
 
HacktoberFestPune - DSC MESCOE x DSC PVGCOET
HacktoberFestPune - DSC MESCOE x DSC PVGCOETHacktoberFestPune - DSC MESCOE x DSC PVGCOET
HacktoberFestPune - DSC MESCOE x DSC PVGCOET
 
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
 
Trends of AI in ITSM
Trends of AI in ITSMTrends of AI in ITSM
Trends of AI in ITSM
 
Presentation by Germin8 at Zensar #TechShowcase - An iSPIRT ProductNation ini...
Presentation by Germin8 at Zensar #TechShowcase - An iSPIRT ProductNation ini...Presentation by Germin8 at Zensar #TechShowcase - An iSPIRT ProductNation ini...
Presentation by Germin8 at Zensar #TechShowcase - An iSPIRT ProductNation ini...
 
ABM: How to Define Your Ideal Customer Profile
ABM: How to Define Your Ideal Customer ProfileABM: How to Define Your Ideal Customer Profile
ABM: How to Define Your Ideal Customer Profile
 
Ai design sprint - Finance - Wealth management
Ai design sprint  - Finance - Wealth managementAi design sprint  - Finance - Wealth management
Ai design sprint - Finance - Wealth management
 

Plus de Kevin Lee

Introduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric DepartmentIntroduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric Department
Kevin Lee
 
Prompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data ScientistsPrompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data Scientists
Kevin Lee
 
Leading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management LeadershipLeading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management Leadership
Kevin Lee
 
Perfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard dataPerfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard data
Kevin Lee
 
Machine Learning : why we should know and how it works
Machine Learning : why we should know and how it worksMachine Learning : why we should know and how it works
Machine Learning : why we should know and how it works
Kevin Lee
 
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
Kevin Lee
 
Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?
Kevin Lee
 
SAS integration with NoSQL data
SAS integration with NoSQL dataSAS integration with NoSQL data
SAS integration with NoSQL data
Kevin Lee
 
Introduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmersIntroduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmers
Kevin Lee
 

Plus de Kevin Lee (20)

Patient’s Journey using Real World Data and its Advanced Analytics
Patient’s Journey using Real World Data and its Advanced AnalyticsPatient’s Journey using Real World Data and its Advanced Analytics
Patient’s Journey using Real World Data and its Advanced Analytics
 
Introduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric DepartmentIntroduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric Department
 
Prompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data ScientistsPrompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data Scientists
 
Leading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management LeadershipLeading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management Leadership
 
How to create SDTM DM.xpt using Python v1.1
How to create SDTM DM.xpt using Python v1.1How to create SDTM DM.xpt using Python v1.1
How to create SDTM DM.xpt using Python v1.1
 
Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...
 
How I became ML Engineer
How I became ML Engineer How I became ML Engineer
How I became ML Engineer
 
Artificial Intelligence in Pharmaceutical Industry
Artificial Intelligence in Pharmaceutical IndustryArtificial Intelligence in Pharmaceutical Industry
Artificial Intelligence in Pharmaceutical Industry
 
Tell stories with jupyter notebook
Tell stories with jupyter notebookTell stories with jupyter notebook
Tell stories with jupyter notebook
 
Perfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard dataPerfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard data
 
Machine Learning : why we should know and how it works
Machine Learning : why we should know and how it worksMachine Learning : why we should know and how it works
Machine Learning : why we should know and how it works
 
Big data for SAS programmers
Big data for SAS programmersBig data for SAS programmers
Big data for SAS programmers
 
Big data in pharmaceutical industry
Big data in pharmaceutical industryBig data in pharmaceutical industry
Big data in pharmaceutical industry
 
How FDA will reject non compliant electronic submission
How FDA will reject non compliant electronic submissionHow FDA will reject non compliant electronic submission
How FDA will reject non compliant electronic submission
 
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
 
Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?
 
SAS integration with NoSQL data
SAS integration with NoSQL dataSAS integration with NoSQL data
SAS integration with NoSQL data
 
Introduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmersIntroduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmers
 
Standards Metadata Management (system)
Standards Metadata Management (system)Standards Metadata Management (system)
Standards Metadata Management (system)
 
Data centric SDLC for automated clinical data development
Data centric SDLC for automated clinical data developmentData centric SDLC for automated clinical data development
Data centric SDLC for automated clinical data development
 

Dernier

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
FIDO Alliance
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
FIDO Alliance
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Dernier (20)

WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Decarbonising Commercial Real Estate: The Role of Operational Performance
Decarbonising Commercial Real Estate: The Role of Operational PerformanceDecarbonising Commercial Real Estate: The Role of Operational Performance
Decarbonising Commercial Real Estate: The Role of Operational Performance
 
Stronger Together: Developing an Organizational Strategy for Accessible Desig...
Stronger Together: Developing an Organizational Strategy for Accessible Desig...Stronger Together: Developing an Organizational Strategy for Accessible Desig...
Stronger Together: Developing an Organizational Strategy for Accessible Desig...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data PlatformLess Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Navigating Identity and Access Management in the Modern Enterprise
Navigating Identity and Access Management in the Modern EnterpriseNavigating Identity and Access Management in the Modern Enterprise
Navigating Identity and Access Management in the Modern Enterprise
 
API Governance and Monetization - The evolution of API governance
API Governance and Monetization -  The evolution of API governanceAPI Governance and Monetization -  The evolution of API governance
API Governance and Monetization - The evolution of API governance
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Choreo: Empowering the Future of Enterprise Software Engineering
Choreo: Empowering the Future of Enterprise Software EngineeringChoreo: Empowering the Future of Enterprise Software Engineering
Choreo: Empowering the Future of Enterprise Software Engineering
 
Modernizing Legacy Systems Using Ballerina
Modernizing Legacy Systems Using BallerinaModernizing Legacy Systems Using Ballerina
Modernizing Legacy Systems Using Ballerina
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 

A fear of missing out and a fear of messing up : A Strategic Roadmap for ChatGPT Integration at Work

  • 1. Strategic Gen AI (ChatGPT) Integration at Enterprise-level Kevin Lee
  • 2. Disclaimer The views and opinions presented here represent those of the speaker and should not be considered to represent any companies or organizations.
  • 3. Agenda ➢ Gen AI (ChatGPT) Implementation Roadmap for the whole organization ➢ Gen AI & ChatGPT Introduction ➢ Risks and Concerns ➢ Benefits and Use Cases ➢ Cross Functional Team ➢ Policy and Guidelines ➢ Training and Education ➢ PoC ➢ Evaluation ➢ Discussion 3
  • 4. Does your company allow ChatGPT at Work? 4
  • 5. 5 A fear of missing out A fear of messing up
  • 6. Gen AI (Generative AI) - Introduction - Gen AI Market Trend
  • 7. What is Gen AI? Gen AI – a trained Machine Learning model that generate new contents with a simple prompt. • Text (e.g., Large Language Models) : Content Writing, Chatbots, Assistants, Search • Code : Code Generation, Data Set Generation • Image : Image Generation, Image Edit • Audio : Voice Generation/Edit, Sound creation, Audio Translation • Video : Video Creation/Edit, Voice Translation, Deepfake 7
  • 8. Gen AI in AI Landscape 8 AI ML DL Gen AI
  • 9. How Gen AI ( LLM) Works • So, when ‘input texts’ are prompted into LLM, LLM provide ‘response’, which show a highest probability. 9
  • 11. ChatGPT - Introduction - Development - Plan - Popularity - Why Should I use it & Why not
  • 12. What is ChatGPT? • ChatGPT is an advanced LLM developed by OpenAI. • ChatGPT is trained on large corpus of text (~300B tokens). • Its main strength • the ability to generate human-like responses in various contexts. • The ability to understand and generate text in a wide range of domains. • Its application • Inquiry/prompt ( rather than search ) • Content Generation • Customer support • Interactive Storytelling • Coding • Image Analysis • Art Development 12
  • 13. ChatGPT Development 13 ChatGPT4 • March’2023 • 8K tokens • 32k tokens (ChatGPT4- 32k) • ~1,760B parameters ChatGPT3.5 • April’2023 • 4K tokens (3,072 words) • 16K tokens (ChatGPT3.5-turbo-16k) • 175B parameters ChatGPT3 • June’2020 • 1,536 words • 175B parameters ChatGPT2 • Feb’2019 • 768 word • 1.5B parameters Reference Points • Tweet : 55 words • NY Times Article : 622 words • Standard Novel : 90K words • Kings James Bible : 783,137 words Each prompt include the current tokens and previous tokens.
  • 14. ChatGPT Popularity ChatGPT gained 100M users within 2 months since its release. 14
  • 15. Reasons that ChatGPT is not being used • A lack of understanding of ChatGPT Use Cases / Benefits • A lack of ChatGPT Usages( Prompt Engineering) • Concerns/Risks using ChatGPT 15
  • 17. 17 Gen AI (ChatGPT) Implementation Roadmap Risk and Concerns Benefits and Use Cases Cross Functional Team Policy and Guideline Training / Education PoC ROI
  • 18. Concerns using AI (ChatGPT) - Data Privacy & Security - Bias - Regulatory Compliance - Ethical Consideration - Black Box Feature - Resource Requirements - Lack of Expertise - Cost & ROI
  • 19. 19 Data Privacy • Data Privacy – the right of a person to have control over how their personal information is collected and used. (e.g., clinical trial data) • Since ML is built using data, ML algorithms can contain sensitive information even though it is one of a Big Data. • The growth of ML has increased the possibility of using sensitive data in ways that may violate data privacy. (e.g., ChatGPT)
  • 20. 20 Bias of Machine Learning • Phenomenon that occurs when ML algorithms produces results that are prejudiced due to wrong assumptions • Examples : • Amazon ML recruiting engine show a bias on women. • ML was trained to vet applicants using 10 years of resume • Most came from men, a reflection of male dominance across tech industry.
  • 21. 21 Regulatory Compliance • Regulatory Compliance – the process of adhering to laws, regulations, standards, and other rules set by governments and other regulatory bodies. • For pre-market approval, AI- based software needs to follow regulatory guidelines (e.g., Good Machine Learning for Medical Device Development Guiding Principles)
  • 22. 22 Ethical Consideration • Who will make decision? AI or human? • Can AI be responsible for their decision? • Is AI transparent?
  • 23. Potential Benefits using ChatGPT - Higher Productivity / Efficiency - Better Patient Engagement - Patient’s Recruitment - Enhancement in Image - Market Research & Insights
  • 24. ChatGPT Users vs Non-users • Results of consultants using ChatGPT • finished 12.2% more tasks on average • completed tasks 25.1% more quickly • produced 40% higher quality results 24
  • 25. Bar Exam Score Performance : ChatGPT3.5 vs ChatGPT4 25 10% vs 90%
  • 26. CPA Exam Performance: ChatGPT3.5 vs ChatGPT4 26 35.1% vs 85.1%
  • 29. AI Implementation through Enterprise Policy and Guidelines - Data Privacy - Regulatory Compliance - Secure Data Storage - Secure Access in Gen AI
  • 30. 30 Risks Enterprise-wide Policies & Guidelines Compliant AI Implementation Risk mitigation through Policies and Guidelines
  • 31. 31 Employee Training • Employees who will be using and managing ChatGPT • Security best practices • Data Privacy • Data Handling Procedures with ChatGPT • Ethics and Compliance
  • 33. 33 So, should we use Gen AI such as ChatGPT at work?