SlideShare une entreprise Scribd logo
1  sur  48
ChatGPT, Generative AI
and Web3
Opportunities, challenges and some ambitious ideas
Jesus Rodriguez
IntoTheBlock
GENERATIVE AI and WEB3
Agenda
● A brief history of foundation models
● Web3 and foundation models: opportunities
● Challenges
● Moonshot ideas
An Update About IntoTheBlock
GENERATIVE AI and WEB3
IntoTheBlock Analytics has a New Look
CoinTracking
Libertify
New Live
Customers
GENERATIVE AI and WEB3
CoinTracking
Libertify
New Live
Customers
GENERATIVE AI and WEB3
GENERATIVE AI and WEB3
● New protocols have been onboarded for the DeFi Risk Radar release
● New DeFi strategies have been added to the ITB Smart Yields platform
● ITB analytics is about to release support for Optimism analytics
Other Updates
The evolution towards ChatGPT, GPT4 and
foundation models…
GENERATIVE AI and WEB3
GENERATIVE AI and WEB3
Models such as ChatGPT or GPT-4 are known
as foundation models which represents the
dominant paradigm in generative AI
GENERATIVE AI and WEB3
A foundation model is a
large artificialintelligence model
trained on a vast quantity of
unlabeled data at scale resultingin
a model that can be adapted to a
wide range of downstream tasks.
Foundation Models
GENERATIVE AI and WEB3
It All Started with the BERT Paper
GENERATIVE AI and WEB3
Followed by an Explosion of Large Models
GENERATIVE AI and WEB3
GPT-3 was the Dominant Foundation Model But Had
Major Limitations
What changed between GPT-3 and
ChatGPT(GPT-3.5)?
GENERATIVE AI and WEB3
Reinforcement Learning with Human Feedback (RLHF)
GENERATIVE AI and WEB3
GPT-3+ RLHF= InstructGPT
GENERATIVE AI and WEB3
InstructGPT + GPT-3= ChatGPT
GENERATIVE AI and WEB3
What transformers did for language models,
diffusion did for computer vision models…
GENERATIVE AI and WEB3
Diffusion Models can Deconstruct and Reconstruct Images
GENERATIVE AI and WEB3
The Explosion of Text-to-Image Models
GENERATIVE AI and WEB3
Stable Diffusion Showed that Foundation Models can be
Open Source
GENERATIVE AI and WEB3
Emerging capabilities such as math and coding
also developed in generative AI models…
GENERATIVE AI and WEB3
Coding and Math Became Important Features of
Foundation Models
GENERATIVE AI and WEB3
Multi-modality emerges as a dominant paradigm
in foundation models…
GENERATIVE AI and WEB3
GPT-4 Combines Language, Image, Code and More in a
Single Model
GENERATIVE AI and WEB3
Beyond OpenAI
GENERATIVE AI and WEB3
Generative AI and foundation models represent
the most important technological leap in several
generations…
Generative AI and Web3
The Opportunities
GENERATIVE AI and WEB3
GENERATIVE AI and WEB3
Generative AI Presents Some Immediate
Opportunities in Web3
https://www.coindesk.com/consensus-magazine/2023/02/08/a-pragmatic-view-of-chatgpt-in-a-web3-world/
GENERATIVE AI and WEB3
Conversational Wallets
Wallets that use language as its core interface
Capabilities
1. Request information about transactions
2. Buy or sale actions
3. Interact with DeFi protocols, NFT collections and other relevant
Web3 artifacts
GENERATIVE AI and WEB3
Language-Based Explorers
Use language as the core interface to interact with a block explorer
Capabilities
1. Query transactions and addresses
2. Engage in long-form dialogs querying blockchain activity
3. Use semantic information and labels for addresses
GENERATIVE AI and WEB3
Smart Contract Copilot
Agents that generate security tests against smart contracts
Capabilities
1. Generate security tests based on a specific smart contract
2. Cover the entire lifecycle from dev to audit
3. Become smarter as new vulnerabilities are being uncovered
GENERATIVE AI and WEB3
Intelligent NFTs
Collectibles that incorporate intelligent capabilities powered by foundation models
Capabilities
1. Answer questions about a specific NFT
2. NFTs that change based on user’s emotions
3. Audio, video, 3D NFTs
Generative AI and Web3
The Challenges
GENERATIVE AI and WEB3
GENERATIVE AI and WEB3
There are Some Major Challenges for the Adoption
of Generative AI in Web3
https://www.coindesk.com/consensus-magazine/2023/03/29/chatgpt-web3-crypto/
GENERATIVE AI and WEB3
Generative AI can create an unbridgeable
technological gap between Web2 and Web3
GENERATIVE AI and WEB3
Lack of
ML Foundation
Web3 platforms
haven’t built a robust
machine learning
foundation in the last
decade.
As a result, generative
AI models mostly rely on
Web2 cloud
infrastructures.
Generative AI can create an unbridgeable
technological gap between Web2 and Web3
Cost and
Scale
Web3 platforms still
don’t scale to the levels
required by large
foundation models.
VC Investment and
Talent
VC funding and
engineering talent is
moving from Web3 to
the generative AI
space.
GENERATIVE AI and WEB3
Lack of
ML Foundation
Web3 platforms
haven’t built a robust
machine learning
foundation in the last
decade.
As a result, generative
AI models mostly rely on
Web2 cloud
infrastructures.
Cost and
Scale
Web3 platforms still
don’t scale to the levels
required by large
foundation models.
Generative AI can create an unbridgeable
technological gap between Web2 and Web3
VC Investment and
Talent
VC funding and
engineering talent is
moving from Web3 to
the generative AI
space.
GENERATIVE AI and WEB3
Lack of
ML Foundation
Web3 platforms
haven’t built a robust
machine learning
foundation in the last
decade.
As a result, generative
AI models mostly rely on
Web2 cloud
infrastructures.
Cost and
Scale
Web3 platforms still
don’t scale to the levels
required by large
foundation models.
VC Investment and
Talent
VC funding and
engineering talent is
moving from Web3 to
the generative AI
space.
Generative AI can create an unbridgeable
technological gap between Web2 and Web3
GENERATIVE AI and WEB3
Some Areas in Which Web3 can Contribute to
Generative AI
Decentralized Generative AI
Provide the infrastructure to
run open source models like
Bloom, Alpaca, Dolly in
blockchain runtimes.
Proof of Knowledge
Use blockchains as a core layer to
enforce accountability, fairness
and transparency of the lifecycle of
foundation models.
From Using Generative AI to Embodying
Generative AI
Some Ambitious Ideas
GENERATIVE AI and WEB3
GENERATIVE AI and WEB3
In an initial phase, Web3 applications can use
foundation models but there will be a new generation
of core components of Web3 architectures that can
be reimagined with generative AI…
GENERATIVE AI and WEB3
A Generative AI Blockchain
Core Idea
A new blockchain runtime
optimized for the training and
operationalization of
foundation models
Capabilities
Public datasets
Model weights
Generative AI agents smart
contracts
Proof of knowledge protocols
…
GENERATIVE AI and WEB3
BlockGPT: A Generative AI Model for Crypto
Core Idea
A generative AI model fine
tuned in blockchain records,
news, social media messages,
etc .
Capabilities
Providing a language interface to
interact with blockchain datasets
Finding patterns about
transactions
Understanding white papers,
discord interactions etc
…
A new generation of Web3 platforms
will emerge using generative AI as a
core component
GENERATIVE AI and WEB3
Summary
● Generative AI is the most transformation technology movement of several
generations
● Web3 applications such as explorers or wallets can be reimagined with
generative AI as a core component
● Web3 has fallen behind in the generative AI race
● There are some ambitious ideas for building the next generation of Web3
infrastructure with generative AI as a core building blocks
Thank You!
Jesus Rodriguez
jr@intotheblock.io
medium.com/@jrodthoughts
intotheblock.com

Contenu connexe

Tendances

Tendances (20)

Journey of Generative AI
Journey of Generative AIJourney of Generative AI
Journey of Generative AI
 
Large Language Models - Chat AI.pdf
Large Language Models - Chat AI.pdfLarge Language Models - Chat AI.pdf
Large Language Models - Chat AI.pdf
 
Cavalry Ventures | Deep Dive: Generative AI
Cavalry Ventures | Deep Dive: Generative AICavalry Ventures | Deep Dive: Generative AI
Cavalry Ventures | Deep Dive: Generative AI
 
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
How Does Generative AI Actually Work? (a quick semi-technical introduction to...How Does Generative AI Actually Work? (a quick semi-technical introduction to...
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
 
Generative AI at the edge.pdf
Generative AI at the edge.pdfGenerative AI at the edge.pdf
Generative AI at the edge.pdf
 
Using Generative AI
Using Generative AIUsing Generative AI
Using Generative AI
 
Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
 
Exploring Opportunities in the Generative AI Value Chain.pdf
Exploring Opportunities in the Generative AI Value Chain.pdfExploring Opportunities in the Generative AI Value Chain.pdf
Exploring Opportunities in the Generative AI Value Chain.pdf
 
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...
 
Responsible Generative AI
Responsible Generative AIResponsible Generative AI
Responsible Generative AI
 
Understanding generative AI models A comprehensive overview.pdf
Understanding generative AI models A comprehensive overview.pdfUnderstanding generative AI models A comprehensive overview.pdf
Understanding generative AI models A comprehensive overview.pdf
 
Let's talk about GPT: A crash course in Generative AI for researchers
Let's talk about GPT: A crash course in Generative AI for researchersLet's talk about GPT: A crash course in Generative AI for researchers
Let's talk about GPT: A crash course in Generative AI for researchers
 
Generative AI, WiDS 2023.pptx
Generative AI, WiDS 2023.pptxGenerative AI, WiDS 2023.pptx
Generative AI, WiDS 2023.pptx
 
Large Language Models Bootcamp
Large Language Models BootcampLarge Language Models Bootcamp
Large Language Models Bootcamp
 
LanGCHAIN Framework
LanGCHAIN FrameworkLanGCHAIN Framework
LanGCHAIN Framework
 
A Comprehensive Review of Large Language Models for.pptx
A Comprehensive Review of Large Language Models for.pptxA Comprehensive Review of Large Language Models for.pptx
A Comprehensive Review of Large Language Models for.pptx
 
How ChatGPT and AI-assisted coding changes software engineering profoundly
How ChatGPT and AI-assisted coding changes software engineering profoundlyHow ChatGPT and AI-assisted coding changes software engineering profoundly
How ChatGPT and AI-assisted coding changes software engineering profoundly
 
Intro to LLMs
Intro to LLMsIntro to LLMs
Intro to LLMs
 
Generative models
Generative modelsGenerative models
Generative models
 
AI and ML Series - Introduction to Generative AI and LLMs - Session 1
AI and ML Series - Introduction to Generative AI and LLMs - Session 1AI and ML Series - Introduction to Generative AI and LLMs - Session 1
AI and ML Series - Introduction to Generative AI and LLMs - Session 1
 

Similaire à ChatGPT, Foundation Models and Web3.pptx

generative-ai-fundamentals and Large language models
generative-ai-fundamentals and Large language modelsgenerative-ai-fundamentals and Large language models
generative-ai-fundamentals and Large language models
AdventureWorld5
 
WHERE-TO-START-TO-GET-SMART-ABOUT-WEB3--1662302051 (1).pdf
WHERE-TO-START-TO-GET-SMART-ABOUT-WEB3--1662302051 (1).pdfWHERE-TO-START-TO-GET-SMART-ABOUT-WEB3--1662302051 (1).pdf
WHERE-TO-START-TO-GET-SMART-ABOUT-WEB3--1662302051 (1).pdf
Adelaide Leitão
 
Is Web Development Dying?
Is Web Development Dying?Is Web Development Dying?
Is Web Development Dying?
MSR Buzz
 
AI in Web3 Exploring How AI Manifests in the World of Web3 (2).pdf
AI in Web3 Exploring How AI Manifests in the World of Web3 (2).pdfAI in Web3 Exploring How AI Manifests in the World of Web3 (2).pdf
AI in Web3 Exploring How AI Manifests in the World of Web3 (2).pdf
SoluLab1231
 

Similaire à ChatGPT, Foundation Models and Web3.pptx (20)

leewayhertz.com-AI in web3 How AI manifests in the world of web3.pdf
leewayhertz.com-AI in web3 How AI manifests in the world of web3.pdfleewayhertz.com-AI in web3 How AI manifests in the world of web3.pdf
leewayhertz.com-AI in web3 How AI manifests in the world of web3.pdf
 
20240411 QFM009 Machine Intelligence Reading List March 2024
20240411 QFM009 Machine Intelligence Reading List March 202420240411 QFM009 Machine Intelligence Reading List March 2024
20240411 QFM009 Machine Intelligence Reading List March 2024
 
generative-ai-fundamentals and Large language models
generative-ai-fundamentals and Large language modelsgenerative-ai-fundamentals and Large language models
generative-ai-fundamentals and Large language models
 
Past, Present and Future of Generative AI
Past, Present and Future of Generative AIPast, Present and Future of Generative AI
Past, Present and Future of Generative AI
 
U.S. Share of Web3 Developers is Shrinking
U.S. Share of Web3 Developers is ShrinkingU.S. Share of Web3 Developers is Shrinking
U.S. Share of Web3 Developers is Shrinking
 
G107980 top-it-trends-atlanta-v1904b
G107980 top-it-trends-atlanta-v1904bG107980 top-it-trends-atlanta-v1904b
G107980 top-it-trends-atlanta-v1904b
 
WHERE-TO-START-TO-GET-SMART-ABOUT-WEB3--1662302051 (1).pdf
WHERE-TO-START-TO-GET-SMART-ABOUT-WEB3--1662302051 (1).pdfWHERE-TO-START-TO-GET-SMART-ABOUT-WEB3--1662302051 (1).pdf
WHERE-TO-START-TO-GET-SMART-ABOUT-WEB3--1662302051 (1).pdf
 
Is Web Development Dying?
Is Web Development Dying?Is Web Development Dying?
Is Web Development Dying?
 
What is web2.0
What is web2.0What is web2.0
What is web2.0
 
codex (1).ppt
codex (1).pptcodex (1).ppt
codex (1).ppt
 
Global Metaverse Innovators Roadshow
Global Metaverse Innovators RoadshowGlobal Metaverse Innovators Roadshow
Global Metaverse Innovators Roadshow
 
Web 2.0 and LiveQuotes Presentation
Web 2.0 and LiveQuotes PresentationWeb 2.0 and LiveQuotes Presentation
Web 2.0 and LiveQuotes Presentation
 
AI in Web3 Exploring How AI Manifests in the World of Web3 (2).pdf
AI in Web3 Exploring How AI Manifests in the World of Web3 (2).pdfAI in Web3 Exploring How AI Manifests in the World of Web3 (2).pdf
AI in Web3 Exploring How AI Manifests in the World of Web3 (2).pdf
 
Web3.0Document.docx
Web3.0Document.docxWeb3.0Document.docx
Web3.0Document.docx
 
The coming generative AI trends of 2024.pdf
The coming generative AI trends of 2024.pdfThe coming generative AI trends of 2024.pdf
The coming generative AI trends of 2024.pdf
 
What Web 2.pdf
What Web 2.pdfWhat Web 2.pdf
What Web 2.pdf
 
Best technologies for web app development
Best technologies for web app developmentBest technologies for web app development
Best technologies for web app development
 
2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits
 
Web 2.0 - Then And Now
Web 2.0 - Then And NowWeb 2.0 - Then And Now
Web 2.0 - Then And Now
 
6 Amazing IT Job Opportunities in Metaverse.pptx
6 Amazing IT Job Opportunities in Metaverse.pptx6 Amazing IT Job Opportunities in Metaverse.pptx
6 Amazing IT Job Opportunities in Metaverse.pptx
 

Plus de Jesus Rodriguez

Plus de Jesus Rodriguez (20)

The Emergence of DeFi Micro-Primitives
The Emergence of DeFi Micro-PrimitivesThe Emergence of DeFi Micro-Primitives
The Emergence of DeFi Micro-Primitives
 
DeFi Opportunities and Challenges in the Current Crypto Market
DeFi Opportunities and Challenges in the Current Crypto MarketDeFi Opportunities and Challenges in the Current Crypto Market
DeFi Opportunities and Challenges in the Current Crypto Market
 
MEV Deep Dive .pptx
MEV Deep Dive .pptxMEV Deep Dive .pptx
MEV Deep Dive .pptx
 
Quant in Crypto Land
Quant in Crypto LandQuant in Crypto Land
Quant in Crypto Land
 
The Polygon Blockchain by the Numbers
The Polygon Blockchain by the NumbersThe Polygon Blockchain by the Numbers
The Polygon Blockchain by the Numbers
 
Social Analytics for Cryptocurrencies
Social Analytics for Cryptocurrencies Social Analytics for Cryptocurrencies
Social Analytics for Cryptocurrencies
 
DeFi Quant Yield-Generating Strategies
DeFi Quant Yield-Generating StrategiesDeFi Quant Yield-Generating Strategies
DeFi Quant Yield-Generating Strategies
 
High Frequency Trading and DeFi
High Frequency Trading and DeFiHigh Frequency Trading and DeFi
High Frequency Trading and DeFi
 
Simple DeFi Analytics Any Crypto-Investor Should Know About
Simple DeFi Analytics Any Crypto-Investor Should Know About Simple DeFi Analytics Any Crypto-Investor Should Know About
Simple DeFi Analytics Any Crypto-Investor Should Know About
 
15 Minutes of DeFi Analytics
15 Minutes of DeFi Analytics15 Minutes of DeFi Analytics
15 Minutes of DeFi Analytics
 
DeFi Trading Strategies: Opportunities and Challenges
DeFi Trading Strategies: Opportunities and ChallengesDeFi Trading Strategies: Opportunities and Challenges
DeFi Trading Strategies: Opportunities and Challenges
 
Practical Crypto Asset Predictions rev
Practical Crypto Asset Predictions revPractical Crypto Asset Predictions rev
Practical Crypto Asset Predictions rev
 
Better Technical Analysis with Blockchain Indicators
Better Technical Analysis with Blockchain IndicatorsBetter Technical Analysis with Blockchain Indicators
Better Technical Analysis with Blockchain Indicators
 
Price Predictions for Cryptocurrencies
Price Predictions for CryptocurrenciesPrice Predictions for Cryptocurrencies
Price Predictions for Cryptocurrencies
 
Fascinating Metrics and Analytics About Cryptocurrencies
Fascinating Metrics and Analytics About CryptocurrenciesFascinating Metrics and Analytics About Cryptocurrencies
Fascinating Metrics and Analytics About Cryptocurrencies
 
Price PRedictions for Crypto-Assets Using Deep Learning
Price PRedictions for Crypto-Assets Using Deep LearningPrice PRedictions for Crypto-Assets Using Deep Learning
Price PRedictions for Crypto-Assets Using Deep Learning
 
Demystifying Centralized Crypto Exchanges using Data Science
Demystifying Centralized Crypto Exchanges using Data ScienceDemystifying Centralized Crypto Exchanges using Data Science
Demystifying Centralized Crypto Exchanges using Data Science
 
Crypto assets are a data science heaven rev
Crypto assets are a data science heaven revCrypto assets are a data science heaven rev
Crypto assets are a data science heaven rev
 
Implementing Machine Learning in the Real World
Implementing Machine Learning in the Real WorldImplementing Machine Learning in the Real World
Implementing Machine Learning in the Real World
 
Fundamental Analysis for Crypto Assets
Fundamental Analysis for Crypto AssetsFundamental Analysis for Crypto Assets
Fundamental Analysis for Crypto Assets
 

Dernier

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 

ChatGPT, Foundation Models and Web3.pptx

  • 1. ChatGPT, Generative AI and Web3 Opportunities, challenges and some ambitious ideas Jesus Rodriguez IntoTheBlock
  • 2. GENERATIVE AI and WEB3 Agenda ● A brief history of foundation models ● Web3 and foundation models: opportunities ● Challenges ● Moonshot ideas
  • 3. An Update About IntoTheBlock GENERATIVE AI and WEB3
  • 7. GENERATIVE AI and WEB3 ● New protocols have been onboarded for the DeFi Risk Radar release ● New DeFi strategies have been added to the ITB Smart Yields platform ● ITB analytics is about to release support for Optimism analytics Other Updates
  • 8. The evolution towards ChatGPT, GPT4 and foundation models… GENERATIVE AI and WEB3
  • 9. GENERATIVE AI and WEB3 Models such as ChatGPT or GPT-4 are known as foundation models which represents the dominant paradigm in generative AI
  • 10. GENERATIVE AI and WEB3 A foundation model is a large artificialintelligence model trained on a vast quantity of unlabeled data at scale resultingin a model that can be adapted to a wide range of downstream tasks. Foundation Models
  • 11. GENERATIVE AI and WEB3 It All Started with the BERT Paper
  • 12. GENERATIVE AI and WEB3 Followed by an Explosion of Large Models
  • 13. GENERATIVE AI and WEB3 GPT-3 was the Dominant Foundation Model But Had Major Limitations
  • 14. What changed between GPT-3 and ChatGPT(GPT-3.5)?
  • 15. GENERATIVE AI and WEB3 Reinforcement Learning with Human Feedback (RLHF)
  • 16. GENERATIVE AI and WEB3 GPT-3+ RLHF= InstructGPT
  • 17. GENERATIVE AI and WEB3 InstructGPT + GPT-3= ChatGPT
  • 18. GENERATIVE AI and WEB3 What transformers did for language models, diffusion did for computer vision models…
  • 19. GENERATIVE AI and WEB3 Diffusion Models can Deconstruct and Reconstruct Images
  • 20. GENERATIVE AI and WEB3 The Explosion of Text-to-Image Models
  • 21. GENERATIVE AI and WEB3 Stable Diffusion Showed that Foundation Models can be Open Source
  • 22. GENERATIVE AI and WEB3 Emerging capabilities such as math and coding also developed in generative AI models…
  • 23. GENERATIVE AI and WEB3 Coding and Math Became Important Features of Foundation Models
  • 24. GENERATIVE AI and WEB3 Multi-modality emerges as a dominant paradigm in foundation models…
  • 25. GENERATIVE AI and WEB3 GPT-4 Combines Language, Image, Code and More in a Single Model
  • 26. GENERATIVE AI and WEB3 Beyond OpenAI
  • 27. GENERATIVE AI and WEB3 Generative AI and foundation models represent the most important technological leap in several generations…
  • 28. Generative AI and Web3 The Opportunities GENERATIVE AI and WEB3
  • 29. GENERATIVE AI and WEB3 Generative AI Presents Some Immediate Opportunities in Web3 https://www.coindesk.com/consensus-magazine/2023/02/08/a-pragmatic-view-of-chatgpt-in-a-web3-world/
  • 30. GENERATIVE AI and WEB3 Conversational Wallets Wallets that use language as its core interface Capabilities 1. Request information about transactions 2. Buy or sale actions 3. Interact with DeFi protocols, NFT collections and other relevant Web3 artifacts
  • 31. GENERATIVE AI and WEB3 Language-Based Explorers Use language as the core interface to interact with a block explorer Capabilities 1. Query transactions and addresses 2. Engage in long-form dialogs querying blockchain activity 3. Use semantic information and labels for addresses
  • 32. GENERATIVE AI and WEB3 Smart Contract Copilot Agents that generate security tests against smart contracts Capabilities 1. Generate security tests based on a specific smart contract 2. Cover the entire lifecycle from dev to audit 3. Become smarter as new vulnerabilities are being uncovered
  • 33. GENERATIVE AI and WEB3 Intelligent NFTs Collectibles that incorporate intelligent capabilities powered by foundation models Capabilities 1. Answer questions about a specific NFT 2. NFTs that change based on user’s emotions 3. Audio, video, 3D NFTs
  • 34. Generative AI and Web3 The Challenges GENERATIVE AI and WEB3
  • 35. GENERATIVE AI and WEB3 There are Some Major Challenges for the Adoption of Generative AI in Web3 https://www.coindesk.com/consensus-magazine/2023/03/29/chatgpt-web3-crypto/
  • 36. GENERATIVE AI and WEB3 Generative AI can create an unbridgeable technological gap between Web2 and Web3
  • 37. GENERATIVE AI and WEB3 Lack of ML Foundation Web3 platforms haven’t built a robust machine learning foundation in the last decade. As a result, generative AI models mostly rely on Web2 cloud infrastructures. Generative AI can create an unbridgeable technological gap between Web2 and Web3 Cost and Scale Web3 platforms still don’t scale to the levels required by large foundation models. VC Investment and Talent VC funding and engineering talent is moving from Web3 to the generative AI space.
  • 38. GENERATIVE AI and WEB3 Lack of ML Foundation Web3 platforms haven’t built a robust machine learning foundation in the last decade. As a result, generative AI models mostly rely on Web2 cloud infrastructures. Cost and Scale Web3 platforms still don’t scale to the levels required by large foundation models. Generative AI can create an unbridgeable technological gap between Web2 and Web3 VC Investment and Talent VC funding and engineering talent is moving from Web3 to the generative AI space.
  • 39. GENERATIVE AI and WEB3 Lack of ML Foundation Web3 platforms haven’t built a robust machine learning foundation in the last decade. As a result, generative AI models mostly rely on Web2 cloud infrastructures. Cost and Scale Web3 platforms still don’t scale to the levels required by large foundation models. VC Investment and Talent VC funding and engineering talent is moving from Web3 to the generative AI space. Generative AI can create an unbridgeable technological gap between Web2 and Web3
  • 40. GENERATIVE AI and WEB3 Some Areas in Which Web3 can Contribute to Generative AI Decentralized Generative AI Provide the infrastructure to run open source models like Bloom, Alpaca, Dolly in blockchain runtimes. Proof of Knowledge Use blockchains as a core layer to enforce accountability, fairness and transparency of the lifecycle of foundation models.
  • 41. From Using Generative AI to Embodying Generative AI Some Ambitious Ideas GENERATIVE AI and WEB3
  • 42. GENERATIVE AI and WEB3 In an initial phase, Web3 applications can use foundation models but there will be a new generation of core components of Web3 architectures that can be reimagined with generative AI…
  • 43. GENERATIVE AI and WEB3 A Generative AI Blockchain Core Idea A new blockchain runtime optimized for the training and operationalization of foundation models Capabilities Public datasets Model weights Generative AI agents smart contracts Proof of knowledge protocols …
  • 44. GENERATIVE AI and WEB3 BlockGPT: A Generative AI Model for Crypto Core Idea A generative AI model fine tuned in blockchain records, news, social media messages, etc . Capabilities Providing a language interface to interact with blockchain datasets Finding patterns about transactions Understanding white papers, discord interactions etc …
  • 45. A new generation of Web3 platforms will emerge using generative AI as a core component
  • 46. GENERATIVE AI and WEB3 Summary ● Generative AI is the most transformation technology movement of several generations ● Web3 applications such as explorers or wallets can be reimagined with generative AI as a core component ● Web3 has fallen behind in the generative AI race ● There are some ambitious ideas for building the next generation of Web3 infrastructure with generative AI as a core building blocks
  • 47.