SlideShare une entreprise Scribd logo
1  sur  28
Télécharger pour lire hors ligne
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Text Analysis using AmCAT
Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
8 July 2013
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Workshop outline
Workshop Outline
ˆ Three Sessions
ˆ 14:00 - 15:00 I: AmCAT: Introduction
ˆ 15:00 - 16:00 II: Automatic Analysis
ˆ 16:00 - 17:00 III: Manual Analysis
ˆ Session Format
ˆ Presentation + Hands-on
ˆ Material
ˆ Outline
ˆ Work book
ˆ AmCAT Manual
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
AmCAT: Introduction
AmCAT: Introduction
ˆ The role of quantitative content analysis
ˆ What is AmCAT?
ˆ Getting started with AmCAT
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
AmCAT: Introduction
Quantitative Content Analysis
ˆ Repeatable and valid
ˆ Latent or manifest, `objective' or `subjective'
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
AmCAT: Introduction
Quantitative Content Analysis
ˆ Repeatable and valid
ˆ Latent or manifest, `objective' or `subjective'
ˆ Fixed units of measurement
ˆ Fixed values for variables
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
AmCAT: Introduction
Manual and Auatmtic Analysis
ˆ Content Analysis as measurement
ˆ Coding of symbolic content to numeric values
ˆ Interpretation / Assignment of meaning
ˆ Automatic Analysis: instruction to computer
ˆ Manual Analysis: instruction and interpretation
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
AmCAT: Introduction
Combination of analysis techniques
1 Qualitative analysis (inductive)
2 Automtic quantitative analysis
ˆ Measuring concepts under study
ˆ Finding interesting articles
3 Manual quantitative analysis
ˆ Measuring concepts
4 Qualitative analysis (interpretative)
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Getting started with AmCAT (ch. 1 and 2.2)
What is AmCAT?
ˆ Framework for text analysis
ˆ Developed at VU University
ˆ Open source, open data, open platform
ˆ Main functions:
ˆ Text storage
ˆ Automatic analysis
ˆ Manual analysis
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Getting started with AmCAT (ch. 1 and 2.2)
Key terminology
ˆ Project
ˆ Article
ˆ Article Set
ˆ Index
ˆ Coding Job, Coding Schema, Code Book
ˆ Navigator, Annotator, API
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Getting started with AmCAT (ch. 1 and 2.2)
Who can use it? What does it cost?
ˆ AmCAT source code is free and open source
ˆ VU University hosts amcat.vu.nl
ˆ Free to use for small projects
ˆ (no support)
ˆ Contribution requested for larger projects
ˆ (or just setup your own server)
ˆ Development is open but centrally controlled
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Getting started with AmCAT (ch. 1 and 2.2)
Getting started with AmCAT
ˆ Creating an account
ˆ Creating a project
ˆ Uploading data
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Getting started with AmCAT (ch. 1 and 2.2)
Hands-on session 1
ˆ Create an account and project
ˆ Upload data
ˆ Until 15:00
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Finding Conceptsx in Texts using Keywords (ch. 4.1)
Automatic Analysis
ˆ Keywords as concept indicators
ˆ Making good keyword queries
ˆ Analysing and exporting results
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Finding Conceptsx in Texts using Keywords (ch. 4.1)
Concepts, words, and indicators
ˆ A Dictionary is a list of:
ˆ Theoretical Concepts
ˆ Operationalized using keywords
ˆ Which are indicators for the concept
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Finding Conceptsx in Texts using Keywords (ch. 4.1)
Example searches
(interactive demo)
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Finding Conceptsx in Texts using Keywords (ch. 4.1)
AmCAT Query Syntax
(See manual Ÿ4.2 and `search syntax help' in AmCAT)
ˆ Connectors
ˆ war OR conflict
ˆ gaza AND war
ˆ gaza AND (war OR conflict)
ˆ (war OR conflict) NOT drugs
ˆ Wildcards
ˆ war*
ˆ Phrases
ˆ "war on drugs"
ˆ "war drugs"~5
ˆ "palest* (terror* OR suicide)"~10
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Finding Conceptsx in Texts using Keywords (ch. 4.1)
Precision and recall
ˆ Query too broad:
ˆ Articles are found that don't contain the concept
ˆ Low precision
ˆ Narrow query using phrases, AND/NOT conditions
ˆ Query too narrow
ˆ Articles are missed that do contain the concept
ˆ Low recall
ˆ Widen query using wildcards, OR synonyms
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Finding Conceptsx in Texts using Keywords (ch. 4.1)
Testing the eect of widening/narrowing a search
ˆ Search for narrow and for wide NOT narrow
ˆ After widening a search:
ˆ e.g. war → war*
ˆ Search for war* NOT war, and check resulting
documents
ˆ After narrowing a search
ˆ e.g. suicide → suicide (bomb* OR attack*)~10
ˆ Search for
suicide NOT (suicide (bomb* OR attack*)~10)
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Analysing and Exporting Results (ch. 4.3)
Analysing and exporting data in AmCAT
ˆ Trends and patterns: Tabulating data
ˆ You can export raw data, hits, and aggregate results
(interactive demo)
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Analysing and Exporting Results (ch. 4.3)
Hands-on session 2
ˆ Create search terms for actors and issues
ˆ Export results
ˆ Until 16:00
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Quantitative Content Analysis (ch. 5-7)
Quantitative manual content analysis
ˆ Measure specic, known concepts in specic textual units
ˆ Fixed Unit of measurement
ˆ Sentence or Article
ˆ Fixed sample of articles
ˆ Fixed variables and values
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Quantitative Content Analysis (ch. 5-7)
AmCAT jargon
ˆ Codebook: list of values for a single variable
ˆ Coding schema: list of variables and their values
ˆ Coding Job: Article set assigned to someone for coding
using a specic schema
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Quantitative Content Analysis (ch. 5-7)
Codebooks
ˆ List of values (codes) for a single variable
ˆ Possible hierarchical organization
ˆ Comparable to SPSS value labels
ˆ Issues
ˆ Economy
ˆ Unemployment
ˆ Economic growth
ˆ . . .
ˆ . . .
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Quantitative Content Analysis (ch. 5-7)
Coding schemas
ˆ List of variables and their type
ˆ Field types in AmCAT:
ˆ Text
ˆ Number
ˆ Yes/No
ˆ Quality (-1 . . . +1)
ˆ Codebook
ˆ Comparable to SPSS variables view
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Manual analysis in AmCAT (ch. 10)
Manual content analysis in AmCAT
(interactive demo)
ˆ Creating a codebook and coding schema
ˆ Selecting and assigning a sample to code
ˆ Coding
ˆ Exporting results
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Manual analysis in AmCAT (ch. 10)
Hands-on session 3
ˆ Create code book, coding schema, coding job
ˆ Code articles and export results
ˆ Until 16:55
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Wrap-up: conclusions and road ahead?
What can AmCAT do for me? / What can I do for AmCAT?
ˆ Use AmCAT for your coding or storage needs
ˆ Install your own AmCAT server
ˆ Improve AmCAT by reporting bugs, providing plugins,
adding features
ˆ Write and share (R) scripts/libraries for text-based
analyses
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up
Wrap-up: conclusions and road ahead?
Programma for Thursday
ˆ Proposal: Advanced automatic analysis:
ˆ Tools for improving queries: cluster maps, keyword in
context
ˆ Vocabulary analysis and LDA using the R API
ˆ Semantic Network Analysis: keyword association,
grammatical analysis
Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi

Contenu connexe

En vedette

Campus New Proposal.
Campus New Proposal.Campus New Proposal.
Campus New Proposal.Sayed Ali
 
16720032294774_Sirallapu_Anitha_corpReport
16720032294774_Sirallapu_Anitha_corpReport16720032294774_Sirallapu_Anitha_corpReport
16720032294774_Sirallapu_Anitha_corpReportanitha sirallapu
 
Aspiring Minds | Automata
Aspiring Minds | Automata Aspiring Minds | Automata
Aspiring Minds | Automata Aspiring Minds
 
Aspiring Minds | Labor market insights
Aspiring Minds | Labor market insightsAspiring Minds | Labor market insights
Aspiring Minds | Labor market insightsAspiring Minds
 
Aspiring Minds | Outcomes using test scores
Aspiring Minds | Outcomes using test scoresAspiring Minds | Outcomes using test scores
Aspiring Minds | Outcomes using test scoresAspiring Minds
 
Institute Performance Solutions
Institute Performance Solutions Institute Performance Solutions
Institute Performance Solutions Youth4work.com
 
About Youth4work - Integrated Talent Solutions
About Youth4work - Integrated Talent SolutionsAbout Youth4work - Integrated Talent Solutions
About Youth4work - Integrated Talent SolutionsYouth4work.com
 
Youth4work Marketing & Advertising Solutions
Youth4work Marketing & Advertising SolutionsYouth4work Marketing & Advertising Solutions
Youth4work Marketing & Advertising SolutionsYouth4work.com
 
Campus Hiring Made Easy
Campus Hiring Made Easy Campus Hiring Made Easy
Campus Hiring Made Easy Youth4work.com
 
Humanika Consulting presentation 2012b english
Humanika Consulting presentation 2012b englishHumanika Consulting presentation 2012b english
Humanika Consulting presentation 2012b englishSeta Wicaksana
 

En vedette (14)

Campus New Proposal.
Campus New Proposal.Campus New Proposal.
Campus New Proposal.
 
16720032294774_Sirallapu_Anitha_corpReport
16720032294774_Sirallapu_Anitha_corpReport16720032294774_Sirallapu_Anitha_corpReport
16720032294774_Sirallapu_Anitha_corpReport
 
Aspiring Minds | Automata
Aspiring Minds | Automata Aspiring Minds | Automata
Aspiring Minds | Automata
 
Aspiring Minds | Svar
Aspiring Minds | SvarAspiring Minds | Svar
Aspiring Minds | Svar
 
Amcat Certificate
Amcat CertificateAmcat Certificate
Amcat Certificate
 
Aspiring Minds | Labor market insights
Aspiring Minds | Labor market insightsAspiring Minds | Labor market insights
Aspiring Minds | Labor market insights
 
Aspiring Minds | Outcomes using test scores
Aspiring Minds | Outcomes using test scoresAspiring Minds | Outcomes using test scores
Aspiring Minds | Outcomes using test scores
 
Institute Performance Solutions
Institute Performance Solutions Institute Performance Solutions
Institute Performance Solutions
 
About Youth4work - Integrated Talent Solutions
About Youth4work - Integrated Talent SolutionsAbout Youth4work - Integrated Talent Solutions
About Youth4work - Integrated Talent Solutions
 
Youth4work Marketing & Advertising Solutions
Youth4work Marketing & Advertising SolutionsYouth4work Marketing & Advertising Solutions
Youth4work Marketing & Advertising Solutions
 
Amcat & nac
Amcat & nac Amcat & nac
Amcat & nac
 
Campus Hiring Made Easy
Campus Hiring Made Easy Campus Hiring Made Easy
Campus Hiring Made Easy
 
Humanika Consulting presentation 2012b english
Humanika Consulting presentation 2012b englishHumanika Consulting presentation 2012b english
Humanika Consulting presentation 2012b english
 
Amcat 2
Amcat 2Amcat 2
Amcat 2
 

Similaire à Am cat workshop part 1

FFicili_Curriculum - v1.3 - 07092014 - ENG
FFicili_Curriculum - v1.3 - 07092014 - ENGFFicili_Curriculum - v1.3 - 07092014 - ENG
FFicili_Curriculum - v1.3 - 07092014 - ENGFrancesco Ficili
 
Advanced Testing with TTCN-3 and UML Testing Profile
Advanced Testing with TTCN-3 and UML Testing ProfileAdvanced Testing with TTCN-3 and UML Testing Profile
Advanced Testing with TTCN-3 and UML Testing ProfileAxel Rennoch
 
Toolbox for Structural Mechanics
Toolbox for Structural MechanicsToolbox for Structural Mechanics
Toolbox for Structural Mechanicsandreslahe
 
maxbox_starter110 overview collection
maxbox_starter110 overview collectionmaxbox_starter110 overview collection
maxbox_starter110 overview collectionMaxKleiner3
 
Python Introduction | JNTUA | R19 | UNIT 1
Python Introduction | JNTUA | R19 | UNIT 1 Python Introduction | JNTUA | R19 | UNIT 1
Python Introduction | JNTUA | R19 | UNIT 1 FabMinds
 
A tool to evaluate symmetric key algorithms
A tool to evaluate symmetric key algorithmsA tool to evaluate symmetric key algorithms
A tool to evaluate symmetric key algorithmsTharindu Weerasinghe
 
Functional and non-functional testing with IoT-Testware
Functional and non-functional testing with IoT-TestwareFunctional and non-functional testing with IoT-Testware
Functional and non-functional testing with IoT-TestwareAxel Rennoch
 
Automata based programming
Automata based programmingAutomata based programming
Automata based programmingM Reza Rahmati
 
Matlab to vhdl
Matlab to vhdlMatlab to vhdl
Matlab to vhdlsumalama
 
LP-I_Lab Manual_TE_AY2023-24_updated.pdf
LP-I_Lab Manual_TE_AY2023-24_updated.pdfLP-I_Lab Manual_TE_AY2023-24_updated.pdf
LP-I_Lab Manual_TE_AY2023-24_updated.pdfAmeyaKatkar
 
Mining Social Web APIs with IPython Notebook - Data Day Texas 2014
Mining Social Web APIs with IPython Notebook - Data Day Texas 2014Mining Social Web APIs with IPython Notebook - Data Day Texas 2014
Mining Social Web APIs with IPython Notebook - Data Day Texas 2014Matthew Russell
 
Ecet 375 Enhance teaching / snaptutorial.com
Ecet 375  Enhance teaching / snaptutorial.comEcet 375  Enhance teaching / snaptutorial.com
Ecet 375 Enhance teaching / snaptutorial.comDavis117a
 
Software Architecture in Process Automation: UML & the "Smart Factory"
Software Architecture in Process Automation: UML & the "Smart Factory"Software Architecture in Process Automation: UML & the "Smart Factory"
Software Architecture in Process Automation: UML & the "Smart Factory"Heiko Koziolek
 
“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...
“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...
“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...Design World
 
Labsheet1 ec303 student
Labsheet1 ec303 studentLabsheet1 ec303 student
Labsheet1 ec303 studentfarah146
 

Similaire à Am cat workshop part 1 (17)

FFicili_Curriculum - v1.3 - 07092014 - ENG
FFicili_Curriculum - v1.3 - 07092014 - ENGFFicili_Curriculum - v1.3 - 07092014 - ENG
FFicili_Curriculum - v1.3 - 07092014 - ENG
 
Advanced Testing with TTCN-3 and UML Testing Profile
Advanced Testing with TTCN-3 and UML Testing ProfileAdvanced Testing with TTCN-3 and UML Testing Profile
Advanced Testing with TTCN-3 and UML Testing Profile
 
Toolbox for Structural Mechanics
Toolbox for Structural MechanicsToolbox for Structural Mechanics
Toolbox for Structural Mechanics
 
maxbox_starter110 overview collection
maxbox_starter110 overview collectionmaxbox_starter110 overview collection
maxbox_starter110 overview collection
 
LaTeX-Presentation
LaTeX-PresentationLaTeX-Presentation
LaTeX-Presentation
 
Python Introduction | JNTUA | R19 | UNIT 1
Python Introduction | JNTUA | R19 | UNIT 1 Python Introduction | JNTUA | R19 | UNIT 1
Python Introduction | JNTUA | R19 | UNIT 1
 
A tool to evaluate symmetric key algorithms
A tool to evaluate symmetric key algorithmsA tool to evaluate symmetric key algorithms
A tool to evaluate symmetric key algorithms
 
Functional and non-functional testing with IoT-Testware
Functional and non-functional testing with IoT-TestwareFunctional and non-functional testing with IoT-Testware
Functional and non-functional testing with IoT-Testware
 
Automata based programming
Automata based programmingAutomata based programming
Automata based programming
 
Matlab to vhdl
Matlab to vhdlMatlab to vhdl
Matlab to vhdl
 
LP-I_Lab Manual_TE_AY2023-24_updated.pdf
LP-I_Lab Manual_TE_AY2023-24_updated.pdfLP-I_Lab Manual_TE_AY2023-24_updated.pdf
LP-I_Lab Manual_TE_AY2023-24_updated.pdf
 
B08 139 081012 Diapo Masselot En
B08 139 081012 Diapo Masselot EnB08 139 081012 Diapo Masselot En
B08 139 081012 Diapo Masselot En
 
Mining Social Web APIs with IPython Notebook - Data Day Texas 2014
Mining Social Web APIs with IPython Notebook - Data Day Texas 2014Mining Social Web APIs with IPython Notebook - Data Day Texas 2014
Mining Social Web APIs with IPython Notebook - Data Day Texas 2014
 
Ecet 375 Enhance teaching / snaptutorial.com
Ecet 375  Enhance teaching / snaptutorial.comEcet 375  Enhance teaching / snaptutorial.com
Ecet 375 Enhance teaching / snaptutorial.com
 
Software Architecture in Process Automation: UML & the "Smart Factory"
Software Architecture in Process Automation: UML & the "Smart Factory"Software Architecture in Process Automation: UML & the "Smart Factory"
Software Architecture in Process Automation: UML & the "Smart Factory"
 
“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...
“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...
“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...
 
Labsheet1 ec303 student
Labsheet1 ec303 studentLabsheet1 ec303 student
Labsheet1 ec303 student
 

Dernier

Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 

Dernier (20)

Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 

Am cat workshop part 1

  • 1. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi 8 July 2013 Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 2. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Workshop outline Workshop Outline ˆ Three Sessions ˆ 14:00 - 15:00 I: AmCAT: Introduction ˆ 15:00 - 16:00 II: Automatic Analysis ˆ 16:00 - 17:00 III: Manual Analysis ˆ Session Format ˆ Presentation + Hands-on ˆ Material ˆ Outline ˆ Work book ˆ AmCAT Manual Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 3. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up AmCAT: Introduction AmCAT: Introduction ˆ The role of quantitative content analysis ˆ What is AmCAT? ˆ Getting started with AmCAT Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 4. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up AmCAT: Introduction Quantitative Content Analysis ˆ Repeatable and valid ˆ Latent or manifest, `objective' or `subjective' Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 5. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up AmCAT: Introduction Quantitative Content Analysis ˆ Repeatable and valid ˆ Latent or manifest, `objective' or `subjective' ˆ Fixed units of measurement ˆ Fixed values for variables Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 6. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up AmCAT: Introduction Manual and Auatmtic Analysis ˆ Content Analysis as measurement ˆ Coding of symbolic content to numeric values ˆ Interpretation / Assignment of meaning ˆ Automatic Analysis: instruction to computer ˆ Manual Analysis: instruction and interpretation Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 7. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up AmCAT: Introduction Combination of analysis techniques 1 Qualitative analysis (inductive) 2 Automtic quantitative analysis ˆ Measuring concepts under study ˆ Finding interesting articles 3 Manual quantitative analysis ˆ Measuring concepts 4 Qualitative analysis (interpretative) Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 8. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Getting started with AmCAT (ch. 1 and 2.2) What is AmCAT? ˆ Framework for text analysis ˆ Developed at VU University ˆ Open source, open data, open platform ˆ Main functions: ˆ Text storage ˆ Automatic analysis ˆ Manual analysis Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 9. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Getting started with AmCAT (ch. 1 and 2.2) Key terminology ˆ Project ˆ Article ˆ Article Set ˆ Index ˆ Coding Job, Coding Schema, Code Book ˆ Navigator, Annotator, API Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 10. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Getting started with AmCAT (ch. 1 and 2.2) Who can use it? What does it cost? ˆ AmCAT source code is free and open source ˆ VU University hosts amcat.vu.nl ˆ Free to use for small projects ˆ (no support) ˆ Contribution requested for larger projects ˆ (or just setup your own server) ˆ Development is open but centrally controlled Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 11. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Getting started with AmCAT (ch. 1 and 2.2) Getting started with AmCAT ˆ Creating an account ˆ Creating a project ˆ Uploading data Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 12. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Getting started with AmCAT (ch. 1 and 2.2) Hands-on session 1 ˆ Create an account and project ˆ Upload data ˆ Until 15:00 Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 13. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Finding Conceptsx in Texts using Keywords (ch. 4.1) Automatic Analysis ˆ Keywords as concept indicators ˆ Making good keyword queries ˆ Analysing and exporting results Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 14. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Finding Conceptsx in Texts using Keywords (ch. 4.1) Concepts, words, and indicators ˆ A Dictionary is a list of: ˆ Theoretical Concepts ˆ Operationalized using keywords ˆ Which are indicators for the concept Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 15. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Finding Conceptsx in Texts using Keywords (ch. 4.1) Example searches (interactive demo) Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 16. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Finding Conceptsx in Texts using Keywords (ch. 4.1) AmCAT Query Syntax (See manual Ÿ4.2 and `search syntax help' in AmCAT) ˆ Connectors ˆ war OR conflict ˆ gaza AND war ˆ gaza AND (war OR conflict) ˆ (war OR conflict) NOT drugs ˆ Wildcards ˆ war* ˆ Phrases ˆ "war on drugs" ˆ "war drugs"~5 ˆ "palest* (terror* OR suicide)"~10 Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 17. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Finding Conceptsx in Texts using Keywords (ch. 4.1) Precision and recall ˆ Query too broad: ˆ Articles are found that don't contain the concept ˆ Low precision ˆ Narrow query using phrases, AND/NOT conditions ˆ Query too narrow ˆ Articles are missed that do contain the concept ˆ Low recall ˆ Widen query using wildcards, OR synonyms Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 18. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Finding Conceptsx in Texts using Keywords (ch. 4.1) Testing the eect of widening/narrowing a search ˆ Search for narrow and for wide NOT narrow ˆ After widening a search: ˆ e.g. war → war* ˆ Search for war* NOT war, and check resulting documents ˆ After narrowing a search ˆ e.g. suicide → suicide (bomb* OR attack*)~10 ˆ Search for suicide NOT (suicide (bomb* OR attack*)~10) Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 19. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Analysing and Exporting Results (ch. 4.3) Analysing and exporting data in AmCAT ˆ Trends and patterns: Tabulating data ˆ You can export raw data, hits, and aggregate results (interactive demo) Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 20. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Analysing and Exporting Results (ch. 4.3) Hands-on session 2 ˆ Create search terms for actors and issues ˆ Export results ˆ Until 16:00 Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 21. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Quantitative Content Analysis (ch. 5-7) Quantitative manual content analysis ˆ Measure specic, known concepts in specic textual units ˆ Fixed Unit of measurement ˆ Sentence or Article ˆ Fixed sample of articles ˆ Fixed variables and values Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 22. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Quantitative Content Analysis (ch. 5-7) AmCAT jargon ˆ Codebook: list of values for a single variable ˆ Coding schema: list of variables and their values ˆ Coding Job: Article set assigned to someone for coding using a specic schema Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 23. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Quantitative Content Analysis (ch. 5-7) Codebooks ˆ List of values (codes) for a single variable ˆ Possible hierarchical organization ˆ Comparable to SPSS value labels ˆ Issues ˆ Economy ˆ Unemployment ˆ Economic growth ˆ . . . ˆ . . . Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 24. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Quantitative Content Analysis (ch. 5-7) Coding schemas ˆ List of variables and their type ˆ Field types in AmCAT: ˆ Text ˆ Number ˆ Yes/No ˆ Quality (-1 . . . +1) ˆ Codebook ˆ Comparable to SPSS variables view Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 25. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Manual analysis in AmCAT (ch. 10) Manual content analysis in AmCAT (interactive demo) ˆ Creating a codebook and coding schema ˆ Selecting and assigning a sample to code ˆ Coding ˆ Exporting results Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 26. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Manual analysis in AmCAT (ch. 10) Hands-on session 3 ˆ Create code book, coding schema, coding job ˆ Code articles and export results ˆ Until 16:55 Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 27. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Wrap-up: conclusions and road ahead? What can AmCAT do for me? / What can I do for AmCAT? ˆ Use AmCAT for your coding or storage needs ˆ Install your own AmCAT server ˆ Improve AmCAT by reporting bugs, providing plugins, adding features ˆ Write and share (R) scripts/libraries for text-based analyses Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi
  • 28. Introduction I: AmCAT II: Automatic Analysis III: Manual Analysis Wrap-up Wrap-up: conclusions and road ahead? Programma for Thursday ˆ Proposal: Advanced automatic analysis: ˆ Tools for improving queries: cluster maps, keyword in context ˆ Vocabulary analysis and LDA using the R API ˆ Semantic Network Analysis: keyword association, grammatical analysis Text Analysis using AmCAT Wouter van Atteveldt - Nel Ruigrok - Carina Jacobi