SlideShare une entreprise Scribd logo
1  sur  34
Télécharger pour lire hors ligne
Ştefan Trăuşan-Matu, Traian Rebedea
            Universitatea “Politehnica” Bucureşti,

Institutul de Cercetări în Inteligenţă Artificială al
                               Academiei Române
Outlook
    Chat Conversations with Multiple Participants
    A Polyphonic Model of Discourse
    Inter-animation Analysis
    The PolyCAFe Analysis System




March 23, 2010   Cicling 2010 - Iasi, Romania       2
Chat Conversations with
    Multiple Participants
         Multiple participants (≥3), conferencing style
         Very important in the context of the spread of forums and
         instant messengers – chats
         Important tool for
             Computer-Supported Collaborative Learning (CSCL)
             Cooperative work online
         Particular features – multiple, parallel discussion chains !!!
         There is a need for
             Determining important utterances
             Contributions of the participants
             Degree of collaboration - inter-animation analysis


March 23, 2010          Cicling 2010 - Iasi, Romania                      3
Example: CSCL assignment
    Students had to debate in chat sessions in groups
    ranging from 3 to 8
    In the first part of the conversation, each student had
    to defend a technology by presenting its features and
    advantages and criticize the others by invoking their
    flaws and drawbacks
    In the final part of the chat, they had to discuss on
    how they could integrate all these technologies in a
    single online collaboration platform


March 23, 2010   Cicling 2010 - Iasi, Romania                 4
CSCL assignment: Problems
    How to assist teachers in evaluating students’ work
   in chats?
    Offer assistance to students
           Abstraction tools
           Automatic feedback




March 23, 2010      Cicling 2010 - Iasi, Romania   March 23, 2010   5
Experiments with
 chat-based CSCL
 K-12 students solving mathematics problems
both individually and collaboratively in the VMT
project at Drexel University, Philadelphia, USA
 Computer Science students at Bucharest
“Politehnica” University, Romania at
       Human-Computer Interaction course in Romanian
      and French – role playing and debate
       Natural Language Processing - role playing and debate
       Algorithm Design – problem solving


March 23, 2010    Cicling 2010 - Iasi, Romania     March 23, 2010   6
The VMT chat environment




        Cicling 2010 - Iasi, Romania   March 23, 2010   7
VMT Referencing facility




March 23, 2010   Cicling 2010 - Iasi, Romania   8
Discourse
    Monologue
         Unidirectional model of communication, from a speaker to a
         listener – theories and methods of analysis:
             Rhetorical Schema Theory
             Centering Theory
             Co-reference resolution
    Dialogue
         Phone-like, face to face style – units of analysis:
             Speech acts
             Dialog acts
             Adjacency pairs
    Multi-parties conversation

March 23, 2010          Cicling 2010 - Iasi, Romania                  9
Theories for analysing
multi-parties conversation
       Discourse analysis (Tannen)
       Conversation analysis (Sacks, Jefferson, Schegloff)
       Accountable talk (Resnick)
       Transactivity (Teasley, Berkowitz & Gibbs, Joshi &
       Rose)
       Inter-animation (Bakhtin, Wegerif, Trausan-Matu)
       Polyphony (Bakhtin, Trausan-Matu et al.)


March 23, 2010    Cicling 2010 - Iasi, Romania               10
Transactivity analysis
    TF-IDF
    Latent Semantic Analysis
    Naïve Bayes
    Social Network Analysis
    WordNet (wordnet.princeton.edu)
    Support Vector Machines
    Collin’s perceptron
    TagHelper environment


March 23, 2010   Cicling 2010 - Iasi, Romania   11
Transactivity analyis
    TF-IDF
    Latent Semantic Analysis Almost all are based also on
    Naïve Bayes                      a two interlocutors
    Social Network Analysis              model, in which
    WordNet (wordnet.princeton.edu) one person speaks
    Support Vector Machines          at a time, resulting
    Collin’s perceptron          one discussion thread
    TagHelper environment


March 23, 2010   Cicling 2010 - Iasi, Romania           12
A socio-cultural perspective on Natural
  Language
    Sfard: “rather than speaking about ‘acquisition of knowledge,’ many
  people prefer to view learning as becoming a participant in a certain
  discourse” (2000)
    Wertch: Lotman - text is a „thinking device” (1981)
    Stahl “to learn is to become a skilled member of communities of practice
  …. and to become competent at using their …. speech genres” (2006)
   Koshmann: “the voices of others become woven into what we say, write,
  and think” (1999)
    Wegerif - teaching thinking skills by inter-animation: “meaning-making
  requires the inter-animation of more than one perspective“ (2005)




March 23, 2010       Cicling 2010 - Iasi, Romania                March 23, 2010 13
Dialogism – Mikhail Bakhtin
       • Basis for the CSCL paradigm (Koschman, 1999)
       • “… Any true understanding is dialogic in nature”
         (Voloshinov-Bakhtin, 1973)
       • Opposed to de Saussure ideas:
            • Real life dialog should be the focus, not written text
            • Words are not arbitrary
       • Utterances (not sentences) should be the unit of
         analysis
       • Speech genres
         Polyphony
         Inter-animation of voices


March 23, 2010         Cicling 2010 - Iasi, Romania           March 23, 2010 14
Polyphony and counterpoint
       Concept derived from classical music
           “These are different voices singing variously on a
           single theme. This is indeed 'multivoicedness,'
           exposing the diversity of life and the great complexity
           of human experience. 'Everything in life is
           counterpoint, that is, opposition,' “ (Bakhtin, 1984)
       Multiple voices – each utterance contains
       multiple voices
       Voices inter-animate in an unmerged way:
            “a plurality of independent and unmerged voices and
           consciousnesses” (Bakhtin)


March 23, 2010       Cicling 2010 - Iasi, Romania       March 23, 2010 15
Polyphonic inter-animation




March 23, 2010   Cicling 2010 - Iasi, Romania   16
Cicling 2010 - Iasi, Romania   March 23, 2010 17
Polyphony




March 23, 2010   Cicling 2010 - Iasi, Romania   March 23, 2010 18
Words, voices and threads
    Positions assigned to participants – voices
    Additional voices – frequent concepts – repeated
    words become voices, stronger or weaker
    Voices continue and influence each other through
    explicit or implicit links.
    Voices correspond to chains or threads of utterances:
         repeated words
         lexical chains
         co-references
         reasoning or argumentation
         rhetorical schemas
March 23, 2010     Cicling 2010 - Iasi, Romania             19
LTfLL - EU FP7 Project
  (2008-2011)
     Language Technologies for Lifelong Learning
     Netherlands, France, United Kingdom, Germany, Ausria,
     Romania, Bulgaria

     PolyCAFe system (Polyphony-based Collaboration Analysis
     and Feedback generation)
     The system has just been validated with students and tutors



March 23, 2010    Cicling 2010 - Iasi, Romania      March 23, 2010 20
March 23, 2010   Cicling 2010 - Iasi, Romania   March 23, 201021
March 23, 2010   Cicling 2010 - Iasi, Romania   March 23, 201022
NLP pipe
    spelling correction, stemmer, tokenizer, Named Entity
    Recognizer, POS tagger and parser, and NP-chunker.
    Stanford NLP software (http://nlp.stanford.edu/software)
    Spellchecker : Jazzy
    http://www.ibm.com/developerworks/java/library/j-jazzy/
    Alternative NLP pipes are under development,
         GATE (http://gate.ac.uk)
         LingPipe (http://aliasi.com/lingpipe/).




March 23, 2010       Cicling 2010 - Iasi, Romania              23
Pattern Language
    Regular expression search
    Synonyms, hypernyms and hyponyms via WordNet
    Words’ stems and their part of speech (POS)
    consideration of utterances as a search unit, for
    example, specifying that a word should be searched in
    the previous n utterances and that two expressions
    should be in two utterances



March 23, 2010   Cicling 2010 - Iasi, Romania               24
Pattern Language (ex.)
    <S "convergence"> #[*] cube searches pairs of
    utterances that have a synonym of “convergence” in the
    first utterance and “cube” in the second
    1103 # 1107. overlap # cube [that would stil have to
    acount for the overlap that way] # [an idea: Each cube
    is assigned to 3 edges. Then add the edges on the
    diagonalish face.]



March 23, 2010   Cicling 2010 - Iasi, Romania            25
Classical NLP analysis
(content and discourse analysis)
    Identification of concepts (using NLP pipe, pattern
    language, cue-phrases and graph algorithms)
    Utterance features:
         Speech acts
         Argumentation types in utterances (as in Toulmin’s theory Warrant,
         Concession, Rebuttal and Qualifiers)
    Implicit links:
         Repetitions
         Adjacency pairs
         Co-references (with the BART system http://bart-coref.org/)



March 23, 2010        Cicling 2010 - Iasi, Romania                        26
Social network analysis
    Consider explicit and implicit referencing as arcs
    between participants, which are the nodes
    A kind of page-rank algorithm – an utterance is
    important if it is referred by important utterances; The
    strength of a voice (of an utterance) depends on the
    strength of the utterances that refer to it
    Determines if a person is central/peripheral




March 23, 2010   Cicling 2010 - Iasi, Romania              27
Polyphony, Inter-animation and
Collaboration analysis
    Assign an importance value for each utterance
    considering several indicators of inter-animation
    (collaboration)
         Detection of voices (chains) inter-animation patterns
         (Trausan-Matu) in the chat
         Consider several criteria such as the presence in the chat
         of questions, agreement, disagreement
         Presence of others’ voices
         Social Networks metrics
    Machine learning approach (genetic algorithms and
    neural networks) for tuning the
March 23, 2010      Cicling 2010 - Iasi, Romania                  28
March 23, 2010   Cicling 2010 - Iasi, Romania   March 23, 201029
March 23, 2010   Cicling 2010 - Iasi, Romania   March 23, 201030
March 23, 2010   Cicling 2010 - Iasi, Romania   March 23, 201031
March 23, 2010   Cicling 2010 - Iasi, Romania   March 23, 201032
March 23, 2010   Cicling 2010 - Iasi, Romania   March 23, 201033
Thank You!

   Questions?



                                                34
March 23, 2010   Cicling 2010 - Iasi, Romania

Contenu connexe

Tendances

Beyond Verbocentricity
Beyond VerbocentricityBeyond Verbocentricity
Beyond VerbocentricityGreg Mcverry
 
Interactive Text Mining Suite: Data Visualization for Literary Studies
Interactive Text Mining Suite: Data Visualization for Literary Studies Interactive Text Mining Suite: Data Visualization for Literary Studies
Interactive Text Mining Suite: Data Visualization for Literary Studies Olga Scrivner
 
SEMANTIC INTEGRATION FOR AUTOMATIC ONTOLOGY MAPPING
SEMANTIC INTEGRATION FOR AUTOMATIC ONTOLOGY MAPPING SEMANTIC INTEGRATION FOR AUTOMATIC ONTOLOGY MAPPING
SEMANTIC INTEGRATION FOR AUTOMATIC ONTOLOGY MAPPING cscpconf
 
Network Visualization guest lecture at #DataVizQMSS at @Columbia / #SNA at PU...
Network Visualization guest lecture at #DataVizQMSS at @Columbia / #SNA at PU...Network Visualization guest lecture at #DataVizQMSS at @Columbia / #SNA at PU...
Network Visualization guest lecture at #DataVizQMSS at @Columbia / #SNA at PU...Denis Parra Santander
 
Digital Libraries, Digital Archives, Digital Humanities, Digital Scholarship:...
Digital Libraries, Digital Archives, Digital Humanities, Digital Scholarship:...Digital Libraries, Digital Archives, Digital Humanities, Digital Scholarship:...
Digital Libraries, Digital Archives, Digital Humanities, Digital Scholarship:...Jenn Riley
 
Stewart, benjamin english language educators and technology ije v5 n1 20...
Stewart, benjamin english language educators and technology ije v5 n1 20...Stewart, benjamin english language educators and technology ije v5 n1 20...
Stewart, benjamin english language educators and technology ije v5 n1 20...William Kritsonis
 
Node XL - features and demo
Node XL - features and demoNode XL - features and demo
Node XL - features and demoMayank Mohan
 
Electronic literature and its place in digital library
Electronic literature and its place in digital libraryElectronic literature and its place in digital library
Electronic literature and its place in digital libraryAlexandr Belov
 
Auto Mapping Texts for Human-Machine Analysis and Sensemaking
Auto Mapping Texts for Human-Machine Analysis and SensemakingAuto Mapping Texts for Human-Machine Analysis and Sensemaking
Auto Mapping Texts for Human-Machine Analysis and SensemakingShalin Hai-Jew
 
Multilayer tutorial-netsci2014-slightlyupdated
Multilayer tutorial-netsci2014-slightlyupdatedMultilayer tutorial-netsci2014-slightlyupdated
Multilayer tutorial-netsci2014-slightlyupdatedMason Porter
 
Forty Years of the OTA
Forty Years of the OTAForty Years of the OTA
Forty Years of the OTAMartin Wynne
 

Tendances (20)

MCRP - copie
MCRP - copieMCRP - copie
MCRP - copie
 
MDST 3703 F10 Seminar 3
MDST 3703 F10 Seminar 3MDST 3703 F10 Seminar 3
MDST 3703 F10 Seminar 3
 
Node similarity
Node similarityNode similarity
Node similarity
 
The P4 of Networkacy
The P4 of NetworkacyThe P4 of Networkacy
The P4 of Networkacy
 
Beyond Verbocentricity
Beyond VerbocentricityBeyond Verbocentricity
Beyond Verbocentricity
 
Interactive Text Mining Suite: Data Visualization for Literary Studies
Interactive Text Mining Suite: Data Visualization for Literary Studies Interactive Text Mining Suite: Data Visualization for Literary Studies
Interactive Text Mining Suite: Data Visualization for Literary Studies
 
SEMANTIC INTEGRATION FOR AUTOMATIC ONTOLOGY MAPPING
SEMANTIC INTEGRATION FOR AUTOMATIC ONTOLOGY MAPPING SEMANTIC INTEGRATION FOR AUTOMATIC ONTOLOGY MAPPING
SEMANTIC INTEGRATION FOR AUTOMATIC ONTOLOGY MAPPING
 
Network Visualization guest lecture at #DataVizQMSS at @Columbia / #SNA at PU...
Network Visualization guest lecture at #DataVizQMSS at @Columbia / #SNA at PU...Network Visualization guest lecture at #DataVizQMSS at @Columbia / #SNA at PU...
Network Visualization guest lecture at #DataVizQMSS at @Columbia / #SNA at PU...
 
03 Communities in Networks (2017)
03 Communities in Networks (2017)03 Communities in Networks (2017)
03 Communities in Networks (2017)
 
02 Descriptive Statistics (2017)
02 Descriptive Statistics (2017)02 Descriptive Statistics (2017)
02 Descriptive Statistics (2017)
 
04 Data Visualization (2017)
04 Data Visualization (2017)04 Data Visualization (2017)
04 Data Visualization (2017)
 
Digital Libraries, Digital Archives, Digital Humanities, Digital Scholarship:...
Digital Libraries, Digital Archives, Digital Humanities, Digital Scholarship:...Digital Libraries, Digital Archives, Digital Humanities, Digital Scholarship:...
Digital Libraries, Digital Archives, Digital Humanities, Digital Scholarship:...
 
Stewart, benjamin english language educators and technology ije v5 n1 20...
Stewart, benjamin english language educators and technology ije v5 n1 20...Stewart, benjamin english language educators and technology ije v5 n1 20...
Stewart, benjamin english language educators and technology ije v5 n1 20...
 
A tool for discourse visualization and analysis
A tool for discourse visualization and analysisA tool for discourse visualization and analysis
A tool for discourse visualization and analysis
 
Node XL - features and demo
Node XL - features and demoNode XL - features and demo
Node XL - features and demo
 
Uk seminar
Uk seminarUk seminar
Uk seminar
 
Electronic literature and its place in digital library
Electronic literature and its place in digital libraryElectronic literature and its place in digital library
Electronic literature and its place in digital library
 
Auto Mapping Texts for Human-Machine Analysis and Sensemaking
Auto Mapping Texts for Human-Machine Analysis and SensemakingAuto Mapping Texts for Human-Machine Analysis and Sensemaking
Auto Mapping Texts for Human-Machine Analysis and Sensemaking
 
Multilayer tutorial-netsci2014-slightlyupdated
Multilayer tutorial-netsci2014-slightlyupdatedMultilayer tutorial-netsci2014-slightlyupdated
Multilayer tutorial-netsci2014-slightlyupdated
 
Forty Years of the OTA
Forty Years of the OTAForty Years of the OTA
Forty Years of the OTA
 

En vedette

PolyCAFe and Social Learning Support for CSCL in LTfLL
PolyCAFe and Social Learning Support for CSCL in LTfLLPolyCAFe and Social Learning Support for CSCL in LTfLL
PolyCAFe and Social Learning Support for CSCL in LTfLLStefan Trausan-Matu
 
A socio-cultural ontology for urban development
A socio-cultural ontology for urban development A socio-cultural ontology for urban development
A socio-cultural ontology for urban development Stefan Trausan-Matu
 
Automatic Support for the Analysis of Online Collaborative Learning Chat Conv...
Automatic Support for the Analysis of Online Collaborative Learning Chat Conv...Automatic Support for the Analysis of Online Collaborative Learning Chat Conv...
Automatic Support for the Analysis of Online Collaborative Learning Chat Conv...Stefan Trausan-Matu
 
Ontology-Based Analyze of Chat Conversations. An Urban Development Case
Ontology-Based Analyzeof Chat Conversations. An Urban Development CaseOntology-Based Analyzeof Chat Conversations. An Urban Development Case
Ontology-Based Analyze of Chat Conversations. An Urban Development CaseStefan Trausan-Matu
 
G325 b media theory and theorists_sectionb-
G325 b media theory and theorists_sectionb-G325 b media theory and theorists_sectionb-
G325 b media theory and theorists_sectionb-gdsteacher
 

En vedette (7)

PolyCAFe and Social Learning Support for CSCL in LTfLL
PolyCAFe and Social Learning Support for CSCL in LTfLLPolyCAFe and Social Learning Support for CSCL in LTfLL
PolyCAFe and Social Learning Support for CSCL in LTfLL
 
A socio-cultural ontology for urban development
A socio-cultural ontology for urban development A socio-cultural ontology for urban development
A socio-cultural ontology for urban development
 
Ch01
Ch01Ch01
Ch01
 
Ch02
Ch02Ch02
Ch02
 
Automatic Support for the Analysis of Online Collaborative Learning Chat Conv...
Automatic Support for the Analysis of Online Collaborative Learning Chat Conv...Automatic Support for the Analysis of Online Collaborative Learning Chat Conv...
Automatic Support for the Analysis of Online Collaborative Learning Chat Conv...
 
Ontology-Based Analyze of Chat Conversations. An Urban Development Case
Ontology-Based Analyzeof Chat Conversations. An Urban Development CaseOntology-Based Analyzeof Chat Conversations. An Urban Development Case
Ontology-Based Analyze of Chat Conversations. An Urban Development Case
 
G325 b media theory and theorists_sectionb-
G325 b media theory and theorists_sectionb-G325 b media theory and theorists_sectionb-
G325 b media theory and theorists_sectionb-
 

Similaire à A Polyphonic Model and System for Inter-animation Analysis in Chat Conversations with Multiple Participants

Knowledge Acquisition from Social Awareness Streams
Knowledge Acquisition from Social Awareness StreamsKnowledge Acquisition from Social Awareness Streams
Knowledge Acquisition from Social Awareness StreamsClaudia Wagner
 
Contemporary media literacy competences
Contemporary media literacy competencesContemporary media literacy competences
Contemporary media literacy competencesPierre Fastrez
 
Discourse-Centric Learning Analytics
Discourse-Centric Learning AnalyticsDiscourse-Centric Learning Analytics
Discourse-Centric Learning AnalyticsSimon Buckingham Shum
 
20111022 ontologiescomeofageocas germanymcguinnessfinal
20111022 ontologiescomeofageocas germanymcguinnessfinal20111022 ontologiescomeofageocas germanymcguinnessfinal
20111022 ontologiescomeofageocas germanymcguinnessfinalDeborah McGuinness
 
Semantic Interoperation of Information Systems by Evolving Ontologies through...
Semantic Interoperation of Information Systems by Evolving Ontologies through...Semantic Interoperation of Information Systems by Evolving Ontologies through...
Semantic Interoperation of Information Systems by Evolving Ontologies through...Christophe Debruyne
 
Ounl Celstec Presentation
Ounl Celstec PresentationOunl Celstec Presentation
Ounl Celstec PresentationRiina Vuorikari
 
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...Traian Rebedea
 
Objectification Is A Word That Has Many Negative Connotations
Objectification Is A Word That Has Many Negative ConnotationsObjectification Is A Word That Has Many Negative Connotations
Objectification Is A Word That Has Many Negative ConnotationsBeth Johnson
 
Multimodal Semiotics
Multimodal SemioticsMultimodal Semiotics
Multimodal Semioticssvngl
 
Critical Narrative Analysis in Linguistics: Analysing a Homodiegetic Rape Nar...
Critical Narrative Analysis in Linguistics: Analysing a Homodiegetic Rape Nar...Critical Narrative Analysis in Linguistics: Analysing a Homodiegetic Rape Nar...
Critical Narrative Analysis in Linguistics: Analysing a Homodiegetic Rape Nar...ChisomOgamba
 
Sociolinguistic moving methode .pptx
Sociolinguistic moving methode .pptxSociolinguistic moving methode .pptx
Sociolinguistic moving methode .pptxRumahBelajarMiranda
 
Addressing Plagiarism In A Digital Age
Addressing Plagiarism In A Digital AgeAddressing Plagiarism In A Digital Age
Addressing Plagiarism In A Digital AgeSean Flores
 
SATANJEEV BANERJEE
SATANJEEV BANERJEESATANJEEV BANERJEE
SATANJEEV BANERJEEbutest
 
The wisdom in Tweetonomies
The wisdom in TweetonomiesThe wisdom in Tweetonomies
The wisdom in TweetonomiesClaudia Wagner
 
Wilkie
WilkieWilkie
Wilkieanesah
 
Workshop Part 1: Digitality (arts & aesthetic education)
Workshop Part 1: Digitality (arts & aesthetic education)Workshop Part 1: Digitality (arts & aesthetic education)
Workshop Part 1: Digitality (arts & aesthetic education)Benjamin Jörissen
 
Knowledge Sharing and Education
Knowledge Sharing and EducationKnowledge Sharing and Education
Knowledge Sharing and EducationKaitlin Thaney
 

Similaire à A Polyphonic Model and System for Inter-animation Analysis in Chat Conversations with Multiple Participants (20)

Knowledge Acquisition from Social Awareness Streams
Knowledge Acquisition from Social Awareness StreamsKnowledge Acquisition from Social Awareness Streams
Knowledge Acquisition from Social Awareness Streams
 
Contemporary media literacy competences
Contemporary media literacy competencesContemporary media literacy competences
Contemporary media literacy competences
 
Discourse-Centric Learning Analytics
Discourse-Centric Learning AnalyticsDiscourse-Centric Learning Analytics
Discourse-Centric Learning Analytics
 
Social Networking in Second Language Learning
Social Networking in Second Language LearningSocial Networking in Second Language Learning
Social Networking in Second Language Learning
 
20111022 ontologiescomeofageocas germanymcguinnessfinal
20111022 ontologiescomeofageocas germanymcguinnessfinal20111022 ontologiescomeofageocas germanymcguinnessfinal
20111022 ontologiescomeofageocas germanymcguinnessfinal
 
Semantic Interoperation of Information Systems by Evolving Ontologies through...
Semantic Interoperation of Information Systems by Evolving Ontologies through...Semantic Interoperation of Information Systems by Evolving Ontologies through...
Semantic Interoperation of Information Systems by Evolving Ontologies through...
 
Ounl Celstec Presentation
Ounl Celstec PresentationOunl Celstec Presentation
Ounl Celstec Presentation
 
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
 
The Web and the Mind
The Web and the MindThe Web and the Mind
The Web and the Mind
 
Objectification Is A Word That Has Many Negative Connotations
Objectification Is A Word That Has Many Negative ConnotationsObjectification Is A Word That Has Many Negative Connotations
Objectification Is A Word That Has Many Negative Connotations
 
Multimodal Semiotics
Multimodal SemioticsMultimodal Semiotics
Multimodal Semiotics
 
Critical Narrative Analysis in Linguistics: Analysing a Homodiegetic Rape Nar...
Critical Narrative Analysis in Linguistics: Analysing a Homodiegetic Rape Nar...Critical Narrative Analysis in Linguistics: Analysing a Homodiegetic Rape Nar...
Critical Narrative Analysis in Linguistics: Analysing a Homodiegetic Rape Nar...
 
Presentation iccsa 2014
Presentation iccsa 2014Presentation iccsa 2014
Presentation iccsa 2014
 
Sociolinguistic moving methode .pptx
Sociolinguistic moving methode .pptxSociolinguistic moving methode .pptx
Sociolinguistic moving methode .pptx
 
Addressing Plagiarism In A Digital Age
Addressing Plagiarism In A Digital AgeAddressing Plagiarism In A Digital Age
Addressing Plagiarism In A Digital Age
 
SATANJEEV BANERJEE
SATANJEEV BANERJEESATANJEEV BANERJEE
SATANJEEV BANERJEE
 
The wisdom in Tweetonomies
The wisdom in TweetonomiesThe wisdom in Tweetonomies
The wisdom in Tweetonomies
 
Wilkie
WilkieWilkie
Wilkie
 
Workshop Part 1: Digitality (arts & aesthetic education)
Workshop Part 1: Digitality (arts & aesthetic education)Workshop Part 1: Digitality (arts & aesthetic education)
Workshop Part 1: Digitality (arts & aesthetic education)
 
Knowledge Sharing and Education
Knowledge Sharing and EducationKnowledge Sharing and Education
Knowledge Sharing and Education
 

Dernier

Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 

Dernier (20)

Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 

A Polyphonic Model and System for Inter-animation Analysis in Chat Conversations with Multiple Participants

  • 1. Ştefan Trăuşan-Matu, Traian Rebedea Universitatea “Politehnica” Bucureşti, Institutul de Cercetări în Inteligenţă Artificială al Academiei Române
  • 2. Outlook Chat Conversations with Multiple Participants A Polyphonic Model of Discourse Inter-animation Analysis The PolyCAFe Analysis System March 23, 2010 Cicling 2010 - Iasi, Romania 2
  • 3. Chat Conversations with Multiple Participants Multiple participants (≥3), conferencing style Very important in the context of the spread of forums and instant messengers – chats Important tool for Computer-Supported Collaborative Learning (CSCL) Cooperative work online Particular features – multiple, parallel discussion chains !!! There is a need for Determining important utterances Contributions of the participants Degree of collaboration - inter-animation analysis March 23, 2010 Cicling 2010 - Iasi, Romania 3
  • 4. Example: CSCL assignment Students had to debate in chat sessions in groups ranging from 3 to 8 In the first part of the conversation, each student had to defend a technology by presenting its features and advantages and criticize the others by invoking their flaws and drawbacks In the final part of the chat, they had to discuss on how they could integrate all these technologies in a single online collaboration platform March 23, 2010 Cicling 2010 - Iasi, Romania 4
  • 5. CSCL assignment: Problems How to assist teachers in evaluating students’ work in chats? Offer assistance to students Abstraction tools Automatic feedback March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 2010 5
  • 6. Experiments with chat-based CSCL K-12 students solving mathematics problems both individually and collaboratively in the VMT project at Drexel University, Philadelphia, USA Computer Science students at Bucharest “Politehnica” University, Romania at Human-Computer Interaction course in Romanian and French – role playing and debate Natural Language Processing - role playing and debate Algorithm Design – problem solving March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 2010 6
  • 7. The VMT chat environment Cicling 2010 - Iasi, Romania March 23, 2010 7
  • 8. VMT Referencing facility March 23, 2010 Cicling 2010 - Iasi, Romania 8
  • 9. Discourse Monologue Unidirectional model of communication, from a speaker to a listener – theories and methods of analysis: Rhetorical Schema Theory Centering Theory Co-reference resolution Dialogue Phone-like, face to face style – units of analysis: Speech acts Dialog acts Adjacency pairs Multi-parties conversation March 23, 2010 Cicling 2010 - Iasi, Romania 9
  • 10. Theories for analysing multi-parties conversation Discourse analysis (Tannen) Conversation analysis (Sacks, Jefferson, Schegloff) Accountable talk (Resnick) Transactivity (Teasley, Berkowitz & Gibbs, Joshi & Rose) Inter-animation (Bakhtin, Wegerif, Trausan-Matu) Polyphony (Bakhtin, Trausan-Matu et al.) March 23, 2010 Cicling 2010 - Iasi, Romania 10
  • 11. Transactivity analysis TF-IDF Latent Semantic Analysis Naïve Bayes Social Network Analysis WordNet (wordnet.princeton.edu) Support Vector Machines Collin’s perceptron TagHelper environment March 23, 2010 Cicling 2010 - Iasi, Romania 11
  • 12. Transactivity analyis TF-IDF Latent Semantic Analysis Almost all are based also on Naïve Bayes a two interlocutors Social Network Analysis model, in which WordNet (wordnet.princeton.edu) one person speaks Support Vector Machines at a time, resulting Collin’s perceptron one discussion thread TagHelper environment March 23, 2010 Cicling 2010 - Iasi, Romania 12
  • 13. A socio-cultural perspective on Natural Language Sfard: “rather than speaking about ‘acquisition of knowledge,’ many people prefer to view learning as becoming a participant in a certain discourse” (2000) Wertch: Lotman - text is a „thinking device” (1981) Stahl “to learn is to become a skilled member of communities of practice …. and to become competent at using their …. speech genres” (2006) Koshmann: “the voices of others become woven into what we say, write, and think” (1999) Wegerif - teaching thinking skills by inter-animation: “meaning-making requires the inter-animation of more than one perspective“ (2005) March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 2010 13
  • 14. Dialogism – Mikhail Bakhtin • Basis for the CSCL paradigm (Koschman, 1999) • “… Any true understanding is dialogic in nature” (Voloshinov-Bakhtin, 1973) • Opposed to de Saussure ideas: • Real life dialog should be the focus, not written text • Words are not arbitrary • Utterances (not sentences) should be the unit of analysis • Speech genres Polyphony Inter-animation of voices March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 2010 14
  • 15. Polyphony and counterpoint Concept derived from classical music “These are different voices singing variously on a single theme. This is indeed 'multivoicedness,' exposing the diversity of life and the great complexity of human experience. 'Everything in life is counterpoint, that is, opposition,' “ (Bakhtin, 1984) Multiple voices – each utterance contains multiple voices Voices inter-animate in an unmerged way: “a plurality of independent and unmerged voices and consciousnesses” (Bakhtin) March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 2010 15
  • 16. Polyphonic inter-animation March 23, 2010 Cicling 2010 - Iasi, Romania 16
  • 17. Cicling 2010 - Iasi, Romania March 23, 2010 17
  • 18. Polyphony March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 2010 18
  • 19. Words, voices and threads Positions assigned to participants – voices Additional voices – frequent concepts – repeated words become voices, stronger or weaker Voices continue and influence each other through explicit or implicit links. Voices correspond to chains or threads of utterances: repeated words lexical chains co-references reasoning or argumentation rhetorical schemas March 23, 2010 Cicling 2010 - Iasi, Romania 19
  • 20. LTfLL - EU FP7 Project (2008-2011) Language Technologies for Lifelong Learning Netherlands, France, United Kingdom, Germany, Ausria, Romania, Bulgaria PolyCAFe system (Polyphony-based Collaboration Analysis and Feedback generation) The system has just been validated with students and tutors March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 2010 20
  • 21. March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 201021
  • 22. March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 201022
  • 23. NLP pipe spelling correction, stemmer, tokenizer, Named Entity Recognizer, POS tagger and parser, and NP-chunker. Stanford NLP software (http://nlp.stanford.edu/software) Spellchecker : Jazzy http://www.ibm.com/developerworks/java/library/j-jazzy/ Alternative NLP pipes are under development, GATE (http://gate.ac.uk) LingPipe (http://aliasi.com/lingpipe/). March 23, 2010 Cicling 2010 - Iasi, Romania 23
  • 24. Pattern Language Regular expression search Synonyms, hypernyms and hyponyms via WordNet Words’ stems and their part of speech (POS) consideration of utterances as a search unit, for example, specifying that a word should be searched in the previous n utterances and that two expressions should be in two utterances March 23, 2010 Cicling 2010 - Iasi, Romania 24
  • 25. Pattern Language (ex.) <S "convergence"> #[*] cube searches pairs of utterances that have a synonym of “convergence” in the first utterance and “cube” in the second 1103 # 1107. overlap # cube [that would stil have to acount for the overlap that way] # [an idea: Each cube is assigned to 3 edges. Then add the edges on the diagonalish face.] March 23, 2010 Cicling 2010 - Iasi, Romania 25
  • 26. Classical NLP analysis (content and discourse analysis) Identification of concepts (using NLP pipe, pattern language, cue-phrases and graph algorithms) Utterance features: Speech acts Argumentation types in utterances (as in Toulmin’s theory Warrant, Concession, Rebuttal and Qualifiers) Implicit links: Repetitions Adjacency pairs Co-references (with the BART system http://bart-coref.org/) March 23, 2010 Cicling 2010 - Iasi, Romania 26
  • 27. Social network analysis Consider explicit and implicit referencing as arcs between participants, which are the nodes A kind of page-rank algorithm – an utterance is important if it is referred by important utterances; The strength of a voice (of an utterance) depends on the strength of the utterances that refer to it Determines if a person is central/peripheral March 23, 2010 Cicling 2010 - Iasi, Romania 27
  • 28. Polyphony, Inter-animation and Collaboration analysis Assign an importance value for each utterance considering several indicators of inter-animation (collaboration) Detection of voices (chains) inter-animation patterns (Trausan-Matu) in the chat Consider several criteria such as the presence in the chat of questions, agreement, disagreement Presence of others’ voices Social Networks metrics Machine learning approach (genetic algorithms and neural networks) for tuning the March 23, 2010 Cicling 2010 - Iasi, Romania 28
  • 29. March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 201029
  • 30. March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 201030
  • 31. March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 201031
  • 32. March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 201032
  • 33. March 23, 2010 Cicling 2010 - Iasi, Romania March 23, 201033
  • 34. Thank You! Questions? 34 March 23, 2010 Cicling 2010 - Iasi, Romania