SlideShare une entreprise Scribd logo
1  sur  14
GENERATING NEWSCASTS
SEMANTIC SNAPSHOTS USING
ENTITY EXPANSION
JOSÉ LUIS REDONDO GARCIA
GIUSEPPE RIZZO
LILIA PÉREZ ROMERO
MICHIEL HILDEBRAND
RAPHAËL TRONCY
@peputo / redondo@eurecom.fr
@giusepperizzo / giuseppe.rizzo@eurecom.fr
L.Perez@cwi.nl
@McHildebrand / Michiel.Hildebrand@cwi.nl
@rtroncy / raphael.troncy@eurecom.fr
NEWS CONSUMPTION
SEMANTIC SNAPSHOT
(NSS)
Named Entity
Expansion
News item
2
News Semantic Snapshot
(NSS)
Snowden asks
Russia for asylum
15th International Conference on Web Engineering (ICWE)June 25, 2015
NEWS ENTITY
EXPANSION
NSS
June 25, 2015 3
(20) (1) (4) (4)
Web-based, Unsupervised, Sequential
15th International Conference on Web Engineering (ICWE)
Involving: (experts in the news domain + users)
Dimensions:
Play with the data and help us to extend it at:
https://github.com/jluisred/NewsConceptExpansion/wiki/Golden-
Standard-Creation
EVALUATION: NEWS ENTITIES
GOLD STANDARD
(1) Video Subtitles
(2) Image in the video
(3) Text in the video image
(4) Suggestions of an expert
(5) Related articles
4June 25, 2015 15th International Conference on Web Engineering (ICWE)
DOCUMENT
COLLECTION
(20 variations)
Using Google Custom Search Engine (CSE)1
[1] https://cse.google.com/cse/all
June 25, 2015 5
N …N NN N N
N N N N N N N N N N
N N N
Web sites to be crawled:
- Google:
- L1 : A set of 10 internationals English speaking newspapers
- L2 : A set of 3 international newspapers used in GS
Temporal Window:
- 1W:
- 2W:
Annotation filtering:
15th International Conference on Web Engineering (ICWE)
DOCUMENT
ANNOTATION
NER extractors in
NERD *
(*) Benchmarking the Extraction and
Disambiguation of Named Entities on
the Semantic Web, Rizzo et al. (2004)
6June 25, 2015 15th International Conference on Web Engineering (ICWE)
ENTITY FILTERING
(4 variations)
Filtering dimensions:
- F1: NERD type:
- Person
- Organization
- Location
- F2: Confidence score:
> Threshold
- F3: Capitalization:
country
president
Obama
asylum
June 25, 2015 715th International Conference on Web Engineering (ICWE)
RANKING
STRATEGIES (1)
increase representativeness  leverage on entity frequency
June 25, 2015 8
(Freq) (Gaussian)
15th International Conference on Web Engineering (ICWE)
RANKING
STRATEGIES (2)
Rules: [ Sel(e) , ]
POPULARITY EXPERT RULES
9
- Based on Google Trends
- w = 2 months
- μ + 2*σ (2.5%)
- .
Example:
- [ Location, = 0.48 ]
- [ Person, = 0.74 ]
- [ Organization, = 0.95 ]
- [ < 2 , = 0.0 ]
(4 variations)
June 25, 2015 15th International Conference on Web Engineering (ICWE) 9
EVALUATION:
MEASURES
Mean P/R at N:
- Most popular
- Easy to interpret
Mean Average Precision at N (MAP):
- Considers ranking
- Relevant documents at the top positions
Mean Normalized Discounted Cumulative Gain at N (MNDCG):
- Different levels of document relevance
- The lower an high relevant document is ranked, the less useful
is for the user
N = 10
June 25, 2015 1015th International Conference on Web Engineering (ICWE)
RESULTS (1)
Baselines:
BS1: Former Entity Expansion Implementation*
• Google
• No temporal window
• No_Schema.org
• No_Filter
•
BS2: TFIDF-based Function.
June 25, 2015 1115th International Conference on Web Engineering (ICWE)
(*) Describing and Contextualizing
Events in TV News Show, Redondo et
al. (2014)
RESULTS(2)
1
20 x 4 x 4 =
320 runs
F3 Freq + POP + EXPGoogle + 2W + Schema.org 12
CONCLUSIONS & FUTURE WORK
- News Entity Expansion  Generate the News
Semantic Snapshot
- Best score: 0.666 in MNDCG at 10, better than BS1/2
• Collection: CSE (Google + 2W + Schema.org)
• Filtering: F3
• Ranking: Freq + POP + EXP
What’s next:
- Extend the Ground Truth
- Supervised approach
- Better exploit semantic connections between entities in KB
- Is MNDCG@10 an ideal indicator for assessing NSS quality?
June 25, 2015 1315th International Conference on Web Engineering (ICWE)
JOSÉ LUIS REDONDO GARCIA
GIUSEPPE RIZZO
LILIA PÉREZ ROMERO
MICHIEL HILDEBRAND
RAPHAËL TRONCY
@peputo / redondo@eurecom.fr
@giusepperizzo / giuseppe.rizzo@eurecom.fr
L.Perez@cwi.nl
@McHildebrand / Michiel.Hildebrand@cwi.nl
@rtroncy / raphael.troncy@eurecom.fr

Contenu connexe

Tendances

FIAT-IFTA 2013 - Television linked to the web: the case for audiovisual arch...
FIAT-IFTA 2013 - Television linked to the web:  the case for audiovisual arch...FIAT-IFTA 2013 - Television linked to the web:  the case for audiovisual arch...
FIAT-IFTA 2013 - Television linked to the web: the case for audiovisual arch...
Johan Oomen
 
Up2U Worskshop at the TNC18 conference
Up2U Worskshop at the TNC18 conferenceUp2U Worskshop at the TNC18 conference
Up2U Worskshop at the TNC18 conference
Up2Universe
 

Tendances (19)

FIAT-IFTA 2013 - Television linked to the web: the case for audiovisual arch...
FIAT-IFTA 2013 - Television linked to the web:  the case for audiovisual arch...FIAT-IFTA 2013 - Television linked to the web:  the case for audiovisual arch...
FIAT-IFTA 2013 - Television linked to the web: the case for audiovisual arch...
 
EDMO workshop 17 Feb 2021
EDMO workshop 17 Feb 2021EDMO workshop 17 Feb 2021
EDMO workshop 17 Feb 2021
 
FIRE at the ICT2015
FIRE at the ICT2015FIRE at the ICT2015
FIRE at the ICT2015
 
Fire at Net Futures2015
Fire at Net Futures2015Fire at Net Futures2015
Fire at Net Futures2015
 
MeVer tools for disinformation detection
MeVer tools for disinformation detectionMeVer tools for disinformation detection
MeVer tools for disinformation detection
 
FIRE Brochure 2014 multimedia eBook -version
FIRE Brochure 2014 multimedia eBook -versionFIRE Brochure 2014 multimedia eBook -version
FIRE Brochure 2014 multimedia eBook -version
 
Savenkov meetup161020
Savenkov meetup161020Savenkov meetup161020
Savenkov meetup161020
 
Up2U Workshop at TNC 2018-introduction
Up2U Workshop at TNC 2018-introductionUp2U Workshop at TNC 2018-introduction
Up2U Workshop at TNC 2018-introduction
 
Up2U Worskshop at the TNC18 conference
Up2U Worskshop at the TNC18 conferenceUp2U Worskshop at the TNC18 conference
Up2U Worskshop at the TNC18 conference
 
Widgetsintro 28 Jan09
Widgetsintro 28 Jan09Widgetsintro 28 Jan09
Widgetsintro 28 Jan09
 
LinkedTV project overview (2nd year)
 LinkedTV project overview (2nd year) LinkedTV project overview (2nd year)
LinkedTV project overview (2nd year)
 
Amif2008 Politech
Amif2008 PolitechAmif2008 Politech
Amif2008 Politech
 
LinkedTV: Television Linked to the Web, June 2013
LinkedTV: Television Linked to the Web, June 2013LinkedTV: Television Linked to the Web, June 2013
LinkedTV: Television Linked to the Web, June 2013
 
FIRE slideshow @ECFI-2
FIRE slideshow @ECFI-2FIRE slideshow @ECFI-2
FIRE slideshow @ECFI-2
 
GAIA and Alternative Networks
GAIA and Alternative NetworksGAIA and Alternative Networks
GAIA and Alternative Networks
 
Webinar on 1st Open Call - slideset
Webinar on 1st Open Call - slidesetWebinar on 1st Open Call - slideset
Webinar on 1st Open Call - slideset
 
Energy Domain Working Groups - OPEN DEI 1st Energy Domain Workshop
Energy Domain Working Groups - OPEN DEI 1st Energy Domain WorkshopEnergy Domain Working Groups - OPEN DEI 1st Energy Domain Workshop
Energy Domain Working Groups - OPEN DEI 1st Energy Domain Workshop
 
1st Technical Meeting - WP8
1st Technical Meeting - WP81st Technical Meeting - WP8
1st Technical Meeting - WP8
 
IoT Meets Exhibition Areas: a Modular Architecture to Improve Proximity Inter...
IoT Meets Exhibition Areas: a Modular Architecture to Improve Proximity Inter...IoT Meets Exhibition Areas: a Modular Architecture to Improve Proximity Inter...
IoT Meets Exhibition Areas: a Modular Architecture to Improve Proximity Inter...
 

Similaire à News Semantic Snapshot

(Linked Data Development and Exploitation track) "Generating the Semantic Sna...
(Linked Data Development and Exploitation track) "Generating the Semantic Sna...(Linked Data Development and Exploitation track) "Generating the Semantic Sna...
(Linked Data Development and Exploitation track) "Generating the Semantic Sna...
icwe2015
 
Revolution R: 100% R and more
Revolution R: 100% R and moreRevolution R: 100% R and more
Revolution R: 100% R and more
Masayoshi Ootsuka
 
Clearvale Overview En 2010 01 07
Clearvale Overview En 2010 01 07Clearvale Overview En 2010 01 07
Clearvale Overview En 2010 01 07
rwang5688
 

Similaire à News Semantic Snapshot (20)

(Linked Data Development and Exploitation track) "Generating the Semantic Sna...
(Linked Data Development and Exploitation track) "Generating the Semantic Sna...(Linked Data Development and Exploitation track) "Generating the Semantic Sna...
(Linked Data Development and Exploitation track) "Generating the Semantic Sna...
 
Concentric Semantic Snapshot
Concentric Semantic SnapshotConcentric Semantic Snapshot
Concentric Semantic Snapshot
 
SC4 Hangout 1: BDE-Transport Webinar Simon Scerri
SC4 Hangout 1: BDE-Transport Webinar Simon ScerriSC4 Hangout 1: BDE-Transport Webinar Simon Scerri
SC4 Hangout 1: BDE-Transport Webinar Simon Scerri
 
The International Information Conference on Search, Data Mining and Visualiza...
The International Information Conference on Search, Data Mining and Visualiza...The International Information Conference on Search, Data Mining and Visualiza...
The International Information Conference on Search, Data Mining and Visualiza...
 
II-SDV 2017 - The International Information Conference on Search, Data Mining...
II-SDV 2017 - The International Information Conference on Search, Data Mining...II-SDV 2017 - The International Information Conference on Search, Data Mining...
II-SDV 2017 - The International Information Conference on Search, Data Mining...
 
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
 
Presentation of the Big Data Europe project at the EIP Water Conference 2016 ...
Presentation of the Big Data Europe project at the EIP Water Conference 2016 ...Presentation of the Big Data Europe project at the EIP Water Conference 2016 ...
Presentation of the Big Data Europe project at the EIP Water Conference 2016 ...
 
Revolution R: 100% R and more
Revolution R: 100% R and moreRevolution R: 100% R and more
Revolution R: 100% R and more
 
SC6 Workshop 1: Big Data Europe platform requirements and draft architecture:...
SC6 Workshop 1: Big Data Europe platform requirements and draft architecture:...SC6 Workshop 1: Big Data Europe platform requirements and draft architecture:...
SC6 Workshop 1: Big Data Europe platform requirements and draft architecture:...
 
SmartAmerica / Global City Teams Challenge
SmartAmerica / Global City Teams ChallengeSmartAmerica / Global City Teams Challenge
SmartAmerica / Global City Teams Challenge
 
Real Time Analytics with Apache Cassandra - Cassandra Day Berlin
Real Time Analytics with Apache Cassandra - Cassandra Day BerlinReal Time Analytics with Apache Cassandra - Cassandra Day Berlin
Real Time Analytics with Apache Cassandra - Cassandra Day Berlin
 
Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
 
Rainer Sternfeld - Planetary Big Data - PlanetOS - Stanford Engineering - Mar...
Rainer Sternfeld - Planetary Big Data - PlanetOS - Stanford Engineering - Mar...Rainer Sternfeld - Planetary Big Data - PlanetOS - Stanford Engineering - Mar...
Rainer Sternfeld - Planetary Big Data - PlanetOS - Stanford Engineering - Mar...
 
What to expect when you are visualizing
What to expect when you are visualizingWhat to expect when you are visualizing
What to expect when you are visualizing
 
Snowflakes in the Cloud Real world experience on a new approach for Big Data
Snowflakes in the Cloud Real world experience on a new approach for Big DataSnowflakes in the Cloud Real world experience on a new approach for Big Data
Snowflakes in the Cloud Real world experience on a new approach for Big Data
 
Software Development for the Cloud - Trends, Opportunities, and Challenges
Software Development for the Cloud - Trends, Opportunities, and ChallengesSoftware Development for the Cloud - Trends, Opportunities, and Challenges
Software Development for the Cloud - Trends, Opportunities, and Challenges
 
DisrupTech - Robin Bloor (2)
DisrupTech - Robin Bloor (2)DisrupTech - Robin Bloor (2)
DisrupTech - Robin Bloor (2)
 
Platform for Big Data Analytics and Visual Analytics: CSIRO use cases. Februa...
Platform for Big Data Analytics and Visual Analytics: CSIRO use cases. Februa...Platform for Big Data Analytics and Visual Analytics: CSIRO use cases. Februa...
Platform for Big Data Analytics and Visual Analytics: CSIRO use cases. Februa...
 
Clearvale Overview En 2010 01 07
Clearvale Overview En 2010 01 07Clearvale Overview En 2010 01 07
Clearvale Overview En 2010 01 07
 
Current state of industrial IoT / Industrie 4.0 markets - IoT Tech Expo
Current state of industrial IoT / Industrie 4.0 markets - IoT Tech ExpoCurrent state of industrial IoT / Industrie 4.0 markets - IoT Tech Expo
Current state of industrial IoT / Industrie 4.0 markets - IoT Tech Expo
 

Dernier

"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments""Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
mphochane1998
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
Kamal Acharya
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
ssuser89054b
 

Dernier (20)

kiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal loadkiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal load
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
 
Computer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersComputer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to Computers
 
Online food ordering system project report.pdf
Online food ordering system project report.pdfOnline food ordering system project report.pdf
Online food ordering system project report.pdf
 
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
 
Wadi Rum luxhotel lodge Analysis case study.pptx
Wadi Rum luxhotel lodge Analysis case study.pptxWadi Rum luxhotel lodge Analysis case study.pptx
Wadi Rum luxhotel lodge Analysis case study.pptx
 
Hostel management system project report..pdf
Hostel management system project report..pdfHostel management system project report..pdf
Hostel management system project report..pdf
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
 
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments""Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna Municipality
 
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptxOrlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
 
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
COST-EFFETIVE  and Energy Efficient BUILDINGS ptxCOST-EFFETIVE  and Energy Efficient BUILDINGS ptx
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best ServiceTamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
 
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
 
Online electricity billing project report..pdf
Online electricity billing project report..pdfOnline electricity billing project report..pdf
Online electricity billing project report..pdf
 
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
 
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
 

News Semantic Snapshot

  • 1. GENERATING NEWSCASTS SEMANTIC SNAPSHOTS USING ENTITY EXPANSION JOSÉ LUIS REDONDO GARCIA GIUSEPPE RIZZO LILIA PÉREZ ROMERO MICHIEL HILDEBRAND RAPHAËL TRONCY @peputo / redondo@eurecom.fr @giusepperizzo / giuseppe.rizzo@eurecom.fr L.Perez@cwi.nl @McHildebrand / Michiel.Hildebrand@cwi.nl @rtroncy / raphael.troncy@eurecom.fr
  • 2. NEWS CONSUMPTION SEMANTIC SNAPSHOT (NSS) Named Entity Expansion News item 2 News Semantic Snapshot (NSS) Snowden asks Russia for asylum 15th International Conference on Web Engineering (ICWE)June 25, 2015
  • 3. NEWS ENTITY EXPANSION NSS June 25, 2015 3 (20) (1) (4) (4) Web-based, Unsupervised, Sequential 15th International Conference on Web Engineering (ICWE)
  • 4. Involving: (experts in the news domain + users) Dimensions: Play with the data and help us to extend it at: https://github.com/jluisred/NewsConceptExpansion/wiki/Golden- Standard-Creation EVALUATION: NEWS ENTITIES GOLD STANDARD (1) Video Subtitles (2) Image in the video (3) Text in the video image (4) Suggestions of an expert (5) Related articles 4June 25, 2015 15th International Conference on Web Engineering (ICWE)
  • 5. DOCUMENT COLLECTION (20 variations) Using Google Custom Search Engine (CSE)1 [1] https://cse.google.com/cse/all June 25, 2015 5 N …N NN N N N N N N N N N N N N N N N Web sites to be crawled: - Google: - L1 : A set of 10 internationals English speaking newspapers - L2 : A set of 3 international newspapers used in GS Temporal Window: - 1W: - 2W: Annotation filtering: 15th International Conference on Web Engineering (ICWE)
  • 6. DOCUMENT ANNOTATION NER extractors in NERD * (*) Benchmarking the Extraction and Disambiguation of Named Entities on the Semantic Web, Rizzo et al. (2004) 6June 25, 2015 15th International Conference on Web Engineering (ICWE)
  • 7. ENTITY FILTERING (4 variations) Filtering dimensions: - F1: NERD type: - Person - Organization - Location - F2: Confidence score: > Threshold - F3: Capitalization: country president Obama asylum June 25, 2015 715th International Conference on Web Engineering (ICWE)
  • 8. RANKING STRATEGIES (1) increase representativeness  leverage on entity frequency June 25, 2015 8 (Freq) (Gaussian) 15th International Conference on Web Engineering (ICWE)
  • 9. RANKING STRATEGIES (2) Rules: [ Sel(e) , ] POPULARITY EXPERT RULES 9 - Based on Google Trends - w = 2 months - μ + 2*σ (2.5%) - . Example: - [ Location, = 0.48 ] - [ Person, = 0.74 ] - [ Organization, = 0.95 ] - [ < 2 , = 0.0 ] (4 variations) June 25, 2015 15th International Conference on Web Engineering (ICWE) 9
  • 10. EVALUATION: MEASURES Mean P/R at N: - Most popular - Easy to interpret Mean Average Precision at N (MAP): - Considers ranking - Relevant documents at the top positions Mean Normalized Discounted Cumulative Gain at N (MNDCG): - Different levels of document relevance - The lower an high relevant document is ranked, the less useful is for the user N = 10 June 25, 2015 1015th International Conference on Web Engineering (ICWE)
  • 11. RESULTS (1) Baselines: BS1: Former Entity Expansion Implementation* • Google • No temporal window • No_Schema.org • No_Filter • BS2: TFIDF-based Function. June 25, 2015 1115th International Conference on Web Engineering (ICWE) (*) Describing and Contextualizing Events in TV News Show, Redondo et al. (2014)
  • 12. RESULTS(2) 1 20 x 4 x 4 = 320 runs F3 Freq + POP + EXPGoogle + 2W + Schema.org 12
  • 13. CONCLUSIONS & FUTURE WORK - News Entity Expansion  Generate the News Semantic Snapshot - Best score: 0.666 in MNDCG at 10, better than BS1/2 • Collection: CSE (Google + 2W + Schema.org) • Filtering: F3 • Ranking: Freq + POP + EXP What’s next: - Extend the Ground Truth - Supervised approach - Better exploit semantic connections between entities in KB - Is MNDCG@10 an ideal indicator for assessing NSS quality? June 25, 2015 1315th International Conference on Web Engineering (ICWE)
  • 14. JOSÉ LUIS REDONDO GARCIA GIUSEPPE RIZZO LILIA PÉREZ ROMERO MICHIEL HILDEBRAND RAPHAËL TRONCY @peputo / redondo@eurecom.fr @giusepperizzo / giuseppe.rizzo@eurecom.fr L.Perez@cwi.nl @McHildebrand / Michiel.Hildebrand@cwi.nl @rtroncy / raphael.troncy@eurecom.fr

Notes de l'éditeur

  1. Usupervised
  2. ----- Meeting Notes (6/16/15 11:16) ----- Extending the Repository