Alberto Simões. Instituto Politécnico do Cávado e do Ave (Portugal).

1. Alberto Simões <ambs@ilch.uminho.pt>
José João Almeida <jj@di.uminho.pt>
Xavier Gómez Guinovart <xgg@uvigo.es>
Experimentsonthe
constructionandenrichmentof
aPortuguesewordnet

2. ThePrincetonWordNet
WordNet® is a large lexical database of English.
Nouns, verbs, adjectives and adverbs are grouped
into sets of cognitive synonyms (synsets), each
expressing a distinct concept. Synsets are
interlinked by means of conceptual-semantic and
lexical relations.

3. WordNet
A lot of similar initiatives for other languages.
Some languages have more than one WordNet.
Each WordNet has its own peculiarities.
Some are free, some are not.
Some are bigger than others.
Some created automatically, some other, manually.

4. SomeofthePortugueseWordNets
WordNet.PT - Portuguese WordNet, manually constructed, only
queriable by web browser;
OWN-PT - Bootstrapped automatically, manually corrected and
enriched, free;
Onto.PT - automatically constructed resource, aims at a
general lexical ontology (not aligned with WordNet);
PULO - Portuguese Unified Lexical Ontology, aims at
constructing a resource aligned with WordNet.Pr, made
available through Multilingual Central Repository, and
currently built automatically.

5. http://wordnet.pt

6. http://wordnet.pt

7. http://wordnet.pt

8. BootstrappingandEnlargingPULO
1. Bootstrap through Probabilistic Translation Dictionaries
using Galician, Spanish and English WordNets
2. Enlarge using Apertium MT translation dictionaries of
Galician, Catalan and Spanish WordNets
3. Enlarge using a 100 years old definitions dictionary
4. Enlarge using a 10 years old definitions dictionary

9. ExperimentI

10. ExperimentI:BootstrapthroughEN,ESandGLtranslation
Resource 1: ES, GL and EN WordNets

11. ExperimentI:BootstrapthroughEN,ESandGLtranslation
Resource 2: Probabilistic Transltion Dictionaries
- PT → ES e PT → EN extracted from Per-Fide corpus
- GL → ES extracted from CLUVI corpus
- PT → GL = PT → ES + ES → GL

12. ExperimentI:BootstrapthroughEN,ESandGLtranslation
Resource 3: PT → GL dictionary
Based on language proximity
Rewrites Portuguese words into Galician words
(lots of problems)
Resource 4: Portuguese Orthographic Vocabulary
182,012 lemmas

13. Algorithm:
1. Translate EN, ES and GL synsets into Portuguese
2. Score each translation if:
a. translation is symmetrical;
b. obtained from multiple variants/wordnets
c. are direct Galician transltions;
d. are in the Portuguese vocabullary.
ExperimentI:BootstrapthroughEN,ESandGLtranslation

14. Evaluation:
Manual evaluation of samples for different scores:
score ≥ 2.0 results in 70% of correctness
score ≥ 1.5 results in 60% of correctness
Select higher scored variants (score ≥ 2.0)
Created 18K Variants, distributed by 17,8K Synsets.
ExperimentI:BootstrapthroughEN,ESandGLtranslation

15. ExperimentII

16. ExperimentII:EnlargetranslatingGL,ESandCA
Resource 1: ES, GL and CA WordNets
Resource 2: ES-PT, GL-PT and CA-PT translation dict.

17. Algorithm:
1. Translate GL, ES and CA into Portuguese;
2. Compute multisets with all possible translations;
3. Select translations that:
a. were obtained from two or more languages;
b. were obtained from two or more variants
(possible from the same language)
ExperimentII:EnlargetranslatingGL,ESandCA

18. Evaluation:
Manual evaluation of 200 variants sample.
About 7K new variants added
ExperimentII:EnlargetranslatingGL,ESandCA

19. ExperimentIII

20. ExperimentIII:Enlargingusing100y.o.Dictionary
Resource:
Novo Diccionario da Lingua Portuguesa
Cândido de Figueiredo
1913
Transcribed for Gutenberg Project, available after
orthography modernization and TEI annotation in
dicionario-aberto.net

21. ExperimentIII:Enlargingusing100y.o.Dictionary
Algorithm:
1. Detect definitions that are comma separated lists
of words;
2. Construct sets with headword and that list;
3. Intersect constructed sets with PULO synsets
a. Suggest mergings when intersection ≥ 2

22. Evaluation:
Manual evaluation of 200 variants sample.
Quality too low, nothing added.
ExperimentIII:Enlargingusing100y.o.Dictionary

23. ExperimentIV

24. ExperimentIV:Enlargingusing10y.o.Dictionary
Had the luck to put my hand on Dicionário da Língua
Portuguesa Contemporânea from Academia das Ciências de
Lisboa;
In PDF format 😡
Black Magic (with Perl), patience, more patience, and some
more Black Magic
Dictionary in XML format 😸

25. ExperimentIV:TheDLPC
About 70K entries;
Lots of compound terms;
Well structured (senses, subsenses)
Interesting information (antonyms and synonyms per sense)

26. ExperimentIV:DLPCSynsets
43.036 different synsets
(some are subsets of each
other…)
Ranging from 2 to 9 synonyms each
(synonym plus head(s) word(s)
Average of 2.788 synonyms per synset

27. ExperimentIV:FirstAnalysis
Intercept synsets from DLPC and PULO
- With 3 terms intersection
573 expanded synsets (846 new variants)
Quick manual evaluation of 100 synsets:
OK: 76 Not OK: 11 Ambiguous: 13
- With 2 terms intersection
8,926 expanded synsets (15,773 new variants)
Evaluation: OK: 62 Not OK: 27 Ambiguous: 11

28. ExperimentIV:UsingMultilingualism
Join bilingual resources:
- probabilistic translation dictionaries;
- all kind of translation dictionaries in the web;
- (we confess some are less legal…)
- for three languages: Galician, Spanish and English;

29. ExperimentIV:OvertranslateDLPCSynsets
PT: evidente|óbvio
EN: indisputable:11.7647058824:response:
200.0000000000:flaming:11.7647058824:obtain:
200.0000000000:particularly:200.0000000000:apparent:
11.7647058824:evident:261.7647058824:assumptive:
50.0000000000:conspicuous:11.7647058824:evidential:
11.7647058824:manifest:11.7647058824:living:
11.7647058824:sure:50.0000000000:clear:
400.0000000000:palpable:11.7647058824:pronounced:
11.7647058824:irrefutable:11.7647058824:patent:
11.7647058824:glaring:11.7647058824:direct:
11.7647058824:striking:11.7647058824:downright:
11.7647058824:obvious:461.7647058824:direction:
200.0000000000

30. ExperimentIV:IntersectTranslatedDLPCSynsets
For each translated DLPC synset ($lang = EN, SP and GL)
For each WordNet.$lang synset
Check which has higher score intersection
Save mappings for each language
(DLPC synset ID -- WordNet ILI)
Intersect language mappings
(including the previous PT intersections)

31. ExperimentIV:Results
From this alignment of DLPC synsets with PULO synsets:
424 alignments resulted in no additions
(the variants were already part of PULO)
28,427 alignments suggest enrichment
(new variants to existing synsets)
10,012 alignments suggest enlargement
(new variants to empty synsets)
Confidences ranging from 1 to 678
Average at 25...

32. ExperimentIV:NewVariantsEvaluation
Cut by a score threshold of 100 (whatever that means)
- 2,114 extensions (some for same synset)
- manual evaluation of 100 expansions:
- 67% OK (166 variants)
- 20% NOK (35 variants)
- 13% Ambiguous (29 variants)
- 72% of added variants are correct

33. ExperimentIV:NewSynsetsEvaluation
Cut by a score threshold of 50(whatever that means)
- 366 new synsets (some for same synset)
- manual evaluation of 100 new synsets:
- 83% OK (267 variants)
- 11% AMB (29 variants)
- 6% NOK (19 variants)
- 85% of added variants are correct

34. ExperimentIV:Future
Previous results suggest different synonyms for same Synset:
1. create multisets of addition suggestions;
2. use multiset cardinality as confidence;
3. use morphological analyzer to match POS;
Some of which might have been done in the last week if not
for a acute conjunctivitis.

35. Extra
(ifyoulike
automation)

36. ManagingaWordNetfromCommandLine
Using SQL to manage directly a wordnet is
- tiresome,
- error prone,
Using a textual syntax is
- error prone,
Using a graphical tool is
- tiresome,
Using a command line tool is
- geek and fast.

37. Pulo-Shell

38. Alberto Simões <ambs@ilch.uminho.pt>
José João Almeida <jj@di.uminho.pt>
Xavier Gómez Guinovart <xgg@uvigo.es>
Experimentsonthe
constructionandenrichmentof
aPortuguesewordnet