[2024]Digital Global Overview Report 2024 Meltwater.pdf
MCN 2008: could tagging and folksonomy improve access to art museum collections on-line
1. could tagging and folksonomy
improve access to
art museum collections on-line?
J. Trant
Archives & Museum Informatics
MCN2008 | November 2008
http://conference.archimuse.com/jtrants
3. Access to Collections
From: J. P. xxxxxx@xxxxxx.com
Date: Sat, 26 Aug 2006 11:24:43 -0700
To: timeline@metmuseum.org
Subject: Looking for a painting
Please help:
I have been looking on and off for years for this painting. The painting is of a
very well dressed renaissance man standing in a room (a library) in front of him
on a table is a large hour glass. The painting has very rich colors. I have talked
to a lot of people and they have said they have seen this painting but can't
remember its name or the name of the artist.
Could you please use your resources to find this painting?
Reference Questions
c.f. Catechism Project, Janney & Sledge
6. Access to Collections
What “J. P.” knows What a Met curator knows
Portrait of a Man, ca. 1520–25
painting Moretto da Brescia (Alessandro Bonvicino)
Renaissance (Italian, Brescian, born about 1498, died 1554)
Oil on canvas; 34 1/4 x 32 in. (87 x 81.3 cm)
standing Rogers Fund, 1928 (28.79)
man Provenance: Maffei, Brescia (by 1760, as quot;Ritratto d'uomo con
very well dressed carta in mano, ed Orologio, di Callisto da Lodiquot;); by descent to
contessa Beatrice Erizzo Maffei Fenaroli Avogadro, Palazzo
library Fenaroli, Brescia (by 1853–at least 1857, as by Moretto); her
daughter, contessa Maria Livia Fenaroli Avogadro, later marchesa
hourglass Fassati, Brescia (in 1862); her son, marchese Ippolito Fassati,
Milan (by 1878–at least 1912); [Elia Volpi, Florence, by 1915–16;
table sold to Knoedler]; [Knoedler, New York, 1916–28; sold to MMA]
rich colors
What they both know ...
8. Access to Collections
bangs
robe
beard
border
Renaissance
cape
scholar
contemplation
elbow
scroll
hourglass
time
landscape
trees
learned
man
mountain
moustache
nobleman
painting
portrait
ring volunteer supplied tags
robe might help
Renaissance from MMA proof of concept
18. research question
Can tagging and folksonomy
improve online access to art
collections?
http://conference.archimuse.com/jtrants
19. Research Questions
gilded
animal
bejeweled
antler
rearing
deer
Artist
woman (Nationality, Dates)
Title, Date
Medium
action Dimensions
hunting
Ownership
Notes museum
...
luxury
documents
dog
bow
horse
object
leaping
huntress
users tag J. Trant, Jan 28, 2008
based on Wyman et al. 2006, Fig.2
a model of tagging
http://conference.archimuse.com/jtrants
20. Research Questions
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
Research Process
21. Research Questions
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
Research Process
23. Research Questions: Tagging
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
What was tagged?
24. Research Questions: Tagging
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
What was tagged?
25. Research Questions: Tagging
Multi-Institutional Tagger: Works by Institution
[all works]
The Metropolitan Museum of
Art Boston Museum of Fine Arts
14% 13%
Cleveland Museum of Art
Tate Modern 7%
3%
Skirball Denver Art Museum
1%
9%
Indianapolis Museum of Art
13%
San Francisco Museum of
Modern Art
9%
Rubin Los Angeles County Museum
6% Minneapolis Institute of Arts of Art
14% 11%
Characterizing Tagging: Works Tagged
Same MMA 251 in both sets
26. Research Questions: Tagging
Multi-Institutional Tagger: Works by Institution
[all works]
1,784 works
The Metropolitan Museum of
Art
14%
Boston Museum of Fine Arts
13%
Cleveland Museum of Art
Tate Modern 7%
3%
Skirball Denver Art Museum
11 museums
1%
9%
Indianapolis Museum of Art
13%
San Francisco Museum of
Modern Art
9%
Rubin Los Angeles County Museum
6% Minneapolis Institute of Arts of Art
14% 11%
Characterizing Tagging: Works Tagged
Same MMA 251 in both sets
29. Research Questions: Tagging
users folksonomy
who assigns what kinds of terms
how many terms? are assigned?
terms
tag works of art
assigned 1
how does users' terms
tagging differ? assigned 2
Tags per work
# of tags # of taggers # tags per tagger
total distinct total total tags distinct tags
high low average std. dev. high low average std. dev.
all works
work 1
work 2
work 3
Study Terms Assigned
30. Research Questions: Tagging
users folksonomy
who assigns what kinds of terms
how many terms? are assigned?
terms
tag works of art
assigned 1 descriptive statistics
• tagger velocity
how does users' terms
assigned 2
• tag variation
tagging differ?
Tags per work
# of tags # of taggers # tags per tagger
total distinct total total tags distinct tags
high low average std. dev. high low average std. dev.
all works
work 1
work 2
work 3
Study Terms Assigned
31. Research Questions: Tagging
Multi-Institution Tagger Single-Institution Tagger
# of # of # of # of
# of tags # of tags
works users works users
total distinct total total distinct total
1,784 36,981 11,944 1,621 251 56,399 21,557 690
Characterizing Tagging: Basic Descriptive Statistics
32. Research Questions: Tagging
Multi-Institution Tagger Single-Institution Tagger
# of # of # of # of
# of tags # of tags
works users works users
total distinct total total distinct total
1,784 36,981 11,944 1,621 251 56,399 21,557 690
22 tags / 82 tags /
Characterizing Tagging: Basic Descriptive Statistics
user user
34. Research Questions: Tagging
Multi-Institutional Tagger
Unregistered Users
Registered Users
registered users
tag more
Characterizing Tagging: Compare Registered | Unregistered
35. Research Questions: Tagging
Multi-Institutional Tagger: Sessions per Registered User
6% 6%
4 or more sessions
4 or more sessions
6%
3 sessions 3 sessions
6%
20%
2 sessions
20%
2 sessions
68%
1 session
68%
1 session
Characterizing Tagging: Sessions per Registered User
unregistered users only come once by definition
36. Research Questions: Tagging
Multi-Institutional Tagger: Tags per Work, Average by Object Type
number of tags per object type divided by number of works of that object type
highlighted values for samples of fewer than 10 works
40
35
Average Tags / Work
Linear (Average Tags / Work)
33.4
30
25 27.1 27.0
25.1
23.4 23.7
20 22.2 21.6
20.7 20.1
15
16.4 16.0
14.5
13.4
10
5
1.5
0
s
rs
ts
s
s
eo
hs
re
ts
ns
a
e
ry
er
s
ile
g
k
ok
i
ur
lo
ec
ed
in
tu
el
th
or
in
ap
tio
d
xt
ct
Bo
co
Vi
Pr
w
bj
nt
p
O
M
W
r
la
Te
ite
ul
Je
o-
og
er
O
i
ed
al
Pa
l
Sc
Al
di
ch
at
ot
n
d
st
ix
Au
ria
an
W
Ar
Ph
In
M
ita
d
e
an
um
l
tli
gs
U
st
Co
in
d
an
w
ra
s
t
D
Ar
created from
e
iv
tagsPerWork-080828.xls
at
or
ec
D
Characterizing Tagging: Tags Per Work by Object Type
37. Research Questions: Tagging
Multi-Institutional Tagger: Tags per Work, Average by Object Type
number of tags per object type divided by number of works of that object type
highlighted values for samples of fewer than 10 works
40
35
Average Tags / Work
Linear (Average Tags / Work)
33.4
30
25 27.1 27.0
25.1
23.4 23.7
20 22.2 21.6
20.7 20.1
15
16.4 16.0
14.5
13.4
10
some works
5
1.5
0
s
rs
ts
s
s
eo
hs
re
ts
ns
a
e
ry
er
s
ile
g
k
ok
i
ur
lo
ec
ed
in
tu
el
th
or
in
ap
tio
d
xt
ct
Bo
co
Vi
Pr
w
bj
nt
p
O
M
W
r
la
Te
ite
ul
Je
o-
og
er
O
i
are harder al
ed
Pa
l
Sc
Al
di
ch
at
ot
n
d
st
ix
Au
ria
an
W
Ar
Ph
In
M
ita
d
e
an
um
l
tli
gs
U
st
Co
in
d
an
w
ra
s
t
D
Ar
created from
e
iv
tagsPerWork-080828.xls
at
or
ec
D
Characterizing Tagging: Tags Per Work by Object Type
40. Are tags new terms?
http://conference.archimuse.com/jtrants
41. Research Questions: Museum Documentation
research questions:
social tagging and folksonomy analysis
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
Do user tags differ from museum documentation?
42. Research Questions: Museum Documentation
research questions:
social tagging and folksonomy analysis
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
Do user tags differ from museum documentation?
51. Research Questions: Museum Documentation
Multi-Institutional Tagger: Terms Not Found in
Multi-institutional Tagger:Documentation Found in Museum Documentation
Museum Terms Not
200
150
Times Assigned
100
50
0
an
s
gn
om
si
w
ic
da
zo
J. Trant created from
September 18, 2008 Term termsMuseumDocumentation.xls:musdocNULL-freq
Do user tags differ from museum documentation?
52. Research Questions: Museum Documentation
Multi-Institutional Tagger: Terms Not Found in
Multi-institutional Tagger:Documentation Found in Museum Documentation
Museum Terms Not
200
150
31,949 terms
Times Assigned
100
50
86% not found
0
an
s
gn
om
si
w
ic
da
zo
J. Trant created from
September 18, 2008 Term termsMuseumDocumentation.xls:musdocNULL-freq
Do user tags differ from museum documentation?
53. Times Assigned
w
100
150
200
0
50
om
an
J. Trant
la b
nd lue
sc
ap
e
re
po d
rt
ra
it
m
an
gr
ee
flo n
w
er
s
tr
e es
go
ab ld
st
ra
he ct
br
ew
cl
ou
bl ds
ac
k as
an ia
d n
w
hi
t
af e
ric
an
ho
re rse
lig
io
u
ye s
llo
pa w
tt
er
n
flo
r
w al
om
en
nu
de
bl
de a
co ck
ra
tiv
st e
at
ue
sk
y
va
m se
o
ge der
om n
et
ric
w
hi
te
w
at
e
fe r
m
sc a
ul le
pt
u
ca re
rv
in
g
Multi-Institutional Tagger: Museum Documentation
st
on
e
[terms assigned more than 50 times, by occurrence]
m
en
fa
c
in e
te
rio
pe r
Do user tags differ from museum documentation?
rs
Multi-institutional Tagger: Terms Not Found inTerms Not Found in Museum Documentation
on
m
et
re al
lig
io
n
da
rk
Research Questions: Museum Documentation
tr
ee
te
xt
il
o e
54. Research Questions: Museum Documentation
Multi-institutional Tagger: Terms Not Found inTerms Not Found in Museum Documentation
Multi-Institutional Tagger: Museum Documentation
[terms assigned more than 50 times, by occurrence]
Top 100
Not Matched
200
subject 39
150
genre 27
Times Assigned
color 10
100
geo-cultural 10
material 9
50
style/period 5
0
he ct
es
w al
an
om n
st e
en
an
on
re al
af e
y
te
fe r
o e
n
m se
n
e
ric
s
ul le
an
re rse
g
pe r
ee
n
d
it
en
n
ld
ds
ye s
ue
nd lue
co ck
e
de
rk
ew
ca re
pa w
in e
e
rio
er
u
tiv
sk
t
il
on
ap
ge der
ee
c
ia
in
re
er
io
ra
r
llo
et
a
ra
go
hi
hi
at
da
u
e
va
a
xt
fa
ou
io
tr
m
m
ric
et
rs
om
om
nu
at
flo
br
m
as
b
lig
rv
w
ho
tt
pt
tr
rt
bl
te
gr
st
sc
ra
m
w
w
st
w
lig
te
o
flo
cl
po
ab
w
d
sc
an
de
la
k
ac
bl
J. Trant
Do user tags differ from museum documentation?
55. Research Questions: Extended Museum Documentation
Are Tags in Other Forms of Museum Documentation?
Useful?
Genres
✓ gallery label text
✓ docent tour talking points / tour scripts
✓ special exhibition catalogue entries
✓ permanent collection guidebook text
✓ curatorial analysis or notes
✓ scholarly article
✓ web site 'feature' texts
✓ audio tours or podcasts
✓ newspaper/popular article
56. Research Questions: Extended Museum Documentation
Are Tags in Other Forms of Museum Documentation?
Useful?
Genres
✓ gallery label text
✓ docent tour talking points / tour scripts
✓ special exhibition catalogue entries
✓ permanent collection guidebook text
✓ curatorial analysis or notes
✓ scholarly article
✓ web site 'feature' texts both scholarly
✓ audio tours or podcasts + general public
✓ newspaper/popular article
58. Research Questions: Extended Museum Documentation
11 documents
19 distinct tags
found 138 times
51 relevant
63% false matches
87 not relevant
... the house where
he grew up ...
60. Research Questions: Extended Museum Documentation
➡Extended documentation
not better than online
museum documentation
➡Text mining not algorithmic
➡Public genres not much
better than scholarly
62. Research Questions: Usefulness
research questions:
social tagging and folksonomy analysis
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
Do Museum Professionals Find
Tagging Terminology Useful?
63. Research Questions: Usefulness
research questions:
social tagging and folksonomy analysis
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
Do Museum Professionals Find
Tagging Terminology Useful?
75. Research Questions: AAT/ULAN
research questions:
social tagging and folksonomy analysis
users folksonomy vocabulary sources
who assigns what kinds of terms
are terms found in...
how many terms? are assigned?
Art and
Architecture
Thesaurus
terms
tag works of art
assigned 1 museum
(AAT)
records Union List
of Artists
Names
how does users' terms (ULAN)
tagging differ? assigned 2
searches of
art image
databases
works of art
J. Trant, February 2008
are terms applicable to
based on Trant 2006
Are tags in Museum Vocabulary Sources?
Editor's Notes
- theories of precision and recall developed in a very different context (scarce resources, and searching by an intermediary). now people browse
lots of possibility: no real answers
add highlights to each section
term review: “if you found this work using a search on this term, would you be surprised?” Tagging tags to understand tagging
what are the relationships between the terms used for searching (found in logs), the tags assignedto works of art, and the words in museum documentation?
what are the relationships between the terms used for searching (found in logs), the tags assignedto works of art, and the words in museum documentation?
there are no artists in museums ...
- theories of precision and recall developed in a very different context (scarce resources, and searching by an intermediary). now people browse