In July 2013, SFMOMA launched its first online collection catalogue, the Rauschenberg Research Project (RRP), which features nearly 90 Robert Rauschenberg works from the museum's permanent collection. The RRP combines rigorous scholarship with multimedia resources. With more than 500 images, videos, and research materials, it is the largest research effort the museum has ever devoted to a single artist; a print equivalent would have totalled more than 600 pages. The RRP is part of the Getty Foundation's Online Scholarly Catalogue Initiative (OSCI), which explores how scholarly collection catalogues can be transformed by the online environment. Based on a recent evaluation, this presentation will share insights into the reach and impact of an online scholarly museum publication. Who is using the RRP specifically, and online scholarly catalogues more generally? How is it being used? How is it perceived by its target audience of scholars, historians, and curators? The findings are encouraging, while also revealing concerns.
5. 1. Who is using the RRP?
2. How is it being used?
3. How is it perceived?
4. Is it replicable by SFMOMA?
Frankly, Green + Webb
6. Frankly, Green + Webb
What We Did
1. Online survey
2. Interviews with users and
stakeholders
3. Usability testing
4. Google Analytics
7. Let’s start with some good news
1. Reaching the primary audience
2. Used for research and
teaching
3. A trusted source
4. A new form
Frankly, Green + Webb
8. The RRP is reaching its primary target audience
20%
Other
Audiences
Q: What best describes you?
Frankly, Green + Webb
69% Primary Audiences
• 25% Graduate
students
• 18% Professors
• 16% Curators
• 6% Independent
scholars
• 4% Librarians
N=51
69%
Primary
Audiences
12%
Secondary
Audiences
9. It’s also reaching secondary and wider audiences
20%
Other
Audiences
Q: What best describes you?
Frankly, Green + Webb
69% Primary Audiences
• 25% Graduate
students
• 18% Professors
• 16% Curators
• 6% Independent
scholars
• 4% Librarians
12% Secondary Audiences
• 10% Museum educators
• 2% Undergraduates
N=51
69%
Primary
Audiences
12%
Secondary
Audiences
10. Greater and more diverse reach than
a comparable print catalogue
700
Museum, university and
library network domains
from around the world
Frankly, Green + Webb
24,792
Unique visitors in first
six months
11. Google is the key to the
discoverability of the RRP
>48%
Traffic referred by Google
Frankly, Green + Webb
I'm Googling for …some random
fact about Rauschenberg in
1953…and I often find that
that takes me back to an essay
in the RRP.
Graduate student
12. Where do scholars expect to find
Frankly, Green + Webb
the RRP?
…in academic databases?
14. Where do scholars expect to find
Frankly, Green + Webb
the RRP?
…at the library
…it's parallel to a
huge book…I might expect to
see to it listed instead in
the actual [university]
library where they're
cataloguing books…
Graduate student
15. Frankly, Green + Webb
But…there’s no
standardized
process for
adding digital
publications to
library
catalogues
16. What does this
mean for you?
Frankly, Green + Webb
• SEO is critical to the
findability of your online
scholarly catalogue
• Get an ISBN number for your
online publication
• Getting online publications
into university libraries will
require outreach to art
librarians
17. How is the RRP being used?
Looking for conservation
research
Looking for images of
Rauschenberg’s work
Researching Robert
Rauschenberg
Looking for materials and
resources to support teaching
General research
Interest in online catalogues
Frankly, Green + Webb
N=81
35%
19%
20%
12%
14%
1%
0% 5% 10% 15% 20% 25% 30% 35% 40%
Q: What were your reasons for visiting/using the Rauschenberg Research Project
online? (Please select all that apply)
18. How is the RRP being used?
Looking for conservation
research
Looking for images of
Rauschenberg’s work
Researching Robert
Rauschenberg
Looking for materials and
resources to support teaching
General research
Interest in online catalogues
Frankly, Green + Webb
Visitors who are
interested in the
catalogue’s form,
rather than its
content
N=81
35%
19%
20%
12%
14%
1%
0% 5% 10% 15% 20% 25% 30% 35% 40%
Q: What were your reasons for visiting/using the Rauschenberg Research Project
online? (Please select all that apply)
19. How is the RRP being used?
Looking for conservation
research
Looking for images of
Rauschenberg’s work
Researching Robert
Rauschenberg
Looking for materials and
resources to support teaching
General research
Interest in online catalogues
Frankly, Green + Webb
15% of RRP
visitors have
been to the
site 9-200
times
Visitors who are
interested in the
catalogue’s form,
rather than its
content
N=81
35%
19%
20%
12%
14%
1%
0% 5% 10% 15% 20% 25% 30% 35% 40%
Q: What were your reasons for visiting/using the Rauschenberg Research Project
online? (Please select all that apply)
20. Primary audiences rate RRP content very highly
4.63
4.26
4.43
4.51
4.54
Videos
Conservation documents
Curatorial documents
Exhibition histories
Scholarly essays and
curatorial commentary
Q: “How do you rate the content of the Rauschenberg Research Project on a
scale of 1-5 where 1 is not at all useful and 5 is extremely useful? N=35
Frankly, Green + Webb
4.54
1 2 3 4 5
Images of the artworks
Extremel
y useful
Very
useful
Fairly
useful
Not very
useful
Not at all
useful
21. There was universal praise for the usefulness, quality, depth
and breadth of RRP content
98%
of the primary audience said they
were likely to use the RRP for any
future research on Rauschenberg
Frankly, Green + Webb
The [RRP] was a huge
asset for my [Masters]
paper…
Graduate student
comprehensive.
I cite it as a model
Graduate student
The research…is
just phenomenal
Curator
22. The audience also trusted RRP as a scholarly source
37%
of the primary audience that had
used the RRP said they planned to
cite it in future research
The RRP presents
itself as something
that makes me trust
it to a very high
Frankly, Green + Webb
standard.
Curator
…generally…I don't cite
online material…but because
of the rigor that was used
in this project, I felt
comfortable citing it.
Graduate student
23. A deeper level of access to museum information
Frankly, Green + Webb
It’s like the museum
opened up their databases to
me. I wish I could find this
kind of resource for the
artists I work on.
Curator
24. Features for the academic audience
1. Video transcripts and sharing
2. Citation tools
3. Downloadability
[Recommended format for citation
is] super super important…in terms
of training our students in
research and documentation”
Frankly, Green + Webb
Professor
25. Features for the academic audience
1. Video transcripts and sharing
2. Citation tools
3. Downloadability
Frankly, Green + Webb
I downloaded pretty
much everything …because
I wanted to use it offline
where I didn't have WiFi.
Graduate student
26. But many also saw the RRP as offering a new type of scholarship
The RRP seems somewhat unique
in the aggregation of very high
quality images...detailed object
information and particular
essays geared toward those
Frankly, Green + Webb
objects.
Graduate student
The…content of the essays
was …the most surprising and interesting
thing for me. The essays by SFMOMA curators
had insights about the physical objects,
their histories, that don't appear in
traditional art historical scholarship
written by people who have limited access
to the objects…
Graduate student
The RRP appears to be a
new kind of thing…a unique
publication… It's a new kind
of form
Graduate student
27. What does this
mean for you?
Frankly, Green + Webb
• Online catalogues need some
specialized functionality to
meet the needs of a scholarly
audience
• The features reflect working
process and signify academic
authority
• Online scholarly catalogues
offer opportunities for
innovation in content and form
28. Frankly, Green + Webb
Challenges
1. Boundaries
2. Permanence
3. Status
4. Replicability
30. Boundaries: where does an online
publication begin and end?
Frankly, Green + Webb
Where is the container
that makes this into a separate
publication? Does it bleed
out into the rest of the
website?...where does the publication
begin and where does it end? And how
do you tell when you're in it or not
in it?
Graduate student
33. Permanence: will this be here
Frankly, Green + Webb
in 20 years?
But if you cite
something there's the
possibility that it
would disappear.
There's a lot of
scholarly nervousness
about that.
Graduate student
Do we have a way
to ensure that... 20 years from now,
will we be able to read this data?
…If it's in a library catalogue…will
that URL be stable?
Graduate student
34. Status: what is the value of
an online scholarly catalogue?
Frankly, Green + Webb
35. Status: what is the value of
an online scholarly catalogue?
Frankly, Green + Webb
It doesn't feel as
prestigious [as a printed
catalogue] but I think
that's changing…I wouldn't
hesitate to sign on to a
project that was digital.
Curator
The physical heft of
a book is in some ways how
we translate the
intellectual weight
Graduate student
36. Status: what is the value of
an online scholarly catalogue?
Frankly, Green + Webb
I have published in museum
publications before. And… what I've
been told is that they don't count
towards tenure review…they go on my
CV, but they…aren't considered tenure-worthy.
But..the RRP that's some new
territory I think…
Graduate student
37. Status: what is the value of
an online scholarly catalogue?
It changed my opinion... it
served for me as an example of
Frankly, Green + Webb
what's possible.
Graduate student
I saw that one could be done
in a very comprehensive and
scholarly manner. I'm not
sure I was a big believer
prior to that.
Curator and RRP contributor
38. What does this
mean for you?
Frankly, Green + Webb
• Clear boundaries translate to
audience trust
• Can online catalogues be
permanent, updatable and
archival?
• Perceptions of online
catalogues are shaped by
larger issues of status and
publication record in the
academic community
I
41. Frankly, Green + Webb
• Technical framework
• Integration of museum
systems
• Roles and
responsibilities
• Resources and workflow
42. What does this
mean for you?
Frankly, Green + Webb
• Technology integrations
• New museum workflows
• New roles and responsibilities
• Quantifying scope and effort
for appropriate resources
43. Frankly, Green + Webb
e:
laura@franklygreenwebb.com
t:
@lhmann
Images thanks to Flickr Commons:
The hidden treasures of the Worlds
Public Archives
http://www.flickr.com/commons