Webinar describing the evolution of the DataUp tool for managing research data. Includes demonstration of web application version of the tool.

1. Carly
Strasser
2
October
2012

UC3
Webinar
Series

California
Digital
Library

3. Big
Data
OSTP
March
2012
Big
Data
Effort
Launched

4. Guys?
The
Little
Big
Data
From
Flickr
by
jason
0nder

5. The
Long
Tail
Size
of
dataset
#
datasets

6. The
Long
Tail
Size
of
dataset
#
datasets
#
researchers

7. The
Long
Tail
Data
Managers
Size
of
dataset
#
datasets
#
researchers
All
alone

8. UGLY TRUTH
Many
(most?)
btrgroup.com
researchers…
are
not
taught
data
management
don’t
know
what
metadata
are
can’t
name
data
centers
or
repositories
don’t
share
data
publicly
or
store
it
in
an
archive
aren’t
convinced
they
should
share
data

9. From
Flickr
by
DW0825
From
Flickr
by
Flickmor
From
Flickr
by
deltaMike
Digital
data
www.woodrow.org
C.
Strasser
Courtesey
of
WHOI
From
Flickr
by
US
Army
Environmental
Command

10. Digital
data
+
Complex
workflows

11. Where
data
end
up
From
Flickr
by
diylibrarian
www
blog.order2disorder.com
From
Flickr
by
csessums
Data
Metadata
From
Flickr
by
csessums
Recreated
from
Klump
et
al.
2006

12. Where
data
end
up
From
Flickr
by
diylibrarian
www
Data
www
Metadata
From
Flickr
by
torkildr
Recreated
from
Klump
et
al.
2006

13. The
Fallout
Data
Reuse
Data
Sharing
Data
Management

14. Barriers
From
Flickr
by
Chris0na
Ann
VanMeter
• Cost:
time,
personnel,
software
&
hardware
• Confusion
about
standards,
how
to
start
• Disparate
datasets
• Lack
of
training
From
Flickr
by
bthomso
• Fear
of
lost
rights/benefits
• No
incentives

15. From
Flickr
by
diylibrarian
?
www
Data
www
Metadata
From
Flickr
by
torkildr
Recreated
from
Klump
et
al.
2006

16. Intercept
researchers
where
they
already
work

18. Facilitate
Archiving
Data
management
Data
Reuse
&
Sharing
Reproducibility
&
organization
Publishing

19. Open
Source
Tool
Add-­‐in
&
Web
Application
Earth,
environmental,
?
ecological
researchers

20. Add-­‐in
• Download
&
install
• Appears
as
“ribbon”
in
Excel
• Windows
Excel
2007+
Web-­‐based
application
• Website
that
does
something
with
user’s
files
• New
user
interface
• Any
platform
?

21. What
will
DataUp
do?
What
do
scientists
need?

22. ~ 150
scientists
• No
data
preservation
– Unaware
of
archives
– Resistant
to
sharing
• Poor
data
documentation
• 90%
use
Excel
+
other
programs

23. Requirements
Features
Best
practices
check
Generate
metadata
Generate
citation
?
Post
data
to
repository

24. ?
Data
Repository
for
Anyone
|
Anywhere

25. NSF
funded
DataNet
Project
Office
of
Cyberinfrastructure
www.dataone.org

26. B
A
C

27. B
A
C
C

28. DataUp
Web
App
Demo

29. Add-­‐in:
Ribbon

30. Add-­‐in:
Metadata
tab

31. Build
community
Add
repositories
From
anima0onresources.org
Add
metadata
schema

32. Main
site:
dataup.cdlib.org

33. Main
site:
dataup.cdlib.org

34. Code
site:
bitbucket.org/dataup/main

35. Code
site:
bitbucket.org/dataup/main

36. Web
app
site:
dataup.
org

37. CDL’s
Data
Pub
Blog:
datapub.cdlib.org

38. www.cdlib.org
www.cdlib.org/uc3
dataup.cdlib.org
@DataUpCDL
facebook.com/DataUpCDL
carlystrasser.net
@carlystrasser
carlystrasser@gmail.com