Geo Metadata Workshop given by Tony Mathys at Glasgow University on 24 November 2010

1. Geospatial Metadata and Spatial Data WorkshopGeospatial Metadata and Spatial Data Workshop

2. Workshop ProgrammeWorkshop Programme
PRESENTATION SESSION:PRESENTATION SESSION:
 Background information
 Metadata, standards and application profiles
 UK Academic Geospatial Metadata Application Profile, Version 2
(UK AGMAP 2) and guidelines
 Geodoc Metadata Editor tool, Go-Geo! portal and other resources
 ShareGeo Open spatial data repository
 Look at current and future activities
REFRESHMENTS (15 - 30 minutes)REFRESHMENTS (15 - 30 minutes)
DEMONSTRATION/HANDS-ON SESSION:DEMONSTRATION/HANDS-ON SESSION:
 Geodoc Metadata Editor tool, Go-Geo! portal and ShareGeo Open
spatial data repository

3. BackgroundBackground
 three decades of GIS and spatial
data capture technology
 an eclectic range of academic
disciplines using GIS as a
research and teaching tool
 considerable cost and time
invested in spatial data creation
*2006 spatial data audit at
4 universities: +500 dataset files,
100s of orphan datasets
Requires a spatial data management,
discovery and sharing solution
delivered through portal technology
and metadatametadata.

4. So what isSo what is METADATAMETADATA?
The word appears to be of Greek and Latin origin……
but metadatametadata represents something completely different……
Photographic Images copyright: Jupiter Images 2006

5. Photographic Images copyright: Jupiter Images 2006
and it’s not sun and holiday

6. Represents a documented and ordered summary of information
that describes something, in this case, a spatial dataset.
Provides the What, Where, WhenWhat, Where, When and WhyWhy of a dataset,
OwnershipOwnership andand ContactContact details and AccessAccess andand UseUse conditions.
Think of metadata as a recipe for making beer…..Think of metadata as a recipe for making beer…..
WhatWhat are the
ingredients?
WhatWhat are the
brewing steps?
WhoWho sells the
ingredients or
Wherehere can you
buy them?
Purpose of making
beer?
Metadata (data describing data)Metadata (data describing data)
Photographic Images copyright: Jupiter Images 2006
An incentive to encourage
metadata creation?

7. WhereWhere is the study area
represented in the data?
WhenWhen were the data collected?
WhatWhat is the dataset’s purpose?
spatial reference system?
spatial accuracy?
type of application?
processes or algorithms used?
WhoWho supplies the data?
WhatWhat do these polygons represent?
WhatWhat attribute information is
associated with these polygons?
So why metadata?So why metadata?
Can you tell me fromCan you tell me from
these files…..these files…..

8. WhatWhat do these
SOILCLASS
values mean?
WhatWhat does this
attribute mean?

9. These questions can
be answered in one
metadata record

10. The relevance of geospatial metadataThe relevance of geospatial metadata
Useful for local data management
DatasetDataset
Creator/Creator/
UserUser
MetadataMetadata
RecordRecord
Spatial datasetSpatial dataset
DirectoryDirectory
SpatialSpatial
DatasetsDatasets
MetadataMetadata
DirectoryDirectory

11. GeoportalGeoportal: an interface to run searches on the internet to locate
geographical resources, and to discover, harvest and publish
metadata records representing spatial data and geo services.
A geoportal enables users to search and discover geospatial
metadata using
 geographic location (co-ordinates and place name)
 free text
 date
 resource type
GeoportalGeoportal
MetadataMetadata
RecordRecord
SpatialSpatial
DatasetsDatasets
andand
Geo-servicesGeo-services
Useful to discover spatial data and services via metadata publishedUseful to discover spatial data and services via metadata published
on a Geoportalon a Geoportal

12. Dataset B (Contours)
Dataset A (Raster Map)
Dataset C (3D Model)
Revealing and sharing spatial data from different sourcesRevealing and sharing spatial data from different sources
offers potential for creating new datasetsoffers potential for creating new datasets
© Crown Copyright/database right 2008
© Crown Copyright/database right 2008
© Crown Copyright/database right 2008

13. and developing GIS applicationsand developing GIS applications

14. Other benefits: data protectionOther benefits: data protection
Photographic Images copyright: Jupiter Images 2006

15.  protects investments of time and cost dedicated to
dataset creation and development;
 maintains an inventory of datasets to reduce time required to
re-assess existing datasets for new and future applications;
 ensures integrity of existing and new datasets using metadata
as a tracking mechanism to monitor changes and edits to
datasets;
 reduces and minimises the disruptive effects of staff
turnover;
 eliminates or reduces the risk of redundancy in dataset
collection;
 accidental deletion of dataset files.

16. 1. Intellectual Property Rights (IPR)
2. residual licensed data rights for derived data
3. liability fears
4. concerns over data quality (data creator and user)
5. privacy and security
6. time and cost for data delivery
7. data transformation and harmonisation (scale, positional
accuracy, projections, formats)
8. legacy data
9. time and cost to anonymise data for release
10. time and cost for metadata record updates, especially descriptive
level metadata
11. performance, maintenance and enhancements of portals and
repositories
12. data archiving
13. data and software warehousing issues
14. long-term commitment and investment in the infrastructure
15. revisions to standards
16. confusion about standards compliance and which standard to use
Still issues though!Still issues though!

17. Metadata standardsMetadata standards
 provide precise specifications;
 enforce and ensure consistency and interoperability;
 define and describe metadata entities and data elements;
 classify and group relevant metadata elements with entities;
 assign structure and conditions (obligations, data type, domain).

18. Dublin Core (ISO 15836)Dublin Core (ISO 15836)
Dublin Core: 15 elements to facilitate simple resource
discovery in a networked environment (e.g. internet or library)
Photographic Images copyright: Jupiter Images 2006

19. Geospatial metadata standardsGeospatial metadata standards
 Federal Geographic Data Committee (FGDC) Content StandardFederal Geographic Data Committee (FGDC) Content Standard
for Digital Geospatial Metadata (CSDGM)for Digital Geospatial Metadata (CSDGM) introduced in mid
1990s for documenting spatial datasets.
 ISO 19115 Metadata Standard for Geographic InformationISO 19115 Metadata Standard for Geographic Information was
ratified in 2003 and supersedes FGDC.
Geospatial metadata standards are critical for supportingGeospatial metadata standards are critical for supporting
metadata creation and…………………………metadata creation and…………………………

20. Other
Content
Providers
NGDF/GIgateway
Network
Geo-data
Gateway
Local Go-Geo!
database
Geoportal
portal interoperability and search capabilities across the internet.
User

21. Centre for Ecology
and Hydrology (CEH)
Centre for Ecology
and Hydrology (CEH)
National Environment
Research Council (NERC)
National Environment
Research Council (NERC)
National Soil Resources
Institute (NSRI)
National Soil Resources
Institute (NSRI)

22. Geospatial Metadata Application ProfilesGeospatial Metadata Application Profiles
ISO 19115 standard has too many elements (300+)

23. * An application profile is derived from a standard and represents a
reduction of the number of entities and elements.
* It should include the core element set of a standard to support
interoperability across the wider geospatial community
(DiscoveryDiscovery levellevel metadata).
* Should include elements for DescriptiveDescriptive level metadata?
* It can be extended to include elements which are best suited for a
working group’s specific applications.
Example: The Biological Data Profile (BDP)The Biological Data Profile (BDP)
An approved profile with additional elements to allow for
documenting biological information such as taxonomytaxonomy, m, methodologyethodology
and analytical toolsanalytical tools.
http://www.flickr.com/photos/f10n4/186861991/

24. Creating application profiles from ISO 19115Creating application profiles from ISO 19115
ISO 19115
Metadata
Standard
Core
Element Set
Application
Profiles
Academia
(43 + 33=76)
Public Sector
(43 + 62=105)
Private Sector
(43 + 12=55)300+
elements
43
elements
HealthHealth
Geological
Sciences
Geological
Sciences
Specialised
APs
* ANZLIC Metadata Profile
* North American Application Profile (NAP), Canada and the US
** INSPIRE Directive Metadata Guidelines** INSPIRE Directive Metadata Guidelines
** UK GEMINI 2.1** UK GEMINI 2.1, an INSPIRE compliant geospatial metadata
standard for the UK

25. Infrastructure for
Spatial Information
in the European
Community
(INSPIRE)
Infrastructure for
Spatial Information
in the European
Community
(INSPIRE)
*European Commission (EC)
*European Environment
Agency (EEA)
*Representatives from
Member States (Mapping/GIS)
INSPIRE Directive Metadata GuidelinesINSPIRE Directive Metadata Guidelines

26. INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC]
 Targets electronic spatial data and services for environmental
information.
 Aims to create a European Spatial Data Infrastructure (SDI) based
on Member States’ infrastructures, to improve interoperability of
spatial information.
 These data and services to be delivered through initiatives across
Europe.
 INSPIRE Regulations 2009 No 3157 came into force on 31
December 2009 and applies to England, Northern Ireland and
Wales.
 Scotland’s Parliament enacted a complementary regulation which
came into force on the same date.
 Public authorities will be obliged to produce and keep up to date
‘metadata’ for describing datasets, dataset series and geo services.
 Includes UK academia as it must comply with the Freedom of
Information Act, 2000.

27. • Provide metadata catalogues to reveal what information is available.
• Provide online data discoverydiscovery, viewview, downloaddownload and transformationtransformation
(interoperability) services.
• Licensing arrangements to allow for information sharing, access and
use in accordance with state regulations.
• Set up e-commerce arrangements where charging is applicable.
• Introduce monitoring mechanisms to show that information is being
made available.
• Introduce co-ordination mechanisms to ensure effective operation of
the infrastructure.
• Comply with the 34 data specifications in three annexes
(reference geographies, environmental datasets).
INSPIRE Regulations for member statesINSPIRE Regulations for member statesINSPIRE Regulations for member statesINSPIRE Regulations for member states

28. INSPIRE spatial data themes and deadlines for creating metadataINSPIRE spatial data themes and deadlines for creating metadata

30. INSPIRE Metadata Editor and GeoportalINSPIRE Metadata Editor and Geoportal

31. * First released in 2004 to support creation of ISO 19115 and e-GMS
compliant metadata - supersedes the National Geospatial Data
Framework (NGDF)
* Targeting the UK public sector
* 2010: UK Location Programme (UKLP)
revised UK GEMINI 2.1 to meet the
requirements of the EU INSPIRE Directive.
UK GEMINIUK GEMINI
UK Location Programme (UKLP)
is a pan-government
collaborative initiative with the
responsibility to develop and implement
the INSPIRE Directive 2007/2/EC
and the UK Location Strategy.
UK Location Programme (UKLP)
is a pan-government
collaborative initiative with the
responsibility to develop and implement
the INSPIRE Directive 2007/2/EC
and the UK Location Strategy.

32. UK Location Metadata Editor and Catalogue (beta)
supports UK GEMINI 2.1

33. http://www.flickr.com/photos/musebrarian/3289649684/#/

34. Geo resources for UK academiaGeo resources for UK academia

35. UK Academic Geospatial Metadata ApplicationUK Academic Geospatial Metadata Application
Profile, Version 2 (UK AGMAP 2)Profile, Version 2 (UK AGMAP 2)
UK AGMAP 2 created to
support the specific needs of
the UK H&FE academic
communities.
Comprises elements from ISO
19115, UK GEMINI 2 and
INSPIRE.
Supports documentation of a
dataset, dataset series or geo
service for the purpose of
discovery and description.
Mapped to Dublin Core,
FGDC, INSPIRE, UK GEMINI 2
and DDI.

36. UK AGMAP 2 profile
for datasets
and dataset series
UK AGMAP 2 profile
for datasets
and dataset series
Contact details = 7
Drop down lists = 10
Red = Mandatory
Green = Conditional
32 mandatory32 mandatory
91 elements91 elements

37. UK AGMAP 2
profile for
Geo-services
UK AGMAP 2
profile for
Geo-services
Contact details = 7
Drop down lists = 6
Red = Mandatory
Green = Conditional
25 mandatory25 mandatory
40 elements40 elements

38. Contain descriptions and examples to assist metadata creators and
Go-Geo! portal users from numerous, eclectic academic disciplines.
UK AGMAP 2 GuidelinesUK AGMAP 2 Guidelines

39. Most spatial data information
is stored in our heads.
We need to move it from there
to electronic files.
Metadata CreationMetadata Creation
Photographic Images copyright: Jupiter Images 2006

40. Mind reading aliens?
Solutions?Solutions?
Spatial data
extraction device?

41. Geodoc Metadata Editor ToolGeodoc Metadata Editor ToolGeodoc Metadata Editor ToolGeodoc Metadata Editor Tool

42. Geodoc design and functionality
• Java-built online tool
• authentication required
• text fields and drop-down
lists for entering information
• validation (red fields)
access to metadata guidelines
and Geodoc reference guide.

43. MyGo-Geo! automation
and customisation tool

44. Geodoc coordinate extent toolGeodoc coordinate extent tool
Map tool captures co-ordinate values for bounding box elements used
to define the extent of a dataset’s study area.
Extentsfor Nations
at the click of the mouse
Extentsfor Nations
at the click of the mouse

45. Direct links at click of button to metadata guidelines ‘Help’ pages

46. Personal and secure directory for storing, editing and exporting
metadata records.

47. eXXtensible MMarkup LLanguage (XML) is used for marking up
documents and data using tags that define structural elements.
A standard way to describe and share data on the web.

48. Geodoc exports UK AGMAP 2
Metadata records in
user-friendly *.pdf format
Geodoc exports UK AGMAP 2
Metadata records in
user-friendly *.pdf format

49. Publication on open or private (institutional) node

50. 1,2) create and validate record;
3) submit record for review;
4,5) Metadata creator is contacted and record
subsequently published on the Go-Geo! portal
11
22 33 55
A few easy steps to publication of a metadataA few easy steps to publication of a metadata
record using Geodocrecord using Geodoc
44
Photographic Images copyright: Jupiter Images 2006

51. A simple interface designed for
UK academia to run queries to
discover metadata for spatial
datasets.
The portal enables searching
by the use of various options
including
-free text
-date
-resource type
-geographic location
www.gogeo.ac.uk
Go-Geo! PortalGo-Geo! PortalGo-Geo! PortalGo-Geo! Portal

52. Go-Geo! simple search
Place name search
using Unlock
middleware gazetteer
Place name search
using Unlock
middleware gazetteer

53. Search results page and extents display

54. Metadata record published on Go-Geo!

55. Links between Go-Geo! portal elements to UK AGMAP 2 guidelines

56. Advanced search
- Data Type
- Location
- Text
- Date Range
*BGS JIDI Photo Collection
*COPAC

57. Access to metadata records published on institutional (private) nodeAccess to metadata records published on institutional (private) node

58. Why publish metadata on the Go-Geo! portal?Why publish metadata on the Go-Geo! portal?
 a repository for you to store and manage your
metadata thus savings in cost and time;
 use metadata to announce your data and applications;
 advertise (and sell?) your spatial datasets to other
interested parties in academia and in the private and
public sectors;
 metadata in the portal can be referenced and cited for
project proposals;
 could be configured as an internal resource to access
and share datasets.

59. Web resource channels
almost 3,000 resources

60. Bookmark resources (MyGo-Geo!)

61. Other geospatial metadata resources

62. Geospatial Metadata Workshops
July 2007
Aberdeen University
Marine/ECO-IMAGINE
Geospatial
Technologies Course
2008
Sheffield University
Southampton University
May 2010
Plymouth University
2003
Durham University
City University
2004
University of Essex
York University
Strathclyde University
Bradford University
Oxford Brookes
University
Coventry University
Edinburgh University
Oxford University
Kingston University
Sheffield University
2006
Aberdeen University
Leeds University
Cambridge University
Oxford University
Stirling University
Glasgow University
Heriot-Watt University
Strathclyde University
Kingston University
GISRUK Conference
(Nottingham)
Edinburgh University
Autumn 2010
Cardiff University
Aberdeen University
Lancaster University
Glasgow University
Leeds UniversityLeeds University
Civil EngineeringBiological Sciences
Planning
Environmental Sciences
Architecture
Information Technology
Retailing
Climate
Sociology
Library Science Landscape Planning
Archaeology
Mathematics
Health
EcologyGeosciencesComputing

63. ShareGeo OpenShareGeo Open
 Key to delivering a Spatial Data Infrastructure (SDI) for the UK
academic GI community.
 A repository for deposit and extraction of spatial data.
 Support access to and sharing of spatial data.
 Holds national and international spatial datasets
(raster, vector and tabular).
 ArcGIS plugin to create metadata to deposit with data.

64. Spatial dataset extractionSpatial dataset extraction

66. Spatial data submission: simple metadata record form to complete;
extents extracted from dataset

67. Ordnance Survey (OS OpenData)

68. ShareGeo (closed)ShareGeo (closed) Addresses issues surrounding IPR
and spatial data derived from
licensed data.

69. Current and future activitiesCurrent and future activities

70. Rebuild Go-Geo! portal with GeoNetworkRebuild Go-Geo! portal with GeoNetwork
GeoNetwork: A standards based, free and
open source catalogue application to manage
spatially referenced resources through the web.
Provides powerful metadata editing and search
functions as well as an embedded interactive web
map viewer.
http://www.flickr.com/photos/mndrix/4203609704/

71. -UK AGMAP 2
-Guidelines
-Geodoc metadata tool
-Go-Geo! portal nodes
-Workshops
-eLearning objects
Geography
Archaeology
Geological Sciences
Biological Sciences
Research
Offer Go-Geo! resources for local spatial
data management

72. UK AGMAP 2
Guidelines
Geodoc tadata tool
Customised Go-Geo! Portal
Nodes
Training
Geography
Archaeology
Geological Sciences
Biological Sciences
Go-Geo!
Go-Go!
Go-Geo!
University A
UK AGMAP 2
Guidelines
Geodoc metadata tool
Customised Go-Geo! Portal
Nodes
Training
Geography
Archaeology
Geological Sciences
Biological Sciences
Go-Geo!
Go-Go!
Go-Geo!
University B
UK AGMAP 2
Guidelines
Geodoc metadata tool
Customised Go-Geo! Portal
Nodes
Training
Geography
Archaeology
Geological Sciences
Biological Sciences
Go-Geo!
Go-Go!
Go-Geo!
University C
UK AGMAP 2
Guidelines
Geodoc metadata tool
Customised Go-Geo! Portal
Nodes
Training
Geography
Archaeology
Geological Sciences
Biological Sciences
Go-Geo!
Go-Go!
University D
Go-Geo!
Open Spatial Data Infrastructure (SDI)Open Spatial Data Infrastructure (SDI)
for UK academiafor UK academia
Other
resources
and portals
Spatial DataSpatial Data
RepositoryRepository
Spatial data
Metadata
Search
Data
user
Metadata

73. Discover
Locate
Access
Use
Publish
Fit for
purpose?
Preserve
Steps to data immortality

74.  Encourage and promote more metadata creation and publication.
*Cambridge, Edinburgh, Kingston, Leeds, Sheffield and Southampton
have created and published more than +200 metadata records on
Go-Geo! portal (global and private).
 Engage with UK academic institutions to identify INSPIRE data.
The way forward…..

75. Questions?