SlideShare une entreprise Scribd logo
1  sur  40
VIRTUAL INTEGRATION OF
WISCONSIN PARCEL DATA
Howard Veregin                Martin Goettl
                              Geography & Anthropology
Brenda Hemstead               UW – Eau Claire
State Cartographer’s Office
UW-Madison
A RESEARCH PROJECT
Research focus: virtual data integration

Exploring feasibility of the approach

•   Advantages
•   Limitations
•   Challenges
•   Best practices
WHAT WE HAVE DONE
Combined existing county Web map services
into single multi-county online parcel map

Counties supplied REST service endpoints
•   No physical data exchange
•   No edgematching or
    common data model
•   Web map points to
    published county dataset
    (most current data)
WHAT ARE WEB SERVICES?
It depends on who you ask

Technology perspective
• Software and standards supporting
   computer interaction over the Internet

User perspective
• Web apps offering data, product, or
  service delivered over Web
WHAT ARE WEB MAP SERVICES?
 Technically
 • Web Map Service = WMS
 • OGC standard for online maps display
 • One of a family of standards

 Generically
 • Way to deliver map content over Web
 • Also, feature and geoprocessing
   services…
OUR GOALS
Project goals broadened over time

Initial goal: create multi-county parcel
Web map

Our focus now is on the research side
• Not just parcels, but any theme
• Limitations, challenges, best practices
• Alignment with other GIS/IT trends
OUTLINE OF PRESENTATION
Background (Howard)

Project status (Brenda)

Main challenges (Howard)
• Performance
• Availability of map services
• Resymbolization and map appearance
• Distributed analysis and querying
• Legal issues
BACKGROUND
GEOSPATIAL DATA INTEGRATION
 “Combining data from different sources to
 provide a unified view of data for users”

 A mashup combines different geospatial
 themes over one area.

 Data integration combines the same
 theme over different (adjacent) areas.
ADVANTAGE #1
“Well-behaved” problem

Once source datasets are delivered, no
further external inputs are needed

Relatively easy to allocate personnel and
budget to the task
ADVANTAGE #2
True integration is possible (in theory)

Rubber sheeting and edgematching
eliminate spatial “gaffs” (slivers, overlaps)

Common data model facilitates analysis
and querying
ADVANTAGE #3
Republishing is relatively easy

Integrator can make data available in a
variety of formats
DISADVANTAGE #1
Data producers provide copy of dataset

Issues:
• Data sharing arrangements
• Loss of local control over data
• Possible quality decline due to spatial
   and/or attribute adjustments
DISADVANTAGE #2
Integrated data may not be current

Depends on time it takes to perform
integration, plus volatility of the layer

Re-integrating updated data is frequently
costly (so often never happens)
DISADVANTAGE #3
Curating integrated datasets is
increasingly impractical

Large data volumes (“big data”)

More frequent updates, data collection
Need a solution that
incorporates distributed
  access, visualization,
 analysis and querying
STATUS
PROCESS
                          Dear <<LIO>>,

                          This email is to inform you of a joint research project by the State Cartographers Office
                          (SCO) at UW-Madison and the Department of Geography and Anthropology at UW-Eau
                          Claire. The purpose of our project is to investigate the feasibility of using Web map
                          services to create a statewide view of geospatial data collected and maintained at the county
                          level.
Supported and             Our initial goal is to incorporate existing map services showing tax parcels into a single

facilitated by LION
                          online map application. We have chosen parcel data for this initial test because this type of
                          data is of interest to a wide range of users. However, our project has a broader purpose,
                          namely to explore how Web map services can be used to support virtual data integration for
                          simple mapping and display. Specific research questions we will be investigating include:

                          - How much flexibility exists to resymbolize map services from different counties? Can we

Contacted stakeholders    apply a common set of map symbols to different services to make the integrated map look
                          more consistent?
                          - What are the limitations on querying and analysis, given that data models and attributes
(county LIOs) via email   are not consistent from county to county? What implications does this have for data
                          standards?
                          - How much of an issue is performance? Are there performance improvements that can be
                          implemented?
                          - Can we integrate commercial and open-source services in a single Web application?

Gathered REST URL         Since our approach makes use of existing Web map services, we do not need to ask for
                          copies of your geospatial datasets. Instead, we will simply be tapping into existing services

(or other URL)            that are already available on the Web. This also means that any map that includes your
                          county's data will be up-to-date and accurate.

                          We do have one request. We would greatly appreciate your assistance by providing the
                          URL of your parcel data Web service. For most counties, this will be an ArcGIS Server
                          REST endpoint of the form:
Followed up in person     https://<host>/ArcGIS/rest/services

or by phone               We are also interested in other types of services -- such as ArcIMS, WMS, etc. If you have
                          such a service, we would appreciate your help identifying its URL.

                          To provide us with your URL, simply reply to this email or to one of the email addresses
                          listed below. So that we can keep on schedule for our project, we would greatly appreciate
                          a response by May 1, 2012.

                          Please let us know in your email response if you have any conditions or terms associated
REST ENDPOINTS
Representational State Transfer

A communications protocol for the Web

http://example.wi.us/arcgis/rest/services

Once a service is published through ArcMap
to ArcGIS Server it is visible at the REST URL
EXAMPLE

  REST SERVICES
DIRECTORY EXAMPLE
STATUS
Most counties use Esri
ArcGIS Server (REST)

ArcIMS still widely used
(but, migrating)

Small number of counties
using Open Source
technology
ARCGIS ONLINE
SOME EXAMPLES

    Waupaca            Outagamie
     County             County




                    County
                     Line
 REST
Services
SOME EXAMPLES

Waupaca         Outagamie
 County          County




             County
              Line
SOME EXAMPLES
Washington
 County                 Ozaukee
                        County


             Popup



Waukesha             Milwaukee
 County               County
CHALLENGES
PERFORMANCE
Many county REST services designed for
internal access or occasional citizen use

Impact on these users if site usage
increased significantly?

One of the reasons we are not releasing a
public-access viewer at this time
SERVICE AVAILABILITY
Services can be added, removed, or
modified

Affects where the map viewer points to
the data

Services may also go off-line

Virtually no control over these changes
SERVICE AVAILABILITY


 Map service
not responding
SERVICE AVAILABILITY



 Map service
 unavailable
RESYMBOLIZATION
Need to control symbol color and size

Also need to control zoom levels where
features appear and disappear

Relatively easy to
do, but little
consistency or
standardization
between counties
DISTRIBUTED QUERYING
How to query across multiple datasets
with different schemas

A big research issue (“semantic web”)

“Distributed query” or “federated search”

user  query  subqueries to participating
data sources  aggregation of query results
LEGAL ISSUES
Opens up new legal issues

Data readily incorporated into any
mashup for any purpose

Loss of control over data

How will local governments
react to this new technology?
CONCLUSION
WHO BENEFITS FROM INTEGRATED DATA?
Geospatial professionals
• Demonstrate ROI for cost of geospatial services
• Model a successful data integration scenario

Counties
• Active participants in an effort that will have
  impacts beyond county boundaries

Citizens and taxpayers
• Maximizing utilization of taxpayer investments
• Obtaining greater benefits
• More effective and efficient governance!
BENEFITS OF STUDY
Education about GIS Web services

Forward-looking way of thinking about data integration

Challenges and solutions to this new approach

Standards and best practices for Web services
THANK YOU!
  Howard Veregin, veregin@wisc.edu
Brenda Hemstead, hemstead@wisc.edu
  Martin Goettl, goettlm@uwec.edu
   Photos by UW-Madison, University Communications
   Geology Lab Michael Forster Rothbart/University of Wisconsin-Madison/2003
   Globe Jeff Miller/University of Wisconsin-Madison/2011
   Community Engagement Jeff Miller/University of Wisconsin-Madison/2009
   Jeopardy Bryce Richter/University of Wisconsin-Madison/2008
   All photos © Board of Regents of the University of Wisconsin System

   Other photos
   VIIRS Suomi Earth Image Norman Kuring/NASA/NOAA/GSFC/Suomi NPP/VIIRS

Contenu connexe

Similaire à Wisconsin SCO Virtual Data Integration

Introduction to RAGLD
Introduction to RAGLDIntroduction to RAGLD
Introduction to RAGLDragld
 
11.concept for a web map implementation with faster query response
11.concept for a web map implementation with faster query response11.concept for a web map implementation with faster query response
11.concept for a web map implementation with faster query responseAlexander Decker
 
Concept for a web map implementation with faster query response
Concept for a web map implementation with faster query responseConcept for a web map implementation with faster query response
Concept for a web map implementation with faster query responseAlexander Decker
 
Leveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Leveraging ArcGIS Platform & CityEngine for GIS based Master PlansLeveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Leveraging ArcGIS Platform & CityEngine for GIS based Master PlansEsri India
 
GIS Standards and Interoperability
GIS Standards and InteroperabilityGIS Standards and Interoperability
GIS Standards and InteroperabilityNasr Khashoggi
 
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...NeGD Capacity Building
 
Geospatial Ontologies and GeoSPARQL Services
Geospatial Ontologies and GeoSPARQL ServicesGeospatial Ontologies and GeoSPARQL Services
Geospatial Ontologies and GeoSPARQL ServicesStephane Fellah
 
Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Next Generation Open Data Platforms | AWS Public Sector Summit 2016Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Next Generation Open Data Platforms | AWS Public Sector Summit 2016Amazon Web Services
 
Getting your Data Out There: An Introduction to Distributed GIS
Getting your Data Out There:An Introduction to Distributed GISGetting your Data Out There:An Introduction to Distributed GIS
Getting your Data Out There: An Introduction to Distributed GISJohn Reiser
 
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...GIS in the Rockies
 
ESRIUK_Track4_maria adamson BT Lancashire Services
ESRIUK_Track4_maria adamson BT Lancashire ServicesESRIUK_Track4_maria adamson BT Lancashire Services
ESRIUK_Track4_maria adamson BT Lancashire ServicesEsri UK
 
Future of GIS, Moving to the Enterprise Platform
Future of GIS, Moving to the Enterprise PlatformFuture of GIS, Moving to the Enterprise Platform
Future of GIS, Moving to the Enterprise PlatformSSP Innovations
 
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
Strategies for Integrating Utility System Operational Data into ArcGIS Server...Strategies for Integrating Utility System Operational Data into ArcGIS Server...
Strategies for Integrating Utility System Operational Data into ArcGIS Server...True North Geographic Technologies
 
Web Mapping - exploiting location based information through eGovernment
Web Mapping - exploiting  location based information through eGovernmentWeb Mapping - exploiting  location based information through eGovernment
Web Mapping - exploiting location based information through eGovernmentDavid Hayward
 
WEB GIS AND WEB MAP.pptx
WEB GIS AND WEB MAP.pptxWEB GIS AND WEB MAP.pptx
WEB GIS AND WEB MAP.pptxAsim Pt
 

Similaire à Wisconsin SCO Virtual Data Integration (20)

Utah Reorganizes its GIS Around Web Services
Utah Reorganizes its GIS Around Web ServicesUtah Reorganizes its GIS Around Web Services
Utah Reorganizes its GIS Around Web Services
 
GIS in Utah
GIS in UtahGIS in Utah
GIS in Utah
 
Introduction to RAGLD
Introduction to RAGLDIntroduction to RAGLD
Introduction to RAGLD
 
11.concept for a web map implementation with faster query response
11.concept for a web map implementation with faster query response11.concept for a web map implementation with faster query response
11.concept for a web map implementation with faster query response
 
Concept for a web map implementation with faster query response
Concept for a web map implementation with faster query responseConcept for a web map implementation with faster query response
Concept for a web map implementation with faster query response
 
Leveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Leveraging ArcGIS Platform & CityEngine for GIS based Master PlansLeveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Leveraging ArcGIS Platform & CityEngine for GIS based Master Plans
 
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
 
GIS Standards and Interoperability
GIS Standards and InteroperabilityGIS Standards and Interoperability
GIS Standards and Interoperability
 
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
 
Geospatial Ontologies and GeoSPARQL Services
Geospatial Ontologies and GeoSPARQL ServicesGeospatial Ontologies and GeoSPARQL Services
Geospatial Ontologies and GeoSPARQL Services
 
Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Next Generation Open Data Platforms | AWS Public Sector Summit 2016Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Next Generation Open Data Platforms | AWS Public Sector Summit 2016
 
Getting your Data Out There: An Introduction to Distributed GIS
Getting your Data Out There:An Introduction to Distributed GISGetting your Data Out There:An Introduction to Distributed GIS
Getting your Data Out There: An Introduction to Distributed GIS
 
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
 
Web mapping
Web mappingWeb mapping
Web mapping
 
ESRIUK_Track4_maria adamson BT Lancashire Services
ESRIUK_Track4_maria adamson BT Lancashire ServicesESRIUK_Track4_maria adamson BT Lancashire Services
ESRIUK_Track4_maria adamson BT Lancashire Services
 
Web Mapping
Web MappingWeb Mapping
Web Mapping
 
Future of GIS, Moving to the Enterprise Platform
Future of GIS, Moving to the Enterprise PlatformFuture of GIS, Moving to the Enterprise Platform
Future of GIS, Moving to the Enterprise Platform
 
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
Strategies for Integrating Utility System Operational Data into ArcGIS Server...Strategies for Integrating Utility System Operational Data into ArcGIS Server...
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
 
Web Mapping - exploiting location based information through eGovernment
Web Mapping - exploiting  location based information through eGovernmentWeb Mapping - exploiting  location based information through eGovernment
Web Mapping - exploiting location based information through eGovernment
 
WEB GIS AND WEB MAP.pptx
WEB GIS AND WEB MAP.pptxWEB GIS AND WEB MAP.pptx
WEB GIS AND WEB MAP.pptx
 

Plus de Wisconsin Land Information Association

Workshop using open source software for mobile data collection workshop - a...
Workshop   using open source software for mobile data collection workshop - a...Workshop   using open source software for mobile data collection workshop - a...
Workshop using open source software for mobile data collection workshop - a...Wisconsin Land Information Association
 
Mapping spatial patterns of whai finder usage to measure community outreach e...
Mapping spatial patterns of whai finder usage to measure community outreach e...Mapping spatial patterns of whai finder usage to measure community outreach e...
Mapping spatial patterns of whai finder usage to measure community outreach e...Wisconsin Land Information Association
 
Lakesheds and riverscapes extending wisconsin's hydro database with landsca...
Lakesheds and riverscapes   extending wisconsin's hydro database with landsca...Lakesheds and riverscapes   extending wisconsin's hydro database with landsca...
Lakesheds and riverscapes extending wisconsin's hydro database with landsca...Wisconsin Land Information Association
 
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...Wisconsin Land Information Association
 
Integrating sanitary televising data with utility gis data within the city of...
Integrating sanitary televising data with utility gis data within the city of...Integrating sanitary televising data with utility gis data within the city of...
Integrating sanitary televising data with utility gis data within the city of...Wisconsin Land Information Association
 
Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Integrating high accuracy gps with esri's arc gis for windows mobile field so...Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Integrating high accuracy gps with esri's arc gis for windows mobile field so...Wisconsin Land Information Association
 
Implementing arc gis 10.1 for the wisconsin dnr nhi portal levi felling
Implementing arc gis 10.1 for the wisconsin dnr nhi portal   levi fellingImplementing arc gis 10.1 for the wisconsin dnr nhi portal   levi felling
Implementing arc gis 10.1 for the wisconsin dnr nhi portal levi fellingWisconsin Land Information Association
 
City of ashland an analysis of mobile gis through amazon elastic cloud comp...
City of ashland   an analysis of mobile gis through amazon elastic cloud comp...City of ashland   an analysis of mobile gis through amazon elastic cloud comp...
City of ashland an analysis of mobile gis through amazon elastic cloud comp...Wisconsin Land Information Association
 

Plus de Wisconsin Land Information Association (20)

Airphoto anomilies
Airphoto anomiliesAirphoto anomilies
Airphoto anomilies
 
A wikimap of landscape values in the bad river watershed carl sack
A wikimap of landscape values in the bad river watershed   carl sackA wikimap of landscape values in the bad river watershed   carl sack
A wikimap of landscape values in the bad river watershed carl sack
 
Workshop using open source software for mobile data collection workshop - a...
Workshop   using open source software for mobile data collection workshop - a...Workshop   using open source software for mobile data collection workshop - a...
Workshop using open source software for mobile data collection workshop - a...
 
Wigicc's role in wisconsin jon schwitchtenberg
Wigicc's role in wisconsin   jon schwitchtenbergWigicc's role in wisconsin   jon schwitchtenberg
Wigicc's role in wisconsin jon schwitchtenberg
 
Wi 590 nutrient management web application lisa morrison
Wi 590 nutrient management web application   lisa morrisonWi 590 nutrient management web application   lisa morrison
Wi 590 nutrient management web application lisa morrison
 
Surveying and land records management dean roth
Surveying and land records management   dean rothSurveying and land records management   dean roth
Surveying and land records management dean roth
 
Mapping spatial patterns of whai finder usage to measure community outreach e...
Mapping spatial patterns of whai finder usage to measure community outreach e...Mapping spatial patterns of whai finder usage to measure community outreach e...
Mapping spatial patterns of whai finder usage to measure community outreach e...
 
Local gis in the statewide voter registration system sarah whitt
Local gis in the statewide voter registration system   sarah whittLocal gis in the statewide voter registration system   sarah whitt
Local gis in the statewide voter registration system sarah whitt
 
Li dar quality control a client's perspective - tyler grosshuesch
Li dar quality control   a client's perspective - tyler grosshueschLi dar quality control   a client's perspective - tyler grosshuesch
Li dar quality control a client's perspective - tyler grosshuesch
 
Li dar meets wisconsinview jc nelson
Li dar meets wisconsinview   jc nelsonLi dar meets wisconsinview   jc nelson
Li dar meets wisconsinview jc nelson
 
Lakesheds and riverscapes extending wisconsin's hydro database with landsca...
Lakesheds and riverscapes   extending wisconsin's hydro database with landsca...Lakesheds and riverscapes   extending wisconsin's hydro database with landsca...
Lakesheds and riverscapes extending wisconsin's hydro database with landsca...
 
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
 
Integrating sanitary televising data with utility gis data within the city of...
Integrating sanitary televising data with utility gis data within the city of...Integrating sanitary televising data with utility gis data within the city of...
Integrating sanitary televising data with utility gis data within the city of...
 
Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Integrating high accuracy gps with esri's arc gis for windows mobile field so...Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Integrating high accuracy gps with esri's arc gis for windows mobile field so...
 
Implementing arc gis 10.1 for the wisconsin dnr nhi portal levi felling
Implementing arc gis 10.1 for the wisconsin dnr nhi portal   levi fellingImplementing arc gis 10.1 for the wisconsin dnr nhi portal   levi felling
Implementing arc gis 10.1 for the wisconsin dnr nhi portal levi felling
 
Gis in parks and recreation the proragis website - trish nau
Gis in parks and recreation   the proragis website - trish nauGis in parks and recreation   the proragis website - trish nau
Gis in parks and recreation the proragis website - trish nau
 
Geo moose project update brian fischer
Geo moose project update   brian fischerGeo moose project update   brian fischer
Geo moose project update brian fischer
 
Developing mobile apps pick your poison - levi felling
Developing mobile apps   pick your poison - levi fellingDeveloping mobile apps   pick your poison - levi felling
Developing mobile apps pick your poison - levi felling
 
City of ashland an analysis of mobile gis through amazon elastic cloud comp...
City of ashland   an analysis of mobile gis through amazon elastic cloud comp...City of ashland   an analysis of mobile gis through amazon elastic cloud comp...
City of ashland an analysis of mobile gis through amazon elastic cloud comp...
 
A Journey Through Mobile Application Development - Brian Fischer
A Journey Through Mobile Application Development - Brian FischerA Journey Through Mobile Application Development - Brian Fischer
A Journey Through Mobile Application Development - Brian Fischer
 

Dernier

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 

Dernier (20)

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 

Wisconsin SCO Virtual Data Integration

  • 1. VIRTUAL INTEGRATION OF WISCONSIN PARCEL DATA Howard Veregin Martin Goettl Geography & Anthropology Brenda Hemstead UW – Eau Claire State Cartographer’s Office UW-Madison
  • 2. A RESEARCH PROJECT Research focus: virtual data integration Exploring feasibility of the approach • Advantages • Limitations • Challenges • Best practices
  • 3. WHAT WE HAVE DONE Combined existing county Web map services into single multi-county online parcel map Counties supplied REST service endpoints • No physical data exchange • No edgematching or common data model • Web map points to published county dataset (most current data)
  • 4. WHAT ARE WEB SERVICES? It depends on who you ask Technology perspective • Software and standards supporting computer interaction over the Internet User perspective • Web apps offering data, product, or service delivered over Web
  • 5. WHAT ARE WEB MAP SERVICES? Technically • Web Map Service = WMS • OGC standard for online maps display • One of a family of standards Generically • Way to deliver map content over Web • Also, feature and geoprocessing services…
  • 6. OUR GOALS Project goals broadened over time Initial goal: create multi-county parcel Web map Our focus now is on the research side • Not just parcels, but any theme • Limitations, challenges, best practices • Alignment with other GIS/IT trends
  • 7. OUTLINE OF PRESENTATION Background (Howard) Project status (Brenda) Main challenges (Howard) • Performance • Availability of map services • Resymbolization and map appearance • Distributed analysis and querying • Legal issues
  • 9. GEOSPATIAL DATA INTEGRATION “Combining data from different sources to provide a unified view of data for users” A mashup combines different geospatial themes over one area. Data integration combines the same theme over different (adjacent) areas.
  • 10.
  • 11. ADVANTAGE #1 “Well-behaved” problem Once source datasets are delivered, no further external inputs are needed Relatively easy to allocate personnel and budget to the task
  • 12. ADVANTAGE #2 True integration is possible (in theory) Rubber sheeting and edgematching eliminate spatial “gaffs” (slivers, overlaps) Common data model facilitates analysis and querying
  • 13. ADVANTAGE #3 Republishing is relatively easy Integrator can make data available in a variety of formats
  • 14. DISADVANTAGE #1 Data producers provide copy of dataset Issues: • Data sharing arrangements • Loss of local control over data • Possible quality decline due to spatial and/or attribute adjustments
  • 15. DISADVANTAGE #2 Integrated data may not be current Depends on time it takes to perform integration, plus volatility of the layer Re-integrating updated data is frequently costly (so often never happens)
  • 16. DISADVANTAGE #3 Curating integrated datasets is increasingly impractical Large data volumes (“big data”) More frequent updates, data collection
  • 17. Need a solution that incorporates distributed access, visualization, analysis and querying
  • 18.
  • 20. PROCESS Dear <<LIO>>, This email is to inform you of a joint research project by the State Cartographers Office (SCO) at UW-Madison and the Department of Geography and Anthropology at UW-Eau Claire. The purpose of our project is to investigate the feasibility of using Web map services to create a statewide view of geospatial data collected and maintained at the county level. Supported and Our initial goal is to incorporate existing map services showing tax parcels into a single facilitated by LION online map application. We have chosen parcel data for this initial test because this type of data is of interest to a wide range of users. However, our project has a broader purpose, namely to explore how Web map services can be used to support virtual data integration for simple mapping and display. Specific research questions we will be investigating include: - How much flexibility exists to resymbolize map services from different counties? Can we Contacted stakeholders apply a common set of map symbols to different services to make the integrated map look more consistent? - What are the limitations on querying and analysis, given that data models and attributes (county LIOs) via email are not consistent from county to county? What implications does this have for data standards? - How much of an issue is performance? Are there performance improvements that can be implemented? - Can we integrate commercial and open-source services in a single Web application? Gathered REST URL Since our approach makes use of existing Web map services, we do not need to ask for copies of your geospatial datasets. Instead, we will simply be tapping into existing services (or other URL) that are already available on the Web. This also means that any map that includes your county's data will be up-to-date and accurate. We do have one request. We would greatly appreciate your assistance by providing the URL of your parcel data Web service. For most counties, this will be an ArcGIS Server REST endpoint of the form: Followed up in person https://<host>/ArcGIS/rest/services or by phone We are also interested in other types of services -- such as ArcIMS, WMS, etc. If you have such a service, we would appreciate your help identifying its URL. To provide us with your URL, simply reply to this email or to one of the email addresses listed below. So that we can keep on schedule for our project, we would greatly appreciate a response by May 1, 2012. Please let us know in your email response if you have any conditions or terms associated
  • 21. REST ENDPOINTS Representational State Transfer A communications protocol for the Web http://example.wi.us/arcgis/rest/services Once a service is published through ArcMap to ArcGIS Server it is visible at the REST URL
  • 22. EXAMPLE REST SERVICES DIRECTORY EXAMPLE
  • 23. STATUS Most counties use Esri ArcGIS Server (REST) ArcIMS still widely used (but, migrating) Small number of counties using Open Source technology
  • 25. SOME EXAMPLES Waupaca Outagamie County County County Line REST Services
  • 26. SOME EXAMPLES Waupaca Outagamie County County County Line
  • 27. SOME EXAMPLES Washington County Ozaukee County Popup Waukesha Milwaukee County County
  • 29. PERFORMANCE Many county REST services designed for internal access or occasional citizen use Impact on these users if site usage increased significantly? One of the reasons we are not releasing a public-access viewer at this time
  • 30. SERVICE AVAILABILITY Services can be added, removed, or modified Affects where the map viewer points to the data Services may also go off-line Virtually no control over these changes
  • 31. SERVICE AVAILABILITY Map service not responding
  • 32. SERVICE AVAILABILITY Map service unavailable
  • 33. RESYMBOLIZATION Need to control symbol color and size Also need to control zoom levels where features appear and disappear Relatively easy to do, but little consistency or standardization between counties
  • 34. DISTRIBUTED QUERYING How to query across multiple datasets with different schemas A big research issue (“semantic web”) “Distributed query” or “federated search” user  query  subqueries to participating data sources  aggregation of query results
  • 35.
  • 36. LEGAL ISSUES Opens up new legal issues Data readily incorporated into any mashup for any purpose Loss of control over data How will local governments react to this new technology?
  • 38. WHO BENEFITS FROM INTEGRATED DATA? Geospatial professionals • Demonstrate ROI for cost of geospatial services • Model a successful data integration scenario Counties • Active participants in an effort that will have impacts beyond county boundaries Citizens and taxpayers • Maximizing utilization of taxpayer investments • Obtaining greater benefits • More effective and efficient governance!
  • 39. BENEFITS OF STUDY Education about GIS Web services Forward-looking way of thinking about data integration Challenges and solutions to this new approach Standards and best practices for Web services
  • 40. THANK YOU! Howard Veregin, veregin@wisc.edu Brenda Hemstead, hemstead@wisc.edu Martin Goettl, goettlm@uwec.edu Photos by UW-Madison, University Communications Geology Lab Michael Forster Rothbart/University of Wisconsin-Madison/2003 Globe Jeff Miller/University of Wisconsin-Madison/2011 Community Engagement Jeff Miller/University of Wisconsin-Madison/2009 Jeopardy Bryce Richter/University of Wisconsin-Madison/2008 All photos © Board of Regents of the University of Wisconsin System Other photos VIIRS Suomi Earth Image Norman Kuring/NASA/NOAA/GSFC/Suomi NPP/VIIRS