SlideShare une entreprise Scribd logo
1  sur  14
Télécharger pour lire hors ligne
In Cooperation with the New Mexico Interstate Stream Commission (NMISC)

    Building a Water-Resources
    Geodatabase for the Rio Grande Basin
    – San Acacia, New Mexico to Fort
    Quitman, Texas
    Thomas E. Burley, GISP
    USGS Texas Water Science Center – Austin, TX

    2011 Texas GIS Forum – Austin, TX



U.S. Department of the Interior
U.S. Geological Survey
Overview – Need and Significance

 Data collected for middle Rio Grande Basin for variety of
  purposes over several decades by numerous agencies,
  researchers, and organizations
 Previous attempts to compile these data have not been
  complete or done in a way that could be repeated
 A well-organized and usable database is needed to
  identify management priorities and facilitate hydrologic
  studies
Hydrologic Geodatabase Overview

   Data organized into a comprehensive spatially-
    enabled relational database (geodatabase)
   Stores spatial and tabular data for area of interest
    from multiple sources
   Data can be queried and/or viewed spatially to assist
    in identifying data gaps, conduct spatial analysis, and
    support decision-making
Rio Grande Basin – San Acacia, New
       Mexico to Fort Quitman, Texas

   Surface-water catchments
    encompass approximate
    extents of underlying aquifers
    of interest
   Surface-water catchments
    used to geographically filter
    physical sites and associated
    data from sources with larger
    spatial delivery extents
Data Sources and Types
 Hard-copy reports, previous data compilations, and
  various collecting entities
 Updated web-accessible raw data sources such as USGS
  NWIS, EPA STORET and state environmental agencies,
  many current through day of download
 Surface-water discharges, ground-water elevations, and
  water-quality data (daily and instantaneous)
Data Complexity: Making Sense of it All
Compilation Methods and Tools
 Data pre-processing scripts stage raw data for loading (e.g.,
  separate source files with site/sample/result/parameter tables)
 Loaders query data from staged source files
   • Facilitate maintenance and updates
   • Document how table fields were mapped from source files to final compiled
      geodatabase

 Methods scalable for a variety of hydrologic studies (data types,
  data size)
   • 24 distinct data sources
   • Of those, 10 are pre-existing compilations or raw data aggregation efforts
      such as EPA STORET which contain data from one or more collecting
      entities
Data Pre-Processing Scripts
 Import and format data from raw downloaded files into one
  “staged” relational database per source
 Scripts help clean data to ensure data integrity
   •   Remove extraneous non-printable characters
   •   Remove extra spaces
   •   Date formatting (MM/DD/YYYY)
   •   Separate multiple data types from one field (e.g., result values with
       comments) into separate fields

 Repeatable script programs (VBScript, VBA) with code
  comments as documentation help ensure data consistency
  and reduce human error
Data Compilation Loaders

   Load data into compilation database from source “staged”
    databases
   Cross-walks source file table fields with compilation table
    fields
   Functions as process documentation; customizable for
    each source
   Repeatable and consistent – helps reduce human error
Data Management Challenges:
           The Devil is in the Details
 Source compilation relational databases – database design
  and data integrity issues
 Site identification (Site ID’s): different ID’s & names for the
  same physical location on the ground
 Duplicate data
 Data recovery efforts and methods used
 Null values vs. zero; result value rounding
 Little or no metadata in most cases
Direct Benefits to Researchers

                      Multiple agencies’ data
                       managed in one location
                      Record-level metadata to
Relevant Data Only     document collecting agencies
                       and data sources (not always
                       the same)
                      One comprehensive relational
                       geodatabase as opposed to
                       scattered records stored as flat
                       files in spreadsheets
Direct Benefits to Researchers (cont.)
 Data can be limited to
  just relevant
  parameters/sites using
  traditional database
  queries via Structured
  Query Language (SQL)
  and/or spatial selections
  in a GIS
 Data enhanced for map
  production and spatial
  and temporal analysis
Summary
   Usability of source data greatly enhanced
   Facilitates identification of data gaps – spatial,
    temporal, and thematic
   Multitude of data stored in a well-documented format
    that can be readily updated
   Sound data management helps support sound science
    – quality information can only be derived from quality
    data
Questions?
                      Thomas E. Burley
                 Texas Water Science Center
                   U.S. Geological Survey
                     teburley@usgs.gov

Associated Publication:
Burley, T.E., 2010, Usage and administration manual for a geodatabase compendium of
   water-resources data—Rio Grande Basin from the Rio Arriba-Sandoval County line,
   New Mexico, to Presidio, Texas, 1889–2009: U.S. Geological Survey Open-File
   Report 2010–1331, 62 p. Available from http://pubs.usgs.gov/of/2010/1331/

Contenu connexe

Similaire à Building a water resources geodatabase for the rio grande basin

2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)
Rudolf Husar
 
Alive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values StudyAlive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values Study
CESSDA Training
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax
cmspinto
 
Relational database revised
Relational database revisedRelational database revised
Relational database revised
mnodalo
 

Similaire à Building a water resources geodatabase for the rio grande basin (20)

2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)
 
Srds Pres011120
Srds Pres011120Srds Pres011120
Srds Pres011120
 
Database Management Systems - Management Information System
Database Management Systems - Management Information SystemDatabase Management Systems - Management Information System
Database Management Systems - Management Information System
 
Dats nih-dccpc-kc7-april2018-prs-uoxf
Dats  nih-dccpc-kc7-april2018-prs-uoxfDats  nih-dccpc-kc7-april2018-prs-uoxf
Dats nih-dccpc-kc7-april2018-prs-uoxf
 
Brislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evsBrislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evs
 
Alive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values StudyAlive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values Study
 
Dbms9
Dbms9Dbms9
Dbms9
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax
 
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing SystemsTYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
 
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRISCombining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
 
GPS to GIS Emergency Mapping
GPS to GIS Emergency MappingGPS to GIS Emergency Mapping
GPS to GIS Emergency Mapping
 
Data base
Data baseData base
Data base
 
Relational database revised
Relational database revisedRelational database revised
Relational database revised
 
A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...
 
FINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptxFINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptx
 
Geographic information systems (gis) for libraries
Geographic information systems (gis) for librariesGeographic information systems (gis) for libraries
Geographic information systems (gis) for libraries
 
6.2 software
6.2 software6.2 software
6.2 software
 
EcoInformatics FRS Presentation - Discussion 20101206
EcoInformatics FRS Presentation - Discussion 20101206EcoInformatics FRS Presentation - Discussion 20101206
EcoInformatics FRS Presentation - Discussion 20101206
 
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and ApplicationsSemantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
 

Plus de Texas Natural Resources Information System

From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...
Texas Natural Resources Information System
 

Plus de Texas Natural Resources Information System (20)

Txgio presentation rgsm_gps_pearson_062012
Txgio presentation rgsm_gps_pearson_062012Txgio presentation rgsm_gps_pearson_062012
Txgio presentation rgsm_gps_pearson_062012
 
Usslsc cgsic regional austin 061312
Usslsc cgsic regional austin 061312Usslsc cgsic regional austin 061312
Usslsc cgsic regional austin 061312
 
Using gps technology at the texas general land
Using gps technology at the texas general landUsing gps technology at the texas general land
Using gps technology at the texas general land
 
Ussls austin civil utility - klein - 061312 - final
Ussls austin   civil utility - klein - 061312 - finalUssls austin   civil utility - klein - 061312 - final
Ussls austin civil utility - klein - 061312 - final
 
Tx dot gps applications fuegner
Tx dot gps applications   fuegnerTx dot gps applications   fuegner
Tx dot gps applications fuegner
 
Tnris 2012
Tnris 2012Tnris 2012
Tnris 2012
 
Nmc ussls charter 2012
Nmc ussls charter 2012Nmc ussls charter 2012
Nmc ussls charter 2012
 
Nationwide dgps (ndgps) lt mendoza
Nationwide dgps (ndgps)   lt mendozaNationwide dgps (ndgps)   lt mendoza
Nationwide dgps (ndgps) lt mendoza
 
Lyle tamucc 2
Lyle tamucc 2Lyle tamucc 2
Lyle tamucc 2
 
Dirks cgsic brief 2012
Dirks cgsic brief 2012Dirks cgsic brief 2012
Dirks cgsic brief 2012
 
Connected vehicle highway network applications
Connected vehicle highway network applicationsConnected vehicle highway network applications
Connected vehicle highway network applications
 
Cgsic presentation humphreys
Cgsic presentation humphreysCgsic presentation humphreys
Cgsic presentation humphreys
 
Cgsic navcen
Cgsic navcenCgsic navcen
Cgsic navcen
 
Gnss international policy regional cgsic (austin - jun2012)
Gnss international policy   regional cgsic (austin - jun2012)Gnss international policy   regional cgsic (austin - jun2012)
Gnss international policy regional cgsic (austin - jun2012)
 
From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...
 
Early warning forecast of an oil spill bp deepwater horizon in the gulf
Early warning forecast of an oil spill bp deepwater horizon in the gulfEarly warning forecast of an oil spill bp deepwater horizon in the gulf
Early warning forecast of an oil spill bp deepwater horizon in the gulf
 
We are the music makers and we are the dreamers of dreams
We are the music makers and we are the dreamers of dreamsWe are the music makers and we are the dreamers of dreams
We are the music makers and we are the dreamers of dreams
 
Volunteered geographic information (vgi) for the national map
Volunteered geographic information (vgi) for the national mapVolunteered geographic information (vgi) for the national map
Volunteered geographic information (vgi) for the national map
 
Uav image recognition technology and applications
Uav image recognition technology and applicationsUav image recognition technology and applications
Uav image recognition technology and applications
 
Texas high water marks crowd sourcing history, culture, and geography
Texas high water marks   crowd sourcing history, culture, and geographyTexas high water marks   crowd sourcing history, culture, and geography
Texas high water marks crowd sourcing history, culture, and geography
 

Dernier

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Dernier (20)

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 

Building a water resources geodatabase for the rio grande basin

  • 1. In Cooperation with the New Mexico Interstate Stream Commission (NMISC) Building a Water-Resources Geodatabase for the Rio Grande Basin – San Acacia, New Mexico to Fort Quitman, Texas Thomas E. Burley, GISP USGS Texas Water Science Center – Austin, TX 2011 Texas GIS Forum – Austin, TX U.S. Department of the Interior U.S. Geological Survey
  • 2. Overview – Need and Significance  Data collected for middle Rio Grande Basin for variety of purposes over several decades by numerous agencies, researchers, and organizations  Previous attempts to compile these data have not been complete or done in a way that could be repeated  A well-organized and usable database is needed to identify management priorities and facilitate hydrologic studies
  • 3. Hydrologic Geodatabase Overview  Data organized into a comprehensive spatially- enabled relational database (geodatabase)  Stores spatial and tabular data for area of interest from multiple sources  Data can be queried and/or viewed spatially to assist in identifying data gaps, conduct spatial analysis, and support decision-making
  • 4. Rio Grande Basin – San Acacia, New Mexico to Fort Quitman, Texas  Surface-water catchments encompass approximate extents of underlying aquifers of interest  Surface-water catchments used to geographically filter physical sites and associated data from sources with larger spatial delivery extents
  • 5. Data Sources and Types  Hard-copy reports, previous data compilations, and various collecting entities  Updated web-accessible raw data sources such as USGS NWIS, EPA STORET and state environmental agencies, many current through day of download  Surface-water discharges, ground-water elevations, and water-quality data (daily and instantaneous)
  • 6. Data Complexity: Making Sense of it All
  • 7. Compilation Methods and Tools  Data pre-processing scripts stage raw data for loading (e.g., separate source files with site/sample/result/parameter tables)  Loaders query data from staged source files • Facilitate maintenance and updates • Document how table fields were mapped from source files to final compiled geodatabase  Methods scalable for a variety of hydrologic studies (data types, data size) • 24 distinct data sources • Of those, 10 are pre-existing compilations or raw data aggregation efforts such as EPA STORET which contain data from one or more collecting entities
  • 8. Data Pre-Processing Scripts  Import and format data from raw downloaded files into one “staged” relational database per source  Scripts help clean data to ensure data integrity • Remove extraneous non-printable characters • Remove extra spaces • Date formatting (MM/DD/YYYY) • Separate multiple data types from one field (e.g., result values with comments) into separate fields  Repeatable script programs (VBScript, VBA) with code comments as documentation help ensure data consistency and reduce human error
  • 9. Data Compilation Loaders  Load data into compilation database from source “staged” databases  Cross-walks source file table fields with compilation table fields  Functions as process documentation; customizable for each source  Repeatable and consistent – helps reduce human error
  • 10. Data Management Challenges: The Devil is in the Details  Source compilation relational databases – database design and data integrity issues  Site identification (Site ID’s): different ID’s & names for the same physical location on the ground  Duplicate data  Data recovery efforts and methods used  Null values vs. zero; result value rounding  Little or no metadata in most cases
  • 11. Direct Benefits to Researchers  Multiple agencies’ data managed in one location  Record-level metadata to Relevant Data Only document collecting agencies and data sources (not always the same)  One comprehensive relational geodatabase as opposed to scattered records stored as flat files in spreadsheets
  • 12. Direct Benefits to Researchers (cont.)  Data can be limited to just relevant parameters/sites using traditional database queries via Structured Query Language (SQL) and/or spatial selections in a GIS  Data enhanced for map production and spatial and temporal analysis
  • 13. Summary  Usability of source data greatly enhanced  Facilitates identification of data gaps – spatial, temporal, and thematic  Multitude of data stored in a well-documented format that can be readily updated  Sound data management helps support sound science – quality information can only be derived from quality data
  • 14. Questions? Thomas E. Burley Texas Water Science Center U.S. Geological Survey teburley@usgs.gov Associated Publication: Burley, T.E., 2010, Usage and administration manual for a geodatabase compendium of water-resources data—Rio Grande Basin from the Rio Arriba-Sandoval County line, New Mexico, to Presidio, Texas, 1889–2009: U.S. Geological Survey Open-File Report 2010–1331, 62 p. Available from http://pubs.usgs.gov/of/2010/1331/