SlideShare une entreprise Scribd logo
1  sur  20
Use of FME Workbench in Edmonton’s
Open Data Catalogue

Bohdan Hrynyshyn
City of Edmonton
IT Business Analyst, Open Data Team

                                      Edmonton, Alberta - April 12, 2013
What is Open Data?
 Certain data to be freely available for everyone to use and
 republish as they wish, without restrictions or control

Rationale
 Data generated or collected by public organizations belong to
  taxpayers, and where releasing it will not violate any laws or
  rights to privacy

 Component of Open Government
    Building and maintaining relationships between
     government and citizens by sharing ideas and information
Why Open Data?


Make Local Government More ….
    Open
    Accountable
    Accessible
Open Government …..

 Encourage a Constant Exchange of Ideas




 Want Government to make better decisions for all of us
Openness ……..

 Laws and Decisions Open for Discussion
 Collaboration in policy-making, policy
  implementation, and policy enforcement
Accessibility ……..
 Budgets may be reviewed by anyone
 Government does not have all the answers – participation
  through various communication tools
 Public mayhave necessary knowledge and experience to
  deal with issues
 Economic opportunities by turning data into apps, web-sites
  or other useful products
Accountability ……
 Public Officials are Accountable
 Government meetings are open to everyone
 Civic engagement, stakeholder groups collaboration,
  collaborative public management, and dispute resolution
  with citizens and stakeholders have answerability
Why Open Data Edmonton?
    make accessible, data about Edmonton’s municipal services to Edmonton's
     citizens, media, and public


    Why Are We Doing This?
    City committed to better manage business information
    Provide easy access to public Data Assets
    Improve accessibility, transparency and accountability for City Of Edmonton data
    Increase engagement of citizens, community organizations and private businesses
     in creative community problem solving and development of innovative services,
     applications and solutions
    Promote ‘One City’ concept - one location for all city data
    Integrate data from various discrete data-sets to provide more value and
     intelligence
About Edmonton’s Open Data
 The City of Edmonton - dedicated to using technology to make municipal information
 more open, transparent and accessible.


History
Open Data Principles ……

 1. Complete
     Data not subject to privacy, legislative, security or privilege limitations

 2. Primary
     Data collected at source
     Granularity at lowest level possible
     not in aggregate or modified form

 3. Timely
     Data is current and relevant

 4. Accessible
     to wide range of users
     for many different purposes
Open Data Principles ……

  5. Machine processable
      Data structured for automated processing

  6. Non-discriminatory Access
      Data available to anyone, with no requirements

  7. Non-Proprietary Format
      Data available in format no entity has exclusive control

  8. Data license-free
      Data not subject to any copyright, patent, trademark or
       regulations
Open Data Infrastructure
Why Use FME?

 Transform (restructure, reformat, and integrate)
  spatial and non-spatial data into proper format
  and structure for loading into Socrata’s Open
  Data Catalogue

 Add spatial components to non-spatial data so it
  can be readily visualized on a map in Socrata’s
  Open Data Catalogue
How to publish Open Data Cycle

 Choose Data for Release
 Prepare data extract in Open Format (csv, xls,
  shp)
 Create Open Data page on Catalogue
 Create Meta Data for dataset
 Make Dataset public
FME Transformers

   AttributeKeeper
   AttributeRenamer
   CoordinateExtractor
   NullAttributeReplacer
   Reprojector
   Sorter
   StringConcatenator
   StringSearcher
   Tester
Trees
List of all trees owned and maintained by the City of Edmonton

https://data.edmonton.ca/Environmental-Services/Trees-Species-Map-View-/cggb-hzzm



                                                                                    •extract data from SLIM (Oracle)
                                                                                    • format and filter in FME
                                                                                    • output as csv file
City Properties for Sale
List of all City-owned properties for sale
https://data.edmonton.ca/City-Administration/City-of-Edmonton-s-Properties-for-Sale/yutc-c5ju




                                                                                 • extract view data from SLIM (Oracle) and POSSE
                                                                                 • format and filter in FME
                                                                                 • output as csv file
City of Edmonton/NAIT Solar Panel Reference System -
Daily Power Production
Daily production of electrical power from solar panels located at NAIT

https://data.edmonton.ca/Environmental-Services/City-of-Edmonton-NAIT-Solar-Panel-Reference-System/ysgw-us2d




                                                                         •assemble “scraped” data for each panel
                                                                         from vendor using FME
                                                                         • format and consolidate each panel
                                                                         • output as csv file
Portable Signs
List of all licensed portable signs in the City

https://data.edmonton.ca/Sustainable-Development/Temporary-Signs-Map/xt3a-rjpj



                                                                         •extract data from POSSE Data Warehouse
                                                                         • format and filter in FME
                                                                         • output as csv file
Thank You!

 Questions?

 For more information:
   Bohdan Hrynyshyn – City of Edmonton, IT Branch

   bohdan.hrynyshyn@edmonton.ca

   opendata@edmonton.ca

Contenu connexe

Plus de Safe Software

Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISSafe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriSafe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfSafe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologySafe Software
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersSafe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsSafe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategySafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Safe Software
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMESafe Software
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Safe Software
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Safe Software
 
Bringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleBringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleSafe Software
 
Democratizing Transformer Creation in FME
Democratizing Transformer Creation in FMEDemocratizing Transformer Creation in FME
Democratizing Transformer Creation in FMESafe Software
 
Working Forward: From Data to Location Intelligence for Renewables Siting and...
Working Forward: From Data to Location Intelligence for Renewables Siting and...Working Forward: From Data to Location Intelligence for Renewables Siting and...
Working Forward: From Data to Location Intelligence for Renewables Siting and...Safe Software
 

Plus de Safe Software (20)

Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FME
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework
 
Bringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleBringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) People
 
Democratizing Transformer Creation in FME
Democratizing Transformer Creation in FMEDemocratizing Transformer Creation in FME
Democratizing Transformer Creation in FME
 
Working Forward: From Data to Location Intelligence for Renewables Siting and...
Working Forward: From Data to Location Intelligence for Renewables Siting and...Working Forward: From Data to Location Intelligence for Renewables Siting and...
Working Forward: From Data to Location Intelligence for Renewables Siting and...
 

Dernier

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfOverkill Security
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusZilliz
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...apidays
 

Dernier (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 

Using FME to Create Open Data Datasets

  • 1. Use of FME Workbench in Edmonton’s Open Data Catalogue Bohdan Hrynyshyn City of Edmonton IT Business Analyst, Open Data Team Edmonton, Alberta - April 12, 2013
  • 2. What is Open Data? Certain data to be freely available for everyone to use and republish as they wish, without restrictions or control Rationale  Data generated or collected by public organizations belong to taxpayers, and where releasing it will not violate any laws or rights to privacy  Component of Open Government  Building and maintaining relationships between government and citizens by sharing ideas and information
  • 3. Why Open Data? Make Local Government More ….  Open  Accountable  Accessible
  • 4. Open Government …..  Encourage a Constant Exchange of Ideas Want Government to make better decisions for all of us
  • 5. Openness ……..  Laws and Decisions Open for Discussion  Collaboration in policy-making, policy implementation, and policy enforcement
  • 6. Accessibility ……..  Budgets may be reviewed by anyone  Government does not have all the answers – participation through various communication tools  Public mayhave necessary knowledge and experience to deal with issues  Economic opportunities by turning data into apps, web-sites or other useful products
  • 7. Accountability ……  Public Officials are Accountable  Government meetings are open to everyone  Civic engagement, stakeholder groups collaboration, collaborative public management, and dispute resolution with citizens and stakeholders have answerability
  • 8. Why Open Data Edmonton?  make accessible, data about Edmonton’s municipal services to Edmonton's citizens, media, and public Why Are We Doing This?  City committed to better manage business information  Provide easy access to public Data Assets  Improve accessibility, transparency and accountability for City Of Edmonton data  Increase engagement of citizens, community organizations and private businesses in creative community problem solving and development of innovative services, applications and solutions  Promote ‘One City’ concept - one location for all city data  Integrate data from various discrete data-sets to provide more value and intelligence
  • 9. About Edmonton’s Open Data The City of Edmonton - dedicated to using technology to make municipal information more open, transparent and accessible. History
  • 10. Open Data Principles ……  1. Complete  Data not subject to privacy, legislative, security or privilege limitations  2. Primary  Data collected at source  Granularity at lowest level possible  not in aggregate or modified form  3. Timely  Data is current and relevant  4. Accessible  to wide range of users  for many different purposes
  • 11. Open Data Principles ……  5. Machine processable  Data structured for automated processing  6. Non-discriminatory Access  Data available to anyone, with no requirements  7. Non-Proprietary Format  Data available in format no entity has exclusive control  8. Data license-free  Data not subject to any copyright, patent, trademark or regulations
  • 13. Why Use FME?  Transform (restructure, reformat, and integrate) spatial and non-spatial data into proper format and structure for loading into Socrata’s Open Data Catalogue  Add spatial components to non-spatial data so it can be readily visualized on a map in Socrata’s Open Data Catalogue
  • 14. How to publish Open Data Cycle  Choose Data for Release  Prepare data extract in Open Format (csv, xls, shp)  Create Open Data page on Catalogue  Create Meta Data for dataset  Make Dataset public
  • 15. FME Transformers  AttributeKeeper  AttributeRenamer  CoordinateExtractor  NullAttributeReplacer  Reprojector  Sorter  StringConcatenator  StringSearcher  Tester
  • 16. Trees List of all trees owned and maintained by the City of Edmonton https://data.edmonton.ca/Environmental-Services/Trees-Species-Map-View-/cggb-hzzm •extract data from SLIM (Oracle) • format and filter in FME • output as csv file
  • 17. City Properties for Sale List of all City-owned properties for sale https://data.edmonton.ca/City-Administration/City-of-Edmonton-s-Properties-for-Sale/yutc-c5ju • extract view data from SLIM (Oracle) and POSSE • format and filter in FME • output as csv file
  • 18. City of Edmonton/NAIT Solar Panel Reference System - Daily Power Production Daily production of electrical power from solar panels located at NAIT https://data.edmonton.ca/Environmental-Services/City-of-Edmonton-NAIT-Solar-Panel-Reference-System/ysgw-us2d •assemble “scraped” data for each panel from vendor using FME • format and consolidate each panel • output as csv file
  • 19. Portable Signs List of all licensed portable signs in the City https://data.edmonton.ca/Sustainable-Development/Temporary-Signs-Map/xt3a-rjpj •extract data from POSSE Data Warehouse • format and filter in FME • output as csv file
  • 20. Thank You!  Questions?  For more information:  Bohdan Hrynyshyn – City of Edmonton, IT Branch  bohdan.hrynyshyn@edmonton.ca  opendata@edmonton.ca