SlideShare une entreprise Scribd logo
1  sur  12
CONNECT. TRANSFORM. AUTOMATE.
Illuminating the World:
Generating Night Scenes with FME
Joanna Hobbins
GIS Analyst - CAE
Who we are
CONNECT. TRANSFORM. AUTOMATE.
A world leader in providing simulation and modelling
technologies and integrated training solutions
// DEFENCE
& SECURITY
// CIVIL // HEALTHCARE
// MINING
CAE at a glance
CONNECT. TRANSFORM. AUTOMATE.
 Founded in Canada in 1947
 Annual revenues of $2.1B
 Approx. 8,000 employees
 65+ years of breakthrough innovation
 Largest installed base of flight simulators globally
 100,000 pilots and crewmembers trained annually
The Goal
 To produce realistic
night scenes for the
CAE TroposTM-6000XR
visual image generator
for civil aviation
training
CONNECT. TRANSFORM. AUTOMATE.
The Challenges
 Global dataset
 69,170 land-based 1-degree tiles
 57.8GB of vector data as input
 More than 35,000,000 road segments
 55201 illumination zones
 Automatic generation and validation
 6 week timeframe
CONNECT. TRANSFORM. AUTOMATE.
The Old Process
 VMAP0 (1:1M scale) built up areas populated with
road textures and light points randomly scattered
inside polygons
 Higher resolution insets created by tracing
imagery in Photoshop and running scripts on the
paths
 Over 8 hours of manual work per 1-degree tile
CONNECT. TRANSFORM. AUTOMATE.
The New Process
 Use publicly available geospatial data
 Roads
 Open Street Maps
 Illumination zones
 Derived from DMSP-OLS Nighttime Lights 2012
CONNECT. TRANSFORM. AUTOMATE.
Before and After
CONNECT. TRANSFORM. AUTOMATE.
Basic Workflow
Clip roads to
illumination
zones
Populate points
along roads
Convert to
raster
Process raster
with
ImageMagick
Restore
georeferencing
Combine Tiles
CONNECT. TRANSFORM. AUTOMATE.
Tips and techniques
 ImageMagick http://www.imagemagick.org/
 Command line software for image editing
 Useful for focal analysis tools not available in FME
CONNECT. TRANSFORM. AUTOMATE.
Tips and techniques 2
 Combining workspace runner and custom
transformer
 Run multiple child workspaces at the same time
but all workspaces completed before continuing to
process
CONNECT. TRANSFORM. AUTOMATE.
Thank You!
 Questions?
 For more information:
 Joanna Hobbins joanna.hobbins@cae.com
 CAE
 http://www.cae.com/
CONNECT. TRANSFORM. AUTOMATE.

Contenu connexe

Similaire à Illuminating the World: Generating Night Scenes with FME (Lightning Talk)

4A_ 3_Parallel k-means clustering using gp_us for the geocomputation of real-...
4A_ 3_Parallel k-means clustering using gp_us for the geocomputation of real-...4A_ 3_Parallel k-means clustering using gp_us for the geocomputation of real-...
4A_ 3_Parallel k-means clustering using gp_us for the geocomputation of real-...
GISRUK conference
 

Similaire à Illuminating the World: Generating Night Scenes with FME (Lightning Talk) (20)

AI and Space: finally, no more arguing with the GPS
AI and Space: finally, no more arguing with the GPSAI and Space: finally, no more arguing with the GPS
AI and Space: finally, no more arguing with the GPS
 
Airfare prediction using Machine Learning with Apache Spark on 1 billion obse...
Airfare prediction using Machine Learning with Apache Spark on 1 billion obse...Airfare prediction using Machine Learning with Apache Spark on 1 billion obse...
Airfare prediction using Machine Learning with Apache Spark on 1 billion obse...
 
2006 mine integration plan
2006 mine integration plan2006 mine integration plan
2006 mine integration plan
 
3 D Visual Avis Project
3 D Visual Avis Project3 D Visual Avis Project
3 D Visual Avis Project
 
2006 mine integration plan
2006 mine integration plan2006 mine integration plan
2006 mine integration plan
 
Use FME To Efficiently Create National-Scale Vector Contours From High-Resolu...
Use FME To Efficiently Create National-Scale Vector Contours From High-Resolu...Use FME To Efficiently Create National-Scale Vector Contours From High-Resolu...
Use FME To Efficiently Create National-Scale Vector Contours From High-Resolu...
 
Intelligent Energy Systems
Intelligent Energy SystemsIntelligent Energy Systems
Intelligent Energy Systems
 
General Aviation and NextGen
General Aviation and NextGenGeneral Aviation and NextGen
General Aviation and NextGen
 
Carving the Perfect Engineer (EWME'16, 11may16)
Carving the Perfect Engineer (EWME'16, 11may16)Carving the Perfect Engineer (EWME'16, 11may16)
Carving the Perfect Engineer (EWME'16, 11may16)
 
GWT 2014: Emergency Conference - 01 Introduzione
GWT 2014: Emergency Conference - 01 IntroduzioneGWT 2014: Emergency Conference - 01 Introduzione
GWT 2014: Emergency Conference - 01 Introduzione
 
Benevolent machine learning and ai
Benevolent machine learning and aiBenevolent machine learning and ai
Benevolent machine learning and ai
 
FME Around the World
FME Around the WorldFME Around the World
FME Around the World
 
Aphelion Orbitals November 2018 pitch deck
Aphelion Orbitals November 2018 pitch deckAphelion Orbitals November 2018 pitch deck
Aphelion Orbitals November 2018 pitch deck
 
El nuevo superordenador Mare Nostrum y el futuro procesador europeo
El nuevo superordenador Mare Nostrum y el futuro procesador europeoEl nuevo superordenador Mare Nostrum y el futuro procesador europeo
El nuevo superordenador Mare Nostrum y el futuro procesador europeo
 
4A_ 3_Parallel k-means clustering using gp_us for the geocomputation of real-...
4A_ 3_Parallel k-means clustering using gp_us for the geocomputation of real-...4A_ 3_Parallel k-means clustering using gp_us for the geocomputation of real-...
4A_ 3_Parallel k-means clustering using gp_us for the geocomputation of real-...
 
Convolutional Neural Network for pixel-wise skyline detection
Convolutional Neural Network for pixel-wise skyline detectionConvolutional Neural Network for pixel-wise skyline detection
Convolutional Neural Network for pixel-wise skyline detection
 
Bpr Media Broadcast
Bpr Media BroadcastBpr Media Broadcast
Bpr Media Broadcast
 
MAXSS & NVIDIA
MAXSS & NVIDIAMAXSS & NVIDIA
MAXSS & NVIDIA
 
AI in Aerospace
AI in AerospaceAI in Aerospace
AI in Aerospace
 
NASA's Space Exploration, Open Innovation, and the Future of Work
NASA's Space Exploration, Open Innovation, and the Future of WorkNASA's Space Exploration, Open Innovation, and the Future of Work
NASA's Space Exploration, Open Innovation, and the Future of Work
 

Plus de Safe Software

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
Safe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
Safe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software
 

Plus de Safe Software (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 

Dernier

Dernier (20)

presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 

Illuminating the World: Generating Night Scenes with FME (Lightning Talk)

  • 1. CONNECT. TRANSFORM. AUTOMATE. Illuminating the World: Generating Night Scenes with FME Joanna Hobbins GIS Analyst - CAE
  • 2. Who we are CONNECT. TRANSFORM. AUTOMATE. A world leader in providing simulation and modelling technologies and integrated training solutions // DEFENCE & SECURITY // CIVIL // HEALTHCARE // MINING
  • 3. CAE at a glance CONNECT. TRANSFORM. AUTOMATE.  Founded in Canada in 1947  Annual revenues of $2.1B  Approx. 8,000 employees  65+ years of breakthrough innovation  Largest installed base of flight simulators globally  100,000 pilots and crewmembers trained annually
  • 4. The Goal  To produce realistic night scenes for the CAE TroposTM-6000XR visual image generator for civil aviation training CONNECT. TRANSFORM. AUTOMATE.
  • 5. The Challenges  Global dataset  69,170 land-based 1-degree tiles  57.8GB of vector data as input  More than 35,000,000 road segments  55201 illumination zones  Automatic generation and validation  6 week timeframe CONNECT. TRANSFORM. AUTOMATE.
  • 6. The Old Process  VMAP0 (1:1M scale) built up areas populated with road textures and light points randomly scattered inside polygons  Higher resolution insets created by tracing imagery in Photoshop and running scripts on the paths  Over 8 hours of manual work per 1-degree tile CONNECT. TRANSFORM. AUTOMATE.
  • 7. The New Process  Use publicly available geospatial data  Roads  Open Street Maps  Illumination zones  Derived from DMSP-OLS Nighttime Lights 2012 CONNECT. TRANSFORM. AUTOMATE.
  • 8. Before and After CONNECT. TRANSFORM. AUTOMATE.
  • 9. Basic Workflow Clip roads to illumination zones Populate points along roads Convert to raster Process raster with ImageMagick Restore georeferencing Combine Tiles CONNECT. TRANSFORM. AUTOMATE.
  • 10. Tips and techniques  ImageMagick http://www.imagemagick.org/  Command line software for image editing  Useful for focal analysis tools not available in FME CONNECT. TRANSFORM. AUTOMATE.
  • 11. Tips and techniques 2  Combining workspace runner and custom transformer  Run multiple child workspaces at the same time but all workspaces completed before continuing to process CONNECT. TRANSFORM. AUTOMATE.
  • 12. Thank You!  Questions?  For more information:  Joanna Hobbins joanna.hobbins@cae.com  CAE  http://www.cae.com/ CONNECT. TRANSFORM. AUTOMATE.