SlideShare une entreprise Scribd logo
1  sur  24
Télécharger pour lire hors ligne
Encontro de Usuários 2017
Casos de uso do FME no IBGE
Renan de Alcantara Soares
The Brazilian Institute of Geography and Statistics (IBGE) is the main provider of data
and information in Brazil, which responds to the needs of the most diverse segments of
civil society, as well as federal, state and municipal government bodies.
IBGE offers a complete and current view of the Country through the performance of its
main functions:
 Production and analysis of statistical information
 Coordination and consolidation of statistical information
 Production and analysis of geographical information
 Coordination and consolidation of geographical information
 Documentation and dissemination of information
 Coordination of statistical and cartographic systems
Coordenação de Cartografia
Coordination of Cartography
The Coordination of Cartography is responsible for planning, organizing,
coordinating, supervising and executing the cartographic works, aiming at the
production of maps, as well as other documents of a cartographic nature,
necessary for the representation of the Brazilian territorial space "(Portaria nº
215, 12/08/2004 - Art. 60.) "
Interoperability of data from many
sources
Coordenação de Cartografia
Coordination of Cartography
CCAR
Vetorial cartographic base
production of all national territory
1:1.000.000
1:250.000
1:100.000 (in progress)
1:25.000 (RJ)
(Coordination of
Cartography main use)
EDGV
(Structure of Vector Geospatial Data)
Standarize
Topological Rules
Identify
Fix
Equipe
Team
Renan de Alcantara Soares
 Cartographic and Surveyor Engineer - Federal University of Viçosa
(UFV)
Rafael Damiati Ferreira
 Geographer – São Paulo State University (UNESP)
 Master in Remote Sensing – Brazilian National Institute for Space
Research (INPE)
Ludolf da Mota Silva
 Cartographic Engineer - Rio de Janeiro State University (UERJ)
All with advanced knowledge in GIS, but had never used FME before,
learning it by job needs and investigative curiosity.
Casos
Cases #1
The vetorial cartographic continuous bases of Brazil, has as main
applications and products the planning and management of government
programs with a territorial approach; The analyzes that demand an overall
view (country, region and states); The elaboration of maps in smaller scales
(Brazilian, regional, state and Atlas series maps) and representations of
thematic aspects of the territory (statistics, natural resources and
environmental research).
Its modeling is implemented according to the Technical Specifications for
Vector Geospatial Data Structuring (ET-EDGV). In relation to the geodesic
and cartographic spatial references, the Base follows the current norm,
using the SIRGAS 2000 reference system, with a geographic coordinate
system.
The data are available in free format (shapefile, geopackeg and dump from
the PostGIS database) for use in Geographic Information Systems, and it is
compatible with different softwares.
Casos
Cases #1
Vetorial cartographic base of 1:1000000Vetorial cartographic base of 1:250000Vetorial cartographic base of 1:100000Vetorial cartographic base of 1:25000
Casos
Cases #1
And of course, on such a large base, errors may occur during vector
acquisition.
Like, overlap of two features that should not, Intersessions without break,
gap between adjacent polygons.
Problems that require time, resources and expertise available to apply the
correct fixes, and still, can be subject to human errors.
The flows created in the FME to the Vector Base, in several scales, aimed
at a quick identification and correction, with the minimum of human vector
editing.
Casos
Cases #1
A few examples: Poligons (Must not Overlap)Line (Fixes the flow (direction) of the rivers to fit the downstream direction)Point (Correction in many features simultaneously)Checks the contours and identifies discontinuities, missing curves or wrong
values, also identifies incoherent points between two curves
Casos
Cases #2
The Brazilian topographic mapping carried out
between the 1970s and 1980s, whose purpose
was to represent the Brazilian territorial space, in
a systematic way, through a series of general,
continuous, homogeneous and articulated maps,
elaborated selectively and progressively, at the
standard scales of 1:1000000, 1:250000,
1:100000, 1:50000 and 1:25000.
Casos
Cases #2
Scale 1:25000Scale 1:50000Scale
1:100000
Scale
1:250000
Scale
1:1000000
Casos
Cases #2
In January 1991, plans were started for the
conversion of topographic sheets to CAD, which
took time for the scanning and the vectorization, a
project that took a lot of time during the 1990s.
Some of the regions of this systematic mapping
have never been revisited, being this unique data
for some local names, settlements, rivers and
mountains. What motivated the idea of​ updating
this data to the shapefile format.
Casos
Cases #2
The first problem encountered was the Datum, there were at least 8, all
digitized in DGN with units in kilometers. None of them recognized by FME.
Casos
Cases #2
TransportHydrographyBuildingsBatch
Reads a folder, where 26504
files are stored in DGN
extension
Organizes for each line the
various output addresses for
each scale and mapped region.
Distributes feature classes
correctly for processing
It calls the workspaces's that
convert dgn to shp, each line
represents a class of feature
(Transport, Hydrography,
Hypsometry, Buildings,
Metadata, etc ...). The input data
is iterative until it is able to make
all such dgns in the folder
(including subfolders) and prints
according to the specified folder
organization.
Casos
Cases #2
Organization of the results folder
 Scale
 Producer of the data
 Topographic Map
 Metodology (also contains Metadata and Grid)
 Feature Class
 Shapefiles
Casos
Cases #2
Results
Casos
Cases #3
The Ibge has more than 50TB of raster images, for the Rapid-Eye images,
which are being used in the production of the new vectorial cartographic
base of 1: 100000 are 3 collections of Rapid-Eye covers from Brazil (5
meters). To correct or confirm the accuracy of these images, IBGE has a
database for Ground Control Points (GCP), which has at least 15,5
thousand points spread throughout the Country.
Still, some Rapid-Eye coverage scenes may not have control points on it, or
not enough points for an adequate analysis of their accuracy.
The technical team responsible for image processing opted to evaluate the
positional quality of Rapid-Eye images comparing them with OrtoPhotos of
greater precision. For that, Erdas AutoSync was used to compare two or
more images, from search windows to determine the similar features and
obtain the coordinates of these similar features, generating a report of the
results found.
Casos
Cases #3
First problem, the report is
generated with coordinates in
geographic system, while the
Rapid-Eye images have
coordinate in UTM (diverse
fuses).
Also the displacement can only
be calculated on the plane.
Casos
Cases #3
Read the report in
txt.
Reads the raster in
GeoTIFF
It plots the report points and
defines it as EPSG: 4326
Extract the coordinate system
information from the raster
Transfers this information for
points and reproject it for the
Raster coordinate system
Do the statistics
This workspace also has a batch caller, which arranges the output folder,
toggles between several input files, and even if you need to stop and continue
on another day it understands which raster has already been processed and
discards them before it starts.
Statistics results (Output file)
Casos
Cases #4
IBGE has a vast historical collection of analog aerial photos stored in Rio de
Janeiro. These photos were the main resources for different cartographic
products published by the institution, mostly consisted of topographic maps at
various scales.
We’ve started the process of digitization and cataloging historical aerial
photographs with approximate georeferencing.
The effort aims to facilitate searching and accessing the historical data and to
preserve paper information once it tends to deteriorate over the time.
This work was presented in:
SBSR - Brazilian Remote Sensing Symposium (2017) – Santos
ICC - International Cartographic Conference (2017) – Washington DC
Casos
Cases #4
Casos
Cases #4
Dúvidas
Questions

Contenu connexe

Tendances

Geographic information system
Geographic information systemGeographic information system
Geographic information systemSumanta Das
 
datamodel_vector
datamodel_vectordatamodel_vector
datamodel_vectorRiya Gupta
 
Geographic information system
Geographic information systemGeographic information system
Geographic information systemOssamaElShanawany
 
TYBSC IT PGIS Unit III Chapter II Data Entry and Preparation
TYBSC IT PGIS Unit III Chapter II Data Entry and PreparationTYBSC IT PGIS Unit III Chapter II Data Entry and Preparation
TYBSC IT PGIS Unit III Chapter II Data Entry and PreparationArti Parab Academics
 
ppt spatial data
ppt spatial datappt spatial data
ppt spatial dataRahul Kumar
 
Vector data model
Vector data model Vector data model
Vector data model Pramoda Raj
 
Lect 9 lab-1 intro to interface
Lect 9 lab-1 intro to interfaceLect 9 lab-1 intro to interface
Lect 9 lab-1 intro to interfaceRehana Jamal
 
Big Data and Geospatial with HPCC Systems
Big Data and Geospatial with HPCC SystemsBig Data and Geospatial with HPCC Systems
Big Data and Geospatial with HPCC SystemsHPCC Systems
 
Exploring Spatial data in GIS Environment
Exploring Spatial data in GIS Environment Exploring Spatial data in GIS Environment
Exploring Spatial data in GIS Environment NAXA-Developers
 
Gis (geographical information system)
Gis (geographical information system)Gis (geographical information system)
Gis (geographical information system)AlfahadFarwa
 
The Application of GIS in Urban Planning
The Application of GIS in Urban PlanningThe Application of GIS in Urban Planning
The Application of GIS in Urban Planningagungwah
 
Vector and Raster Data data model
Vector and Raster Data data modelVector and Raster Data data model
Vector and Raster Data data modelCalcutta University
 
GI2016 ppt shi (big data analytics on the internet)
GI2016 ppt shi (big data analytics on the internet)GI2016 ppt shi (big data analytics on the internet)
GI2016 ppt shi (big data analytics on the internet)IGN Vorstand
 
Data collection and input overview
Data collection and input overviewData collection and input overview
Data collection and input overviewsrinivas2036
 
Raster data model
Raster data modelRaster data model
Raster data modelPramoda Raj
 
Sql server 2008 r2 spatial data whitepaper
Sql server 2008 r2 spatial data whitepaperSql server 2008 r2 spatial data whitepaper
Sql server 2008 r2 spatial data whitepaperKlaudiia Jacome
 

Tendances (20)

Geographic information system
Geographic information systemGeographic information system
Geographic information system
 
Spatial databases
Spatial databasesSpatial databases
Spatial databases
 
datamodel_vector
datamodel_vectordatamodel_vector
datamodel_vector
 
Geographic information system
Geographic information systemGeographic information system
Geographic information system
 
TYBSC IT PGIS Unit III Chapter II Data Entry and Preparation
TYBSC IT PGIS Unit III Chapter II Data Entry and PreparationTYBSC IT PGIS Unit III Chapter II Data Entry and Preparation
TYBSC IT PGIS Unit III Chapter II Data Entry and Preparation
 
ppt spatial data
ppt spatial datappt spatial data
ppt spatial data
 
GIS & Raster
GIS & RasterGIS & Raster
GIS & Raster
 
Gis Concepts 3/5
Gis Concepts 3/5Gis Concepts 3/5
Gis Concepts 3/5
 
Vector data model
Vector data model Vector data model
Vector data model
 
Lect 9 lab-1 intro to interface
Lect 9 lab-1 intro to interfaceLect 9 lab-1 intro to interface
Lect 9 lab-1 intro to interface
 
Big Data and Geospatial with HPCC Systems
Big Data and Geospatial with HPCC SystemsBig Data and Geospatial with HPCC Systems
Big Data and Geospatial with HPCC Systems
 
Exploring Spatial data in GIS Environment
Exploring Spatial data in GIS Environment Exploring Spatial data in GIS Environment
Exploring Spatial data in GIS Environment
 
Gis (geographical information system)
Gis (geographical information system)Gis (geographical information system)
Gis (geographical information system)
 
The Application of GIS in Urban Planning
The Application of GIS in Urban PlanningThe Application of GIS in Urban Planning
The Application of GIS in Urban Planning
 
Vector and Raster Data data model
Vector and Raster Data data modelVector and Raster Data data model
Vector and Raster Data data model
 
GI2016 ppt shi (big data analytics on the internet)
GI2016 ppt shi (big data analytics on the internet)GI2016 ppt shi (big data analytics on the internet)
GI2016 ppt shi (big data analytics on the internet)
 
Data collection and input overview
Data collection and input overviewData collection and input overview
Data collection and input overview
 
Gis concepts
Gis conceptsGis concepts
Gis concepts
 
Raster data model
Raster data modelRaster data model
Raster data model
 
Sql server 2008 r2 spatial data whitepaper
Sql server 2008 r2 spatial data whitepaperSql server 2008 r2 spatial data whitepaper
Sql server 2008 r2 spatial data whitepaper
 

Similaire à Apresentação IBGE

ILWIS 3.0 SUMMARY PRESENTATION
ILWIS 3.0 SUMMARY PRESENTATIONILWIS 3.0 SUMMARY PRESENTATION
ILWIS 3.0 SUMMARY PRESENTATIONmusadoto
 
Getting started with GIS
Getting started with GISGetting started with GIS
Getting started with GISEsri India
 
Introduction to GIS systems
Introduction to GIS systemsIntroduction to GIS systems
Introduction to GIS systemsVivek Srivastava
 
Unit 4 Data Input and Analysis.pptx
Unit 4 Data Input and Analysis.pptxUnit 4 Data Input and Analysis.pptx
Unit 4 Data Input and Analysis.pptxe20ag004
 
What is Geography Information Systems (GIS)
What is Geography Information Systems (GIS)What is Geography Information Systems (GIS)
What is Geography Information Systems (GIS)John Lanser
 
Geographic Information System unit 1
Geographic Information System   unit 1Geographic Information System   unit 1
Geographic Information System unit 1sridevi5983
 
THE NATURE AND SOURCE OF GEOGRAPHIC DATA
THE NATURE AND SOURCE OF GEOGRAPHIC DATATHE NATURE AND SOURCE OF GEOGRAPHIC DATA
THE NATURE AND SOURCE OF GEOGRAPHIC DATANadia Aziz
 
Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
 Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd... Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...hydrologywebsite1
 
Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
 Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd... Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...hydrologyproject001
 
Introduction to gis and arc gis
Introduction to gis and arc gis Introduction to gis and arc gis
Introduction to gis and arc gis Saad Raja
 
Data input and transformation
Data input and transformationData input and transformation
Data input and transformationMohsin Siddique
 
Fundamentals of GIS and Database Management for Disaster Management
Fundamentals of GIS and Database Management for Disaster ManagementFundamentals of GIS and Database Management for Disaster Management
Fundamentals of GIS and Database Management for Disaster ManagementSyadur Rahaman
 

Similaire à Apresentação IBGE (20)

ILWIS 3.0 SUMMARY PRESENTATION
ILWIS 3.0 SUMMARY PRESENTATIONILWIS 3.0 SUMMARY PRESENTATION
ILWIS 3.0 SUMMARY PRESENTATION
 
Geographic information system
Geographic information systemGeographic information system
Geographic information system
 
Getting started with GIS
Getting started with GISGetting started with GIS
Getting started with GIS
 
Introduction to GIS systems
Introduction to GIS systemsIntroduction to GIS systems
Introduction to GIS systems
 
Introduction to gis
Introduction to gisIntroduction to gis
Introduction to gis
 
Unit 4 Data Input and Analysis.pptx
Unit 4 Data Input and Analysis.pptxUnit 4 Data Input and Analysis.pptx
Unit 4 Data Input and Analysis.pptx
 
Gis
GisGis
Gis
 
What is Geography Information Systems (GIS)
What is Geography Information Systems (GIS)What is Geography Information Systems (GIS)
What is Geography Information Systems (GIS)
 
GIS and Its Components.pptx
GIS and Its Components.pptxGIS and Its Components.pptx
GIS and Its Components.pptx
 
Fundamentals of GIS
Fundamentals of GISFundamentals of GIS
Fundamentals of GIS
 
Geographic Information System unit 1
Geographic Information System   unit 1Geographic Information System   unit 1
Geographic Information System unit 1
 
THE NATURE AND SOURCE OF GEOGRAPHIC DATA
THE NATURE AND SOURCE OF GEOGRAPHIC DATATHE NATURE AND SOURCE OF GEOGRAPHIC DATA
THE NATURE AND SOURCE OF GEOGRAPHIC DATA
 
Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
 Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd... Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
 
Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
 Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd... Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
Download-manuals-ground water-manual-gw-volume5operationmanualgiscreationofd...
 
Mrp Intrim
Mrp IntrimMrp Intrim
Mrp Intrim
 
introduction to GIS
introduction to GIS introduction to GIS
introduction to GIS
 
Change detection
Change detection Change detection
Change detection
 
Introduction to gis and arc gis
Introduction to gis and arc gis Introduction to gis and arc gis
Introduction to gis and arc gis
 
Data input and transformation
Data input and transformationData input and transformation
Data input and transformation
 
Fundamentals of GIS and Database Management for Disaster Management
Fundamentals of GIS and Database Management for Disaster ManagementFundamentals of GIS and Database Management for Disaster Management
Fundamentals of GIS and Database Management for Disaster Management
 

Plus de Inovação GIS - Tecnologia da Informação

Uso de ETL na integração de dados geoespaciais nas atividades de planejament...
 Uso de ETL na integração de dados geoespaciais nas atividades de planejament... Uso de ETL na integração de dados geoespaciais nas atividades de planejament...
Uso de ETL na integração de dados geoespaciais nas atividades de planejament...Inovação GIS - Tecnologia da Informação
 
IMPACTOS DA CONVERSÃO DE DADOS GEOESPACIAIS NA GESTÃO DOS IMÓVEIS PÚBLICOS FE...
IMPACTOS DA CONVERSÃO DE DADOS GEOESPACIAIS NA GESTÃO DOS IMÓVEIS PÚBLICOS FE...IMPACTOS DA CONVERSÃO DE DADOS GEOESPACIAIS NA GESTÃO DOS IMÓVEIS PÚBLICOS FE...
IMPACTOS DA CONVERSÃO DE DADOS GEOESPACIAIS NA GESTÃO DOS IMÓVEIS PÚBLICOS FE...Inovação GIS - Tecnologia da Informação
 

Plus de Inovação GIS - Tecnologia da Informação (20)

PROJETO DE MONITORAMENTO DE TARTARUGAS MARINHAS (PMTM) PORTO DO AÇÚ
PROJETO DE MONITORAMENTO DE TARTARUGAS MARINHAS (PMTM) PORTO DO AÇÚPROJETO DE MONITORAMENTO DE TARTARUGAS MARINHAS (PMTM) PORTO DO AÇÚ
PROJETO DE MONITORAMENTO DE TARTARUGAS MARINHAS (PMTM) PORTO DO AÇÚ
 
PROJETO DE MONITORAMENTO DA PESCA PORTO DO AÇÚ
PROJETO DE MONITORAMENTO DA PESCA PORTO DO AÇÚPROJETO DE MONITORAMENTO DA PESCA PORTO DO AÇÚ
PROJETO DE MONITORAMENTO DA PESCA PORTO DO AÇÚ
 
FME na Celesc – Ganho na automação dos processos
FME na Celesc – Ganho na automação dos processosFME na Celesc – Ganho na automação dos processos
FME na Celesc – Ganho na automação dos processos
 
Uso de ETL na integração de dados geoespaciais nas atividades de planejament...
 Uso de ETL na integração de dados geoespaciais nas atividades de planejament... Uso de ETL na integração de dados geoespaciais nas atividades de planejament...
Uso de ETL na integração de dados geoespaciais nas atividades de planejament...
 
Relatórios automatizados utilizando FME
Relatórios automatizados utilizando FMERelatórios automatizados utilizando FME
Relatórios automatizados utilizando FME
 
SharperDataBI
SharperDataBI SharperDataBI
SharperDataBI
 
FME na Comgás – Automação de processos
FME na Comgás – Automação de processosFME na Comgás – Automação de processos
FME na Comgás – Automação de processos
 
IMPACTOS DA CONVERSÃO DE DADOS GEOESPACIAIS NA GESTÃO DOS IMÓVEIS PÚBLICOS FE...
IMPACTOS DA CONVERSÃO DE DADOS GEOESPACIAIS NA GESTÃO DOS IMÓVEIS PÚBLICOS FE...IMPACTOS DA CONVERSÃO DE DADOS GEOESPACIAIS NA GESTÃO DOS IMÓVEIS PÚBLICOS FE...
IMPACTOS DA CONVERSÃO DE DADOS GEOESPACIAIS NA GESTÃO DOS IMÓVEIS PÚBLICOS FE...
 
Sabesp FME 2018
Sabesp FME 2018Sabesp FME 2018
Sabesp FME 2018
 
Casos de uso do FME no IBGE
Casos de uso do FME no IBGECasos de uso do FME no IBGE
Casos de uso do FME no IBGE
 
Novidades fme 2018
Novidades fme 2018Novidades fme 2018
Novidades fme 2018
 
Fme e bigdata
Fme e bigdataFme e bigdata
Fme e bigdata
 
Automatizando processo utilizando workflow
Automatizando processo utilizando workflowAutomatizando processo utilizando workflow
Automatizando processo utilizando workflow
 
Apresentação SPU
Apresentação SPUApresentação SPU
Apresentação SPU
 
Automatizando no FME server
Automatizando no FME serverAutomatizando no FME server
Automatizando no FME server
 
Apresentação Comgás
Apresentação ComgásApresentação Comgás
Apresentação Comgás
 
Apresentação Transpetro
Apresentação  TranspetroApresentação  Transpetro
Apresentação Transpetro
 
Web services melhores praticas para Integração
Web services melhores praticas para Integração Web services melhores praticas para Integração
Web services melhores praticas para Integração
 
Novidades FME 2017
Novidades FME 2017Novidades FME 2017
Novidades FME 2017
 
Extraindo informações de Sites_usando_FME
Extraindo informações de  Sites_usando_FMEExtraindo informações de  Sites_usando_FME
Extraindo informações de Sites_usando_FME
 

Dernier

Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 

Dernier (20)

Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 

Apresentação IBGE

  • 2. Casos de uso do FME no IBGE Renan de Alcantara Soares
  • 3. The Brazilian Institute of Geography and Statistics (IBGE) is the main provider of data and information in Brazil, which responds to the needs of the most diverse segments of civil society, as well as federal, state and municipal government bodies. IBGE offers a complete and current view of the Country through the performance of its main functions:  Production and analysis of statistical information  Coordination and consolidation of statistical information  Production and analysis of geographical information  Coordination and consolidation of geographical information  Documentation and dissemination of information  Coordination of statistical and cartographic systems
  • 4. Coordenação de Cartografia Coordination of Cartography The Coordination of Cartography is responsible for planning, organizing, coordinating, supervising and executing the cartographic works, aiming at the production of maps, as well as other documents of a cartographic nature, necessary for the representation of the Brazilian territorial space "(Portaria nº 215, 12/08/2004 - Art. 60.) " Interoperability of data from many sources
  • 5. Coordenação de Cartografia Coordination of Cartography CCAR Vetorial cartographic base production of all national territory 1:1.000.000 1:250.000 1:100.000 (in progress) 1:25.000 (RJ) (Coordination of Cartography main use) EDGV (Structure of Vector Geospatial Data) Standarize Topological Rules Identify Fix
  • 6. Equipe Team Renan de Alcantara Soares  Cartographic and Surveyor Engineer - Federal University of Viçosa (UFV) Rafael Damiati Ferreira  Geographer – São Paulo State University (UNESP)  Master in Remote Sensing – Brazilian National Institute for Space Research (INPE) Ludolf da Mota Silva  Cartographic Engineer - Rio de Janeiro State University (UERJ) All with advanced knowledge in GIS, but had never used FME before, learning it by job needs and investigative curiosity.
  • 7. Casos Cases #1 The vetorial cartographic continuous bases of Brazil, has as main applications and products the planning and management of government programs with a territorial approach; The analyzes that demand an overall view (country, region and states); The elaboration of maps in smaller scales (Brazilian, regional, state and Atlas series maps) and representations of thematic aspects of the territory (statistics, natural resources and environmental research). Its modeling is implemented according to the Technical Specifications for Vector Geospatial Data Structuring (ET-EDGV). In relation to the geodesic and cartographic spatial references, the Base follows the current norm, using the SIRGAS 2000 reference system, with a geographic coordinate system. The data are available in free format (shapefile, geopackeg and dump from the PostGIS database) for use in Geographic Information Systems, and it is compatible with different softwares.
  • 8. Casos Cases #1 Vetorial cartographic base of 1:1000000Vetorial cartographic base of 1:250000Vetorial cartographic base of 1:100000Vetorial cartographic base of 1:25000
  • 9. Casos Cases #1 And of course, on such a large base, errors may occur during vector acquisition. Like, overlap of two features that should not, Intersessions without break, gap between adjacent polygons. Problems that require time, resources and expertise available to apply the correct fixes, and still, can be subject to human errors. The flows created in the FME to the Vector Base, in several scales, aimed at a quick identification and correction, with the minimum of human vector editing.
  • 10. Casos Cases #1 A few examples: Poligons (Must not Overlap)Line (Fixes the flow (direction) of the rivers to fit the downstream direction)Point (Correction in many features simultaneously)Checks the contours and identifies discontinuities, missing curves or wrong values, also identifies incoherent points between two curves
  • 11. Casos Cases #2 The Brazilian topographic mapping carried out between the 1970s and 1980s, whose purpose was to represent the Brazilian territorial space, in a systematic way, through a series of general, continuous, homogeneous and articulated maps, elaborated selectively and progressively, at the standard scales of 1:1000000, 1:250000, 1:100000, 1:50000 and 1:25000.
  • 12. Casos Cases #2 Scale 1:25000Scale 1:50000Scale 1:100000 Scale 1:250000 Scale 1:1000000
  • 13. Casos Cases #2 In January 1991, plans were started for the conversion of topographic sheets to CAD, which took time for the scanning and the vectorization, a project that took a lot of time during the 1990s. Some of the regions of this systematic mapping have never been revisited, being this unique data for some local names, settlements, rivers and mountains. What motivated the idea of​ updating this data to the shapefile format.
  • 14. Casos Cases #2 The first problem encountered was the Datum, there were at least 8, all digitized in DGN with units in kilometers. None of them recognized by FME.
  • 15. Casos Cases #2 TransportHydrographyBuildingsBatch Reads a folder, where 26504 files are stored in DGN extension Organizes for each line the various output addresses for each scale and mapped region. Distributes feature classes correctly for processing It calls the workspaces's that convert dgn to shp, each line represents a class of feature (Transport, Hydrography, Hypsometry, Buildings, Metadata, etc ...). The input data is iterative until it is able to make all such dgns in the folder (including subfolders) and prints according to the specified folder organization.
  • 16. Casos Cases #2 Organization of the results folder  Scale  Producer of the data  Topographic Map  Metodology (also contains Metadata and Grid)  Feature Class  Shapefiles
  • 18. Casos Cases #3 The Ibge has more than 50TB of raster images, for the Rapid-Eye images, which are being used in the production of the new vectorial cartographic base of 1: 100000 are 3 collections of Rapid-Eye covers from Brazil (5 meters). To correct or confirm the accuracy of these images, IBGE has a database for Ground Control Points (GCP), which has at least 15,5 thousand points spread throughout the Country. Still, some Rapid-Eye coverage scenes may not have control points on it, or not enough points for an adequate analysis of their accuracy. The technical team responsible for image processing opted to evaluate the positional quality of Rapid-Eye images comparing them with OrtoPhotos of greater precision. For that, Erdas AutoSync was used to compare two or more images, from search windows to determine the similar features and obtain the coordinates of these similar features, generating a report of the results found.
  • 19. Casos Cases #3 First problem, the report is generated with coordinates in geographic system, while the Rapid-Eye images have coordinate in UTM (diverse fuses). Also the displacement can only be calculated on the plane.
  • 20. Casos Cases #3 Read the report in txt. Reads the raster in GeoTIFF It plots the report points and defines it as EPSG: 4326 Extract the coordinate system information from the raster Transfers this information for points and reproject it for the Raster coordinate system Do the statistics This workspace also has a batch caller, which arranges the output folder, toggles between several input files, and even if you need to stop and continue on another day it understands which raster has already been processed and discards them before it starts. Statistics results (Output file)
  • 21. Casos Cases #4 IBGE has a vast historical collection of analog aerial photos stored in Rio de Janeiro. These photos were the main resources for different cartographic products published by the institution, mostly consisted of topographic maps at various scales. We’ve started the process of digitization and cataloging historical aerial photographs with approximate georeferencing. The effort aims to facilitate searching and accessing the historical data and to preserve paper information once it tends to deteriorate over the time. This work was presented in: SBSR - Brazilian Remote Sensing Symposium (2017) – Santos ICC - International Cartographic Conference (2017) – Washington DC