SlideShare une entreprise Scribd logo
1  sur  6
Télécharger pour lire hors ligne
Optimizing UAV Systems for Rapid Survey and Reconstruction of Large Scale
Cultural Heritage Sites
Dominique Meyer, Elioth Fraijo, Eric Lo, Dominique Rissolo, and Falko Kuester
Center of Interdisciplinary Science for Art, Architecture, and Archaeology (CISA3)
University of California, San Diego
San Diego, California 92093
Email: {demeyer, efraijo, eklo, drissolo, fkuester}@ucsd.edu
Abstract—Recording geometrically and aesthetically
accurate models of cultural heritage sites is important for both
their conservation and understanding of historical importance.
Rapid imaging systems are required to capture models
efficiently so that large sites can be documented with sufficient
resolution. Increasing availability of consumer-level drones has
fostered digital data collection to replace traditional surveying
methods. While such systems allow photogrammetric data to
be gathered, they often prove inadequate for large scale rapid
imaging. We propose an aerial system infrastructure based on:
adapted aerial platforms; optimizations for flight path
generation and UAV operations; high-bandwidth LTE
transmission; methods of efficient point cloud generation, to
rapidly document large scale heritage sites.
Keywords—UAV; Photogrammetry; LTE; Structure-from-
Motion
I. INTRODUCTION
The development of airframes, control systems and
communication networks has allowed low-cost drones to
become more useful to collect data. Improvements of
payload capacity, flight time, user operation and reduced
costs has made it possible for a diverse population to use
UAVs to carry sensors to image objects. While the
improvements have made it easier for people to create
videos and aesthetic photographs, few systems have
demonstrated improvements for creating 3D models from a
variety of sensors on large scale. Large scale fixed wing
UAVs such as the Penguin B are able to carry the necessary
payload over a large range. Such platforms however require
a large take-off area and are hard to transport. Our scaling
method is to have lower cost-fixed wings which operate in
swarms over a long range. This allows us for easier field
deployment and repair. Each aircraft would be carrying a
high-resolution mirror-less camera to obtain high resolution
imagery.
It can take multiple weeks before data gets to locations
where it can be processed. Smaller survey areas can be
computed on field compatible supercomputers, whereas
large datasets require an infrastructure of SFM dedicated
machines, or distribution over cloud processing. We suggest
using a software-defined radio system to upload data in
close to real-time to the ground where field computers are
located or a high bandwidth access point to upload to the
cloud for processing. Integrating IMU information from the
platform together with GPS makes it optimal for rapid
processing as the software can estimate a camera position
for the reconstruction. It is possible to integrate a live
preview of merged images however it will take hours of
cloud processing time to render high resolution point
clouds.
II. MOTIVATION
Applying remote sensing technologies to survey and
reconstruct heritage sites is important for a multitude of
reasons. A majority of sites need to be documented to
preserve their information as they risk to physically change.
Due to a destruction from war, conflict, weather and
urbanization, a significant number of sites are at risk of
disappearance or degradation. While site preservation
programs attempt to protect sites, it is often the case that
less visible parts of the site are left out, or not known of.
With the aid of aerial imaging it is possible to find and
document all parts of heritage sites. It is often physically
impossible to map areas between sites using total stations or
traditional equipment, therefore one must rely on correct
geo-referencing of sites or satellite imagery to merge
datasets. Being able to image over multiple sites
simultaneously will have an incredible impact on the
understanding of the interaction between sites or societies.
Three- dimensional reconstructions are often imported
into CAD software to do structural analysis of structures, as
well as creating support structures. Rapidly generating 3D
models of historic sites is crucial to the rapid restoration of
buildings and artifacts.
Natural disasters can often devastate heritage sites in a
very short time. Post-disaster analysis of sites can lead to
effective damage analysis as well rapid reconstruction plans
to be created.
III. OPTIMIZATION OF AERIAL PLATFORMS AND SENSOR
INTEGRATION
Surveying of remote areas present a unique challenge
when tackling data acquisition for rapid imaging of
geographical sites. Target areas can often be remote or
inaccessible due to geographical constraints. The use of
UAVs for rapid aerial data acquisition make them a crucial
novel technology. UAVs have the ability to take off and
land in rugged terrain, carry high resolution imaging
sensors, withstand weather condition, and remain portable
enough to transport them around the world. Figure 1 shows
a map of the area we document in a total of 5 flying days.
This area is of interest to understand the interaction between
old Mayan cities, in the north eastern part of Quintana Roo,
Mexico. A total of 800 km was flown in that time period.
Fig. 1. Large Scale Mappign in Quintana Roo
In general, most UAV platforms are well diverse and
can be combined to satisfy most survey applications. The
goal is to meet the eight requirements for 3D reconstruction
of large-scale heritage sites: high geometric accuracy,
capture of all details, photorealism, high automation level,
low cost, portability, application flexibility, and model
efficiency.3
Since one specific system is not known to
satisfy all specified criteria of 3D reconstruction, the criteria
can be used as a base to select Unmanned Aerial Vehicle. In
order to select an aerial platform for rapid survey and 3D
reconstruction we also need to: identify the size of the area
of interest, obtain weather conditions for the region, assess
take-off and landing logistics, and determine the aircraft’s
flexibility and portability.
Based on the above criteria, we selected three main
types of platforms that can be used for rapid large scale
mapping: fixed/rotary wing aircraft, foldable wing aircraft,
and multi-rotor helicopters. Each platform characteristics
and flight parameters are shown in Figure 2.
Fig. 2. Aircraft Specification for Rapid and Large Scale Surveying
Fixed/rotary aircraft are most common in the UAV
development for long range mapping. In a case study
deployment done in Quintana Roo, Mexico two fixed/rotary
aircrafts were tested for the use of rapid long range 3D
mapping. The first airplane used was the ready-to-fly 3DR
Aero aircraft produced by 3D Robotics Inc. and the second
airplane used was the the Ranger EX 757-3. Both aircraft
were, previously tested for autonomy stability and safety
before surveying the Quintana Roo jungles. A total of 19
survey flights were done with the Aero covering a distance
of 350 km. Similarly, a total of 12 survey flights were done
with the Ranger, flying 450km. Together the platforms
reached 800km automated flight distance
Both platforms were equipped with a Pixhawk
autopilot system, 3DR GPS and Compass, and a digital
airspeed sensors that enable full autonomy. Detail
specification of the platforms can be seen in Figure 2.
Figure 3 shows us launching the 3DR Aero.
Fig. 3. Launching 3DRobotics Aero Fixed Wing
In comparison to most fixed /rotary-wing aircraft,
which tend to become heavy and large when carrying
observation and communication payloads, a new
experimental platform is being developed by CISA 3. A
foldable aircraft or a powered paraglider (PPG) is closely
related to an airship or an air balloon. The difference is that
an airship tends to have a large airframe in comparison to
their payload. A PPG is excellent in portability, since the
canopy or wing is folded during transportation and unfolded
during operation. Furthermore, a PPG is able to fly at low
speeds and cover long distances, making it perfect for detail
land observation and long range mapping. The current
design has a payload of 5- 10 kg with a foldable wing span
of 4 meters. The mission of this platform is to have a full
automated system that works on a prototype design and
upscale the project to carry payloads up to 70 kg. Detail
specification of the PPG can be seen in Figure 2. Figure 4
illustrates an initial prototype of this platform.
Fig. 4. Large Scale Mappign in Quintana Roo
Multicopters are one of the most common systems
used for high-detail aerial data acquisition of structures.
Multicopters have the potential to maintain level flight and
close range to structures. They are able to obtain high
geometry accuracy, capture rugged details, obtain
photorealism photography, while maintaining high
automation level, low cost, and portability. In the same case
study done in the Quintana Roo, Mexico, the travel-copter
we developed flew for a total of 2 times. Although,
multicopters have a limited flight time of less than 30
minutes depending on the payload weight, multicopters are
the closest platform that can meet the eight requirements for
3D reconstruction. As battery technology advances and the
problem of flight endurance is overcome, multicopters will
meet the eight requirements for creating long range 3D
mapping models. Detail specification of the multirotors can
be seen in Figure1. Figure 5 shows a CAD model of the
foldable long endurance multi-rotor.
Fig. 5. Travel-copter: Foldable Long Range Copter
IV. IMAGING SENSORS
The optimization of UAV sensors for rapid survey
and reconstruction of large scale cultural heritage sites is
highly dependent on the cost and size of the sensors. Many
approaches to create 3D models are often done by
combining multiple techniques: image-based modeling,
range-based modeling, and image-based rendering. Many of
these techniques require expensive imaging sensors that can
be costly and large to equip on portable UAVs. For this
reason we are forced to explore the alternative and equip our
aerial platforms with relatively low cost and compact
sensors. A representation of our data acquisition can be seen
in Figure 1. The data shows the parameters obtained from
our visual survey of (Conil, Q. Roo) taken with a ( Sony
QX1). The flight was performed at an altitude of 203.24
meters covering a total area of 2.3 square km, with a ground
resolution of .0384 m/pix. A 3D photo-mosaic panorama
was stitched together using structure from motion (SFM)
techniques, allowing us to create a rapid large scale map of
the region to search for cultural heritage sites.
Fig. 6. Coverage of Conil in Quintana Roo, Mexico
Some of the other sensors used in the Quintana Roo
deployment as well as other deployments include IR (infra-
red), thermal, and high resolution cameras along with laser
range sensors. Figure 7 is an Orthorectified image from
2800 images collected by the Volantex Ranger UAV.
Fig. 7. Orthorectified Image of Conil
V. GENERATION OF FLIGHT PATHS FOR SENSORS
The use of flight paths for large-scale mapping and
autonomous data gathering is of high importance. Before
any survey platform is deployed, the site of interest is
usually surveyed using satellite images to identify key
points of interest. Preparation of a survey deployment for
large-scale mapping consists of a preliminary digital survey,
selection of the target mapping area, and a pre-planned
flight path based on weather conditions. All sensors used
required overlap between the images or samples. This is so
that they can optimally be merged. For visible light cameras,
we use a standard overlap of 60% to 70%. This is so that if
there is one anomalous image or data point, that it can be
ignored, and data from nearby images can substitute it. The
distance between flight lines is calculated between a
spreadsheet which combines Field of View from the
sensors, their resolution and the desired model resolution.
Figure 8 links the data resolution to flight altitude for the
Sony Qx1 Camera.
Fig. 8. Table of resolutions at flight altitudes for Sony QX1
VI. LTE COMMUNICATION AND TELEMETRY
Communications are a key component to the rapid
survey and large scale mapping of cultural sites of interest.
In the case for rapid survey and real time image processing,
we propose the use of LTE communications as a solution
that would consist of a workflow for the streaming of data
back to a base station. A mobile phone would be used
onboard the UAV to capture imagery at regular intervals
using a self-designed app, and paired with GPS and IMU
data from the flight controller. This device is connected to
the ground station via an LTE network on 400 MHz. The
phone uploads JPEG images through this connection to a
LTE ground station.
The mobile phone will either be flown on a long-
endurance UAV (Fixed/rotor aircraft, foldable aircraft, or
multi-rotor helicopter) as mentioned in the optimization of
aerial platforms section. In the case of a fixed/rotor wing
aircraft, we will pre-program a commercial autopilot with a
mapping mission characterized by flying in an optimized
lawn-mower pattern, with automatic triggering of any
arbitrary camera at distance intervals designed such that the
images overlap by 50-70% for a given flight altitude.
Further work will focus on achieving stereo imagery using 2
smartphones located in each wingtip of a fixed wing, to
enhance orthorectification of the imagery and create better
height profile maps. By closing the feedback loop of
visualization and path planning without needing to land, we
can reconfigure the flight path in real time to further
examine particular areas of interest in higher resolution.
A second communication system on board is
required for telemetry to provide real-time health and status
dates of all the UAV avionic systems. Each aerial platform
transmits crucial information to the ground station. The
telemetry data allows the flight team to monitor all aspects
of the flight including altitude, mission duration, battery
life, flight plan, etc. Real-time health and status dates enable
us to determine the stability of our platform. Without such
sensors rapid survey and large scale mapping would not
feasible. Loss of communication and platform health can
result in the loss of aircraft and jeopardize data acquisition.
VII. VISUALIZATION AND ANALYSIS OF DATA
For this project, we used existing computing
resources of CISA3 at Calit2, University of California San
Diego for the image stitching and visualization. A multitude
of dedicated computers will continue to complete feature
recognition, image alignment, and blending algorithms
already generated by other researchers. The images would
be saved to the processing machines directly, and the output
streamed to a visualization display. The visualization room
of Calit2 offers unique capabilities to view high resolution
imagery in 2D or 3D across a tile display array. We wish to
further use the visualization room with real-time imagery as
it is being collected with overlaid GIS satellite data to help
viewers to rapidly contextualize the imagery. Any pictures
taken by the UAV will directly appear on the display,
merged into the data which is already visible. The workflow
can be summarized in the flowchart in Figure 9:
Fig. 9. Workflow for imaging.
VIII.RAPID PROCESSING OF LARGE DATASETS
We use Agisoft Photoscan Professional to create
structure from motion reconstructions from our aerial
imagery. Photoscan processing has multiple stages: sparse
point cloud generation, dense point cloud reconstruction,
meshing, and texturing. For geometrically accurate
visualization, we use the dense point cloud, visualized with
a custom point cloud renderer. To condense the data into a
more easily digestible format, we mesh the point cloud,
enabling generation of a digital elevation model (DEM) or a
textured photorealistic orthophoto.
We have observed that each stage of processing has
different computational requirements. The feature detection
and matching in the sparse point cloud generation
parallelize well across CPU cores, making it advantageous
to use a dual CPU system with high clock rate, such as the
Intel Xeon E5-2690, which has 8 cores and a base clock
frequency of 2.9GHz. Dense cloud generation has more
stages which appear serially bound, making CPU clock rate
more critical than number of cores. In addition, the
overhead on having 2 CPUs interact with GPUs over PCIe
slows down processing significantly compared to the same
processing with 1 CPU. As Photoscan does not use double
precision floating point calculations on the GPU, the more
expensive compute processors, such as Nvidia’s Tesla line,
are disadvantaged compared to the higher clocked consumer
GeForce line. Regardless of the processing stage, a large
amount of memory is required to process large datasets.
Our workstations are equipped with 128GB or 256GB of
RAM to meet these needs.
To prepare imagery of a large area for processing, it
must first be divided into individual chunks which can be
run efficiently. With the previously described Xeon
workstations, we have found that chunks of around 1000
images work well. Each chunk should include all the
images of one region, but also have images that overlap with
neighbouring regions, to ensure that chunks can align well.
Having geotagged images of a survey area can help in
determining how to chunk the image set.
Amazon AWS presents an attractive alternative to
purchasing multiple expensive dual CPU systems for
processing a large amount of data for short period of time.
By creating a number of EC2 instances with virtualized
dual Xeon setups, such as the c3.8xlarge instances, multiple
chunks can be run efficiently to generate sparse point clouds
in less than a day. The EC2 instances can then be
terminated, and the individual chunks combined on local
hardware.
NEXT STEPS
With advancements on UAV research and
development we will continue to explore the three main
aerial platforms presented in this paper. We hope to achieve
aerial platform endurance of 150 km per flight, for a total air
time of 1.5-2 hours. The level of autonomy has allowed us
to have multiple aerial platforms flying at once, we will
continue to push the boundaries of multi-platform
surveying. LTE communication research advancements will
enable us to do real-time image processing on ground
stations and will be part of an emergency response package.
We will write a script to automatically handle multi-
platform waypoint navigation to enable us to increase the
platforms which are simultaneously in air.Furthermore, we
will be integrating a LIDAR sensor into our platform to
merge both photometric and LIDAR point clouds, and to
increase spatial resolution of the final result.
CONCLUSION
With the availability of consumer-level drones we are able
to foster digital data collection to replace traditional survey
methods. While meeting the requirements of high geometric
accuracy and photorealism we are achieving large scale
surveys. Adapting an infrastructure around the optimization
of large-scale imaging, we are able to rapidly image large
heritage sites for their conservation. Our research has shown
that we are able to obtain a 1-8 centimeter per pixel
resolution from a flight altitude range of 50-400 meter. We
hope to provide accessible, cost effective solutions that will
enable archaeologists to explore and record historical sites
with unprecedented accuracy and reproducibility.
ACKNOWLEDGMENT
This work was supported by the National Science
Foundation under award #DGE-0966375, “Training,
Research and
Education in Engineering for Cultural Heritage
Diagnostics,”
and award #CNS-1338192, “MRI: Development of
Advanced
Visualization Instrumentation for the Collaborative
Exploration of Big Data.” Additional support was provided
by the Qualcomm Institute at UC San Diego, the Friends of
CISA3, and the World Cultural Heritage Society. Opinions,
findings, and conclusions from this study are those of the
authors and do not necessarily reflect the opinions of the
research sponsors. The authors would also like to thank
Centro INAH Quintana Roo, Adriana Velazquez Morlet,
Enrique Terrones, Sandra Elizalde, Alexandra Hubenko,
Vanessa Pool, Fabio Esteban Amador, Jeffrey Glover,
Andrew Vaughn, Roberto Echeverria, Manuel Joya,
Reymundo Joya, Carlos Basto, Jorge Pacheco, Miguel De
Villa, Sebastian Afshari and Marcia Kirby.
REFERENCES
[1] Wantanabe, Ochi “Modelling and simulation of the dynamics of a
powered paraglider” Proceedings of the Institution of Mechanical
Engineers, Part G: Journal of Aerospace Engineering April 2011 225:
373-386,
[2] Crandall, David, et al. "Discrete-continuous optimization for large-
scale structure from motion." Computer Vision and Pattern
Recognition (CVPR), 2011 IEEE Conference on. IEEE, 2011.
[3] El-Hakim, Sabry F., et al. "Detailed 3D reconstruction of large-scale
heritage sites with integrated techniques." Computer Graphics and
Applications, IEEE24.3 (2004): 21-29.
[4] Bates, Karl T., et al. "High-resolution LiDAR and photogrammetric
survey of the Fumanya dinosaur tracksites (Catalonia): implications
for the conservation and interpretation of geological heritage sites."
Journal of the Geological Society165.1 (2008): 115-127.
[5] Beraldin, Jean-Angelo, et al. "Virtual reconstruction of heritage sites:
opportunities and challenges created by 3D technologies." (2005).
[6] Strecha, C., et al. "TERRESTRIAL 3D MAPPING USING FISHEYE
AND PERSPECTIVE SENSORS."
[7] Botterill, Tom, Steven Mills, and Richard Green. "Real-time aerial
image mosaicing." Image and Vision Computing New Zealand
(IVCNZ), 2010 25th International Conference of. IEEE, 2010.
[8] Hansen, Michael, et al. "Real-time scene stabilization and mosaic
construction." Applications of Computer Vision, 1994., Proceedings
of the Second IEEE Workshop on. IEEE, 1994.
[9] Suzuki, Taro, et al. "Real-time hazard map generation using small
unmanned aerial vehicle." SICE Annual Conference, 2008. IEEE,
2008.
[10] G. Eason, B. Noble, and I.N. Sneddon, “On certain integrals of
Lipschitz-Hankel type involving products of Bessel functions,” Phil.
Trans. Roy. Soc. London, vol. A247, pp. 529-551, April 1955.
(references)
[11] J. Clerk Maxwell, A Treatise on Electricity and Magnetism, 3rd ed.,
vol. 2. Oxford: Clarendon, 1892, pp.68-73.
[12] I.S. Jacobs and C.P. Bean, “Fine particles, thin films and exchange
anisotropy,” in Magnetism, vol. III, G.T. Rado and H. Suhl, Eds. New
York: Academic, 1963, pp. 271-350.
[13] K. Elissa, “Title of paper if known,” unpublished.
[14] R. Nicole, “Title of paper with only first word capitalized,” J. Name
Stand. Abbrev., in press.
[15] Y. Yorozu, M. Hirano, K. Oka, and Y. Tagawa, “Electron
spectroscopy studies on magneto-optical media and plastic substrate
interface,” IEEE Transl. J. Magn. Japan, vol. 2, pp. 740-741, August
1987 [Digests 9th Annual Conf. Magnetics Japan, p. 301, 1982].

Contenu connexe

Tendances

Remote Sensing in Digital Model Elevation
Remote Sensing in Digital Model ElevationRemote Sensing in Digital Model Elevation
Remote Sensing in Digital Model ElevationShishir Meshram
 
HAAPS Technology
HAAPS TechnologyHAAPS Technology
HAAPS Technologysmart488
 
Broadband Communications and Applications from High Altitude Platforms
Broadband Communications and Applications from High Altitude PlatformsBroadband Communications and Applications from High Altitude Platforms
Broadband Communications and Applications from High Altitude PlatformsIDES Editor
 
Brosure Laser 4D Monitoring Systems 3DLM UK Jogja
Brosure Laser 4D Monitoring Systems 3DLM UK JogjaBrosure Laser 4D Monitoring Systems 3DLM UK Jogja
Brosure Laser 4D Monitoring Systems 3DLM UK JogjaMurabet, MRT
 
Aerial photography-for-aerial-mapping
Aerial photography-for-aerial-mappingAerial photography-for-aerial-mapping
Aerial photography-for-aerial-mappingHigh Exposure
 
High resolution dem dtm
High resolution dem dtmHigh resolution dem dtm
High resolution dem dtmTTI Production
 
5. lecture 4 data capturing techniques - satellite and aerial images
5. lecture 4   data capturing techniques - satellite and aerial images5. lecture 4   data capturing techniques - satellite and aerial images
5. lecture 4 data capturing techniques - satellite and aerial imagesFenTaHun6
 
5. lecture 4 data capturing techniques - satellite and aerial images
5. lecture 4   data capturing techniques - satellite and aerial images5. lecture 4   data capturing techniques - satellite and aerial images
5. lecture 4 data capturing techniques - satellite and aerial imagesFenTaHun6
 
IkeGPS Joliet Case Study
IkeGPS Joliet Case StudyIkeGPS Joliet Case Study
IkeGPS Joliet Case StudyGlobalgeoGNSS
 
Accuracy of UAV Photogrammetry
Accuracy of UAV PhotogrammetryAccuracy of UAV Photogrammetry
Accuracy of UAV Photogrammetrybaselinesurvey
 
The visual intelligence iris one airborne digital camera systems petrie geo...
The visual intelligence iris one airborne digital camera systems   petrie geo...The visual intelligence iris one airborne digital camera systems   petrie geo...
The visual intelligence iris one airborne digital camera systems petrie geo...Armando Guevara
 
Systematic Oblique Aerial Photography Using Multiple Digital Cameras
Systematic Oblique Aerial Photography Using Multiple Digital CamerasSystematic Oblique Aerial Photography Using Multiple Digital Cameras
Systematic Oblique Aerial Photography Using Multiple Digital Camerasgpetrie
 
Review on Digital Elevation Model
Review on Digital Elevation ModelReview on Digital Elevation Model
Review on Digital Elevation ModelIJMER
 

Tendances (20)

DTM
DTMDTM
DTM
 
Photographic survey
Photographic survey Photographic survey
Photographic survey
 
Slope Modeling & Terrain Analysis (EPAN09)
Slope Modeling & Terrain Analysis (EPAN09)Slope Modeling & Terrain Analysis (EPAN09)
Slope Modeling & Terrain Analysis (EPAN09)
 
Remote Sensing in Digital Model Elevation
Remote Sensing in Digital Model ElevationRemote Sensing in Digital Model Elevation
Remote Sensing in Digital Model Elevation
 
HAAPS Technology
HAAPS TechnologyHAAPS Technology
HAAPS Technology
 
Broadband Communications and Applications from High Altitude Platforms
Broadband Communications and Applications from High Altitude PlatformsBroadband Communications and Applications from High Altitude Platforms
Broadband Communications and Applications from High Altitude Platforms
 
Brosure Laser 4D Monitoring Systems 3DLM UK Jogja
Brosure Laser 4D Monitoring Systems 3DLM UK JogjaBrosure Laser 4D Monitoring Systems 3DLM UK Jogja
Brosure Laser 4D Monitoring Systems 3DLM UK Jogja
 
Aerial photography-for-aerial-mapping
Aerial photography-for-aerial-mappingAerial photography-for-aerial-mapping
Aerial photography-for-aerial-mapping
 
Digital terrain model
Digital terrain modelDigital terrain model
Digital terrain model
 
High resolution dem dtm
High resolution dem dtmHigh resolution dem dtm
High resolution dem dtm
 
5. lecture 4 data capturing techniques - satellite and aerial images
5. lecture 4   data capturing techniques - satellite and aerial images5. lecture 4   data capturing techniques - satellite and aerial images
5. lecture 4 data capturing techniques - satellite and aerial images
 
5. lecture 4 data capturing techniques - satellite and aerial images
5. lecture 4   data capturing techniques - satellite and aerial images5. lecture 4   data capturing techniques - satellite and aerial images
5. lecture 4 data capturing techniques - satellite and aerial images
 
IkeGPS Joliet Case Study
IkeGPS Joliet Case StudyIkeGPS Joliet Case Study
IkeGPS Joliet Case Study
 
Digital Elevation Model (DEM)
Digital Elevation Model (DEM)Digital Elevation Model (DEM)
Digital Elevation Model (DEM)
 
Accuracy of UAV Photogrammetry
Accuracy of UAV PhotogrammetryAccuracy of UAV Photogrammetry
Accuracy of UAV Photogrammetry
 
The visual intelligence iris one airborne digital camera systems petrie geo...
The visual intelligence iris one airborne digital camera systems   petrie geo...The visual intelligence iris one airborne digital camera systems   petrie geo...
The visual intelligence iris one airborne digital camera systems petrie geo...
 
Systematic Oblique Aerial Photography Using Multiple Digital Cameras
Systematic Oblique Aerial Photography Using Multiple Digital CamerasSystematic Oblique Aerial Photography Using Multiple Digital Cameras
Systematic Oblique Aerial Photography Using Multiple Digital Cameras
 
Review on Digital Elevation Model
Review on Digital Elevation ModelReview on Digital Elevation Model
Review on Digital Elevation Model
 
Bridge Scour
Bridge Scour Bridge Scour
Bridge Scour
 
Underground survey
Underground surveyUnderground survey
Underground survey
 

En vedette

Paradrone_Presentation
Paradrone_PresentationParadrone_Presentation
Paradrone_PresentationElioth Fraijo
 
Presentasi Seminar rere
Presentasi Seminar rerePresentasi Seminar rere
Presentasi Seminar rereReinita Putri
 
Falling on Your Sword
Falling on Your SwordFalling on Your Sword
Falling on Your SwordWayne Clare
 
August September D'varim
August September D'varimAugust September D'varim
August September D'varimJanet Anderson
 
Communications Plan
Communications PlanCommunications Plan
Communications PlanWayne Clare
 
Technology in Sheltered Instruction for Early Elementary Rebecca Lagrand for UoP
Technology in Sheltered Instruction for Early Elementary Rebecca Lagrand for UoPTechnology in Sheltered Instruction for Early Elementary Rebecca Lagrand for UoP
Technology in Sheltered Instruction for Early Elementary Rebecca Lagrand for UoPrebeccalagrand
 
El extraño caso del Dr. Jekyll y Mr. Hyde perte 7 y 8
El extraño caso del Dr. Jekyll y Mr. Hyde perte 7 y 8El extraño caso del Dr. Jekyll y Mr. Hyde perte 7 y 8
El extraño caso del Dr. Jekyll y Mr. Hyde perte 7 y 8deisy16velasquez
 
Communication Technology in the Medical Field in 2025
Communication Technology in the Medical Field in 2025Communication Technology in the Medical Field in 2025
Communication Technology in the Medical Field in 2025jsscot07
 

En vedette (14)

Paradrone_Presentation
Paradrone_PresentationParadrone_Presentation
Paradrone_Presentation
 
Presentasi Seminar rere
Presentasi Seminar rerePresentasi Seminar rere
Presentasi Seminar rere
 
Falling on Your Sword
Falling on Your SwordFalling on Your Sword
Falling on Your Sword
 
HHD Packet
HHD PacketHHD Packet
HHD Packet
 
August September D'varim
August September D'varimAugust September D'varim
August September D'varim
 
SnapFast
SnapFastSnapFast
SnapFast
 
Communications Plan
Communications PlanCommunications Plan
Communications Plan
 
Yourprezi
YourpreziYourprezi
Yourprezi
 
Leadership
LeadershipLeadership
Leadership
 
Strange Data
Strange DataStrange Data
Strange Data
 
Technology in Sheltered Instruction for Early Elementary Rebecca Lagrand for UoP
Technology in Sheltered Instruction for Early Elementary Rebecca Lagrand for UoPTechnology in Sheltered Instruction for Early Elementary Rebecca Lagrand for UoP
Technology in Sheltered Instruction for Early Elementary Rebecca Lagrand for UoP
 
El extraño caso del Dr. Jekyll y Mr. Hyde perte 7 y 8
El extraño caso del Dr. Jekyll y Mr. Hyde perte 7 y 8El extraño caso del Dr. Jekyll y Mr. Hyde perte 7 y 8
El extraño caso del Dr. Jekyll y Mr. Hyde perte 7 y 8
 
Security Plan
Security PlanSecurity Plan
Security Plan
 
Communication Technology in the Medical Field in 2025
Communication Technology in the Medical Field in 2025Communication Technology in the Medical Field in 2025
Communication Technology in the Medical Field in 2025
 

Similaire à digital_heritage

RDC-2016-ST-paper-final-Mukherjee.pdf
RDC-2016-ST-paper-final-Mukherjee.pdfRDC-2016-ST-paper-final-Mukherjee.pdf
RDC-2016-ST-paper-final-Mukherjee.pdfPoulastya Mukherjee
 
anaFLY01-05: A MULTIPURPOSE QUADCOPTER WITH DUALITY FEATURES
anaFLY01-05: A MULTIPURPOSE QUADCOPTER WITH DUALITY FEATURESanaFLY01-05: A MULTIPURPOSE QUADCOPTER WITH DUALITY FEATURES
anaFLY01-05: A MULTIPURPOSE QUADCOPTER WITH DUALITY FEATURESNathaniel A. ADEWOLE
 
IRJET - Drone Delivery System: A Review
IRJET - Drone Delivery System: A ReviewIRJET - Drone Delivery System: A Review
IRJET - Drone Delivery System: A ReviewIRJET Journal
 
IRJET- Drone Delivery System
IRJET- Drone Delivery SystemIRJET- Drone Delivery System
IRJET- Drone Delivery SystemIRJET Journal
 
End of Semester Design Report Final Version
End of Semester Design Report Final VersionEnd of Semester Design Report Final Version
End of Semester Design Report Final VersionDaniel Worts
 
The Truth About Drones in Mapping and Surveying
The Truth About Drones in Mapping and SurveyingThe Truth About Drones in Mapping and Surveying
The Truth About Drones in Mapping and SurveyingPeter Sydoruk, P.Eng.
 
Triton UAS Technical Design Paper 2020-2021
Triton UAS Technical Design Paper 2020-2021Triton UAS Technical Design Paper 2020-2021
Triton UAS Technical Design Paper 2020-2021KennyPham19
 
HighSpeed_Stealthy_PayloadFocused_VTOL_UAV
HighSpeed_Stealthy_PayloadFocused_VTOL_UAVHighSpeed_Stealthy_PayloadFocused_VTOL_UAV
HighSpeed_Stealthy_PayloadFocused_VTOL_UAVMichael C. Becker
 
Efficient Road Detection and Tracking for Unmanned Aerial Vehicle
Efficient Road Detection and Tracking for Unmanned Aerial VehicleEfficient Road Detection and Tracking for Unmanned Aerial Vehicle
Efficient Road Detection and Tracking for Unmanned Aerial VehicleProjectsatbangalore
 
Drone Survey Mapping | Aerial Photography Survey - EpitomeGs
Drone Survey Mapping  | Aerial Photography Survey - EpitomeGsDrone Survey Mapping  | Aerial Photography Survey - EpitomeGs
Drone Survey Mapping | Aerial Photography Survey - EpitomeGsNeerajMudgil1
 
Drone Survey Mapping | Aerial Photography Survey Mapping - Eptiome
Drone Survey Mapping | Aerial Photography Survey Mapping - EptiomeDrone Survey Mapping | Aerial Photography Survey Mapping - Eptiome
Drone Survey Mapping | Aerial Photography Survey Mapping - EptiomeNeerajMudgil1
 
Comparative Study of Indoor Navigation Systems for Autonomous Flight
Comparative Study of Indoor Navigation Systems for Autonomous FlightComparative Study of Indoor Navigation Systems for Autonomous Flight
Comparative Study of Indoor Navigation Systems for Autonomous FlightTELKOMNIKA JOURNAL
 
Automated_Drones_-_Giant_Step_in_Mining_Value_Chain
Automated_Drones_-_Giant_Step_in_Mining_Value_ChainAutomated_Drones_-_Giant_Step_in_Mining_Value_Chain
Automated_Drones_-_Giant_Step_in_Mining_Value_ChainSean Jefferys
 
Microsat Proximity and Docking Operations
Microsat Proximity and Docking OperationsMicrosat Proximity and Docking Operations
Microsat Proximity and Docking OperationsJeffrey Robinson
 
Microsat Ground Test Vehicle
Microsat  Ground Test VehicleMicrosat  Ground Test Vehicle
Microsat Ground Test VehicleJeffrey Robinson
 
FYP Report rev34 AM-10-04-15
FYP Report rev34 AM-10-04-15FYP Report rev34 AM-10-04-15
FYP Report rev34 AM-10-04-15Andy Mathieson
 
Person Detection in Maritime Search And Rescue Operations
Person Detection in Maritime Search And Rescue OperationsPerson Detection in Maritime Search And Rescue Operations
Person Detection in Maritime Search And Rescue OperationsIRJET Journal
 
Person Detection in Maritime Search And Rescue Operations
Person Detection in Maritime Search And Rescue OperationsPerson Detection in Maritime Search And Rescue Operations
Person Detection in Maritime Search And Rescue OperationsIRJET Journal
 

Similaire à digital_heritage (20)

Helicopter With Gps
Helicopter With GpsHelicopter With Gps
Helicopter With Gps
 
RDC-2016-ST-paper-final-Mukherjee.pdf
RDC-2016-ST-paper-final-Mukherjee.pdfRDC-2016-ST-paper-final-Mukherjee.pdf
RDC-2016-ST-paper-final-Mukherjee.pdf
 
anaFLY01-05: A MULTIPURPOSE QUADCOPTER WITH DUALITY FEATURES
anaFLY01-05: A MULTIPURPOSE QUADCOPTER WITH DUALITY FEATURESanaFLY01-05: A MULTIPURPOSE QUADCOPTER WITH DUALITY FEATURES
anaFLY01-05: A MULTIPURPOSE QUADCOPTER WITH DUALITY FEATURES
 
IRJET - Drone Delivery System: A Review
IRJET - Drone Delivery System: A ReviewIRJET - Drone Delivery System: A Review
IRJET - Drone Delivery System: A Review
 
IRJET- Drone Delivery System
IRJET- Drone Delivery SystemIRJET- Drone Delivery System
IRJET- Drone Delivery System
 
End of Semester Design Report Final Version
End of Semester Design Report Final VersionEnd of Semester Design Report Final Version
End of Semester Design Report Final Version
 
The Truth About Drones in Mapping and Surveying
The Truth About Drones in Mapping and SurveyingThe Truth About Drones in Mapping and Surveying
The Truth About Drones in Mapping and Surveying
 
Drone survey
Drone surveyDrone survey
Drone survey
 
Triton UAS Technical Design Paper 2020-2021
Triton UAS Technical Design Paper 2020-2021Triton UAS Technical Design Paper 2020-2021
Triton UAS Technical Design Paper 2020-2021
 
HighSpeed_Stealthy_PayloadFocused_VTOL_UAV
HighSpeed_Stealthy_PayloadFocused_VTOL_UAVHighSpeed_Stealthy_PayloadFocused_VTOL_UAV
HighSpeed_Stealthy_PayloadFocused_VTOL_UAV
 
Efficient Road Detection and Tracking for Unmanned Aerial Vehicle
Efficient Road Detection and Tracking for Unmanned Aerial VehicleEfficient Road Detection and Tracking for Unmanned Aerial Vehicle
Efficient Road Detection and Tracking for Unmanned Aerial Vehicle
 
Drone Survey Mapping | Aerial Photography Survey - EpitomeGs
Drone Survey Mapping  | Aerial Photography Survey - EpitomeGsDrone Survey Mapping  | Aerial Photography Survey - EpitomeGs
Drone Survey Mapping | Aerial Photography Survey - EpitomeGs
 
Drone Survey Mapping | Aerial Photography Survey Mapping - Eptiome
Drone Survey Mapping | Aerial Photography Survey Mapping - EptiomeDrone Survey Mapping | Aerial Photography Survey Mapping - Eptiome
Drone Survey Mapping | Aerial Photography Survey Mapping - Eptiome
 
Comparative Study of Indoor Navigation Systems for Autonomous Flight
Comparative Study of Indoor Navigation Systems for Autonomous FlightComparative Study of Indoor Navigation Systems for Autonomous Flight
Comparative Study of Indoor Navigation Systems for Autonomous Flight
 
Automated_Drones_-_Giant_Step_in_Mining_Value_Chain
Automated_Drones_-_Giant_Step_in_Mining_Value_ChainAutomated_Drones_-_Giant_Step_in_Mining_Value_Chain
Automated_Drones_-_Giant_Step_in_Mining_Value_Chain
 
Microsat Proximity and Docking Operations
Microsat Proximity and Docking OperationsMicrosat Proximity and Docking Operations
Microsat Proximity and Docking Operations
 
Microsat Ground Test Vehicle
Microsat  Ground Test VehicleMicrosat  Ground Test Vehicle
Microsat Ground Test Vehicle
 
FYP Report rev34 AM-10-04-15
FYP Report rev34 AM-10-04-15FYP Report rev34 AM-10-04-15
FYP Report rev34 AM-10-04-15
 
Person Detection in Maritime Search And Rescue Operations
Person Detection in Maritime Search And Rescue OperationsPerson Detection in Maritime Search And Rescue Operations
Person Detection in Maritime Search And Rescue Operations
 
Person Detection in Maritime Search And Rescue Operations
Person Detection in Maritime Search And Rescue OperationsPerson Detection in Maritime Search And Rescue Operations
Person Detection in Maritime Search And Rescue Operations
 

digital_heritage

  • 1. Optimizing UAV Systems for Rapid Survey and Reconstruction of Large Scale Cultural Heritage Sites Dominique Meyer, Elioth Fraijo, Eric Lo, Dominique Rissolo, and Falko Kuester Center of Interdisciplinary Science for Art, Architecture, and Archaeology (CISA3) University of California, San Diego San Diego, California 92093 Email: {demeyer, efraijo, eklo, drissolo, fkuester}@ucsd.edu Abstract—Recording geometrically and aesthetically accurate models of cultural heritage sites is important for both their conservation and understanding of historical importance. Rapid imaging systems are required to capture models efficiently so that large sites can be documented with sufficient resolution. Increasing availability of consumer-level drones has fostered digital data collection to replace traditional surveying methods. While such systems allow photogrammetric data to be gathered, they often prove inadequate for large scale rapid imaging. We propose an aerial system infrastructure based on: adapted aerial platforms; optimizations for flight path generation and UAV operations; high-bandwidth LTE transmission; methods of efficient point cloud generation, to rapidly document large scale heritage sites. Keywords—UAV; Photogrammetry; LTE; Structure-from- Motion I. INTRODUCTION The development of airframes, control systems and communication networks has allowed low-cost drones to become more useful to collect data. Improvements of payload capacity, flight time, user operation and reduced costs has made it possible for a diverse population to use UAVs to carry sensors to image objects. While the improvements have made it easier for people to create videos and aesthetic photographs, few systems have demonstrated improvements for creating 3D models from a variety of sensors on large scale. Large scale fixed wing UAVs such as the Penguin B are able to carry the necessary payload over a large range. Such platforms however require a large take-off area and are hard to transport. Our scaling method is to have lower cost-fixed wings which operate in swarms over a long range. This allows us for easier field deployment and repair. Each aircraft would be carrying a high-resolution mirror-less camera to obtain high resolution imagery. It can take multiple weeks before data gets to locations where it can be processed. Smaller survey areas can be computed on field compatible supercomputers, whereas large datasets require an infrastructure of SFM dedicated machines, or distribution over cloud processing. We suggest using a software-defined radio system to upload data in close to real-time to the ground where field computers are located or a high bandwidth access point to upload to the cloud for processing. Integrating IMU information from the platform together with GPS makes it optimal for rapid processing as the software can estimate a camera position for the reconstruction. It is possible to integrate a live preview of merged images however it will take hours of cloud processing time to render high resolution point clouds. II. MOTIVATION Applying remote sensing technologies to survey and reconstruct heritage sites is important for a multitude of reasons. A majority of sites need to be documented to preserve their information as they risk to physically change. Due to a destruction from war, conflict, weather and urbanization, a significant number of sites are at risk of disappearance or degradation. While site preservation programs attempt to protect sites, it is often the case that less visible parts of the site are left out, or not known of. With the aid of aerial imaging it is possible to find and document all parts of heritage sites. It is often physically impossible to map areas between sites using total stations or traditional equipment, therefore one must rely on correct geo-referencing of sites or satellite imagery to merge datasets. Being able to image over multiple sites simultaneously will have an incredible impact on the understanding of the interaction between sites or societies. Three- dimensional reconstructions are often imported into CAD software to do structural analysis of structures, as well as creating support structures. Rapidly generating 3D models of historic sites is crucial to the rapid restoration of buildings and artifacts. Natural disasters can often devastate heritage sites in a very short time. Post-disaster analysis of sites can lead to effective damage analysis as well rapid reconstruction plans to be created. III. OPTIMIZATION OF AERIAL PLATFORMS AND SENSOR INTEGRATION Surveying of remote areas present a unique challenge when tackling data acquisition for rapid imaging of geographical sites. Target areas can often be remote or inaccessible due to geographical constraints. The use of UAVs for rapid aerial data acquisition make them a crucial novel technology. UAVs have the ability to take off and land in rugged terrain, carry high resolution imaging sensors, withstand weather condition, and remain portable enough to transport them around the world. Figure 1 shows
  • 2. a map of the area we document in a total of 5 flying days. This area is of interest to understand the interaction between old Mayan cities, in the north eastern part of Quintana Roo, Mexico. A total of 800 km was flown in that time period. Fig. 1. Large Scale Mappign in Quintana Roo In general, most UAV platforms are well diverse and can be combined to satisfy most survey applications. The goal is to meet the eight requirements for 3D reconstruction of large-scale heritage sites: high geometric accuracy, capture of all details, photorealism, high automation level, low cost, portability, application flexibility, and model efficiency.3 Since one specific system is not known to satisfy all specified criteria of 3D reconstruction, the criteria can be used as a base to select Unmanned Aerial Vehicle. In order to select an aerial platform for rapid survey and 3D reconstruction we also need to: identify the size of the area of interest, obtain weather conditions for the region, assess take-off and landing logistics, and determine the aircraft’s flexibility and portability. Based on the above criteria, we selected three main types of platforms that can be used for rapid large scale mapping: fixed/rotary wing aircraft, foldable wing aircraft, and multi-rotor helicopters. Each platform characteristics and flight parameters are shown in Figure 2. Fig. 2. Aircraft Specification for Rapid and Large Scale Surveying Fixed/rotary aircraft are most common in the UAV development for long range mapping. In a case study deployment done in Quintana Roo, Mexico two fixed/rotary aircrafts were tested for the use of rapid long range 3D mapping. The first airplane used was the ready-to-fly 3DR Aero aircraft produced by 3D Robotics Inc. and the second airplane used was the the Ranger EX 757-3. Both aircraft were, previously tested for autonomy stability and safety before surveying the Quintana Roo jungles. A total of 19 survey flights were done with the Aero covering a distance of 350 km. Similarly, a total of 12 survey flights were done with the Ranger, flying 450km. Together the platforms reached 800km automated flight distance Both platforms were equipped with a Pixhawk autopilot system, 3DR GPS and Compass, and a digital airspeed sensors that enable full autonomy. Detail specification of the platforms can be seen in Figure 2. Figure 3 shows us launching the 3DR Aero. Fig. 3. Launching 3DRobotics Aero Fixed Wing In comparison to most fixed /rotary-wing aircraft, which tend to become heavy and large when carrying observation and communication payloads, a new experimental platform is being developed by CISA 3. A foldable aircraft or a powered paraglider (PPG) is closely related to an airship or an air balloon. The difference is that an airship tends to have a large airframe in comparison to their payload. A PPG is excellent in portability, since the canopy or wing is folded during transportation and unfolded during operation. Furthermore, a PPG is able to fly at low speeds and cover long distances, making it perfect for detail land observation and long range mapping. The current design has a payload of 5- 10 kg with a foldable wing span of 4 meters. The mission of this platform is to have a full automated system that works on a prototype design and upscale the project to carry payloads up to 70 kg. Detail specification of the PPG can be seen in Figure 2. Figure 4 illustrates an initial prototype of this platform.
  • 3. Fig. 4. Large Scale Mappign in Quintana Roo Multicopters are one of the most common systems used for high-detail aerial data acquisition of structures. Multicopters have the potential to maintain level flight and close range to structures. They are able to obtain high geometry accuracy, capture rugged details, obtain photorealism photography, while maintaining high automation level, low cost, and portability. In the same case study done in the Quintana Roo, Mexico, the travel-copter we developed flew for a total of 2 times. Although, multicopters have a limited flight time of less than 30 minutes depending on the payload weight, multicopters are the closest platform that can meet the eight requirements for 3D reconstruction. As battery technology advances and the problem of flight endurance is overcome, multicopters will meet the eight requirements for creating long range 3D mapping models. Detail specification of the multirotors can be seen in Figure1. Figure 5 shows a CAD model of the foldable long endurance multi-rotor. Fig. 5. Travel-copter: Foldable Long Range Copter IV. IMAGING SENSORS The optimization of UAV sensors for rapid survey and reconstruction of large scale cultural heritage sites is highly dependent on the cost and size of the sensors. Many approaches to create 3D models are often done by combining multiple techniques: image-based modeling, range-based modeling, and image-based rendering. Many of these techniques require expensive imaging sensors that can be costly and large to equip on portable UAVs. For this reason we are forced to explore the alternative and equip our aerial platforms with relatively low cost and compact sensors. A representation of our data acquisition can be seen in Figure 1. The data shows the parameters obtained from our visual survey of (Conil, Q. Roo) taken with a ( Sony QX1). The flight was performed at an altitude of 203.24 meters covering a total area of 2.3 square km, with a ground resolution of .0384 m/pix. A 3D photo-mosaic panorama was stitched together using structure from motion (SFM) techniques, allowing us to create a rapid large scale map of the region to search for cultural heritage sites. Fig. 6. Coverage of Conil in Quintana Roo, Mexico Some of the other sensors used in the Quintana Roo deployment as well as other deployments include IR (infra- red), thermal, and high resolution cameras along with laser range sensors. Figure 7 is an Orthorectified image from 2800 images collected by the Volantex Ranger UAV. Fig. 7. Orthorectified Image of Conil
  • 4. V. GENERATION OF FLIGHT PATHS FOR SENSORS The use of flight paths for large-scale mapping and autonomous data gathering is of high importance. Before any survey platform is deployed, the site of interest is usually surveyed using satellite images to identify key points of interest. Preparation of a survey deployment for large-scale mapping consists of a preliminary digital survey, selection of the target mapping area, and a pre-planned flight path based on weather conditions. All sensors used required overlap between the images or samples. This is so that they can optimally be merged. For visible light cameras, we use a standard overlap of 60% to 70%. This is so that if there is one anomalous image or data point, that it can be ignored, and data from nearby images can substitute it. The distance between flight lines is calculated between a spreadsheet which combines Field of View from the sensors, their resolution and the desired model resolution. Figure 8 links the data resolution to flight altitude for the Sony Qx1 Camera. Fig. 8. Table of resolutions at flight altitudes for Sony QX1 VI. LTE COMMUNICATION AND TELEMETRY Communications are a key component to the rapid survey and large scale mapping of cultural sites of interest. In the case for rapid survey and real time image processing, we propose the use of LTE communications as a solution that would consist of a workflow for the streaming of data back to a base station. A mobile phone would be used onboard the UAV to capture imagery at regular intervals using a self-designed app, and paired with GPS and IMU data from the flight controller. This device is connected to the ground station via an LTE network on 400 MHz. The phone uploads JPEG images through this connection to a LTE ground station. The mobile phone will either be flown on a long- endurance UAV (Fixed/rotor aircraft, foldable aircraft, or multi-rotor helicopter) as mentioned in the optimization of aerial platforms section. In the case of a fixed/rotor wing aircraft, we will pre-program a commercial autopilot with a mapping mission characterized by flying in an optimized lawn-mower pattern, with automatic triggering of any arbitrary camera at distance intervals designed such that the images overlap by 50-70% for a given flight altitude. Further work will focus on achieving stereo imagery using 2 smartphones located in each wingtip of a fixed wing, to enhance orthorectification of the imagery and create better height profile maps. By closing the feedback loop of visualization and path planning without needing to land, we can reconfigure the flight path in real time to further examine particular areas of interest in higher resolution. A second communication system on board is required for telemetry to provide real-time health and status dates of all the UAV avionic systems. Each aerial platform transmits crucial information to the ground station. The telemetry data allows the flight team to monitor all aspects of the flight including altitude, mission duration, battery life, flight plan, etc. Real-time health and status dates enable us to determine the stability of our platform. Without such sensors rapid survey and large scale mapping would not feasible. Loss of communication and platform health can result in the loss of aircraft and jeopardize data acquisition. VII. VISUALIZATION AND ANALYSIS OF DATA For this project, we used existing computing resources of CISA3 at Calit2, University of California San Diego for the image stitching and visualization. A multitude of dedicated computers will continue to complete feature recognition, image alignment, and blending algorithms already generated by other researchers. The images would be saved to the processing machines directly, and the output streamed to a visualization display. The visualization room of Calit2 offers unique capabilities to view high resolution imagery in 2D or 3D across a tile display array. We wish to further use the visualization room with real-time imagery as it is being collected with overlaid GIS satellite data to help viewers to rapidly contextualize the imagery. Any pictures taken by the UAV will directly appear on the display, merged into the data which is already visible. The workflow can be summarized in the flowchart in Figure 9: Fig. 9. Workflow for imaging. VIII.RAPID PROCESSING OF LARGE DATASETS We use Agisoft Photoscan Professional to create structure from motion reconstructions from our aerial imagery. Photoscan processing has multiple stages: sparse
  • 5. point cloud generation, dense point cloud reconstruction, meshing, and texturing. For geometrically accurate visualization, we use the dense point cloud, visualized with a custom point cloud renderer. To condense the data into a more easily digestible format, we mesh the point cloud, enabling generation of a digital elevation model (DEM) or a textured photorealistic orthophoto. We have observed that each stage of processing has different computational requirements. The feature detection and matching in the sparse point cloud generation parallelize well across CPU cores, making it advantageous to use a dual CPU system with high clock rate, such as the Intel Xeon E5-2690, which has 8 cores and a base clock frequency of 2.9GHz. Dense cloud generation has more stages which appear serially bound, making CPU clock rate more critical than number of cores. In addition, the overhead on having 2 CPUs interact with GPUs over PCIe slows down processing significantly compared to the same processing with 1 CPU. As Photoscan does not use double precision floating point calculations on the GPU, the more expensive compute processors, such as Nvidia’s Tesla line, are disadvantaged compared to the higher clocked consumer GeForce line. Regardless of the processing stage, a large amount of memory is required to process large datasets. Our workstations are equipped with 128GB or 256GB of RAM to meet these needs. To prepare imagery of a large area for processing, it must first be divided into individual chunks which can be run efficiently. With the previously described Xeon workstations, we have found that chunks of around 1000 images work well. Each chunk should include all the images of one region, but also have images that overlap with neighbouring regions, to ensure that chunks can align well. Having geotagged images of a survey area can help in determining how to chunk the image set. Amazon AWS presents an attractive alternative to purchasing multiple expensive dual CPU systems for processing a large amount of data for short period of time. By creating a number of EC2 instances with virtualized dual Xeon setups, such as the c3.8xlarge instances, multiple chunks can be run efficiently to generate sparse point clouds in less than a day. The EC2 instances can then be terminated, and the individual chunks combined on local hardware. NEXT STEPS With advancements on UAV research and development we will continue to explore the three main aerial platforms presented in this paper. We hope to achieve aerial platform endurance of 150 km per flight, for a total air time of 1.5-2 hours. The level of autonomy has allowed us to have multiple aerial platforms flying at once, we will continue to push the boundaries of multi-platform surveying. LTE communication research advancements will enable us to do real-time image processing on ground stations and will be part of an emergency response package. We will write a script to automatically handle multi- platform waypoint navigation to enable us to increase the platforms which are simultaneously in air.Furthermore, we will be integrating a LIDAR sensor into our platform to merge both photometric and LIDAR point clouds, and to increase spatial resolution of the final result. CONCLUSION With the availability of consumer-level drones we are able to foster digital data collection to replace traditional survey methods. While meeting the requirements of high geometric accuracy and photorealism we are achieving large scale surveys. Adapting an infrastructure around the optimization of large-scale imaging, we are able to rapidly image large heritage sites for their conservation. Our research has shown that we are able to obtain a 1-8 centimeter per pixel resolution from a flight altitude range of 50-400 meter. We hope to provide accessible, cost effective solutions that will enable archaeologists to explore and record historical sites with unprecedented accuracy and reproducibility. ACKNOWLEDGMENT This work was supported by the National Science Foundation under award #DGE-0966375, “Training, Research and Education in Engineering for Cultural Heritage Diagnostics,” and award #CNS-1338192, “MRI: Development of Advanced Visualization Instrumentation for the Collaborative Exploration of Big Data.” Additional support was provided by the Qualcomm Institute at UC San Diego, the Friends of CISA3, and the World Cultural Heritage Society. Opinions, findings, and conclusions from this study are those of the authors and do not necessarily reflect the opinions of the research sponsors. The authors would also like to thank Centro INAH Quintana Roo, Adriana Velazquez Morlet, Enrique Terrones, Sandra Elizalde, Alexandra Hubenko, Vanessa Pool, Fabio Esteban Amador, Jeffrey Glover, Andrew Vaughn, Roberto Echeverria, Manuel Joya, Reymundo Joya, Carlos Basto, Jorge Pacheco, Miguel De Villa, Sebastian Afshari and Marcia Kirby. REFERENCES [1] Wantanabe, Ochi “Modelling and simulation of the dynamics of a powered paraglider” Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering April 2011 225: 373-386, [2] Crandall, David, et al. "Discrete-continuous optimization for large- scale structure from motion." Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, 2011. [3] El-Hakim, Sabry F., et al. "Detailed 3D reconstruction of large-scale heritage sites with integrated techniques." Computer Graphics and Applications, IEEE24.3 (2004): 21-29. [4] Bates, Karl T., et al. "High-resolution LiDAR and photogrammetric survey of the Fumanya dinosaur tracksites (Catalonia): implications for the conservation and interpretation of geological heritage sites." Journal of the Geological Society165.1 (2008): 115-127.
  • 6. [5] Beraldin, Jean-Angelo, et al. "Virtual reconstruction of heritage sites: opportunities and challenges created by 3D technologies." (2005). [6] Strecha, C., et al. "TERRESTRIAL 3D MAPPING USING FISHEYE AND PERSPECTIVE SENSORS." [7] Botterill, Tom, Steven Mills, and Richard Green. "Real-time aerial image mosaicing." Image and Vision Computing New Zealand (IVCNZ), 2010 25th International Conference of. IEEE, 2010. [8] Hansen, Michael, et al. "Real-time scene stabilization and mosaic construction." Applications of Computer Vision, 1994., Proceedings of the Second IEEE Workshop on. IEEE, 1994. [9] Suzuki, Taro, et al. "Real-time hazard map generation using small unmanned aerial vehicle." SICE Annual Conference, 2008. IEEE, 2008. [10] G. Eason, B. Noble, and I.N. Sneddon, “On certain integrals of Lipschitz-Hankel type involving products of Bessel functions,” Phil. Trans. Roy. Soc. London, vol. A247, pp. 529-551, April 1955. (references) [11] J. Clerk Maxwell, A Treatise on Electricity and Magnetism, 3rd ed., vol. 2. Oxford: Clarendon, 1892, pp.68-73. [12] I.S. Jacobs and C.P. Bean, “Fine particles, thin films and exchange anisotropy,” in Magnetism, vol. III, G.T. Rado and H. Suhl, Eds. New York: Academic, 1963, pp. 271-350. [13] K. Elissa, “Title of paper if known,” unpublished. [14] R. Nicole, “Title of paper with only first word capitalized,” J. Name Stand. Abbrev., in press. [15] Y. Yorozu, M. Hirano, K. Oka, and Y. Tagawa, “Electron spectroscopy studies on magneto-optical media and plastic substrate interface,” IEEE Transl. J. Magn. Japan, vol. 2, pp. 740-741, August 1987 [Digests 9th Annual Conf. Magnetics Japan, p. 301, 1982].