05/12/2016 Michele Lazzarini Presentation "The BDE Secure Societies Pilot"

1. THE BDE SECURE
SOCIETIES PILOT
3rd BDE Hangout “Big Data in Secure Societies”5 December 2016
Michele Lazzarini, EU SatCen
RTDI Project Officer

2. User Requirements in Secure Societies
 Data Chain
o To exploit data coming from space (using open data and tools)
o To integrate satellite, geospatial and other data
o To develop automatic tools for the whole data chain management
o Possible applications of Big Data should be mainly related to access, archiving,
analysis, visualization and dissemination
 Platform Characteristics
o Reliable, stable, efficient, time reducing, economically convenient, open source-
based, user-friendly, multi-lingual and interoperable
o Security compliant, geospatial oriented, Platform as a Service (PaaS), single
access, customizable and extensible

3. Pilot General Description
Remote Sensing Big Data Platform Social Sensing
Change Detection Workflow
Event Detection Workflow

4. Pilot Data
 Sentinel-1
o Sen-1A launched in 2014, Sen-1B launched in 2016
o C-band Synthetic Aperture Radar (day and night)
o Revisiting Time of 6 days (in interferometric conditions)
o Ground resolution of 5 x 20 m
o Level-1 Ground Range Detected images
 Twitter
o Free Twitter Public Streams API and specific user accounts
o Plain text along with metadata in JSON format
 Reuters
o News articles through RSS feeds in XML format

5. Change Detection Workflow
 Area of Interest and dates range are set in the GUI
 Sentinel-1images are downloaded from the Sentinel
Scientific Data Hub
 Pre-processing operations based on SNAP* are
performed to prepare the data for the processing step
 A change detection algorithm (in house tool) is applied to
detect areas with changes
 Output maps are then associated with social media and
news items and presented to the end-user for cross-
validation
*http://step.esa.int/main/toolboxes/snap/

6. Event Detection Workflow
 News (Reuters) and social media (Twitter accounts) sources
are monitored
 Items from specific news sources might be clustered into
events (based on topic clustering) or searched via
keywords
 Locations in the news items as well as in tweets and events
can be determined
 News location and contents from the detected events
could be verified with satellite images from the Change
Detection Workflow

7. Pilot Demo

8. Second Phase
 Change Detection
o Further SNAP modules (e.g. Subset) to be adapted to SPARK
o Optimize scalability of existing Spark-based Sentinel-1 operators
o Fully integrate the Pixel Aggregator module (DBScan) into the workflow
o Refinements of the results visualization
 Event Detection
o Dockerize SPARK version of the workflow
o Activation of the Change Detection workflow from the Event Detection one
o Add the possibility to search for keywords through a Twitter Search API
 Whole Pilot
o Cybersecurity mechanisms to be added (e.g. authentication/authorization)
o Improvement of Sextant functionalities

9. UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
Michele Lazzarini
RTDI Project Officer
michele.lazzarini@satcen.europa.eu