Esri ArcGIS Online Feature Services allow you to share map features over the web. With mobile apps and workstations, easy access to collect and edit those features across the organization is gained. Once edits are made, FME makes it easy to manage your hosted data with the ArcGIS Online Reader Writer or ArcGISOnlineConnector.
However, not everyone knows that FME is the Data Integration tool that enables automated manipulation of Webhook data for easy processing. With FME, you can move your data from one place to another, enrich it, and manipulate it. During this hour-long webinar, we’ll take you through:
- An introduction to Webhooks & key terms
- A demonstration of Survey123 Webhooks
- A demonstration of Field Maps Webhooks
- With time to follow for a Q&A session at the end
By leveraging Webhooks, you can initiate a workflow within moments and enrich your data along the way. You’ll leave this webinar with the technical toolset to get started with Webhooks.
2. Dan
Minney
FME Form
Tech Support Specialist
Sanae
Mendoza
FME Flow
Tech Support Specialist
Matt
Meeboer
FME Flow
Tech Support Specialist
3. Welcome to Livestorm.
A few ways to engage with us during the webinar:
Audio issues? Click this for 4 simple
troubleshooting steps.
4. Agenda
1 An Introduction to Safe & FME
2 An Introduction to Webhooks
3 Flash Demo
4 A demonstration of Survey123 Webhooks
5 A demonstration of Field Maps Webhooks
6 Resources & conclusion
7 Q&A
Agenda
6. 29+
27K+
128
190
20K+
years of solving data
challenges
FME Community
members
countries with
FME customers
organizations worldwide
global partners with
FME services
29+
29K+
128
140+
25K+
years of solving data
challenges
FME Community
members
countries with
FME customers
organizations worldwide
global partners with
FME services
14. Webhooks are a lightweight integration tool for systems and users. Allowing us to
exchange and transform data in real-time.
● Automate workflows between applications
● Respond to events in real-time
● Synchronize data across all systems
● Build simple, secure, easy to maintain integrations
● Enrich, transform, and deliver data
Why use Webhooks?
15. Webhooks vs. REST API
● Webhooks communicate over the web
via HTTP, like a REST API.
● Webhooks can watch for specific
events, then sent event information to a
URL.
● REST API requires us to poll an
application for new data.
● Webhooks deliver that data, as soon as
it is available.
16. A Webhook Trigger provides a URL
The URL is given to another application
Whenever an event happens in
that application….
….the automation receives a
message
17. Working with JSON
JSON (JavaScript Object Notation) is a
common format for exchanging information
between applications.
Example webhook message:
{
"surveyInfo": {
"formItemId": "752764383a374belksjdflj234e42216a”…
"eventType": "addData",
"feature": {
"attributes": {
"Name": "FME Lizard",
"Tree_Found": "norway_maple"..}}
FME Workbench
18. ArcGIS Online & ArcGIS Portal can send webhook message to FME Flow when
specified “events” occur. Webhooks can monitor for activity on items, users,
groups or administrative updates*.
Webhooks in ArcGIS
*Webhook configuration and availability may vary depending on the type of
event, application, or platform.
20. One Image and Copy
ArcGIS Survey123 is a platform for creating,
sharing, and analyzing surveys. This allows for
the easy collection of data via the web or a
mobile device.
Survey123
21. Sync data
submitted through
the Survey123 App
to SQL Server &
Tableau
Goal Block Key
Survey123 Webhooks & FME Flow
Result
No direct way to
connect Survey123
to our data
destinations
Use FME Flow
automations to
retrieve a webhook
message and sync
it to SQL Server
and Tableau
An always
up-to-date dataset
& dashboard for all
the data submitted
through the
Survey123 App
23. Connecting Survey123 & FME
Server
● Survey123 webhook capabilities allow
FME Server to retrieve data every time
survey submitted
● In FME Server Automations, Webhook
Trigger can pick up webhook message
and expose for further transformations
and translations down line
● Fully automated approach
24. Processing the Webhook Response
● Extract attributes from the webhook response using the JSONFragmenter + more
● ImageFetcher can be used to retrieve the images - for storage we will need to encode this
as a blob
● Write our cleaned up data to two locations: SQL Server table & Google Sheets table
26. Tips & Tricks
● JSONFragmenter makes it easy to extract attributes and their values from webhook
responses
● Remember to use the ParameterFetcher to retrieve the webhook message
● Enable Authentication with an ArcGIS Online Web Connection in the ImageFetcher
28. Integrating with BI tools
● We can extend our data to
other platforms as well such
as Tableau
● Data Destination: a format
that is digestible and instantly
accessible by our BI tool
○ Google Sheets
30. From mobile apps and workstations, those in
the field can collect and edit features using
ArcGIS applications.
● Instant Apps
● Quick Capture
● Collector
● REST API
● Field Maps
Field Maps (and other
applications)
31. ● Feature Services: host map features
online with symbology & relates
● End-users: view & interact from anywhere
● A Feature Service Webhook: send
event data for any change (e.g. inserts,
updates, deletions, attachments)
Event data is sent to FME Flow, instantly.
ArcGIS Feature Service
Webhooks
32. Tools for Feature Service Webhooks
The ArcGISOnlineWebhookDataGetter is
custom transformer designed to process
ArcGIS Webhook payloads.
Available for download on the FME Hub
Updated feature data is accessed
through a “changesURL” provided in the
webhook message.
33. Slide Title
Employees must
be notified as soon
as they’ve been
assigned new work
orders.
Goal Block Key
Instant Updates from the Field
Result
Work order
information is
collected, stored,
and assigned by
separate
employees and
applications.
Use Feature
Service webhooks
to integrate ArcGIS
data with the work
management
applications.
Work management
is more efficient
when employees
have access to the
most up-to-date
information.
35. Tips & Tricks
● The AGOL account must have permissions to Admin settings.
● Ensure the Feature Service settings allows for edits to be tracked.
● The ArcGISOnlineWebhookDataGetter extracts data from the Feature Service webhook
payload.
● We can listen for kinds of events on AGOL and Portal. (Click the platform for available
Webhook events.)
37. Summary Points
FME Server Automations make it easy to process Survey123 and Feature Service webhook
responses in real-time. This allows you transform your ArcGIS data and extend it to other
platforms.
Feature updates are just one example of event types webhooks can watch for. ArcGIS Online and
ArcGIS Portal support webhooks for other kinds of events, like user or administrative activity.
38. 1 2 3
Contact us
We would love to chat with
you about anything data
info@safe.com
Download FME
Download the latest version &
the webinar workspaces
Free Trial | Upgrade
Apply
The workspaces to your own
data to manage changes
Next Steps
39. ● Video: Automate Integrations with Survey123
and ArcGIS Field Maps using FME and
Webhooks
● Automating Workflows from Survey123 to
ArcGIS using FME Server
● Push Data from an ArcGIS Online Feature
Service to an Application in Real-time
● Automating Workflows from ArcGIS Field Maps
● Connect to APIs and Webhooks in No Time
Resources
40. Free 90-min Workshop
on FME
safe.com/accelerator
Get our Ebook
Spatial Data for the
Enterprise
fme.ly/gzc
More Webinars
Upcoming & on-demand
webinars
safe.com/webinars
FME Accelerator
41. ClaimYour Community Badge
● Get community badges for watching
webinars!
● fme.ly/WebinarBadge
● Today’s code: FBACS
Join the Community today!