2. Index of
Content
V i r t u a l
P a t i e n t
O b s e r v a t i o n
Intro to NTT Disruption
Virtual Patient Observation Solution
The problem
The solution
How it works
Benefits
Architecture and Hardware Platforms
VPO Video Processing Pipeline
VPO & Xilinx Alveo - Advantages
VPO Solution Walk-through
3. We are NTT Disruption
We create today what really matters for tomorrow.
We partner with clients to identify opportunities in their
industries and create disruptive solutions that could be added to
NTT Group’s portfolio in the future.
We do so by developing Industry Partnerships
and PoCs / MVPs / Early-stage products
5. Continuous patient monitoring is crucial to ensure their
wellbeing.
V i r t u a l
P a t i e n t
O b s e r v a t i o n
An average ICU nurse dedicates 20% of is work time* monitoring patient’s status. This
means over 185K hours* spent daily in the USA in ICU patient monitoring.
*Source: different interviews held with ICU nursing team at InCor, Hospital das Clinicas, Sao Paolo, Brazil.
*Assuming 1:2 nurse to patient ratio, 70% ICU occupancy, avg. 20% time per nurse dedicated on patient supervision.
This is a difficult and inefficient duty, that can result in
unwanted patient incidences, that can generate high impact
outcomes for both the hospital and the patient
Increase in length of ICU stay with the consequent extra cost for the hospital,
patient’s functional decline or injury, increase in cost of the healthcare
services, legal costs, etc
Patient falls stats*:
• Around 700,000 to 1 million falls per year in hospitalized
patients in the US*,
• 30% to 35% injured as a result of the fall
• Approximately 11,000 falls are fatal.
• Injuries related to fall result in additional 6.3 hospital days.
• Average extra cost of serious fall with injury: $14,056 per
patient.
Extubation stats*:
• Over 120,000 unplanned and unintentional extubations occur every
year in the US.
• Up to 90% are self extubations
• This has a cost for hospitals of over $5 billion annually
6. V i r t u a l
P a t i e n t
O b s e r v a t i o n
Virtual Patient Observation – VPO - is a
solution that detects certain patients’
movements, or actions, that can result in
risky situations with a high impact on the
patient’s safety, having costly
consequences for the Hospital.
The permanent eyes of nurses
for patients’ care
For Nurses &
Doctors
For the
Hospital
VPO improves their daily work and simplifies manual monitoring
procedures.
VPO helps improving protocols against falls, extubation, etc.
VPO provides insights on daily operation efficiency, patient safety KPIs, etc.
VPO allows to make nursing team more efficient without increasing
headcount.
VPO helps avoiding increase of hospital stay due to undesired events,
also saving money on legal expenses.
VPO provides higher standards of Patient Service Quality and
Compliance and Patient safety KPIs.
Main Benefits
For Patients
A better and more effective care is provided while keeping
patient’s privacy.
Families are sure that their relatives are being monitored
24/7, no matter the conditions or situation inside the ICU.
7. VPO constantly monitors the patient from a video stream coming from the ICU room and triggers the necessary alarms
whenever an unwanted event is detected.
V i r t u a l
P a t i e n t
O b s e r v a t i o n
How Virtual Patient Observation works
VPO The patient is monitored 24/7,
feeling cared for even when the
team is not around
VPO will send an alarm to the
medical staff in almost real time if
any event is detected
Nurses can effectively attend the patient in
order to avoid fatal consequences for the
patient health.
Patient sitting down on bed to stand up (Fall Risk)
When the patient sits on the bed, as a previous step to leave the bed.
Extremities out of bed
Nurses can define a “virtual fence” to detect if patient moves any limb away from a
predefined region (normally the edge of the bed).
Empty bed alarm
It warns when patient completely leaves the bed or virtual fence previously predefined
by the nurses.
Patient falls off the bed
When a patient falls to the floor in any way. This event can be prevented by
attending the alert of patient sitting down on bed.
Nurse raises arm to ask for help
When nurse raises one or both arms to ask other nurses for urgent assistance, without
the need to leave the patient alone.
Patient touching face insistently
When patient moves his arms insistently to the face, as a
symptom that he is trying to extubate himself.
VPO AI analytics on the video stream
received from the room, detecting
unwanted events and risky situations
for the patient
Events detected by VPO
8. V i r t u a l
P a t i e n t
O b s e r v a t i o n
VPO Main view
• Grid view of rooms monitored
• Comprehensive visual & sound
alerts
VPO Room view
• Room live streaming
• Alerts’ history of room
• 24h activity timeline
How Virtual Patient Observation works
9. V i r t u a l
P a t i e n t
O b s e r v a t i o n
VPO Accelerated Video Processing Pipeline
• VPO is a business application built on top of an accelerated video analytics processing pipeline.
• This pipeline, that runs on top of acceleration hardware (Xilinx Alveo U50 FPGAs), allows VPO to perform video analytics and ML inference
in real time
Media Server
Pre-processing
Decoding, Scaling
OpenPose
Optical Flow
ML Inferencing
Different models in
parallel to detect
different events
Post processing
Alarms filtering
Heuristics
VPO Server at Hospital Data Center
VPO Application Server
VPO Business Logic
Events Management
Storage
Usability filters
Monitoring PC
VPO Application Client
Up to 12 cameras
per server,
depending on
configuration
RESTful API
HL7 Interop Compliant
RTSP websocket
protocol
RTSP websocket protocol
Video Stream input Image pre-processing – No video kept
Accelerated process
Raw Alarms
generation
This makes VPO GDPR (Patient
Privacy) compliant
10. V i r t u a l
P a t i e n t
O b s e r v a t i o n
VPO & Xilinx Alveos - Advantages
KEY BENEFITS of Xilinx Alveo for VPO
VPO Technological differentiation
Relying on Xilinx Alveo acceleration capabilities, VPO is able to provide complex and
simultaneous events detection without impacting latency.
This makes it suitable for latency-sensitive scenarios like ICU units.
Xilinx Alveos allow to keep latency low
even if analytics complexity grows
Performance of preprocessing up to 40%
higher than equivalent GPU (OpenPose)
Reduced TCO and overall solution cost
since Xilinx Alveos provide higher streams
per server ratio.
11. V i r t u a l
P a t i e n t
O b s e r v a t i o n
VPO Architecture & Hardware Platform
• VPO relies on Xilinx Alveo FPGAs in order to provide real
time video analytics capabilities at a reasonable cost.
• VPO is currently deployed on premise as a requisite on
most Hospitals & Healthcare clients.
• Current VPO solution is supported by centralized,
dedicated servers at the Hospital’s Data Center
• VPO will further support distributed, edge/hybrid
architectures for better adaptations to clients’ needs and
make it even more efficient.
VPO partners with HPE & Xilinx for hardware infrastructure
HPE ProLiant DL385 Gen10 Server
8x Xilinx Alveo U50 Cards
TBD - Edge Server
TBD – Xilinx Alveo Cards
Data Center
bundle
Edge
bundle
Coming
soon
Up to 12 rooms
per server
13. You can observe a specific
room by clicking on it.
Click on room 4034
You’re currently in the
ICU ROOMS View
V i r t u a l
P a t i e n t
O b s e r v a t i o n
14. This is a Live video stream of
room 4034.
Here you see the timeline of
alerts’ activity for the past 6h-
12h-24h and a list of alerts
triggered
Click on to go back
You’re currently in the
ROOM 4034 View
List of Alerts
Timeline Repose: Periods without Alerts
Warning: Periods with Yellow Alerts
Critical: Periods with Red Alerts
V i r t u a l
P a t i e n t
O b s e r v a t i o n
15. A Red alert is about to be
triggered… There’s a risk of
extubation in room 4028
Click on room 4028
You’re currently in the
ICU ROOMS View
V i r t u a l
P a t i e n t
O b s e r v a t i o n
16. This is a Live video stream of
room 4028.
You can observe the patient’s
room with the live stream
video.
Once the patient is attended,
the alert must be solved.
Click on .
You’re currently in the
ROOM 4028 View
V i r t u a l
P a t i e n t
O b s e r v a t i o n
17. Alert is cleared and will be
hidden from this screen.
You can go back to
Main View
Click on to go back.
You’re currently in the
ROOM 4028 View
V i r t u a l
P a t i e n t
O b s e r v a t i o n
18. A Yellow alert is about to be
triggered… The bed has just
been left empty in room 4030
Click on room 4030
You’re currently in the
ICU ROOMS View
V i r t u a l
P a t i e n t
O b s e r v a t i o n
19. This is a Live video stream of
room 4030.
There are 2 alerts registered.
Once the patient is assisted,
the alerts must be solved one
by one.
Click on .
You’re currently in the
ROOM 4030 View
V i r t u a l
P a t i e n t
O b s e r v a t i o n
20. All alerts have been cleared.
You can go back to
Main View
Click on to go back.
You’re currently in the
ROOM 4030 View
V i r t u a l
P a t i e n t
O b s e r v a t i o n
21. Another available view is the
Manual Monitoring
You’re currently in the
ICU ROOMS View
Click on
V i r t u a l
P a t i e n t
O b s e r v a t i o n
22. You can observe up to 4 rooms
with live stream.
To select different rooms, click
on the button
(top right corner of each video stream)
Click on to open the
drop-down menu
You’re currently in the
MANUAL
MONITORING View
23. VPO provides different setup
uptions, such as activating or
deactivating specific alarms for
each patient, enabling sound
alarms, etc.
This can be accessed in the
Configuration Menu
Click on to see the
Configuration Menu.
You’re currently in the
MANUAL
MONITORING View
V i r t u a l
P a t i e n t
O b s e r v a t i o n
24. Thank you!
Now, it’s time to accelerate
Implement Video AI acceleration technologies to
provide real-time & adaptable capabilities, not
feasible so far
Contact NTT Disruption to collaborate
Mateo Hermosín
Manager, NTT Disruption
mateo.hermosin@nttdisruption.com
