Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Maris V-SoM
1. Video System on Module (VSoM)
Technology Presentation
January 2013
2. The Need for VSoM
HW and BSP SW Development Complexity
&
Variety and Complexity of Video Standards and Interfaces
&
Fast Time-to-Market
Off-the-shelf VSoM
as a
“Short-cut” for video based embedded systems developers
focusing on their application
3. VSoM Definition
Single board based on SoC with memory, interfaces and features with strong
affinity to video technologies required for embedded computer
Lacks standard I/O peripherals connectors
Dense package used in small and specialized applications requiring low power
Standalone board, which breaks the I/O signals out via board-to-board or board-
to-cable connectors
4. VSoM Definition
Used as a carrier to a rich and varied world of video interfaces and other I/O
peripherals via add-on modules or panel mounted standard peripheral
connectors
BSP and Linux/Android OS
Advanced Ultimate Digital Video Platform (“UDVP”) API
9. VSoM - Applications
Home-land security (threat detection intelligent IP cameras)
Law-enforcement & Public-safety (mobile recording and streaming)
Military & Intelligence (low-latency streaming observation systems)
10. Intelligence Observation Network
UAV
Intelligent IP-Camera
Low-Latency Streaming, Recording and Display
UAV Control
over
Mobile Wireless Broadband IP
Special Units
UGV
UVG Control Ground Observation
11. Public-Safety Observation Network
Arial Observation
Street IP-Camera
Low-Latency Streaming, Recording and Display
over
Mobile Wireless Broadband IP
Law Enforcement Public Safety
12. VSoM - Applications
Access control (biometric identification and digital audio/video intercom)
Entertainment (broadcast video wireless distribution)
Extreme sports (mobile recording & streaming)
Robotics (low-latency visual remote control)
Automotive (security and infotainment)
Industrial (visual inspection)
Medical (visual inspection)
16. VSoM Fundamental Requirements
Processing performance modularity (multiple-core processing platforms)
Interfaces variety
Multiple A/V input and output channels
Independent video processing modules
Independent 2/3D graphics accelerators
Low power consumption
Small dimensions
17. VSoM – General Architecture
Main Platforms:
Based on SoC with integrated Codec (MPEG-2, H.264, MJPEG, etc.)
Dual video input/output general purpose parallel ports
Audio input/output
Network (10/100/1000 Ethernet)
Control (RS232/422/485, I2C, SPI, USB)
Storage (SDIO, USB, SATA)
Direction & Orientation (Compass, Accelerometer)
18. VSoM – General Architecture
Add-On Modules:
Camera (video receivers for each standard)
Display (video transmitters for each standard)
External storage devices (SD Card, SSD, USB)
Wi-Fi
Bluetooth
GPS
3/4G mobile
19. VSoM Functionality Requirements
Multiple-channel video and audio capture and display
Position and orientation data capture
Video pre-processing on raw-data (Stabilizer, Scale, Overlay, Picture-in-picture)
Video analytics
20. VSoM Functionality Requirements
Simultaneous multiple-channel encoding, decoding and transcoding
Simultaneous multiple-channel/multiple-media recording and playback
3D stereoscopic display
Position and orientation data capture, stamping and record
Multiple-channel low-latency streaming (Ethernet, Wi-Fi, USB, 3/4G mobile)
21. VSoM – General Functionality Flow
Camera Audio TS Operation
Modules Sensors Source Devices
Video Video & Audio Video TS IR/RF
Pre-Processing Inputs Analytics Input Interfaces
GPS Encoding Direction & DRM Local/Remote
Module Orientation UI
Transcoding
Control
Interfaces
TS Decoding
Generation Bluetooth
Module
Playback
TS TS Low Latency 3D-View
Recording Streaming TS Streaming Generation
Storage Ethernet Wi-Fi Mobile Video & Audio
Interfaces Interface Module Module. Outputs
Storage Display Headphones
Devices Modules Speakers
22. VSoM - Camera Module
HDMI HDMI
Receiver
HD-SDI HD-SDI
Receiver
LVDS De-serializer
Parallel
Camera
Camera Link De-serializer Port
Analog x (1:4) Video
Decoder
Parallel CMOS
Module
MIPI
MIPI
23. VSoM - Display Modules
HDMI
HDMI
Parallel
HDMI HDMI
LVDS De-serializer Transmitter
Parallel
HD-SDI HD-SDI
Parallel LVDS De-serializer Transmitter
or
LVDS
Display Parallel
Analog
Port TV
Encoder
LVDS De-serializer
Parallel
LVDS
MIPI
MIPI
24. VSoM – General Block Diagram
GPS
DDR3 NAND RS232
Micro Module
SD Accel.
Compass
Camera Display
Port Port
Camera Module Display Module
Control Control
TV Out
Audio In Audio Out
MIPI In
SoC HDMI Out
Camera Display
Port Port
Camera Module Display Module
Control Control
RS422 Wi-Fi
SDIO
Module
RS232 Bluetooth
SDIO
Module
PCIe USB OTG GbE USB Host SATA