Since its beginning, the Performance Advisory Council aims to promote engagement between various experts from around the world, to create relevant, value-added content sharing between members. For Neotys, to strengthen our position as a thought leader in load & performance testing. During this event, 12 participants convened in Chamonix (France) exploring several topics on the minds of today’s performance tester such as DevOps, Shift Left/Right, Test Automation, Blockchain and Artificial Intelligence.

1. Assuring Performance for the
Connected World
Hari Krishnan Ramachandran

2. A day in the life of Lucie
Lucie’s Home
• Smart Appliances and Products
• Amazon Alexa & Google Home
• Smart Home Automation
Lucie’s Fitness
• Smart watch and Wearables
• Embedded Sensors
Lucie’s Car
• Telematics & Tracking Devices
• Connected Cars
Lucie's Farm house
• Precision farming & Connected
drones
• Cattle monitoring and health
checks
Lucie Go Shopping
• Personalized offers and
feedbacks
• Smart Shelves
• Automated Checkouts
Insurance Health Care
Communication
& Tech.
Retail Banking

3. Poor Performance Impact On Lucie’s life
Lucie’s Home
• Smart Appliances and Products
• Amazon Alexa & Google Home
• Smart Home Automation
Lucie’s Fitness
• Smart watch and Wearables
• Embedded Sensors
Lucie’s Car
• Telematics & Tracking
Devices
• Connected Cars
Lucie's Farm house
• Precision farming & Connected drones
• Cattle monitoring and health checks
• Smart greenhouse
Lucie Go Shopping
• Personalized offers and feedbacks
• Smart Shelves
• Automated Checkouts
 Delayed response / alert to the
security systems will result in
theft / security breach
 Slow data transmission leads
to malfunctioning of
appliances
 Poor device performance will
drain battery
 Slower data transmission to
the target systems that do
hourly calculations on health
data will provide invalid
health data
 IoT Platform need to support
huge volume of vehicles
 Inadequate traffic data on
time / slowness leads to
excessive fuel and battery
usage
 Crop monitoring systems
slowness can reduce the crop
health and production
 Insufficient / Slow data
transmission will result in
wastage of natural resources
 Payment failures due to
timeouts and slow systems

 Unable to do competitive
pricing analysis on time
Did You
KNOW
By 2024
?
75
Billion
$6
Trillion
> 400
Zeta
Bytes Per
Year
3X
Increase
in data
traffic
Connected
Devices
Economic
Impact
Data generated
by IoT Devices
In Cloud & Data
centers
44% 38%38% 35%33% 23%
Energy and utilities
Healthcare and pharma
Retail
Manufacturing
Transport and logistics
Automotive
Consumer electronics
THE IOT ADOPTION
42%

4. Internet of things(IoT)
“IoT
is Not a
Technology,
rather it is
an ecosystem for
building
use cases”
Things/Process
(Data)
People
(Value)
Power efficiency
Light Weight
Communication
Huge Data Volume
Seamless User
Experience
Personalized Value
Multiple Touch
points
Cloud/Platform
(Computing)

5. IoT’s Ingrédients
Protocol Communication IoT Platform User Experience
Network
management
Mobile development
Management
Gateway
Data
Collection
Log
Collection
Device
Management
Content
Management
Config
Management
Alert
Notification
Rule
Engine
Data
Analytics
Social
Analytics
3rd Party
Integration
Payment Gateway
Integration
Performance
Management &
Tuning
HMI
Interface
Hybrid Apps
Porting
Subscription
Management
Predictive
Maintenance
Engine
Localization
Ecosystem
Simulation
Cloud
Deployment &
Management
Verification
& Validation

6. Key Challenges & Solutions for Performance
Assurance of IoT systems

7. Protocol Layer
Protocol Layer
Communication
Layer
IoT Platform Layer
User Experience
Layer
Key Challenges
• Diverse platforms, protocols, languages & technologies
• Lack of standardization, complex use cases and ecosystems
• Interoperability
Solutions
 Leverage Industry standard tools/Build custom frameworks
 Intelligent data simulation model
 Create right infrastructure
A leading US based truck manufacturer implementing
telematics solution for Vehicle Diagnostics and Fleet
Management was grappling with the challenge of scaling 10K
Vehicle devices sending UDP packets every 3 secs
Case-In
Point

8. Communication Layer
Protocol Layer
Communication
Layer
IoT Platform Layer
User Experience
Layer
Key Challenges
• Multiple devices connect using different network or medium
like GSM, BLE, WiFi, LAN, ZigBee etc.
• Monitoring of Infrastructure, Gateways, Devices
Solutions
 Network condition emulators to mimic real-word scenario
 Identify tools that support the various data link protocols
A leading pest control service provider implementing IoT
solution to provide proactive pest management service
through unmanned control panels sending consolidated
sensor data to central server communicating through 2G/3G
networks.
Case-In
Point

9. IoT PlatformLayer
Protocol Layer
Communication
Layer
IoT Platform Layer
User Experience
Layer
Key Challenges
• Concurrent devices, Humongous data ingestion and Variety of
device payload
• Scalability of IoT platform
• Integration with Enterprise applications
Solutions
 Monitor/Certify performance of each component
 Automated Test data provisioning
 Integrated Performance & Resilience Testing
Heavy construction , machinery and equipment company
implementing IoT solution for predictive maintenance trying
to scale the solution to 2 Mn Assets with 20Mn messages
Case-In
Point

10. User ExperienceLayer
Protocol Layer
Communication
Layer
IoT Platform Layer
User Experience
Layer
Key Challenges
• Consistent user experience for multi-device implementation
• Context and Personalized services
• High quality data visualization and real time analytics
Solutions
 Client side performance validation on devices and access points
 End to End Automated Performance Testing
A leading mass media, cable and broadcasting company is
launching “Smart Home” initiative trying to provide a seamless
user experience and a scalable IoT solution for 750K
subscribers
Case-In
Point

11. OptimalPerformanceTest StrategyMap for IoT
DEVICE
HARDWARE
DEVICE
SOFTWARE
COMMUNICATIONS CLOUD
PLATFORM
USER
APPLICATIONS
DATA
ANALYTICS
 Device Profiling –
 API Performance and scalability
 End to End Performance Testing
Network
performance
analysis under
varied network
conditions
 Platform scalability assessment
 Resiliency validation
 Database performance analysis
Web app
performance & Cx.
Validation
An optimal performance test strategy assures high performance and faster
time to market

12. Way forwardin testingIoT
Industry 4.0
Edge Computing
5G
Integration with
Emerging technology
 Improved and efficient algorithms
to define the automation process
 Self-optimization and Self-
diagnosis systems
 Intelligent manufacturing systems
 Advanced hardware accelerations
 Reduced data transmission and
Improved Performance
 Improved cloud integration with devices
 Increased data rate will result in
more number of connected devices
 Requirements for servers with
massive load handling capacity
 Integration with Cloud Service
Providers
 Advanced machine learning
techniques for smart management

13. Thank you