SITE_6_Release_Highlights.pdf

SITE Release
Highlights
SITE 6

© 2020 Mobileum, Inc. All rights reserved. Contains Confidential and Proprietary Information of Mobileum, Inc.
Commercial
Highlights
1

Automation Framework
▪ Current Features
▪ AF IDE
▪ New High Level Keyword libraries
▪ Selenium keywords on wireless
Interfaces
▪ Running AF Tests on GRP LUs
▪ Roadmap

Current Features for Automation Framework
SITE Module
Robot Libraries
Providing Keywords for
controlling any SITE module
to make use of SITE
(end2end) test interfaces
Community
Robot Libraries
Interaction with external
nodes independent from
Vendor
User-defined
Python Libraries
Allowing users to create
their own low level
keywords for special
purposes
Build any custom testcase incl. KPIs with Keywords in user defined Robot Framework scripts
SITE Special
Robot Libraries
special purposes that are
requested from the market
- Execute any site module
(manual)
- Basic
- CS Calls
- IVR
- SMS
- Basic IP
- All BuiltIn
- Most popular community
libraries
- Selenium
- Restful APIs
- SOAP
- SSH / Telnet
- Pcap Analyzer
- Automate all Wireshark
actions
- Filtering
- Extracting
- Comparing
- Principal freedom and
limitless possibilities for
customers
- Example: Send an email
Running on Automation Unit
Running on
Radio/Core Probes Running on Automation Unit Running on Automation Unit

Automation Framework IDE
• Full IDE available in Shared Files
• Directly edit robot scripts on the fly
• Import & Backup Support
• Easy creation of new Testcases
• Freedom to use IDE of choice
preserved
• Syntax Highlighting*
* Only available in later releases

Extension of SITE RF Libraries
Library Description SiteAutom
VoLTE High Level keywords to support VoLTE 1.1
Audio High level keywords to support Audio 1.1
Common Common high level keywords used in most testcases, especially to bring
devices into idle state, e.g. LocationUpdate
1.0
Base High Level keywords to support basic call tests, e.g. Initiate a CS call 1.0
SMS High Level keywords to support sending and receiving of SMS 1.0
IP High Level keywords to support IP tests, e.g. Activate PDPContext or
perform a Download
1.0
IVR High level keywords to support IVR tests, e.g. Recognize a prompt 1.0

Extension of SITE Special Robot Libraries
Library Description SiteAutom
Email High Level keywords to send emails in an Automation Testcase 1.1
Pcap
Analyzer
High Level keywords to automate nearly all thinkable wireshark gui tasks,
such as filtering, deep diving into a protocol and comparing or extracting
information
1.0

VoLTE High Level Keywords
Easy creation of VoLTE Testcases with new High-Level Keywords
A-Side B-Side
Preamble
Add Sip Context
Act PDP
Prepare VoLTE
VoLTE Register
VoLTE Subscribe
A calls B
VoLTE SendInvite
VoLTE RTP Init
Stop Call
VoLTE RTP Close
VoLTE Send Bye
Deregister
Preamble
Add Sip Context
Act PDP
Prepare VoLTE
VoLTE Register
VoLTE Subscribe
A calls B
VoLTE Rec Invite
VoLTE RTP Init
Stop Call
VoLTE RTP Close
VoLTE Send Bye
Deregister
SITE Module Layer High Level Keywords

Audio – Voice Quality Checks
Full VoLTE_MO_MT including VQ check

Use Selenium keywords with wireless interfaces
• The Selenium Library for Robot Framework enables
users to automate Browsing sessions with simple
keywords
• Until now this was limited to use the browser on the
Automation Unit
• Comfortable alternative to the old “Webtesting”
testcases
1. Bring the phone online
2. Browse to a page
3. Click a link
4. Make a screenshot and
add it to the result files

Extension of AF Online Help and detailed library Description
Improved Description of keywords

Transfer files between Units
Automation Unit
SITE System
Web UI User API Client
Smartphone
Probes
Core Probes
NB-IoT / LTE-M
Network
Application Server
Radio Probes
• Capture a file on an arbitrary unit
• Transfer the file to any other arbitrary unit
• Example:
• Capture a tcpdump on wireless LU
• Transfer the pcap to Automation Unit
• Automation Unit uploads the pcap to a
network internal platform
Available in SITE 6.2

Automation Framework on GRP Units
Create any testcase you want and execute it on a GRP location
Telco Network
Retrieve
Welcome
SMS text
Automation Unit
SITE System
Web UI User API Client
Smartphone
Probes
Core Probes
NB-IoT / LTE-M
Network
Application Server
Radio Probes
GRP
Receive Welcome
SMS and
Compare text
1.
2.

2022
May Jun Jul Aug Sept Oct
2022
SITE 7.0 - May
• Additional Licensing Models with different
Capabilities
• Ability to clone KPIs from existing
testcases to new AF testcases
SITE 7.3 - September
• Integration of Lab Testing Use Cases – ability
to control dsTest comfortably with tailored
testcases including scheduling
SITE 8 and Future
• Controlling Smart Phone Experience phones
via SITE Automation Framework over the
Appium library
• Introduction of RoboShark allowing to
automatically analyze the pcap of any SITE
testcase right after it has been executed
• Workflow Automation – the missing “super
sequence” that allows true control structures
between completely independent testcases with
different resources
Automation Framework Roadmap
Nov

5G Testing
▪ SA Resource Sub-Type
▪ 5G Network Slicing Testing

5G wireless interface for NSA and SA deployments
• With 6.0, testing of 5G SA deployments is supported
• Type of network deployment is selectable as a parameter, “resource
subtype”, in test cases
• New KPIs NR_Band and NR_DL_Bandwidth are available:
• from 6.0 for 5G SA
• from 6.2, together with NR_DL_ARFCN, for 5G NSA
• Support of L3 trace NR_RRC messages is already available in Trace
Analyzer, whereas NR_NAS are available as a part of exported
Wireshark trace (“Download as PCAP” functionality) from 6.0
• 5G SA test case using SIMMUX needs to be configured with additional
Description parameter. With 6.2 this will not be needed.

© 2021 Mobileum, Inc. All rights reserved. Contains Confidential and Proprietary Information of Mobileum, Inc. 16
Network Slicing Concept
• Network Slicing is a fundamental feature of 5G Networks
that leverages virtualization capabilities to create logical
networks with different QoS proprieties based on the
applications / UEs that they serve
• The 5G architecture was built with slicing in mind, thus
network slicing can be performed at the RAN and Core
Network (CN) Part
• Network Slices are uniquely identified by the S-NSSAI
(Single – Network Slice Selection Assistance Information:
• Slice/Service Type (SST) – mandatory 8-bit field that
identifies the slice type (0-255)
• Slice Differentiator (SD) – optional field to differentiate
slices with the same SST – 24 bits
• A UE can include a maximum of 8 S-NSSAI in the NSSAI
list provided to the network
The UE supports maximum 8 slices
simultaneously
Each S-NSSI may be associted to a PLMN
and have network specific values or standard
values

© 2021 Mobileum, Inc. All rights reserved. Contains Confidential and Proprietary Information of Mobileum, Inc. 17
Network Slicing Testing Points and Methods
AMF SMF
AMF SMF
AMF SMF
eMBB Slice
Mission Critical Slice
IoT Slice
Smartphone
Wireless Module
Core Network
Probe
N2/N3 Interfaces
UPF
UPF
UPF
UE Control Plane (NAS / RRC)
Emulated N2 Interface - CP
Emulated N3 Interface - UP
UE User Plane
Smartphone Based Testing
on the NR Uu Air Interface
Wireless Module Based
Testing on the NR Uu Air
Interface
Core Network Emulation of
N2 and N3 Interfaces
S-NSSAI Configuration
SST
SD
NSSAI Configuration in SITE

Network Slicing Testing Methods
EPC
5G Wireless Modules* 5G CN Probe (N2/N3)**
• Testing performed by Automating
5G Smartphones
• Application and Service
Performance can be monitored for
different subscriptions (SIMs)
• Association with Network Slice is
done on the subscription level
• Provides QoE analysis of services
delivered by the Slices that the
Smartphone is connecting to
• Can be used to test both RAN and
CN Slicing
• Testing performed on wireless
modules on the NR Uu Interface
• Full access to Layer 3 NAS and
RRC messages
• NSSAI list and S-NSSAI(s) are
extracted from the L3 traces and
provided as KPIs
• Provides QoS analysis with
correlation to S-NSSAI as KPI
• Can be used to test both RAN and
CN Slicing
• Testing is performed by emulating
the N2/N3 5G CN Interfaces
• NSSAI list and S-NSSAI(s) can be
configured as parameters
• Allows full control of the slice that
the emulated UE connects to
• Can be used to proactively test
and monitor all slices configured in
a 5G network
• Can be used to test CN Slicing
5G Smartphone Experience
**Available in SITE 6.2
*Prototype Available SITE 6.2

Maintenance
Highlights
19

Single Sign ON for SITE and SiC
• Single Sign On will allow users to integrate SITE into 3rd party User Management
Systems
• SAML and OpenID Connect are supported
*Available in SITE 6.2
SITE Web UI SITE / SiC
User Accesses SITE
SSO Request to Identity
Provider
SSO Reply to SITE
User is Logged in

Juniper virtual server for Openstack
• To connect Wireless Local Units into SITE system,
customers need to use Juniper VPN server
• Juniper VPN server can come as a bare metal, or it can
be virtualized
• So far virtual Juniper VPN was deployed on OVA images
and from SITE 6.1 it will be possible to deploy Juniper
virtual server for OpenStack

New module Gemalto PLS83-W as a successor for ME909
Specifications
LTE Cat. 4 (DL 150Mbps, UL 50Mbps), HSPA+ (DL 21Mbps), HSUPA (UL 5.7Mbps), CSFB
Supported frequency bands and variants
FDD-LTE: bands 1, 2, 3, 4, 5, 7, 8, 12, 13, 18, 19, 20, 26, 28, 66
TD-LTE: bands 38, 40, 41
UMTS (WCDMA/FDD): bands 1, 2, 3, 4, 5, 6, 8, 19
Quad Band GSM: 850, 900, 1800, 1900 MHz
4G LTE/UMTS/HSPA+ Uu
Interface
PLS83-W
Supported communication
2G, 3G Voice and Data, CSFB, LTE Data (Cat. 4)
01001
22

Test sequence – new TestcaseEndState “IMS registered”
TEST SEQUENCE – allows execution of multiple test
cases sequentially, using the same resources, within
the same test job, which significantly reduces time of
the tests’ execution.
Options for end state of the test:
• Idle
• Attached
• Activated
• IMS registered*

New IVR test cases
• IVR_PlayAudio_IMS – calling external number using
VoLTE/IMS, sending optional DTMF sequence and
playing audio repeatedly based on “call duration”
parameter
• IVR_AudioDialog* – checks audio in both directions as
an ad-hoc test against an external number. Calling
direction, MO or MT, can be configured via CallType
parameter. Once call is estabilshed, audio file has been
played and afterwards audio will be recorded by module.
It supports GSM, UMTS, PSTN and ISDN (SITE 6.1)
*Available with SITE 6.1

DNS over TLS in SITE
• Existing test case DNS_ps is extended with TLS capability
• DNS_Request can be configured with additional parameters for DNS over TLS:
• standard DNS (DNS_Request)
• secure DNS over TLS, method: Opportunistic
• secure DNS over TLS with DNS hostname verification, method: Out-Of-Band
• secure DNS over TLS with DNS hostname verification and pin: method: Strict
• Available on all interfaces, resource types, SIM capabilities

Smartphone Experience
▪ View SX Results without Login
▪ SX and Wireless Interfaces – Phase 1
▪ Support for Samsung Galaxy S21+,
Galaxy S21 Ultra
▪ Support for iPhone 13, iPhone 13 Pro
▪ Supports iOS 15.1

• Alarms subjects are extended to
provide link to the SX results
• When the link is clicked, it is navigated
to the SX result which caused the alarm
to be triggered
• It is not required to login to SITE WebUI
to view the triggered SX result (like
dashboard)
• It is also possible to navigate to the SX
result tree without login
Available with SITE 6.1
View SX results without login

• Framework for sending and receiving MMS from SX to interface or vice versa
is available
• Multi-sided testing allows users to schedule test scripts using several
interfaces
• Supports up to four sides and it is mandatory to have one Smartphone
Experience device
• Both sides are synchronized which is triggered via SX script and this means
that the execution is done in parallel from that step onwards
• KPIs:
• App Launch Duration
• App Launch Success
• MMS Send to Push Arrival Duration
• MMS Send Duration
• Originator
• Receiver
• MMS Received Success
Available with SITE 6.1
Integration of SX and wireless interface

Samsung Galaxy S21+
Available for Smartphone Experience
*Requires MacOS Big Sur – Remote Upgrade not currently possible
Samsung Galaxy S21 Ultra
Smartphone Experience
iPhone 13*
iPhone 13 Pro*
Support of iOS 15.1

SITE API
▪ Export API Template as JSON
▪ Automatic update of Test Status

Export JSON via API Call* or Web UI**
* API method available with SITE 6.1
** Web UI Context Menu avaliable with SITE 6.2
POST: https://HOST/siteapi/expo
rt-testcase
Request:
{
"path" : "/Test
Folder/SIG_Write_Measurements_P
ASS"
}
• Users can now export test
configurations as JSON files, which
simplifies creating API calls from
existing test definitions
• JSON Export is available with two
methods: API call and as a Web UI
context menu selection

2021
Dec Jan March May June Aug
2022
SITE 6.1 – December
• Export JSON of test
definition via API
SITE 6.2 – March
• Export JSON of test
definition via Web UI
• Automatic Update of Test
Satus
SITE 7.0 – May
• API Method for Creating a
New Test
• Capbility to define maximum
number of orders per user
SITE RESTful API Roadmap
SITE 7.1 – June
• API Method to list Available
Test Parameters

SITE Web UI
▪ Export Trace as PCAP
▪ Save Report as PDF
▪ Improved Context Menu

Trace Analyzer: Export to PCAP
• Up till now, Trace Analyzer offered the possibility
to Export the trace as CSV, PDF or ZIP
• Export the trace as PCAP is now also an option,
so the full trace can be saved and later
inspected with e.g. WireShark
• 5G Layer 3 Traces available via PCAP export
Requires Server Image 3.2

Save Report as PDF
Users can now save an
entire report as PDF, which
allows reports to be easily
shared among teams or
organizations.

Improved Context Menu
The context menu available
in the column browser has
now more actions, enabling
better user experience

Schedule Dialog as pop-up
Schedule dialogue is now a
pop-up for better user
experience

Commercial Maintenance
✓ Single Sign-On
✓ SX and Wireless Interfaces –
Phase 1
✓ New SX Flagship Devices
✓ API Enhancements
✓ Web UI Enhancements
Maintenance
Summary - SITE 6 Release Highlights
✓ Automation Framework –
SITE IDE
✓ Automation Framework – GRP
Access
✓ 5G SA Sub-Type
✓ 5G Network Slicing Testing

THANK YOU

SITE_6_Release_Highlights.pdf

Recommandé

Recommandé

Contenu connexe

Similaire à SITE_6_Release_Highlights.pdf

Similaire à SITE_6_Release_Highlights.pdf (20)

Dernier

Dernier (20)

SITE_6_Release_Highlights.pdf