2. /
...
> Testing Frameworks and the Computaris Solution
While telecom markets, OSS/BSS systems and media content are continuously converging, technologies evolve and
products become more complex, testing becomes imperative.
Computaris has developed a solution to these challenges: the unique suite of testing tools assists developers, system
integrators and network operators with testing and helps them cope with the ever changing telecom landscape.
The Computaris solution is a comprehensive and versatile suite of testing tools for end-to-end testing, evaluation and
validation of telecom services.
All tools are dressed in a convenient GUI, allowing for the easy creation of test plans and test scenarios.
The test scenarios describe a logical sequence of protocol messages and can be added with a set of validation rules for
assertion-based verification of results. All messages are encoded and decoded according to the protocol scheme of the
system under test.
> What is TOP Testing Suite?
TOP Testing Suite – a Java-based tool that can run on
any platform – is designed around JMeter, a versatile
testing application to load test functional behavior and
measure performance.
A set of additional modular plug-ins are available mak-
ing TOP Testing Suite a unique and most comprehen-
sive testing solution, supporting all major telecom pro-
tocols.
> Application Servers and Systems Under Test
Computaris’ approach to verify, evaluate and validate
application servers and other systems under test is
based on a black box strategy as defined by 3GPP.
Systems under test can be peer servers running any of
the major telecom application protocols: Diameter, RA-
DIUS, CAMEL, CORBA, Web Services, HTTP/S.
LDAP, FTP, Telnet, JMS, SIP, SMPP, JDBC, and
more.
Test plans can be accommodated to the actual produc-
tion environment, for example to simulate patterns of
Diameter traffic like 10% immediate event charging,
20% event charging with unit reservation, and 70%
session-based charging.
To simulate any production environment – in which ap-
plications can run on simple commodity hardware and
on highly complex OSS/BSS infrastructures – TOP
Testing Suite is both horizontally and vertically scala-
ble.
Multiple instances of TOP Testing Suite can run on one
or multiple nodes enabling extensive load and stress
testing.
TOP Testing Suite’s multi-threading feature allows run-
ning multiple tasks to scale up with the hardware in-
stalled base of any telecom system under test.
3. > Use Cases
TOP Testing Suite can assist in simple to most complex
use cases.
In simple configurations, the suite runs as a standalone
application to replace and simulate telecom nodes such
as MSC’s, SCP’s, or billing and charging systems in
order to generate system specific messages and net-
work traffic.
In more complex use cases, TOP Testing Suite provi-
sions data to multiple nodes to test any logical combi-
nation of network elements (including MSCs, SCPs,
Billing and Charging servers, and other back-end data-
base servers), protocols and services.
> JMeter
JMeter is a powerful testing framework designed to
load test functional behavior and measure perfor-
mance.
JMeter provides extensive performance testing capabil-
ities, including: HTTP, FTP, JDBC queries, SOAP,
Web Services, TCP, LDAP, JMS, JUnit, and SMTP.
JMeter can generate load on a server and analyze
overall performance under different load types and load
factors, and produce a graphical analysis of the meas-
ured performance.
> Defining a Test Strategy
TOP Testing Suite offers a service creation environ-
ment enabling users to graphically compose test
plans, and a visualization environment to aid with the
analysis and examination of the measured results.
Test plans can be created by choosing from a wide
range of test elements, and organized as one or more
thread groups each representing a particular test sce-
nario.
The user has complete freedom in creating and orches-
trating test logic by building modular test trees using
TOP Testing Suite’s predefined and preconfigured test
elements.
> Graphical User Interface
TOP Testing Suite is dressed in a convenient graphical
user interface assisting test and application engi-
neers to build test plans to match with the level of com-
plexity of the system under test.
The intuitive GUI is modular and easy to use, and re-
quires no specific protocol knowledge allowing users to
focus on E2E application level test scenarios.
The GUI concept is based on hierarchical test and mes-
sage trees which are composed of XML elements.
Protocols can be easily customized by adding new
messages or message types in the form of XML.
Test scenarios can be extended with assertions for vali-
dation of received messages, logic controllers for add-
ing conditional decision logic to the test plan, and listen-
ers to collect and gather specific data.
Configuration elements allow the easy configuration
and customization of the sampler plug-ins.
Test plans can be run simultaneously or sequentially. In
both cases the generated network traffic is aggregated
and displayed in real-time. By choosing any combina-
tion of specific listeners the data can be displayed in
various formats: in tabular, diagrammatic, or as a hier-
archical message tree which information can be viewed
as plain text, HTML, XML, or JSON formatted data.
/
...
4. > Supported Standards
Diameter-Base standard (RFC 3588),
Diameter Credit Control Applications (RFC4006 / 3GPP TS
32.299), 3GPP TS 03.78 version 7.8.1 (CAMEL phase 2),
3GPP TS 29.078 version 4.8.0 (CAMEL phase 3),
TCAP: ITU-T (White Book) Q.771-774, WSDL v1.1, CORBA
2.3.1 (formal/99-10-07), Telnet Protocol Specification (IETF
RFC 854, May 1983)
> Horizontal and Vertical Scalability
Multiple instances on multiple nodes, supports both
multi-threaded and single threaded environments
> Operating Modes
Single Node Mode, Distributed Mode
> GUI Features
Hierarchical test tree, logic controllers, timers, configuration
elements, pre-/post-processors, samplers, assertions, listen-
ers, Java, BeanShell Scripting, visualization
> Supported Protocols
Diameter, RADIUS, CAP 2/3, CORBA, Telnet, SSH, SOAP/
Web Services, HTTP/S, LDAP, FTP, JMS, SIP, SMPP,
JDBC, NOSQL
> Data Analysis
Sample number, sample time, average, minimum, maximum,
standard deviation, error rate (%), throughput per time unit
(second, minute, hour, kB/sec, number of bytes)
> Supported Java Versions
Java 1.7 or higher
> Additional Plug-ins
Developed on request or as part of the Computaris roadmap
> Supported Platforms
Runs on all Java-enabled platforms
> Testing Types
Functional, revenue assurance, load, performance, stress,
stability, configuration
> Logging and Tracing
File (XML and plain text) based logging and tracing
> Transport and Security Protocols
TCP, SCTP, TLS
/
...
