Preparing for Cyber Monday all boils down to 5 very simple principles:
1. Get everyone to do their part by ensuring they spend at least a few minutes every day testing, monitoring and/or tuning performance
2. Ensure that everyone has the support tools and environments they need to do their part
3. Have everyone give an update on performance at every status meeting
4. Don’t consider any story or iteration to be “done” until performance is tested, characterized, and deemed production worthy
5. Never assume — Test and monitor
2. “
“
While we expect Cyber Monday to drive the most revenue
based on the 3 previous years’ weekend tallies, what wasn’t
expected was that this 8.5 mm+ peak would be the highest
retail traffic peak in history - 13% higher than Thanksgiving
- or that it would drive more volume throughout the day 16% higher than Black Friday.
- Lelah Manz, Akamai
6. 167 million US shoppers made a purchases online on Cyber Monday (53% of the
American population)
2012 Cyber Monday sales were estimated
at $1.5 billion - a 30% increase over 2011
Cyber Monday sales accounted for 2.2 % of
all domestic sales
8. Being known as ‘that company’ – you
know, the one that makes headlines for a
massive site outage instead of record sales
numbers
Losing customers because they have a
bad experience on your site. Worse, they
could end up buying from a competitor.
Your business missing out on a billion+
dollar shopping day
9. Let’s look at it from the consumer’s perspective
I don’t care how many people
are on the site…
I don’t want to wait!
Jupiter Research has shown that
site outages result in 9% of online
customers permanently abandoning
a site and 48% to establish a
relationship with a competitor.
11. Do you have a system in place to
monitor and react to the
impact of traffic in real time?
Can you track and report on web
and mobile
performance?
Do you have a plan to minimize
the damage if things go wrong?
12. We’ve got your back.
We’ve put together our best “avoiding performance
disaster” advice to help your site stand up to the
shopping stampede.
14. Get performance into your
requirements and/or acceptance
criteria (qualitative goals are better
than fabricated numbers).
Test components, stories, etc. as they
are developed.
Monitor and trend key performance
indicators throughout development.
15. Test single and
multi-user scenarios so
you can determine how
your site is performing,
how much traffic it
really can handle, and to
pinpoint bottlenecks that
could cause failure.
16. LoadUIWeb offers performance, stress,
scalability, and load testing of Web
applications.
If your website relies on internal and/or
3rd party APIs, LoadUI will specifically test
those critical dependencies.
For more this subject, check out our
eBook: Test Strategist’s Guide to Load
Testing API Web Apps
17. Test in production-like environments
under production-like conditions,
both anticipated conditions and
less-likely but potentially
disastrous ones.
18. Practice monitoring in prodution-like
environments, under production-like
conditions – AlertSite InSite offers
behind-the-firewall monitoring to
provide visibility into the performance
of internal applications inaccessible via
the public Internet – like those running
within internal dev environments.
19. Test multiple variations of the
expected usage model – and tune for
consistent performance across
variants.
20. Employ intelligent design related to
decision making around client-side
browsers & devices (i.e. if mobile
display site version x, if flash is
disabled display site version y).
21. When acceptable good performance
is achieved under anticipated peak
conditions, strive for consistent and
reliable performance from single user
through stress conditions (far in
excess of expected peak).
22. Build in performance safety features
(i.e. switch to streamlined version of
the site when key performance
indicators exceed x, configure
automatic redirects to an
“emergency overflow site” when key
performance indicators exceed y).
24. Identify “danger values” for key
performance indicators & configure
monitoring alerts in production as an
early warning system AlertSite Performance Threshold
Notifications enable you to define
acceptable performance levels and
receive real-time alerts when a
slowdown or outage occurs.
33. The reality is that it’s
virtually impossible to test for
everything that could happen
in production.
34. Conversely, no matter how
well you monitor your site,
fixing a live issue has a far
greater impact on your
customers than if it never
made it there in the first place.
35. Do them together and your
test results improve your
monitoring efficiency and your
monitoring results improve
your test accuracy.
36. Final
5 tips that will
ensure ultimate
preparedness for
the coming
CyberMonday
traffic
Thoughts
38. 2
If you have
one, it’s a
great time to
review it to
ensure
it’s still
adequate.
39. 3
If you have either
a performance
testing strategy
or a performance
monitoring
strategy, but not
both, champion
implementing
one you’re
missing.
40. 4
If mobile isn’t part
of your
performance
strategy then make
it one - according
to current trends,
you could be
ignoring up to 30%
of your online
holiday shoppers.
41. 5
LoadUIWeb Pro and
AlertSite by
SmartBear offer
comprehensive
solutions for your
respective testing
and monitoring needs
so you can ensure
your site is ready for
Cyber Monday and
high traffic times to
come.
43. Year after year, Black Friday & Cyber
Monday break sales records and exceed
traffic expectations. Successful online
retailers are prepared to handle the
high-volume, because they know their
customers expect a seamless experience.
44. A good example of this is Smartbear client,
ShopBop. Since 99% of their revenue comes from
online transactions, the ability to scale up during
busy season is critical.
45. “With about 1,500,000 hits a day, the traffic
volume to ShopBop can be overwhelming to
say the least. Smartbear provides the support
we need to make sure our Web host and,
therefore our site, can deliver an outstanding
online shopping experience.”